Deliverer of ideas for a living. Believer in internet autonomy, dignity. I upkeep instances of FOSS platforms like this for the masses. Previously on Twitter under the same handle. I do software things, but also I don’t.

  • 0 posts
  • 8 comments
Joined 3 years ago
Cake day: June 5th, 2023
  • Hello! I recently deployed GPUStack, a self-hosted GPU resource manager.

    It helps you deploy AI models across clusters of GPUs, regardless of network or device. Got a Mac? It can toss a model on there and route it into an interface. Got a VM on a sever somewhere? Same. How about your home PC, with that beefy gaming GPU? No prob. GPUStack is great at scaling what you have on hand, without having to deploy a bunch of independent instances of ollama, llama.ccp, etc.

    I use it to route pre-run LLMs into Open WebUI, another self-hosted interface for AI interactions, via the OpenAI API that both GPUStack and Open WebUI support!

  • What’s your hypervisor manager? Or are you just bare metal?

    For VMWare and Proxmox both, I would recommend the community edition of Veeam. It can handle up to 10 VMs for free.

    If you’ve got the funds as a small-to-large business, Veeam’s first paid tier, on a yearly basis, is a solid option to backup even more.

    Caveat emptor if you buy a license (or not): Veeam runs on Windows only. I have used, like, a single internal network Windows VM dedicated just to Veeam before. It has an easy to pick up UX after a little research, and the UI is clean.

    Bacula is deprecated, unfortunately.

  • There’s a handful of approaches that may be helpful for this. I don’t want to make any assumptions on what you’ve tried, yet, though. Would you mind clarifying what you’ve given a go at, so that we don’t offer something that doesn’t do what you’re looking for?

  • If you have access to any kind of UX and UI folks, you automagicallly get a leg up on this, y’all. It is goddamn amazing.

    Single dev on a personal project? Go find someone in the community who has an eye for design or hit up a design forum. Work has you on a project with only two other devs and limited resources? Ask for a favor from the UX team down the hall.

    We are all tryna make good experiences out here. Let us avoid getting ‘teabagged.’