Great American humorist. C# developer. Open source enthusiast.

XMPP: wagesj45@chat.thebreadsticks.com
Mastodon: wagesj45@mastodon.jordanwages.com
Blog: jordanwages.com

  • 0 posts
  • 18 comments
Joined 3 years ago
Cake day: June 12th, 2023
  • This is important. I dunno about scale, but backups. I started out hosting a chat room on a raspberry pi. It was a fun side project. But then, that became where my friends all hung out. That was the place, so it became important to me. And then the SD card got corrupted. I then moved on to a consumer laptop. It was way more stable, much faster. But if I messed up anything about the installation, I was hosed.

    I very highly suggest using Proxmox, like you say, and setting up automatic backups. And occasionally transfer them to a hard drive. It doesn’t matter what kind of virtual CPUs or services you install, gedaliyah@lemmy.world, as long as you have a plan for when something you host becomes important to you and you lose it.

  • I think a lot of people in this thread are just upset/projecting because this is the first real hint that they’re not as much of a special-boy-programmer as they think. OP’s use case is fairly limited in scope, using the LLM for something it is actually pretty good for, and never implied he doesn’t check the output. They’ll never admit it, and will deflect, but they’re just worried.

  • Posters aren’t saying that its impossible to put search results through an LLM and ask it to cite the source it reads. They’re saying that the neural networks, as used today in LLMs, do not store token attribution in the vocabulary or per node. You can implement a system for the neural network to work in that provides it the proper input (search results) and prodding (a prompt that encourages the network to biasing toward citation), not that the single LLM can conceptualize of that on its own.