Man, like it’s good the Liquid Glass guy left because holy crap what a steaming pile of terrible UX, but dang do they need to fix this stuff.

Also stop overly rounding corners. It’s stupid and gives me less space to interact with the content I actually want. Like skeuomorphic design was better than this by a lot, if a little “dated” looking.

I’ll look into this, but at first blush this is just mostly tool calling with RAG. This does not prevent a whole host of issues with AI, and doesn’t really prevent lying. The general premise here is to put tight guard rails on how it can interact with data, and in some cases entirely forcing a function / tool path with macros. I am not really sure this would work any better than just a stateful and traditional search algorithm on your own data sources, and would require much less hardware / battery / requirements and would be much more portable.

I like the effort, but this feels a bit like trying to make everything look like a nail.

I think it’s okay, I made a comment about the license first! It’s good discussion. I certainly like everything being copyleft, but I also get why people who make a contribution (an extension or otherwise) might want to license it differently. Ultimately whoever does the work gets to decide on the license — closed source I’ll never touch, extension or otherwise, but I’m lenient on open source.

Oh I’m fine with copyleft, even preferred. I just see any open source license, even MIT, and am pleased. Perhaps my bar is too low, but at this point anyone posting anything with open source protection to the creation is cool to me.

Hey some folks responded here which is great! For me, I think wiki and tracker are perfect like someone else mentioned, because a lot of folks without accounts can still access the knowledge created. The hard part is moderating of course. I’m not sure there is a perfect solution.

Ultimately, you’re producing something cool for the community and you get to set the terms for that; if discord is easy and sustainable, I prefer that to you doing anything else that isn’t sustainable to see the project through as long and vibrantly as you can. So in that sense just choose what makes sense.

So in short: do what makes sense for you and if one of the alternatives listed (maybe wiki it seems? That would be cool with me) works then that’s great!

I guess I’ll also plug forgejo or codeberg at this time haha

Edit: I’ll also say, more folks here for discussion is cool too, and good to have you posting and hope to see more discussion around it in the future here!

MIT license, cool! I’ll check this out. Any chance to migrate from discord to a more open platform for community engagement?

Oh interesting. I’ll give gdm a try and see if that gives any joy. Thanks for this tip, will return tomorrow with update on this particular change

Update: alas, no dice for this change.

Yeah, I think I’ll go with proxmox as a first attempt — it seems to fit what I’m looking for and the feedback here has been pretty positive on that front. My main concern now is figuring out how to provision the hdds so that a jellyfin lxc can utilize it, nextcloud could use it, and I can save (configuration) backups to it. I’m comfortable with zfs in general (run that on my desktop), but I was under the impression that raid10 would be more performant with the same redundancy, when using 4 disks in raid10. Any one disk could fail, writes are at the speed of the disk because of mirror, and reads are 2x. I lose usable disk space, but I think 16tb is enough for me (for now of course haha). Am I wrong though on the zfs vs raid10? I guess actually I could use zfs, create a single pool with two mirrored vdevs. I am not sure how that would affect future growth, but should do really well for now. Does that sound like a reasonable thing to do, in your opinion?

Amazing, thank you! I think I’m gonna have to be okay with not nailing it on the first go and trialing it out the next few days. Step one sounds like proxmox to me :)

Hey, thanks so much for the response, this is great! Love the idea of offloading ai workloads to their on vms to make facilitating managing resources easier.

Also, big thanks for the recommended software — very helpful list for me to look through, especially on the AI front. Do you have any notes on configuration for those in particular?

Thanks for the reply!

My understanding was that with only 4 drives, raidz would lower read throughput and not add much space / redundancy. Is that not true? Would you mind giving me a few more details on how you’d set up a 4x8tb raidz array (or could point me to a tool / resource that could help me? I haven’t been able to fully convince myself either way)

You can, of course, feel free to show us how you’d implement this in python. It’s fine to say you would do it differently, but don’t stop there, show how/what you would do differently. Add to the discussion, like the person you were replying to did, don’t detract.

Bookmarked and will come back to this. One thing that may be if interest to add is for AMD cards with 20gb of ram. I’d suppose that it would be Qwen 2.5 34B with maybe less strict quant or something.

Also, it may be interesting to look at the AllenAI molmo related models. I’m kind of planning to do this myself but haven’t had time as yet.

While this is true, I also kind of doubt that Reddit isn’t just one mistake away from accidentally deleting an old db and losing the historical data. So it may in fact mess up their ability to sell the data.

Also potential GDPR violations etc if you’re in the EU