• 0 posts
  • 3 comments
Joined 2 years ago
Cake day: June 6th, 2024
  • I also recently got into selfhosting LLM. Having an AMD card meant I had to scourge for solutions since everything expects to have CUDA suppport which means having Nvidia cards. Koboldcpp has a fork with ROCM support which works on my machine, so I’m content with that for now.