I’ve never personally had issues with 8x7b refusing requests, but I guess I haven’t really plumbed the depths on what it might agree or disagree to, I have run it through the ordinary gambit (pretend to be public figure x, make dangerous item y, say untrue thing about company z) and it hasn’t given me any problems but sure whatever works for you
- 0 Posts
- 10 Comments
Actually not 100% true, you can offload a portion of the model into ram to save VRAM to save money on a crazy gpu and still run a decent model, it just takes a bit longer. I personally can wait a minute for a detailed answer instead of needing it in 5 seconds but of course YMMV
I wouldn’t say it’s easy to get started…
You have to know about open source AI models, then you have to know what fine tuning is, then you have to know where to go to get software that runs the models, and then finally you need to know what models are compatible with both AMD and Nvidia graphics cards.
There’s plenty of open source models that don’t really have any restrictions, you just have to host them yourself (which you can do on your own computer if you have a decent gpu)
for example: mixtral 8x7b
just use koboldcpp or something similar to run the GGUF files and you’re good
Huh, I wonder what OP is using…
Don’t use fucking linux mint for playing video games, are you guys insane or just bots?
let’s go over some cons of linux mint again for the unitiated
-ancient packages -installing a separate ppa for graphics drivers that BRICKS YOUR SYSTEM if you don’t remove it before every update and then reinstall it -completely garbage dpkg based package manager that makes everything harder than it needs to be
just use nobara, endeavor, fedora, or arch if you’re feeling daring. I swear I see at least one person recommending mint to beginners for every one of these posts even though the distro is complete trash
ah yes, the millionth person recommending mint as a beginner distro because they used it 10 years ago, ignoring the fact that it completely bricks your system if you DON’T REMOVE AND REINSTALL YOUR GRAPHICS DRIVERS WITH EVERY UPDATE
use something with a sane and easy to use package manager that just works like nobara, fedora, endeavor, literally anything else



I hate jeeps as much as the next guy but glass transmission subarus being at the top of the list for reliability, as well as the fact that the rating is based off of “user predicted reliability” tells me everything I need to know about this list