Store Page
RimWorld
All Discussions Screenshots Artwork Broadcasts Videos Workshop News Guides Reviews

RimWorld

Store Page
RimWorld >  Workshop > Gerik Uylerk's Workshop > EchoColony > Discussions
EchoColony
Description Discussions30 Comments469 Change Notes
Lone_Explorer Nov 9 @ 10:51am
LLM Recommendations
I'm looking to set up my own LLM to run with mod. I'm looking for advice of what model I should use, if I should use Kobold, LMStudio, or Ollama, and what configurations people use for the model, mod, and personality settings. What do folks use and how well does it run?
< >
Showing 1-2 of 2 comments
Auster Nov 20 @ 9:10am 
I use LM Studio. Mod author pinned up my thread:

https://steamcommunity.com/workshop/filedetails/discussion/3463505750/600777519165089587/

Currently I use bartowski/neuraldaredevil-8b-abliterated. It is 8.5 gb. If that one is too large then I have also used neuraldaredevil-8b-abliterated@q5_k_m 5.7 gb.

Please be warned when you use LM Studio with Rimworld running, the game's ram usage will go up alot. If your game runs around 5 gb with mods it might go up to 10+ gigs fyi.
#1
Lone_Explorer Nov 21 @ 4:15pm 
Cool! Got it all set up. Any recommendations for the prompt and LM settings? From my testing, I often get responses that are several paragraphs long.
#2
< >
Showing 1-2 of 2 comments
Per page: 1530 50