Whats the deal with the 13gb model?

[karlkablisk]

I don't know how many people have had the chance to test it. But its completely insane. Different from the 125 model but that is the closest comparison.

Why would the "top" AI model and the lowest one be so similar?
I am thinking maybe this AI model isn't aligned the same way the middle ones are, the 6gb and 4gb.

Example:
Item
Blue Cusion
picture was of a woman
Desc: A soft Blue Throw Pillowcase."What?"you ask as Huntress finishes describing what she found once again unfolds itself from underneath her bedskirt."That's all there seems to be,"she says"."

It always does this too. It like put in weird dialogue for people, place and item descriptions. Sometimes theres <ad deleted> so theres ads in there that were autoblocked?

I think its doing normal prompts inside the npc, location, item and enemies areas. Thats what makes me think its not aligned with the game correctly.

Or is it just a bad model? I really want to know, the hardest model to get working and most demanding shouldn't be like this I would think.

The other thing it could be are the smaller settings. I know in other AI games if I tweaked the parameters of randomness etc even just a little bit I got complete garbage text. So maybe thats whats happening here? Maybe this model just needs more testing?

Doing some testing and it kept trying to send me to random locations for no reason. I was on a stage, and it was like "Go to the wild west?", "go to the dormitories?" for really unprompted normal text entries. and the locations made no sense. The dialogue too, its really unplayable not wacky like the 125 model.

The 6gb and 4gb models on the other hand works so well with logical descriptions for items etc. So thats why it strikes me as so strange.

[Spuz]

I too found the 13GB model to be pretty much unplayable. It just failed in every way.

[AI Roguelite: AI-generated RPG]

I *might* know what the issue is; can I have the exact name of the model you're trying to use? Is it under https://huggingface.co/KoboldAI ?

[Xom]

Surely he means the one that's one of the default dropdown choices? Comparing the dropdown labels with the KoboldAI models, I think they are:
https://huggingface.co/KoboldAI/GPT-Neo-125M-AID?text=%3E+You+wake+up.
https://huggingface.co/KoboldAI/GPT-Neo-1.3B-Adventure?text=%3E+You+wake+up.
https://huggingface.co/KoboldAI/GPT-Neo-2.7B-AID?text=%3E+You+wake+up.
https://huggingface.co/KoboldAI/GPT-J-6B-Adventure?text=%3E+You+wake+up.

[Xom]

It was annoying to locate all of the descriptions of those four models, so here:

https://huggingface.co/KoboldAI/GPT-Neo-125M-AID?text=%3E+You+wake+up.
This model was finetuned by Henk717 on Google Colab, it contains text adventure tuning and its the smallest 'Adventure' model of its size. Because of its limited size the behavior is mostly suitable for testing text adventure gamemodes at fast speeds, for a coherent adventure you are better off using one of the 2.7B models.

https://huggingface.co/KoboldAI/GPT-Neo-1.3B-Adventure?text=%3E+You+wake+up.
(This model was finetuned by VE_FORBRYDERNE.)
The training data is a direct copy of the "cys" dataset by VE, a CYOA-based dataset.

https://huggingface.co/KoboldAI/GPT-Neo-2.7B-AID?text=%3E+You+wake+up.
(This model was finetuned by melastacho.)
Also know as Adventure 2.7B this is a clone of the AI Dungeon Classic model and is best known for the epic wackey adventures that AI Dungeon Classic players love.

https://huggingface.co/KoboldAI/GPT-J-6B-Adventure?text=%3E+You+wake+up.
(This model was finetuned by VE_FORBRYDERNE.)
Adventure is a 6B model designed to mimick the behavior of AI Dungeon. It is exclusively for Adventure Mode and can take you on the epic and wackey adventures that AI Dungeon players love. It also features the many tropes of AI Dungeon as it has been trained on very similar data. It must be used in second person (You).

[AI Roguelite: AI-generated RPG]

Ohh I got 13Gb (which I guess is the 6B) confused with 13B. Has it always been broken or does anyone remember a time when it worked fine in the game?

[Mister Soggybottoms]

Well I just got the game and it's broken for me

[karlkablisk]

Thanks for the help XOM.

Sorry I wasn't clear I would only talk about the models in the game by default, I know anything custom is up in the air if it will work well. Thats right the 6B model.

Its always been broken Its one of the first AI models I've used, I mention a bit in my custom AI and AI review thread I made with some more info on it.

To be clear:
KoboldAI/GPT-J-6-Adventure (~13GB VRAM)
Is the highest option but its never stable in a different way from the 125M model
It seems strange to use all that power and VRAM for a worse result so I was thinking something is wrong with the calibration or its just messed up with all the info in it.

As XOM posted in the description it mimics AI dungeon and I know in that if you get some parameters a little off it gets unusable. So maybe it can't work with the same settings as the other models? Its probably not tested often as its a little hard to get working. But since the 6gb version has been on and off in quality for me I have started to wonder about a stronger model again.

I can do a few turns in it and provide a log, you can see some of how weird it is. I'll do that soon.

[Mister Soggybottoms]

I can do that, too. I was looking forward to being able to run something like that with my newly acquired 24gb of vram! If it will help i can run it for a bit and link a logfile.

[Mister Soggybottoms]

hmm i just tried, do you have to do something other than copy and paste from the tilde screen? that seemed to only have a small amount of the game data. Is the log saved somewhere else?

[karlkablisk]

Thanks Mister Soggybottoms, I appreciate it. Your help would allow a chance for this AI model to actually become usable.

If you play a bit and then do the ~ and press the copy button, it should copy almost everything including items and npc descriptions. So go through a few turns till you see a few weird things happen. Then copy it.

When I copied the text, it was so long I had to put it into https://pastebin.com/
because the text was longer than steam discussion forums allow.

[Mister Soggybottoms]

pastebin says it contains inappropriate content lol well here's a log file then https://github.com/Revpancake/Revsnonsense/blob/main/logfileai6b.txt

[karlkablisk]

Thanks for the post, strange about pastebin

Please note what about this model strikes you as odd compared to the other models. I mentioned how I got weird text.

As for you Mister Soggybottoms I hope you are playing the game on 6gb model in the meantime when you want to have a smooth experience.

[AI Roguelite: AI-generated RPG]

After some testing I figured maybe the GPT-J and more advanced models use a different calculation when it comes to repetition_penalty and are a lot more sensitive to this value, so I included some logic to make sure it's low when calling GPT-J. I've updated the game with a maybe-fix. Please try the GPT-J-6B model again if you have time, and post the debugging log again if it's still weird

[karlkablisk]

Thanks so much! I feel so glad to be part of what might make the strongest available AI become viable. I'll post my findings sometime soon. Is this normal update or beta?

[AI Roguelite: AI-generated RPG]

Thanks! It is currently in both "beta" and "default"