Custom Generation (Of Everything)

[LightOfTheFuture]

Please enable us to use our own models for text generation, image generation and allow the integration of XTTSv2 (or some other locally-run customizable TTS).

I have my own custom model for text generation that I enjoy using. I would prefer to use it, which I have spent time fine-tuning, rather than being forced to use an unmodified model directly downloaded from the hugging-face website.

Also, why does the local image generation for Stable diffusion not offer any options for changing models or integrating LoRAs?

I hope to see these additions in the future! Keep up the good work!

[AI Roguelite: AI-generated RPG]

Thanks. You can use kobold API or oobabooga API for text, and for image gen choose between stable diffusion with "run your own server" checked or the comfyui option. Let me know if you run into issues

[LightOfTheFuture]

Thank you for the quick reply. I am relatively new to this, so please forgive my ignorance.

[Uncertain]

I have a mod up on the Workshop that aims to enable a more advanced, customisable ComfyUI workflow with LoRAs as quickly/easily as possible. It might serve as a good template/guide to implement your own improvements. It's relatively new and has a big "FAST GOOD COMFYUI" icon.

Alternatively, you can also use the Dev Mode options in ComfyUI to export a workflow directly from there in a nearly AIR-compatible form. I haven't tried this, but I think the Dev checkbox in the cog-icon menu enables a special API export button somewhere. The workflow file it creates would still need to be structured into a local mod and hand-edited a bit to become fully AIR-compatible.

(Re. the hand-editing part:) AIR seems to pass internal variables (such as seed, steps, checkpoint) defined in its in-game options to the first 9 or so nodes in the graph, so the file should define those nodes in an order which lets them receive those variables usefully (see \AI Roguelike\ai-roguelite-config\default\model-params\comfyui-prompt-params.txt for AIR's built-in workflow).

[LightOfTheFuture]

Originally posted by Uncertain:

I have a mod up on the Workshop that aims to enable a more advanced, customisable ComfyUI workflow with LoRAs as quickly/easily as possible.

Thank you, I'll check it out!