Fallout 4

Fallout 4

View Stats:
This topic has been locked
Regarding AI Voiced mods.
Sorry if this has been asked before, but in recent months I've been seeing stuff on YouTube about how different characters got completely new voice lines using the recent AI Vocalization technology, where the AI studies the speech sounds and creates brand new voice lines based on the given speech sounds. With this technology available, has anyone made or is in the process of making a mod that offers a lot of new voice lines to the major companions in Fallout 4?
< >
Showing 1-15 of 21 comments
Zekiran Sep 10, 2023 @ 3:52pm 
It's going to be very very touchy once laws start getting enacted, s.

If you'd search on nexus you will find them.

I do not recommend them. The voice lines are collected and trained from people and companies who have *not* given their express permission to do so. Most companies already do forbid actors from doing dialog of their characters for fan based products, and this is part of the ongoing strike which the voice actors guild has also recently joined.

If you want voices, hire an actor.
Twelvefield Sep 10, 2023 @ 5:06pm 
100% agree! There's a whole system around taking somebody else's work and then shoehorning it into some mod or unauthorized add-on. It's so commonplace we all do it, and it's also piracy, but now AI makes that even easier. Instead of stealing a single work in its entirety, it can steal a million pieces from works and assemble them into something that none of the original creators had intended.

Real people are being replaced by AI models. This means these folks don't get new work, they don't get money, and it's harder to compete for what's left. We will see what happens at the end of this strike, the consequences will be enormous for the entire entertainment industry, perhaps worldwide. Anybody who has respect for artists should avoid distributing AI work until this is resolved.
Originally posted by Twelvefield:
100% agree! There's a whole system around taking somebody else's work and then shoehorning it into some mod or unauthorized add-on. It's so commonplace we all do it, and it's also piracy, but now AI makes that even easier. Instead of stealing a single work in its entirety, it can steal a million pieces from works and assemble them into something that none of the original creators had intended.

Real people are being replaced by AI models. This means these folks don't get new work, they don't get money, and it's harder to compete for what's left. We will see what happens at the end of this strike, the consequences will be enormous for the entire entertainment industry, perhaps worldwide. Anybody who has respect for artists should avoid distributing AI work until this is resolved.

While I understand the sentiment, it is technically worth noting that modders use prexisting art assets all the time as well as remix pieces of fallout 4 art to create new assets. So using voice lines to create new ones really isn't all that different. However training AI on existing voices is not necessary. There is software out there that lets people use and alter voice lines from actual real paid voice actors in their software. All legal and ethical. The thing though is. If Bethesda allows us to mod everything they is available in the creation kit, I don't really see how this would be any different for voice lines unless they explicitly stated otherwise. Because all the voice lines the voice actors use are available in the creation kit.
Last edited by Sea Prince Gillywix; Sep 10, 2023 @ 7:43pm
Zekiran Sep 10, 2023 @ 11:30pm 
Because they have been given express permission to use in-game assets for in-game mods. And that IS okay. That's part of 'using the kit'. Like using Hammer or SFM to make movies using Valve's characters and games.

However, most times people are talking about "using AI to make new things" they are NOT, in fact, talking about using existing in-game lines and remixing them. Hell I could do THAT. It's basic youtube poop level.

But they ARE often enough using voices tapped from other sources. Other games, characters in movies, etc. Some of the best AI voice training I've heard used Gaben's voice *so convincingly* even the people who DID that (the Alyx Gnome series by Wayneradiotv) said *straight up* - do not do this, it will get you in trouble some day, and count the months before this technology is heavily regulated. Whether it WILL be heavily regulated who knows. But it's *not* ethical to use ANY AI that you yourself didn't plug your own voice into, without the express permission of the company who owns the character, the game, etc.

A case in point: Garry's Mod mods for, say, dragging Aliens Isolation models or Batman game assets *are not legal*. it's not even a grey area, nor is it ethical. You sign a contract (however enforceable it might or might not be) to not do that very thing when you download and play a game. If the owners of the franchises put a stop to it, that's that. Just because they haven't, or have not noticed, doesn't mean it's free and clear.

This is why the console version of Fallout 4 cannot allow certain mods. and why sites like Nexus exist, to facilitate those less-than-proper things in a setting where they do not have to negotiate with major companies about legalities of using other people's stuff without their permission.

(full disclosure, I love garrys mod and have plentiful bits from a huge variety of games that I do not own in it, but I always live in the anxious state of 'some day, they will get sued to high heaven for selling this product and encouraging people to decompile our software which is expressly forbidden by clicking play and accepting the eula)
Seraph Jun 17, 2024 @ 12:42pm 
Hey man, if you can find me a VA who will stay on standby recording new unique lines every time I boot up for $0, I'll take it. In the meantime, I'm a modder, not a lawyer.
PeaceMaker Jun 17, 2024 @ 12:58pm 
I have an AI program and downloaded Curie voice samples into it, so it mimics exactly how she talks. I also trained it to have the exact personality of the Follower too.

It's like listening to an extended Curie talking to me in real time!

Creepy and kinda cool.
id795078477 Jun 17, 2024 @ 1:45pm 
Originally posted by PeaceMaker:
I have an AI program and downloaded Curie voice samples into it, so it mimics exactly how she talks. I also trained it to have the exact personality of the Follower too.

It's like listening to an extended Curie talking to me in real time!

Creepy and kinda cool.

XVASynth (that's probably your "AI program") isn't one of those fancy multi-modal LLMs. And so long as you use it locally and do not distribute - you neither break ToS of some AI corp (which would love to have all the queries controlled) nor any copyright of any voice actors or their employers. So go for it.

To be honest, I think the "strikes" and whatever other things people will try to come up with to hinder AI voice coverage will not do a jot to stifle this thing. Because the most common use-case is to "just have human voice over it", not a "voice of a certain person". And to that extent - there are already public free sounds and voices available to use on any LLMs you can think of.

So ultimately yes, that means certain roles of voice acting will be automated more and more and it will probably be a "part of luxury craftsmanship" at the end. Even today there are people who still smelt steel, make swords of it by hand and sell it. But those are - first - the very best of the best in their field, and - second - they don't do it en-masse, those are "prizes of art". Same will be with many of the jobs that will be automated by AI. Still remain in some capacity, but only the best of the best will be able to do it and only in small quantities as a sign of luxury.
Last edited by id795078477; Jun 17, 2024 @ 1:47pm
Langkard Jun 17, 2024 @ 4:04pm 
Legislation is almost certain when it comes to multi-modal LLM AI's using any source at will. AI companies have been reticent at best about tracking the sources from which their AI programs get their content. It will likely happen in Europe first, but the USA has some fairly strict copyright and trademark protections. And that could be the reason AI companies are reluctant and/or unable to track the sources. Much of it comes right off the internet without regard to whether or not the original is copyrighted/trademarked and without any regard for the people who make their living as voice actors.
Last edited by Langkard; Jun 17, 2024 @ 4:05pm
sdack Jun 17, 2024 @ 4:16pm 
A discussion on AI and copyright was not what the OP was asking. Let those affected speak for themselves - they probably do not need anyone to speak for them than they need AI speaking for them - and let modders do their thing.
Zekiran Jun 17, 2024 @ 5:00pm 
Originally posted by sdack:
A discussion on AI and copyright was not what the OP was asking. Let those affected speak for themselves - they probably do not need anyone to speak for them than they need AI speaking for them - and let modders do their thing.


So, "steal voice actors work without fair and just compensation".

Yeah, that's not legal, so no. That's not what will happen. "Letting modders do their thing" you realize that there are thousands of potential voice actors just sitting right here on the steam forum? Some might work for the joy of just doing it, others might volunteer or ask for modest compensation.

Voice Acting is a real thing that real people do.

AI is THEFT.
Jason Jun 17, 2024 @ 5:21pm 
Originally posted by Zekiran:
Originally posted by sdack:
A discussion on AI and copyright was not what the OP was asking. Let those affected speak for themselves - they probably do not need anyone to speak for them than they need AI speaking for them - and let modders do their thing.


So, "steal voice actors work without fair and just compensation".

Yeah, that's not legal, so no. That's not what will happen. "Letting modders do their thing" you realize that there are thousands of potential voice actors just sitting right here on the steam forum? Some might work for the joy of just doing it, others might volunteer or ask for modest compensation.

Voice Acting is a real thing that real people do.

AI is THEFT.
lol, lmao even. again, OP is asking about re-voiced companions not your philosophical view on how voice actors get compensated. cringe af.

for op https://www.nexusmods.com/fallout4/mods/49340 but you might have to do some work to get what you want.
sdack Jun 17, 2024 @ 6:02pm 
Originally posted by Zekiran:
So, "steal voice actors work without fair and just compensation".

Yeah, that's not legal, so no. That's not what will happen. "Letting modders do their thing" you realize that there are thousands of potential voice actors just sitting right here on the steam forum? Some might work for the joy of just doing it, others might volunteer or ask for modest compensation.

Voice Acting is a real thing that real people do.

AI is THEFT.
Cry me a river. The law applies to people and not to AIs. It is no different from guns. AI is a tool and only how we use it matters. You are just making yourself into a fruit basket like those who say "GUNS are MURDER" when your point is that "AI is THEFT".

If a mod author creates mods using AI then it is no different from someone copying a superhero costume for cosplay. You then do not see Marvel going around and suing every cosplayer at every convention for having copied one of their costumes. It is just fans showing their affection for the things they love and we let them and not sue them. As long as a mod author does not take money for their mods is there no imminent problem. If a voice actor disagrees with a particular mod will they have their reasons and have to take the person to court. They do not need some kid on the Internet to spasm over misdirected feelings of injustice. Rethink your next comments.
Last edited by sdack; Jun 17, 2024 @ 6:05pm
Zekiran Jun 17, 2024 @ 6:09pm 
It absolutely is not.

Talk to Elias Toufexas (adam jensen, among other roles) about how he as a voice and live actor feels about AI.

he is representative of the entire voice union. You need to remember that AI is trained on stolen, unauthorized voice clips.
sdack Jun 17, 2024 @ 6:14pm 
... And we also shall leave Britney alone, right?
id795078477 Jun 18, 2024 @ 1:07am 
Originally posted by Zekiran:
It absolutely is not.

Talk to Elias Toufexas (adam jensen, among other roles) about how he as a voice and live actor feels about AI.

he is representative of the entire voice union. You need to remember that AI is trained on stolen, unauthorized voice clips.
Listening only to someone who stands to lose from advancement in said technology is never a good idea. Not saying AI corps or users should freely disregard IP or consent from voice actors, but the recordings of paid voice actors aren't the only human speech available that was ever recorded. Many people don't care and will give explicit consent to AI corps even if asked. Many recordings happen in places where you must give explicit consent to use the services (like CuCa, etc).

Wake up. The tech will find its way. If voice actors unions are resisting it - so be it, but they don't have the power to control all voice recording that ever happens. Nor should they. If there's tech to do it and someone wants to use a VO of people who made their voice a public domain - there should not be any hurdles or obstacles to it.
< >
Showing 1-15 of 21 comments
Per page: 1530 50

Date Posted: Sep 10, 2023 @ 3:34pm
Posts: 21