I am working on a script to do something exactly like this. Here is a background story for Lydia generated on the spot with ChatGPT. There may not be in-game consequences for dialogue, but in terms of fleshing out characters and creating stories unique to your playthrough this is completely possible with today's tech.
It's definitely on my radar. I wanted to start off with xVASynth first as the voice models are readily available / it's free, but I'm hoping to add functionality to switch out different language / voice synthesis models as needed to find the best balance between performance and cost.
This is an early version of a Python script I am working on which lets you talk to Skyrim NPCs using ChatGPT and xVASynth. Once the script is running, NPCs can be loaded by saying "Hello" + NPC name. The relevant voice model for that NPC is then loaded, along with a summary text of their background and any of their previous conversations with the player.
Art_from_the_Machine t1_jee112v wrote
Reply to comment by 3z3ki3l in GPT characters in games by YearZero
I am working on a script to do something exactly like this. Here is a background story for Lydia generated on the spot with ChatGPT. There may not be in-game consequences for dialogue, but in terms of fleshing out characters and creating stories unique to your playthrough this is completely possible with today's tech.