Pelican xVASynth

xVASynth is an AI voice acting synthesis tool using voices from video games, popularly used to create Skyrim and Fallout mods for custom characters. It uses voice models individually trained on real character voice data to synthesize new voice lines based on that voice data.

This mod makes use of a plugin for xVASynth to provide real-time voice synthesis based on Stardew Valley character dialogue.

Here's some videos showing this mod in action:








Installing

Download xVASynth (this is the Skyrim page for it, but it is game-independent).
Download voices for xVASynth from any of the various xVASynth pages (links on the xVASynth page linked above).
Download the xVASynth real-time TTS plugin in this mod's files tab and install it into the xVASynth resources\app\plugins folder.
Download and install Generic Mod Config Menu mod and install it.

Download and install this mod for SDV.

Setting Voices

Run xVASynth.
Enable the real-time TTS plugin (click the puzzle piece icon to open the plugins window).
Run Stardew Valley.
Open the Generic Mod Config Menu settings for this mod and select voices for NPCs.
Save settings.

Notes

xVASynth must be open in the background to play voices.
There is a short delay as xVASynth creates the voice line - this might improve in the future.
Playback may not always occur as expected, there are still some kinks in the process to be worked out.
If you have lots of voices, GMCM only shows five in the drop down menu - I had to hold down the mouse button while using the scroll wheel to change voices.

Credits

Thanks to DanRuta for creating xVASynth, and whoever else works on that project.
The developers of SDV and SMAPI.
The voice actors whose voices are synthesized by xVASynth.

Technical

Requires SDV 1.5.5+

Requires SMAPI, uses Harmony.

Compatible with Mod Updater for automatic updates.

Code is at https://github.com/aedenthorn/StardewValleyMods.

If you want to complain or ask for help or help me test my mods, you can visit my Discord server.

A list of all my mods for Stardew Valley is available at https://www.nexusmods.com/stardewvalley/articles/895.