Epic Launch AI Voice NPCs via Gemini & ElevenLabs in Fortnite UEFN

Remember that AI-powered Darth Vader tech demo that recently pushed SAG-AFTRA to file an unfair labor practice charge against Epic Games? Well, we finally know what all that testing was building toward. With the release of the v40.20 update on April 16, 2026, Epic Games has fundamentally changed how players interact with characters inside Fortnite. They just rolled out an experimental feature for the Unreal Editor for Fortnite (UEFN) called "Conversations." Originally teased as the "Persona device," this system completely ditches old-school dialogue trees. Instead, it lets you walk straight up to an NPC and talk to them in real-time using your own microphone.

Under the hood, Epic has teamed up with some heavy hitters to pull this off. As wccftech claimed, the studio is using Google's Gemini 3.1 Flash-Lite model to act as the "brain" for these characters. It handles all the logic and text generation, processing what you say and figuring out how the NPC should react. From there, ElevenLabs steps in to take that text and turn it into realistic, emotive spoken audio. The crazy part is how simple it is for island creators to set up. 

Developers don't need to write endless branching storylines; they can define a character's entire personality, knowledge base, and voice tone using as few as twenty lines of basic prompt text. Right now, because the feature is in an experimental testing phase, Epic is actually footing the bill for both the Gemini and ElevenLabs operational costs.

Beyond Chatting: Dynamic Gameplay Integration

But these NPCs aren't just fancy chatboxes. According to Epic, the Conversations system allows characters to actually remember things you've done during your play session and influence the game itself. Through UEFN's Scene Graph component and Verse API, an AI's unscripted decisions can tie directly into gameplay. You could literally use your microphone to sweet-talk an AI guard into opening a restricted gate. Depending on what you say and do, these characters can trigger in-game events, act as adaptive narrators, or even tweak the game's difficulty on the fly based on how well you're playing.

Because you can't entirely predict what generative AI is going to say, Epic has laid down some serious ground rules to keep Fortnite family-friendly. They've updated the Developer Rules with a new clause, Rule 1.22, which strictly bans creators from making NPCs that give out medical or mental health advice. They also completely shut the door on virtual romance. You are not allowed to create a persona that simulates a date or intimate partner, as per wccftech.

Anyone caught trying to bypass or jailbreak Epic's safety filters will face heavy enforcement actions, up to a permanent account ban. If you're worried about privacy while talking to these bots, Epic has explicitly confirmed that they do not store any player audio.

What's Next for UEFN Creators

While Conversations is still experimental, you won't be seeing these AI characters in your regular Battle Royale lobbies anytime soon. Creators are currently restricted to playing with the tech in UEFN testing environments and cannot publish these islands to live public servers until the feature reaches a more stable Beta state. Epic says they are using this time to iron out latency issues with the LLM responses and improve the overall voice quality. 

For developers looking to get a head start, Epic has already published four extensive documentation pages covering LLM conversations, developing personas, designing a conversation, and using the prompt editor tool. While the community digests this massive AI leap, Epic Games is also gearing up for another major project. The studio is reportedly preparing to launch a Disney-themed extraction shooter, similar to ARC Raiders, later this year in November.