Have you checked out AI Roguelite yet? It's the world's first game to use gpt for actual game mechanics. Granted it's only text based. For a future version, judging by the way technology is progressing, I'd envision skipping the entire 3D model step altogether and jumping straight to on-the-fly video generation.