The model, called GameNGen, was made by Dani Valevski at Google Research and his colleagues, who declined to speak to New Scientist. According to their paper on the research, the AI can be played for up to 20 seconds while retaining all the features of the original, such as scores, ammunition levels and map layouts. Players can attack enemies, open doors and interact with the environment as usual.
After this period, the model begins to run out of memory and the illusion falls apart.
It’s cool but it’s more or less just a party trick.
It’s a proof of concept demonstration not a final product. You might as well say the Wright brothers didn’t have anything other than their party trick.
So many practical applications for being able to do this beyond just video games in fact video games are probably the least useful application for this technology.
Such as?
Is it though? We can show an AI thousands of hours of something and it can simulate it almost perfectly. All the game mechanics work! It even makes you collect keys and stock up on ammo. For a stable diffusion model that’s pretty profound emergent behavior.
I feel like you’re kidding yourself if you don’t think this has real world applications. This is the kind breakthrough we need for self-driving: the ability to simulate what would happen in real life given a precise current state and a set of fictional inputs.
Doom is a low-graphics game, so it’s definitely easier to simulate, but this method could make the next generation of niche “VidGen” models extremely accurate.
Can’t wait for your self-driving car to go out of memory mid ride.
I’m not convinced. The ammo seems to go up and down on a whim, as does the health