Matches in SemOpenAlex for { <https://semopenalex.org/work/W4360891908> ?p ?o ?g. }
Showing items 1 to 89 of
89
with 100 items per page.
- W4360891908 abstract "Game engines are powerful tools in computer graphics. Their power comes at the immense cost of their development. In this work, we present a framework to train game-engine-like neural models, solely from monocular annotated videos. The result-a Learnable Game Engine (LGE)-maintains states of the scene, objects and agents in it, and enables rendering the environment from a controllable viewpoint. Similarly to a game engine, it models the logic of the game and the underlying rules of physics, to make it possible for a user to play the game by specifying both high- and low-level action sequences. Most captivatingly, our LGE unlocks the director's mode, where the game is played by plotting behind the scenes, specifying high-level actions and goals for the agents in the form of language and desired states. This requires learning game AI, encapsulated by our animation model, to navigate the scene using high-level constraints, play against an adversary, devise the strategy to win a point. The key to learning such game AI is the exploitation of a large and diverse text corpus, collected in this work, describing detailed actions in a game and used to train our animation model. To render the resulting state of the environment and its agents, we use a compositional NeRF representation used in our synthesis model. To foster future research, we present newly collected, annotated and calibrated large-scale Tennis and Minecraft datasets. Our method significantly outperforms existing neural video game simulators in terms of rendering quality. Besides, our LGEs unlock applications beyond capabilities of the current state of the art. Our framework, data, and models are available at https://learnable-game-engines.github.io/lge-website." @default.
- W4360891908 created "2023-03-25" @default.
- W4360891908 creator A5021757527 @default.
- W4360891908 creator A5038007540 @default.
- W4360891908 creator A5052645912 @default.
- W4360891908 creator A5058028206 @default.
- W4360891908 creator A5065059558 @default.
- W4360891908 creator A5080103406 @default.
- W4360891908 creator A5087319775 @default.
- W4360891908 date "2023-03-23" @default.
- W4360891908 modified "2023-09-25" @default.
- W4360891908 title "Plotting Behind the Scenes: Towards Learnable Game Engines" @default.
- W4360891908 doi "https://doi.org/10.48550/arxiv.2303.13472" @default.
- W4360891908 hasPublicationYear "2023" @default.
- W4360891908 type Work @default.
- W4360891908 citedByCount "0" @default.
- W4360891908 crossrefType "posted-content" @default.
- W4360891908 hasAuthorship W4360891908A5021757527 @default.
- W4360891908 hasAuthorship W4360891908A5038007540 @default.
- W4360891908 hasAuthorship W4360891908A5052645912 @default.
- W4360891908 hasAuthorship W4360891908A5058028206 @default.
- W4360891908 hasAuthorship W4360891908A5065059558 @default.
- W4360891908 hasAuthorship W4360891908A5080103406 @default.
- W4360891908 hasAuthorship W4360891908A5087319775 @default.
- W4360891908 hasBestOaLocation W43608919081 @default.
- W4360891908 hasConcept C107457646 @default.
- W4360891908 hasConcept C121684516 @default.
- W4360891908 hasConcept C154945302 @default.
- W4360891908 hasConcept C170828538 @default.
- W4360891908 hasConcept C190390380 @default.
- W4360891908 hasConcept C205711294 @default.
- W4360891908 hasConcept C21442007 @default.
- W4360891908 hasConcept C2986528223 @default.
- W4360891908 hasConcept C3018412434 @default.
- W4360891908 hasConcept C3020701032 @default.
- W4360891908 hasConcept C35674477 @default.
- W4360891908 hasConcept C38652104 @default.
- W4360891908 hasConcept C41008148 @default.
- W4360891908 hasConcept C41065033 @default.
- W4360891908 hasConcept C41826821 @default.
- W4360891908 hasConcept C47187476 @default.
- W4360891908 hasConcept C49774154 @default.
- W4360891908 hasConcept C502989409 @default.
- W4360891908 hasConcept C503285160 @default.
- W4360891908 hasConcept C54276265 @default.
- W4360891908 hasConcept C69369342 @default.
- W4360891908 hasConcept C77660652 @default.
- W4360891908 hasConcept C80646779 @default.
- W4360891908 hasConcept C90697248 @default.
- W4360891908 hasConceptScore W4360891908C107457646 @default.
- W4360891908 hasConceptScore W4360891908C121684516 @default.
- W4360891908 hasConceptScore W4360891908C154945302 @default.
- W4360891908 hasConceptScore W4360891908C170828538 @default.
- W4360891908 hasConceptScore W4360891908C190390380 @default.
- W4360891908 hasConceptScore W4360891908C205711294 @default.
- W4360891908 hasConceptScore W4360891908C21442007 @default.
- W4360891908 hasConceptScore W4360891908C2986528223 @default.
- W4360891908 hasConceptScore W4360891908C3018412434 @default.
- W4360891908 hasConceptScore W4360891908C3020701032 @default.
- W4360891908 hasConceptScore W4360891908C35674477 @default.
- W4360891908 hasConceptScore W4360891908C38652104 @default.
- W4360891908 hasConceptScore W4360891908C41008148 @default.
- W4360891908 hasConceptScore W4360891908C41065033 @default.
- W4360891908 hasConceptScore W4360891908C41826821 @default.
- W4360891908 hasConceptScore W4360891908C47187476 @default.
- W4360891908 hasConceptScore W4360891908C49774154 @default.
- W4360891908 hasConceptScore W4360891908C502989409 @default.
- W4360891908 hasConceptScore W4360891908C503285160 @default.
- W4360891908 hasConceptScore W4360891908C54276265 @default.
- W4360891908 hasConceptScore W4360891908C69369342 @default.
- W4360891908 hasConceptScore W4360891908C77660652 @default.
- W4360891908 hasConceptScore W4360891908C80646779 @default.
- W4360891908 hasConceptScore W4360891908C90697248 @default.
- W4360891908 hasLocation W43608919081 @default.
- W4360891908 hasOpenAccess W4360891908 @default.
- W4360891908 hasPrimaryLocation W43608919081 @default.
- W4360891908 hasRelatedWork W1530015531 @default.
- W4360891908 hasRelatedWork W1969996323 @default.
- W4360891908 hasRelatedWork W2140829396 @default.
- W4360891908 hasRelatedWork W2239513291 @default.
- W4360891908 hasRelatedWork W2364771046 @default.
- W4360891908 hasRelatedWork W2380341002 @default.
- W4360891908 hasRelatedWork W2549551529 @default.
- W4360891908 hasRelatedWork W3191027477 @default.
- W4360891908 hasRelatedWork W4206758222 @default.
- W4360891908 hasRelatedWork W1948465453 @default.
- W4360891908 isParatext "false" @default.
- W4360891908 isRetracted "false" @default.
- W4360891908 workType "article" @default.