poster

Prompt-Guided Level Generation

Authors:

Shyam Sudhakaran,

Miguel González-Duque,

Claire Glanois,

Matthias Freiberger,

Elias Najarro, and

Sebastian RisiAuthors Info & Claims

GECCO '23 Companion: Proceedings of the Companion Conference on Genetic and Evolutionary Computation

July 2023

Pages 179 - 182

https://doi.org/10.1145/3583133.3590656

Published: 24 July 2023 Publication History

Abstract

Automated generation of complex and diverse environments can be achieved through the use of Procedural Content Generation (PCG) algorithms. However, generating content that is both meaningful and reflective of specific intentions and constraints remains a challenge. Recent advances in Large Language Models (LLMs) have demonstrated their effectiveness in various domains. These models can be fine-tuned and information can be reused to accelerate training for new tasks. Our study presents MarioGPT, a fine-tuned GPT2 model that has been trained to generate tile-based game levels for Super Mario Bros. The results demonstrate that MarioGPT can generate diverse levels and can be text-prompted for controllable level generation, addressing a critical challenge in current PCG techniques.

References

[1]

Dzmitry Bahdanau, KyungHyun Cho, and Yoshua Bengio. 2014. Neural machine translation by jointly learning to align and translate. arXiv preprint arXiv:1409.0473 (2014).

[2]

Cameron Browne and Frederic Maire. 2010. Evolutionary game design. IEEE Transactions on Computational Intelligence and AI in Games 2, 1 (2010), 1--16.

[3]

Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2018. BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding.

[4]

Matthew C. Fontaine, Ruilin Liu, Ahmed Khalifa, Jignesh Modi, Julian Togelius, Amy K. Hoover, and Stefanos Nikolaidis. 2020. Illuminating Mario Scenes in the Latent Space of a Generative Adversarial Network.

[5]

Edoardo Giacomello, Pier Luca Lanzi, and Daniele Loiacono. 2018. Doom level generation using generative adversarial networks. In 2018 IEEE Games, Entertainment, Media Conference (GEM). IEEE, 316--323.

[6]

Miguel González-Duque, Rasmus Berg Palm, Søren Hauberg, and Sebastian Risi. 2022. Mario Plays on a Manifold: Generating Functional Content in Latent Space through Differential Geometry.

[7]

Ian Goodfellow, Jean Pouget-Abadie, Mehdi Mirza, Bing Xu, David Warde-Farley, Sherjil Ozair, Aaron Courville, and Yoshua Bengio. 2020. Generative adversarial networks. Commun. ACM 63, 11 (2020), 139--144.

Digital Library

[8]

Sepp Hochreiter and Jürgen Schmidhuber. 1997. Long short-term memory. Neural computation 9, 8 (1997), 1735--1780.

Digital Library

[9]

Zhengbao Jiang, Frank F. Xu, Jun Araki, and Graham Neubig. 2019. How Can We Know What Language Models Know?

[10]

Diederik P. Kingma and Jimmy Ba. 2014. Adam: A Method for Stochastic Optimization.

[11]

Mike Lewis, Yinhan Liu, Naman Goyal, Marjan Ghazvininejad, Abdelrahman Mohamed, Omer Levy, Ves Stoyanov, and Luke Zettlemoyer. 2019. BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehension.

[12]

Jialin Liu, Sam Snodgrass, Ahmed Khalifa, Sebastian Risi, Georgios N Yannakakis, and Julian Togelius. 2021. Deep learning for procedural content generation. Neural Computing and Applications 33, 1 (2021), 19--37.

Digital Library

[13]

Alec Radford, Jeff Wu, Rewon Child, David Luan, Dario Amodei, and Ilya Sutskever. 2019. Language Models are Unsupervised Multitask Learners. (2019).

[14]

David E Rumelhart, Geoffrey E Hinton, and Ronald J Williams. 1985. Learning internal representations by error propagation. Technical Report. California Univ San Diego La Jolla Inst for Cognitive Science.

[15]

Victor Sanh, Lysandre Debut, Julien Chaumond, and Thomas Wolf. 2019. DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lighter.

[16]

Anurag Sarkar and Seth Cooper. 2021. Dungeon and Platformer Level Blending and Generation using Conditional VAEs. In Proceedings of the IEEE Conference on Games (CoG).

Digital Library

[17]

Anurag Sarkar and Seth Cooper. 2021. Generating and Blending Game Levels via Quality-Diversity in the Latent Space of a Variational Autoencoder. In Proceedings of the Foundations of Digital Games.

Digital Library

[18]

Anurag Sarkar, Zhihan Yang, and Seth Cooper. 2020. Conditional Level Generation and Game Blending. In Proceedings of the Experimental AI in Games (EXAG) Workshop at AIIDE.

[19]

Noor Shaker, Julian Togelius, and Mark J Nelson. 2016. Procedural content generation in games. (2016).

[20]

Adam M Smith and Michael Mateas. 2011. Answer set programming for procedural content generation: A design space approach. IEEE Transactions on Computational Intelligence and AI in Games 3, 3 (2011), 187--200.

[21]

Adam Summerville and Michael Mateas. 2016. Super Mario as a String: Platformer Level Generation Via LSTMs.

[22]

Adam Summerville, Sam Snodgrass, Matthew Guzdial, Christoffer Holmgård, Amy K Hoover, Aaron Isaksen, Andy Nealen, and Julian Togelius. 2018. Procedural content generation via machine learning (PCGML). IEEE Transactions on Games 10, 3 (2018), 257--270.

[23]

Adam James Summerville, Sam Snodgrass, Michael Mateas, and Santiago Ontañón. 2016. The VGLC: The Video Game Level Corpus.

[24]

Graham Todd, Sam Earle, Muhammad Umair Nasir, Michael Cerny Green, and Julian Togelius. 2023. Level Generation Through Large Language Models. In Proceedings of the 18th International Conference on the Foundations of Digital Games. 1--8.

Digital Library

[25]

Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, Łukasz Kaiser, and Illia Polosukhin. 2017. Attention is all you need. Advances in neural information processing systems 30 (2017).

[26]

Vanessa Volz, Jacob Schrum, Jialin Liu, Simon M. Lucas, Adam Smith, and Sebastian Risi. 2018. Evolving Mario Levels in the Latent Space of a Deep Convolutional Generative Adversarial Network.

[27]

Georgios N Yannakakis and Julian Togelius. 2018. Artificial intelligence and games. Vol. 2. Springer.

Digital Library

Cited By

Anjum ALi YLaw NCharity MTogelius J(2024)The Ink Splotch Effect: A Case Study on ChatGPT as a Co-Creative Game DesignerProceedings of the 19th International Conference on the Foundations of Digital Games10.1145/3649921.3650010(1-15)Online publication date: 21-May-2024
https://dl.acm.org/doi/10.1145/3649921.3650010
Sweetser P(2024)Large Language Models and Video Games: A Preliminary Scoping ReviewProceedings of the 6th ACM Conference on Conversational User Interfaces10.1145/3640794.3665582(1-8)Online publication date: 8-Jul-2024
https://dl.acm.org/doi/10.1145/3640794.3665582
Gaier AStoddart JVillaggi LSudhakaran SLi XHandl J(2024)Generative Design through Quality-Diversity Data Synthesis and Language ModelsProceedings of the Genetic and Evolutionary Computation Conference10.1145/3638529.3654138(823-831)Online publication date: 14-Jul-2024
https://dl.acm.org/doi/10.1145/3638529.3654138

Index Terms

Prompt-Guided Level Generation
1. Computing methodologies
  1. Artificial intelligence

Recommendations

Region-Guided Pixel-Level Label Generation for Weakly Supervised Semantic Segmentation
ICCCV '21: Proceedings of the 4th International Conference on Control and Computer Vision

The lack of reliable segmentation labels is the major obstacles to weakly supervised semantic segmentation. We provide a pseudo-label generation approach based on a deep convolutional neural network, which is supervised by the image-level category ...
Read More
Unsupervised Disentanglement Learning Model for Exemplar-Guided Paraphrase Generation
Exemplar-guided paraphrase generation is the task of generating a paraphrase for a source sentence when given another exemplar sentence as syntactic guidance information. The target sentence must convey the semantics of the source sentence in surface form,...
Read More
Lesion Guided Explainable Few Weak-Shot Medical Report Generation
Medical Image Computing and Computer Assisted Intervention – MICCAI 2022
Abstract
Medical images are widely used in clinical practice for diagnosis. Automatically generating interpretable medical reports can reduce radiologists’ burden and facilitate timely care. However, most existing approaches to automatic report generation ...
Read More

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

GECCO '23 Companion: Proceedings of the Companion Conference on Genetic and Evolutionary Computation

July 2023

2519 pages

ISBN:9798400701207

DOI:10.1145/3583133

Chair:
Sara Silva,
Program Chair:
Luís Paquete

Copyright © 2023 Owner/Author(s).

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the owner/author(s).

Sponsors

SIGEVO: ACM Special Interest Group on Genetic and Evolutionary Computation

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 24 July 2023

Check for updates

Qualifiers

Poster

Conference

GECCO '23 Companion

Sponsor:

SIGEVO

GECCO '23 Companion: Companion Conference on Genetic and Evolutionary Computation

July 15 - 19, 2023

Lisbon, Portugal

Acceptance Rates

Overall Acceptance Rate 1,669 of 4,410 submissions, 38%

Upcoming Conference

GECCO '24

Sponsor:
sigevo

Genetic and Evolutionary Computation Conference

July 14 - 18, 2024

Melbourne , VIC , Australia

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

3
Total Citations
View Citations
184
Total Downloads

Downloads (Last 12 months)184
Downloads (Last 6 weeks)13

Other Metrics

View Author Metrics

Citations

Cited By

Anjum ALi YLaw NCharity MTogelius J(2024)The Ink Splotch Effect: A Case Study on ChatGPT as a Co-Creative Game DesignerProceedings of the 19th International Conference on the Foundations of Digital Games10.1145/3649921.3650010(1-15)Online publication date: 21-May-2024
https://dl.acm.org/doi/10.1145/3649921.3650010
Sweetser P(2024)Large Language Models and Video Games: A Preliminary Scoping ReviewProceedings of the 6th ACM Conference on Conversational User Interfaces10.1145/3640794.3665582(1-8)Online publication date: 8-Jul-2024
https://dl.acm.org/doi/10.1145/3640794.3665582
Gaier AStoddart JVillaggi LSudhakaran SLi XHandl J(2024)Generative Design through Quality-Diversity Data Synthesis and Language ModelsProceedings of the Genetic and Evolutionary Computation Conference10.1145/3638529.3654138(823-831)Online publication date: 14-Jul-2024
https://dl.acm.org/doi/10.1145/3638529.3654138

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents