Expressive Range: Evaluating and Comparing Generative Systems

With the growth in popularity of procedural content generation, it is important for us to be able to measure not only the quantity of a generator’s output but also it’s quality. It is easy to claim that a generator produces thousands of unique artifacts; it is harder to evaluate how similar or different these artifacts from each other. This ongoing research project looks at methods for evaluating and comparing content generators in terms of qualities of their outputs: the range of content that can be made, how controllable that range is, and how that range compares to that of other content generators. The original work for evaluating expressive range was performed on the Launchpad level generator, and is being expanded to a broader range of generative systems.

Software

Launchpad cluster visualization tool: This tool visualizes the expressive range of Launchpad via hierarchical clustering of rhythm groups it produces. Clusters are generated based on the edit distance between rhythm groups. An interactive treemap visualization allows the user to browse different clusters see the size and characteristics of individual clusters at different layers of the hierarchy. Requires Java plugin.

Publications

Alessandro Canossa, Gillian Smith. Towards a Procedural Evaluation Technique: Metrics for Level Design. Proceedings of the 2015 Conference on the Foundations of Digital Games (FDG 2015). Monterey, CA, June 22-25, 2015. (more…)Read More...

 

Britton Horn, Steve Dahlskog, Noor Shaker, Gillian Smith, Julian Togelius. A Comparative Evaluation of Level Generators in the Mario AI FrameworkProceedings of the 2014 Foundations of Digital Games Conference (FDG 2014), Fort Lauderdale, FL, April 3-7, 2014. (more…)Read More...

 

Gillian Smith, Jim Whitehead, Michael Mateas, Mike Treanor, Jameka March, Mee Cha. Launchpad: A Rhythm-Based Level Generator for 2D PlatformersIEEE Transactions on Computational Intelligence and AI in Games (TCIAIG), vol. 3, iss. 1, March 2011. (more…)Read More...

 

Gillian Smith, Jim Whitehead. Analyzing the Expressive Range of a Level GeneratorProceedings of the Workshop on Procedural Content Generation in Games, co-located with FDG 2010, Monterey, CA, June 18, 2010. (more…)Read More...

You may also like...

Leave a Reply

Your email address will not be published. Required fields are marked *