{"id":1058,"date":"2020-08-23T16:31:54","date_gmt":"2020-08-23T15:31:54","guid":{"rendered":"https:\/\/hudecekpetr.cz\/?p=1058"},"modified":"2020-08-23T16:31:54","modified_gmt":"2020-08-23T15:31:54","slug":"model-judging-criteria-for-game-dev-competitions","status":"publish","type":"post","link":"https:\/\/hudecekpetr.cz\/cs\/model-judging-criteria-for-game-dev-competitions\/","title":{"rendered":"Model judging criteria for game dev competitions"},"content":{"rendered":"<p class=\"qtranxs-available-languages-message qtranxs-available-languages-message-cs\"> <\/p><p><span style=\"font-weight: 400;\"><a href=\"https:\/\/hudecekpetr.cz\/wp-content\/uploads\/2020\/08\/eligibility-criteria.jpg\"><img loading=\"lazy\" decoding=\"async\" class=\"alignright  wp-image-1060\" src=\"https:\/\/hudecekpetr.cz\/wp-content\/uploads\/2020\/08\/eligibility-criteria.jpg\" alt=\"\" width=\"162\" height=\"152\" srcset=\"https:\/\/hudecekpetr.cz\/wp-content\/uploads\/2020\/08\/eligibility-criteria.jpg 355w, https:\/\/hudecekpetr.cz\/wp-content\/uploads\/2020\/08\/eligibility-criteria-300x281.jpg 300w\" sizes=\"auto, (max-width: 162px) 100vw, 162px\" \/><\/a>Game development competitions (shorter ones are called \u201cgame jams\u201d) have scoring systems to determine the winners of the competition, but it can be difficult to design a scoring system that causes the best game to win.<\/span><\/p>\n<p><!--more--><\/p>\n<p><span style=\"font-weight: 400;\">Here I propose model judging criteria for a game development competition that have several advantages:<\/span><\/p>\n<ul>\n<li style=\"font-weight: 400;\"><span style=\"font-weight: 400;\">They can be used by even untrained judges to score games fairly.<\/span><\/li>\n<li style=\"font-weight: 400;\"><span style=\"font-weight: 400;\">They reward all aspects of game design and development.<\/span><\/li>\n<li style=\"font-weight: 400;\"><span style=\"font-weight: 400;\">They reward games with the most effort behind them.<\/span><\/li>\n<li style=\"font-weight: 400;\"><span style=\"font-weight: 400;\">They provide a lot of feedback to the game developers.<\/span><\/li>\n<\/ul>\n<p><span style=\"font-weight: 400;\">You are free to use these criteria in your own game development contests, or to modify them for your contest\u2019s needs. They are based on the criteria I used in 2010 for the UFEC contest which were in turn based on the criteria of GameDev.net\u2019s Four Elements series of contests.\u00a0<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Here\u2019s the criteria. I describe the judging system and details on the criteria further below.<\/span><\/p>\n<table>\n<tbody>\n<tr>\n<td><span style=\"text-decoration: underline;\"><strong>Technical<\/strong><\/span><\/td>\n<td><span style=\"text-decoration: underline;\"><strong>Production<\/strong><\/span><\/td>\n<td><span style=\"text-decoration: underline;\"><strong>Gameplay<\/strong><\/span><\/td>\n<td><span style=\"text-decoration: underline;\"><strong>Theme<\/strong><\/span><\/td>\n<\/tr>\n<tr>\n<td><b>Stability<\/b><b><br \/>\n<\/b><span style=\"font-weight: 400;\">Does it crash? Are there bugs? How does it handle errors?<\/span><\/td>\n<td><b>Graphics<\/b><span style=\"font-weight: 400;\"><br \/>\n<\/span><span style=\"font-weight: 400;\">Is the artwork good? Is the art and art style appropriate?\u00a0<\/span><\/td>\n<td><b>Fun (immediate)<\/b><b><br \/>\n<\/b><span style=\"font-weight: 400;\">Is it fun when you first play the game?<\/span><\/td>\n<td><b>Theme cohesion<\/b><b><br \/>\n<\/b><span style=\"font-weight: 400;\">Does the theme fit the game, or does it feel \u201cbolted on\u201d an existing game?<\/span><\/td>\n<\/tr>\n<tr>\n<td><b>Best practices<\/b><b><br \/>\n<\/b><span style=\"font-weight: 400;\">Does it offer video options? Confirmation before quitting?\u00a0<\/span><\/td>\n<td><b>Audio<br \/>\n<\/b><span style=\"font-weight: 400;\">Are the music and SFX good? Is it voice-acted well?<\/span><\/td>\n<td><b>Fun (long term)<\/b><b><br \/>\n<\/b><span style=\"font-weight: 400;\">Is the game long or replayable? Can it hold your interest?\u00a0<\/span><\/td>\n<td><b>Theme-based<\/b><b><br \/>\n<\/b><span style=\"font-weight: 400;\">Is theme so integral that the game couldn\u2019t function without it?<\/span><\/td>\n<\/tr>\n<tr>\n<td><b>Performance<\/b><b><br \/>\n<\/b><span style=\"font-weight: 400;\">Does it stutter? How fast does it load up? How much memory does it use?<\/span><\/td>\n<td><b>Writing<\/b><b><br \/>\n<\/b><span style=\"font-weight: 400;\">Is the story and dialogue inspired? Is the interface text clear?<\/span><\/td>\n<td><b>Originality<\/b><b><br \/>\n<\/b><span style=\"font-weight: 400;\">How original is the gameplay and the game concept?<\/span><\/td>\n<td><b>General cohesion<\/b><b><br \/>\n<\/b><span style=\"font-weight: 400;\">Does it feel like a single, smooth system? Does everything \u201cfit\u201d in the design?<\/span><\/td>\n<\/tr>\n<tr>\n<td><b>Documentation<\/b><b><br \/>\n<\/b><span style=\"font-weight: 400;\">Is the manual easy to read and helpful? Is it available in-game? Does it explain hidden mechanics?<\/span><\/td>\n<td><b>Polish<\/b><b><br \/>\n<\/b><span style=\"font-weight: 400;\">Does the game feel smooth and polished?\u00a0\u00a0<\/span><\/td>\n<td><b>Accessibility<\/b><b><br \/>\n<\/b><span style=\"font-weight: 400;\">Is it easy to install? Does it have a tutorial? How is the difficulty curve? How are the controls?<\/span><\/td>\n<td><b>Completion<\/b><b><br \/>\n<\/b><span style=\"font-weight: 400;\">When you beat the game, did it feel like a complete game? Or more like a demo?<\/span><\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<p><b>The judging system. <\/b><span style=\"font-weight: 400;\">Many judging systems are compatible with these criteria. In general, you\u2019re going to have one or more judges who each assign scores for one or more criteria on one or more entries.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">For example, UFEC used the following system:<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Each contestant and anyone from the public may each grade any number of games. You can\u2019t grade your own game. You don\u2019t need to grade each game on each criterion. For each criterion where you put a grade (a number from 0 to 10), you must submit feedback as text as well. To get the total score of game, sum the average score of each criterion. The winner is the game with the greatest total score.<\/span><\/p>\n<p><b>Details on the criteria.<\/b><\/p>\n<ul>\n<li><b>Technical. <span style=\"font-weight: 400;\">This category rewards technical craftsmanship and attention to detail.<\/span><\/b>\n<ul>\n<li><strong>Stability.<\/strong> <span style=\"font-weight: 400;\">A game should be rewarded for not having game-breaking, progression-breaking or annoying bugs.<\/span><\/li>\n<li><strong>Best practices.<\/strong> <span style=\"font-weight: 400;\">This is a catch-all technical criterion for various minor features such as those that I list in <\/span><a href=\"https:\/\/hudecekpetr.cz\/gamedev-technical-best-practices\/\"><span style=\"font-weight: 400;\">Gamedev Technical Best Practices<\/span><\/a><span style=\"font-weight: 400;\">.<\/span><\/li>\n<li><strong>Performance.<\/strong> <span style=\"font-weight: 400;\">Games are usually expected to be able to run at 60 FPS on a standard gaming PC at some reasonable configuration.\u00a0<\/span><\/li>\n<li><strong>Documentation.<\/strong> <span style=\"font-weight: 400;\">Admittedly less standard than in the past, documentation still enhances the player\u2019s experience. It is better to have documentation available in-game, such as with an in-game encyclopedia. Documentation is more required for complex rules-based systems, such as turn-based strategy games, and less so for action games.<\/span><\/li>\n<\/ul>\n<\/li>\n<li><strong>Production.<\/strong> <span style=\"font-weight: 400;\">This category rewards the art aspects of game development.<\/span>\n<ul>\n<li><strong>Graphics.<\/strong> <span style=\"font-weight: 400;\">Good art can exist in any medium, even in retro-style low-pixel-count games, and that\u2019s one aspect of grading, but also some games simply have better graphics than others, and a modern FPS shooter should always get a higher score here than a box-sliding puzzle game: this category includes grading the art on its own merit.<\/span><\/li>\n<li><strong>Audio.<\/strong> <span style=\"font-weight: 400;\">A game that\u2019s voice-acted is better than one where you must read the dialogue yourself. Music and sound effects are expected in all games.<\/span><\/li>\n<li><strong>Writing.<\/strong> <span style=\"font-weight: 400;\">This includes both the instructions being understandable, and the writing being fun and enjoyable to read, perhaps because the story is original or the characters interesting or relatable. Grammar and spelling errors should cause the grade to go down.<\/span><\/li>\n<li><strong>Polish.<\/strong> <span style=\"font-weight: 400;\">This is a catch-all criterion for how technically and artistically polished the game feels.\u00a0<\/span><\/li>\n<\/ul>\n<\/li>\n<li><strong>Gameplay.<\/strong> <span style=\"font-weight: 400;\">This category rewards game design and the implementation of mechanics.<\/span>\n<ul>\n<li><strong>Fun (immediate).<\/strong> <span style=\"font-weight: 400;\">A good game should catch the judge\u2019s attention from the start and shouldn\u2019t force them to sit through thirty minutes before it starts to get good.<\/span><\/li>\n<li><strong>Fun (longterm).<\/strong> <span style=\"font-weight: 400;\">But also games should be rewarded for either their replayability or amount of content. A short quick game that only gets you a couple of minutes\u2019 worth of fun should be graded worse than a 40-hour RPG.<\/span><\/li>\n<li><strong>Originality.<\/strong> <span style=\"font-weight: 400;\">It is more difficult to create a game that isn\u2019t a gameplay clone of an existing game but such efforts should be rewarded.<\/span><\/li>\n<li><strong>Accessibility.<\/strong> <span style=\"font-weight: 400;\">A game\u2019s difficulty usually shouldn\u2019t come from learning its user interface or from trying to get it to run. The best difficulty curve is usually smooth.<\/span><\/li>\n<\/ul>\n<\/li>\n<li><strong>Theme.<\/strong> <span style=\"font-weight: 400;\">This category rewards compliance with the competition theme.<\/span>\n<ul>\n<li><strong>Theme cohesion.<\/strong> <span style=\"font-weight: 400;\">The developer should be rewarded for inventing their core game based on the theme rather than preparing a game in advance and then \u201cbolting on\u201d the competition\u2019s theme onto it.<\/span><\/li>\n<li><strong>Theme-based.<\/strong> <span style=\"font-weight: 400;\">And if the developer bases their game on the theme to such a level that the game couldn\u2019t work at all without it, then that\u2019s worth extra recognition.<\/span><\/li>\n<li><strong>General cohesion.<\/strong> <span style=\"font-weight: 400;\">This is an extra subjective criterion that you may wish to roll into Production\u2019s Polish criterion.<\/span><\/li>\n<li><strong>Completion.<\/strong> <span style=\"font-weight: 400;\">When you complete the game, do you feel like \u201cthis was the appropriate point at which the game should have ended\u201d (good), or do you feel like \u201cthe developer ran out of time at this point and just packaged the game\u201d?<\/span><\/li>\n<\/ul>\n<\/li>\n<\/ul>\n<p><b>Conclusion<\/b><\/p>\n<p><span style=\"font-weight: 400;\">I proposed model criteria for a game development contest that rewards complete games rather than prototypes of a work that still needs to be finished.\u00a0<\/span><\/p>\n<p><span style=\"font-weight: 400;\">It is my hope that more game dev competitions will adopt judging criteria similar to these because contests with such criteria test a wider array of skills and also result in more complete and fun games available to the general public.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">If you create or know of a contest like that, let me know in the comments or at <\/span><a href=\"mailto:petrhudecek2010@gmail.com\"><span style=\"font-weight: 400;\">petrhudecek2010@gmail.com<\/span><\/a><span style=\"font-weight: 400;\">, please!<\/span><\/p>","protected":false},"excerpt":{"rendered":"<p>Game development competitions (shorter ones are called \u201cgame jams\u201d) have scoring systems to determine the winners of the competition, but it can be difficult to design a scoring system that causes the best game to win.<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[8],"tags":[],"class_list":["post-1058","post","type-post","status-publish","format-standard","hentry","category-blog"],"_links":{"self":[{"href":"https:\/\/hudecekpetr.cz\/cs\/wp-json\/wp\/v2\/posts\/1058","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/hudecekpetr.cz\/cs\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/hudecekpetr.cz\/cs\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/hudecekpetr.cz\/cs\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/hudecekpetr.cz\/cs\/wp-json\/wp\/v2\/comments?post=1058"}],"version-history":[{"count":3,"href":"https:\/\/hudecekpetr.cz\/cs\/wp-json\/wp\/v2\/posts\/1058\/revisions"}],"predecessor-version":[{"id":1062,"href":"https:\/\/hudecekpetr.cz\/cs\/wp-json\/wp\/v2\/posts\/1058\/revisions\/1062"}],"wp:attachment":[{"href":"https:\/\/hudecekpetr.cz\/cs\/wp-json\/wp\/v2\/media?parent=1058"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/hudecekpetr.cz\/cs\/wp-json\/wp\/v2\/categories?post=1058"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/hudecekpetr.cz\/cs\/wp-json\/wp\/v2\/tags?post=1058"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}