{"id":92,"date":"2008-04-16T13:25:08","date_gmt":"2008-04-16T18:25:08","guid":{"rendered":"http:\/\/haleyai.com\/wordpress\/2008\/04\/16\/real-ai-for-games\/"},"modified":"2016-06-09T08:23:35","modified_gmt":"2016-06-09T13:23:35","slug":"real-ai-for-games","status":"publish","type":"post","link":"http:\/\/haleyai.com\/wordpress\/2008\/04\/16\/real-ai-for-games\/","title":{"rendered":"Real AI for Games"},"content":{"rendered":"<p><a href=\"http:\/\/www.androidblues.com\/interviewmpeg1.mpg\" target=\"_blank\"><img loading=\"lazy\" decoding=\"async\" src=\"http:\/\/www.androidblues.com\/gallery\/interview449.jpg\" border=\"0\" alt=\"\" width=\"200\" height=\"150\" align=\"right\" \/><\/a>Dave Mark&#8217;s post on <a href=\"http:\/\/feeds.aigamedev.com\/~r\/AiGameDev\/~3\/270875475\/more-simulation\" target=\"_blank\"><span style=\"color: #828282;\">Why Not More Simulation in Game AI?<\/span><\/a> and the comments it elicited are right on the money about the correlation between lifespan and intelligence of supposedly intelligent adversaries in first person shooter (FPS) games.\u00a0 It is extremely refreshing to hear advanced gamers agreeing that more intelligent, longer-lived characters would keep a game more interesting and engaging than current FPS.\u00a0 This is exactly consistent with my experience with one of my employers who delivers intelligent agents for the military.\u00a0 The military calls them &#8220;computer generated forces&#8221; (CGFs).\u00a0 The idea is that these things need to be smart and human enough to constitute a meaningful adversary for training purposes (i.e., &#8220;serious games&#8221;).\u00a0 Our agents fly fixed wing and rotary wing aircraft or animate special operations forces (SOFs) on the ground.\u00a0 (They even talk &#8211; with humans &#8211; over the radio.\u00a0 I love that part.\u00a0 It makes them seem so human.)<!--more--><\/p>\n<p>Of course, they get to demonstrate this intelligence only because they are not shot up or blown to bits within seconds!<\/p>\n<p>Here&#8217;s where AI in games is headed (from the perspective of a behavior leader in serious games):<\/p>\n<ol>\n<li>Real AI is being embedded with gaming milddleware to animate non-player characters (NPCs) with much higher human-like fidelity.<\/li>\n<li>Human performance modeling, including emotion, is being enhanced within the cognitive models of CGFs and will show up next in NPCs.<\/li>\n<li>Crowd animation is becoming much more sophisticated and moving to center stage in role-playing games (RPGs).<\/li>\n<\/ol>\n<p>The first step involves embedding a rule-based or similar cognitive architecture in game AI middleware.\u00a0 These days, game AI middleware is pretty much about path planning and finite-state machine (FSM) modeling of agent behavior.\u00a0 That is, it is not knowledge based and has all the limitations on context-sensitive and complexity that you would expect if you were hard-coding in C++ (Java is out since the middleware has to support the Xbox and the Playstation, as well as Microsoft Windows and Linux, in some cases.)\u00a0 The FSM approach has been played out to its limit with hierarchical task networks.<\/p>\n<p>For a look at some of this software, see:<\/p>\n<ul>\n<li><a href=\"http:\/\/www.ai-implant.com\/\" target=\"_blank\">AI-Implant<\/a> from Presagis<\/li>\n<li><a href=\"http:\/\/www.emergent.net\/en\/Products\/Gamebryo\/\" target=\"_blank\">Gamebryo <\/a>from Emergent Game Technologies<\/li>\n<li><a href=\"http:\/\/www.kynogon.com\/\" target=\"_blank\">kynapse <\/a>from kynogon (acquired by Autodesk)<\/li>\n<li><a href=\"http:\/\/www.touchdownentertainment.com\/jupiterEX.htm\" target=\"_blank\">Jupiter <\/a>from Touchdown Entertainment<\/li>\n<li><a href=\"http:\/\/www.diguy.com\/diguy\/\" target=\"_blank\">DI-Guy<\/a> from Boston Dynamics<\/li>\n<\/ul>\n<p>From our standpoint, Presagis is particularly well positioned to transition from serious games to entertainment.\u00a0 We also think their <a href=\"http:\/\/www.presagis.com\/products\/\" target=\"_blank\">simulation, 3D terrain, and flight dynamics <\/a>capabilities are by far the best for our autonomous pilots in our military markets.\u00a0 (We might have to plug-in to Microsoft Flight Simulator in the consumer market, though!)<\/p>\n<h3>Autonomy in gaming and robotics<\/h3>\n<p>Parenthetically, our agents can also fly unmanned aerial vehicles (UAVs), but for those most part those are\u00a0teleoperated rather than autonomous.\u00a0 Boston Dynamics <a href=\"http:\/\/www.bostondynamics.com\/content\/sec.php?section=BigDog\" target=\"_blank\">BigDog<\/a> is one example of an autonomous unmanned ground vehicle (UGV) that will have our kind of cognition on board in the surprisingly near future.\u00a0 Boston Dynamics apparently sees the same<strong> <\/strong>synergy in autonomy across gaming and robotics that we do.\u00a0 They are also teamed up with Presagis using <a href=\"http:\/\/www.presagis.com\/products\/simulation\/details\/aiimplant\/more\/di_guy_for_stage_scenario\/\" target=\"_blank\">DI-Guy with AI-implant<\/a>.<\/p>\n<p>If you are interested in this kind of synnergy, you might also want to take a look at the following robotics middleware:<\/p>\n<ul>\n<li><a href=\"http:\/\/www.gostai.com\/\" target=\"_blank\">URBI <\/a>from GostAI<\/li>\n<li><a href=\"http:\/\/msdn.microsoft.com\/robotics\/\" target=\"_blank\">Microsoft Robotics Studio<\/a><\/li>\n<\/ul>\n<p>If you take a close look at the &#8220;behavior modeling&#8221; of these and game AI software you will see many conceptual similarities.<\/p>\n<h3>Short term AI for NPCs<\/h3>\n<p>Bringing rule-based cognitive capabilities to NPCs involves taking our AI technology and replacing or augmenting the FSM\/HTN approaches of existing middleware is the critical step forward for AI in games.\u00a0 This means C++ in order to support the Xbox and the Playstation, if not Microsoft Windows and Linux, too.\u00a0 Our technology tends to be a little too heavy for the massive crowds that kynogon addresses (check out <a href=\"http:\/\/www.kynogon.com\/products\/demos\/index.html\" target=\"_blank\">these videos<\/a>).\u00a0 Our technology is more capable of moderate crowds, but it is really targeted at teams of agents at high fidelity.\u00a0 And our technology is perfect for high-fidelity human animation.\u00a0 Check out <a href=\"http:\/\/www.diguy.com\/dist\/diguy\/movies\/DI-Guy_SAIC_Irv_Lessel_v2.wmv\" target=\"_blank\">this <\/a>(and <a href=\"http:\/\/www.diguy.com\/diguy\/download_movies_diguy.html\" target=\"_blank\">other<\/a>) videos from DI-Guy, for example.<\/p>\n<p>Aside from the post I referenced above, these audio\/video clips can give you some insight on how much game developers are commited to AI and how hard they are working to push the limits of their current approaches:<\/p>\n<ul>\n<li>A <a href=\"http:\/\/www.bungie.net\/News\/content.aspx?type=topnews&amp;cid=12705\" target=\"_blank\">podcast <\/a>by a developer of the AI in Halo III.\u00a0 (I too like the NPCs fighting to drive the HumVee.)<\/li>\n<li>A <a href=\"http:\/\/www.gametrailers.com\/player\/26446.html\" target=\"_blank\">video <\/a>with the developer of the AI in Assassins&#8217; Creed.<\/li>\n<\/ul>\n<p>The Assassin&#8217;s Creed scenario is close to ideal for today&#8217;s cognitive AI.\u00a0 You have a small crowd of agents of long-lived NPCs where the quality of the game emerges from the reality and complexity of interactions with them.\u00a0 It has a long way to go but this game clearly broke ground.<\/p>\n<p>The basic\u00a0approach is to take the lessons from military\u00a0CGFs, especially concerning cognitive and human performance modeling, including emotion, and raise the level of everything from path planning to behavior up to the knowledge-level.\u00a0 If you take a close look at some of the game AI middleware, you will see that NPCs actually throw out rays to &#8220;see&#8221;.\u00a0 In a few years (a game cycle or two), NPCs will just drop into games and perceive their environment with the same vision that camera and laser equiped robots use.\u00a0 And they will figure how to get from point A to point B the same way you and I do.<\/p>\n<p>Going into all the details of how this is unfolding is too much for me at the moment, but here are few more references on where the military folks are coming from:<\/p>\n<ul>\n<li><a href=\"http:\/\/www.stottlerhenke.com\/\" target=\"_blank\">Stottler Henke<\/a> tried (apparently unsuccessfully) with the FSM\/HTN approach in <a href=\"http:\/\/www.simbionic.com\/indexjs.htm\" target=\"_blank\">SimBionic<\/a>.<\/li>\n<li><a href=\"http:\/\/www.chisystems.com\/\" target=\"_blank\">Chi Systems<\/a> tried (apparently unsuccessfully) with a proprietary cognitive architecture in <a href=\"http:\/\/www.cognitiveagent.com\/\" target=\"_blank\">iGEN<\/a>.<\/li>\n<li><a href=\"http:\/\/www.maad.com\/index.pl\/computer_generated_forces\" target=\"_blank\">Micro Analysis &amp; Design<\/a> remains strictly military\u00a0 CGF emphasizing stress\/fatique\/hunger\/training\u00a0more than cognition or emotion.<\/li>\n<li><a href=\"http:\/\/www.soartech.com\" target=\"_blank\">Soar Technology<\/a> also remains strictly military CGF with the strongest emphasis on cognition and some emotional modeling.<\/li>\n<\/ul>\n<p>Note that each of these companies does more than &#8220;intelligent&#8221; agent work, I am only commenting on those aspects here.<\/p>\n<h3>Realistic Avatars<\/h3>\n<p>As more human behavior (including performance and emotion) is modeled, facial animation, including speech will become key.\u00a0 I enjoy <a href=\"http:\/\/www.reallusion.com\/crazytalk\/\" target=\"_blank\">CrazyTalk<\/a> from Reallusion but image metrics seem to be <a href=\"http:\/\/www.image-metrics.com\/\" target=\"_blank\">the facial animation leader for current games<\/a>.\u00a0\u00a0 Also, check out <a href=\"http:\/\/www.mpi-inf.mpg.de\/~blanz\/\" target=\"_blank\">Volker Blanz<\/a>.<\/p>\n<p>If you find this interesting, nothing that I have seen compares to the work of <a href=\"http:\/\/www.androidblues.com\/\" target=\"_blank\">Stephen Stahlberg<\/a>.\u00a0 It will take a lot of horsepower before the agents that we interact with will be as personified as the video behind his face shown above, but will happen.<\/p>\n<h3>Intelligent Agents<\/h3>\n<p>As compelling as synthetic humans may become, their ability to engage us and be of use to us will require more the complex behavior, it will require learning and problem solving that current rule technology does not address.\u00a0 Some of the cognitive architectures such as Soar and ACT-R provide these capabilities, the former on a rule-based platform.\u00a0 Soar is an interesting technology with a good rule engine.\u00a0 It may not be the exact approach to embed in AI middleware, but it is certainly a guidepost on the way towards intelligent autonomous agents, whether they be on screen or robots.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Dave Mark&#8217;s post on Why Not More Simulation in Game AI? and the comments it elicited are right on the money about the correlation between lifespan and intelligence of supposedly intelligent adversaries in first person shooter (FPS) games.\u00a0 It is extremely refreshing to hear advanced gamers agreeing that more intelligent, longer-lived characters would keep a &hellip; <\/p>\n<p class=\"link-more\"><a href=\"http:\/\/haleyai.com\/wordpress\/2008\/04\/16\/real-ai-for-games\/\" class=\"more-link\">Continue reading<span class=\"screen-reader-text\"> &#8220;Real AI for Games&#8221;<\/span><\/a><\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[6,21],"tags":[30,31,32,42,47,49,54,59,80,84,105,117,118,141,142,149,156,159,166,183,186,194,202,204,209,215,219,228,233,891,254,256,273,277,278,281,283,285,290,296,303,315],"class_list":["post-92","post","type-post","status-publish","format-standard","hentry","category-cognitive-agents","category-rules-engines","tag-ai-middleware","tag-ai-implant","tag-air-force","tag-assassins-creed","tag-autodesk","tag-avatars","tag-bigdog","tag-boston-dynamics","tag-chi-systems","tag-cognitive-modeling","tag-di-guy","tag-emergent-game-technologies","tag-emotion","tag-game-ai","tag-gamebryo","tag-gostai","tag-halo","tag-hierarchical-task-networks","tag-igen","tag-jupiter","tag-kynogon","tag-mad","tag-micro-analysis-design","tag-microsoft-robotics","tag-mybase","tag-non-player-characters","tag-npc","tag-playstation","tag-presagis","tag-robotics","tag-role-playing-games","tag-rpg","tag-simbionic","tag-soar","tag-soar-technology","tag-sof","tag-special-operations-forces","tag-stottler-henke","tag-synthetic-humans","tag-touchdown-entertainment","tag-urbi","tag-xbox"],"_links":{"self":[{"href":"http:\/\/haleyai.com\/wordpress\/wp-json\/wp\/v2\/posts\/92","targetHints":{"allow":["GET"]}}],"collection":[{"href":"http:\/\/haleyai.com\/wordpress\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"http:\/\/haleyai.com\/wordpress\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"http:\/\/haleyai.com\/wordpress\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"http:\/\/haleyai.com\/wordpress\/wp-json\/wp\/v2\/comments?post=92"}],"version-history":[{"count":1,"href":"http:\/\/haleyai.com\/wordpress\/wp-json\/wp\/v2\/posts\/92\/revisions"}],"predecessor-version":[{"id":857,"href":"http:\/\/haleyai.com\/wordpress\/wp-json\/wp\/v2\/posts\/92\/revisions\/857"}],"wp:attachment":[{"href":"http:\/\/haleyai.com\/wordpress\/wp-json\/wp\/v2\/media?parent=92"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"http:\/\/haleyai.com\/wordpress\/wp-json\/wp\/v2\/categories?post=92"},{"taxonomy":"post_tag","embeddable":true,"href":"http:\/\/haleyai.com\/wordpress\/wp-json\/wp\/v2\/tags?post=92"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}