SlideShare una empresa de Scribd logo
1 de 13
1
Evolving the strategies of agents for the ANTS
Game
J. Carpio, P. García-Sánchez, A.M. Mora,
J.J. Merelo, J. Caraballo1, F. Vaz , C. Cotta
IWANN 2013, Tenerife, 12-14 July
2
Agenda
●
RTS Games
●
Google AI Challenge
●
ANTS game
●
Bot Behaviour
●
Parameters to optimize
●
Fitness used
●
Experimental Setup
●
Results
●
Conclusions
3
RTS Games
●
Real-Time Strategy Games
●
Several units distributed in a playing arena that
competes for resources
●
Examples: StarCraft, WarCraft, Age of Empires
4
Google AI Challenge
●
Create AIs for RTS games: TRON (2010), Planet
Wars (2011) , and ANTS (2012)
●
Each submission competes with the others in the
Google server
5
ANTS Game
●
Objective: conquer all the anthills of the enemy
●
Surround enemy's ants to kill them
●
Collect food to create more ants
●
Restrictions
–
Algorithms can not use previous fighting information.
–
Only a second per turn to move the ants colony.
6
Maps
7
Bot Behaviour
IF enemy hill in sight
attack the hill
ELSE IF food in sight
pick up the food
ELSE IF enemy ants in sight
attack the ants
ELSE IF non-explored zone in sight
explore the area randomly
8
Parameters to optimize with the GA
●
Food distance
●
Time remaining margin
●
Distances to hill/ant
●
Turns during left mode
9
Fitness used
●
Standard: using only the “score” (number of anthills
conquered)
●
Hierarchical: a tuple with [score, -enemy's score,
number of ants, -number of enemy's ants]
10
Experimental Setup
●
Six different maps have been used
●
Each fitness evaluation is made 10 times
●
64 individuals
●
0,3 crossover rate
●
Pool of 32 best parents
●
After the training we compare versus the winner of
the competition and positions 165 and 993.
11
Results
●
Prior to optimization of the parameters, our bot ended
in position 2076.
●
But after optimization, it wins the bot in position 993
●
Number 1 and 163 were very competitive, but using
the optimized parameters with the hierarchical fitness
increased the number of ants and decreased the
enemy's ant
12
Conclusions
●
A simple agent can be optimized to win better
opponents
●
Hierarchical fitness increases the chances to win
(adding more information)
●
The strategy depends of the enemies
●
Future work: map analysis, online adaptation,
analysis of the enemies...
13
Thanks!

Más contenido relacionado

Destacado

Environmental Intelligence for Coastal Communities
Environmental Intelligence for Coastal CommunitiesEnvironmental Intelligence for Coastal Communities
Environmental Intelligence for Coastal CommunitiesChesapeake Bay Foundation
 
October 21 -22. idiom, vp 7 quiz, re 4 a text, novel discussion groups
October 21 -22. idiom, vp 7 quiz, re 4 a text, novel discussion groupsOctober 21 -22. idiom, vp 7 quiz, re 4 a text, novel discussion groups
October 21 -22. idiom, vp 7 quiz, re 4 a text, novel discussion groupsIECP
 
"Ο κόσμος των παιδιών "εισήγηση συνεδρίου
"Ο  κόσμος των παιδιών "εισήγηση συνεδρίου"Ο  κόσμος των παιδιών "εισήγηση συνεδρίου
"Ο κόσμος των παιδιών "εισήγηση συνεδρίουΥπουργείο Παιδείας
 
Carteles experiencias2013
Carteles experiencias2013Carteles experiencias2013
Carteles experiencias2013cepdegranada
 
01 peyo yavorov school
01 peyo yavorov school01 peyo yavorov school
01 peyo yavorov schoolPepi Nikova
 
σεναριο τριτησ παρεμβασησ
σεναριο τριτησ παρεμβασησσεναριο τριτησ παρεμβασησ
σεναριο τριτησ παρεμβασησpankatrisiosi
 
Red rock infosolutions Web Development Portfolio
Red rock infosolutions Web Development PortfolioRed rock infosolutions Web Development Portfolio
Red rock infosolutions Web Development PortfolioVinay Mani
 

Destacado (13)

41 55
41 5541 55
41 55
 
Environmental Intelligence for Coastal Communities
Environmental Intelligence for Coastal CommunitiesEnvironmental Intelligence for Coastal Communities
Environmental Intelligence for Coastal Communities
 
October 21 -22. idiom, vp 7 quiz, re 4 a text, novel discussion groups
October 21 -22. idiom, vp 7 quiz, re 4 a text, novel discussion groupsOctober 21 -22. idiom, vp 7 quiz, re 4 a text, novel discussion groups
October 21 -22. idiom, vp 7 quiz, re 4 a text, novel discussion groups
 
"Ο κόσμος των παιδιών "εισήγηση συνεδρίου
"Ο  κόσμος των παιδιών "εισήγηση συνεδρίου"Ο  κόσμος των παιδιών "εισήγηση συνεδρίου
"Ο κόσμος των παιδιών "εισήγηση συνεδρίου
 
Taller d'aromes
Taller d'aromesTaller d'aromes
Taller d'aromes
 
Carteles experiencias2013
Carteles experiencias2013Carteles experiencias2013
Carteles experiencias2013
 
01 peyo yavorov school
01 peyo yavorov school01 peyo yavorov school
01 peyo yavorov school
 
Mabel
MabelMabel
Mabel
 
Radhika
RadhikaRadhika
Radhika
 
Periódico
PeriódicoPeriódico
Periódico
 
σεναριο τριτησ παρεμβασησ
σεναριο τριτησ παρεμβασησσεναριο τριτησ παρεμβασησ
σεναριο τριτησ παρεμβασησ
 
Vysoké Mýto
Vysoké MýtoVysoké Mýto
Vysoké Mýto
 
Red rock infosolutions Web Development Portfolio
Red rock infosolutions Web Development PortfolioRed rock infosolutions Web Development Portfolio
Red rock infosolutions Web Development Portfolio
 

Último

Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...
Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...
Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...Angeliki Cooney
 
Platformless Horizons for Digital Adaptability
Platformless Horizons for Digital AdaptabilityPlatformless Horizons for Digital Adaptability
Platformless Horizons for Digital AdaptabilityWSO2
 
Exploring Multimodal Embeddings with Milvus
Exploring Multimodal Embeddings with MilvusExploring Multimodal Embeddings with Milvus
Exploring Multimodal Embeddings with MilvusZilliz
 
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot TakeoffStrategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoffsammart93
 
DEV meet-up UiPath Document Understanding May 7 2024 Amsterdam
DEV meet-up UiPath Document Understanding May 7 2024 AmsterdamDEV meet-up UiPath Document Understanding May 7 2024 Amsterdam
DEV meet-up UiPath Document Understanding May 7 2024 AmsterdamUiPathCommunity
 
Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...
Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...
Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...Orbitshub
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerThousandEyes
 
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...DianaGray10
 
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...apidays
 
MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024MIND CTI
 
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024Victor Rentea
 
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWEREMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWERMadyBayot
 
FWD Group - Insurer Innovation Award 2024
FWD Group - Insurer Innovation Award 2024FWD Group - Insurer Innovation Award 2024
FWD Group - Insurer Innovation Award 2024The Digital Insurer
 
ICT role in 21st century education and its challenges
ICT role in 21st century education and its challengesICT role in 21st century education and its challenges
ICT role in 21st century education and its challengesrafiqahmad00786416
 
WSO2's API Vision: Unifying Control, Empowering Developers
WSO2's API Vision: Unifying Control, Empowering DevelopersWSO2's API Vision: Unifying Control, Empowering Developers
WSO2's API Vision: Unifying Control, Empowering DevelopersWSO2
 
Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf
Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdfRising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf
Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdfOrbitshub
 
Mcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot Model
Mcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot ModelMcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot Model
Mcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot ModelDeepika Singh
 
presentation ICT roal in 21st century education
presentation ICT roal in 21st century educationpresentation ICT roal in 21st century education
presentation ICT roal in 21st century educationjfdjdjcjdnsjd
 
"I see eyes in my soup": How Delivery Hero implemented the safety system for ...
"I see eyes in my soup": How Delivery Hero implemented the safety system for ..."I see eyes in my soup": How Delivery Hero implemented the safety system for ...
"I see eyes in my soup": How Delivery Hero implemented the safety system for ...Zilliz
 
Artificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : UncertaintyArtificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : UncertaintyKhushali Kathiriya
 

Último (20)

Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...
Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...
Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...
 
Platformless Horizons for Digital Adaptability
Platformless Horizons for Digital AdaptabilityPlatformless Horizons for Digital Adaptability
Platformless Horizons for Digital Adaptability
 
Exploring Multimodal Embeddings with Milvus
Exploring Multimodal Embeddings with MilvusExploring Multimodal Embeddings with Milvus
Exploring Multimodal Embeddings with Milvus
 
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot TakeoffStrategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
 
DEV meet-up UiPath Document Understanding May 7 2024 Amsterdam
DEV meet-up UiPath Document Understanding May 7 2024 AmsterdamDEV meet-up UiPath Document Understanding May 7 2024 Amsterdam
DEV meet-up UiPath Document Understanding May 7 2024 Amsterdam
 
Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...
Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...
Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
 
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
 
MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024
 
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
 
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWEREMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
 
FWD Group - Insurer Innovation Award 2024
FWD Group - Insurer Innovation Award 2024FWD Group - Insurer Innovation Award 2024
FWD Group - Insurer Innovation Award 2024
 
ICT role in 21st century education and its challenges
ICT role in 21st century education and its challengesICT role in 21st century education and its challenges
ICT role in 21st century education and its challenges
 
WSO2's API Vision: Unifying Control, Empowering Developers
WSO2's API Vision: Unifying Control, Empowering DevelopersWSO2's API Vision: Unifying Control, Empowering Developers
WSO2's API Vision: Unifying Control, Empowering Developers
 
Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf
Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdfRising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf
Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf
 
Mcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot Model
Mcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot ModelMcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot Model
Mcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot Model
 
presentation ICT roal in 21st century education
presentation ICT roal in 21st century educationpresentation ICT roal in 21st century education
presentation ICT roal in 21st century education
 
"I see eyes in my soup": How Delivery Hero implemented the safety system for ...
"I see eyes in my soup": How Delivery Hero implemented the safety system for ..."I see eyes in my soup": How Delivery Hero implemented the safety system for ...
"I see eyes in my soup": How Delivery Hero implemented the safety system for ...
 
Artificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : UncertaintyArtificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : Uncertainty
 

Ants iwann jcc

  • 1. 1 Evolving the strategies of agents for the ANTS Game J. Carpio, P. García-Sánchez, A.M. Mora, J.J. Merelo, J. Caraballo1, F. Vaz , C. Cotta IWANN 2013, Tenerife, 12-14 July
  • 2. 2 Agenda ● RTS Games ● Google AI Challenge ● ANTS game ● Bot Behaviour ● Parameters to optimize ● Fitness used ● Experimental Setup ● Results ● Conclusions
  • 3. 3 RTS Games ● Real-Time Strategy Games ● Several units distributed in a playing arena that competes for resources ● Examples: StarCraft, WarCraft, Age of Empires
  • 4. 4 Google AI Challenge ● Create AIs for RTS games: TRON (2010), Planet Wars (2011) , and ANTS (2012) ● Each submission competes with the others in the Google server
  • 5. 5 ANTS Game ● Objective: conquer all the anthills of the enemy ● Surround enemy's ants to kill them ● Collect food to create more ants ● Restrictions – Algorithms can not use previous fighting information. – Only a second per turn to move the ants colony.
  • 7. 7 Bot Behaviour IF enemy hill in sight attack the hill ELSE IF food in sight pick up the food ELSE IF enemy ants in sight attack the ants ELSE IF non-explored zone in sight explore the area randomly
  • 8. 8 Parameters to optimize with the GA ● Food distance ● Time remaining margin ● Distances to hill/ant ● Turns during left mode
  • 9. 9 Fitness used ● Standard: using only the “score” (number of anthills conquered) ● Hierarchical: a tuple with [score, -enemy's score, number of ants, -number of enemy's ants]
  • 10. 10 Experimental Setup ● Six different maps have been used ● Each fitness evaluation is made 10 times ● 64 individuals ● 0,3 crossover rate ● Pool of 32 best parents ● After the training we compare versus the winner of the competition and positions 165 and 993.
  • 11. 11 Results ● Prior to optimization of the parameters, our bot ended in position 2076. ● But after optimization, it wins the bot in position 993 ● Number 1 and 163 were very competitive, but using the optimized parameters with the hierarchical fitness increased the number of ants and decreased the enemy's ant
  • 12. 12 Conclusions ● A simple agent can be optimized to win better opponents ● Hierarchical fitness increases the chances to win (adding more information) ● The strategy depends of the enemies ● Future work: map analysis, online adaptation, analysis of the enemies...