IFAAMAS

77tthh IInntteerrnnaattiioonnaall JJooiinntt CCoonnffeerreennccee oonn AAuuttoonnoommoouuss AAggeennttss aanndd MMuullttiiaaggeenntt SSyysstteemmss

AAMAS 2008

May 12 - 16, 2008 Estoril, Portugal

Volume 1 of 3

Printed from e-media with permission by:

Curran Associates, Inc. 57 Morehouse Lane Red Hook, NY 12571 www.proceedings.com

ISBN: 978-1-60560-470-1

Some format issues inherent in the e-media version may also appear in this print version.

International Foundation for Autonomous Agents and Multiagent Systems (IFAAMAS)

Copyright © 2008

All Rights Reserved IFAAMAS

7th International Joint Conference on Autonomous Agents and Multiagent Systems 2008

TABLE OF CONTENTS

Volume 1

Computer Science and ...... 1 Yoav Shoham

Truthful Reputation Mechanisms for Online Systems...... 11 Radu Jurca

Cooperative control of small and micro air vehicles ...... 12 Randal W. Beard

Game-Theoretic Recommendations: Some Progress in an Uphill Battle ...... 13 Moshe Tennenholtz

Autonomous Virtual Humans and Lower Animals: From Biomechanics to Intelligence ...... 20 Demetri Terzopoulos

Adaptive Multi-Robot Wide-Area Exploration and Mapping...... 24 Kian Hsiang Low, John Dolan, Pradeep Khosla

A Decentralized Approach to Cooperative Situation Assessment in Multi-Robot Systems ...... 32 Giuseppe Settembre, Alessandro Farinelli, Paul Scerri, Katia Sycara, Daniele Nardi

Self-organized Flocking with a Mobile Robot Swarm ...... 40 Ali Turgut, Hande Celikkanat, Fatih Gokce, Erol Sahin

Autonomous Geocaching: Navigation and Goal Finding in Outdoor Domains ...... 48 James Neufeld, Michael Bowling, Jason Roberts, Stephen Walsh, Adam Milstein, Michael Sokolsky

The Impact of Adversarial Knowledge on Adversarial Planning in Perimeter Patrol ...... 56 Noa Agmon, Vladimir Sadov, Sarit Kraus, Gal Kaminka

A Realistic Model of Frequency-Based Multi-Robot Fence Patrolling ...... 64 Yehuda Elmaliach, Asaf Shiloni, Gal Kaminka

Sensing-based Shape Formation on Modular Multi-Robot Systems: A Theoretical Study ...... 72 Chih-Han Yu, Radhika Nagpal

PNP: A Formal Model for Representation and Execution of Multi-Robot Plans...... 80 Vittorio Ziparo, Luca Iocchi, Daniele Nardi, Pier Francesco Palamara, Hugo Costelha

An Empathic Virtual Dialog Agent to Improve Human-Machine Interaction...... 88 Magalie Ochs, Catherine Pelachaud, David Sadek

ERIC: A Generic Rule-based Framework for an Affective Embodied Commentary Agent ...... 96 Martin Strauss, Michael Kipp

The Identification of Users by Relational Agents ...... 104 Daniel Schulman, Mayur Sharma, Timothy Bickmore

Trackside DEIRA: A Dynamic Engaging Intelligent Reporter Agent ...... 111 François Knoppel, Almer Tigelaar, Danny Oude Bos, Thijs Alofs, Zsofi Ruttkay

Does the Contingency of Agents’ Nonverbal Feedback Affect Users’ Social Anxiety? ...... 119 Sin-Hwa Kang, Jonathan Gratch, Ning Wang, James Watt

The Design of a Generic Framework for Integrating ECA Components ...... 127 Hung-Hsuan Huang, Aleksandra Cerekovic, Igor Pandzic, Yukiko Nakano, Toyoaki Nishida

Being a Part of the Crowd: Toward Validating VR Crowds Using Presence ...... 135 Nuria Pelechano, Catherine Stocker, Jan Allbeck, Norman Badler

Simulation of Individual Spontaneous Reactive Behavior ...... 142 Alejandra Garcia-Rojas, Mario Gutierrez, Daniel Thalmann

SmartBody: Behavior Realization for Embodied Conversational Agents ...... 150 Marcus Thiebaux, Andrew Marshall, Stacy Marsella, Marcelo Kallmann

Distinctiveness in multimodal behaviours...... 158 Maurizio Mancini, Catherine Pelachaud

Modeling Parallel and Reactive Empathy in Virtual Agents: An Inductive Approach ...... 166 Scott McQuiggan, Jennifer Robison, Robert Phillips, James Lester

Towards Background Emotion Modeling for Embodied Virtual Agents...... 174 Luís Morgado, Graca Gaspar

MADeM: a multi-modal decision making for social MAS...... 182 Francisco Grimaldo, Miguel Lozano Ibañez, Fernando Barber

Dynamic Bayesian Network Based Interest Estimation for Visual Attentive Presentation Agents ...... 190 Boris Brandherm, Helmut Prendinger, Mitsuru Ishizuka

A Model of Gaze for the Purpose of Emotional Expression in Virtual Embodied Agents ...... 198 Brent Lance, Stacy Marsella

Politeness and Alignment in Dialogues with a Virtual Guide...... 206 Markus de Jong, Mariet Theune, Dennis Hofs

Cost-Based BDI Plan Selection for Change Propagation...... 214 Khanh Hoa Dam, Michael Winikoff

Integrating Artifact-Based Environments with Heterogeneous Agent Programming Platforms ...... 222 Alessandro Ricci, Michele Piunti, Lemi Daghan Acay, Rafael Bordini, Jomi Hübner, Mehdi Dastani

A Domain Specific Modeling Language for Multiagent Systems...... 230 Christian Hahn

A Model-driven, Agent-based Approach for the Integration of Services into a Collaborative BP ...... 238 Ingo Zinnikus, Christian Hahn, Klaus Fischer

Flexible Service Provisioning with Advance Agreements...... 246 Sebastian Stein, Terry Payne, Nick Jennings

Exploiting Organisational Information for Service Coordination in Multiagent Systems ...... 254 Alberto Fernandez, Sascha Ossowski

Towards verifying compliance in agent-based web service compositions...... 262 Alessio Lomuscio, Hongyang Qu, Monika Solanki

Semantic Matchmaking of Web Services using Model Checking...... 270 Akin Gunay, Pinar Yolum

Autonomous Transfer for Reinforcement Learning ...... 278 Matthew Taylor, Gregory Kuhlmann, Peter Stone

Analysis of an Evolutionary Reinforcement Learning Method in a Multiagent Domain ...... 286 Jan Hendrik Metzen, Mark Edgington, Yohannes Kassahun, Frank Kirchner

The Utility of Temporal Abstraction in Reinforcement Learning ...... 294 Nicholas Jong, Todd Hester, Peter Stone

Switching Dynamics of Multi-Agent Learning ...... 302 Peter Vrancx, Karl Tuyls, Ronald Westra, Ann Nowe

Modeling how Humans Reason about Others with Partial Information ...... 310 Sevan Ficici, Avi Pfeffer

Simultaneously Modeling Humans' Preferences and their Beliefs about Others' Preferences...... 318 Sevan Ficici, Avi Pfeffer

Opponent Modelling in Automated Multi-Issue Negotiation Using Bayesian Learning ...... 326 Dmytro Tykhonov, Koen Hindriks

A Few Good Agents: Multi-Agent Social Learning...... 334 Jean Oh, Stephen Smith

Sequential Decision Making in Repeated Coalition Formation under Uncertainty...... 342 Georgios Chalkiadakis, Craig Boutilier

Emerging coordination in infinite team Markov games ...... 350 Francisco Melo, Isabel Ribeiro

Approximate Predictive State Representations...... 358 Britton Wolfe, Michael James, Satinder Singh

MB-AIM-FSI : A Model Based Framework for exploiting gradient ascent MultiAgent Learners in Strategic...... 366 Doran Chakraborty, Sandip Sen

Sigma Point Policy Iteration ...... 374 Michael Bowling, Alborz Geramifard, David Wingate

Dynamics Based Control with PSRs...... 382 Ariel Adam, Zinovi Rabinovich, Jeffrey Rosenschein

Goal Generation with Relevant and Trusted Beliefs ...... 390 Célia da Costa Pereira, Andrea G. B. Tettamanzi

Suspending and Resuming Tasks in Intelligent Agents...... 398 John Thangarajah, James Harland, David Morley, Neil Yorke-Smith

Partial Goal Satisfaction and Goal Change...... 406 Yi Zhou, Leon van der Torre, Yan Zhang

Belief Operations for Motivated BDI Agents ...... 414 Patrick Krümpelmann, Matthias Thimm, Gabriele Kern-Isberner, Manuela Ritterskamp

A constrained argumentation system for practical reasoning...... 422 Leila Amgoud, Caroline Devred, Marie-Christine Lagasquie-Schiex

Using Enthymemes in an Inquiry Dialogue System ...... 430 Elizabeth Black, Anthony Hunter

A dialogue mechanism for public argumentation using conversation policies...... 438 Yuqing Tang, Simon Parsons

An Exact Algorithm for Solving MDPs under Risk-Sensitive Objective with One- Switch Utility Functions ...... 446 Yaxin Liu, Sven Koenig

Controlling Deliberation in a Markov Decision Process-Based Agent...... 454 George Alexander, Anita Raja, David Musliner

Generalized Adaptive A*...... 462 Xiaoxun Sun, Sven Koenig, William Yeoh

A Model of Contingent Planning for Agent Programming Languages...... 470 Yves Lesperance, Giuseppe De Giacomo, Atalay Ozgovde

Not All Agents Are Equal: Scaling up Distributed POMDPs for Agent Networks ...... 478 Janusz Marecki, Tapana Gupta, Pradeep Varakantham, Milind Tambe, Makoto Yokoo

The Permutable POMDP: Fast Solutions to POMDPs for Preference Elicitation ...... 486 Doshi Finale, Nicholas Roy

Value-Based Observation Compression for DEC-POMDPs ...... 494 Alan Carlin, Shlomo Zilberstein

No-Regret Learning and a Mechanism for Distributed Multi-Agent Planning ...... 502 Jan-P. Calliess, Geoffrey Gordon

Exploiting Locality of Interaction in Factored Dec-POMDPs...... 510 Frans Oliehoek, Matthijs Spaan, Shimon Whiteson, Nikos Vlassis

Interaction-Driven Markov Games for Decentralized Multiagent Planning under Uncertainty ...... 518 Matthijs Spaan, Francisco Melo

Regulating Air Traffic Flow with Coupled Agents ...... 526 Adrian Agogino, Kagan Tumer

Decentralized Algorithms for Collision Avoidance in Airspace...... 534 David Sislak, Jiri Samek, Michal Pechoucek

Heuristics for Negotiation Schedules in Multi-plan Optimization...... 542 Bo An, Fred Douglis, Fan Ye

Reaction Functions for Task Allocation to Cooperative Agents ...... 550 Xiaoming Zheng, Sven Koenig

Role-Based Teamwork Activity Recognition in Observations of Embodied Agent Actions ...... 558 Linus Luotsinen, Ladislau Boloni

Tags and Image Scoring for Robust Cooperation...... 566 Nathan Griffiths

Efficiently Determining the Appropriate Mix of Personal Interaction and Reputation Information in Partner Choice...... 574 Shulamit Reches, Philip Hendrix, Barbara Grosz, Sarit Kraus

BnB-ADOPT: An Asynchronous Branch-and-Bound DCOP Algorithm ...... 582 William Yeoh, Ariel Felner, Sven Koenig

Evaluating the Performance of DCOP Algorithms in a Real World, Dynamic Problem...... 590 Robert Junges, Ana Bazzan

On K-Optimal Distributed Constraint Optimization Algorithms: New Bounds and Algorithms ...... 598 Emma Bowring, Jonathan Pearce, Christopher Portway, Manish Jain, Milind Tambe

Volume 2

Automated Global-to-Local Programming in 1-D Spatial Multi-Agent Systems...... 606 Daniel Yamins, Radhika Nagpal

An Approach to Online Optimization of Heuristic Coordination Algorithms ...... 614 Jumpol Polvichai, Paul Scerri, Michael Lewis

Using Multi-agent Potential Fields in Real-time Games ...... 622 Johan Hagelbäck, Stefan Johansson

Decentralised Coordination of Low-Power Embedded Devices Using the Max- Sum Algorithm ...... 630 Alessandro Farinelli, Alex Rogers, Adrian Petcu, Nick Jennings

Look Where You Can See:Predictability & Criticality Metrics for Coordination in Complex Environments...... 638 Rajiv Maheswaran, Pedro Szekely, Marcel Becker, Stephen Fitzpatrick, Gergely Gati, Jing Jin, Robert Neches, Nader Noori, Craig Rogers,Romeo Sanchez, Kevin Smyth, Chris Van Buskirk

Aligning social welfare and agent preferences to alleviate traffic congestion ...... 646 Kagan Tumer, Zach Welch, Adrian Agogino

Quantifying Over Coalitions in Epistemic Logic ...... 654 Thomas Agotnes, Wiebe van der Hoek, Michael Wooldridge

Coalitions and Announcements ...... 662 Thomas Agotnes, Hans van Ditmarsch

Modelling Coalitions: ATL + Argumentation...... 670 Nils Bulling, Carlos I. Chesnevar, Jürgen Dix

Information-based Deliberation...... 678 Carles Sierra, John Debenham

A Temporal Logic for Markov Chains ...... 686 Wojtek Jamroga

Model-Checking Agent Refinement ...... 694 Lacramioara Astefanoaei, Frank S. de Boer

Goals in Agent Systems: A Unifying Framework ...... 702 M. Birna van Riemsdijk, Mehdi Dastani, Michael Winikoff

Internal models and private multi agent belief revision...... 710 Guillaume Aucher

Anchoring Institutions in Agents' Attitudes: Towards a Logical Framework for Autonomous MAS...... 717 Benoit Gaudou, Dominique Longin, Emiliano Lorini, Luca Tummolini

Verifying time, memory and communication bounds in systems of reasoning agents...... 725 Natasha Alechina, Brian Logan, Hoang Nga Nguyen, Abdur Rakib

Robust Normative Systems ...... 733 Thomas Agotnes, Wiebe van der Hoek, Michael Wooldridge

Sequential Decision Making with Untrustworthy Service Providers...... 741 Luke Teacy, Georgios Chalkiadakis, Alex Rogers, Nick Jennings

A Statistical Relational Model for Trust Learning...... 749 Achim Rettinger, Matthias Nickles, Volker Tresp

The Conclusion of Contracts by Software Agents in the Eyes of the Law ...... 757 Tina Balke, Torsten Eymann

Norm Emergence Under Constrained Interactions in Diverse Societies...... 765 Partha Mukherjee, Stephane Airiau, Sandip Sen

Checking Correctness of Business Contracts via Commitments ...... 773 Nirmit Desai, Nanjangud Narendra, Munindar Singh

Constitutive Interoperability ...... 781 Amit Chopra, Munindar Singh

Annotation and Matching of First-Class Agent Interaction Protocols ...... 789 Tim Miller, Peter McBurney

Agent Communication in Ubiquitous Computing: the Ubismart Approach ...... 797 Jurriaan van Diggelen, Robbert-Jan Beun, Rogier van Eijk, Peter J. Werkhoven

Using Organization Knowledge to Improve Routing Performance in Wireless Multi-Agent Networks ...... 805 Huzaifa Zafar, Victor Lesser, Dan Corkill, Deepak Ganesan

Conjunctive Queries for Ontology based Agent Communication in MAS ...... 813 Cassia Trojahn, Paulo Quaresma, Renata Vieira

A Cooperation-Based Approach For Evolution Of Service Ontologies ...... 821 Murat Sensoy, Pinar Yolum

Strategic Betting for Competitive Agents...... 829 Liad Wagman, Vincent Conitzer

Synthesis of Strategies from Interaction Traces ...... 837 Tsz-Chiu Au, Dana Nau, Sarit Kraus

Artificial agents learning human fairness ...... 845 Steven De Jong, Karl Tuyls, Katja Verbeeck

Self-Interested Database Managers Playing The View Maintenance Game...... 853 Hala Mostafa, Victor Lesser, Gerome Miklau

Zero-Intelligence Agents in Prediction Markets ...... 861 Abraham Othman

The Effects of Market-Making on Price Dynamics...... 869 Sanmay Das

Playing Games for Security: An Efficient Exact Algorithm for Solving Bayesian Stackelberg Games...... 877 Praveen Paruchuri, Jonathan Pearce, Janusz Marecki, Milind Tambe, Fernando Ordonez, Sarit Kraus

Solving two-person zero-sum repeated games of incomplete information...... 885 Andrew Gilpin, Tuomas Sandholm

A heads-up no-limit Texas Hold'em player: Discretized betting models and automatically generated equilibrium finding programs...... 893 Andrew Gilpin, Tuomas Sandholm, Troels Bjerre Sørensen

Computing an Approximate Jam/Fold Equilibrium for 3-player No-Limit Texas Hold'em Tournaments ...... 901 Sam Ganzfried, Tuomas Sandholm

Anonymity-Proof : Extending Shapley Value for Coalitional Games in Open Environments...... 909 Naoki Ohta, Vincent Conitzer, Yasufumi Satoh, Atsushi Iwasaki, Makoto Yokoo

An anytime approximation method for the inverse Shapley value problem ...... 917 Shaheen Fatima, Michael Wooldridge, Nick Jennings

Approximating Power Indices ...... 925 Yoram Bachrach, Vangelis Markakis, Ariel Proccacia, Jeffrey Rosenschein, Amin Saberi

Automated Design of Scoring Rules by Learning from Examples ...... 933 Ariel Procaccia, Aviv Zohar, Jeffrey Rosenschein

Evaluation of Election Outcomes under Uncertainty...... 941 Noam Hazon, Yonatan Aumann, Sarit Kraus, Michael Wooldridge

Complexity of Terminating Preference Elicitation...... 949 Toby Walsh

Divide and Conquer: False-Name Manipulations in Weighted Voting Games ...... 957 Yoram Bachrach, Edith Elkind

Copeland Voting: Ties Matter ...... 965 Piotr Faliszewski, Edith Hemaspaandra, Henning Schnoor

A Broader Picture of the Complexity of Strategic Behavior in Multi-Winner Elections ...... 973 Reshef Meir, Ariel Procaccia, Jeffrey Rosenschein

Power and Stability in Connectivity Games...... 981 Yoram Bachrach, Jeffrey Rosenschein, Ely Porat

A Tractable and Expressive Class of Marginal Contribution Nets and Its Applications...... 989 Edith Elkind, Leslie Ann Goldberg, Paul Goldberg, Michael Wooldridge

Cooperative Boolean Games ...... 997 Paul Dunne, Sarit Kraus, Wiebe van der Hoek, Michael Wooldridge

Coalitional Skill Games ...... 1005 Yoram Bachrach, Jeffrey Rosenschein

Mechanism Design for Abstract Argumentation ...... 1013 Iyad Rahwan, Kate Larson

Undominated VCG Redistribution Mechanisms ...... 1021 Mingyu Guo, Vincent Conitzer

Optimal-in-Expectation Redistribution Mechanisms ...... 1029 Mingyu Guo, Vincent Conitzer

Stochastic Search Methods for Approximation in Simulation- Based Games ...... 1037 Yevgeniy Vorobeychik, Michael Wellman

Searching for Approximate Equilibria in Empirical Games...... 1045 Patrick Jordan, Yevgeniy Vorobeychik, Michael Wellman

Computationally-efficient Winner Determination for Mixed Multi-Unit Combinatorial Auctions...... 1053 Andrea Giovannucci, Meritxell Vinyals, Juan A. Rodriguez-Aguilar, Jesus Cerquides

Characterizing effective auction mechanisms: Insights from the 2007 TAC market design competition ...... 1061 Jinzhong Niu, Kai Cai, Enrico Gerding, Peter McBurney, Simon Parsons

Mobile Opportunistic Commerce: Mechanisms, Architecture, and Application...... 1069 Ece Kamar, Eric Horvitz, Chris Meek

Selecting Strategies Using Empirical Game Models: An Experimental Analysis of Meta-Strategies ...... 1077 Christopher Kiekintveld, Michael Wellman

Distributed Multiagent Resource Allocation in Diminishing Marginal Return Domains ...... 1085 Yoram Bachrach, Jeffrey Rosenschein

Trajectories of Goods in Distributed Allocation ...... 1093 Yann Chevaleyre, Ulle Endriss, Nicolas Maudet

Resource Limitations, Transmission Costs and Critical Thresholds in Scale-Free Networks ...... 1101 Chung-Yuan Huang, Chuen-Tsai Sun, Chia-Ying Cheng, Yu-Shiuan Tsai

Agent-Based Simulation of the Spatial Dynamics of Crime...... 1109 Tibor Bosse, Charlotte Gerritsen

Reusing Models in Multi-Agent Simulation with Software Components ...... 1117 Paulo Salem da Silva, Ana Cristina Vieira de Melo

Agent-based Models for Animal Cognition: A Proposal and Prototype ...... 1125 Elske van der Vaart, Rineke Verbrugge

Multi Agent Based Simulation of Transport Chains...... 1133 Paul Davidsson, Johan Holmgren, Jan Persson, Linda Ramstedt

Programming Agents as a Means of Capturing Self-Strategy ...... 1141 Michal Chalamish, David Sarne, Sarit Kraus

On Reduced Time Fault Tolerant Paths for Multiple UAV Covering a Hostile Terrain ...... 1149 Rahul Sawhney, Madhava Krishna, Srinathan Kannan, Mahesh Mohan

Protoswarm: A Language for Programming Multi-Robot Systems Using the Amorphous Medium Abstraction ...... 1153 Jonathan Bachrach, James McLurkin, Anthony Grue

A Scalable and Distributed Model for Self-Organization and Self-Healing...... 1157 Michael Rubenstein, Wei-Min Shen

Teaching Multi-Robot Coordination using Demonstration of Communication and State Sharing ...... 1161 Sonia Chernova, Manuela Veloso

Modelling, Analysis and Execution of Multi-Robot Tasks using Petri Nets ...... 1165 Hugo Costelha, Pedro Lima

Coalition game-based distributed coverage of unknown environments by robot swarms...... 1169 Ke Cheng, Prithviraj Dasgupta

Decentralized Coordination of Automated Guided Vehicles...... 1173 David Herrero-Pérez, Humberto Martínez-Barberá

Robust Team Play in Highly Uncertain Environments...... 1177 Henry Work, Eric Chown, Tucker Hermans, Jesse Butterfield

A Coordination Mechanism for Swarm Navigation: Experiments and Analysis...... 1181 Leandro Marcolino, Luiz Chaimowicz openSDK - An Open-source Implementation of OPEN-R ...... 1185 Nuno Lopes, Pedro Lima

Multi-robot Markov Random Fields...... 1189 Jesse Butterfield, Odest Jenkins, Brian Gerkey

Creating Crowd Variation with the OCEAN Personality Model ...... 1193 Funda Durupinar, Jan Allbeck, Nuria Pelechano, Norman Badler

Influence of Social Relationships on Multiagent Persuasion...... 1197 Katsunori Kadowaki, Kazuki Kobayashi, Yasuhiko Kitamura

What Should the Agent Know? The Challenge of Capturing Human Knowledge...... 1201 Emma Norling iCat: An Affective Game Buddy Based on Anticipatory Mechanisms...... 1205 Iolanda Leite, Carlos Martinho, André Pereira, Ana Paiva

If I were you - Double appraisal in affective agents ...... 1209 Ruth Aylett, Sandy Louchart

Volume 3

User’s Gestural Exploration of Different Virtual Agents’ Expressive Profiles ...... 1213 Matthieu Courgeon, Jean-Claude Martin, Christian Jacquemin

Negotiating Task Interruptions with Virtual Agents for Health Behavior Change ...... 1217 Timothy Bickmore, Daniel Mauer, Francisco Crespo, Thomas Brown

The Senior Companion Multiagent Dialogue System ...... 1221 Hugo Pinto, Yorick Wilks, Roberta Catizone, Alexiei Dingli

Dancing the Night Away — Controlling a Virtual Karaoke Dancer by Multimodal Expressive Cues ...... 1225 Matthias Rehm, Thurid Vogt, Nikolaus Bee, Michael Wissner iCat, the Player: The influence of embodiment in the enjoyment of a game ...... 1229 André Pereira, Carlos Martinho, Iolanda Leite, Ana Paiva

Learning to Interact: Connecting Perception with Action in Virtual Environments...... 1233 Pedro Sequeira, Ana Paiva

The Intensity of Perceived Emotions in 3D Virtual Humans...... 1237 Ahmad Shaarani, Daniela Romano

Conviviality Masks in Multiagent Systems...... 1241 Patrice Caire, Serena Villata, Guido Boella, Leon van der Torre

So tell me what happened: turning agent-based interactive drama into comics...... 1245 Tiago Alves, Ana Rita Simões, Rui Figueiredo, Marco Vala, Ana Paiva, Ruth Aylett

Methods for Complex Single-Mind Architecture Designs ...... 1249 Kristinn Thorisson, Gudny Ragna Jonsdottir, Eric Nivel

The Intermediary Agent's Brain: Supporting Learning to Collaborate at the Inter- Personal Level...... 1253 Juan Martinez-Miranda, Bernhard Jung, Sabine Payr, Paolo Petta

A ‘Companion’ ECA with Planning and Activity Modelling ...... 1257 Marc Cavazza, Cameron Smith, Daniel Charlton, Li Zhang, Jaakko Hakulinen, Markku Turunen

Emotional Reading of Medical Texts Using Conversational Agents...... 1261 Gersende Georg, Catherine Pelachaud, Marc Cavazza

Individual Differences in Expressive Response: A Challenge for ECA Design ...... 1265 Ning Wang, Stacy Marsella, Tim Hawkins

Another Look at Search-Based Drama Management ...... 1269 Michael Mateas, Mark Nelson

On the Importance of Migration for Fairness in Online Grid Markets ...... 1273 Lior Amar, Ahuva Mu'alem, Jochen Stößer

A Flexible Framework for Verifiable Agent Programming...... 1277 Louise Dennis, Berndt Farwer, Rafael Bordini, Michael Fisher

Structure in Threes: Modelling Organization-Oriented Software Architectures Built Upon Multi-Agent Systems ...... 1281 Matthias Wester-Ebbinghaus, Daniel Moldt

Engineering Large-scale Distributed Auctions...... 1285 Peter Gradwell, Michel Oey, Reinier Timmer, Julian Padget, Frances Brazier

Ontology-based Test Generation for Multi Agent Systems...... 1289 Cu Nguyen, Anna Perini, Paolo Tonella

Non-linear Dynamics in Multiagent Reinforcement Learning Algorithms ...... 1293 Sherief Abdallah, Victor Lesser

Expediting RL by Using Graphical Structures...... 1297 Peng Dai, Alexander Strehl, Judy Goldsmith

Transfer of Task Representation in Reinforcement Learning using Policy-based Proto-value Functions ...... 1301 Eliseo Ferrante, Alessandro Lazaric, Marcello Restelli

Reinforcement Learning for DEC-MDPs with Changing Action Sets and Partially Ordered Dependencies...... 1305 Thomas Gabel, Martin Riedmiller

Using Adaptive Consultation of Experts to Improve Convergence Rates in Multiagent Learning...... 1309 Greg Hines, Kate Larson

A New Perspective to the Keepaway Soccer: The Takers...... 1313 Atil Iscen, Umut Erogul

On the Usefulness of Opponent Modeling: the Kuhn Poker case study ...... 1317 Alessandro Lazaric, Mario Quaresimale, Marcello Restelli

Graph Laplacian Based Transfer Learning in Reinforcement Learning ...... 1321 Yi-Ting Tsao, Ke-Ting Xiao, Von Wun Soo

Autonomous Agent Learning using an Actor-Critic Algorithm and Behavior Models...... 1325 Victor Uc Cetina

Teaching Sequential Tasks with Repetition through Voice and Vision ...... 1329 Harini Veeraraghavan, Manuela Veloso

Adaptive Kanerva-based Function Approximation for Multi-Agent Systems...... 1333 Cheng Wu, Waleed Meleis

Efficient Multi-Agent Reinforcement Learning through Automated Supervision ...... 1337 Chongjie Zhang, Sherief Abdallah, Victor Lesser

Continual Collaborative Planning for Mixed-Initiative Action and Interaction ...... 1341 Michael Brenner

Supervision and Diagnosis of Joint Actions in Multi-Agent Plans...... 1345 Roberto Micalizio, Pietro Torasso

Theoretical and Experimental Results on the Goal-Plan Tree Problem...... 1349 Patricia Shaw, Berndt Farwer, Rafael Bordini

Robust and Efficient Plan Recognition for Dynamic Multi-agent Teams...... 1353 Gita Sukthankar, Katia Sycara

Social Reward Shaping in the Prisoner's Dilemma...... 1357 Monica Babes, Enrique Munoz, Michael Littman

Mitigating Catastrophic Failure at Intersections of Autonomous Vehicles...... 1361 Kurt Dresner, Peter Stone

Multi-Agent Search using Sensors with Heterogeneous Capabilities ...... 1365 K.R.Guruprasad, Debasish Ghose

A new approach to cooperative pathfinding...... 1369 Renee Jansen, Nathan Sturtevant

Resource constrained distributed constraint optimization using resource constraint free pseudo-tree ...... 1373 Toshihiro Matsui, Marius Silaghi, Katsutoshi Hirayama, Makoto Yokoo, Hiroshi Matsuo

Coordination of First Responders Under Communication and Resource Constraints ...... 1377 Robert Lass, Joseph Kopena, Evan Sultanik, Duc Nguyen, Christopher Dugan, William Regli

Replacing the Stop Sign: Unmanaged Intersection Control for Autonomous Vehicles...... 1381 Mark Van Middlesworth, Kurt Dresner, Peter Stone

An Improved Dynamic Programming Algorithm for Coalition Structure Generation...... 1385 Talal Rahwan, Nick Jennings

Discovering Tactical Behaviour Patterns Supported by Topological Structures in Soccer-Agent Domains...... 1389 Fernando Ramos, Huberto Ayanegui

A Best-First Anytime Search Algorithm for Coalition Structure Generation...... 1393 Chattrakul Sombattheera, Aditya Ghose

RIAACT: A robust approach to adjustable autonomy for human-multiagent teams...... 1397 Nathan Schurr, Janusz Marecki, Milind Tambe, Chien-Ju Ho, Jane Yung-jen Hsu

Adaptive Manager-side Control Policy in Contract Net Protocol for Massively Multi-Agent Systems...... 1401 Sugawara Toshiharu, Satoshi Kurihara, Toshio Hirotsu, Kensuke Fukuda

Towards Bidirectional Distributed Matchmaking ...... 1405 Victor Shafran, Gal Kaminka, Sarit Kraus, Claudia Goldman

Designing Human-Computer Multi-agent Collaboration in Productive Multi-Player Games ...... 1409 Wenn-Chieh Tsai, Yuan-Hsiang Lee, Tsung-Hsiang Chang , Chien-Ju Ho, Jane Yung-jen Hsu

Trading Off Solution Quality for Faster Computation in DCOP Search Algorithms ...... 1413 William Yeoh, Sven Koenig, Xiaoxun Sun

Anytime Local Search for Distributed Constraint Optimization ...... 1417 Roie Zivan

Reasoning about agent deliberation...... 1421 Natasha Alechina, Mehdi Dastani, Brian Logan, John-Jules Meyer

Negotiation by Induction...... 1425 Chiaki Sakama

Epistemic Logic and Explicit Knowledge in Distributed Programming ...... 1429 Andreas Witzel, Jonathan Zvesper

Identifying Beneficial Teammates using Multi-Dimensional Trust ...... 1433 Jaesuk Ahn, Xin Sui, David DeAngelis, Suzanne Barber

Simulating the Effects of Sanction for the Emergence of Cooperation in a ...... 1437 Ana Bazzan, Silvio Dahmen, Alexandre Baraviera

Learning Task-Specific Trust Decisions...... 1441 Ikpeme Erete, Erin Ferguson, Sandip Sen

Specifying and Enforcing Norms in Artificial Institutions...... 1445 Nicoletta Fornara, Marco Colombetti

An Adaptive Probabilistic Trust Model and its Evaluation...... 1449 Chung-Wei Hang, Yonghong Wang, Munindar Singh

Extending Virtual Organizations to improve trust mechanisms...... 1453 Ramón Hermoso, Roberto Centeno Sánchez, Holger Billhardt, Sascha Ossowski

Convergence at Prominent Agents: A Non-Flat Synchronization Model of Situated Multi-Agents ...... 1457 Jiuchuan Jiang, Yichuan Jiang

How Automated Agents Treat Humans and Other Automated Agents in Situations of Inequity: An Experimental Study ...... 1461 Ron Katz, Sarit Kraus

A Distributed Normative Infrastructure for Situated Multi-Agent Organisations...... 1465 Fabio Okuyama, Rafael Bordini, Antonio Costa

Modeling and Managing Collective Cognitive Convergence...... 1469 Van Parunak, Ted Belding, Rainer Hilscher, Sven Brueckner

Determining Top K Nodes in Social Networks using the Shapley Value ...... 1473 Narayanam RamaSuri, Y. Narahari

Simulating Human Behaviors in Agent Societies...... 1477 Alicia Ruvinsky, Michael Huhns

Do Humans Identify Efficient Strategies in Structured Peer-to-Peer Systems? ...... 1481 Stephan Schosser, Klemens Böhm, Bodo Vogt

Social norm emergence in virtual agent societies ...... 1485 Bastin Tony Roy Savarimuthu, Maryam Purvis, Martin Purvis

Searching and Sharing Information In Networks of Heterogeneous Agents ...... 1489 George Vouros

Stable cooperation in changing environments...... 1493 Colm O'Riordan, Humphrey Sorensen

Efficient Approximate Inference in Distributed Bayesian Networks for MAS-based Sensor Interpretation...... 1497 Norman Carver

Synchronization Protocols for Reliable Communication in Fully Distributed Agent Systems ...... 1501 Hywel Dunn-Davies, Jim Cunningham, Shamima Paurobally

A Multi-Agent Based Implementation of a Delphi Process...... 1505 Ivan Garcia-Magariño, Jorge Gomez Sanz, Jose R. Perez-Aguera

Strategyproof Deterministic Lotteries under Broadcast Communications ...... 1509 Alon Altman, Moshe Tennenholtz

Decommitment in Multi-resource Negotiation ...... 1513 Bo An, Victor Lesser, Kwang Mong Sim

Incentives in Effort Games...... 1517 Yoram Bachrach, Jeffrey Rosenschein

Learn While You Earn: Two Approaches to Learning Auction Parameters in Take- it-or-leave-it Auctions ...... 1521 Archie Chapman, Alex Rogers, Nick Jennings

Incorporating User Utility Into Sponsored-Search Auctions...... 1525 Yagil Engel, David Maxwell Chickering

Nonuniform Bribery ...... 1529 Piotr Faliszewski

A Preliminary result on a representative-based multi-round protocol for multi- issue negotiations...... 1533 Katsuhide Fujita, Takayuki Ito, Mark Klein

Approximating Mixed Nash Equilibria using Smooth in Simultaneous Auctions ...... 1537 Enrico Gerding, Andrew Byde, Edith Elkind, Zinovi Rabinovich, Nick Jennings

Achieving Efficient and Equitable Collaboration among Selfish Agents using Spender-Signed Currency...... 1541 Geert Jonker, Frank Dignum, John-Jules Meyer

Optimized Algorithms for Multi-Agent Routing ...... 1545 Akihiro Kishimoto, Nathan Sturtevant

Evolutionary Dynamics for Designing Multi-Period Auctions...... 1549 Tomas Klos, Gerrit Jan Van Ahee

Understanding How People Design Trading Agents over Time ...... 1553 Efrat Manistersky, Raz Lin, Sarit Kraus

Approximate Bidding Algorithms for a Distributed Combinatorial Auction...... 1557 Benito Mendoza, Jose Vidal

Comparing Winner Determination Algorithms for Mixed Multi-Unit Combinatorial Auctions...... 1561 Brammert Ottens, Ulle Endriss

Asynchronous Congestion Games...... 1565 Michal Penn, Maria Polukarov, Moshe Tennenholtz

Beyond quasi-linear utility: strategy/false-name-proof multi-unit auction protocols...... 1569 Yuko Sakurai, Yasumasa Saito, Atsushi Iwasaki, Makoto Yokoo

Abstractions for Model-Checking Game-theoretic Properties in Combinatorial Auctions...... 1573 Emmanuel Tadjouddine, Frank Guerin, Wamberto Vasconcelos

Winner Determination in Combinatorial Auctions with Logic-based Bidding Languages ...... 1577 Joel Uckelman, Ulle Endriss

Towards Agents Participating in Realistic Multi-Unit Sealed-Bid Auctions ...... 1581 Ioannis Vetsikas, Nick Jennings

Shared Focus of Attention for Heterogeneous Agents...... 1585 Jacob Beal

Physical Parameter Optimization in Swarms of Ultra-Low Complexity Agents...... 1589 Ryan Connaughton, Paul Schermerhorn, Matthias Scheutz

An adaptive and customizable feedback system for VR-based training simulators ...... 1593 Maite Lopez-Garate, Alberto Lozano-Rodero, Luis Matey

An Agent Adaptive Model for Self-Organizing Multi-Agent Systems ...... 1597 Candelaria Sansores, Juan Pavón

GS3 and Tartanian: Game theory-based heads-up limit and no-limit Texas Hold'em poker-playing programs...... 1601 Andrew Gilpin, Tuomas Sandholm, Troels Bjerre Sorensen

JCAT: A Platform for the TAC Market Design Competition...... 1603 Jinzhong Niu, Kai Cai, Enrico Gerding, Peter McBurney, Thierry Moyaux, Steve Phelps, Dave Shield, Simon Parsons

Agent-Based Coordination Technologies in Disaster Management ...... 1605 Sarvapali D. Ramchurn, Alex Rogers, Kathryn Macarthur, Alessandro Farinelli, Perukrishnen Vytelingum, Ioannis Vetsikas, Nicholas. R. Jennings

Evacuation Guide System based on Massively Multiagent System...... 1607 Yuu Nakajima, Shohei Yamane, Hiromitsu Hattori, Toru Ishida

An Agent-Based Electrical Power Market...... 1609 Jaime Cerda Jacobo, David De Roure, Enrico Gerding

Electronic Institutions Development Environment ...... 1611 Marc Esteva, Juan Antonio Rodriguez-Aguilar, Josep Lluis Arcos, Carles Sierra, Pablo Noriega, Bruno Rosel ,David de la Cruz

Multi-Agent Plan Diagnosis and Negotiated Repair ...... 1613 Huib Aldewereld, Pieter Buzing, Geert Jonker, Femke de Jonge, Frank Dignum, John-Jules Ch. Meyer, Nico Roos, Cees Witteveen

Colored Trails: A Multiagent System Testbed for Decision-Making Research ...... 1615 Sevan Ficici, Avi Pfeffer, Ya'akov Gal, Barbara Grosz, Stuart Shieber

SecondLife as an Evaluation Platform for Multiagent Systems Featuring Social Interactions...... 1617 Matthias Rehm, Peter Rosina

AGENTFLY: A Multi-Agent Airspace Test-bed...... 1619 David Sislak, Premysl Volf, Stepan Kopriva, Michal Pechoucek

DCOPolis: A Framework for Simulating and Deploying Distributed Constraint Reasoning Algorithms...... 1621 Evan A. Sultanik, Robert N. Lass, William C. Regli eCAT: a Tool for Automating Test Cases Generation and Execution in Testing Multi-Agent Systems...... 1623 Cu Duy Nguyen, Anna Perini, Paolo Tonella

SEAGENT MAS Platform Development Environment ...... 1625 Oguz Dikenelli

Automated Unit Testing Intelligent Agents in PDT...... 1627 Zhiyong Zhang, John Thangarajah, Lin Padgham

INGENIAS Development Kit: a visual multi-agent system development environment...... 1629 Jorge J. Gomez-Sanz, Rubén Fuentes, Juan Pavón, Ivan García-Magarino

OperettA: A prototype tool for the design, analysis and development of multi- agent organizations ...... 1631 Daniel M. Okouya, Virginia Dignum

A Context-Aware Personal Desktop Assistant ...... 1633 H. H. Bui, F. Cesari, D. Elenius, D. N. Morley, S. Natarajan, S. Saadati, E. Yeh, N. Yorke- Smith

Trackside DEIRA: A Dynamic Engaging Intelligent Reporter Agent ...... 1635 Francois L.A. Knoppel, Almer S. Tigelaar, Danny Oude Bos, Thijs Alofs, Zsofia Ruttkay

Dynamic Scheduling of Multi-media Streams in Home Automation Systems...... 1637 Koen Vangheluwe, Wouter Souffriau, Katja Verbeeck, Patrick De Causmaecker

Urban Form-making through Biased Agent Interaction...... 1639 Kaustuv De Biswas, Simon Kim

Demonstration of Multi-agent Potential Fields in Real-time Strategy Games ...... 1641 Johan Hagelbäck, Stefan J. Johansson

Simulation of Sensor-based Tracking in Second Life...... 1643 Boris Brandherm, Sebastian Ullrich, Helmut Prendinger

A Mobile Agent Approach to Opportunistic Harvesting in Wireless Sensor Networks ...... 1645 R. Tynan, C. Muldoon, M. J. O'Grady, G. M. P. O'Hare

Multi-Agent Approach to Network Intrusion Detection...... 1647 Martin Rehak, Michal Pechoucek, Pavel Celeda, Vojtech Krmicek, Karel Bartos, Martin Grill

Max-Sum Decentralised Coordination for Sensor Systems...... 1649 W. T. L. Teacy, A. Farinelli, N. J. Grabham, P. Padhy, A. Rogers, N. R. Jennings

A Multi-Agent Platform for Auction-Based Allocation of Loads in Transportation Logistics ...... 1651 Han Noot, Valentin Robu, Han La Poutré, Willem-Jan van Schijndel

LS/ABPM - An Agent-powered Suite for Goal-oriented Autonomic BPM ...... 1653 Giovanni Rimassa, Martin E. Kernland, Roberto Ghizzioli

AERIAL : Hypothetical Trajectory Planning for Multi-UAVs Coordination and Control...... 1655 Paul-Edouard Marson, Michael Soulignac, Patrick Taillibert

Coordination in Ambiguity: Coordinated Active Localization for Multiple Robots...... 1657 Shivudu Bhuvanagiri, Madhava Krishna, Supreeth Achar

Coordination of AGVs in an Industrial Environment...... 1659 David Herrero-Perez, Humberto Martinez-Barber

Multi-robot Petri Net Plans: A robotic soccer passing demo...... 1661 P.F. Palamara, V. A. Ziparo, L. Iocchi, D. Nardi, P. Lima, H. Costelha

An Embodied Conversational Agent as a Lifestyle Advisor ...... 1663 Cameron Smith, Daniel Charlton, Li Zhang, Jaakko Hakulinen, Markku Turunen, Marc Cavazza

GoGoBot: Group Collaboration, Multi-Agent Modeling, and Robots ...... 1665 William Rand, Paulo Blikstein, Uri Wilensky

Engineering Self-Organizing Multi-Agent Systems...... 1667 Radhika Nagpal, Chih-han Yu, Daniel Yamins

Models and Algorithmic Approaches for Cooperative Multi-Robot Systems...... 1668 Noa Agmon

Content-Oriented Composite Service Negotiation with Complex Preferences...... 1670 Reyhan Aydo?an

Designing Convivial Digital Cities...... 1672 Patrice Caire

Business Process Interoperability...... 1675 Amit K. Chopra

AIM: Autonomous Intersection Management ...... 1677 Kurt Dresner

Multi-Agent Search using Sensors with Heterogeneous Capabilities ...... 1679 K. R. Guruprasad

An agent-oriented approach to support change propagation in software evolution ...... 1681 Khanh Hoa Dam

Emotionally Based Multi-Agent E-Commerce Platform...... 1683 Nicolae Jascanu

Automatic Induction of Generalization Hierarchies for Reinforcement Learning...... 1685 Nicholas K. Jong

Fairness in Multi-Agent Systems ...... 1687 Steven de Jong

Extending agent languages for autonomy ...... 1689 Felipe Rech Meneguzzi

Cognitive agents with non-monotonic reasoning ...... 1691 Peter Novák

An Interactive Platform for Auction-Based Allocation of Loads in Transportation Logistics ...... 1693 Valentin Robu, Han Noot, Han La Poutré, Willem-Jan van Schijndel

Pan-supplier Stock Control in a Virtual Warehouse...... 1701 Emad El-Deen El-Akehal, Julian Padget

Autonomic Machine Control - A Case Study ...... 1709 Christian Dannegger, Dominic Greenwood

MasDISPO_xt: Heat and Sequence Optimisation based on Simulated Trading inside the Supply Chain of Steel Production ...... 1713 Sven Jacobi, David Raber, Klaus Fischer

WADE: A software platform to develop mission critical applications exploiting agents and workflows...... 1717 Giovanni Caire, Danilo Gotta, Massimo Banzi

BDI-Agents for Agile Goal-Oriented Business Processes...... 1725 Birgit Burmeister, M. Arnold, Felicia Copaciu, Giovanni Rimassa

Agent-based Patient Admission Scheduling in Hospitals...... 1733 Anke K. Hutzschenreuter, Peter A. N. Bosman, Ilona Blonk-Altena, Jan van Aarle, Han La Poutré

Case Studies for Contract-based Systems ...... 1741 Michal Jakob, Michal Pechoucek, Simon Miles, Michael Luck

Electronic contracting in aircraft aftercare: A case study...... 1749 Felipe Meneguzzi, Simon Miles, Michael Luck, Camden Holt, Malcolm Smith

Argumentation-based agents for eProcurement ...... 1757 Paul-Amaury Matt, Francesca Toni, Thanassis Stournaras, Dimitris Dimitrelos

Agent-Community-Network-based Business Matching and Collaboration Support System ...... 1761 Tsunenori Mine, Kosaku Kimura, Satoshi Amamiya, Ken'ichi Takahashi, Makoto Amamiya

A Multi-Agent Simulation System for Prediction and Scheduling of Aero Engine Overhaul...... 1765 Armin Stranjak, Partha Sarathi Dutta, Mark Ebden, Alex Rogers, Perukrishnen Vytelingum

Transitioning Multiagent Technology to UAV Applications ...... 1773 Paul Scerri, Tracy Von Gonten, Gerald Fudge, Sean Owens, Katia Sycara

OpCog: An Industrial Development Approach for Cognitive Agent Systems in Military UAV Applications ...... 1781 Kai Reichel, Nico Hochgeschwender, Holger Voos

Towards a Reliable Air Traffic Control...... 1785 Minh Nguyen-Duc, Zahia Guessoum, Olivier Marin, Jean-François Perrot, Jean-Pierre Briot, Vu Duong

Autonomic Multi-Agent Management of Power and Performance in Data Centers...... 1789 Rajarshi Das, Jeffrey O. Kephart, Charles Lefurgy, Gerald Tesauro, David W. Levine, Hoi Chan

Cooperative search for optimizing pipeline operations...... 1797 T. Mora, A.B. Sesay, J. Denzinger, H. Golshan, G. Poissant, C. Konecnik

Deployed ARMOR Protection: The Application of a Game Theoretic Model for Security at the Los Angeles International Airport ...... 1805 James Pita, Manish Jain, Janusz Marecki, Fernando Ordóñez, Christopher Portway, Milind Tambe, Craig Western, Praveen Paruchuri, Sarit Kraus

CAMNEP: Agent-Based Network Intrusion Detection System...... 1813 Martin Rehak, Michal Pechoucek, Pavel Celeda, Jiri Novotny, Pavel Minarik

Author Index