Optimal Channel-Switching Strategies in Multi-Channel Wireless Networks

Total Page:16

File Type:pdf, Size:1020Kb

Optimal Channel-Switching Strategies in Multi-Channel Wireless Networks Optimal Channel-Switching Strategies in Multi-channel Wireless Networks by Qingsi Wang A dissertation submitted in partial fulfillment of the requirements for the degree of Doctor of Philosophy (Electrical Engineering: Systems) in The University of Michigan 2014 Doctoral Committee: Professor Mingyan Liu, Chair Assistant Professor Jacob Abernethy Associate Professor Achilleas Anastasopoulos Professor Demosthenis Teneketzis c Qingsi Wang 2014 All Rights Reserved To my parents and grandparents ii ACKNOWLEDGEMENTS I would like to express my gratitude to my advisor Professor Mingyan Liu, who offered me the great opportunity to become a Wolverine and guided me through years of study and work, as an excellent mentor and friend. I would also like to thank all my committee members, Professors Demosthenis Teneketzis, Achilleas Anastasopoulos and Jacob Abernethy, who have also given me so many enlightening lectures with so much intellectual fun, which is one of the most important parts of my graduate education. I am also thankful to all my friends in Ann Arbor and in China, for the million times of chatting on random topics, for all the Chinese and exotic food we shared, for the “tons of damage” we dealt in the League of Legends, for all the sweet bitter time in life we spent together. I definitely want to thank the lovely town Ann Arbor. The suffering piles of snows in the depressing winters make the warmth from the culture, the people, and the green summer sunshine of this city feel more precious and adorable than any other places I have visited, and I am glad I have left a five-year mark along the dimension of time on this spatial spot, in a universe that I will often revisit in my heart. Last but not least, I am grateful to my parents and grandparents for their eternal support and encouragement. I am regretful for years of lack of verbal communication with them but I always know that all the conquering of hardship in these years would mean, without their love, nothing. iii TABLE OF CONTENTS DEDICATION .................................. ii ACKNOWLEDGEMENTS .......................... iii LIST OF FIGURES ............................... vii LIST OF TABLES ................................ viii LIST OF APPENDICES ............................ ix ABSTRACT ................................... x CHAPTER I. Introduction .............................. 1 1.1 MotivationandOverview .................... 1 1.2 LiteratureReview ........................ 2 1.3 Organization and Main Contributions . 6 1.4 NotationConvention....................... 8 II. Optimal Channel Switching as Jamming Defense - Part I: Against a No-Regret Learning Attacker ............. 10 2.1 ProblemFormulation ...................... 10 2.2 Optimal Channel Switching against a No-Regret Learning At- tacker............................... 12 2.2.1 Against Adaptive Attack with Known Patterns . 13 2.2.2 Against Adaptive Attack with Unknown Patterns . 17 2.3 TheDecoyDilemma....................... 18 2.4 ConcludingRemarks....................... 20 III. Optimal Channel Switching as Jamming Defense - Part II: Against a Resource-Replenishing Attacker with Minimax Op- timality ................................. 22 iv 3.1 Problem Formulation and Preliminaries . 23 3.2 Channel Switching for Minimax Optimality . 30 3.2.1 Basic Characterization . 31 3.2.2 Characterization with Structure on the Replenishment 35 3.2.3 Asymptotics ...................... 37 3.3 ConcludingRemarks....................... 38 3.3.1 Non-negative Mˆ .................... 39 3.3.2 Conversion to a Gain Formulation . 40 IV. Throughput Optimal Channel Switching in Random Access - Part I: Intuition from Slotted Aloha .............. 41 4.1 Preliminaries . 42 4.1.1 Slotted Aloha and IEEE 802.11 DCF . 42 4.1.2 Stability and Throughput Optimality . 43 4.2 Decentralized Throughput Optimal Switching via Individual Learning ............................. 44 4.2.1 Centralized throughput optimal policy . 45 4.2.2 Decentralized implementation via individual learning 47 4.3 Concluding Remarks: Hope and Challenge . 53 V. Throughput Optimal Channel Switching in Random Access - Part II: IEEE 802.11 WLANs .................. 55 5.1 802.11DCFBackoffMechanism . 55 5.2 ProblemFormulation ...................... 56 5.3 Single Channel Stability Region . 62 5.3.1 The Stability Region Equation Σ . 62 5.3.2 Characterizing the Solutions to Σ . 64 5.4 Numerical Results: Single Channel . 66 5.4.1 Multi-equilibrium and Discontinuity in ρ ...... 66 5.4.2 Numerical and Empirical Stability Regions . 69 5.4.3 Discussion: From 802.11 DCF Back to Aloha . 72 5.5 Multi-channel Analysis . 74 5.6 Applicability and Implementation of Unbiased Policies in Both Symmetric and Asymmetric Systems . 80 5.6.1 Unbiased Policies . 80 5.6.2 Practical Implementation of Throughput Optimal Un- biased Policies: Symmetric Channels . 81 5.6.3 Practical Implementation of Throughput Optimal Un- biased Policies: Asymmetric Channels . 83 5.6.4 Fairness under Throughput Optimal Policies . 86 5.7 Signal Quality plus Congestion Level in Channel Selection . 87 v VI. Conclusion and Future Work .................... 91 6.1 SummaryofMainContributions . 91 6.2 FutureWork ........................... 92 APPENDICES .................................. 94 BIBLIOGRAPHY ................................ 112 vi LIST OF FIGURES Figure 2.1 The change of policy in the two-channel scenario. 17 5.1 Solution components for various scenarios: an illustration. 67 5.2 The stability regions in various scenarios - part I. 70 5.3 The stability regions in various scenarios - part II. 72 5.4 The stability region of slotted ALOHA and induced subsets. 73 5.5 The stability region of two-channel 802.11 DCF under the equi-occupancy policy. .................................. 79 5.6 Throughput optimality of equi-occupancy distribution. 79 5.7 The intersection of simulated stability region with the plane of arrival ratesofthetwonodesunderinspection.. 84 5.8 Histogram of node population in the slower channel: (a) SAC ((b) ℓ SAS) with αℓ =0.5; (c) SAC ((d) SAS) with αℓ = m . ........ 86 5.9 Congestion-based vs. signal-based: stability region. 89 C.1 Slottedtimedynamics. ......................... 105 vii LIST OF TABLES Table 2.1 TheHedgealgorithm........................... 14 5.1 Congestion-based vs. signal-based: node distribution. .. 90 C.1 Specifications of the implementation of test bench. 108 viii LIST OF APPENDICES Appendix A. SupplementstoChapterII ........................ 95 B. SupplementstoChapterIII. .. .. 98 C. SupplementstoChapterV . .. .. 103 D. GlossaryofNotation............................ 109 ix ABSTRACT Optimal Channel-Switching Strategies in Multi-channel Wireless Networks by Qingsi Wang Chair: Professor Mingyan Liu The dual nature of scarcity and under-utilization of spectrum resources, as well as recent advances in software-defined radio, led to extensive study on the design of transceivers that are capable of opportunistic channel access. By allowing users to dynamically select which channel(s) to use for transmission, the overall throughput performance and the spectrum utilization of the system can in general be improved, compared to one with a single channel or more static channel allocations. The rea- son for such improvement lies in the exploitation of the underlying temporal, spa- tial, spectral and congestion diversity. In this dissertation, we focus on the channel- switching/hopping decision of a (group of) legitimate user(s) in a multi-channel wire- less communication system, and study three closely related problems: 1) a jamming defense problem against a no-regret learning attacker, 2) a jamming defense problem with minimax (worst-case) optimal channel-switching strategies, and 3) the through- put optimal strategies for a group of competing users in IEEE 802.11-like medium access schemes. For the first problem we study the interaction between a user and an attacker from a learning perspective, where an online learner naturally adapts to the available x information on the adversarial environment over time, and evolves its strategy with certain payoff guarantee. We show how the user can counter a strong learning at- tacker with knowledge on its learning rationale, and how the learning technique can itself be considered as a countermeasure with no such prior information. We further consider in the second problem the worst-case optimal strategy for the user without prior information on the attacking pattern, except that the attacker is subject to a resource constraint, which models its energy consumption and replenishment process. We provide explicit characterization for the optimal strategies and show the most damaging attacker, interestingly, behaves randomly in an i.i.d. fashion. In the last problem, we consider a group of competing users in a non-adversarial setting. We place the interaction among users in the context of IEEE 802.11-like medium access schemes, and derive decentralized channel allocation for overall throughput improve- ment. We show the typically rule-of-thumb load balancing principle in spectrum resource sharing can be indeed throughput optimal. xi CHAPTER I Introduction 1.1 Motivation and Overview Advances in software-defined radio in recent years have motivated numerous stud- ies on building agile, channel-aware transceivers that are capable of sensing instan- taneous channel quality [1, 2, 3]. With this opportunity comes the challenge of mak- ing effective opportunistic channel access and transmission scheduling decisions, as well as designing supporting system architectures. In this research,
Recommended publications
  • Rendezvous Search with Revealed Information: Applications to the Line
    J. Appl. Prob. 44, 1–15 (2007) Printed in England © Applied Probability Trust 2007 RENDEZVOUS SEARCH WITH REVEALED INFORMATION: APPLICATIONS TO THE LINE STEVE ALPERN,∗ London School of Economics Abstract The symmetric rendezvous problem on a network Q asks how two players, forced to use the same mixed strategy, can minimize their expected meeting time, starting from a known initial distribution on the nodes of Q. This minimum is called the (symmetric) ‘rendezvous value’of Q. Traditionally, the players are assumed to receive no information while playing the game. We consider the effect on rendezvous times of giving the players some information about past actions and chance moves, enabling each of them to apply Bayesian updates to improve his knowledge of the other’s whereabouts. This technique can be used to give lower bounds on the rendezvous times of the original game (without any revealed information). We consider the case in which they are placed a known distance apart on the line graph Q (known as ‘symmetric rendezvous on the line’). Our approach is to concentrate on a general analysis of the effect of revelations, rather than compute the best bounds possible with our technique. Keywords: Rendezvous; search; common interest game; team theory 2000 Mathematics Subject Classification: Primary 90B40 1. Introduction In this paper we consider how the revelation of information can affect an important unsolved problem in rendezvous theory: the symmetric rendezvous problem on the line or line graph (whose nodes are the integers, Z) posed in [1], dubbed . (In fact, given the recent solution by Weber [14] of the symmetric rendezvous problem on the complete graph K3,is arguably the main unsolved problem.) The problem begins with a chance move α, called the initial configuration.
    [Show full text]
  • Optimal Symmetric Rendezvous Search on Three Locations
    Optimal Symmetric Rendezvous Search on Three Locations Richard Weber Centre for Mathematical Sciences, Wilberforce Road, Cambridge CB2 0WB email: [email protected] www.statslab.cam.ac.uk/~rrw1 In the symmetric rendezvous search game played on n locations two players are initially placed at two distinct locations. The game is played in discrete steps, at each of which each player can either stay where he is or move to a different location. The players share no common labelling of the locations. We wish to find a strategy such that, if both players follow it independently, then the expected number of steps until they are in the same location is minimized. Informal versions of the rendezvous problem have received considerable attention in the popular press. The problem was proposed by Steve Alpern in 1976 and it has proved notoriously difficult to analyse. In this paper we prove a 20 year old conjecture that the following strategy is optimal for the game on three locations: in each block of two steps, stay where you, or search the other two locations in random order, doing these with probabilities 1=3 and 2=3 respectively. This is now the first nontrivial symmetric rendezvous search game to be fully solved. Key words: rendezvous search; search games; semidefinite programming MSC2000 Subject Classification: Primary: 90B40; Secondary: 49N75, 90C22, 91A12, 93A14 OR/MS subject classification: Primary: Games/group decisions, cooperative; Secondary: Analysis of algorithms; Programming, quadratic 1. Symmetric rendezvous search on three locations In the symmetric rendezvous search game played on n locations two players are initially placed at two distinct locations.
    [Show full text]
  • Algorithm Design and Analysis in Wireless Networks Lin Chen
    Algorithm design and analysis in wireless networks Lin Chen To cite this version: Lin Chen. Algorithm design and analysis in wireless networks. Data Structures and Algorithms [cs.DS]. Paris-Sud XI, 2017. tel-01688436 HAL Id: tel-01688436 https://hal.archives-ouvertes.fr/tel-01688436 Submitted on 24 Jan 2018 HAL is a multi-disciplinary open access L’archive ouverte pluridisciplinaire HAL, est archive for the deposit and dissemination of sci- destinée au dépôt et à la diffusion de documents entific research documents, whether they are pub- scientifiques de niveau recherche, publiés ou non, lished or not. The documents may come from émanant des établissements d’enseignement et de teaching and research institutions in France or recherche français ou étrangers, des laboratoires abroad, or from public or private research centers. publics ou privés. Algorithm Design and Analysis in Wireless Networks Habilitation Thesis Lin CHEN Laboratoire de Recherche en Informatique (UMR 8623) Université Paris-Sud Defended on July 11, 2017 Committee M. Tamer BASAR Reviewer M. Pierre FRAIGNIAUD Reviewer M. Bruno GAUJAL Reviewer M. Eitan ALTMAN Examiner M. Joffroy BEAUQUIER Examiner Mme. Johanne COHEN Examiner M. Mérouane DEBBAH Examiner M. Fabio MARTIGNON Examiner Abstract Algorithms are perhaps the most fundamental and fascinating elements in computer science as a whole. Networks and networked systems are no exception. This habilitation thesis summarizes my research during the last eight years on some algorithmic problems of both fundamental and practical importance in modern networks and networked systems, more specifically, wireless net- works. Generically, wireless networks have a number of common features which form a common ground on which algorithms for wireless networks are designed.
    [Show full text]
  • THE THEORY of SEARCH GAMES and RENDEZVOUS INTERNATIONAL SERIES in OPERATIONS RESEARCH & MANAGEMENT SCIENCE Frederick S
    THE THEORY OF SEARCH GAMES AND RENDEZVOUS INTERNATIONAL SERIES IN OPERATIONS RESEARCH & MANAGEMENT SCIENCE Frederick S. Hillier, Series Editor Stanford University Weyant, J./ ENERGY AND ENVIRONMENTAL POLICY MODELING Shanthikumar, J.G. & Sumita, U. / APPLIED PROBABILITY AND STOCHASTIC PROCESSES Liu, B. & Esogbue, A.O. / DECISION CRITERIA AND OPTIMAL INVENTORY PROCESSES Gal, T., Stewart, T.J., Hanne, T. / MULTICRITERIA DECISION MAKING: Advances in MCDM Models, Algorithms, Theory, and Applications Fox, B.L. / STRATEGIES FOR QUASI-MONTE CARLO Hall, R.W. / HANDBOOK OF TRANSPORTATION SCIENCE Grassman, W.K. / COMPUTATIONAL PROBABILITY Pomerol, J-C. & Barba-Romero, S. / MULTICRITERION DECISION IN MANAGEMENT Axsäter, S./ INVENTORY CONTROL Wolkowicz, H., Saigal, R., & Vandenberghe, L. / HANDBOOK OF SEMI-DEFINITE PROGRAMMING: Theory, Algorithms, and Applications Hobbs, B.F. & Meier, P. / ENERGY DECISIONS AND THE ENVIRONMENT: A Guide to the Use of Multicriteria Methods Dar-El, E. / HUMAN LEARNING: From Learning Curves to Learning Organizations Armstrong, J.S. / PRINCIPLES OF FORECASTING: A Handbook for Researchers and Practitioners Balsamo, S., Personé, V., & Onvural, R./ ANALYSIS OF QUEUEING NETWORKS WITH BLOCKING Bouyssou, D. et al. / EVALUATION AND DECISION MODELS: A Critical Perspective Hanne, T. / INTELLIGENT STRATEGIES FOR META MULTIPLE CRITERIA DECISION MAKING Saaty, T. & Vargas, L. / MODELS, METHODS, CONCEPTS and APPLICATIONS OF THE ANALYTIC HIERARCHY PROCESS Chatterjee, K. & Samuelson, W. / GAME THEORY AND BUSINESS APPLICATIONS Hobbs, B. et al. / THE NEXT GENERATION OF ELECTRIC POWER UNIT COMMITMENT MODELS Vanderbei, R.J. / LINEAR PROGRAMMING: Foundations and Extensions, 2nd Ed. Kimms, A. / MATHEMATICAL PROGRAMMING AND FINANCIAL OBJECTIVES FOR SCHEDULING PROJECTS Baptiste, P., Le Pape, C. & Nuijten, W. / CONSTRAINT-BASED SCHEDULING Feinberg, E. & Shwartz, A.
    [Show full text]
  • Download Book
    Lecture Notes in Computer Science 3279 Commenced Publication in 1973 Founding and Former Series Editors: Gerhard Goos, Juris Hartmanis, and Jan van Leeuwen Editorial Board David Hutchison Lancaster University, UK Takeo Kanade Carnegie Mellon University, Pittsburgh, PA, USA Josef Kittler University of Surrey, Guildford, UK Jon M. Kleinberg Cornell University, Ithaca, NY, USA Friedemann Mattern ETH Zurich, Switzerland John C. Mitchell Stanford University, CA, USA Moni Naor Weizmann Institute of Science, Rehovot, Israel Oscar Nierstrasz University of Bern, Switzerland C. Pandu Rangan Indian Institute of Technology, Madras, India Bernhard Steffen University of Dortmund, Germany Madhu Sudan Massachusetts Institute of Technology, MA, USA Demetri Terzopoulos New York University, NY, USA Doug Tygar University of California, Berkeley, CA, USA Moshe Y. Vardi Rice University, Houston, TX, USA Gerhard Weikum Max-Planck Institute of Computer Science, Saarbruecken, Germany Geoffrey M. Voelker Scott Shenker (Eds.) Peer-to-Peer Systems III Third International Workshop, IPTPS 2004 La Jolla, CA, USA, February 26-27, 2004 Revised Selected Papers 13 Volume Editors Geoffrey M. Voelker University of California, San Diego Department of Computer Science and Engineering 9500 Gilman Dr., MC 0114, La Jolla, CA 92093-0114, USA E-mail: [email protected] Scott Shenker University of California, Berkeley Computer Science Division, EECS Department 683 Soda Hall, 1776, Berkeley, CA 94720, USA E-mail: [email protected] Library of Congress Control Number: Applied for CR Subject Classification (1998): C.2.4, C.2, H.3, H.4, D.4, F.2.2, E.1, D.2 ISSN 0302-9743 ISBN 3-540-24252-X Springer Berlin Heidelberg New York This work is subject to copyright.
    [Show full text]
  • Study and Development of Power Control Schemes Within a Cognitive Radio-Based Game Theoretic Framework
    Aalborg Universitet (AAU) Institut for Elektroniske Systemer Study and Development of Power Control Schemes within a Cognitive Radio-based Game Theoretic Framework by Author: V´ıctor Alvarez´ Roig Advisors: Andrea Fabio Cattoni, Gustavo Wagner Oliveira da Costa Aalborg, April 2010 “Before anything else, preparation is the key to success” Alexander Graham Bell (1847-1922) Aalborg Universitet (AAU) Abstract Institut for Elektroniske Systemer Radio Access Technology by Author: V´ıctor Alvarez´ Roig The requirements of the International Telecommunication Union (ITU) for the 4th generation of mobile devices raised up to 100 Mbps for high and 1Gbps for low mobility conditions. Reaching such challenging targets requires the deployment of picocells and femtocells. These techniques permit to achieve large cell capacity but also lead to difficulties in terms of interference. The GRACE algorithm, based on Cognitive Radio and Game Theory, has shown a fair balance between cell capacity and outage as well as short convergence time, low complexity and easy scalability. The aim of this work is to find an efficient power control algorithm that fits GRACE these goals. Therefore, a study of Cognitive Radio, Game Theory and Power Control algorithms is developed and a new power control algorithm is proposed. The simulation results show that the Fractional Power Control can increase notably the outage performance and the energy saving to the mobile devices. Acknowledgements I would like to start thanking the Aalborg University for the opportunity to perform my Master’s Thesis here in Danmark and also to Nokia Siemens Networks for their facilities and economical support. I want to thank my supervisors Andrea and Gustavo for their advice and support during this time.
    [Show full text]
  • On the Encoding and Solving Partial Information Games Yackolley Amoussou-Guenou, Souheib Baarir, Maria Potop-Butucaru, Nathalie Sznajder, Leo Tible, Sébastien Tixeuil
    On the encoding and solving partial information games Yackolley Amoussou-Guenou, Souheib Baarir, Maria Potop-Butucaru, Nathalie Sznajder, Leo Tible, Sébastien Tixeuil To cite this version: Yackolley Amoussou-Guenou, Souheib Baarir, Maria Potop-Butucaru, Nathalie Sznajder, Leo Tible, et al.. On the encoding and solving partial information games. [Research Report] LIP6, Sorbonne Université, CNRS, UMR 7606; LINCS; CEA Paris Saclay; Sorbonne Université. 2018. hal-01790508 HAL Id: hal-01790508 https://hal.archives-ouvertes.fr/hal-01790508 Submitted on 20 May 2018 HAL is a multi-disciplinary open access L’archive ouverte pluridisciplinaire HAL, est archive for the deposit and dissemination of sci- destinée au dépôt et à la diffusion de documents entific research documents, whether they are pub- scientifiques de niveau recherche, publiés ou non, lished or not. The documents may come from émanant des établissements d’enseignement et de teaching and research institutions in France or recherche français ou étrangers, des laboratoires abroad, or from public or private research centers. publics ou privés. On the encoding and solving of partial information games Yackolley Amoussou-Guenou1,2, Souheib Baarir1, Maria Potop-Butucaru1, Nathalie Sznajder1, L´eo Tible3, and S´ebastien Tixeuil1 1 Sorbonne Universit´e, CNRS, Laboratoire d’Informatique de Paris 6, LIP6, F-75005 Paris, France 2 CEA, LIST, Gif-sur-Yvette, F-91191, France 3 Ecole´ normale sup´erieure Paris-Saclay, Cachan, France Abstract. In this paper we address partial information games restricted to memoryless strategies. Our contribution is threefold. First, we prove that for partial information games, deciding the existence of memoryless strategies is NP-complete, even for games with only reachability objec- tives.
    [Show full text]
  • Searching with Two-Speed Autonomous Mobile Robots
    Searching with Two-Speed Autonomous Mobile Robots by Fraser Lachlan MACQUARRIE A thesis submitted to the Faculty of Graduate and Postdoctoral Affairs in partial fulfillment of the requirements for the degree of Doctor of Philosophy in Computer Science CARLETON UNIVERSITY OTTAWA,ONTARIO c 2015 ⃝ Fraser Lachlan MacQuarrie Abstract We introduce and study various search problems using mobile robots. Specifically we study the problems of exploration and patrolling using a new two-speed model of robots, as well as studying the problems of rendezvous and evacuation using a more traditional one-speed model of mobile robots. The problems are executed on a continuous finite domain by a swarm of n robots r1; r2; : : : ; rn. For the two-speed model, each robot ri has a walking speed wi and a searching speed si, where si < wi. At each moment a robot either moves through the domain with a speed not exceeding wi, or it performs a more elaborate task (such as searching) on the domain with speed not exceeding si. A search of an interval is completed when each of its points have been searched by at least one of the n two-speed robots. We want to develop efficient mobility schedules (algorithms) for the robots which complete the search of the interval as quickly as pos- sible. More exactly, we want to maximize the speed of the mobility schedule – defined as the ratio of the interval length compared to the time of completion of the schedule. For patrolling, a unit interval is to be patrolled collectively by n two-speed robots.
    [Show full text]
  • Distributed Map Construction Master Thesis Media & Knowledge Engineering
    Distributed Map Construction Master Thesis Media & Knowledge Engineering By P.A.C. (Pjotr) Waasdorp, BSc. Distributed Map Construction Page I THESIS submitted in partial fulfillment of the requirements for the degree of MASTER OF SCIENCE In MEDIA & KNOWLEDGE ENGINEERING By Pjotr Waasdorp Delft, the Netherlands Man-Machine Interaction Group Faculty of Electrical Engineering, Mathematics and Computer Science Delft University of Technology, The Netherlands http://mmi.tudelft.nl Distributed Map Construction Page II © 2010 P.A.C. Waasdorp Cover picture: A basic Microsoft Word 2007 option Distributed Map Construction Page III Distributed Map Construction Date: 19 April 2010 Place: Delft Author Supervisor Name: P.A.C. (Pjotr) Waasdorp Name: Prof. Dr. Drs. L.J.M. (Leon) Rothkrantz Student number: 1207482 Email: [email protected] Email: [email protected] Abstract Assume that two sub-graphs of a graph are available and that the graph represents the corridors in a building. Without using any previous knowledge on the entire graph, can these two sub-graphs be used to construct an extended view on the entire graph. To test this assumption a collection of algorithms will be designed and implemented which can fuse two sub-graphs (topological maps) together to achieve this extended view on the unknown environment. The main goal for this project will consist of the distributed construction of topological maps within a simulated environment, with the main focus on the used algorithm(s) for the fusion of multiple maps. This will be realized with the help of a “graph” data structure, a multi agent system and match and merge algorithms.
    [Show full text]
  • Pursuit-Evasion and Differential Games Under Uncertainties
    PURSUIT-EVASION AND DIFFERENTIAL GAMES UNDER UNCERTAINTIES A Thesis Presented to The Academic Faculty by Wei Sun In Partial Fulfillment of the Requirements for the Degree Doctor of Philosophy in the School of Aerospace Engineering Georgia Institute of Technology August 2017 Copyright c 2017 by Wei Sun PURSUIT-EVASION AND DIFFERENTIAL GAMES UNDER UNCERTAINTIES Approved by: Professor Panagiotis Tsiotras Professor Eric N. Johnson Committee Chair, Advisor School of Aerospace Engineering School of Aerospace Engineering Georgia Institute of Technology Georgia Institute of Technology Professor Evangelos A. Theodorou, Professor Anthony J. Yezzi Co-Advisor School of Electrical and Computer School of Aerospace Engineering Engineering Georgia Institute of Technology Georgia Institute of Technology Professor Eric Feron Date Approved: 17 May 2017 School of Aerospace Engineering Georgia Institute of Technology To my parents and my sister. iii ACKNOWLEDGEMENTS I would like to express my sincere gratitude to my advisor Dr. P. Tsiotras for his support and guidance throughout my PhD studies. I would also like to extend my appreciation to my co-advisor Dr. E. A. Theodorou and other committee members: Dr. E. M. Feron and Dr. A. Yezzi for their true interest in evaluating my work. I owe the greatest debt of gratitude to my parents and my sister for their never ending support during my graduate studies. This work is dedicated to them as a token of appreciation. Lastly, but by no means least, I wish to thank my labmates Dr. Efstathios Bakolas, Dr. Nuno Filipe, Dr. Oktay Arslan, Mr. Ioannis Exarchos, Mr. Spyridon Zafeiropou- los, Mr. Florian Hauer, Mr. Changxi You among others who have given me many inspirations during my years at Georgia Tech.
    [Show full text]
  • Optimal Search in Discrete Locations: Extensions and New Findings
    Optimal Search in Discrete Locations: Extensions and New Findings Jake Clarkson, M.Sci.(Hons.), M.Res Submitted for the degree of Doctor of Philosophy at Lancaster University. July 2020 Abstract A hidden target needs to be found by a searcher in many real-life situations, some of which involve large costs and significant consequences with failure. Therefore, efficient search methods are paramount. In our search model, the target lies in one of several discrete locations according to some hiding distribution, and the searcher's goal is to discover the target in minimum expected time by making successive searches of individual locations. In Part I of the thesis, the searcher knows the hiding distribution. Here, if there is only one way to search each location, the solution to the search problem, discovered in the 1960s, is simple; search next any location with a maximal probability per unit time of detecting the target. An equivalent solution is derived by viewing the search problem as a multi-armed bandit and following a Gittins index policy. Motivated by modern search technology, we introduce two modes|fast and slow| to search each location. The fast mode takes less time, but the slow mode is more likely to find the target. An optimal policy is difficult to obtain in general, because it requires an optimal sequence of search modes for each location, in addition to a set of sequence-dependent Gittins indices for choosing between locations. For each mode, we identify a sufficient condition for a location to use only that search mode in an optimal policy.
    [Show full text]
  • Game Theory Approach in Multi-Agent Resources Sharing Tangui Le Gléau, Xavier Marjou, Tayeb Lemlouma, Benoît Radier
    Game Theory Approach in Multi-agent Resources Sharing Tangui Le Gléau, Xavier Marjou, Tayeb Lemlouma, Benoît Radier To cite this version: Tangui Le Gléau, Xavier Marjou, Tayeb Lemlouma, Benoît Radier. Game Theory Approach in Multi- agent Resources Sharing. 25th IEEE Symposium on Computers and Communications (ISCC), Jul 2020, Rennes, France. hal-02901236 HAL Id: hal-02901236 https://hal.archives-ouvertes.fr/hal-02901236 Submitted on 17 Jul 2020 HAL is a multi-disciplinary open access L’archive ouverte pluridisciplinaire HAL, est archive for the deposit and dissemination of sci- destinée au dépôt et à la diffusion de documents entific research documents, whether they are pub- scientifiques de niveau recherche, publiés ou non, lished or not. The documents may come from émanant des établissements d’enseignement et de teaching and research institutions in France or recherche français ou étrangers, des laboratoires abroad, or from public or private research centers. publics ou privés. Game Theory Approach in Multi-agent Resources Sharing Tangui Le Gleau´ Xavier Marjou Tayeb Lemlouma Benoit Radier Orange Labs Orange Labs IRISA Orange Labs Lannion, France Lannion, France Lannion, France Lannion, France [email protected] [email protected] [email protected] [email protected] Abstract—In multiple real life situations involving several network operators can exchange resources to reach an optimal agents, cooperation can be beneficial for all. For example, situation and we consider that their personal interest are driven some telecommunication or electricity providers may cooperate only by their personal utility (which can for example be in order to address occasional resources needs by giving to coopetitors some quantities of their own surplus while expecting considered as the quality of experience in telecommunications in return a similar service.
    [Show full text]