Resource Discovery Mechanisms in Grid Systems: a Survey
Total Page:16
File Type:pdf, Size:1020Kb
See discussions, stats, and author profiles for this publication at: https://www.researchgate.net/publication/261327710 Resource discovery mechanisms in grid systems: A survey Article in Journal of Network and Computer Applications · May 2014 Impact Factor: 2.23 · DOI: 10.1016/j.jnca.2013.09.013 CITATIONS READS 15 254 4 authors: Nima Jafari Navimipour Amir Masoud Rahmani Islamic Azad University Tabriz Branch Islamic Azad University Tehran Science and… 22 PUBLICATIONS 111 CITATIONS 199 PUBLICATIONS 648 CITATIONS SEE PROFILE SEE PROFILE Ahmad Habibizad Navin Mehdi Hosseinzadeh Islamic Azad University Islamic Azad University 48 PUBLICATIONS 197 CITATIONS 31 PUBLICATIONS 102 CITATIONS SEE PROFILE SEE PROFILE All in-text references underlined in blue are linked to publications on ResearchGate, Available from: Nima Jafari Navimipour letting you access and read them immediately. Retrieved on: 30 May 2016 Journal of Network and Computer Applications 41 (2014) 389–410 Contents lists available at ScienceDirect Journal of Network and Computer Applications journal homepage: www.elsevier.com/locate/jnca Review Resource discovery mechanisms in grid systems: A survey Nima Jafari Navimipour b, Amir Masoud Rahmani a, Ahmad Habibizad Navin b,n, Mehdi Hosseinzadeh a a Department of Computer Engineering, Science and Research Branch, Islamic Azad University, Tehran, Iran b Department of Computer Engineering, East Azarbaijan Science and Research Branch, Islamic Azad University, Tabriz, Iran article info abstract Article history: Grid computing systems provide a vast amount of computing resources from multiple administrative Received 12 April 2013 domains to reach a main objective. One of the most important challenges in these systems is to discover Received in revised form appropriate resource in networks. In this paper we survey the resource discovery mechanisms which 21 July 2013 have been used in Grid computing systems so far. We classify the resource discovery mechanisms into Accepted 30 September 2013 five main categories: Centralized, Decentralized, Peer to Peer, Hierarchical, and Agent based. We Available online 10 October 2013 reviewed the major development in these five categories and outlined new challenges. This survey Keywords: paper also provides a discussion of differences between considered mechanisms in terms of scalability, Grid systems dynamicity, reliability and queries' attributes as well as directions for future research. Peer to peer & 2013 Elsevier Ltd. All rights reserved. Resource discovery Network applications Scalability Centralized Decentralized Hierarchical Agent Contents 1. Introduction . 390 2. Basic concepts and related terminologies. 390 3. Resource discovery mechanisms. 391 3.1. Centralized mechanisms . 391 3.1.1. Overview of centralized mechanisms . 391 3.1.2. Popular centralized mechanisms. 391 3.1.3. Summary of centralized mechanisms . 392 3.2. Decentralized mechanism . 393 3.2.1. Overview of decentralized mechanisms . 393 3.2.2. Popular decentralized mechanisms. 393 3.2.3. Summary of decentralized mechanisms . 395 3.3. Peer to peer mechanisms . 395 3.3.1. Overview of peer to peer mechanisms . 395 3.3.2. Unstructured peer to peer mechanisms . 395 3.3.3. Structured peer to peer mechanisms . 397 3.3.4. Super to peer mechanisms . 399 3.3.5. Hybrid mechanisms . 401 3.3.6. Summary of peer to peer mechanisms . 402 3.4. Hierarchical mechanisms. 403 n Corresponding author. Tel.: þ98 9144125973; fax: þ98 4113817221. E-mail addresses: [email protected] (N. Jafari Navimipour), [email protected] (A. Masoud Rahmani), [email protected] (A. Habibizad Navin), [email protected] (M. Hosseinzadeh). 1084-8045/$ - see front matter & 2013 Elsevier Ltd. All rights reserved. http://dx.doi.org/10.1016/j.jnca.2013.09.013 390 N. Jafari Navimipour et al. / Journal of Network and Computer Applications 41 (2014) 389–410 3.4.1. Overview of hierarchical mechanisms . 403 3.4.2. Popular hierarchical mechanisms . 403 3.4.3. Summary of hierarchical mechanisms . 404 3.5. Agent-based mechanisms . 404 3.5.1. Overview of agent-based mechanisms . 405 3.5.2. Popular agent-based mechanisms. 405 3.5.3. Summary of agent-based mechanisms . 406 4. Results and comparison . 406 5. Open issues . 408 6. Conclusion . 408 References.............................................................................................................408 1. Introduction systems. Resource discovery is one of the essential challenges in Grid, which discovers appropriate resources based on the The term “Grid” was coined in the mid 1990s offering access to requested task. There are certain factors that make the resource a vast collection of heterogeneous resources as a single, unified discovery problem difficult to solve. These factors are the huge resource to solve large-scale computing and data intensive pro- number of resources, distributed ownership, heterogeneity of blems for advanced science and engineering (Balasangameshwara resources, resource failure, reliability, dynamicity and resource and Raju, 2012; Erdil, 2012; Ian Foster and Kesselman, 1999; Siva evolution (Hameurlain et al., 2010). These factors are essential Sathya and Syam Babu, 2010). Some examples of Grid computing criteria for designing a good resource discovery mechanism. systems are NASA IPG (Johnston et al., 1999), the World Wide In this paper, we divided most of the introduced resource Grid,1 HealthGrid (Naseer and Stergioulas, 2010), and Selenium- discovery algorithms into five main categories, centralized, decen- Grid.2 After almost 20 years of development, Grid computing has tralized, peer to peer, hierarchical, and agent-based. This paper made many varieties, such as computational Grid which denotes provides a survey on resource and service discovery mechanisms systems that have higher aggregated computational capacity in Grid systems and compares the differences between mentioned available for single applications; data Grid which provides an mechanisms and describes several popular resource discovery infrastructure for synthesizing new information from data reposi- mechanisms. Also a taxonomy to differentiate between considered tories such as digital libraries or data warehouses that are mechanisms is provided. distributed in a wide area network; information Grid which is The rest of this paper is structured as follows. The basic concepts the integration of information across heterogeneous data sources; and terminologies are provided in the next section. Section 3 service Grid which provides services that cannot be provided by discusses resource discovery mechanisms in Grid system and any single machine; wireless Grid which enables wireless and categorizes them. Section 4 presents the taxonomy and comparison mobile users to share computing resources, services, and informa- of proposed mechanisms. Section 5 maps out some open issues. tion (Moreno-Vozmediano, 2009); A multimedia Grid which Finally Section 5 concludes this paper. provides an infrastructure for real-time multimedia applications and cloud computing (Krauter et al., 2002). The Grid architecture adopts a layered structure that corre- sponds to the Internet protocol architecture (Fig. 1). The Grid 2. Basic concepts and related terminologies architecture consists of four layers: fabric, connectivity, collective and application layer. The fabric layer in this structure refers to a This section introduces the basic concepts and related ter- set of resources or devices, including computers, storage systems, minologies which are used in this paper. We explain the following networks, and various types of computer-controlled instruments concepts and terminologies: and devices. The Connectivity layer defines core communication Scalability: scalability is one of the important issues for design- and authentication protocols required for Grid-specific network ing resource discovery mechanisms. It defines the ability of a transactions (Foster et al., 2001). The Resource layer is built on resource discovery mechanism to handle a growing amount of Connectivity layer communication and authentication protocols to Grid systems with predefined level of efficiency. define protocols for the secure negotiation, initiation, monitoring, control, accounting, and payment of sharing operations on indivi- dual resources (Foster et al., 2001). Above the resource and connectivity layers, the collective layer contains protocols, ser- vices, and APIs that implement interactions across collections of resources, therefore collective layer coordinates multiple resources (Wang et al., 2009) that provide facilities to access some useful services such as resource discovery and management. The final layer in Grid architecture is the application layer which comprises the user applications (Foster et al., 2001). In Grid, there are many types of resources such as computers, cluster of computers, online tools, storage space, data, and appli- cations (Iamnitchi and Foster, 2001) which are widely distributed and heterogeneous in comparison to traditional and cluster 1 http://www.buyya.com/ecogrid/wwg/. Fig. 1. Grid architecture compared with internet architecture (Ian Foster et al., 2 www.selenium-grid.seleniumhq.org. 2001). N. Jafari Navimipour et al. / Journal of Network and Computer Applications 41 (2014) 389–410 391 Multi-Attribute Query: a multi-attribute query is a set of sub- chance that a resource is not found even if.