Hindawi Mobile Information Systems Volume 2017, Article ID 6965028, 16 pages https://doi.org/10.1155/2017/6965028

Research Article Multihoming for Mobile of Multimedia Things

Titus Balan, Dan Robu, and Florin Sandu

Department of Electronics and Computers, “Transilvania” University of Brasov, Brasov, Romania

Correspondence should be addressed to Titus Balan; [email protected]

Received 28 April 2017; Revised 14 July 2017; Accepted 6 August 2017; Published 26 September 2017

Academic Editor: Bartolomeo Montrucchio

Copyright © 2017 Titus Balan et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Mobility, redundancy, and bandwidth requirements are transforming the communication models used for IoT, mainly in case of Critical Communications and multimedia streaming (“IoMT, Internet of Multimedia Things”), as wireless video traffic is expected to be 60–75% of the global mobile traffic by 2020. One of the characteristics of 5G networks will be the proliferation of different/heterogeneous radio networks (virtualized radio access networks, RAN, new energy-efficient radios, femtocells, and offloading capabilities) and the possibility for IoT objects to connect and load-balance between dual and multiple RANs. Thispaper focuses on the possibility of using LISP (Locator Identifier Separation Protocol) for multihoming and load-balancing purposes and presents an illustrative scenario for the case of mobile IoT (e.g., the “things” part of vehicular or public transportation systems, PTS) that are also intensive bandwidth consumers, like the case of connected multimedia “things.” We have implemented and tested a demonstrator of a mobile LISP IoT gateway that is also integrated with Cloud-based video analytics.

1. Introduction Although3GPPhassomeowninitiativesintheareaof mobility, LIPA (Local IP Access), SIPTO (Selected IP Traffic IoT devices are supposed to be small sized objects equipped Offload), IFOM (IP Flow Mobility), MAPCON (Multiple with a limited amount of power resources. That is why 3GPP Access PDN Connectivity), or S1-flex (meshed S1 interfacing), also defined Narrow-Band IoT (NB-IoT) [1] for low band- each solution having some drawbacks, this paper focuses on width and low power consuming devices. However, there are the opportunities of using LISP [5]. Recognized as a serious some IoT applications [2] that manifest an increased request candidate for 5G standardization and intensively backed-up for redundancy and some also for a greater throughput. And by a IETF (Internet Engineering Task Force) Work Group, here we can mention the needs of Internet of Multimedia LISP offers mobility, multihoming, and load-balancing that Things (IoMT) [3] applications and also the IP broadband have the advantage to be applied with no changes in the Inter- requirements from Mission Critical Communications appli- netarchitecture(directlyatthemobileIoTelement)[6]and cations [4] that are enhanced with IoT communication. furthermore can be perfectly matched with SDN (Software Smart IoT multihoming and multiple-RAN connectivity Defined Networks) that represent another highlight of 5G management, including automatic air interface selection and architectures. optimal weighted load-balancing between interfaces, are IoT mobility gets a new dimension when we discuss the challenges for the reliability of future networks. Without implementations of Mobile Edge Computing (MEC) [7] and reliable mechanisms for multihoming and load-balancing of Fog Computing for IoT, as the processing can take place multiple interfaces, all the Mission Critical Communication distributed, where the objects are, thus reducing commu- could not function. nication delays to a central processing Cloud. Mobility, redundancy, and bandwidth requirements may In this case, IoT mobility could refer to be transferred, in an IoT ecosystem, from the sensors and devices to the IoT gateway element, but wherever it resides, (i) the mobility of “things” (IoT gateways, devices, and the redundancy and load-balancing function of mobile IoT is sensors) following the global understanding of host/ dependent on the mechanisms for RAN multihoming. user mobility; 2 Mobile Information Systems

(ii) the mobility of the virtual machines (VMM, Virtual despite having some advantages, has the main disadvantage MachineMobility)fromoneEdgeCloudtotheother, that it operates at the . This means that the concept also known as “Follow-Me Cloud,” a method applications must be written from the beginning to support for interworking of federated clouds and distributed SCTP or the existing applications must be rewritten. This is mobile networks [8]. where LISP does a better job: the applications remain the same; also a big part of the network is unchanged. SCTP had The LISP protocol is a recognized solution for both the a big traction in telecommunications but outside of this field above-mentioned mobility cases, thus being differentiated was not promoted at all. fromothermobilitysolutions.Furthermore,itisaverygood Although not included in this category by the survey in option for multihoming, among other multihoming solutions [15], NEMO (Network Mobility) is also considered in the that will be mentioned in a latter section. related work for end-site mobility [18], as it manages the Although LISP is a recognized mobility solution, there are mobility of a network of nodes that are typically moving in no implementations focused on using LISP for IoT systems. tandem [19]. Separation between location and identity for the This paper is focused on identifying the advantages of LISP case of multihoming is also mentioned in [20], but using the for IoT and describes an implementation for IoT of the LISP ILNPv6 protocol. architecturebasedontheopen-sourceLISPimplementation LISP-MN (for Mobile Networking) [21] is a lighter version Open Overlay (OOR) [9] and IBM Watson [10] of LISP. Compared to Mobile IP v4 or v6, there are no as IoT platform. The implemented use-case is focused on required Home Agents/Foreign Agents but LISP-MN has also IoMT, an IoT network based on multimedia sensors with less routing capabilities (as routing is needed for a single video analytics support in the Cloud. Furthermore, our use- destination). case takes into consideration multiple operator solutions for Different scenarios for multihoming and mobility testing multimedia streaming based . based on LISP are proposed in [5] and RFC 6830 bis, as Thispaperisorganizedasfollows:thefirstpartisthe well as in [22]. Testing LISP for multihoming purpose was introduction; the second section makes a fast description also performed in [23]: a performance evaluation of LISP of the related work in respect to multihoming and LISP multihoming was accomplished in a controlled environment. usage for this use-case, while the third and fourth sections The LISP implementation used in [23] is the Open Overlay describe briefly the LISP protocol and the advantages of using Router (OOR) [9], the same implementation to be used also LISP for IoT and the methods to handle IoT mobility and in this paper. While [23] aims to demonstrate the accuracy of multihoming with LISP. The next part details our experi- the OOR implementation, with respect to the configurability mental implementation of an IoT gateway having as base the of load-balancing weights and, nevertheless, to the behavior Open Overlay Router LISP implementation, while the sixth of LISP for data transfers in a static (nonmobile) environ- section handles the IBM Watson for data analytics. Last two ment, our paper will focus on a mobile IoT environment. parts describe the methodology used and the experimental As shown in [24], OOR supports both LISP and LISP-MN results for video streaming in a mobile, multihomed, and by implementing both the mobile node, MN, and a lighter load-balanced environment. Conclusions and plans for future version of xTRouting. works are presented in the last section. LISP was also proposed as a mobile solution for mul- tihoming in Mission Critical Communications [25] for the 2. Related Work representative ATN (Aeronautical Telecommunication Net- work) use-case [26, 27]. There are already different methodologies to address the A LISP assessment was done in Deutsche Telekom Labs important issues of multihoming; part of the related multi- in the BOWL Testbed [28], using a LISP implementation homing methodologies make use of the LISP protocol that is developed at “Technische Universitat¨ Berlin.” Testing was also in the focus of our approach [11–13]. In this section, as done in both static and mobile environments (where clients we review the existing approaches, we gradually try to point roam from one node to another). However, most of the results out the novelty of our solutions and the advancement with arecomparedintheBOWLIP-in-IPconfiguration(which respect to the state of the art. consists in adding an extra IP header to the IP packets, which Important state-of-the-art reference papers [14–16] differ- contains the tunneling information) and not with other entiate between the end-host and end-site multihoming. End- multihoming “classical” solutions (e.g., SCTP). The mobility site multihoming has gained more attention than end-host testing is based only on Wi-Fi testing. In respect to this multihoming, mainly due to the routing scalability problems related work, our approach aims for real equipment testing that Internet is facing and because of the ascension of Mobile (RET) of LISP, “in the field” of a real mobile environment Edge Computing. Edge computing will be an important part (usingtwoormoremobileoperatornetworks)thatare of our implementation, as described in the following. suitable for the heterogeneous IoT elements. As shown in LISP is mentioned in [15] as a method for end-site multi- the following, RET will take benefit of high-performance homing but an evaluation of its efficiency is not included; our professional instrumentation; the radio coverage maps (for paper aims to bring such an evaluation. Reference [15] also each of the multihomed networks) that we used were not considers multihoming based on transport protocols, includ- considered up-to-date as a baseline for testing of multihomed ing the well-known method of Stream Control Transmission LISP solutions. Multihoming was separately evaluated for Protocol(SCTP)multihoming,evaluatedin[16,17].SCTP, mobile vehicular networks, but not based on LISP [29]. We Mobile Information Systems 3

IoT “thing” running LISP-MN IoT Gateway 1 EID RLOC1 IoT “thing” 10.0.0.1 193.2.0.0/16 running LISP Mapping servers EID MS/MR 12.0.0.2

Internet IPv4 or IPv6

LISP-MN RLOC IoT Gateway 2 193.1.0.0/16 RLOC2 193.3.0.0/16

10.0.0.1 12.0.0.2 193.1.0.1 193.2.0.2 193.1.0.1 193.2.0.2 10.0.0.1 12.0.0.2 10.0.0.1 12.0.0.2 10.0.0.1 12.0.0.2

IoT EID addressing domain Normal IPv4/IPv6 addressing domain IoT EID addressing domain

Figure 1: LISP implementation example: LISP-MN runs on the mobile device on the left side, while LISP multihoming scenario with multiple IoT gateways is visible on the right side. can see that the parameters of the signal (strength, SNR, etc.) Concluding on the advancement with respect to the state in urban areas vary a lot [30]. Therefore, an analysis is needed oftheart,ourpaperhasthegoaltoevaluateLISPforIoMT before any bandwidth tests are performed for assessing the in a real mobility environment over multihomed mobile mobile test environment (included in our research based on telecommunication networks using bandwidth consuming professional tooling). applications. The paper has an important heuristic (practical) Another LISP evaluation [31] was performed for Android value and presents implementation and methodical steps that implementations of Open Overlay Router [9] (former LISP- aimtobeconsideredasavaluable“bestpractice.” mob). The important conclusion of this paper is that, com- paredwithstandardIPv4traffic,LISPhasalmostthehalf 3. An Overview of LISP oftherelativestandarddeviationversusIP:thismeansthat communications over LISP tunneling are very stable and this LISP is a network architecture and a set of network-layer has obvious good consequences in terms of channel through- based protocols developed by the IETF “LISP Working put, despite the delay introduced by tunneling/encapsulation. Group” in RFC 6830 [5] that documents the separation of IP The specialized literature lacks testing of LISP multihom- addresses into two new numbering spaces: Endpoint Identi- ing in mobility scenarios; the previously published LISP mul- fiers (EID-s) and Routing Locators (RLOCs) [33]. The EID tihoming tests were performed only in the above-mentioned identifies the nodes that are connected to the network. The controlled lab environments (even the Android case [31] RLOC identifies the location by using the traditional address- does not mention mobility testing) or not with complex ing schemes: IPv4 and IPv6. Most of the time, the RLOC is the applications, like video streaming (most of the previous tests public address of the routers or gateways [34]. By introducing were oriented on ping, ftp, or BitTorrent transfers). this separation, new capabilities for mobility, scalability, and So, at the application level, [28] and [23] are using bench- security become available [35]. marking methods for assessing the transfer rate by down- The LISP architecture, based on the “map-and-encap- loading torrent files. In this respect, our approach is focused sulate” paradigm, implements a mapping process that is on applications that need network performance based on transparent for the users: the RLOCs are responsible for aggregated bandwidth of different Internet providers. Thus, looking up the mapping between the destination EID-s and our evaluation methods are going towards the multimedia the corresponding destination RLOC. The key of the system streaming (more specific the WebRTC case) and to the isbasedonthedistributedmappingsystem,similartoDNS IoMT paradigm. We aim to promote decentralization of LISP (Domain Name System): MS (Map Server) and MR (Map controls: our demonstrator has an IoT gateway implemented Resolver). The MS stores the mapping between the EID and on a Single Board Computer. theRLOCofaLISPNodeanditdistributesthisinformation IoT multihoming should be seen also from the per- inthemappingsystem.TheMRisusedtointerrogatetheMS spective of mobility protocols. Though LISP is considered a database: it receives queries for EID-s and it responds with mobility protocol, the latest surveys on mobility management the corresponding RLOC. Map Servers have similar behavior solutions for IoT [32] do not mention LISP as an option. The totheHomeAgentsinMobileIP. only aspect where LISP was assessed for IoT usage is not Figure 1 describes a LISP multihoming scenario for IoT, mobility but security (details will be given in the following, several IoT gateways having also the role of xTR (Ingress/ Section 4.4). Egress Tunnel Router), thus having an assigned RLOC [33], 4 Mobile Information Systems and the IoT devices/sensors keep their identity (EID) no mat- example, the migration of the IoT gateway functions from one ter their attachment or roaming status in the network. One of RAN Cloud to another. Vehicle-to-vehicle communication the most important advantages of LISP is multihoming, as it is and self-driving cars imply a lot of processing that can only be “embedded” in the protocol definition, providing redundancy performed at the edge of the network, in the Edge Clouds, in and load-sharing, and thus IoT device (EID) can be simulta- order to minimize the delays. Migration of virtual machines neously connected to two or more IoT gateways (RLOCs). during their run using LISP is a method for the processing Furthermore, Figure 1 illustrates in the left side the LISP- power to follow the intelligent devices in IoT. For VMM (Vir- Mobile Node option, a LISP option where the mobile node tualMachineMobility),theprocessingpowerandapplica- plays the EID and RLOC role simultaneously, at a smartphone tions can follow the mobility of the “thing.” The benefits of level (there are open LISP implementations available for using LISP for linking the Virtual Machine Mobility to the Android). user mobility were already demonstrated by some experi- mental work [39]. This can be the advantage for LISP com- 4. Locator/Identifier Separation Protocol pared to other mobility protocols and correlated with the Advantages for IoT ascension of edge computing. Mobility management RFCs proposals also refer to LISP Here are some of the main advantages of using LISP for IoT as one candidate solution. “Mobility Management for 5G [34]. Network Architectures Using Identifier-Locator Addressing” [40] specification describes the Mobility Management Archi- 4.1. Easiness for End-To-End Installation in the Network and tecture for 5G Networks Using Identifier-Locator Addressing on the IoT Device. As expressed in RFC 6830 no changes are in IPv6 for virtualized mobile telecommunication networks. required to either host protocol stacks or the “core” of the Identifier-Locator addressing differentiates between location Internet infrastructure. The Locator/ID Separation Protocol and identity of a network node, and it is considered the key (LISP) can be incrementally deployed, without a “flag day” method for 5G mobility [41]. [5]. So only some elements/routers in the network need “to know” the LISP protocol (the IoT gateway in case of IoT), 4.3. RAN Multihoming and Load-Balancing. For redundancy or only a mobile device, in case the LISP-MN option of the purpose, in case of IoT elements supporting critical infras- protocol is used. The rest of the network and the routing in tructure elements, failover mechanisms are essential in a the Internet remain unchanged. There are schemes for LISP network that is connected to multiple providers, while still to non-LISP addressing and LISP proxy implementations, so being reachable via the same address (most probably an that LISP deployment is facile. IPv6 address, but EID addressing is very permissive). LISP LISP is commonly used with IPv4 or IPv6, but it can implementations allow the setting of prioritization meth- be used with any other type of addressing for the EID or ods (weighting) for the parallel connected RANs networks, RLOC addresses, as the key of the routing is part of the though providing load-balancing for enhance throughput, DNS-like mapping servers (MS). For IoT this could bring a not just back-up connectivity. great advantage; thus the end-to-end addressing of non-IP When it comes to LISP multihoming, performance eval- IoT devices, like, for instance, IEEE 802.15.4 devices, could be uation of LISP multihoming was performed in a controlled possible directly in the IP header as long as IANA (Internet environment [23]. Our implementation that will be further Assigned Number Authority) is supported, without the need detailed is making experiments in the mobile environment, of addressing the gateway. using two ISP (Internet Service Providers). We took also Another advantage of LISP is the support for High-Scale benefit of the mobility function of LISP, as our endpoint VPN support, with or without encryption. device (EID) was free to roam; furthermore, the IoT gateways RLOC itself was mobile. 4.2. Mobility. LISP is a host mobility protocol and a Virtual There are also optimization methods for LISP multihom- MachineMobilityprotocol[21].IncaseofIoTitcanbeused ing based on path ranking algorithms [24]. as host mobility; the EID based addressing is a method for simplification and abstraction of network infrastructure and 4.4. Security Aspects. LISP was considered as a protocol for theRANusedaspointofattachmentinthenetwork. IoT and step-by-step analyzed from security conformance Separation between location and identifier is considered point of view based on X.805 standard that proposes three and acknowledged as the optimal method for user/host security layers (application, services, and infrastructure); mobility. In [6] a detailed survey and analysis of network three security planes (end-user, control, and management), architectures based on location/identifier separation are pre- which are based on the performed activates over the network, sented. LISP mobility was previously compared to Mobile and eight security dimensions to address general system vul- IPv6 mobility [36]. It can be considered that also proxy nerabilities (access control, authentication, nonreputation, mobility, PMIP [37], used in LTE networks [38], is a separa- data confidentiality, communication security, data integrity, tion of edge mobility in relation to the core network; mobile availability, and privacy) [42, 43]. hosts keep their IP address as long as they are part of the same In [44, 45] a security implementation to LISP protocol has proxymobilitydomain. been found. However, this security protocol provides security As Virtual Machine Mobility protocol, LISP can be used to xTR (i.e., ITR and ETR) routers and not for devices that are for the migration of the localized processing function, for connected to the architecture. Mobile Information Systems 5

Big data and analytics services

Lisp4.net beta network Proxyy xTR MS/MR servers Data centercenter// cencentralizedtralized serservicesvices (e.(e.g.,g., emeremergencygency disdispatcher)patcher) Radio access Radio access network A network B Internet routed network Service provider A Service provider B

WAN1 WAN2

Provider 1 IoT gateway

Video capable IoT device

Devices Sensors Vehicular network

Figure 2: Simple prototyping of in-vehicle LISP configuration for IoT, based on open solutions (OOR).

In November 2016, a standard proposal was defined (i) On the IoT gateway that is also a multi-RAN router, with the IETF LISP Working Group. This memo specifies as detailed in Figure 2 LISP-SEC, a set of security mechanisms that provides origin (ii) Directly on the IoT element (“thing”) using the LISP- authentication, integrity, and antireplay protection to LISP’s MN (Mobile Node) version of the protocol imple- EID-to-RLOC mapping data conveyed via mapping lookup mentation. process. LISP-SEC also enables verification of authorization on EID-prefix claims in Map-Reply messages [46]. Our proposal for an in-vehicle architecture is based on an open-source implementation. There are several open LISP 5. LISP Implementation of RAN Multihoming implementations, and we can mention OpenLISP [48] as one and Load-Balancing for Mobile IoT of them, but we have focused our attention to Open Overlay Router, initially named LISPmob. OOR is an open-source As part of our previous work we have implemented a simu- implementation to create programmable overlay networks, lated demonstrator based on Cisco devices supporting LISP writteninC,offeringthebigadvantageofplatformflexibility, [47] in order to demonstrate the benefits of LISP compared as there are dedicated versions for Linux, Android, and to other routing protocols but also to validate security and OpenWRT. load-balancing solutions. The demonstrator, part of our We have chosen to use the Linux OOR implementation, previous work, was illustrative for the LISP configuration installed on a Raspberry Pi SBC (Single Board Computer) and functionality and can be applied for several scenarios, element that plays the role of an IoT gateway as it runs also from distributed enterprise offices to the mobility use-cases, IBMWatson[10]for“RasPi”andcanalsobeconnectedtothe ensuring encrypted communications, failover mechanisms, IBM Bluemix Cloud for further analytics and processing. andload-balancinginanemulatedenterpriseenvironment. Our IoT gateway implementation is illustrative for an eco- Compared to the emulated demonstrator we now extrap- system of overlay networks, as OOR can be integrated with olate to a mobility scenario. In this section, we propose an the concept of Software Defined Networks [49], LISP having adapted mobile IoT architecture detailing the LISP elements support also from OpenDaylight SDN Controller [50] as implementation. We have considered the case of IoT elements partoftheLISPFlowMappingsmodule[51],oneofthemost inside a vehicular or public transportation network. developed open solutions of this type. OpenDaylight can play There are 2 methods that can be chosen for implementa- theroleofthemappingservers(MS/MR);thusdecisionsfor tion of LISP for IoT: the intelligent routing are collocated with the LISP mapping 6 Mobile Information Systems

109.166.171.20 (up) Unitbv xTR intouch-ams-mr-ms-1 Yes Yes 00:10:00 0 153.16.61.32/28 213.233.72.16 (up) 109.166.171.20 (up) Unitbv xTR tdc-mr-ms Yes Yes 00:10:00 0 153.16.61.32/28 213.233.72.16 (up) 109.166.171.20 (up) Unitbv xTR upc-mr-ms Yes Yes 00:10:00 0 153.16.61.32/28 213.233.72.16 (up)

Figure 3: LISP4. Beta implementation for our “Unitbv” xTR nodes.

servers. Furthermore, SDN controllers play a crucial role in demanding from bandwidth and processing power point of the concept of network slicing defined for Network Functions view. Virtualization [52] environments in 5G networks, and one Some scenarios for IoT based on multimedia communi- dedicated mobile operator network slice can be exactly the cation are as follows: IoT slice. There are more roles that are implemented as part of (i) Coupled with video analytics, the use-case also cho- theOORopensolution:currently,itcanoperateasanxTR, sen by us for implementation (e.g., face/object recog- MS/MR, RTR, or LISP-MN. We have enabled LISP on the nition, behavior interpretation, automatic alerts when WANrouterthatactsasxTR.Anotherscenariocouldhave movement of objects is inconsistent with predefined been the usage of LISP-MN directly on the Android phone, patterns, and smart business management and mar- asdepictedinFigure1. keting) Furthermore, the IoT gateway element has 2 mobile WAN (ii) Browser-based creation of ad hoc video rooms or interfaces for two local mobile operators that we will further audio calls that could aggregate the scenario re- name Operator 1 and Operator 2. In order not to give any quested resources (e.g., ambient assisted living, com- benchmarking details on the public mobile networks without munication with ad hoc medical personal, or includ- the operator’s consent, we will not mention the commercial ing artificial intelligence) name of the public networks used. (iii) Video based robot/UAV controlling (e.g., “see what I The connection was possible via 3G USB modems and see” scenarios). the Linux tool wvdial. Each of the interfaces has a public RLOC address as visible in Figure 3 on the experimental For some of the above-mentioned services, the video network used. For the tests performed we have chosen to use quality [56] becomes essential in the case of Critical Com- the public LISP4 pilot network [53] that has been deployed munications. For example, video analytics could be used in worldwide, consisting of 8 mapping servers and several a restricted area (like an oil plant) to monitor the mobile proxy-xTR covering three main regions, USA, Europe, and workforce and signal when employees are in a dangerous Asia [54]. The LISP4 Beta network has an increased network situation (“man down” scenario). of public xTR sites. That is why when involving mobility and video analytics For the LISP4 Beta network usage we had to provide thereisaneedtoensurethesystemreliabilityandagood public/routable IP addresses in the networks of Operator 1 image quality, so the video processing is effective. The adapt- and Operator 2, as visible in Figure 3. ive codecs are reducing the video quality in case of band- Illustration of the two point-to-point connection inter- width reduction, but this could deteriorate the video to the faces, each for one mobile operator, that are aggregated in the limit, thus becoming improper for analysis. Solutions for LISP tunnel interface (lispTun0), based on the Open Overlay multihoming and load-balancing could become effective in Router implementation, is shown in Box 1. keeping the available bandwidth high; thus the automatic quality adaptations of modern codecs in case of poor network 6. IoT Video Analytics conditions will not affect the video analysis. From our implementation point of view we have chosen Wirelessvideotrafficisexpectedtobe60–75%oftheglobal touseIBMWatsonandIBMBluemixfortheIoTand mobile traffic by 2020 according to Cisco [55], but this video analytics components. One of the reasons for choosing percentage will increase considering the new set of applica- Watson is that it can be installed on Linux based systems tions to be launched in the “everything connected” Internet of like the Raspbian , so it can cope with our Things upcoming era. Internet of Multimedia Things (IoMT) Open Overlay Router implementation. Furthermore, it offers represents the proliferation of real-time communication ser- the distributed processing power of IBM Bluemix from the vices that involve the interaction of smart heterogeneous Cloud. With Watson, one can analyze and interpret all the IoT multimedia things with one another and with other Internet data, including unstructured text, images, audio, and video. connected elements [3]. We have used NodeRED [57] for IoT service description That is the reason why we have decided that in order to and, as part of our basic video analytics and for demonstrative reveal the benefits of multihoming the Internet of Multimedia purposes,wehaveconsideredthesimplecaseoffacial Things use-case is relevant, as this type of applications is very recognition. Figure 4 illustrates the image processing chain Mobile Information Systems 7

lispTun0 Link encap: UNSPEC HWaddr 00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00 UP POINTOPOINT RUNNING MTU: 1440 Metric: 1 ppp0 Lin encap: Point-to-Point Protocol inet addr: 109.166.171.20 P--P: 10.64.64.64 Mask: 255.255.255.255 UP POINTOPOINT RUNNING NOARP MULTICAST MTU: 1500 Metric: 1 ppp1 Link encap: Point-to-Point Protocol inet addr: 213.233.72.16 P-t-P: 10.64.64.65 Mask: 255.255.255.255 UP POINTOPOINT RUNNING NOARP MULTICAST MTU: 1500 Metric: 1

Box 1

has not so far been extensively used for Internet of Multimedia Things. Our initial focus was based on the video quality testing, using a reference video to be playedviaWebRTCstreams.Bycomparingtheeffec- tive bandwidth with the video quality delivered over thenetwork,wehavediscoveredthatmobileopera- tors produce their own video processing/transcoding that affects the video quality. (iv)AsthenetworkandtheWebRTCserverwereintro- Figure 4: Video analytics with IBM Watson: services visually ducing some nonpredictive variable in our testing described using NodeRed. in relation to the effective quality of the video, we focused on the quality of experience for parallel usage of multiple WebRTC streams, where the LISP implemented using NodeRED. For the face recognition, we multihoming brings advantage. considered the case of Edge Processing on the “RasPi” device with a local OpenCV (Open Computer Vision) implementa- 7.1. The Reference Mobile Coverage Maps. In order to avoid tion, but also the Cloud processing with Bluemix. The details our complex testing being influenced by the coverage prob- of these implementations that we have realized are not lems of the mobile network operators, we conducted a of this paper but are illustrations on possible usage scenario preliminary analysis of the 3G and LTE coverage maps for the with intensive bandwidth consuming applications. two operators used in parallel during our tests. We have used the following mobile configuration: a 7. Experimental Results for Multihoming and “PCTEL” scanner (produced by RF Solutions), an omnidirec- Load-Balancing in Mobile IoT Methodology tional antenna, and a “TEMS Investigation” software package running on a notebook (with a hardware configuration and Testing Approach specific for Drive-Tests). The PCTEL scanner (Figure 5) Our testing approach is based on several steps that will be enables performance assessment and offers optimizing solu- further detailed in this section: tions adapted to the wireless network under test (130 MHz to 6 GHz). Data are acquired in a SeeGull MX concurrent (i) As the multihoming and load-balancing are depen- collection, for all RF bands defined by 3GPP, for all major dent on the mobile operator coverage maps, our first technologies simultaneously (after a unique radio module, intention was to establish a baseline for the radio there are high-performance signal processing modules run- coverage using professional tools (e.g., the PCTEL ning in parallel). mobile network radio scanner). The scanned data was analyzed using TEMS Investiga- tion, an active end-to-end testing solution for verification (ii) Using this method, we have found out that not and heterogeneous RAN optimization, allowing operators to both operators investigated have proper mobile radio test and assess the network quality from a user perspective, coverage in all areas and sometimes the loss of signals including in-vehicle mobility scenarios. leads to interface disconnections in our demonstrator. The first step for setting the configuration of the scanned Thus, we have decided to introduce an automation networksisthechannelandfrequencybearerparameters methodology to make the system more responsive in selection (Figure 7), for the evaluated mobile operators. We case of errors, also enhancing the LISP advantages of have chosen the central bearer frequency for the 3G and tunneling, independent of the number of underlying 4G technologies and the bandwidth, specific for each ISP. connections. The bandwidth for 3G is in general 5 MHz, while the 4G (iii) Third step was the effective testing of video streaming bandwidth varies between 5 MHz and 20 MHz, depending on methodologies that are becoming part of the IoT the resource allocation for the frequencies of each operator, world.ThisisaninnovativeapproachasWebRTC[58] according to the radio licenses they are allowed to operate. 8 Mobile Information Systems

Figure 7: Setting the LTE central frequencies in TEMS Investiga- tion.

Figure 5: The RF Solutions “PCTEL” scanner.

Figure 6: Testing configuration using visual programming with “PCtell MX SeeGull scanner.” Figure 8: Drive-test route showing the preferred channel numbers: EARFCN (EUTRA Absolute Radio-Frequency Channel Number). In Figure 6 it is presented, in a graphical format, the configurationscriptforthe“PCtellMXSeeGull”scanner, using the TEMS Investigator software. This configuration is disconnected mobile interface does not recover by itself and used for scanning the downlink service capability in 3G and is not used again in the LISP OOR tunnel without a specific 4G for the two chosen operators. reinitiation. For the drive-test run we have used an application for Thus, we have decided to introduce, via scripting, a the real-time processing of data, including also a graphical method for “self-healing” of the system, thus making it robust representation for some of the parameters. Thus, any error or and error resistant. abnormal functionality of the system could be immediately identified and corrected, so the scanning test could continue 7.2. Automation of the LISP-Based Mobile Demonstrator for normally. IoMT. For the concepts presented in Section 5, we have We have chosen a predefined route in the city of Brasov accomplished the following demonstrator (Figure 9) that was for the drive-test reference route. The antennas were placed tested in the mobility scenario. on the car roof to avoid signal loss; the distance between the There were considered intensive bandwidth consumers, antennas and the car roof end should be bigger than 𝜆/2. video streams (on the screen of the end-user, a “thin client,” While running the test we can identify the radio condi- e.g., a tablet connected to the LISP “RasPi” node, the IoT tions on that specific route for each of the two operators and gateway). The structure of the implemented mobile test also get a statistic of the best channel to be used by the mobile system is given in Figure 10. Our mobile IoT demonstrator, device while performing the service. The LISP demonstrator based on LISP, is an autonomous system, battery powered, was driven following the circuit of Figure 8; for the validation so completely mobile. All the end-users or IoT sensors and of handover correctness, the PCTEL scanned the quality of devices are automatically connected to the system via WiFi thedownlinkfortheOperator1andOperator2cellswith as connecting to a normal hot-spot. theEARFCN(EUTRAAbsoluteRadio-FrequencyChannel System automation for treating of errors or for loss-of- Number) cell identities 1300 and 6250 (Operator 1) and 1600 signal recovery was done with bash scripting. LISP brings and 2950 (Operator 2). an additional advantage for the system robustness, besides Not all testing results will be detailed in this paper, but the multihoming and load-balancing: as with the Mobile IP using the radio scanning method we have found out that not protocol, with LISP the TCP-IP connections are preserved no both operators have a proper mobile radio coverage in all the matter the availability of physical channels/connections, but parts of the reference drive-test route. There are areas where with the advantage that there are less modifications needed we have loss of signal for one of the operators and this leads forthenetworkinfrastructure.Withourimplemented to errors in the behavior of our LISP based IoT gateway, as a scripting, besides keeping the tunnel up (and the TCP-IP Mobile Information Systems 9

∗∗ Lisp4.net beta network RLOC1 - 109.166.171. Mapping server

ISP1

ISP2 ∗∗ 153.16.61. /28 End-user ∗∗ RLOC2 - 213.233.72.

Figure 9: PTS (public transportation system) demonstrator for mobile IoT with LISP.

Power bank

Fixed public IP settings: ∗∗ RLOC1-109.166.171. :Operator 2 ∗∗ RLOC2-213.233.72. :Operator 1

∗∗ EID-153.16.61. /28 by DHCP

IoT gateway: Raspberry Pi

Figure 10: The mobile test minisystem.

connection) that is a LISP attribute we also automate a method for an interface recovery. Additionally, as emphasized [Dialer Operator 1] in Section 3, LISP brings the advantage of a facile end-to- Init1 = ATZ endimplementation,asthemobilenodedoesnotnecessarily Init2 = AT + CGDCONT = 1, “IP”, “ipfix.operator1.ro” need a specific implementation if it only uses LISP networks Init3=at+cgeqreq=1,2,0,0,0,0,2,0,“0E0”,“0E0”,3,0,0 Stupid Mode = 1 or LISP proxies. Modem Type = Analog Modem Below there are some details of the implementation Phone = ∗99 ∗ ∗ ∗ 1# that are automated as part of the “self-healing” script. The Modem = /dev/ttyUSB3 network access for the two mobile operators (based on the Username = {} AT commands for GPRS, CG, to set up the APN and the Password = {} extended quality of service required) can be configured with Baud = 460800 any software tool as in the following example (for wvdial tool): See Boxes 2 and 3. The OOR (Open Overlay Router) was configured with Box 2 two router interfaces and three MS (Map Servers), according to the addressing space allocated in Figure 3. See Boxes 4 and 5. It is important to mention that although all OOR con- Here there are some scripting extracts for the interfaces figurations were properly realized, the routes on the IoT startup and routing configuration. gateway device were not set as part of the OOR deployment See Box 6. for multihoming support. 10 Mobile Information Systems

[Dialer Operator 2] map-server { Init1 = ATZ address = 147.83.131.32 Init2=AT+CGDCONT=1,“IP”,“lant” key-type = 1 Init3=at+cgeqreq=1,2,0,0,0,0,2,0,“0E0”,“0E0”,3,0,0 key = 6YAuVd8BRJ Stupid Mode = 1 proxy-reply = off Modem Type = Analog Modem } Phone = ∗99 ∗ ∗ ∗ 1# map-server { Modem = /dev/ttyUSB0 address = 193.162.145.50 Username = {} key-type = 1 Password = {} key = 6YAuVd8BRJ proxy-reply = off } Box 3 map-server { address = 217.8.98.42 key-type = 1 key = 6YAuVd8BRJ { rtr-ifaces proxy-reply = off rtr-iface { } iface = ppp0 ip version = 4 priority = 100 Box 5 weight = 50 } { rtr-iface thousands of simultaneous clients, there are few options in iface = ppp1 regard to testing the quality of the video streams, once the ip version = 4 signaling is established [62]. Of course, we must mention the priority = 100 professional testing tools, used by mobile operators for opti- weight = 50 } mizing their network, like TEMS [63] or Nemo Outdoor [64]. } For the video quality testing there are also some imple- mentationslikeCodeUrjc[65],butthisrequiresalsothe installation of a Kurento Media Server and a complex setup Box 4 methodology to perform the tests, difficult to be used with public WebRTC servers. As we were interested to also assess the quality of the Typically, a host connected to a network, such as the video streams, we have designed our own WebRTC testing Internet, will have one default route using a WAN interface. procedure.ForIoMTthequalityofthevideocanbecritical, However, if a second WAN interface is added and both are so below some minimum quality threshold the video process- accessed, one can end up with a situation referred to as “(hot) ing cannot be considered relevant. potato routing,” or deflection routing, meaning the answer to Usingawebcamdriver,wehavesimulatedavideosource somerequestcomingoverthesecondWANinterfacewillbe and we were able to broadcast a known/reference video into replied using only the first WAN interface that is considered a WebRTC stream. We have used public available WebRTC the default route. Thus, we had to manually configure two servers like OpenTok [66] and AppRTC [67] to produce default gateways by setting two lookup rules with the same WebRTC video conferences. priority, 1000 in our case, ensuring that the two redundant Even not depicted in the following (Figure 11), several multihomed paths are used in parallel. WebRTCstreamsweresimulated.Onthecorresponding edge, we have recorded the video stream using the Recor- 7.3. WebRTC as Video Streaming over LISP Network. For test- dRTCtool[68].Thus,oncebroadcastedviatheWebRTC ing purpose, our focus was to use the latest web technologies. system, the reference video stream is recorded and can be When it comes to Real-Time Communications, WebRTC is analyzed at the corresponding edge. the new standard, enabling browsers and mobile applications with Real-Time Communications (RTC) capabilities via sim- 7.3.1. Testing Solutions. Once the WebRTC streams were ple APIs (Application Programming Interfaces). captured using the above-mentioned methodology, for the Being purely browser based and not requesting any comparative quality estimation of video streams we used application or plug-in installation [59, 60] make WebRTC the tool named qpsnr [69]. It measures the peak signal-to- a versatile option that could easily be accommodated and noise ratio (PSNR) and the structural similarity index (SSIM). embedded as part of the heterogeneous IoT ecosystem. SSIM is a method for predicting the perceived quality of Even if there are several open tools dedicated for WebRTC digital television and cinematic pictures, as well as other [61] signaling testing, mostly focused on functional and kinds of digital images and videos. SSIM is basically used load testing of WebRTC signaling (e.g., Telestax/Restcomm for measuring the similarity between two images and it implementation [61]), emulating connection of hundreds or is designed to improve on traditional benchmarks such as Mobile Information Systems 11

... if [ -z “ifconfig | grep ‘ppp1’”]; then { sleep 15 sudo ifconfig eth0 down sudo ip route add default dev ppp0 table multihome operator 2 sudo ip rule add from 109.166.171.20 lookup multihome operator 2 prio 1000 sudo ifconfig eth0 up } ...

Box 6

WebRTC server AppRTC OpenTokRTC Non-LISP Emulated video camera correspondent node play reference video file into running RecordRTC the WebRTC client LISP site

Figure 11: Method for testing WebRTC streams.

PSNR and mean squared error (MSE), which have proven to be inconsistent with human visual perception. The second test that we have performed uses an older IIS Microsoft feature for Live Streaming called Smooth Streaming [70]. It is based on an IIS7 feature called IIS Media Services that makes it possible for the server to understand Figure 12: Smooth Streaming Performance Testing Tool, perform- thelivevideoplayerrequestsandtimecode. ing video quality requests and evaluation of the response time. This Live Smooth Streaming IIS feature was previously used by Content Delivery Network (CDN) providers like Nimbus, Edgecast, or Akamai that are also currently major Cloud CDN providers. When IIS was used, the Smooth encoding bitrates are switched and adjusted to the network Streaming was performed based on the codec named Expres- connection capability. sion Encoder 4 Pro or with hardware encoders, but now the So even if it is not a real streaming test, this method is a CDN providers are supporting the latest streaming formats good indicator of the network connection capability and the such MPEG-DASH for live delivery. most proper bitrate for a video to be transmitted over a certain The HTTP-based Smooth Streaming infrastructure connection. For our tests we have used a streaming server, requests for little video chunks from the broadcasting web now part of the Akamai network [71]. server. The web server looks up the correct video “chunk” within the audio/video file and serves it up. The Smooth 7.3.2. Test Results and Analysis of Video Quality. By using Streaming Performance Testing Tool (Figure 12) emulates a the qpsrn tool comparative testing for video quality we have Smooth Streaming player that makes tiny HTTP requests observed that Operator 1 video quality is lower compared requesting a second or two of video at a certain bitrate to Operator 2 and to multihoming dual use of Operator 1 + (e.g., “give me 230 k @ 00:01:06, give me 708 k @ 00:01:08”). Operator 2. Requesting different quality video chunks and evaluating the However, other bandwidth tests, like, for example, “classi- response time were a method to assure the “smooth” stream- cal” bandwidth online testers (like Speedtest [72]), indicated ing,andbasedontheresponsetimeforeachchunk,the that Operator 1 has actually a better throughput. With our 12 Mobile Information Systems testingwewereabletoprovethatOperator1hasinplace by the infrastructure elements (the media server and the net- the so-called Mobile Video Optimization (MVO) technique work operator video processing) are not controllable. Also, that covers the use of technologies and solutions enabling we focused on the LISP advantages for multihoming that the mobile network operators to optimize the delivery of are visible in case the network resources are scarce, like in video content through video optimization techniques, prior- the scenario of using multiple parallel video streams (see itization policies, user-based customization, and intelligent Section 7.3.3). management of overall traffic on their data networks. For evaluating the traffic throughput, as visible in Table 1, Besides MVO, there are other elements to be taken into we have used the iptraf-ng tool. considerationthathaveagreatinfluenceontheone-to-one However, while the previous LISP multihoming results comparative video quality analyses using qpsrn: [22] show that the weighted load-balancing is respecting the weight percentages set for each redundant LISP link (since (i) Local browser codec. The played video (from the video a lot of small files were transferred as part of the BitTorrent source, the webcam, or in our case the emulated transfer), in a continuous data stream the load-balancing webcam), is further processed by the browser as part between the two WANconnections is not respecting the OOR of the WebRTC stream. In this case, the browser preconfigured weights. The reason is the source based routing supported code is essential, as some video codecs are used, which has the effect of routing the packets towards a adapted for multiple connections, such as H.264 SRE certain destination based on the source IP address. So the and H.265 with their “Google correspondents” VP8 effect is that if we use only one connection towards a server and VP9. VP8 is a highly efficient video compression (one video stream), those packets will be routed preferably technology developed by the WebM Project. For most over one link. In the case of BitTorrent, we have a lot of small of the browsers, the default audio codec is OPUS connections with a lot of destination IP addresses, which while for video codec it is VP8. VP9, with better fea- explains the even distribution of the traffic. tures related to multipath streaming, has no “native” Also for the bandwidth tests we have observed, in the support in Chrome, so in order to enable it, the results of the Smooth Stream Performance testing, that LISP Chrome browser should be started with the command multihoming is not efficient in case of successive requests and “chrome.exe –enable-webrtc-vp9-support” intensive signaling (see Figure 8) like in the case of retrieving (ii) The media mode of the webRTC implementation different streaming chunks based on a manifest. For each type (relayed or routed). When establishing a WebRTC of streaming (audio/video), the bitrate is mentioned, as well connection, at session creation it is specified how as the response. clients in the session will send audio-video streams, The results in Table 1 do not indicate an improvement known as the media mode with two options STUN by using two parallel WAN connections, as none of the and/or TURN. The “relay server” is a TURN server. If mobile connections was lacking bandwidth; there was no both options are available, web browser will start try- bottleneck even if the excessive signaling of using two parallel ing to use STUN first. However, if clients cannot con- connections caused its own delay. nect due to firewall restrictions or NAT, the session uses the TURN server to relay audio-video streams 7.3.3. Quality of Experience for Multiple WebRTC Streams over (also the case for the OpenTok WebRTC implementa- LISP Tunneling. In this way, we have tried to use multiple tion that we have used). WebRTC should be trans- multimedia streams, like in a real case where multiple IoMT ferring peer-to-peer data, once signaling is estab- devices are connected to the same IoT gateway and focus on lished, but using TURN mode in OpenTok introduces quality of experience. For testing purpose, we have connected another point for multimedia transcoding and stream several WebRTC streams to the same conference using the optimization. same OpenTok WebRTC implementation. We have observed that, at each WebRTC connection Thus, we have concluded that an accurate video analysis establishment, the traffic was directed either to Operator 1 test for comparing a LISP multihomed network to other net- or to Operator 2. The load-balancing observed was not for work needs some enhancements to our testing methodology: splittingthevideostreamovertwoWANmobileconnections, but in the distribution of video streams on different of data (i) Use local MS/MS servers, as the Proxy LISP server paths. used as part of the LISP4 Beta network is introducing To better explain the situation, we could make an analogy delays as they are not optimally placed. with the multicore processors: when only a thread is running (ii)UsealocalWebRTCSTUNserver;avoidNATand (in our case one WebRTC session), just one core is used (in other proxies. our case mostly one operator network is used); in case a (iii) Preset the same codec to be used, or even force a second thread is starting, it is taken over by the second core “non-bandwidth-adaptive” codec, so that bandwidth processor(inourcasetheOperator2),thusbalancingthe is reflected in the video quality and can be analyzed traffic between the 2 operators. This behavior is visible inthe with tools like qpsrn. bandwidth monitoring results (see Figure 14). When only one WebRTC stream is started, only one operator network is used; Another conclusion was that we should focus on the then the second stream is started and this is taken over mostly quality of experience delivered, as the variables introduced by operator 2. Mobile Information Systems 13

Table 1: Load-balancing with multiple WebRTC streams performed as observed with Linux tool iptraf-ng.

iptraf-ng 1.1.4 Iface Total IPv4 IPv6 NonIP BadIP Activity lo 152 152 0 0 0 0.00 kbps eth0 377005 376934 71 0 0 3012.05 kbps wwan0 34 32 2 0 0 0.00 kbps wwan1 34 32 2 0 0 0.00 kbps ppp0 230081 230081 0 0 0 1170.34 kbps ppp1 155369 155369 0 0 0 2056.27 kbps lispTun0 377582 377582 0 0 0 3012.14 kbps

350 4000

300 3500

250 3000

200 2500

150 2000

100 1500

50 1000

0 500 Audio Video Video Video Video Video Video Video 64 300 427 608 866 1233 1636 2436 0 1 webRTC 2 WebRTC 3 WebRTC 4 WebRTC Average of OP1 LISP stream streams streams streams Average of OP2 LISP Average of OP1 + Op2 LISP Sum of Operator 1 Sum of Operator 2 Figure 13: Smooth Streaming Performance Testing comparative results between Operator 1, Operator 2, and multihomed Operator 1 Figure 14: Tests indicate the bandwidth provided for each mobile + Operator 2 tests. The figure indicates the response time (in ms) to operator when playing up to 4 WebRTC streams using OpenTok. retrieve different stream chunks from a remote streaming server.

advantages when it comes to using several parallel WebRTC streams, a valid use-case for using more video capable devices The results in Figures 13 and 14 indicate that benefits of attached to the same LISP-based IoT gateway. using two or more mobile connections are mostly visible in case of multimedia information when using multiple video 8. Conclusions and Future Work streams and when congestion is affecting the network. Furthermore, our intention was to limit the bandwidth This paper is focused on the implementation and analysis ofa ofthemobileconnections,sowecanbetterassessthemulti- multihomed and load-balanced mobile IoT system with focus homing benefits. This was performed using the AT command on one mobility technology (the LISP protocol) and on one “AT + CGEQREQ,” with the intention to limit each network relevant scenario for the bandwidth demanding applications: operator bandwidth to 384 Kbps. However, the mentioned multimedia streaming and video analytics of IoMT systems. command had no effect on the live operator networks that We have made an analysis of the LISP advantages for IoT we have used, so the bandwidth was not limited in order to systems from four perspectives (as LISP usage in IoT was not simulatecongestion.Thetrendistomovethefocusofthedata so far assessed by the scientific community): easiness of end- transmission in the mobile networks from quality of service to-end deployment, mobility, multihoming, and security. We to better throughput. This explains the lack of effect ofthe have highlighted the great advantages of LISP for mobility QoS commands used. that can act as host/device mobility and as Virtual Machine We have concluded that, in the specific case of WebRTC, Mobility VMM solution, so it can be a great solution for Edge LISP usage for multihoming brings benefits for maintaining Cloud processing mobility that follows the mobility of the IoT the sessions by the use of the LISP tunneling that keeps the device/gateway. TCP connections open with the help of the implemented Furthermore, we have implemented a demonstrator for automation method for interface recovery in case of loss an IoT gateway that has the role of the mobility access of signal. Furthermore, the load-balancing brings significant gateway and also it runs the IoT framework IBM Watson 14 Mobile Information Systems with video/image analytics capability. Our demonstrator was the network links. Nevertheless, the lack of standardization mostlybasedonopensolutions,usingaRaspberryPifrom makes such testing not fully relevant for the moment [73, 74]. thehardwarepointofview,runningtheOpenOverlayRouter One important enhancement for our work would be the open LISP implementation and IBM Watson. usage of other types of identifiers for the EID addressing, Compared to previous works and multihoming tests for except IPv4 or IPv6 addresses (for this, we aim to modify LISP, we were focused on video streaming testing as part the Open Overlay Router implementation), that could bring of an IoMT system and mobility. Multihoming was repre- advantages for the easiness of “IP-less” network addressing sented by the usage of multiple mobile operator networks in Internet of Things, an important unexploited advantage of simultaneously. As a baseline for our mobility testing, and to LISP mappings. increase our tests’ relevance, we have introduced a complex demonstrator of mobile IoMT validated by a reference cover- Conflicts of Interest age scanning with high-tech industrial radio equipment and professional dedicated software. The authors declare that there are no conflicts of interest The robustness of the system was ensured by a new regarding the publication of this paper. automated treatment of radio coverage gaps: the session- oriented solution due to the LISP-EID tunnel persistence was Acknowledgments enhanced with scripting for the automatic recovery of the system in case of failure or loss of signal. This work was partially supported by Siemens Convergence As it is the latest technology in regard to multimedia Creators SRL, Romania, who provided testing support and conferencing, we have focused our test on WebRTC imple- expertise that assisted the research. The authors thank the mentations,aninnovativeproposaltobeusedaspartofIoMT members of the COST Action CA15104 IRACON, “Inclusive systems. We have implemented our own WebRTC quality Radio Communication Networks for 5G and Beyond,” for testing methodology using a webcam emulator, a recording their valuable advice and guidance related to the concepts tool, and public WebRTC servers. The experimental LISP presented in this paper. network used for tests was the LISP4 Beta network. In our analysis, we have presented the multiple implica- References tions and specificity of mobile multimedia testing; thus we [1] NB-IOT-feature list, Release 13 (LTE Advanced Pro), 3GPP, haveconcludedinasetofmeasuresthatwewillimplement http://www.3gpp.org/images/PDF/R13 IOT rev3.pdf. in the future for a more accurate measurement of the LISP [2] O. Vermesan and P. Friess, Internet of Things: Converging Tech- multihoming performance: local LISP MS/MR routers, use nologies for Smart Environments and Integrated Ecosystems, of STUN WebRTC servers, and use of several video codecs River Publishers, Denmark, 2013. to check the impact of adaptive bitrate streaming to the test [3]S.A.Alvi,B.Afzal,G.A.Shah,L.Atzori,andW.Mahmood, methodology. “Internet of multimedia things: vision and challenges,” Ad Hoc Furthermore, as the testing environment cannot be fully Networks, vol. 33, pp. 87–111, 2015. controlled (end-to-end), we have focused on the quality of [4] M. J. Peltola, A. University, and H. Hammainen, “Economic fea- experience rather than on the absolute video quality evalua- sibility of mobile broadband network for public safety and tion. From our tests we have presented the advantages of hav- security,” in Proceedingsofthe11thIEEEInternationalConfer- ing multiple parallel mobile connections for the LISP multi- ence on Wireless and Mobile Computing, Networking and Com- homing and load-balancing purpose that becomes relevant munications, WiMob 2015, pp. 67–74, are, October 2015. when using several multimedia WebRTC streams simultane- [5] D. Farinacci, V.Fuller, D. Meyer, and D. Lewis, “The Locator/ID ously. Separation Protocol (LISP),” RFC Editor RFC6830, 2013. As further work, we would like to combine the current [6] W. Ramirez, X. Masip-Bruin, M. Yannuzzi, R. Serral-Gracia, implemented IoT video analytics with the Edge Processing A. Martinez, and M. S. Siddiqui, “A survey and taxonomy of options, Raspberry Pi being a perfect candidate to execute ID/Locator Split Architectures,” Computer Networks,vol.60,pp. 13–33, 2014. some of this processing (e.g., face recognition) while further Cloud video analysis could be triggered only when additional [7] “Mobile Edge Computing (MEC); Service Scenarios,” in ETSI Group Specification, 2015, http://www.etsi.org/deliver/etsi gs/ video processing is needed. Being closer to end-user sites MEC-IEG/001 099/004/01.01.01 60/gs MEC-IEG004v010101p results in reduced transmission costs for businesses and .pdf. improvedqualityofserviceforconsumers.Wewouldlike [8] T. Taleb and A. Ksentini, “Follow Me cloud: interworking fed- to couple the LISP mobility with the Edge Processing; thus erated clouds and distributed mobile networks,” IEEE Network, when a LISP device (having one EID) migrates from one vol. 27, no. 5, pp. 12–19, 2013. IoT gateway (RLOC) to another, also the Edge Processing [9] “Open Overlay Router (OOR),” http://www.openoverlayrouter function would migrate from one IoT gateway to another. .org. Decentralized computing mitigates the risk of a bottleneck [10] “IBM Watson,” https://www.ibm.com/watson. effect when moving large amounts of data, translating into [11] G. Dandachi, S. E. Elayoubi, T. Chahed, and N. . Taher, “Per- lower risk of latency and faster access for customers. formance evaluation of user centric multihoming strategies in AnotherscenariothatwewanttotestistouseaP2P-TV LTE/WiFi networks,” in Proceedings of the 2016 IEEE Wireless system for the video streaming tests, which uses WebRTC Communications and Networking Conference, WCNC 2016,qat, over P2P networks to improve the load-balancing over April 2016. Mobile Information Systems 15

[12] S. Mukherjee, A. Baid, I. Seskar, and D. Raychaudhuri, “Net- [28] M. F. Almirall, Wireless LISP: Prototyping and Evaluation - A work-assisted multihoming for emerging heterogeneous wire- LISP Implementation in the BOWL Testbed at Deutsche Telekom less access scenarios,” in Proceedings of the 2014 25th IEEE Labs [Master, thesis], Technische Universitat¨ Berlin, 2011, Annual International Symposium on Personal, Indoor, and https://core.ac.uk/download/pdf/41803776.pdf. Mobile Radio Communication, IEEE PIMRC 2014,pp.1520– [29] F.Castro,A.Martins,N.Capela,andS.Sargento,“Multihoming 1524, usa, September 2014. for uplink communications in vehicular networks,” in Pro- [13] T. Aura, P. Nikander, and G. Camarillo, “Effects of Mobility and ceedings of the 2017 Wireless Days (WD), pp. 230–237, Porto, Multihoming on Transport-Protocol Security,”in Proceedings of Portugal, March 2017. the IEEE Symposium on Security and Privacy (S&P),pp.12–26, [30] M. Alexandru and R. Urechiatu, “LTE Indoor Radio Coverage Berkeley, CA, USA, May 2004. Optimization Study in Modern City Environments,” Review of [14] A. Dhraief and A. Belghith, “Multihoming support in the Inter- the Air Force Academy,vol.2,no.26,2014. net: A state of the art,” in Proceedings of the International Con- [31] L. Stornaiuolo and P. Bellavista, “State-of-the-art multihoming ference on Models of Information and Communication Systems solutions for Android: A quantitative evaluation and experience (MICS),Rabat,Morocco,2010. report,” in Proceedings of the 11th International Conference on [15]B.M.Sousa,K.Pentikousis,andM.Curado,“Multihoming Network and Service Management, CNSM 2015, pp. 158–162, esp, Management for Future Networks,” Mobile Networks and Appli- November 2015. cations,vol.16,no.4,pp.505–517,2011. [32] S. M. Ghaleb, S. Subramaniam, Z. A. Zukarnain, and A. [16] J. R. Iyengar, P.D. Amer, and R. R. Stewart, “Concurrent multi- Muhammed, “Mobility management for IoT: a survey,” Eurasip path transfer using SCTP multihoming over independent end- Journal on Wireless Communications and Networking,vol.2016, to-end paths,” IEEE/ACM Transactions on Networking,vol.14, no. 1, article 165, 2016. no. 5, pp. 951–964, 2006. [33] LISP Overview, Cisco Whitepaper, http://lisp.cisco.com/lisp [17] Ł. Budzisz, R. Ferrus,´ A. Brunstrom et al., “Towards transport- over.html. layer mobility: Evolution of SCTP multihoming,” Computer [34] L. Iannone, D. Saucez, and O. Bonaventure, “Implementing the Communications, vol. 31, no. 5, pp. 980–998, 2008. locator/ID separation protocol: design and experience,” Com- [18] A. Gladisch, R. Daher, and D. Tavangarian, “Survey on mobility puter Networks,vol.55,no.4,pp.948–958,2011. and multihoming in future internet,” Wireless Personal Commu- [35] V. Jain, A study of Locator ID Separation Protocol, 2011, MSc nications,vol.74,no.1,pp.45–51,2014. paper, Kansas-City University/ProQuest publishers. [19] P.Holliday, “NOMAD A Mobile Ad Hoc and Distruption Toler- ant Routing Protocol for Tactical Military Networks,” in Pro- [36] M. Isah and C. Edwards, “Inter-domain Mobility with LISP-MN ceedings of the 2009 29th IEEE International Conference on - A Performance Comparison with MIPv6,”in Proceedings of the Distributed Computing Systems Workshops (ICDCS Workshops), 8th IFIP Wireless and Mobile Networking Conference, WMNC pp.488–492,Montreal,Quebec,Canada,June2009. 2015,pp.80–87,deu,October2015. [20] B. Simpson and S. N. Bhatti, “An identifier-locator approach to [37] S.-I. Choi and S.-J. Koh, “Use of Proxy Mobile IPv6 for Mobility host multihoming,”in Proceedings of the 28th IEEE International Management in CoAP-Based Internet-of-Things Networks,” Conference on Advanced Information Networking and Applica- IEEE Communications Letters, vol. 20, no. 11, pp. 2284–2287, tions, IEEE AINA 2014, pp. 139–147, can, May 2014. 2016. [21] A. Rodr´ıguez Natal, L. Jakab, M. Portoles´ et al., “LISP-MN: [38]C.Mavromoustakis,G.Mastorakis,andJ.M.Batalla,Eds., mobile networking through LISP,” Wireless Personal Communi- Internet of Things (IoT) in 5G Mobile Technologies , Springer, cations,vol.70,no.1,pp.253–266,2013. ISBN,2016. [22] D. Saucez, L. Iannone, A. Cabellos, and F. Coras, “Locator/ID [39] S. Secci, P. Raad, and P. Gallard, “Linking virtual machine Separation Protocol (LISP) Impact,”RFC Editor RFC7834, 2016. mobility to user mobility,” IEEE Transactions on Network and Service Management,vol.13,no.4,pp.927–940,2016. [23]S.Haeri,R.Gill,M.Hay,T.Wong,andL.Trajkovic,“Multi- homing with locator/ID Separation Protocol: An experimental [40] J. Mueller and T. Herbert, Mobility Management for 5G Net- testbed,” in Proceedings of the 14th IFIP/IEEE International work Architectures Using Identifier-locator Addressing,2016, Symposium on Integrated Network Management, IM 2015,pp. https://tools.ietf.org/html/draft-mueller-ila-mobility-01. 1238–1241, can, May 2015. [41] P. Rost, A. Banchs, I. Berberana et al., “Mobile network archi- [24] D. Saucez, B. Donnet, L. Iannone, and O. Bonaventure, “Inter- tecture evolution toward 5G,” IEEE Communications Magazine, domain traffic engineering in a locator/identifier separation vol.54,no.5,pp.84–91,2016. context,” in Proceedings of the 2008 IEEE Internet Network [42] A. Raheem, A. Lasebae, M. Aiash, and J. Loo, “Supporting Management Workshop, INM 2008,usa,October2008. communications in the IoTs using the location/ID split proto- [25] B. Haindl and M. Lindner, “Ground based lisp for multilink col: A security analysis,” in Proceedings of the 2nd International operation in ATN/IPS communication infrastructure,” in Pro- Conference on Future Generation Communication Technologies, ceedings of the 35th DASC Digital Avionics Systems Conference, FGCT 2013, pp. 143–147, gbr, November 2013. DASC 2016, usa, September 2016. [43] A. Stanciu, M. N. Cirstea, and F. D. Moldoveanu, “Analysis and [26] B. Haindl, “LISP – A Multi-Homing and Mobility Solution for Evaluation of PUF-Based SoC Designs for Security Applica- ATN using IPv6,” in Proceedings of International Civil Avia- tions,” IEEE Transactions on Industrial Electronics,vol.63,no. tion Organization (ICAO), Aeronautical Communications Panel 9, pp. 5699–5708, 2016. (ACP) - 7th meeting of Working Group 1,Montreal,CA,2014. [44] M. Aiash, “A Novel Security Protocol for Resolving Addresses [27] T. McParland, “Multihoming in the ATN/IPS,” in Proceedings in the Location/ID Split Architecture,” in Network and System of the 2016 Integrated Communications Navigation and Surveil- Security,vol.7873ofLecture Notes in Computer Science,pp.68– lance (ICNS), pp. 2B2-1–2B2-11, Herndon, VA, USA, April 2016. 79, Springer Berlin Heidelberg, Berlin, Heidelberg, 2013. 16 Mobile Information Systems

[45] M. Aiash, A. Al-Nemrat, and D. Preston, “Securing Address [68] RecordRTC, “WebRTC Audio, Video and Screen Recording,” Registration in Location/ID Split Protocol Using ID-Based https://www.webrtc-experiment.com/RecordRTC/. Cryptography,” in Wired/Wireless Internet Communication,vol. [69] QPSNR, “A quick PSNR/SSIM analyzer,” https://github.com/ 7889 of Lecture Notes in Computer Science,pp.129–139,Springer hsanson/qpsnr. Berlin Heidelberg, Berlin, Heidelberg, 2013. [70] SSPERF, “Smooth Streaming Performance Testing Tool,” [46] F. Maino, V. Ermagan, A. Cabellos, and D. Saucez, “LISP- https://ssperf.codeplex.com/. Security (LISP-SEC),” https://tools.ietf.org/html/draft-ietf-lisp- [71] “Akamai Live video streaming tool,” https://www.akamai.com/ sec-12. us/en/resources/live-video-streaming.jsp. [47] T. Balan, D. Robu, and F. Sandu, “LISP Optimisation of Mobile [72] “Speedtest – Global Broadband Speed Test,” http://beta.speed- Data Streaming in Connected Societies,” Mobile Information test.net/. Systems, vol. 2016, Article ID 9597579, 2016. [73] Streamroot DNA, “distributed delivery architecture for large- [48] “The OpenLISP Project,” http://www.openlisp.org/. scale OTT and broadband TV,” https://www.streamroot.io. [49] T. Nadeau and K. Gray, “SDN: Software Defined Networks, An [74] Peer5, “P2P CDN (peer-to-peer content delivery network),” Authoritative Review of Network Programmability Technolo- https://www.peer5.com/. gies,” O’Reilly Media,2013. [50] “OpenDaylight: Open Source SDN Platform,” https://www .opendaylight.org. [51] OpenDaylight: LISP Flow Mapping, https://wiki.opendaylight .org/view/OpenDaylight Lisp Flow Mapping:Architecture. [52] R. Cziva, S. Jouet, D. Stapleton, F. P. Tso, and D. P. Pezaros, “SDN-based virtual machine management for cloud data cen- ters,” IEEE Transactions on Network and Service Management, vol.13,no.2,pp.212–225,2016. [53] The LISP pilot network, http://www.lisp4.net/. [54] “The International LISP Beta Network,” http://www.lisp4.net/ images/lisp-ddt.pdf. [55] “Cisco Visual Networking Index: Global Mobile Data Traffic Forecast Update, 2015–2020,” http://www.cisco.com/c/dam/ m/en in/innovation/enterprise/assets/mobile-white-paper-c11- 520862.pdf. [56] L.G.U.Garcia,E.P.L.Almeida,V.S.B.Barbosaetal.,“Mission- critical mobile broadband communications in open-pit mines,” IEEE Communications Magazine,vol.54,no.4,pp.62–69,2016. [57] Node-RED, “Flow-based programming for the Internet of Things,” https://nodered.org/. [58] S. Loreto and S. P. Romano, “Real-Time Communication with WebRTC,” O’Reilly Media,2014. [59] M. Fadda, M. Murroni, and V. Popescu, “Interference Issues for VANET Communications in the TVWS in Urban Environ- ments,” IEEE Transactions on Vehicular Technology,vol.65,no. 7, pp. 4952–4958, 2016. [60] A. Johnston and D. Burnett, WebRTC: APIs and RTCWEB Protocols of the HTML5 Real-Time Web, Digital Codex LLC, 2014. [61] WebRTC Test, Framework for functional and Load Testing of WebRTC, https://github.com/RestComm/webrtc-test. [62] J. Nightingale, Q. Wang, and C. Grecos, “Performance evalua- tion of concurrent multipath video streaming in multihomed mobile networks,” International Journal of Digital Multimedia Broadcasting,vol.2013,ArticleID319594,2013. [63] “TEMS - Testing, monitoring, and analytics of radio and core networks,” http://www.tems.com. [64] “Nemo Outdoor 5.1 mobile testing,” http://www.anite.com/ businesses/networks-testing/news/nemo-outdoor-51-ready-road. [65] “CodeUrjc - automated assessment of WebRTC parameters,” https://github.com/codeurjc/webrtc-benchmark. [66] “TokBox WebRTC Demo on OpenTok platform,” https://open- tokrtc.com. [67] AppRTC, “Video-conference demo app based on WebRTC,” https://appr.tc/. Advances in Journal of Multimedia Industrial Engineering Applied Computational Intelligence and Soft

International Journal of Computing The Scientific Distributed World Journal Sensor Networks Hindawi Publishing Corporation Hindawi Publishing Corporation Hindawi Publishing Corporation Hindawi Publishing Corporation Hindawi Publishing Corporation http://www.hindawi.com Volume 2014 http://www.hindawi.com Volume 2014 http://www.hindawi.com Volume 2014 http://www.hindawi.com Volume 2014 http://www.hindawi.com Volume 201

Advances in Fuzzy Systems

Modelling & Simulation in Engineering

Hindawi Publishing Corporation Hindawi Publishing Corporation Volume 2014 http://www.hindawi.com Volume 2014 http://www.hindawi.com

Submit your manuscripts at https://www.hindawi.com -RXUQDORI &RPSXWHU1HWZRUNV DQG&RPPXQLFDWLRQV Advances in Artificial Intelligence +LQGDZL3XEOLVKLQJ&RUSRUDWLRQ KWWSZZZKLQGDZLFRP 9ROXPH Hindawi Publishing Corporation http://www.hindawi.com Volume 2014

International Journal of Advances in Biomedical Imaging $UWLÀFLDO 1HXUDO6\VWHPV

International Journal of Advances in Computer Games Advances in Computer Engineering Technology Software Engineering

Hindawi Publishing Corporation Hindawi Publishing Corporation Hindawi Publishing Corporation Hindawi Publishing Corporation Hindawi Publishing Corporation http://www.hindawi.com Volume 2014 http://www.hindawi.com Volume 2014 http://www.hindawi.com Volume 2014 http://www.hindawi.com Volume 201 http://www.hindawi.com Volume 2014

International Journal of Reconfigurable Computing

Advances in Computational Journal of Journal of Human-Computer Intelligence and Electrical and Computer Robotics Interaction Neuroscience Engineering Hindawi Publishing Corporation Hindawi Publishing Corporation Hindawi Publishing Corporation Hindawi Publishing Corporation Hindawi Publishing Corporation http://www.hindawi.com Volume 2014 http://www.hindawi.com Volume 2014 http://www.hindawi.com Volume 2014 http://www.hindawi.com Volume 2014 http://www.hindawi.com Volume 2014