Ken SAKAMURA the Iot in Action

Ken Sakamura Professor and Director of Institute of Infrastructure Application of Ubiquitous Computing (IAUC), Interfaculty Initiative in Information Studies, Graduate School, the University of Tokyo Director, YRP Ubiquitous Networking Laboratory Chair, TRON Forum / uID Center Copyright © 2016 by Ken Sakamura

Building Controlled by Open API ① INIAD HUB-1 Every facility in the building can be controlled via API

2 INIAD HUB-1 (Akabanedai, to be opened in2017)

Open API Control API (Application Program Interface) API is a means of passing the command and the command itself for a system to control others automatically The operating status of building facilities, environmental control devices, etc. can be read and they can be controlled via network by means of API.

█ Feasibility study of prototype applications for the IoT research ● Operation of autonomous robot wheelchairs and drones on campus ● Introducing deep learning AI technology for the optimized use of energy or security on campus █ Students can learn how to control their environment by programming in tutorial classes ● Proposal of new business that uses the IoT technology and practicing prototypte creation

6 cf) Daiwa Ubiquitous Computing Research Building

Built in May, 2015 on in the Hongo campus of the University of Tokyo Already conducted many experiments to learn knowhows of open IoT building

Uses the building itself as platform for the research on the IoT environment

10 Copyright © 2016 by Ken Sakamura API for Daiwa Ubiquitous Computing Research Building 1. Warning/Alarm API 2. Rooftop sensor API 3. Indoor Sensor API 4. Illumination API 5. Air conditioner API 6. Electricity smart meter API 7. Elevator API 8. Location API

Various new research results can be tested against the real environmental control needs such as the control by audio command, or visual recognition of gestures by indoor camera.

Floor space is 7 times larger Controlled objects from 200 to 2,000

From the IoT to the IoS ③ Open collaboration of services including homes, buildings, businesses, governments, etc. by means of open API

The essence of the IoT is that the autonomous collaboration of "objects" by means of the API

Such automatic collaboration by means of API does not distinguish "objects" and "humans"

█ Objects are at the end of API = the IoT in the narrow sense █ Buildings are at the end of API ● Open IOT building platform █ Humans are at the end of API ● Matching service █ Organizations are at the end of API ● So-called "API economy" ● Open data, for example ● If the organization at the API is a financial institution, this is a scenario of "Fintech"

█ The collaboration of these services is the important essence

A world where the services, irrespective of the targets such as objects, people, or organizations, can collaborate with each other openly by means of the API

Organization

Human

IoS The Internet of Services

Object

Open API for the IoS ③

Making API Open Necessity to make API open in order to realize the IoT environment

We need the attitude change of companies as well as technology change

23 Device collaboration cannot go beyond the confinment of a

single company if the API is closed Made by B Corp. Network-enabled Panel Heater Made by A Corp. Network-enabled air conditioner Isolated ✕

Made by A Corp. Made by A Corp. Network-enabled Humidifier Network-enabled Circulator Using API of A Corp. they can collaborate

24 Copyright © 2016 by Ken Sakamura Open API makes supporting the physically-challenged easier █ E.g. Volunteer programmers can develop software for people with disabled arms, or paraplegics to use home appliance via voice control.

█ When the cost of development and distribution is low, a customized software used only by 100 users can be developed. ● Customization and tuning to each individual is very important when it comes to software that supports the

25 challenged people. Copyright © 2016 by Ken Sakamura IoT bridges the gap between the virtual world in the network and real world "Open API" makes it possible to program real world objects and make them collaborate with each other as in the objects in the virtual world.

There are combinatorial explosion of technogical challenges, and there is a possibility of seeing many innovations.

Open data for the IoT ④

Open data is very important for the IoT Good educated judgement requires more than dynamic data available from one's own sensors.

We need much more context data in the wider surrounding. Static data of the building such as laayout of the floors, facility configuration and layout, and dynamic social data such as weather forecast in the neighborhood, earthquake data, current traffic conditions, etc.

Open data is a form of open API

"Open data" is data inside databases that can be read via the network using open API.

AI is an important

component for the IoT

Making proper educated judgment based on the big data

consisting of realtime sensor data and open data

is impossible for the conventional control systems, not to mention the human operators.

High expectation on the AI of deep neural network type

Input Output

Open IoT AIBuilding Platform

Open API IoT

Example usage: In an IoT building

Proper control that uses open data from the society as a whole such as weather forecast, the transportation status including delay of train operation, etc.

33 Obama administration in USA

█ President Obama issued a memorandum, "Transparency and Open Government", on January 21, the day when he was sworn in as president. █ The content of the memo ● "Openness will strengthen our democracy and promote efficiency and effectiveness in Government." ● "We will work together to ensure the public trust and establish a system of transparency, public participation, and collaboration. "

34 Advances of “Open Data” movement

█ Turning government data at the national level into open data ● Many national governments have introduced portal sites after the early introduction of data.gove.uk (UK) and data.gov (USA) ● data.gov started with only 47 data sets, but now has more than 160000 data sets (as of April 2016) █ EU had the head start: UK, France, countries in northern Europe have open data portals with 1-100,000 data sets.

35 Open Data Charter was agreed upon at G8 in June 2013 █ The overview ● Open government data are an essential resource of the information age. ● Moving data into the public sphere can improve the lives of citizens, and increasing access to these data can drive innovation, economic growth and the creation of good jobs. ● Making government data publicly available by default and reusable free of charge in machine-readable, readily-accessible, open formats, and describing these data clearly so that the public can readily understand their contents and meanings, generates new fuel for innovation by private sector innovators, entrepreneurs, and non-governmental organisations. ● The progress has been and will be reviewed at each G8 meeting.

36 Open data in London

The Olympic and Paralympic Games in 2012 triggered the open data movement

Transport for London (TfL) released large amount of data

37 Data released by Transport for London (TfL)

█ Live data █ Statistics ● bus operation status ● subway operation status ● Traffic survey data ● traffic jam status ● Number of passengers who use ● Data shown on the roadside electric displays London subway ● Rental bicycle availability at docking stations ● Usage statistics of rental bicycles ● Images from traffic monitor cameras ︙ ︙ █ Basic information █ Olympic-related information ● Standard timetable ● EV recharge spot information (until the Games ended) ● Stations, piers, bus stop locations and KML The expected wait time at the feed ● stations during Olympic Games ● Accessibility data of public transportation facilities ● Event-related oute change/control ︙ information during Olympic Games

38 Open data has become the legacy of Olympic Games Many apps and services related to transporation were born. The economic positive effect was estimated to be 20 million to 70 million GBP in the first year alone.

Other public transportation operators which had created apps on their own switched to open data approach

39 Apps that provide the live information of public transporation in London have multiplied in numbers.

40 From London to Rio de Janeiro

41 2016 Rio de Janeiro Games used data.rio

█ Rio's open data catalog site ● http://data.rio █ Data provided there ● History(922) ● Governmetn (2) ● Social development ● Education(8) ● Entertainment (8) ● Sports (7) including the calendar of Olympic and Paralympic Games ● Tax (2) ● Environment (5) ● Internal Revenue (2) ● Health (2) ● Transportation(23) ● Sightseeing (5) ● Urban planning(7)

42 Olympic City Transportation Challenges

Application contest that was held in Rio de Janeiro to call for transportation applications for the Olympic Games http://transportchallenge.rio/

43 Association for Open Data of Public Transportation

ODPT: association for Open Data of Public Transportation Established in September 2015 to achieve open data of Tokyo's public transportation data in 2020

44 The overview of ODPT

█ Objective of its activity ● Building the standard platform to build advanced next generation open public transportation information services with the public transportation open data at its core █ Main activity plan ● Building the Public Transportation Open Data Center ● Popularization and promotion of public transportation open data such as holding usage contests, etc. ● Research and development of information provision method to variety of users including the physically-challenged and overseas visitors ● Standardization of the positioning infrastructure at the traffic terminals such as train stations ● Providing multi-language dictionary of public transportation terms for automatic machine translation ● Policy proposal for improving public transportation toward 2020 Olympic and Paralympic Games

45 Service overview

Railway operation data Service vender End user

Facility data

End user

ODPT Center Bus operation data Provided in standard protocol, standard data format through the Internet Network service vender Airway Variety of use cases such as notice of delay Digital signage operation data to collaboration partners 46 Almost all the major public transportation operators that cover Tokyo area have participated

█ WingArc1st Inc. █ Secom Trust Systems Co., Ltd. █ Tokyo Waterfront Area Rapid Transit, Inc. █ Val Laboratory Corporation █ ALL NIPPON AIRWAYS CO., LTD. █ TOBU RAILWAY CO., LTD. █ UNOBUS █ Sony Corporation █ TOBU BUS CO., LTD. █ LCL Inc. █ Dai Nippon Printing Co., Ltd. █ NARITA INTERNATIONAL AIRPORT █ Odakyu Electric Railway Co., Ltd. █ TOKYU BUS CORPORATION CORPORATION █ OdakyuBus Co., Ltd. █ TOKYU CORPORATION █ Nishi Tokyo Bus Co., Ltd █ KANTO Bus Co., Ltd █ Fukuda Laboratory, School of █ Japan Airport Terminal Co., Ltd. Environment and Society, Tokyo █ Google Japan, Inc. █ Japan Airlines Co., Ltd. █ Institute of Technology █ Keio Corporation █ Microsoft Japan Co., Ltd. █ Yai Laboratory, Tokyo Institute of █ Keio Dentetsu Bus Co., Ltd. Technology █ PASCO CORPORATION █ Keisei Electric Railway Co., Ltd. █ Tokyo International Air Terminal █ Panasonic System Networks Co., Ltd. Corporation █ Keikyu Corporation █ Hitachi, Ltd. █ Kokusai Kogyo Co., Ltd. █ Institute of Infrastructure Application of Ubiquitous Computing, Interfaculty █ National Defense Academy █ SATO HOLDINGS CORPORATION Initiative in Information Studies, █ Mitsubishi Electric Corporation Graduate School, the University of █ Jorudan Co., Ltd. Tokyo █ YURIKAMOME Inc. █ SEIBU RAILWAY Co., Ltd. █ Bureau of Transportation, Tokyo █ YRP Ubiquitous Networking Laboratory █ Seibu Bus Co., Ltd. Metropolitan Government █ Tokyo Metropolitan Television Broadcasting Corp.

⑤ Open platform project Projects to build open platforms to realize the IoS environment to which TRON Project contributes much

49 CPaaS.io City Platform as a Service – Integrated Open

An EU-Japan collaborative project to build an open software platform that helps cities to solve urban issues

50 R&D content

█ Study of public big data platform ● A research on big data and open data platform that can manage in an integrated manner the real-time data from sensors, etc., static open data held by public sector organizations, and data on communication networks. ● A research on an integrated platform that mixes IoT technology and open data technology derived from semantic web technologies such as RDF+ucode+REST. (In a nutshell, realization of "u2 architecture"). █ IoT research including big data analysis, deep learning, edge heavy computing, etc. █ Research on the solutions that uses open data to solve social issues. ● Transportation ● Tourism ● Healthcare and Medical care

OPaaS.io Omotenashi Platform as a Service – Integrated Open

NIPPON Hospitality ("Omotenashi") CARD O MO TE NA SHI

A government-industry project for "Promoting ICT Use Through Society In View of 2020"

MIC (Ministry of Internal Affairs and Communications) Project: “Promoting ICT Use Through Society In View of 2020”

█ Hosted by Ministry of Internal Affairs and Communications, it is joined by Tokyo metropolitan government, The Tokyo Organising Committee of the Olympic and Paralympic Games, Ministry of Land, Infrastructure, Transportation and Tourism (MLIT), Japan Tourism Agency of MLIT, IT vendors, and service vendors in retail, sightseeing, and travel industries. █ A project to establish the service infrastructure that can cater to the needs of "Omotenashi (hospitality)" to overseas sightseers in the year, 2020 and then to the needs of Japanese citizens afterward as the legacy of the Games.

█ User attribute information is collected and stored ... ● User attribute information is: name, preferred language, size of one's clothing, religous taboos, food preference, etc. But it is up to the user how much he/she stores. █ Under the strict control of end users ... ● End users are the users of the service, and many overseas tourists in the year 2020 are the primary targets. █ Passing the information appropriately to service vendors... ● Services in real world such as hotels, shops, restaurants, museums, art museums, transporatation, etc. are handled rather than the services in the virtual world of networks. █ Open platform for "mediation" (match making) ● The system is open in that it can be used by anyone for anything anytime as long as the registration is done by agreeing to the terms of the platform.

an end user an end user …… an end user an end user Escrow the user attribute(s) to the platform

OPaaS.io mediates

Apply for the usage of user attribute(s)

a service a service a service

Name Residence Age Sex

Name Name Name Residence Age Age ge Sex Sex Sex

Service Vendor

Name

Not CRM (Customer Relationship Management) driven by vendors VRM (Vendor Relationship Management) driven by users

This is an infrastructure service that sends the REQUESTs to the service vendors instead of the user attributes appropriately. For example, "has handicap with one's legs" is "one's attribute", and "guide me using route that does not have bumps along the way" is a request. Collaboration with the government‘s systems for individual identification, and provision of more risk-free infrastructure that can handle privacy data effectively in the clouds This service can be used for variety of purposes from the use by SMEs that cannot spend much on the security of privacy data handling to the government offices where efficiency of handling such data is expected.

Technologies that support the IoT ⑤

Aggregate Computing Model ⑤ 1

TRON Project's architecture model to realize the IoT environment

Governance is required in the age of the Open IoT The advanced management is required "to use something appropriately“.

Access control framework must admit flexible governance management.

With less 'built-in equipment', With a lot of "IoT equipment", control process was light, if control processing is also heavy, so low environmental impact it will be a huge environmental burden

Governance management is heavyweight function. Advanced management needs advanced judgment.

This requires large amount of resources. Policy-based group management of access rights and partial exposure of data, changing of access rights based on the ordinary and emergency settings, and automatic/augmented judgment by artificial intelligence

Functionally rich edge nodes are NOT eco-friendly Many edge nodes will be distributed in the environment.

If the edge nodes are full-fledged rich nodes, they become a burden on the environment (environmental load).

Aggregate Computing Model proposed by TRON Project We achieve the hybrids of "open" and "closed with guaranteed quality of service".

M Corp.

H Corp. N Corp. Collaboration

S Corp. P Corp.

M Corp. P Corp.

P Corp.

N Corp.

Advanced heavy functions are performed in the clouds.

Functions that do not need real-time response should be implemented in the clouds, and edge nodes (= embedded systems) should be lightweight.

█ Embedded system products talk to the manufacturers' clouds directly via tunneling. ● If we only need to focus on the particular connection with a preselected cloud, we can implement a simple and strong security using relatively small amount of computing resources. █ Such clouds must have open API. █ These cloud services then collaborate with other clouds. ● Products that are equipped with general information processing OS and have built-in published API can be the targets of collaboration, too.

█ The platform to facilitate the collaboration of the manufacturers' clouds with advanced access control is provided.

IoT-Aggregator and IoT-Engine

█ Collaboration among services █ Tunneling to a fixed target ● Governance management by means of role-based access control to the APIs of manufacturers clouds ● A tunneling connection to the ● Standard app is provided for users for managing manufacturer's cloud is automatically collaboration established once a device is connected ● Standard API for collaboration is provided to a LAN ● Discovery mechanism for services to be █ Support of IPv6 and IPv4NAT tunneling collaborated ● Matching steps with the consumer are ● Translation mechanism between the manufacturers' supported using owner authentication proprietary APIs and standard API function. ● Synthesized device to manage control over multiple edge nodes

71 Open IoT by means of IoT-Aggregator and IoT-Engine

M Corp.

H Corp. N Corp. IoT-Aggregator

S Corp. P Corp.

M Corp. P Corp.

P Corp. IoT-Aggregat Dashboard N Corp.

S Corp. H Corp.

IoT-Aggregator



█ ID area is longer than before. ucode 2.0 data structure ● ID area was 104-bit before, but ucode2.0 has 124-bit ID area. █ Attributes for management are stored elsewhere as information associated with the ID. ● ID does not have structure just as the previous ucode did not. █ Classes have been defined for ucode assignment, and each class defines a set of attributes. ● ucode base classes are defined and uID center manages the "basic attributes" for each such class. █ Transfer of the ownership of ucode is now supported. ● ucode manager now supports the transfer of ownership, leasing, or the change of manager of the objects to which ucode is assigned. ● The transfer of the issuer's right of ucode is also supported. █ API is provided. ● Standard REST API for issuing of ucode, transfer of the ownership, etc. is provided.

Proprietary API M Corp. Device S Corp. Profile Repository Virtual Device

N Corp. P Corp. Standard API

Coordination via Standard API

Device Manager H Corp.

The "virtual device" that corresponds to the real device is in the clouds.

77 Access control by means of device virtual object model

Access policy Source service action Authorized Device virtual object ucode X Any Allow device virtual objects (ucode Y’) （ucode A’） ucode Y' Read Allow Any Any Deny

Cloud

Real world

Third party without Device real object Owner of device access privileges (ucode A） ucode X ucode Z

Device coordination by Aggregate Computing Model

Cloud of A Cloud of B Direct connection using Corp. IoT-Aggregator Corp.

Protocol of A Corp. Direct connection using

Protocol of B Corp. Made by A Corp. Network-enabled air conditioner

Cooperating Made by B Corp. behavior is realized Network-enabled Panel Heater Made by A Corp. Network-enabled Circulator Made by A Corp. Network-enabled Humidifier

IoT-Engine



82 Copyright © 2016 by Ken Sakamura Seven semiconductor manufacturers from six countries and regions have already expressed intention to commercialize IoT-Engine █ Participating semiconductor manufacturers ● Toshiba Microelectronics Corporation ● Renesas Electronics Corporation ● Cypress Semiconductor Corporation ● Imagination Technologies Limited ● Nuvoton Technology Corporation ● NXP Semiconductors N.V. ● STMicroelectronics █ Sales of IoT-Engine and Development kit ● Personal Media Corporation ● Ubiquitous Computing Technology Corporation

█ Small, low-cost, and equipped with low-power WPAN(IEEE802.15.4) communication ● Frequency may change according to areas/countries: 780MHz (China), 868MHz (EU, India), 915MHz (North America, Australia), 920MHz (Japan), 2.4GHz (common throughout the world), etc. █ WPAN : Wireless Personal Area Network ● Suited to very low-power operation of devices that is powered by a battery or energy harvesting █ Equipped with the support for CoAP and 6LoWPAN protocols ● UCT IoT system products that use 6LoWPAN border route to connect to the clouds. ● CoAP is friendly to Web API in the clouds. █ Support the connection to IoT-Aggregator

84 Copyright © 2016 by Ken Sakamura Features of IoT-Engine █ Equipped with μT-Kernel 2.0 RTOS that supports low- power applications ● It is easy to implement advanced control logic by means of multi-task programming. ● Very low-power consumption by placing the processor into Deep Sleep mode during IEEE802.15.4 beacon mode operation █ Standardization of physical size factor and connectors ● A 0.4 mm pitch 100-pin connector and the positions of the screw holes next to the connector ● Flexible pin assignment that can be used for different microprocessors ● Arduino compatible I/O connector pin assignment leads to low cost and short time-to-market development.

85 6LoWPAN boarder router that talks to WAN directly

WAN direct link type 6 LoWPAN border router Internet SIM Card

Electric curtain Integrated Sensor Lighting control Electric lock

86 The architecture can accommodate the low-rate low-power WAN standard that is being defined today

Integrated Sensor Lighting control Electric lock

87 Implementations that use different MPUs

Reflection on the Year 2015

It was the year when many open platform projects were started.

The keyword of 2016 is “platform” Open IoT building platform for INIAD HUB-1 CPaaS.io for cities, the IoT and open data OPaaS.io that matches people and services IoT Engine, the IoT development platform IoT-Aggregator and ucode behind all of the above

Aiming for open IoT, then the IoS next

A world where all the "services" can collaborate with each other via open APIs