Ken Sakamura

Toward Open IoT

Ken Sakamura

Professor, the University of Tokyo

Chair, TRON Forum / uID Center TRON RTOS: Topmost Share in RTOS Market for 20 Consecutive Years

The Countries Where a Party Agrees to Download Licenses of T- Kernel-related Software ITU150 Award

 Bill Gates (USA) ■ As a co-chair of Bill and Melinda Foundation provided opportunities in the poorest regions in the world  Robert E. Kahn (USA) ■ Designed the world’s first packet exchange network  Thomas Wiegand (Germany) ■ ISO/IEC Standardization of MPEG video format  Mark I. Krivocheev (Russia) ■ Oversaw the global standardization of digital TV  Martin Cooper (USA) ■ Father of “mobile phone”  Ken Sakamura (Japan) ■ Developed TRON open computer architecture for ubiquitous computing 5 “The Objectives of TRON Project” TRON Project 1987, p. 7, Springer-Verlag Copyright © 2015 by Ken SAKAMURA

The IoT

Internet of Things This has become the buzzword and attracts world attention.

From Closed IoT to Open IoT ①

TRON Project Is an Open Technology R&D Project.

What Does “Open” Mean?

All relevant technology documents are made public, and interoperability of systems is assured.

Open Source and Open Hardware

Open API and Open Data

The IoT Needs to Become “Open.”

Many Objects Are Connected inside One Organization.

Objects Are Interconnected beyond the Confine/Boundary of Organizations.

Anyone Can Connect Any Objects as Long as a Certain Set of Rules Are Observed.

Copyright © 2015 by Ken SAKAMURA Copyright © 2015 by Ken SAKAMURA The IoT Can Change the World Only If It Is Open. The Internet changed society because it is an open network which anyone can use for any purpose.

Is the "I" in "IoT" truly the "I" of "Internet"?

On the Other Hand… The "Open" does not mean it is appropriate to have something to be always open, to anybody, anywhere, anytime.

This is the IoT Governance Issue.

The advanced management "to use something appropriately" requires advanced judgment.

Send the data of father's weight only from the weight meter at home to the health-management cloud of the company which employs him A municipality office receives only the statistically processed anonymized data of such weight data.

An Application Model to Realize the Open IoT ②

TRON Smart House ver.1 in 1989

Joint Development by 18 Companies in Housing Industry Designed by Ken SAKAMURA

20 The First TRON House in 1989 Copyright © 2015 by Ken SAKAMURA Development that is turned into current commercial offering  Show toilet  Healthcare monitor  Transmission of healthcare data to doctors  Illumination scene setting  Foot light turned on by movement sensor  Acoustics scene emulation by DSP  Automatic irrigation of plants  Liquid crystal window with dynamically changeable transparency  Indoor sensor network (temperature, other environmental indicators)

TRON Smart House ver.2 PAPI in 2004

TOYOTA's Future House Designed by Ken SAKAMURA

Copyright © 2015 by Ken SAKAMURA Development that is turned into current commercial offering  Smartphone and the control of house facilities by it  Healthcare by wireless wrist-band sensor  Facility control using natural voice recognition  HEMS  Power generation by plug-in hybrid car  Fuel cell for home use  Dye sensitized solar cell  Self-cleaning outer wall that uses photocatalyst  LED display for housing  BGM that follows people's movement  Use of wireless markers for indoor positioning 25 Copyright © 2015 by Ken SAKAMURA

Changes from 1989 to 2004 Concept and functions remained the same Practically usable even today What progressed was the implementation Progress and availability of technologies 26 Copyright © 2015 by Ken SAKAMURA Progress of semiconductor technology

TRON Smart House ver.3 IoT House in 2016

LIXIL IoT House Designed by Ken SAKAMURA

Cost of these objects has been high because they are custom-made.

Introduce mass manufacturing of units with IoT functions

LIXIL will realize IoT Houses a reality A housing component and material manufacturer produces the IoT components instead of a computer manufacturer

All house builders can easily use such functions in the future houses

In 27 years from 1989 to 2016 …

A model in which objects in a household get connected via LAN, and then there is a WAN beyond it…

Why the Change?

Wide deployment of the Internet in the society The dramatic drop in the communication cost with external networks 36 Copyright © 2015 by Ken SAKAMURA When the Communication Cost Is High… Perform as much computing as possible within a single node.

Minimizing the communication volume between nodes by performing the data exchange at a high-level abstract application layer

Use external services as much as possible by means of communication.

Minimizing the computing resource requirement in the edge nodes

39 Today's Open IoT Model in TRON Project

Cloud\

Edge Node Copyright © 2015 by Ken SAKAMURA Functionally Rich Edge Nodes Are Not Eco-friendly. If you install more applications than strictly necessary on each edge node… in order to run the general-purpose information process OS we need advanced information processing functions and necessary memory resources on each individual node.

It is a waste of resources, i.e., duplicated investment, as seen from the system as a whole. In total, we waste resources and energy. 41 Copyright © 2015 by Ken SAKAMURA TRON Project Aims at Realizing Light- weight Edge Nodes.

Edge nodes (= Embedded Systems) should be light-weight and advanced functions are performed in clouds.

The Model of Open IoT in TRON Project ③ Aggregate Computing Model Aggregate: referring to the composed whole

Aggregate Computing Model Embedded system products talk to the manufacturers' cloud directly. Such clouds have Open API. These cloud services collaborate with other clouds.

UI Application

Cloud of

Company C CompanyC Cooperating Displayby application clouds

Cloud of Sensor Sensor from Accessing API Company C CompanyA

Cloud of Company A

Solving issues which embedded systems face by advancing the intelligence of the aggregated whole of local edge nodes and the cloud services

NUI (Natural User Interface) becomes possible. You can start a phone conversation by posing your fingers as if you were holding a handset.

Today’s smartphone has rich set of peripherals, high- performance CPU, large non-volatile memory and network access.

 They are connected via network. ■ Cloud acts as very large non-volatile memory for the CPUs and individuals. ■ In the cloud, functions of home appliances and other devices are aggregated.

 As a whole, more functions than today’s smartphones are realized.

Identification of the speaker by face, powering up by gesture, initiating a conversation by speaking the name of the other party, audio by the audio equipment in the room, video using the TV in a room 50 Copyright © 2015 by Ken SAKAMURA Web Browsing in Aggregate Model

Issues in the Governance of Open IoT

High demand for computing resources to perform access control

Advanced governance management of data and control will become very important.

Case in Point: Latest Digital Cameras Equipped with individual identification function by means of face recognition You can register the faces of your friends or family members with the names and/or birth dates, so that the camera automatically favors the focusing on such people or special mode for baby photos.

Such a camera is full of private information. 55 Copyright © 2015 by Ken SAKAMURA Hardship of Embedded Systems in the Age of the IoT Access control, which is not the essential function of the embedded systems, requires large amount of computing resource.

In Aggregate Model, Advanced Governance Control Is Handled by Cloud Services.

Edge nodes and cloud services are considered to be virtually always connected. We do not need complex governance management locally.

Direct Connection Using Tunneling If we only need to focus on the particular connection with a preselected cloud

Initiative Issue in the Age of the IoT

Who owns the data and knowhow generated by the usage of products made by a company?

Service-oriented Business Model

Service does not end with the sales of a product…

Edge node acts as the "faucet" of the service.

The "Faucet" of the Service Should Be Lightweight.

In Aggregate Model, Big Data and Knowhow Would Stay in the Cloud of the Company which Has Produced the Product.

A service is provided by the aggregated whole of the product and proprietary cloud.

62 Copyright © 2015 by Ken SAKAMURA Advanced Services Are Implemented by Cloud. Artificial intelligence ■ Determining how long a food plate should be heated by the image recognition ■ Voice interface using natural language Big data ■ Preventive maintenance of operation data of home electronics appliances ■ Advanced medical care advise based on measured data ■ Automatic scene completion using database Group control beyond individual household ■ Energy saving in a small area by fine-grained demand side management

The Position of Aggregate Model

It traces the general trends, which the general information processing has adopted, in the embedded systems sector…

Trends in the General Information Processing Drastic drop in the communication cost Increased cost of ownership including update management, etc. The fear of losing data: what if a PC with important data is lost?

Aggregate Model Is Introduced to Embedded Systems Sector.

Thin client embedded systems Functions offered as SaaS, and the use of cloud

Technologies for Aggregate Model ④

67 Today's Open IoT Model in TRON Project

Cloud\

Meta-OS That Controls the Aggregated Whole ④ 1 Meta-OS = Open IoT Platform Context-awareness/big data analysis Federation of different databases/integration of heterogeneous API Security/Access Control Governance policy

u2 uID Architecture 2.0

Individual Objects (Edge Nodes) That Are Connected to the Network.

ucode identifies things or objects irrespective of the application fields and is assured to be uniquely assigned as 128-bit non-semantic ID.

Identification number, i.e., IDentifier

It can be regarded as similar to zip code or product serial number, but ucode is very long.

2128 Numbers

One trillion people can assign ucode IDs to a trillion objects a day for a trillion years.

74 Copyright © 2015 by Ken SAKAMURA The ucode ID Numbers Are Further Assigned to "Concepts" to establish a federated framework for collaboration that permits the control of various groups of embedded devices across organizational and company boundaries by means of ucR cross-queries. ucR: RDF consisting of ucode triplets

75 U2 OpenAPI Architecture

u2 OpenAPI Services

To u2 Web Device database ApplicationWeb Profiles ServicesApplicationWeb ServicesApplicationWeb ServicesApplication Device Services Context Profile Manager Manager

OpenAPI OpenAPI GatewayOpenAPI for Gateway for eachGateway company for each company each company

Devices User Terminals Protocol Architecture

Applications u2 Applications

Device Profiles u2 Device Profiles Exchange Protocol

Device Discovery and Control u2 Core Protocol

Message Transfer CoAP HTTP/1.1, WebSocket

Transport Layer Protocol

Transport TCP/IP Protocol Suite UDP/IP Protocol Suite

Wireless communication is preferable to connect objects…

6LoWPAN Aggregate Model calls for the direct connection of the edge nodes and the cloud service that supports them. We need an IPv6 wireless network for low-power embedded devices. 6LoWPAN is the answer. 81 Copyright © 2015 by Ken SAKAMURA IP-Compatible Wireless Network for Embedded Systems Full-featured IPv6 Wi-Fi to connect nodes to general information processing systems and AV devices is too heavyweight for edge nodes It is inappropriate for the IoT devices that need to run for a long time with a battery.

6LoWPAN IPv6 over Low power Wireless Personal Area Networks

Advanced security by default Cloud services and edge nodes can be connected via OpenAPI gateways of companies. ■ IPv4 requires additional overhead of overcoming NAT ■ No local DHCP setting is required ■ P2P communication is possible by default Multicast allows the service to many users simultaneously

 920 MHz has been meant for communication with energy saving. ■ IEEE 802.15.4 ■ Data transmission speed: 50 kbps - 400 kbps ■ Frame size: 127 octets IPv6 frame size ■ Maximum:1,280 octets ■ Header: 40 octets

●920 MHz: a technology to implement IPv6 ■ IPv6 over Low power Wireless Personal Area Network • Compression of headers • Division of payload

85 Wireless Nodes Are Connected to Cloud Copyright © 2015 by Ken SAKAMURA 6 LoWPAN Border Router ●Router that sits between WPAN and IP network ■ Has a role similar to wireless LAN router ■ Wireless nodes are connected to cloud using IPv6

Requirements of the IoT Wireless Network

Cloud-friendly Expandable to wide-area network Security Power-saving

SDN for the IoT ④ 3

Software Defined Network

 The current trends of the Internet technology  The requirements of the IoT for networking

 We need a very flexible network control as in the control of flight paths where many small drones and jumbo jets mingle and fly.  SDN (Software Defined Networks) NFV (Network Functions Virtualization) ■ Network architecture is changed on the fly to meet changing conditions.

IoT-Engine ④ 4 Standard platform for the IoT devices

Standard computer platform for the IoT equipment and sensor devices, etc.

 Small, low-cost, and equipped with low-power WPAN(IEEE802.15.4) communication  Equipped with the support for CoAP and 6LoWPAN protocols Equipped with μT-Kernel2.0 real-time OS that supports low-power applications  Standardized connector of IoT-Engine

94 T-Car ④ 5

96 Copyright © 2015 by Ken SAKAMURA T-Car: IoT training material with IoT- Engine A model car (scale: 1/10) is equipped with many sensors. ■ Speed sensor, line tracking sensor, 9-axis motion sensor, distance sensor, etc. Equipped with IoT-Engine and the car is controlled in collaboration with cloud services.

97 Copyright © 2015 by Ken SAKAMURA IoT Training package TRON Forum will develop and deploy education package that contains educational material that uses T-Car as a real-time OS example ■ Such education package has much in common with IoT applications in various industrial sectors, and autonomous car technology in particular Plan of T-Car programming contest in 2016 ■ The criteria will not be simple speed competition, but survivability when an unexpected barrier springs up in the course, for example, etc. ・・・

Service 4.0 by Open IoT ⑤

99 Copyright © 2015 by Ken SAKAMURA Unsatisfactory Service Collaboration in View of the Year 2020  We have infrastructure and technology development planning for various services (e.g. free Wi-Fi, digital signage and automatic translation).  OTOH, Service providers in the cities such as restaurants, hotels, taxis, train stations and shopping malls are controlled separately and are not coordinated.

We can realize open collaboration by sharing, beyond the confines of "keiretsu"s and companies, the attribute information of parts and products which are individually recognized by the IoT technology.

Industry 4.0

101 Copyright © 2015 by Ken SAKAMURA The Target of Identification in the Service Sectors Is… The target of identification in the service sectors and of which attributes should be utilized for further services is…

"The Customers" Hospitality ("Omotenashi") is giving the customized optimal service to an individual customer according to their attributes after recognizing the customer. 102 Copyright © 2015 by Ken SAKAMURA

Service 4.0 by Means of Open IoT Concept

Recognizing "the customers" and then sharing the attributes beyond the confines of "keiretsu”s and companies to realize open collaboration

Visitors who do not read Japanese can use the shop list recommended by the concierge at a hotel and come back comfortably without worry.

104 How Do We Recognize "the Customers"?

A passive method from the viewpoint of the customer such as "face recognition" is NOT desirable.

We can implement a method with a hybrid of smartphones and IC cards. Service 4.0 Starts with the Card and Smartphone Owned by a User.

Service personnel application

Hospitality cloud

Transportation IC card Hospitality ("Omotenashi") Portal Application Gate

Service counter terminal Digital signage "Hospitality Infrastructure" based on the uID architecture

MIC (Ministry of Internal Affairs and Communications) Project: "Promoting ICT Use Through Society In View of 2020" Copyright © 2015 by Ken SAKAMURA Location Identification as the Infrastructure of the IoT ⑥ Location identification is an important part of context that needs to be recognized in the IoT age.

Indoor Location Identification Infrastructure Is Getting Ready.

The wide deployment of BLE technology has made the electronic tag marker very practical and affordable.

The Remaining Issues

Cost of installation, and maintenance such as battery replacement Risk of hitting "the customers" when the tag drops from the installed position

110 Copyright © 2015 by Ken SAKAMURA New "Flexible BLE Marker" May Expand the Deployment Widely. Runs on photocell ■ It operates even with the nearby illumination and so there is no need for wiring. Lightweight and flexible ■ It can be installed easily with adhesive tape on the side of an illumination device. ■ Even if it drops, it is light and soft and will not hurt a customer. This marker is shown at Fujitsu booth 111 Copyright © 2015 by Ken SAKAMURA u2 Achieves the Coordination of the Concepts of Location at the High-level Application Layer.

ucode makes the coordination possible by leaving the confine of the devices such as iOS and Android.

Open Data Activity ⑦ A big worry anticipating 2020 the year of the Olympic and Paralympic Games

The Problem of Japanese Public Transportation System

The most advanced and most complex in the world

What Should Japan Do for 2020? Copyright © 2015 by Ken SAKAMURA Many Stakeholders of Public Transportation Infrastructure Many transportation operators In Tokyo alone: 14 railway operators, 38 bus operators, 1,100 taxi operators (excluding independent individual drivers) Public transportation in Japan has been privatized and public transportation infrastructure consists of many operators and stakeholders.

117 Even Simple Information Such as about Facilities in Train Stations Are Hard to Come by. Complex ownership makes it difficult to provide complete facility information

In Europe, public transportation systems are usually operated by the national government or municipalities. Hence, open data of public transportation is easily available in Europe.

For example, Transport for London manages subway (tube), bus, taxi, and rental bicycle in London.

Let's Streamline This Situation by 2020.

Establishment of Association for Open Data of Public Transportation Major public transportation operators that cover Tokyo area have participated.

120 Coordination of Open Data Using u2 Is Planned.

Reflection on the Year 2015

This has been the year the concept of "Open" has gained more importance.

One Keyword of TRON Project Is "Open." TRON Project proposed the concept of "Open Architecture“ in its infancy

The year 2015 saw … Aggregate Model introduces "OPEN API," Service4.0 introduces "OPEN" service, public transportation sector has brought "OPEN" data.

Our Goal Is “Open” IoT. Being "OPEN" and the "CONNECTIVITY" based on it are the essence of the force with which the Internet is reshaping the society.

Computer architecture that goes well with such force will become more important in the future.

In the Future as in the Past

126