Incorporating into RDF Store at The Lightweight Edge Devices

Anh Le-Tuan, Darshan Hingu, Manfred Hauswirth and Danh Le Phuoc | Technische Universitat¨ Berlin RDF4LED - An RDF Engine for Edge Devices

Incorporating Blockchain into RDF4Led

Incorporating Blockchain into RDF Store at The Lightweight Edge Devices | Anh Le-Tuan |

Seite 2 Why Edge Devices ???

Edge Computing - of Things

– reduce network overhead. – reduce latency for real-time applications. – improve scalability. – better privacy control.

Linked Data

– enable data integration of heterogeneous sources. – enable data federation over edge nodes.

Incorporating Blockchain into RDF Store at The Lightweight Edge Devices | Anh Le-Tuan |

Seite 3 Missions

Moving semantic data processing task away from centralised cloud for the IoT

– How much semantic data on small devices ? – How to scale data federation over small devices on edge systems ? – How to encourage people sharing the data from their edge devices ?

Incorporating Blockchain into RDF Store at The Lightweight Edge Devices | Anh Le-Tuan |

Seite 4 RDF4LED - An RDF Engine for Edge Devices

System Design

Incorporating Blockchain into RDF Store at The Lightweight Edge Devices | Anh Le-Tuan |

Seite 5 RDF4LED (cont.)

Physical RDF Organisation: Two-Layers Index

Incorporating Blockchain into RDF Store at The Lightweight Edge Devices | Anh Le-Tuan |

Seite 6 RDF4LED (cont.)

Targeted Small Devices

Incorporating Blockchain into RDF Store at The Lightweight Edge Devices | Anh Le-Tuan |

Seite 7 Incorporating Blockchain into RDF4Led

System Overview

Smart Contract Manager

Distributed

RDF Storage

Incorporating Blockchain into RDF Store at The Lightweight Edge Devices | Anh Le-Tuan |

Seite 8 Incorporating Blockchain into RDF4Led

System Workflow

SPARQL Query Processor

Request Payment 7 Entries

2 Index 5 4 Request Payment riple Pattern

Confirmation

T

Smart 9 Matched

T 3 Contracts Smart Validation riples Contracts Service Trigger Storage 6 Contracts Index Entries Request with Smart Contract Manager 8 Entries Index 1

Distributed RDF Storage

Incorporating Blockchain into RDF Store at The Lightweight Edge Devices | Anh Le-Tuan |

Seite 9 Incorporating Blockchain into RDF4Led

Physical Organisation

Transaction 1: Transaction 2: Transaction N: {Owner: ClientA {Owner:ClientB {Owner: ClientN Price: 0.1 Price: 0.1 . . . Price: 0.1 IPFS:hash1} IPFS:hash2} IPFS:hashN}

Blockchain

s1p1o1: s2p1o5: s3p3o2: { { { Transaction 1 T ransaction 2 . . . Transaction N } } }

Smart Contracts Storage

IPFS:hash1 IPFS:hash2 IPFS:hashN s1 p1 o1 o2 s2 p1 o5; .. s3 p3 o2; .. o3; p2 o4 o5 ...... p3 o6......

Distributed RDF Storage

Incorporating Blockchain into RDF Store at The Lightweight Edge Devices | Anh Le-Tuan |

Seite 10 Incorporating Blockchain into RDF4Led

System Deployment

Miner Nodes

Validation Service Geth Clients

....

Client A Client B Client N

Distributed Storage System Cluster

Incorporating Blockchain into RDF Store at The Lightweight Edge Devices | Anh Le-Tuan |

Seite 11 Incorporating Blockchain into RDF4Led

Evaluation - Input (1) Acc. Throughput on Static Cluster Sizes

2,500 10 nodes Inserting

2,000

1,500 Throughput (triples/sec)

1,000 0 200 400 600 800 1,000 DatasetSize (in millions)

Incorporating Blockchain into RDF Store at The Lightweight Edge Devices | Anh Le-Tuan |

Seite 12 Incorporating Blockchain into RDF4Led

Evaluation - Input (2) Acc. Throughput on Varying Cluster Sizes

40 100 Million triples Dataset

30

20

10 Throughput (triples/sec) in thousands

2 4 6 8 10 No of Nodes

Incorporating Blockchain into RDF Store at The Lightweight Edge Devices | Anh Le-Tuan |

Seite 13 Incorporating Blockchain into RDF4Led

Evaluation - Query

1000 350

60 30

5 second (in log scale)

0.5 1 10 50 100 500 1000 Number of blocks return in query patterns

Incorporating Blockchain into RDF Store at The Lightweight Edge Devices | Anh Le-Tuan |

Seite 14 Thank You !!!

Incorporating Blockchain into RDF Store at The Lightweight Edge Devices | Anh Le-Tuan |

Seite 15 RDF4LED (cont.)

Write Management (1): Clustering example

Incorporating Blockchain into RDF Store at The Lightweight Edge Devices | Anh Le-Tuan |

Seite 16 RDF4LED (cont.)

Write Management (2): Cache Management

Incorporating Blockchain into RDF Store at The Lightweight Edge Devices | Anh Le-Tuan |

Seite 17 RDF4LED (cont.)

Push-based Join Algorithm

Incorporating Blockchain into RDF Store at The Lightweight Edge Devices | Anh Le-Tuan |

Seite 18 RDF4LED (cont.)

Evaluation Results - Input (1)

Incorporating Blockchain into RDF Store at The Lightweight Edge Devices | Anh Le-Tuan |

Seite 19 RDF4LED (cont.)

Evaluation Results - Input (2)

Incorporating Blockchain into RDF Store at The Lightweight Edge Devices | Anh Le-Tuan |

Seite 20 RDF4LED (cont.)

Evaluation Results - Input (3)

Incorporating Blockchain into RDF Store at The Lightweight Edge Devices | Anh Le-Tuan |

Seite 21 RDF4LED (cont.)

Evaluation Results - Query (1)

(a) Query response time on Intel Galileo Gen II 100 VIRTUOSO RDF4Led JENA TDB 10

1 second (in log scale) second (in log

F1 F2 F3 F4 F5 L1 L2 L3 L4 L5 S1 S2 S3 S4 S5 Queries

Incorporating Blockchain into RDF Store at The Lightweight Edge Devices | Anh Le-Tuan |

Seite 22 RDF4LED (cont.)

Evaluation Results - Query (2)

(b) Query response time on Raspberry Pi Zero

VIRTUOSO RDF4Led JENA TDB 100

10

1 second (in log scale) second (in log

F1 F2 F3 F4 F5 L1 L2 L3 L4 L5 S1 S2 S3 S4 S5 Queries

Incorporating Blockchain into RDF Store at The Lightweight Edge Devices | Anh Le-Tuan |

Seite 23 RDF4LED (cont.)

Evaluation Results - Query (3)

(c) Query response time on Beagle Bone Black

VIRTUOSO RDF4Led JENA TDB 100

10

1 second (in log scale) second (in log

F1 F2 F3 F4 F5 L1 L2 L3 L4 L5 S1 S2 S3 S4 S5 Queries

Incorporating Blockchain into RDF Store at The Lightweight Edge Devices | Anh Le-Tuan |

Seite 24 RDF4LED (cont.)

Evaluation Results - Query (4)

(d) Query response time on Beagle Bone Black (20 mil) 10 VIRTUOSO RDF4Led

1 second (in log scale) second (in log

F1 F2 F3 F4 F5 L1 L2 L3 L4 L5 S1 S2 S3 S4 S5 Queries

Incorporating Blockchain into RDF Store at The Lightweight Edge Devices | Anh Le-Tuan |

Seite 25 RDF4LED (cont.)

Evaluation Results - Memory (1)

Incorporating Blockchain into RDF Store at The Lightweight Edge Devices | Anh Le-Tuan |

Seite 26 RDF4LED (cont.)

Evaluation Results - Memory (2)

Incorporating Blockchain into RDF Store at The Lightweight Edge Devices | Anh Le-Tuan |

Seite 27