Graalvm JIT Compiler

Partner Webcast – Cloud Native Java with GraalVM on OCI

Catalin Pohrib Oracle EMEA A&C Partner Technology Cloud Engineer Oracle EMEA CCOE January 21, 2021 Safe harbor statement

The following is intended to outline our general product direction. It is intended for information purposes only, and may not be incorporated into any contract. It is not a commitment to deliver any material, code, or functionality, and should not be relied upon in making purchasing decisions. The development, release, timing, and pricing of any features or functionality described for Oracle’s products may change and remains at the sole discretion of Oracle Corporation.

1 Oracle GraalVM Enterprise Overview

2 GraalVM on OCI Features

3 Accelerating Application Performance

4 Demo

5 Summary and Q&A

1 Oracle GraalVM Enterprise Overview

2 GraalVM on OCI Features

3 Accelerating Application Performance

4 Demo

5 Summary and Q&A

5 Copyright © 2020, Oracle and/or its affiliates. All rights reserved. Enterprises worldwide run 45 billion active Java VMs 55% Java is the only language used by > 55% of businesses worldwide1 #1 in 10 of the top 14 technology trends2 #1 programming language in the world3 Java powers your business-critical applications 1 , 2 VDC Research 2019 3 Tiobe Index February 2020 – https://www.tiobe.com/tiobe-index/

GraalVM Enterprise • high-performance • polyglot compiler • run-time built for modern microservices For both cloud-native and on-premise environments.

• 50% faster on average on real • 27 patented optimizations • Lower memory required world benchmarks • Compile to native executables • Higher throughput with lower • Native executables start • Leverage multiple languages CPU usage instantaneously • Reduced garbage collection overhead

Traditional Java Microservices Multi-Language Embedded Workloads & Cloud Applications

Tomcat

Traditional Java Microservices Multi-Language Embedded Workloads & Cloud Applications High-performance Ahead-of-Time (AOT) Multi-lingual Virtual Software for devices optimizing Just-in- “native image” compiler Machine Time (JIT) compiler

Just-in-time compilation

11 GraalVM Enterprise high performance optimizing compiler

Java JIT Compiler

Oracle Java SE JVM

Java Bytecode JIT Compiler

Oracle Java SE JVM

GraalVM JIT Compiler

RUNNING TIME VS MEMORY, NAIVE-BAYES, JDK 11 5,0

(LOWER IS BETTER) 4,31 4,5 4,30 OpenJDK 11 GraalVM Enterprise (JDK 11)

4,0

3698 3619

3,5 3110

3,0

2,66

2542

2,34 2,33

2,5 2,31

1942

1822

1,84 1717

2,0 1,78

Speedup vsJDK8

1,55

1,52

1,44

1333

1,40

1,36

1,35 1,31

1,5 1,27

1,22

1,18

1,14

1,12

1,09

1,08

1,03 1,02

1,0

457 423 0,5

0,0 5 GB 6 GB 7 GB 8 GB 10 GB

https://Renaissance.dev Source: https://blogs.oracle.com/graalvm/apache-spark%e2%80%94lightning-fast-on-graalvm-enterprise

JDK 8/11 CPU Memory

Execution Time

JDK 8/11 CPU Memory GraalVM CPU

Execution Time

25% reduction in garbage collection time

10% improvement in transactions/sec

0 0 issues 30+ Million core hours

GraalVM Powers Oracle Cloud Infrastructure

1 Oracle GraalVM Enterprise Overview

2 GraalVM on OCI Features

3 Accelerating Application Performance

4 Demo

5 Summary and Q&A

Hybrid Application Manager

Node.js C++ Ruby Traditional applications Java Microservices Python Polyglot Microservices R

GraalVM Compiler and Runtime

Cloud native environment

Operating system

On-premises Public cloud

Ahead-of-time compilation

GraalVM JIT Compiler GraalVM JIT Compiler GraalVM JIT Compiler

22 Copyright © 2020, Oracle and/or its affiliates. All rights reserved. GraalVM Enterprise Native Image - Ahead-of-time compiler & runtime Microservices and Containers Up to 5x less memory 100x faster startup

Linux Executable

Windows Executable

MacOS Executable

Coming Soon!

Supported by popular microservice frameworks

MacOS Windows Linux Executable Executable Executable

1 Oracle GraalVM Enterprise Overview

2 GraalVM on OCI Features

3 Accelerating Application Performance

4 Demo

5 Summary and Q&A

Monolith vs. Microservices

Monolith Microservices

Microservice on GraalVM Enterprise (JIT mode) GraalVM Enterprise Native Image generated microservice executable

Monolith Microservices

Supported by microservice Ideal for Containers frameworks and platforms

Coming Soon!

23 ms 42x Helidon 979 ms

65x 30 ms Micronaut 1967 ms

11 ms 93x Quarkus 983 ms

0 ms 500 ms 1000 ms 1500 ms 2000 ms

GraalVM Native Image JDK 8

26 MByte 4x Helidon 107 MByte

5x 37 MByte Micronaut 198 MByte

16 MByte 10x Quarkus 160 MByte

0 MByte 50 MByte 100 MByte 150 MByte 200 MByte 250 MByte

GraalVM Native Image JDK 8

Allows to start applications almost instantly Time to first request for Spring Boot 2.2 with Tomcat

OracleJDK JIT

GraalVM Native Image

0 500 1000 1500 2000 2500 3000 First request served (ms)

https://youtu.be/3eoAxphAUIg

Popular Framework Benchmark 20000 16% higher 18000

16000 1500% higher

14000

12000

10000 GraalVM Enterprise Native Image

8000 GraalVM Enterprise JIT JDK12, HotSpot

RequestsSecond per 6000

4000

2000

0 1.000 10.000 100.000 1.000.000 10.000.000 Cumulative number of requests sent by ApacheBench

Peak Throughput Startup Speed

Ahead-of-time Just-in-time

Reduced Max Low Memory Latency Footprint

Small Packaging

Peak Throughput Startup Speed

Ahead-of-time Just-in-time

Reduced Max Low Memory Latency Footprint

Small Packaging

Multi-language Support

Ruby Interpreter GraalVM JIT Compiler JavaScript Interpreter

Ruby Runtime JavaScript Runtime

Language Implementation Framework

GraalVM JIT Compiler

• Expert provides "interpreter” for Language Implementation Framework • Existing implementations*: JS, R, Ruby, Python, LLVM, and WebAssembly

• Interoperability – for example, JS code can call Language Implementation Framework Ruby methods and share values without copies GraalVM JIT Compiler

*Ruby, Python, R and WebAssembly are experimental options.

A multilingual VM can be 100% compatible with any language, meeting or beating performance of single language VMs

const express = require('express') const app = express()

const BigInteger = Java.type('java.math.BigInteger')

app.get('/', function (req, res) { var text = 'Hello World from Graal.js!
' // Using Java standard library classes text += BigInteger.valueOf(10).pow(100) .add(BigInteger.valueOf(1)).toString() + '
' // Using R interoperability to create graphs text += Polyglot.eval('R', `svg(); require(lattice); x <- 1:100 y <- sin(x/10) z <- cos(x^1.3/(runif(1)*5+10)) print(cloud(x~y*z, main="cloud plot")) grDevices:::svg.off() `); res.send(text) }) app.listen(3000, function () { console.log('Example app listening on port 3000!') })

• Server-side polyglot - Grid-side code in your favorite language: JavaScript, Python, Ruby, R… • Embed Coherence in non-Java applications - Connect to or host Coherence in non-Java processes including Node.js/Express

1 Oracle GraalVM Enterprise Overview

2 GraalVM on OCI Features

3 Accelerating Application Performance

4 Demo

5 Summary and Q&A

• GraalVM Compiler: compiles either “Just-in-Time” (JIT) or “Ahead of Time” (AOT)

• Two runtimes: OpenJDK fork of “HotSpot” (for larger apps) and “SubstrateVM” (embeddable)

• Language implementation framework (“Truffle”) – making support for new languages easy

• Languages: Java, Scala, JavaScript (production), Python, Ruby, R (experimental)

• Tools VisualVM, VSCode integration, Chrome Debugger integration

• Note: most people use only a subset of the components Red Hat Quarkus: use GraalVM Compiler AOT + SubstrateVM NetSuite: use GraalVM JavaScript RDBMS: use GraalVM JavaScript + SubstrateVM Twitter: use GraalVM Compiler in JIT mode

• Update Java and GraalVM versions at your convenience • Take advantage of new features and functions at no additional cost • Simplify planning with affordable subscription pricing and volume discounts

Leverage affordable, predictable pricing with flexible terms

Monthly Subscription Subscription Volume Metric Price Oracle GraalVM Oracle GraalVM Enterprise Edition 18.0000 Processor 1-99 17.0000 Processor 100-249 16.0000 Processor 250-499 15.0000 Processor 500-999 14.0000 Processor 1,000-2,999 13.0000 Processor 3,000-9,999 12.0000 Processor 10,000-19,999 Contact for Details 20,000+

GraalVM Enterprise license:

Others

Included Subscription Required Subscription Required Subscription Required

Oracle Partner TCE blog: http://blogs.oracle.com/imc

Oracle EMEA Partner CCOE Homepage: http://oracle.com/goto/partners/ccoe

Oracle PTCE Mail: [email protected]

• GraalVM Enterprise product page • GraalVM Enterprise technology Page • GraalVM Enterprise downloads page • GraalVM Enterprise blogs • GraalVM Enterprise full documentation • LinkedIn, Twitter @GraalVM

Catalin Pohrib Partner Technology Cloud Engineer [email protected]