8/23/2020 GO-JEK Case Study | Cloud

GO-JEK: Using Machine Learning for forecasting and dynamic pricing

Using Google Cloud PAlbbaootfuuott r GmGOO-J-JEEKK

and PlaSitinnfcceoe t htrhem ela luan,ucnhc ohf iotsf aitpsp a inp 2p0 i1n5 2, G0O15-J, EGKO- has GO-JEK has establishJbeEecKod mhae sIn bdeocnoesmiae’s Ilneaddoinge soina-’sd elmeaadnidng on- dmeumltiasenrdvi cme uplatitsfoermvi.c He epaldaqtfuoarrmter.ed in Jakarta, GO-JEK is a “super app” that allows residents of itself as a leading on-Headquartered in Jakarta, GO-JEK is a about 167 cities and districts in Indonesia to demand multiservice“super app” that allows residents of about access more than 18 products ranging from 167 cities and districts in Indonesia to platform and one of ttrhanesp ofrteatwion, food delivery, groceries, massage, access more than 18 products ranging and house cleaning to logistics and payments. from transportation, food delivery, unicorn businesses inGO-JEK technology has improved lives for groceries, massage, and house cleaning to Southeast Asia. millions of people, while also empowering the ilnofgoirsmtiacls s eacntodr paanydm meicnrots, .s mGO-all,J aEnKd medium etenctehrnporisloegs y(M hSaMs Eims).proved lives for millions of people, while also empowering the Google Iinfdourmstarile sse:c Ttorra avnedl &m Hicoros, psimtaallilt,y and Cloud medium enterprises (MSMEs). Results Manages up to Location: Indonesia

https://cloud.google.com/customers/go-jek/ 1/12 8/23/2020 GO-JEK Case Study | Google Cloud

Supports 1 5TB of daItnadu sptreiers: Travel & Hospitality million motorcycle day BiLgQoucearyti (ohntt:p Isn:/d/colonued.sgioaogle.com/bigquery/) drivers with Cloud Storage (https://cloud.google.com/storage/) rapid access Products: BigQuery to riders and AI (Phltattpfso:r//mc l(ohutdtp.gso:/o/cglloeu.cdo.gmo/obgigleq.ucoermy/)a,i -Cplloautfdorm/) optimized Storage (https://cloud.google.com/storage/), AI Cloud Pub/Sub (https://cloud.google.com/pubsub/) Platform routes (https://cloud.google.com/ai-platform/), Cloud Enables Cloud (https://cloud.google.com/bigtable/) Pub/Sub (https://cloud.google.com/pubsub/), demand DaCtlaouodw B i(ghttatbplse://cloud.google.com/dataow/) forecasting (https://cloud.google.com/bigtable/), Dataow Cloud Memorystore and pricing (https://cloud.google.com/dataow/), Cloud (https://cloud.google.com/memorystore/) adjustments Memorystore (https://cloud.google.com/memorystore/), Positions Google Data Studio Google Data Studio business for (https://marketingplatform.google.com/about/data- st u(hdtiotp/)s://marketingplatform.google.com/about/ international data-studio/) expansion Cl,o Culdo uDda tDaalatabl a(hbttps://cloud.google.com/datalab/) (https://cloud.google.com/datalab/), TeTnesnosroFrlFolwow (h (thtpttsp:/s/:w//ww.wte.tnesnosrorowo.wo.rogr/g)/), Google Maps Platform Trac congestion is a fact of life for mGooosgtl eIn Mdaopnse Psliaatnform (https://cloud.google.com/maps-platform/) residents. The nation’s roads and asso (hctiatptse:d//cloud.google.com/maps-platform/) infrastructure strains to support the country’s 260 million people, about 10 million of whom reside in the capital, Jakarta. To minimize delays, Indonesians rely heavily on motorcycles, including motorcycle taxis, known as ojeks, to travel to and from work or personal engagements.

Founded in 2010 and headquartered in Jakarta, GO- JEK (https://www.go-jek.com/) started as a call center for ojek bookings. The organization has ridden demand for the service to become one of the few "unicorn" –

https://cloud.google.com/customers/go-jek/ 2/12 8/23/2020 GO-JEK Case Study | Google Cloud

privately held startup businesses valued at over US$1 billion – in Southeast Asia.

“Google Maps Platform now resides at the core of our engine to help us gure out optimized routes and estimated times of arrival for our drivers.”

—Ajey Gore, Group Chief Technology Ocer, GO-JEK

From 2010, GO-JEK collected data to understand customer behavior and in 2015 launched a mobile application that bundled ride-hailing, food delivery, and grocery shopping. “Demand for the application was insatiable and we hit hypergrowth very quickly,” says

https://cloud.google.com/customers/go-jek/ 3/12 8/23/2020 GO-JEK Case Study | Google Cloud

Willem Pienaar, Data Science Platform Lead at GO- JEK.

GO-JEK continued to listen to its customers and gain usage feedback to inform the development of new products. The business has now bundled more than 18 products, one loyalty program, and one electronic money service in its application, as well as other products outside the application. Customers have downloaded the application nearly 108 million times.

GO-JEK today operates in 167 cities and districts throughout Indonesia and is the largest player in many industry verticals. “For ride-hailing alone, we have more than 1 million drivers on our platform and on a typical day we’ll have hundreds of thousands of drivers online at the same time, servicing our customers,” Pienaar says. “We also have more than 300,000 merchants on our food delivery platform,” he adds. “We call them merchants because they are not just restaurants, they are mothers and fathers selling food from their garages. Our platform supports socioeconomic mobility in Indonesia by allowing people to rise up from poverty. Furthermore, our payment service has become one of the leading e- money platforms in Southeast Asia.”

Google ecosystem key

The business has relied heavily on the skills and expertise of its technology team, and on selecting the right technologies, to grow and to expand into new

https://cloud.google.com/customers/go-jek/ 4/12 8/23/2020 GO-JEK Case Study | Google Cloud

markets. GO-JEK elected to run its applications and data in Google Cloud due largely to an ecosystem comprised of (https://cloud.google.com/), and other technologies.

“We have to match the right driver with the right request – whether that is transporting a person or food or other item from location A to location B – as quickly as possible,” explains Ajey Gore, Group Chief Technology Ocer at GO-JEK. Google Maps Platform (https://cloud.google.com/maps-platform/) now resides at the core of our engine to help us gure out optimized routes and estimated times of arrival for our drivers.”

Google Cloud Platform solutions play an integral role in enabling GO-JEK to capture and analyze the data associated with 1 million drivers across 167 districts and cities, and 2.5 million customers. “For example, we ping every one of our drivers every 10 seconds, which means 6 million pings per minute and 8 billion pings per day,” Gore says. “If you look at the scale and number of our customer interactions as well, we generate about 4TB to 5TB of data every day. We need to leverage this data to tell our drivers where demand from customers is strongest and how to get there.”

https://cloud.google.com/customers/go-jek/ 5/12 8/23/2020 GO-JEK Case Study | Google Cloud

“The Google Cloud Professional Services team was instrumental in driving the success of some key projects for the GO-JEK data science team. Ultimately, thanks to Google Cloud Professional Services, we had a deeper understanding of Google technologies, greater collaboration, smarter designs, and a faster time to market.”

https://cloud.google.com/customers/go-jek/ 6/12 8/23/2020 GO-JEK Case Study | Google Cloud

—Willem Pienaar, Data Science Platform Lead, GO-JEK

International expansion looming

As GO-JEK eyes expansion into international markets, data science and machine learning are becoming increasingly important to the business. “Data science plays a key role in understanding our customers,” explains Pienaar. “With international expansion looming in 2018, we wanted to understand the unique demands of customers in different markets. Furthermore, when so many decisions are being made in real time, machine learning is critical.”

Pienaar investigated how GO-JEK’s data scientists were using their time and whether they had access to the tools they needed. “One of our data scientists asked if we could help him optimize his time,” he explains. “This engineer is representative of many engineers within our organization and was working on interesting projects in areas such as fraud detection, personalization, driver allocation, and forecasting. However, he was spending a lot of time on engineering rather than exploring data and creating features and models.”

By reviewing the data scientist’s projects through three lenses: sourcing of data, feature engineering, and

https://cloud.google.com/customers/go-jek/ 7/12 8/23/2020 GO-JEK Case Study | Google Cloud

machine learning, Pienaar’s team identied the need to establish a centralized data foundation.

GO-JEK then worked closely with Google Cloud Professional Services (https://cloud.google.com/consulting/) to further explore and rene its ideas. “The Google Cloud Professional Services team was instrumental in driving the success of some key projects for the GO-JEK data science team,” says Pienaar. “The team brought a wealth of experience in managing high-impact projects from inception to production. Ultimately, thanks to Google Cloud Professional Services, we had a deeper understanding of Google technologies, greater collaboration, smarter designs, and a faster time to market.”

The Professional Services team held workshops, architecture and design sessions, as well as hands-on technology deep dives. Team members then worked with GO-JEK to develop a proof of concept using technologies such as Apache Beam running on Cloud Dataow (https://cloud.google.com/dataow/), Cloud Bigtable (https://cloud.google.com/bigtable/), and BigQuery (https://cloud.google.com/bigquery/), which formed the basis of the GO-JEK feature engineering and storage platform.

Other technologies used in the platform – that would capture and store data from GO-JEK’s product and other teams – included Apache Kafka, Cloud Pub/Sub (https://cloud.google.com/pubsub/), and Cloud Storage

https://cloud.google.com/customers/go-jek/ 8/12 8/23/2020 GO-JEK Case Study | Google Cloud

(https://cloud.google.com/storage/). Those teams would benet from automated reporting, archival, monitoring, event alerts, and security through the foundation, while the data science and machine learning teams could access the data they needed to generate insights.

With feature creation, standardization, and consistency resolved through a combination of Cloud Dataow and Apache Beam, the business had to select a feature storage environment. “We opted for BigQuery to store our training data, because of its high scalability and the fact it is a completely cloud-based service means you don’t have to manage any infrastructure,” says Pienaar. “In addition, it is closely integrated with other Google Cloud services.”

“We believe in the power of togetherness and in the last two years we have worked closely with Google to open up new frontiers and possibilities. Who

https://cloud.google.com/customers/go-jek/ 9/12 8/23/2020 GO-JEK Case Study | Google Cloud

would have thought we would now be a leading application for transport, food, and other services in Indonesia?”

—Ajey Gore, Group Chief Technology Ocer, GO-JEK

For serving, GO-JEK introduced two data stores: Cloud Bigtable and Cloud Memorystore (https://cloud.google.com/memorystore/) for Redis. “Cloud Bigtable was really a game changer for us,” says Pienaar. “It allows us to consistently access feature data at a latency of less than 10 milliseconds and handles very high loads, so you can write and read to it up to 10,000 times per second combined per node, and if you want to scale up, you just add more nodes.

“Meanwhile, Cloud Memorystore for Redis allows us to accommodate circumstances such as updating features 200,000 or 300,000 times per second,” he adds.

https://cloud.google.com/customers/go-jek/ 10/12 8/23/2020 GO-JEK Case Study | Google Cloud

A feature-serving API enables rapid feature lookup from either Cloud Bigtable or Cloud Memorystore and provides caching.

With all this data logged and extremely useful to data scientists, GO-JEK dumps the metadata into a PostgreSQL database. From there, the business uses Google Data Studio (https://datastudio.google.com/overview) to visualize the effectiveness of specic features in predicting outcomes or optimizing for objectives. GO-JEK has also created a feature explorer that its data scientists can use to nd features, select them in BigQuery, and train their models.

Cloud Machine Learning powers dynamic pricing

With the data source and feature engineering building blocks established, GO-JEK has empowered its data scientists to apply scalable machine learning models to deliver dynamic pricing and other initiatives. “We introduced Cloud Machine Learning Engine (https://cloud.google.com/ml-engine/), which integrated closely with BigQuery as our feature and raw data warehouse,” explains Pienaar. Cloud Machine Learning Engine is a scalable, managed service that enables GO-JEK’s data scientists to train and serve TensorFlow (https://www.tensorow.org/) models.

The GO-JEK architecture also incorporates Cloud Dataow for stream inference and Apache Kafka-

https://cloud.google.com/customers/go-jek/ 11/12 8/23/2020 GO-JEK Case Study | Google Cloud

based future demand. The business can now effectively predict changes in demand due to events such as changes in the weather, or change pricing to adjust how drivers are reacting. It was also able to personalize the home screen of its application while meeting service level requirements of 30 milliseconds latency and throughput of upwards of 10,000 requests per second.

GO-JEK engineers now need only concern themselves with using Cloud Datalab (https://cloud.google.com/datalab/) to build machine learning models; nd features in feature explorer; use BigQuery to create training sets; and employ Cloud Machine Learning Engine to train their models.

“The impact on GO-JEK is our data scientists can deliver projects faster, our customer experience has improved a lot, we have fewer data scientists per customer as we expand to new markets, and we spend less time and money on infrastructure,” says Pienaar.

“We believe in the power of togetherness and in the last two years we have worked closely with Google to open up new frontiers and possibilities,” adds Gore. “Who would have thought we would now be a leading application for transport, food, and other services in Indonesia?”

https://cloud.google.com/customers/go-jek/ 12/12