1 Amazon Sagemaker

1 Amazon SageMaker 13:45~14:30 Amazon SageMaker 14:30~15:15 Amazon SageMaker re:Invent 15:15~15:45 Q&A | 15:45~17:00 Amazon SageMaker 20 SmartNews Data Scientist, Meng Lee Sagemaker

SageMaker - FiNC FiNC Technologies SIGNATE Amazon SageMaker SIGNATE CTO

Makoto Shimura, Solutions Architect 2019/01/15

© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark 開発学習推論推論

学習に使うコードを記述大量の GPU 大量のCPU や GPU 小規模データで動作確認大規模データの処理継続的なデプロイ試行錯誤の繰り返し様々なデバイスで動作

エンジニアがプロダクデータサイエンティストが開発環境で作業ション環境に構築開発と学習を同じ 1 台のインスタンスで実施 API サーバにデプロイ Deep Learning であれば GPU インスタンスを使用エッジデバイスで動作

© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark & • 開発学習推論推論 • エンジニアがプロダクデータサイエンティストが開発環境で作業 • ション環境に構築開発と学習を同じ 1 台のインスタンスで実施 API サーバにデプロイ • Deep Learning であれば GPU インスタンスを使用エッジデバイスで動作

• API • •

S3 S3

* IAM

* JupyterLab JupyterLab

SageMaker Examples

SageMaker Python Sdk

chainer_single_machine_cifer10.ipynb Use Create copy

Sagemaker Chainer

SDK github *

Chainer estimator.fit()

estimator.deploy()

predictor.predict()

•

• 13

Jupyter Notebook

API

EC2

API AB API

Jupyter Notebook

API

EC2

API AB API

Office Network AWS Cloud

2. 1.

Office Network AWS Cloud

1. SDK 2. 4.

Office Network AWS Cloud

1. SDK

Office Network AWS Cloud 3. 1. SDK

4. S3 S3

• github SDK • SDK github

https://github.com/aws/sagemaker-python-sdk https://github.com/awslabs/amazon-sagemaker-examples

fit() Chainer S3

deploy()

predict()

transformer.transform() S3 S3

SageMaker argparse

model_fn() SageMaker

Tensorflow ( Keras) Deep Learning Chainer PyTorch MXNet ( Keras)

scikit-learn

Coach Ray

Tensorflow ( Keras) Deep Learning Chainer PyTorch MXNet ( Keras)

scikit-learn

Coach Ray

© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark • Linear Learner • PCA • Factorization Machines • LDA • XGBoost • Neural Topic Model • Image Classification • DeepAR Forecasting • seq2seq • BlazingText (word2vec) • K-means • Random Cut Forest • k-NN • Object Detection • Object2Vec • IP Insights • Semantic Segmentation https://docs.aws.amazon.com/sagemaker/latest/dg/algos.html

https://docs.aws.amazon.com/ja_jp/sagemaker/latest/dg/sagemaker-algo-docker-registry-paths.html

• Tensorflow, Chainer, PyTorch, MXNet, scikit-learn SDK • Tensorflow MXNet Keras • main github • github

https://github.com/aws/sagemaker-python-sdk https://github.com/aws/sagemaker-containers

ECR ID

https://docs.aws.amazon.com/sagemaker/latest/dg/your-algorithms-training-algo.html https://docs.aws.amazon.com/sagemaker/latest/dg/your-algorithms-inference-code.html

• Redshift, Athena, EMR

https://aws.amazon.com/jp/blogs/news/build-amazon-sagemaker-notebooks-backed-by-spark-in-amazon-emr/ https://aws.amazon.com/jp/blogs/news/build-fast-flexible-secure-machine-learning-platform-using-amazon-sagemaker-and-amazon-redshift/

• SageMaker git •

• JupyterLab GUI

• →

•

• • /opt/ml/input/config/resourceConfig.json SageMaker

• SDK estimator.fit(wait=False)

• SageMaker •

https://github.com/aws/sagemaker-python-sdk#sagemaker-automatic-model-tuning

pull • SageMaker • local

https://github.com/aws/sagemaker-python-sdk#local-mode

•

• Accuracy Loss • Linage

https://aws.amazon.com/blogs/machine-learning/amazon-sagemaker-now-comes-with-new-capabilities-for- accelerating-machine-learning-experimentation/

2 • 1 •

https://docs.aws.amazon.com/sagemaker/latest/dg/endpoint-auto-scaling.html#endpoint-auto-scaling-add-policy https://docs.aws.amazon.com/ja_jp/autoscaling/application/userguide/application-auto-scaling-target-tracking.html

• • • • •

Text Embedding

Client Numeric vector

Category Classification

https://docs.aws.amazon.com/sagemaker/latest/dg/inference-pipelines.html

• Elastic Inference CPU EC2 GPU ML

• CPU GPU • 75% • • AWS enhanced versions of TensorFlow • Apache MXNet (including ONNX)

https://docs.aws.amazon.com/AWSEC2/latest/UserGuide/working-with-ei.html

• SageMaker SDK

• AWS SDK SageMaker API

SageMaker SDK AWS SDK

1: SageMaker

開発学習

2: GPU AWS

推論

• Step Functions SageMaker AWS Glue Lambda • Glue – SageMaker – –

AWS Step Functions workflow

CloudWatch Events ETL

https://docs.aws.amazon.com/step-functions/latest/dg/connectors-sagemaker.html