Huawei Technologies Co., Ltd
Total Page:16
File Type:pdf, Size:1020Kb
NAIE V200R021C30 Model Training Service Issue 01 Date 2021-01-30 HUAWEI TECHNOLOGIES CO., LTD. Copyright © Huawei Technologies Co., Ltd. 2021. All rights reserved. No part of this document may be reproduced or transmitted in any form or by any means without prior written consent of Huawei Technologies Co., Ltd. Trademarks and Permissions and other Huawei trademarks are trademarks of Huawei Technologies Co., Ltd. All other trademarks and trade names mentioned in this document are the property of their respective holders. Notice The purchased products, services and features are stipulated by the contract made between Huawei and the customer. All or part of the products, services and features described in this document may not be within the purchase scope or the usage scope. Unless otherwise specified in the contract, all statements, information, and recommendations in this document are provided "AS IS" without warranties, guarantees or representations of any kind, either express or implied. The information in this document is subject to change without notice. Every effort has been made in the preparation of this document to ensure accuracy of the contents, but all statements, information, and recommendations in this document do not constitute a warranty of any kind, express or implied. Huawei Technologies Co., Ltd. Address: Huawei Industrial Base Bantian, Longgang Shenzhen 518129 People's Republic of China Website: https://www.huawei.com Email: [email protected] Issue 01 (2021-01-30) Copyright © Huawei Technologies Co., Ltd. i NAIE Model Training Service Contents Contents 1 Documentation Guide............................................................................................................ 1 2 Introduction.............................................................................................................................. 2 2.1 Overview.................................................................................................................................................................................... 2 2.2 Advantages................................................................................................................................................................................ 2 2.3 Functions.................................................................................................................................................................................... 3 2.4 Architecture............................................................................................................................................................................... 4 2.5 Application Scenarios............................................................................................................................................................. 5 2.6 Basic Concepts.......................................................................................................................................................................... 6 2.7 Service Dependencies.............................................................................................................................................................7 2.8 Billing Description................................................................................................................................................................... 7 2.9 How to Access the Model Training Service.................................................................................................................... 8 2.10 Change History...................................................................................................................................................................... 9 3 Quick Start.............................................................................................................................. 10 3.1 Operation Process................................................................................................................................................................. 10 3.2 Prerequisites............................................................................................................................................................................10 3.3 Subscribing to the Model Training Service...................................................................................................................11 3.4 Accessing the Model Training Service............................................................................................................................11 3.5 Project Creation..................................................................................................................................................................... 12 3.6 Dataset..................................................................................................................................................................................... 13 3.7 Feature Engineering............................................................................................................................................................. 16 3.8 Model Training....................................................................................................................................................................... 23 3.9 Model Management............................................................................................................................................................ 29 3.10 Model Verification.............................................................................................................................................................. 29 3.11 Cloud-based Inference...................................................................................................................................................... 33 3.12 Change History.................................................................................................................................................................... 39 4 User Guide...............................................................................................................................41 4.1 About This Document......................................................................................................................................................... 41 4.2 Training Service Overview..................................................................................................................................................42 4.3 Prerequisites............................................................................................................................................................................43 4.3.1 Subscribing to the Model Training Service............................................................................................................... 43 4.3.2 Operation Process............................................................................................................................................................. 43 4.3.3 Accessing the Model Training Service........................................................................................................................ 44 Issue 01 (2021-01-30) Copyright © Huawei Technologies Co., Ltd. ii NAIE Model Training Service Contents 4.4 Project Creation..................................................................................................................................................................... 44 4.4.1 Introduction to the Training Service Homepage.................................................................................................... 44 4.4.2 Creating a Project.............................................................................................................................................................. 47 4.4.3 Project Overview................................................................................................................................................................ 49 4.5 Dataset..................................................................................................................................................................................... 50 4.5.1 Dataset Overview.............................................................................................................................................................. 50 4.5.2 Creating a Dataset and Importing Data....................................................................................................................54 4.5.3 Performing Dataset Operations....................................................................................................................................64 4.6 Feature Engineering............................................................................................................................................................. 69 4.6.1 Feature Engineering Overview......................................................................................................................................69 4.6.2 Python and Spark Development Platforms.............................................................................................................. 72 4.6.2.1 Creating a Feature Engineering Project..................................................................................................................72 4.6.2.2 Data Sampling...............................................................................................................................................................