ModelArts User Guide (Senior AI Engineers) Issue 01 Date 2021-08-30 HUAWEI TECHNOLOGIES CO., LTD. Copyright © Huawei Technologies Co., Ltd. 2021. All rights reserved. No part of this document may be reproduced or transmitted in any form or by any means without prior written consent of Huawei Technologies Co., Ltd. Trademarks and Permissions and other Huawei trademarks are trademarks of Huawei Technologies Co., Ltd. All other trademarks and trade names mentioned in this document are the property of their respective holders. Notice The purchased products, services and features are stipulated by the contract made between Huawei and the customer. All or part of the products, services and features described in this document may not be within the purchase scope or the usage scope. Unless otherwise specified in the contract, all statements, information, and recommendations in this document are provided "AS IS" without warranties, guarantees or representations of any kind, either express or implied. The information in this document is subject to change without notice. Every effort has been made in the preparation of this document to ensure accuracy of the contents, but all statements, information, and recommendations in this document do not constitute a warranty of any kind, express or implied. Issue 01 (2021-08-30) Copyright © Huawei Technologies Co., Ltd. i ModelArts User Guide (Senior AI Engineers) Contents Contents 1 Operation Guide...................................................................................................................... 1 2 Data Management.................................................................................................................. 5 2.1 Introduction to Data Management...................................................................................................................................5 2.2 Creating a Dataset................................................................................................................................................................10 2.3 Labeling Data......................................................................................................................................................................... 22 2.3.1 Image Classification..........................................................................................................................................................22 2.3.2 Object Detection................................................................................................................................................................ 28 2.3.3 Image Segmentation........................................................................................................................................................ 34 2.3.4 Text Classification.............................................................................................................................................................. 40 2.3.5 Named Entity Recognition............................................................................................................................................. 43 2.3.6 Text Triplet........................................................................................................................................................................... 46 2.3.7 Sound Classification..........................................................................................................................................................50 2.3.8 Speech Labeling................................................................................................................................................................. 53 2.3.9 Speech Paragraph Labeling............................................................................................................................................55 2.3.10 Video Labeling................................................................................................................................................................. 57 2.4 Importing Data...................................................................................................................................................................... 59 2.4.1 Import Operation...............................................................................................................................................................59 2.4.2 Specifications for Importing Data from an OBS Directory..................................................................................63 2.4.3 Specifications for Importing the Manifest File........................................................................................................ 68 2.5 Exporting Data....................................................................................................................................................................... 85 2.6 Modifying a Dataset............................................................................................................................................................ 88 2.7 Publishing a Dataset............................................................................................................................................................ 89 2.8 Deleting a Dataset................................................................................................................................................................91 2.9 Managing Dataset Versions.............................................................................................................................................. 92 2.10 Auto Labeling.......................................................................................................................................................................93 2.11 Confirming Hard Examples............................................................................................................................................. 97 2.12 Auto Grouping...................................................................................................................................................................101 2.13 Data Features.................................................................................................................................................................... 103 2.14 Deploying a Model in One Click................................................................................................................................. 109 2.15 Team Labeling................................................................................................................................................................... 111 2.15.1 Introduction to Team Labeling.................................................................................................................................111 2.15.2 Team Management......................................................................................................................................................113 2.15.3 Member Management................................................................................................................................................ 114 Issue 01 (2021-08-30) Copyright © Huawei Technologies Co., Ltd. ii ModelArts User Guide (Senior AI Engineers) Contents 2.15.4 Managing Team Labeling Tasks.............................................................................................................................. 116 3 DevEnviron (Notebook).....................................................................................................123 3.1 Introduction to Notebook................................................................................................................................................123 3.2 Managing Notebook Instances......................................................................................................................................125 3.2.1 Creating a Notebook Instance....................................................................................................................................125 3.2.2 Creating a Notebook Instance with a Git Repository.........................................................................................129 3.2.3 Opening a Notebook Instance................................................................................................................................... 134 3.2.4 Starting or Stopping a Notebook Instance............................................................................................................ 135 3.2.5 Deleting a Notebook Instance....................................................................................................................................135 3.3 Using Jupyter Notebook...................................................................................................................................................135 3.3.1 Introduction to Jupyter Notebook.............................................................................................................................136 3.3.2 Common Operations on Jupyter Notebook........................................................................................................... 136 3.3.3 Configuring the Jupyter Notebook Environment................................................................................................. 139 3.3.3.1 Using the Notebook Terminal Function...............................................................................................................139