Python: Getting Started Ben Ramseth [email protected] @Esrimapninja E M E R a L D

Total Page:16

File Type:pdf, Size:1020Kb

Python: Getting Started Ben Ramseth Bramseth@Esri.Com @Esrimapninja E M E R a L D Python: Getting Started Ben Ramseth [email protected] @esriMapNinja E M E R A L D SAPPHIRE THANK YOU TO OUR SPONSORS Topics covered • What’s is python? • Why use python? • Basics of python • ArcPy • Geoprocessing tools • Other python options What is Python? What is Python? • Python is an interpreted, object-oriented, high-level programming . • Python's simple, easy to learn syntax emphasizes readability and therefore reduces the cost of program maintenance. • Python supports modules and packages, which encourages program modularity and code reuse. • Scripting language of ArcGIS • Free, cross-platform, easy to learn, widely useful, great community Why use Python? Why use Python with ArcGIS • Automate repetitive tasks • Develop custom tools • Add geoprocessing to web applications • Customize Desktop apps • Extend the capabilities of ArcGIS Basics of Python Where do I write Python scripts? • Python file is text with .py extension • Python window in ArcGIS • Best to use IDE - Integrated Development Environment Python in an IDE GIS from the comfort of your development environment • Integrated Development Environments - Debuggers - Test Frameworks - Coverage - PyLint/pycodestyle - Version Control Integration - Refactoring Tools - Virtual Environment Support - AutoComplete Python in an IDE GIS from the comfort of your development environment • Recommended IDEs - PyCharm - Python Tools for Visual Studio - Spyder - Eclipse with PyDev - Wingware Python basics • Variable - A name that stores a value; assigned using = • Logic for testing conditions - If, else statement - Colon at the end of each condition - Indentation determines what is executed - == tests equality; other operators like >,<, != • Techniques for iterating or looping - While loops, for loops - Colon at end of statement - Indentation determines what is executed Python building blocks • Function: - A defined piece of functionality that performs a specific task; requires arguments • Module: - a Python file where functions live; import • Package: - A collection of related modules • Code example - Math.sqrt(100) … 10 • Python Standard Library / Built-ins - Os, sys, math, datetime, urllib2 Python Demo Basics ArcPy ArcPy • ArcGIS Python site package • Introduced in ArcGIS 10.0 - June 29, 2010 • Successor to arcgisscripting module • Create tools leveraging ArcGIS - In-Application Geoprocessing Tools and Scripting - Standalone Python Programs • 1,000+ ArcPy-based Tools Included in ArcGIS ArcGIS Desktop and ArcGIS Pro Python versions • ArcGIS Desktop uses • ArcGIS Pro uses Python Python 2.7 3.x ArcPy in ArcGIS Pro • ArcGIS 10.x to ArcGIS Pro - ArcObjects SDK will not move to Pro - Great time to be a Python GIS Developer! - ArcObjects high cost of maintenance and very tightly coupled to COM - Rewrite code in Python 3 in Pro - Platform agnostic vs. .NET code - Web Services - Vast library of Packages - Improved features in Pro - … it’s Python and not .NET Automating ArcGIS with Python Toolboxes, Python Toolboxes, Interpreters, Command Line, Services… • Multiple ways to create tools - ArcGIS Toolbox (.tbx) - Python Toolbox (.pyt) - Stand-alone Scripts (.py) - Interactive Python Window • Decouple logic code from Toolbox - Testing!! • Distutils to create packaged code Sharing Install into tools as needed Running geoprocessing tools with Python Run gp tools • Import arcpy • Follow tool syntax - Arcpy.toolname_toolboxalias() - Enter input and output parameters • How do I use a specific tool? - Tool help page - Copy as Python Snippet - Help(arcpy.Buffer_analysis) Geoprocessing environment settings • Use geoprocessing environments as global parameters - See tool help for honored environments • Productivity and code cleanup • Arcpy.env - Example: arcpy.env.workspace = “c:/code” Troubleshooting • Why do errors occur? - Incorrect tool use, typos, syntax, data already exists • My script doesn’t work…now what! - View geoprocessing messages - Use Python error handling - Debug the script in an IDE Geoprocessing messages • Three types of messages - Info, warning, Error • Displayed in the Python window • Errors displayed in the IDE • To see other messages - arcpy.GetMessages Python error handling • Try…Except - Try to do something, and if an error occurs, do something else - Like… - Print(arcpy.GetMessages()) ArcPy functions • Perform useful tasks - List data: - ListFeatureClasses - Get data properties: - Describe • Enables automation of manual tasks Batch processing • Automating a geoprocessing operation to run multiple times - Clip every feature class in a geodatabase to a boundary - Calculate statistics for every raster in a folder • May List functions in ArcPy to perform batch processing • Example: - arcpy.env.workspace = “c:/data” - fcList = arcpy.ListFeatureClasses() - for fc in fcList: - print(fc) Getting data properties • Describe function reads data properties • Returns an object with properties - Data type - Shape type - Spatial reference - Fields • Example: - desc = arcpy.Describe(“c:/data/roads.shp”) - print(desc.shapeType) Python script tools • Python script as custom geoprocessing tool • Great way to create and share workflows, extend ArcGIS - More accessible the stand-alone • Integrated with geoprocessing framework - Use it just like any other tool - Geoprocessing properties and environments - Works with map layers ArcGIS API for Python Script against a portal ArcGIS Python API vs ArcPy ArcGIS Python API ArcPy • Script against a portal • ArcGIS Desktop - ArcGIS Online or ArcGIS Enterprise - ArcMap – Python 2.7 - Python 3.5 - ArcGIS Pro – 3.5 • Analysis, Portal Admin, Content • Mostly geoprocessing Creation, Big Data Analysis • Some map automation Four different groups working with the ArcGIS Python API - Org Administrators - Content Publishers - GIS Analysts and Data Scientists - Power Users/Developers Overview of the ArcGIS Python API • A Pythonic GIS API • Corresponds to best practices • Uses standard Python constructs • Data structures with clean, readable idioms • Easy for a Python programmer to use ArcGIS • Easy for an ArcGIS user to script and automate their GIS The Future of Python in ArcGIS • Conda integration into ArcGIS - Advanced Python Package Management - Curated channels of scientific Python packages - Includes C and Fortran compiler - Create and host your own conda packages - Easily share your code with the GIS community - Built-In Virtual Environment Support - Manage multiple environments with access to ArcPy - Easily share environments - Trivializes dependency issues Questions? .
Recommended publications
  • Python for Bioinformatics, Second Edition
    PYTHON FOR BIOINFORMATICS SECOND EDITION CHAPMAN & HALL/CRC Mathematical and Computational Biology Series Aims and scope: This series aims to capture new developments and summarize what is known over the entire spectrum of mathematical and computational biology and medicine. It seeks to encourage the integration of mathematical, statistical, and computational methods into biology by publishing a broad range of textbooks, reference works, and handbooks. The titles included in the series are meant to appeal to students, researchers, and professionals in the mathematical, statistical and computational sciences, fundamental biology and bioengineering, as well as interdisciplinary researchers involved in the field. The inclusion of concrete examples and applications, and programming techniques and examples, is highly encouraged. Series Editors N. F. Britton Department of Mathematical Sciences University of Bath Xihong Lin Department of Biostatistics Harvard University Nicola Mulder University of Cape Town South Africa Maria Victoria Schneider European Bioinformatics Institute Mona Singh Department of Computer Science Princeton University Anna Tramontano Department of Physics University of Rome La Sapienza Proposals for the series should be submitted to one of the series editors above or directly to: CRC Press, Taylor & Francis Group 3 Park Square, Milton Park Abingdon, Oxfordshire OX14 4RN UK Published Titles An Introduction to Systems Biology: Statistical Methods for QTL Mapping Design Principles of Biological Circuits Zehua Chen Uri Alon
    [Show full text]
  • Python Guide Documentation 0.0.1
    Python Guide Documentation 0.0.1 Kenneth Reitz 2015 11 07 Contents 1 3 1.1......................................................3 1.2 Python..................................................5 1.3 Mac OS XPython.............................................5 1.4 WindowsPython.............................................6 1.5 LinuxPython...............................................8 2 9 2.1......................................................9 2.2...................................................... 15 2.3...................................................... 24 2.4...................................................... 25 2.5...................................................... 27 2.6 Logging.................................................. 31 2.7...................................................... 34 2.8...................................................... 37 3 / 39 3.1...................................................... 39 3.2 Web................................................... 40 3.3 HTML.................................................. 47 3.4...................................................... 48 3.5 GUI.................................................... 49 3.6...................................................... 51 3.7...................................................... 52 3.8...................................................... 53 3.9...................................................... 58 3.10...................................................... 59 3.11...................................................... 62
    [Show full text]
  • Python Guide Documentation Publicación 0.0.1
    Python Guide Documentation Publicación 0.0.1 Kenneth Reitz 17 de May de 2018 Índice general 1. Empezando con Python 3 1.1. Eligiendo un Interprete Python (3 vs. 2).................................3 1.2. Instalando Python Correctamente....................................5 1.3. Instalando Python 3 en Mac OS X....................................6 1.4. Instalando Python 3 en Windows....................................8 1.5. Instalando Python 3 en Linux......................................9 1.6. Installing Python 2 on Mac OS X.................................... 10 1.7. Instalando Python 2 en Windows.................................... 12 1.8. Installing Python 2 on Linux....................................... 13 1.9. Pipenv & Ambientes Virtuales...................................... 14 1.10. Un nivel más bajo: virtualenv...................................... 17 2. Ambientes de Desarrollo de Python 21 2.1. Your Development Environment..................................... 21 2.2. Further Configuration of Pip and Virtualenv............................... 26 3. Escribiendo Buen Código Python 29 3.1. Estructurando tu Proyecto........................................ 29 3.2. Code Style................................................ 40 3.3. Reading Great Code........................................... 49 3.4. Documentation.............................................. 50 3.5. Testing Your Code............................................ 53 3.6. Logging.................................................. 57 3.7. Common Gotchas...........................................
    [Show full text]
  • Python Guide Documentation 0.0.1
    Python Guide Documentation 0.0.1 Kenneth Reitz 2015 09 13 Contents 1 Getting Started 3 1.1 Picking an Interpreter..........................................3 1.2 Installing Python on Mac OS X.....................................5 1.3 Installing Python on Windows......................................6 1.4 Installing Python on Linux........................................7 2 Writing Great Code 9 2.1 Structuring Your Project.........................................9 2.2 Code Style................................................ 15 2.3 Reading Great Code........................................... 24 2.4 Documentation.............................................. 24 2.5 Testing Your Code............................................ 26 2.6 Common Gotchas............................................ 30 2.7 Choosing a License............................................ 33 3 Scenario Guide 35 3.1 Network Applications.......................................... 35 3.2 Web Applications............................................ 36 3.3 HTML Scraping............................................. 41 3.4 Command Line Applications....................................... 42 3.5 GUI Applications............................................. 43 3.6 Databases................................................. 45 3.7 Networking................................................ 45 3.8 Systems Administration......................................... 46 3.9 Continuous Integration.......................................... 49 3.10 Speed..................................................
    [Show full text]
  • Python Frequently Asked Questions Release 3.9.7
    Python Frequently Asked Questions Release 3.9.7 Guido van Rossum and the Python development team August 30, 2021 Python Software Foundation Email: [email protected] CONTENTS 1 General Python FAQ 1 1.1 General Information ......................................... 1 1.1.1 What is Python? ....................................... 1 1.1.2 What is the Python Software Foundation? ......................... 1 1.1.3 Are there copyright restrictions on the use of Python? ................... 1 1.1.4 Why was Python created in the first place? ......................... 2 1.1.5 What is Python good for? .................................. 2 1.1.6 How does the Python version numbering scheme work? .................. 2 1.1.7 How do I obtain a copy of the Python source? ....................... 3 1.1.8 How do I get documentation on Python? .......................... 3 1.1.9 I’ve never programmed before. Is there a Python tutorial? ................. 3 1.1.10 Is there a newsgroup or mailing list devoted to Python? ................... 3 1.1.11 How do I get a beta test version of Python? ......................... 3 1.1.12 How do I submit bug reports and patches for Python? ................... 4 1.1.13 Are there any published articles about Python that I can reference? ............. 4 1.1.14 Are there any books on Python? ............................... 4 1.1.15 Where in the world is www.python.org located? ...................... 4 1.1.16 Why is it called Python? ................................... 4 1.1.17 Do I have to like “Monty Python’s Flying Circus”? ..................... 4 1.2 Python in the real world ....................................... 4 1.2.1 How stable is Python? .................................... 4 1.2.2 How many people are using Python? ...........................
    [Show full text]
  • Flycheck Release 32-Cvs
    Flycheck Release 32-cvs Aug 25, 2021 Contents 1 Try out 3 2 The User Guide 5 2.1 Installation................................................5 2.2 Quickstart................................................7 2.3 Troubleshooting.............................................8 2.4 Check buffers............................................... 12 2.5 Syntax checkers............................................. 14 2.6 See errors in buffers........................................... 18 2.7 List all errors............................................... 22 2.8 Interact with errors............................................ 24 2.9 Flycheck versus Flymake........................................ 27 3 The Community Guide 33 3.1 Flycheck Code of Conduct........................................ 33 3.2 Recommended extensions........................................ 34 3.3 Get help................................................. 37 3.4 People.................................................. 37 4 The Developer Guide 45 4.1 Developer’s Guide............................................ 45 5 The Contributor Guide 51 5.1 Contributor’s Guide........................................... 51 5.2 Style Guide................................................ 54 5.3 Maintainer’s Guide............................................ 57 6 Indices and Tables 63 6.1 Supported Languages.......................................... 63 6.2 Glossary................................................. 85 6.3 Changes................................................. 85 7 Licensing 93 7.1 Flycheck
    [Show full text]
  • Pylint Documentation Release 2.7.3
    Pylint Documentation Release 2.7.3 Logilab, PyCQA and contributors Mar 29, 2021 Contents 1 Introduction 3 1.1 What is Pylint?..............................................3 1.2 What Pylint is not?............................................3 2 Tutorial 5 2.1 Intro...................................................5 2.2 Getting Started..............................................5 2.3 Your First Pylint’ing...........................................6 2.4 The Next Step..............................................8 3 User Guide 11 3.1 Installation................................................ 11 3.2 Running Pylint.............................................. 11 3.3 Pylint output............................................... 14 3.4 Messages control............................................. 16 3.5 Configuration............................................... 19 3.6 Editor and IDE integration........................................ 21 4 How To Guides 27 4.1 How to Write a Checker......................................... 27 4.2 How To Write a Pylint Plugin...................................... 31 4.3 Transform plugins............................................ 32 5 Technical Reference 35 5.1 Startup and the Linter Class....................................... 35 5.2 Checkers................................................. 35 5.3 Optional Pylint checkers in the extensions module........................... 35 5.4 Pylint features.............................................. 43 5.5 Pylint and C extensions........................................
    [Show full text]
  • Python Frequently Asked Questions Release 2.7.6
    Python Frequently Asked Questions Release 2.7.6 Guido van Rossum Fred L. Drake, Jr., editor November 10, 2013 Python Software Foundation Email: [email protected] CONTENTS 1 General Python FAQ 1 1.1 General Information.........................................1 1.2 Python in the real world.......................................4 1.3 Upgrading Python..........................................6 2 Programming FAQ 9 2.1 General Questions..........................................9 2.2 Core Language............................................ 12 2.3 Numbers and strings......................................... 19 2.4 Sequences (Tuples/Lists)....................................... 23 2.5 Dictionaries.............................................. 26 2.6 Objects................................................ 28 2.7 Modules............................................... 32 3 Design and History FAQ 35 3.1 Why does Python use indentation for grouping of statements?................... 35 3.2 Why am I getting strange results with simple arithmetic operations?................ 35 3.3 Why are floating point calculations so inaccurate?......................... 35 3.4 Why are Python strings immutable?................................. 36 3.5 Why must ‘self’ be used explicitly in method definitions and calls?................ 36 3.6 Why can’t I use an assignment in an expression?.......................... 37 3.7 Why does Python use methods for some functionality (e.g. list.index()) but functions for other (e.g. len(list))?...........................................
    [Show full text]
  • Evaluating Static Source Code Analysis Tools Thomas Hofer
    Evaluating Static Source Code Analysis Tools by Thomas Hofer B.S., Ecole´ Polytechnique F´ed´eralede Lausanne (2007) Submitted to the School of Computer and Communications Science in partial fulfillment of the requirements for the degree of Master of Science in Computer Science at the Ecole´ Polytechnique Fed´ erale´ de Lausanne April 2010 c Thomas Hofer, MMX. All rights reserved. The author hereby grants to EPFL and CERN permission to reproduce and distribute publicly paper and electronic copies of this thesis document in whole or in part. Author............................................................................ School of Computer and Communications Science March 12, 2010 Evaluating Static Source Code Analysis Tools by Thomas Hofer Submitted to the School of Computer and Communications Science on March 12, 2010, in partial fulfillment of the requirements for the degree of Master of Science in Computer Science Abstract This thesis presents the results of an evaluation of source code analyzers. Such tools constitute an inexpensive, efficient and fast way of removing the most common vulnerabilities in a software project, even though not all security flaws can be detected. This evaluation was conducted at CERN, the European Organization for Nuclear Research, in the intent of providing its programmers with a list of dedicated software verification/static source code analysis tools. Particular focus of these tools should be on efficiently finding security flaws. The evaluation covered close to thirty different tools for five major programming languages. Thesis Supervisor: Philippe Oechslin Title: Lecturer Thesis Supervisor: Sebastian Lopienski Title: Deputy Computer Security Officer at CERN Thesis Supervisor: Stefan Lueders Title: Computer Security Officer at CERN Acknowledgments I feel particularly grateful to the supervisor with whom I shared offices, Sebastian Lopienski, for his many insightful comments over the months, for his friendly guidance and for his enthusiasm.
    [Show full text]
  • Guide to Developing Software for the EELT
    European Organisation for Astronomical Research in the Southern Hemisphere Programme: E-ELT Project/WP: E-ELT Telescope Control Guide to Developing Software for the EELT Document Number: ESO-288431 Document Version: 3 Document Type: Manual (MAN) Released On: 2019-05-22 Document Classification: ESO Internal [Confidential for Non-ESO Staff] Owner: Pellegrin, Federico Validated by PA/QA: Kurlandczyk, Hervé Validated by WPM: Kornweibel, Nick Approved by PM: Kornweibel, Nick Name European Southern Observatory Karl-Schwarzschild-Straße 2 www.eso.org Headquarters Garching 85748 Garching bei München Doc. Number: ESO-288431 Doc. Version: 3 Guide to Developing Software for the EELT Released on: 2019-05-22 Page: 2 of 32 Authors Name Affiliation F. Pellegrin ESO S. Feyrin ESO Change Record from previous Version Affected Changes / Reason / Remarks Section(s) All Updates for new release of ELT DEV 3.1 New directory structure based on RootAreas.docx 03/04/2018 3.8 Added wtools documentation 3.2-3.3 Added lmod documentation Document Classification: ESO Internal [Confidential for Non-ESO Staff] Doc. Number: ESO-288431 Doc. Version: 3 Guide to Developing Software for the EELT Released on: 2019-05-22 Page: 3 of 32 Contents 1. Introduction ....................................................................................................................... 5 1.1 Scope ......................................................................................................................... 5 1.2 Definitions and Conventions .....................................................................................
    [Show full text]
  • Pylint-2.1.0
    Pylint Documentation Release 2.1.0 Logilab, PyCQA and contributors Mar 05, 2019 Contents 1 Introduction 1 1.1 What is Pylint?..............................................1 1.2 What Pylint is not?............................................1 2 Tutorial 3 2.1 Intro...................................................3 2.2 Getting Started..............................................3 2.3 Your First Pylint’ing...........................................4 2.4 The Next Step..............................................7 3 User Guide 11 3.1 Installation................................................ 11 3.2 Running Pylint.............................................. 11 3.3 Pylint output............................................... 14 3.4 Messages control............................................. 16 3.5 Configuration............................................... 17 3.6 Editor and IDE integration........................................ 20 4 How To Guides 25 4.1 How to Write a Checker......................................... 25 4.2 How To Write a Pylint Plugin...................................... 29 4.3 Transform plugins............................................ 30 5 Technical Reference 33 5.1 Startup and the Linter Class....................................... 33 5.2 Checkers................................................. 33 5.3 Optional Pylint checkers in the extensions module........................... 33 5.4 Pylint features.............................................. 40 5.5 Pylint and C extensions........................................
    [Show full text]
  • Pylint Documentation Release 1.1.0
    Pylint Documentation Release 1.1.0 Logilab and contributors Jul 18, 2017 Contents 1 Introduction 3 1.1 What is Pylint?..............................................3 1.2 What Pylint is not?............................................3 2 Running Pylint 5 2.1 Invoking Pylint..............................................5 2.2 Command line options..........................................6 3 Pylint output 9 3.1 Source code analysis section....................................... 10 3.2 Reports section.............................................. 10 4 Messages control 13 5 Configuration 15 5.1 Naming Styles.............................................. 15 6 Extending Pylint 19 6.1 Writing your own checker........................................ 19 7 IDE integration 21 7.1 Using Pylint thru flymake in Emacs................................... 21 7.2 Setup the MS Visual Studio .NET 2003 editor to call Pylint...................... 23 8 Plugins 25 8.1 Why write a plugin?........................................... 25 8.2 Example................................................. 25 8.3 Enter Plugin............................................... 26 9 Contribute 29 9.1 Bug reports, feedback.......................................... 29 9.2 Mailing lists............................................... 29 9.3 Forge................................................... 30 9.4 Unit test setup.............................................. 30 9.5 Adding new functionnal tests...................................... 31 10 A Beginner’s Guide to Code Standards in Python
    [Show full text]