SMILI Documentation Release 0.0.1

Total Page:16

File Type:pdf, Size:1020Kb

SMILI Documentation Release 0.0.1 SMILI Documentation Release 0.0.1 SMILI Developper Team Jun 21, 2019 Contents 1 Table of Contents 3 i ii SMILI Documentation, Release 0.0.1 Sparse Modeling Imaging Library for Interferometry This website is the documentation for SMILI. SMILI is a python-interfaced library for interferometric imaging using sparse sampling techniques. SMILI is mainly designed for very long baseline interferometry, and has been under the active development primarily for the Event Horizon Telescope. This documentation describes its basic usage with some example data sets. However, SMILI has yet been actively and dynamically developed for many new topics and challenges of the EHT. The documentation is not perfect and sometimes outdated due to dynamical changes in the data structure. Please contact to Kazu Akiyama at NRAO/MIT Haystack Observatory if you have any questions about this library. You may contact with following other core developers, too. • Kazu Akiyama (The Main Developer) at NRAO/MIT Haystack Observatory • Fumie Tazaki (Developer) (Japanese Only) at NAOJ • Shiro Ikeda (Developer) at the Institute of Statistical Mathematics • Kotaro Moriyama (Developer) at NAOJ/MIT Haystack Observatory Contents 1 SMILI Documentation, Release 0.0.1 2 Contents CHAPTER 1 Table of Contents 1.1 Installation 1.1.1 Requirements SMILI consists of python modules and Fortran/C internal libraries called from python modules. Here, we summarize required python packages and external packages for SMILI. You will also need ds9 for some functions such as setting imaging regions (CLEAN box) interatively. 1.1.2 Python Packages and Modules SMILI has been tested and developed in Python 2.7 environments provided by the Anaconda package. We recommend using Anaconda for SMILI. All of mandatory packages will be automatically installed during installation. There are some optional packages that can be used for SMILI. • ehtim: https://github.com/achael/eht-imaging • ehtplot: https://github.com/chanchikwan/ehtplot 1.1.3 External Libraries (For MacPort users, Ubuntu/Debian users) Fortran/C internal libraries of SMILI use following external libraries. This path has been tested for • Mac OS X 10.012/10.13 with MacPort’s gcc 8 • Ubuntu 2016LTS & 2018LTS. 1) OpenBLAS 3 SMILI Documentation, Release 0.0.1 We use OpenBLAS, which is the fastest library among publicly-available BLAS implementations. Our recommendation is to build up OpenBLAS by yourself with a compile option USE_OPENMP=1 and use it for our library. The option USE_OPENMP=1 enables OpenBLAS to perform paralleled multi-threads calculations, which will accelerate our library. In most of cases, you can compile this library by # Clone the current repository git clone https://github.com/xianyi/OpenBLAS # Compile and install cd OpenBLAS make USE_OPENMP=1 make PREFIX="Your install directory; such as /usr/local or $HOME/local" ,!install Note that for MacOSX, USE_OPENMP=1 option does not work and should be omitted. You may need superuser to install OpenBLAS (i.e. to run the last command). SMILI uses pkg-config to find appropriate compiler flags for OpenBLAS. Once the library is installed, you can check if the package configuration file can be accessible. You can type pkg-config --debug openblas If you can see the correct package configuration file in the output (should be $PRE- FIX/lib/pkgconfig/openblas.pc), you are all set with OpenBLAS. Otherwise, you need to set PKG_CONFIG_PATH to your pkgconfig directory by, for instance export PKG_CONFIG_PATH="Your prefix for OpenBLAS such as /usr/local"/lib/ ,!pkgconfig:$PKG_CONFIG_PATH Then you can check by ‘‘pkg-config –debug openblas” if the path is correct. Some Other Tips: If you are using Ubuntu, RedHat and its variant, the default OpenBLAS pack- age, which is installable with apt-get/aptitude or yum, seems compiled without this option (USE_OPENMP=1), so we recommend compiling OpenBLAS by yourself. If you are using macOS, unfortunately, this option is not available so far. You may use a package available in a popular package system (e.g. MacPort, Fink, Homebrew). 2) FFTW3 We use FFTW3, which is one of the fastest library among publicly-available FFT library. For non-Ubuntu users, our recommendation is to build up FFTW3 by yourself. In most of cases, you can compile this library by # Download the library (in case of version 3.3.7) wget http://www.fftw.org/fftw-3.3.7.tar.gz # you should check the latest ,!version tar xzvf fftw-3.3.7.tar.gz cd fftw-3.3.7 # Compile and install ./configure --prefix="install directory; such as /usr/local, $HOME/local"-- ,!enable-openmp --enable-threads --enable-shared make make install 4 Chapter 1. Table of Contents SMILI Documentation, Release 0.0.1 You may need superuser to install FFTW3 (i.e. to run the last command). SMILI uses pkg-config to find appropriate compiler flags for FFTW3. Once the library is installed, you can check if the package configuration file can be accessible. You can type pkg-config --debug fftw3 If you can see the correct package configuration file in the output (should be $PRE- FIX/lib/pkgconfig/fftw3.pc), you are all set with OpenBLAS. Otherwise, you need to set PKG_CONFIG_PATH to your pkgconfig directory by, for instance export PKG_CONFIG_PATH="Your prefix such as /usr/local"/lib/pkgconfig:$PKG_ ,!CONFIG_PATH Then you can check by ‘‘pkg-config –debug fftw3” if the path is correct. Some Other Tips: If you are using Ubuntu, the default fftw3 package, which is installable with apt- get/aptitude seems compiled with the option for Openmp (–enable-openmp). So, you don’t need to install it by yourself. 1.1.4 External Libraries (for homebrew users in MacOS) 1) pyenv and Anaconda installation: Since Anaconda conflicts with Homebrew, it should be installed via pyenv. brew install pyenv export PATH=$HOME/.pyenv/shims:$PATH Then install Anaconda. pyenv install -l | grep anaconda2 pyenv install anaconda2-X # select anaconda 2 version pyenv global anaconda2-X python --version # check versions 2) OPENBLAS installation: It is mostly same to the above one, but you will need to install gcc. # Clone the current repository git clone https://github.com/xianyi/OpenBLAS # Install gcc49 brew install gcc49 sudo ln -sf /usr/local/bin/gcc-4.9 /usr/bin/gcc sudo ln -sf /usr/local/bin/g++-4.9 /usr/bin/g++ # Install OPENBLAS make USE_OPENMP=1CC=gcc make PREFIX=/usr/local install 3) FFTW3 installation: No net change from the above one. # Download the source code wget http://www.fftw.org/fftw-3.X.X.tar.gz tar xzvf fftw-3.X.X.tar.gz cd fftw-3.X.X # Install ./configure prefix="/usr/local" --enable-openmp --enable-threads --enable- ,!shared (continues on next page) 1.1. Installation 5 SMILI Documentation, Release 0.0.1 (continued from previous page) make make install 1.1.5 Downloading SMILI You can download the code from github. # Clone the repository git clone https://github.com/astrosmili/smili 1.1.6 Installing SMILI For compiling the whole library, you need to work in your SMILI directory. cd(Your SMILI Directory) Generate Makefiles with ./configure. If you have correct paths to package-config files for OpenBLAS and FFTW3, you would not need any options. ./configure If you don’t have paths to these files, then you need to specify them manually prior to type ./configure # Example for OpenBLAS export OPENBLAS_LIBS="-LYOURPREFIX/lib -lopenblas" export OPENBLAS_CFLAGS="-IYOURPREFIX/include" # Example for FFTW3 export FFTW3_LIBS="-LYOURPREFIX/lib -lfftw3" export FFTW3_CFLAGS="-IYOURPREFIX/include" Make and compile the library. The internal C/Fortran Library will be compiled into python modules, and then the whole python modules will be added to the package list of your Python environment. make install If you can load following modules in your python interpretator, SMILI is probably installed successfully. # import SMILI from smili import imdata, uvdata, imaging (IMPORTANT NOTE; 2018/04/26) Previously, you needed to type autoconf before ./configure command. This is no longer necessary. (IMPORTANT NOTE; 2018/01/04) Previously, you needed to add a PYTHONPATH to your SMILI Directory. This is no longer required, because the make command will run setup.py and install SMILI into the package list of your Python environment. 1.1.7 Updating SMILI We strongly recommend cleaning up the entire library before updating. 6 Chapter 1. Table of Contents SMILI Documentation, Release 0.0.1 cd(Your SMILI Directory) make uninstall Then, you can update the repository with git pull. git pull Now, the repository has updated. You can follow the above section Installing SMILI for recompiling your SMILI. 1.2 Tutorial and Example Scripts 1.2.1 Images The most basic class for the image in SMILI is imdata.IMFITS object.Here, we show its basic usage. You can see list of functions at in this page. [1]:% matplotlib inline from smili import imdata, util # this is for plotting import matplotlib.pyplot as plt import matplotlib.cm as cm import matplotlib as mpl Creating a blank image Let’s start from a blank image. You can make a blank image. [2]: # Create a blank image image= imdata.IMFITS( # pixel size in the specified angular unit (you can specify dy if you want a non- ,!square image pixel) dx=2, # number of pixels (you can also specify ny if you want a non-square field of ,!view) nx= 256, # angular unit (e.g., rad, deg, amin/arcmin, asec/arcsec, mas, uas) angunit="uas" ) # Plot image (We will explain this function later) image.imshow(scale="linear", colorbar="True") [2]: (<matplotlib.image.AxesImage at 0x1c1da92a90>, <matplotlib.colorbar.Colorbar at 0x1c1dadf110>) 1.2. Tutorial and Example Scripts 7 SMILI Documentation, Release 0.0.1 SMILI also can edit the location of the origin by nxref and nyref in the unit of the pixel number.
Recommended publications
  • Getting Started with Astropy
    Astropy Documentation Release 0.2.5 The Astropy Developers October 28, 2013 CONTENTS i ii Astropy Documentation, Release 0.2.5 Astropy is a community-driven package intended to contain much of the core functionality and some common tools needed for performing astronomy and astrophysics with Python. CONTENTS 1 Astropy Documentation, Release 0.2.5 2 CONTENTS Part I User Documentation 3 Astropy Documentation, Release 0.2.5 Astropy at a glance 5 Astropy Documentation, Release 0.2.5 6 CHAPTER ONE OVERVIEW Here we describe a broad overview of the Astropy project and its parts. 1.1 Astropy Project Concept The “Astropy Project” is distinct from the astropy package. The Astropy Project is a process intended to facilitate communication and interoperability of python packages/codes in astronomy and astrophysics. The project thus en- compasses the astropy core package (which provides a common framework), all “affiliated packages” (described below in Affiliated Packages), and a general community aimed at bringing resources together and not duplicating efforts. 1.2 astropy Core Package The astropy package (alternatively known as the “core” package) contains various classes, utilities, and a packaging framework intended to provide commonly-used astronomy tools. It is divided into a variety of sub-packages, which are documented in the remainder of this documentation (see User Documentation for documentation of these components). The core also provides this documentation, and a variety of utilities that simplify starting other python astron- omy/astrophysics packages. As described in the following section, these simplify the process of creating affiliated packages. 1.3 Affiliated Packages The Astropy project includes the concept of “affiliated packages.” An affiliated package is an astronomy-related python package that is not part of the astropy core source code, but has requested to be included in the Astropy project.
    [Show full text]
  • The Astropy Project: Building an Open-Science Project and Status of the V2.0 Core Package*
    The Astronomical Journal, 156:123 (19pp), 2018 September https://doi.org/10.3847/1538-3881/aabc4f © 2018. The American Astronomical Society. The Astropy Project: Building an Open-science Project and Status of the v2.0 Core Package* The Astropy Collaboration, A. M. Price-Whelan1 , B. M. Sipőcz44, H. M. Günther2,P.L.Lim3, S. M. Crawford4 , S. Conseil5, D. L. Shupe6, M. W. Craig7, N. Dencheva3, A. Ginsburg8 , J. T. VanderPlas9 , L. D. Bradley3 , D. Pérez-Suárez10, M. de Val-Borro11 (Primary Paper Contributors), T. L. Aldcroft12, K. L. Cruz13,14,15,16 , T. P. Robitaille17 , E. J. Tollerud3 (Astropy Coordination Committee), and C. Ardelean18, T. Babej19, Y. P. Bach20, M. Bachetti21 , A. V. Bakanov98, S. P. Bamford22, G. Barentsen23, P. Barmby18 , A. Baumbach24, K. L. Berry98, F. Biscani25, M. Boquien26, K. A. Bostroem27, L. G. Bouma1, G. B. Brammer3 , E. M. Bray98, H. Breytenbach4,28, H. Buddelmeijer29, D. J. Burke12, G. Calderone30, J. L. Cano Rodríguez98, M. Cara3, J. V. M. Cardoso23,31,32, S. Cheedella33, Y. Copin34,35, L. Corrales36,99, D. Crichton37,D.D’Avella3, C. Deil38, É. Depagne4, J. P. Dietrich39,40, A. Donath38, M. Droettboom3, N. Earl3, T. Erben41, S. Fabbro42, L. A. Ferreira43, T. Finethy98, R. T. Fox98, L. H. Garrison12 , S. L. J. Gibbons44, D. A. Goldstein45,46, R. Gommers47, J. P. Greco1, P. Greenfield3, A. M. Groener48, F. Grollier98, A. Hagen49,50, P. Hirst51, D. Homeier52 , A. J. Horton53, G. Hosseinzadeh54,55 ,L.Hu56, J. S. Hunkeler3, Ž. Ivezić57, A. Jain58, T. Jenness59 , G. Kanarek3, S. Kendrew60 , N. S. Kern45 , W. E.
    [Show full text]
  • Data Analysis Tools for the HST Community
    EXPANDING THE FRONTIERS OF SPACE ASTRONOMY Data Analysis Tools for the HST Community STUC 2019 Erik Tollerud Data Analysis Tools Branch Project Scientist What Are Data Analysis Tools? The Things After the Pipeline • DATs: Post-Pipeline Tools Spectral visualization tools Specutils Image visualization tools io models training & documentation modeling fitting - Analysis Tools astropy-helpers gwcs: generalized wcs wcs asdf: advanced data format JWST Tools tutorials ‣ Astropy software distribution astroquery MAST JWST data structures nddata ‣ Photutils models & fitting Astronomy Python Tool coordination photutils + others Development at STScI ‣ Specutils STAK: Jupyter notebooks - Visualization Tools IRAF Add to existing python lib cosmology External replacement Build replacement pkg ‣ Python Imexam (+ds9) constants astropy dev IRAF switchers guide affiliated packages no replacement ‣ Ginga ‣ SpecViz ‣ (MOSViz) ‣ (CubeViz) Data Analysis Software at STScI is for the Community Software that is meant to be used by the astronomy community to do their science. This talk is about some newer developments of interest to the HST user community. 2. 3. 1. IRAF • IRAF was amazing for its time, and the DAT for generations of astronomers What is the long-term replacement strategy? Python’s Scientific Ecosystem Has what Astro Needs Python is now the single most- used programming language in astronomy. Momcheva & Tollerud 2015 And 3rd-most in industry… Largely because of the vibrant scientific and numerical ecosystem (=Data Science): (Which HST’s pipelines helped start!) IRAF<->Python is not 1-to-1. Hence STAK Lead: Sara Ogaz Supporting both STScI’s internal scientists and the astronomy community at large (viewers like you) requires that the community be able to transition from IRAF to the Python-world.
    [Show full text]
  • Python for Astronomers an Introduction to Scientific Computing
    Python for Astronomers An Introduction to Scientific Computing Imad Pasha Christopher Agostino Copyright c 2014 Imad Pasha & Christopher Agostino DEPARTMENT OF ASTRONOMY,UNIVERSITY OF CALIFORNIA,BERKELEY Aknowledgements: We would like to aknowledge Pauline Arriage and Baylee Bordwell for their work in assembling much of the base topics covered in this class, and for creating many of the resources which influenced the production of this textbook. First Edition, January, 2015 Contents 1 Essential Unix Skills ..............................................7 1.1 What is UNIX, and why is it Important?7 1.2 The Interface7 1.3 Using a Terminal8 1.4 SSH 8 1.5 UNIX Commands9 1.5.1 Changing Directories.............................................. 10 1.5.2 Viewing Files and Directories........................................ 11 1.5.3 Making Directories................................................ 11 1.5.4 Deleting Files and Directories....................................... 11 1.5.5 Moving/Copying Files and Directories................................. 12 1.5.6 The Wildcard.................................................... 12 2 Basic Python .................................................. 15 2.1 Data-types 15 2.2 Basic Math 16 2.3 Variables 17 2.4 String Concatenation 18 2.5 Array, String, and List Indexing 19 2.5.1 Two Dimensional Slicing............................................ 20 2.6 Modifying Lists and Arrays 21 3 Libraries and Basic Script Writing ............................... 23 3.1 Importing Libraries 23 3.2 Writing Basic Programs 24 3.2.1 Writing Functions................................................. 25 3.3 Working with Arrays 26 3.3.1 Creating a Numpy Array........................................... 26 3.3.2 Basic Array Manipulation........................................... 26 4 Conditionals and Loops ........................................ 29 4.1 Conditional Statements 29 4.1.1 Combining Conditionals........................................... 30 4.2 Loops 31 4.2.1 While-Loops....................................................
    [Show full text]
  • Investigating Interoperability of the LSST Data Management Software Stack with Astropy
    Investigating interoperability of the LSST Data Management software stack with Astropy Tim Jennessa, James Boschb, Russell Owenc, John Parejkoc, Jonathan Sicka, John Swinbankb, Miguel de Val-Borrob, Gregory Dubois-Felsmannd, K-T Lime, Robert H. Luptonb, Pim Schellartb, K. Simon Krughoffc, and Erik J. Tollerudf aLSST Project Management Office, Tucson, AZ, U.S.A. bPrinceton University, Princeton, NJ, U.S.A. cUniversity of Washington, Seattle, WA, U.S.A dInfrared Processing and Analysis Center, California Institute of Technology, Pasadena, CA, U.S.A. eSLAC National Laboratory, Menlo Park, CA, U.S.A. fSpace Telescope Science Institute, 3700 San Martin Dr, Baltimore, MD, 21218, USA ABSTRACT The Large Synoptic Survey Telescope (LSST) will be an 8.4 m optical survey telescope sited in Chile and capable of imaging the entire sky twice a week. The data rate of approximately 15 TB per night and the requirements to both issue alerts on transient sources within 60 seconds of observing and create annual data releases means that automated data management systems and data processing pipelines are a key deliverable of the LSST construction project. The LSST data management software has been in development since 2004 and is based on a C++ core with a Python control layer. The software consists of nearly a quarter of a million lines of code covering the system from fundamental WCS and table libraries to pipeline environments and distributed process execution. The Astropy project began in 2011 as an attempt to bring together disparate open source Python projects and build a core standard infrastructure that can be used and built upon by the astronomy community.
    [Show full text]
  • Research and Technical Resource Guide
    Research and Technical Resources Princeton Astrophysics This guide is meant to provide an overview of essential tools used in astronomy and astrophysics research. They are primarily aimed at the undergraduates beginning to learn the ins and outs of research. 1 General Information about the Department Here are some general things to be aware of as students in Peyton Hall. • The undergraduate portion of the website: www.princeton.edu/astro/undergraduate. This is the best place to look for requirements. • Peyton Hall documentation wiki: www.astro.princeton.edu/docs/Main Page. Lots of information on technical matters, ranging from ssh-ing into workstations to setting up printers on your computer. • See www.astro.princeton.edu/docs/Requesting assistance for the email to contact for any IT assistance you need. • Spring colloquium series: During the Spring semester, we host a speaker every Tuesday afternoon (at 4:30), followed by a reception. Speakers are invited at least partially based on their ability to give good talks. The schedule can be found at www.princeton.edu/astro/news-events/public-events. • Wunch (Wednesday Lunch): www.astro.princeton.edu/∼wunch. Slightly less formal talks are given throughout the academic year, Wednesdays, 12:30. The speakers are often postdocs or grad students. Feel free to bring (or order|see the website) lunch. • Institute for Advanced Study colloquium: www.sns.ias.edu/∼seminar/colloquia.shtml. Though not often frequented by undergrads, you are welcome to attend the Tuesday morning (11:00) talks they host. These are often given by well-known and established astrophysicists, so if one comes up on a topic you are interested in, you should check it out.
    [Show full text]
  • Python Data Analysis and Reduction Tools for Large-Scale Spectroscopy
    Community Python Data Analysis and Reduction Tools for Large-Scale Spectroscopy Erik Tollerud @eteq Astropy Coordination Data Analysis Tools Branch Committee Member Project Scientist (Also: lover of large-scale spectroscopy of local galaxies… talk to me about an Astro2020 White Paper w/ K. Gilbert about M31 & the outer LG!) Python is now the dominant Language in Astro Research Momcheva & Tollerud 2015 Python (esp. in Science) Embraces an Open Ecosystem Openness leads to sharing the load Although: Open Source ≠ Open Development (More on this later) Astropy Mirrors this “Community ecosystem” (Professional) Astronomers help write it with This means both by engineers’ guidance and for the community, It should be useful pooling our for them as part of resources their day-to-day work Specutils https://specutils.readthedocs.io An Astropy-coordinated package with data structures and standard analysis functions for spectroscopy. • Pythonic data structures for spectra ^ • MOS support specifically built-in! • Analysis functions -> • Flux, Centroids, FWHM • Continuum fitting/subtraction • Spectral arithmetic, respecting units • Line modeling Specreduce https://github.com/astropy/specreduce An in-planning (read: mostly not yet implemented) package for reducing OIR spectra (think IRAF twodspec/ onedspec’s calib parts, or IDL spec2d) Needs more contributors! Too many instruments have decided to “roll their own.” (sometimes for good reasons, sometimes not…) This could be a great place for the MSE community to start… JWST DATs are Leveraging the above Spectral
    [Show full text]
  • The Astropy Project: Building an Inclusive, Open-Science Project and Status of the V2.0 Core Package
    This is a repository copy of The Astropy Project: Building an inclusive, open-science project and status of the v2.0 core package. White Rose Research Online URL for this paper: http://eprints.whiterose.ac.uk/130174/ Version: Published Version Article: Collaboration, T.A., Price-Whelan, A.M., Sipőcz, B.M. et al. (134 more authors) (2018) The Astropy Project: Building an inclusive, open-science project and status of the v2.0 core package. The Astronomical Journal , 156 (3). 123. ISSN 0004-6256 https://doi.org/10.3847/1538-3881/aabc4f Reuse This article is distributed under the terms of the Creative Commons Attribution (CC BY) licence. This licence allows you to distribute, remix, tweak, and build upon the work, even commercially, as long as you credit the authors for the original work. More information and the full terms of the licence here: https://creativecommons.org/licenses/ Takedown If you consider content in White Rose Research Online to be in breach of UK law, please notify us by emailing [email protected] including the URL of the record and the reason for the withdrawal request. [email protected] https://eprints.whiterose.ac.uk/ The Astronomical Journal, 156:123 (19pp), 2018 September https://doi.org/10.3847/1538-3881/aabc4f © 2018. The American Astronomical Society. The Astropy Project: Building an Open-science Project and Status of the v2.0 Core Package* The Astropy Collaboration, A. M. Price-Whelan1 , B. M. Sipőcz44, H. M. Günther2,P.L.Lim3, S. M. Crawford4 , S. Conseil5, D. L. Shupe6, M. W. Craig7, N.
    [Show full text]
  • Matt's Astro Python Toolbox Documentation
    Matt’s astro python toolbox Documentation Release 0.1 Matt Craig February 24, 2017 Contents 1 Contents 1 1.1 Overview.................................................1 1.2 Installation................................................2 1.3 Automated header processing......................................4 1.4 Manual header processing........................................ 15 1.5 Image Management........................................... 16 1.6 Header processing............................................ 20 1.7 Index................................................... 34 Python Module Index 35 i ii CHAPTER 1 Contents Overview This package provides two types of functionality; only the first is likely to be of general interest. Classes for managing a collection of FITS files The class ImageFileCollection provides a table summarizing the values of FITS keywords in the files in a directory and provides easy ways to iterate over the HDUs, headers or data in those files. As a quick example: >>> from msumastro import ImageFileCollection >>> ic= ImageFileCollection('.', keywords=['imagetyp','filter']) >>> for hdu in ic.hdus(imagetype='LIGHT', filter='I'): ... print hdu.header, hdu.data.mean() does what you would expect: it loops over all of the images in the collection whose image type is ‘LIGHT’ and filter is ‘I’. For more details see Image Management. The TableTree constructs, from the summary table of an ImageFileCollection, a tree organized by values in the FITS headers of the collection. See Image Management for more details and examples. Header processing of images from the Feder Observatory Semi-automatic image processing Command line scripts for automated updating of FITS header keywords. The intent with these is that they will rarely need to be used manually once a data preparation pipeline is set up. The simplest option here is to use run_standard_header_process which will chain together all of the steps in data preparation for you.
    [Show full text]
  • Fink , a New Generation of Broker for the LSST Community Anais Möller, Julien Peloton, Emille E
    Fink , a new generation of broker for the LSST community Anais Möller, Julien Peloton, Emille E. O. Ishida, Chris Arnault, Etienne Bachelet, Tristan Blaineau, Dominique Boutigny, Abhishek Chauhan, Emmanuel Gangler, Fabio Hernandez, et al. To cite this version: Anais Möller, Julien Peloton, Emille E. O. Ishida, Chris Arnault, Etienne Bachelet, et al.. Fink , a new generation of broker for the LSST community. Monthly Notices of the Royal Astronomical Society, Oxford University Press (OUP): Policy P - Oxford Open Option A, 2021, 501 (3), pp.3272-3288. 10.1093/mnras/staa3602. hal-03045627 HAL Id: hal-03045627 https://hal-cnrs.archives-ouvertes.fr/hal-03045627 Submitted on 8 Dec 2020 HAL is a multi-disciplinary open access L’archive ouverte pluridisciplinaire HAL, est archive for the deposit and dissemination of sci- destinée au dépôt et à la diffusion de documents entific research documents, whether they are pub- scientifiques de niveau recherche, publiés ou non, lished or not. The documents may come from émanant des établissements d’enseignement et de teaching and research institutions in France or recherche français ou étrangers, des laboratoires abroad, or from public or private research centers. publics ou privés. Version 24 November 2020 Fink, a new generation of broker for the LSST community Anais Möller1¢, Julien Peloton2y, Emille E. O. Ishida1z, Chris Arnault2, Etienne Bachelet 3, Tristan Blaineau2, Dominique Boutigny4, Abhishek Chauhan5, Emmanuel Gangler1, Fabio Hernandez6, Julius Hrivnac2, Marco Leoni2,7, Nicolas Leroy2, Marc Moniez2, Sacha Pateyron2, Adrien Ramparison2, Damien Turpin8, Réza Ansari2, Tarek Allam Jr.9,10, Armelle Bajat 11, Biswajit Biswas1,12, Alexandre Boucaud13, Johan Bregeon14, Jean-Eric Campagne2, Johann Cohen-Tanugi15,1, Alexis Coleiro13, Damien Dornic17, Dominique Fouchez16, Olivier Godet18, Philippe Gris1, Sergey Karpov 11, Ada Nebot Gomez-Moran 18, Jérémy Neveu2, Stephane Plaszczynski2, Volodymyr Savchenko19, Natalie Webb17 1LPC, Université Clermont Auvergne, CNRS/IN2P3, F-63000 Clermont-Ferrand, France.
    [Show full text]
  • Astroquery Documentation Release 0.3.7
    astroquery Documentation Release 0.3.7 Adam Ginsburg Mar 29, 2018 Contents I Introduction3 II Installation7 III Requirements 17 IV Using astroquery 21 V Available Services 25 VI Catalog, Archive, and Other 393 i ii astroquery Documentation, Release 0.3.7 This is the documentation for the Astroquery affiliated package of astropy. Code and issue tracker are on GitHub. Contents 1 astroquery Documentation, Release 0.3.7 2 Contents Part I Introduction 3 astroquery Documentation, Release 0.3.7 Astroquery is a set of tools for querying astronomical web forms and databases. There are two other packages with complimentary functionality as Astroquery: astropy.vo is in the Astropy core and pyvo is an Astropy affiliated package. They are more oriented to general virtual observatory discovery and queries, whereas Astroquery has web service specific interfaces. Check out the A Gallery of Queries for some nice examples. 5 astroquery Documentation, Release 0.3.7 6 Part II Installation 7 astroquery Documentation, Release 0.3.7 The latest version of astroquery can be conda installed while the latest and development versions can be pip installed or be downloaded directly from GitHub. 9 astroquery Documentation, Release 0.3.7 10 CHAPTER 1 Using pip $ pip install astroquery and the ‘bleeding edge’ master version: $ pip install https://github.com/astropy/astroquery/archive/master.zip 11 astroquery Documentation, Release 0.3.7 12 Chapter 1. Using pip CHAPTER 2 Using conda It is also possible to install the latest astroquery with anaconda from the astropy channel: $ conda install -c astropy astroquery 13 astroquery Documentation, Release 0.3.7 14 Chapter 2.
    [Show full text]
  • Automated Workflow to Measure Arabidopsis Thaliana Root Tip Angle Dynamic
    bioRxiv preprint doi: https://doi.org/10.1101/2021.07.15.452462; this version posted July 15, 2021. The copyright holder for this preprint (which was not certified by peer review) is the author/funder, who has granted bioRxiv a license to display the preprint in perpetuity. It is made available under aCC-BY-NC 4.0 International license. Title ACORBA: Automated workflow to measure Arabidopsis thaliana root tip angle dynamic Authors Nelson BC Serre and Matyas Fendrych Affiliation Cell Growth Laboratory, Department of Experimental Plant Biology, Faculty of Sciences, Charles University, Prague, Czech Republic. Corresponding author [email protected] Key Words Root gravitropism - Image segmentation - Deep Machine Learning - Python - UNET Summary Plants respond to the surrounding environment in countless ways. One of these responses is their ability to sense and orient their root growth toward the gravity vector. Root gravitropism is studied in many laboratories as a hallmark of auxin-related phenotypes. However, manual analysis of images and microscopy data is known to be subjected to human bias. This is particularly the case for manual measurements of root bending as the selection lines to calculate the angle are set subjectively. Therefore, it is essential to develop and use automated or semi-automated image analysis to produce reproducible and unbiased data. Moreover, the increasing usage of vertical-stage microscopy in plant root biology yields gravitropic experiments with an unprecedented spatiotemporal resolution. To this day, there is no available solution to measure root bending angle over time for vertical-stage microscopy. To address these problems, we developed ACORBA (Automatic Calculation Of Root Bending Angles), a fully automated software to measure root bending angle over time from vertical- stage microscope and flatbed scanner images.
    [Show full text]