Introduction to High Performance Computing at Case Western Reserve University

Total Page:16

File Type:pdf, Size:1020Kb

Introduction to High Performance Computing at Case Western Reserve University Introduction to High Performance Computing at Case Western Reserve University ! Research Computing and CyberInfrastructure team ! Presenters Emily Dragowsky Daniel Balagué Guardia Hadrian Djohari KSL Data Center Sanjaya Gajurel Bootcamp Outline Who we are Case HPC resources Working with the Cluster Basic Linux Job Scripting Open Discussion/Q&A Who we are • Research Computing and 5th floor, around back CyberInfrastructure Team from the elevators • [U]TECH • University Staff, academic ties • CWRU grads • Research group members • Skilled practitioners • Strong collaboration with Network, Servers and Storage teams RCCI Training Sessions - Spring 2018 • 2/6/18 - Advancing with Software Installation • 2/20/18 - Working with Data Transfer • 3/6/18 - Exploring Amazon Web Services for Researchers • 3/21/18 - Advancing with the Linux Shell • 4/3/18 - Advancing with Matlab Toepfer Room, Adelbert Hall, 2nd floor RCCI Services Cyberinfrastructure Support • High Performance • Education and Awareness Computing • Consultation and Award Pre-support • Research Networking services • Database Design • Research Storage and • Visualization Archival solutions • Secure Research • Programming Services Environment for computing • Concierge for off-premise services on regulated data (XSEDE,OSC,AWS) • Public Cloud and Off- Premise Services CASE HPC Cluster • Designed for computationally intensive jobs • long-running, number crunching • Optimized for batch jobs • combine resources as needed (cpu, memory, gnu) • Supports interactive/graphically intensive jobs • OS version emphasizes stability • Linux (Red Hat Enterprise Linux 7.4) • Accessible from Linux, Mac and Windows • Some level of Linux expertise is needed - why we’re here today! • Clusters: redcat (slurm), and hadoop HPC Cluster Glossary • Head Nodes: Development, Analysis, Job Submission • Compute Nodes: Computational Computers • Panasas: Engineered File System, fastest storage • DELL Fluid File System: “Value” storage • Data Transfer Nodes: hpctransfer, dtn1 • Science DMZ: lowest “resistance” Data Pathway • SLURM: Cluster workload manager & Scheduler) HPC Cluster Components Resource Manager redcat.case.edu ! Science Admin DMZ Nodes Dell FFS Storage Head Nodes SLURM Master Data Transfer Nodes Panasas Storage Batch nodes GPU nodes SMP nodes HPC Cluster Components Resource Manager ! redcat.case.edu University ! Firewall Science Admin DMZ Nodes Dell FFS Storage Head Nodes SLURM Master Data Transfer Nodes Panasas Storage Batch nodes GPU nodes SMP nodes Working on the Cluster How To: ~ access the cluster ~ get my data onto the cluster ~ establish interactive sessions <break> ~ submit jobs through the scheduler ~ monitor jobs • a.k.a. why is my job not running!?!?! • work with others within the cluster Access the Cluster You can login from anywhere You will need: • An approved cluster account • Enter your CaseID and the Single Sign-On password • ssh (secure shell) utility [detailed instructions for all platforms]! • We recommend x2go-client • Putty or cygwin (Windows), Terminal (Mac/Linux) will work for non-graphical output sessions. ! If Off-campus Location,! then Connect through VPN, using two-factor authentication Case Guest wireless == “of-campus” Access the Cluster Access the Cluster Owner Group Permissions { Working within Group Allocations - I • What are linux groups? • Manage affiliations in the multiuser environment • Set “in-between” permissions • Groups are administered — contact [email protected] • Switching the active group: “newgrp - <groupname>” [mrd20@hpc3 ~] groups tas35 oscsys gaussian hpcadmin schrodinger ccm4 singularity [mrd20@hpc3 ~] newgrp - hpcadmin [mrd20@hpc3 ~] groups hpcadmin oscsys gaussian tas35 schrodinger ccm4 singularity Active Linux group affects group ownership of new files Access the Cluster Graphically w/ x2goclient Transfer Data scp command scp [-12346BCpqrv] [-c cipher] [-F ssh_config] [-i identity_file] [-l limit] [-o ssh_option] [-P port] [-S program] [[user@]host1:]file1 ... [[user@]host2:]file2 • Copy from HPC to your local PC • scp -r [email protected]:/home/mrd20/data/vLOS.dat . • ‘.’ — full stop means ‘this directory’ • From your PC to HPC • scp orange.py mrd20@redcat:! • ‘:’ — colon denotes hostname Transfer Data Globus Setup Instructions: https://sites.google.com/a/case.edu/hpc-upgraded-cluster/ home/important-notes-for-new-users/transferring-files HPC Environment Your Full Cluster Resources Your HPC account, sponsored by your PI, provides: ! •Group afliation — resources shared amongst group members •Storage •/home — permanent storage, replicated & “snapshot” protected •/scratch/pbsjobs — up to 1 TB temporary storage •/scratch/users — small-scale temporary storage ➡ exceeding quota(s) will prevent using account!! ! •Cores: member groups allocation of 32+ for an “8-share” • Wall-time: 320-hour limit for member shares (32 hours for guest shares) HPC Environment Your /home • Allocated storage space in the HPC filesystem for your work • Create subdirectories underneath your /home/CaseID, ideally each job has its own subdirectory ! cd — linux command to change the current directory examples to change to “home” ‣ cd /home/<CaseID> ‣ cd ~<CaseID> ‣ cd $HOME ! $HOME is an environment variable that points to /home/<CaseID> HPC Environment Beyond /home Linux systems have hierarchical directory structure User files: /home System files: /bin, /dev, /etc, /log, /opt, /var Application files: /usr/local/<module>/<version> ! ! Consider Python: 4 versions installed ‣ /bin/python — 2.6.6 ‣ /usr/local/python/ ‣ 2.7.8 ‣ 2.7.10 ‣ 3.5.2 Module Hierarchies HPC Environment: Environment Variables on Rider Keeping organized ! ‣ echo $PATH /usr/local/intel-17/openmpi/2.0.1/bin:/usr/local/intel/17/compilers_and_libraries_2017/linux/bin/intel64:/ usr/lib64/qt-3.3/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/opt/dell/srvadmin/bin! ! ‣ echo $LD_LIBRARY_PATH /usr/local/intel-17/openmpi/2.0.1/lib:/usr/local/intel/17/tbb/lib/intel64/gcc4.7:/usr/local/intel/17/ compilers_and_libraries_2017/linux/mkl/lib/intel64:/usr/local/intel/17/compilers_and_libraries_2017/ linux/lib/intel64::/usr/local/lib Changes: slurm commands in /usr/bin —> no longer referenced in the PATH, etc Modules and Environment Module command: avail, spider, list, load, unload Manage the environment necessary to run your applications (binary, libraries, shortcuts) Modify environment variables using module commands: >>module avail & spider — learn what is available and how to load it >>module list (shows modules loaded in your environment) >>module load python (loads default version) >>module load python/3.5.1 (loads specific version) >>module unload python/3.5.1 (unloads specific version) ------------------------------------------------------------------- Modules and Environment On Rider, you might need to load a particular version of a compiler and OpenMPI in order to find your module. ! Command Rider Shows the list of the current loadable modules of a module avail hierarchy. It also shows, visually, which modules are loaded. module spider Shows the list of all modules and description. Shows the list of all modules and description, module spider <pkg> including instructions on how to load module. Modules and Environment On Rider, you might need to load a particular version of a compiler and OpenMPI in order to find your module. ! Command Rider Redcat Shows the list of the current Shows the list of all installed loadable modules of a modules and versions (almost module avail hierarchy. It also shows, all modules are loadable as a visually, which modules are result of the plain system). loaded. loaded. Shows the list of all modules module spider Shows the list of all modules. and how to load them. Modules and Environment Redcat Linux uses branching directory structure — independence • User files: /home • System files: /bin, /dev, /etc, /log, /opt, /var • Application files: /usr/local/<module>/<version> ! ! Consider Python: 4 versions installed ‣ /bin/python — 2.6.6 ‣ /usr/local/python/ ‣ 2.7.8 ‣ 2.7.10 ‣ 3.5.2 — how were they compiled? Modules and Environment Rider Lua module hierarchies — independence & accountability • Core — persistent, independent: no run-time dependence on other packages • Compilers - either intel/17 or gcc/6.3.0 • MPI - currently openmpi/2.0.1 with each compiler option ! Directory structure changes • compiler directory trees [here are the compiler files & executables] • /usr/local/<compiler>/<version> • /usr/local/intel/17 • compiled packages • /usr/local/<compiler>-<version>/<package>/<version> • /usr/local/intel-17/openmpi/2.0.1 Modules and Environment Rider Consider Python: what versions are installed/available? ‣ Which hierarchy is active? ‘module avail’ ! ‣ which python: /bin/python — 2.7.5 ‣ /usr/local/python/ — no such file or directory - run-time dependencies ! ‣ ‘module avail python’ ‣ python/3.5.1 python2/2.7.13 spyder/3.2.0-python2 ‣ ‘module spider python’ — information about python package! ‣ python/3.5.1 ! ‣ other possible module matches: python2 Intel + OpenMPI Hierarchy [mrd20@hpclogin ~]$ module avail ! ---------------------------------------------- /usr/local/share/modulefiles/MPI/intel/17/openmpi/2.0.1 ---------------------------------------------- amber/16-17 eigen3/3.3.4 hdf5/1.10.1 lammps/2017 (D) netcdf/4.4.1.1 python/3.5.1 relion/2.1.b1 vtk/8.0.1 bcftools/1.5 fftw/3.3.6-pl2 imagemagick/7.0.4-10 namd/2.12-cuda neuron/7.5 python2/2.7.13 samtools/1.5 boost/1.63 grace/5.1.25 lammps/2017-gpu namd/2.12 (D) openfoam/4.1 qtgrace/0.26 spyder/3.2.0-python2 ! ---------------------------------------------------
Recommended publications
  • Designing and Packaging Printer and Scanner Drivers
    Designing and Packaging Printer and Scanner Drivers OpenPrinting MC on Linux Plumbers 2020 August 28, 2020 Till Kamppeter, OpenPrinting What we had ● Printer drivers – PPD files – Filters, perhaps also backends – All has to be in CUPS-specific directories ● Scanner drivers – Shared libraries with SANE ABI in SANE-specific directories ● Packaging – Binaries were built specific to destination distro and packaged in DEB or RPM packages – For each distro drivers need to be built, packaged, and tested separately – As files need to be in specific directories drivers cannot be installed with CUPS in a Snap or with scanning user applications in Snaps What we want ● Sandboxed packaging – Snaps – Distribution-independent: Install from Snap Store on any distro running snapd – More security: Every package with all its libraries and files in its own sandbox, fine-grained control for communication between packages – All-Snap distributions ● But – You cannot drop driver files into directories of a snapped CUPS or snapped user applications, Snaps do not see the system’s files – Snaps only communicate via IP or D-Bus, not by files ● Also – CUPS is deprecating support for PPD files, working by itself only in driverless IPP mode. The New Architecture ● Printer/Scanner Applications emulating an IPP device – Easily snappable: Communicates only via IP – Multi-function device support, Printing, Scanning, and Fax Out can be done in one Snap/Application – Web admin interface for vendor/device-specific GUI – Behaves like a network printer/scanner/multi-function
    [Show full text]
  • The Interplay of Compile-Time and Run-Time Options for Performance Prediction Luc Lesoil, Mathieu Acher, Xhevahire Tërnava, Arnaud Blouin, Jean-Marc Jézéquel
    The Interplay of Compile-time and Run-time Options for Performance Prediction Luc Lesoil, Mathieu Acher, Xhevahire Tërnava, Arnaud Blouin, Jean-Marc Jézéquel To cite this version: Luc Lesoil, Mathieu Acher, Xhevahire Tërnava, Arnaud Blouin, Jean-Marc Jézéquel. The Interplay of Compile-time and Run-time Options for Performance Prediction. SPLC 2021 - 25th ACM Inter- national Systems and Software Product Line Conference - Volume A, Sep 2021, Leicester, United Kingdom. pp.1-12, 10.1145/3461001.3471149. hal-03286127 HAL Id: hal-03286127 https://hal.archives-ouvertes.fr/hal-03286127 Submitted on 15 Jul 2021 HAL is a multi-disciplinary open access L’archive ouverte pluridisciplinaire HAL, est archive for the deposit and dissemination of sci- destinée au dépôt et à la diffusion de documents entific research documents, whether they are pub- scientifiques de niveau recherche, publiés ou non, lished or not. The documents may come from émanant des établissements d’enseignement et de teaching and research institutions in France or recherche français ou étrangers, des laboratoires abroad, or from public or private research centers. publics ou privés. The Interplay of Compile-time and Run-time Options for Performance Prediction Luc Lesoil, Mathieu Acher, Xhevahire Tërnava, Arnaud Blouin, Jean-Marc Jézéquel Univ Rennes, INSA Rennes, CNRS, Inria, IRISA Rennes, France [email protected] ABSTRACT Both compile-time and run-time options can be configured to reach Many software projects are configurable through compile-time op- specific functional and performance goals. tions (e.g., using ./configure) and also through run-time options (e.g., Existing studies consider either compile-time or run-time op- command-line parameters, fed to the software at execution time).
    [Show full text]
  • Accurate Segmentation of Brain MR Images
    Accurate segmentation of brain MR images Master of Science Thesis in Biomedical Engineering ANTONIO REYES PORRAS PÉREZ Department of Signals and Systems Division of Biomedical Engineering CHALMERS UNIVERSITY OF TECHNOLOGY Göteborg, Sweden, 2010 Report No. EX028/2010 Abstract Full brain segmentation has been of significant interest throughout the years. Recently, many research groups worldwide have been looking into development of patient-specific electromagnetic models for dipole source location in EEG. To obtain this model, accurate segmentation of various tissues and sub-cortical structures is thus required. In this project, the performance of three of the most widely used software packages for brain segmentation has been analyzed: FSL, SPM and FreeSurfer. For the analysis, real images from a patient and a set of phantom images have been used in order to evaluate the performance r of each one of these tools. Keywords: dipole source location, brain, patient-specific model, image segmentation, FSL, SPM, FreeSurfer. Acknowledgements To my advisor, Antony, for his guidance through the project. To my partner, Koushyar, for all the days we have spent in the hospital helping each other. To the staff in Sahlgrenska hospital for their collaboration. To MedTech West for this opportunity to learn. Table of contents 1. Introduction ......................................................................................................................................... 1 2. Magnetic resonance imaging ..............................................................................................................
    [Show full text]
  • Forensic Identification of Unique Kali Systems Through the Use of File Hashes and Names
    Forensic Identification of Unique Kali Systems Through the Use of File Hashes and Names Troy Ward January 25, 2021 Troy Ward Table of Contents Introduction .................................................................................................................................................. 4 Kali Linux ....................................................................................................................................................... 4 Methodology ................................................................................................................................................. 4 Analysis ......................................................................................................................................................... 5 Unique Names ............................................................................................................................................... 6 Eth0.lease .................................................................................................................................................. 6 Font Config ................................................................................................................................................ 7 LightDM ..................................................................................................................................................... 8 System.Journal .........................................................................................................................................
    [Show full text]
  • Papermerge Documentation
    Papermerge Feb 29, 2020 Contents 1 Requirements 3 1.1 Python..................................................3 1.2 Imagemagick...............................................3 1.3 Poppler..................................................3 1.4 Tesseract.................................................4 1.5 Database.................................................4 2 Installation 5 2.1 OS Specific Packages..........................................5 2.1.1 1. Web App + Workers Machine................................5 2.1.1.1 Ubuntu Bionic 18.04 (LTS)..............................5 2.1.2 2. Web App Machine......................................6 2.1.2.1 Ubuntu Bionic 18.04 (LTS)..............................6 2.1.3 3. Worker Machine.......................................6 2.2 Manual Way...............................................6 2.2.1 Package Dependencies.....................................6 2.2.2 Web App............................................7 2.2.3 Worker.............................................9 2.2.4 Recurring Commands...................................... 10 2.3 Systemd................................................. 11 2.3.1 Package Dependencies..................................... 11 2.3.2 Web App............................................ 11 2.4 Docker.................................................. 13 2.5 Ansible (Semiautomated)........................................ 13 2.6 Jenkins + Ansible (Fully Automated Deployment)........................... 14 3 Languages Support 15 4 REST API 17 4.1 How It Works?.............................................
    [Show full text]
  • Freesurfer Tutorial
    FreeSurfer Tutorial FreeSurfer is brought to you by the Martinos Center for Biomedical Imaging supported by NCRR/P41RR14075, Massachusetts General Hospital, Boston, MA USA 2008-06-01 20:47 1 FreeSurfer Tutorial Table of Contents Section Page Overview and course outline 3 Inspection of Freesurfer output 5 Troubleshooting your output 22 Fixing a bad skull strip 26 Making edits to the white matter 34 Correcting pial surfaces 46 Using control points to fix intensity normalization 50 Talairach registration 55 recon-all: morphometry and reconstruction 69 recon-all: process flow table 97 QDEC Group analysis 100 Group analysis: average subject, design matrix, mri_glmfit 125 Group analysis: visualization and inspection 149 Integrating FreeSurfer and FSL's FEAT 159 Exercise overview 172 Tkmedit reference 176 Tksurfer reference 211 Glossary 227 References 229 Acknowledgments 238 2008-06-01 20:47 2 top FreeSurfer Slides 1. Introduction to Freesurfer - Bruce Fischl 2. Anatomical Analysis with Freesurfer - Doug Greve 3. Surface-based Group Analysis - Doug Greve 4. Applying FreeSurfer Tools to FSL fMRI Analysis - Doug Greve FreeSurfer Tutorial Overview The FreeSurfer tools deal with two main types of data: volumetric data volumes of voxels and surface data polygons that tile a surface. This tutorial should familiarize you with FreeSurfer’s volume and surface processing streams, the recommended workflow to execute these, and many of their component tools. The tutorial also describes some of FreeSurfer's tools for registering volumetric datasets, performing group analysis on morphology data, and integrating FSL Feat output with FreeSurfer overlaying color coded parametric maps onto the cortical surface and visualizing plotted results.
    [Show full text]
  • Confrontsred Tape
    IPS: THE MENTAL HEALTH SERVICES CONFERENCE Oct. 8-11, 2015 • New York City When Good Care Confronts Red Tape Navigating the System for Our Patients and Our Practice New York, NY | Sheraton New York Times Square POSTER SESSION OCTOBER 09, 2015 POSTER SESSION 1 P1- 1 ANGIOEDEMA DUE TO POTENTIATING EFFECTS OF RITONIVIR ON RISPERIDONE: CASE REPORT Lead Author: Luisa S. Gonzalez, M.D. Co-Author(s): David A. Kasle MSIII Kavita Kothari M.D. SUMMARY: For many drugs, the liver is the principal site of its metabolism. The most important enzyme system of phase I metabolism is the cytochrome P-450 (CYP450). Ritonavir, a protease inhibitor used for the treatment of human immunodeficiency virus (HIV) infection and acquired immunodeficiency syndrome (AIDS), has been shown to be a potent inhibitor of the (CYP450) 3A and 2D6 isozymes. This inhibition increases the chance for potential drug-drug interactions with compounds that are metabolized by these isoforms. Risperidone, a second generation atypical antipsychotic, is metabolized to a significant extent by the (CYP450) 2D6, and to a lesser extent 3A4. Ritonavir and risperidone can both cause serious, and even life threatening, side effects. An example of one such rare side effect is angioedema which is characterized by edema of the deep dermal and subcutaneous tissues. Here we present three cases of patients residing in a nursing home setting, diagnosed with HIV/AIDS and comorbid psychiatric illness. These patients were all on antiretroviral medications such as ritonavir, and all later presented with varying degrees of edema after long term use of risperidone. We aim to bring to awareness the potential for ritonavir inhibiting the metabolism of risperidone, thus leading to an increased incidence of angioedema in these patients.
    [Show full text]
  • Seed Selection for Successful Fuzzing
    Seed Selection for Successful Fuzzing Adrian Herrera Hendra Gunadi Shane Magrath ANU & DST ANU DST Australia Australia Australia Michael Norrish Mathias Payer Antony L. Hosking CSIRO’s Data61 & ANU EPFL ANU & CSIRO’s Data61 Australia Switzerland Australia ABSTRACT ACM Reference Format: Mutation-based greybox fuzzing—unquestionably the most widely- Adrian Herrera, Hendra Gunadi, Shane Magrath, Michael Norrish, Mathias Payer, and Antony L. Hosking. 2021. Seed Selection for Successful Fuzzing. used fuzzing technique—relies on a set of non-crashing seed inputs In Proceedings of the 30th ACM SIGSOFT International Symposium on Software (a corpus) to bootstrap the bug-finding process. When evaluating a Testing and Analysis (ISSTA ’21), July 11–17, 2021, Virtual, Denmark. ACM, fuzzer, common approaches for constructing this corpus include: New York, NY, USA, 14 pages. https://doi.org/10.1145/3460319.3464795 (i) using an empty file; (ii) using a single seed representative of the target’s input format; or (iii) collecting a large number of seeds (e.g., 1 INTRODUCTION by crawling the Internet). Little thought is given to how this seed Fuzzing is a dynamic analysis technique for finding bugs and vul- choice affects the fuzzing process, and there is no consensus on nerabilities in software, triggering crashes in a target program by which approach is best (or even if a best approach exists). subjecting it to a large number of (possibly malformed) inputs. To address this gap in knowledge, we systematically investigate Mutation-based fuzzing typically uses an initial set of valid seed and evaluate how seed selection affects a fuzzer’s ability to find bugs inputs from which to generate new seeds by random mutation.
    [Show full text]
  • A Novel Mricompatible Brain Ventricle Phantom for Validation of Segmentation and Volumetry Methods
    CME JOURNAL OF MAGNETIC RESONANCE IMAGING 36:476–482 (2012) Original Research A Novel MRI-Compatible Brain Ventricle Phantom for Validation of Segmentation and Volumetry Methods Amanda F. Khan, MSc,1,2 John J. Drozd, PhD,2 Robert K. Moreland, MSc,2,3 Robert M. Ta, MSc,1,2 Michael J. Borrie, MB ChB,3,4 Robert Bartha, PhD1,2* and the Alzheimer’s Disease Neuroimaging Initiative Purpose: To create a standardized, MRI-compatible, life- Conclusion: The phantom represents a simple, realistic sized phantom of the brain ventricles to evaluate ventricle and objective method to test the accuracy of lateral ventri- segmentation methods using T1-weighted MRI. An objec- cle segmentation methods and we project it can be tive phantom is needed to test the many different segmen- extended to other anatomical structures. tation programs currently used to measure ventricle vol- Key Words: 3T; brain phantom; MRI; ventricle; software umes in patients with Alzheimer’s disease. validation; segmentation Materials and Methods: A ventricle model was con- J. Magn. Reson. Imaging 2012;36:476–482. structed from polycarbonate using a digital mesh of the VC 2012 Wiley Periodicals, Inc. ventricles created from the 3 Tesla (T) MRI of a subject with Alzheimer’s disease. The ventricle was placed in a brain mold and surrounded with material composed of VOLUMETRY HAS DEMONSTRATED that large mor- 2% agar in water, 0.01% NaCl and 0.0375 mM gadopente- phological changes occur in the brain during the tate dimeglumine to match the signal intensity properties course of Alzheimer’s disease (AD) (1). In particular, of brain tissue in 3T T -weighted MRI.
    [Show full text]
  • Foot Prints Feel the Freedom of Fedora!
    The Fedora Project: Foot Prints Feel The Freedom of Fedora! RRaahhuull SSuunnddaarraamm SSuunnddaarraamm@@ffeeddoorraapprroojjeecctt..oorrgg FFrreeee ((aass iinn ssppeeeecchh aanndd bbeeeerr)) AAddvviiccee 101011:: KKeeeepp iitt iinntteerraaccttiivvee!! Credit: Based on previous Fedora presentations from Red Hat and various community members. Using the age old wisdom and Indian, Free software tradition of standing on the shoulders of giants. Who the heck is Rahul? ( my favorite part of this presentation) ✔ Self elected Fedora project monkey and noisemaker ✔ Fedora Project Board Member ✔ Fedora Ambassadors steering committee member. ✔ Fedora Ambassador for India.. ✔ Editor for Fedora weekly reports. ✔ Fedora Websites, Documentation and Bug Triaging projects volunteer and miscellaneous few grunt work. Agenda ● Red Hat Linux to Fedora & RHEL - Why? ● What is Fedora ? ● What is the Fedora Project ? ● Who is behind the Fedora Project ? ● Primary Principles. ● What are the Fedora projects? ● Features, Future – Fedora Core 5 ... The beginning: Red Hat Linux 1994-2003 ● Released about every 6 months ● More stable “ .2” releases about every 18 months ● Rapid innovation ● Problems with retail channel sales model ● Impossible to support long-term ● Community Participation: ● Upstream Projects ● Beta Team / Bug Reporting The big split: Fedora and RHEL Red Hat had two separate, irreconcilable goals: ● To innovate rapidly. To provide stability for the long-term ● Red Hat Enterprise Linux (RHEL) ● Stable and supported for 7 years plus. A platform for 3rd party standardization ● Free as in speech ● Fedora Project / Fedora Core ● Rapid releases of Fedora Core, every 6 months ● Space to innovate. Fedora Core in the tradition of Red Hat Linux (“ FC1 == RHL10” ) Free as in speech, free as in beer, free as in community support ● Built and sponsored by Red Hat ● ...with increased community contributions.
    [Show full text]
  • Medical Images Research Framework
    Medical Images Research Framework Sabrina Musatian Alexander Lomakin Angelina Chizhova Saint Petersburg State University Saint Petersburg State University Saint Petersburg State University Saint Petersburg, Russia Saint Petersburg, Russia Saint Petersburg, Russia Email: [email protected] Email: [email protected] Email: [email protected] Abstract—with a growing interest in medical research problems for the development of medical instruments and to show and the introduction of machine learning methods for solving successful applications of this library on some real medical those, a need in an environment for integrating modern solu- cases. tions and algorithms into medical applications developed. The main goal of our research is to create medical images research 2. Existing systems for medical image process- framework (MIRF) as a solution for the above problem. MIRF ing is a free open–source platform for the development of medical tools with image processing. We created it to fill in the gap be- There are many open–source packages and software tween innovative research with medical images and integrating systems for working with medical images. Some of them are it into real–world patients treatments workflow. Within a short specifically dedicated for these purposes, others are adapted time, a developer can create a rich medical tool, using MIRF's to be used for medical procedures. modular architecture and a set of included features. MIRF Many of them comprise a set of instruments, dedicated takes the responsibility of handling common functionality for to solving typical tasks, such as images pre–processing medical images processing. The only thing required from the and analysis of the results – ITK [1], visualization – developer is integrating his functionality into a module and VTK [2], real–time pre–processing of images and video – choosing which of the other MIRF's features are needed in the OpenCV [3].
    [Show full text]
  • Is the Linux Desktop Less Secure Than Windows 10? Or How Super Mario Music Can Own Your System
    IS THE LINUX DESKTOP LESS SECURE THAN WINDOWS 10? OR HOW SUPER MARIO MUSIC CAN OWN YOUR SYSTEM. Hanno Böck https://hboeck.de 1 This was too easy . It should not be possible to find a serious memory corruption vulnerability in the default Linux desktop attack surface with just a few minutes of looking. Although it’ s hard to say it, this is not the kind of situation that occurs with a latest Windows 10 default install. Is it possible that Linux desktop security has rotted? (Chris Evans) 2 NINTENDO SOUND FILES (1) Exploit against Gstreamer in Ubuntu 12.04 (LTS). Thumbnail parser. 3 NINTENDO SOUND FILES (2) NSF players are mini-emulators - the attacker can execute code in an emulator. Easier to bypass modern exploit mitigation techniques. 4 FIX The fix is to delete the affected NSF gstreamer plugin. No problem: Ubuntu shipped two different NSF player plugins. 5 FLIC EXPLOIT 6 AUTOMATIC DOWNLOADS Some browsers automatically download files to ~/Downloads. Any webpage can create files on your filesystem. (Chrome/Chromium, Epiphany, ... - not Linux specific) 7 TRACKER GNOME Desktop search tool automatically indexes all new files in a user's home - including ~/Downloads. 8 REACTION FROM TRACKER DEVELOPER Furthermore, the GStreamer guys were extremely fast in fixing it. You could claim that other libraries used for metadata extraction are just as insecure, but that'd really be bugs in these libraries to fix. (Carlos Garnacho) 9 TRACKER PARSERS (1) Gstreamer, ffmpeg, flac, totem-pl-parser, tiff, libvorbis, taglib, libpng, libexif, giflib, libjpeg-turbo, libosinfo, poppler, libxml2, exempi, libgxps, ghostscript, libitpcdata 10 TRACKER PARSERS (2) If you can exploit any of them you can exploit many Linux desktop users from the web without user interaction.
    [Show full text]