Journal of Physics: Conference Series PAPER • OPEN ACCESS Related content - Opportunistic Computing with Lobster: Exploiting volatile opportunistic computing Lessons Learned from Scaling up to 25k Non-Dedicated Cores Matthias Wolf, Anna Woodard, Wenzhao resources with Lobster Li et al. To cite this article: Anna Woodard et al 2015 J. Phys.: Conf. Ser. 664 032035 Recent citations - The swiss army knife of job submission tools: grid-control View the article online for updates and enhancements. F Stober et al This content was downloaded from IP address 131.169.5.251 on 16/12/2018 at 23:10 21st International Conference on Computing in High Energy and Nuclear Physics (CHEP2015) IOP Publishing Journal of Physics: Conference Series 664 (2015) 032035 doi:10.1088/1742-6596/664/3/032035 Exploiting volatile opportunistic computing resources with Lobster Anna Woodard, Matthias Wolf, Charles Mueller, Ben Tovar, Patrick Donnelly, Kenyi Hurtado Anampa, Paul Brenner, Kevin Lannon, Mike Hildreth, Douglas Thain University of Notre Dame, Notre Dame, IN 46556, USA E-mail: fawoodard|
[email protected] Abstract. Analysis of high energy physics experiments using the Compact Muon Solenoid (CMS) at the Large Hadron Collider (LHC) can be limited by availability of computing resources. As a joint effort involving computer scientists and CMS physicists at Notre Dame, we have developed an opportunistic workflow management tool, Lobster, to harvest available cycles from university campus computing pools. Lobster consists of a management server, file server, and worker processes which can be submitted to any available computing resource without requiring root access. Lobster makes use of the Work Queue system to perform task management, while the CMS specific software environment is provided via CVMFS and Parrot.