Atlasedinburghgroup

AtlasEdinburghGroup < Main < TWiki

ATLAS Edinburgh Group

Logistics Research Calendar Group Members Getting Started Software Position Name Local Software Academic PhilipClark Tips and Tricks • Core Academic ChristosLeonidopoulos Mailing List Simulation Academic VictoriaMartin Manpower • Upgrade Academic Sinead Farrington Administration Simulation Edinburgh Trac • Distributed Academic YanyanGao Group Meetings Computing Research StephanEisenhardt Calendar • Upgrade Associate Grid Guide Software Research RobertHarrington Edinburgh shifts • HLT Associate Travel (claims) Senior David CorrinneMills WP8 Hardware Gilmour Bequest WP9 Fellow Institute Reviews • Hardware Research BenSmart Covid19 WFH tips Upgrade Associate • Inner Research BenjaminWynne Detector Associate • Tracker Research AndrewWashbrook Upgrade Associate Engineer GeorgiosSidiropoulos Physics Technician JonWebster PhD student (4th FranciscaGaray • Event Y) Generators PhD student (4th TimBristow • UnderlyingEvent Y) • VH (H->bb) PhD student (4th PaulGlaysher • H->ZZ* (4l) Y) • Exotic Searches PhD student (4th SebastianOlivares • Literature for Y) new Students PhD student (2nd XantheHoad • Upgrade Y) Physics PhD student (1st AndreasSogaard Studies Y) • Run2 PhD student (2nd AlanTaylor Physics Y) Planning

Fun

• Edinburgh Recommendations

ATLAS Edinburgh Group 1 AtlasEdinburghGroup < Main < TWiki

Entrance Service Work CERN Accomodation

Latest Changes

AtlasEdinburghDockerGuide BenjaminWynne 2021-04-21 - 18:39 TWeederTopics AlbertoMengoni 2021-03-04 - 13:35 AtlasEdinburghGroup YanyanGao 2021-01-22 - 18:08 AtlasEdinburghShifts MaximKonyushikhin 2020-06-18 - 14:30 AtlasEdinburghCovidWFH BenjaminWynne 2020-03-20 - 14:28

This topic: Main > AtlasEdinburghGroup Topic revision: r99 - 2021-01-22 - YanyanGao

Please put helpful ideas or requests for ideas here The VPN is slow, please help

If all you want inside the VPN is to ssh to another machine, you can connect to the PPE gateway machine using ssh instead: ssh -Y [email protected]

From there just ssh to another machine as normal, including to your desktop machine if you know its name. ECDF should be available, and LXPLUS may work better this way. You should also be able to access all of our disk space.

Please don't run code on the gateway itself. How do I keep my ssh session running?

If you have a patchy connection and need to keep some program running on a remote machine, I suggest you ssh to the PPE gateway (see above) and then start a screen session: just type screen

This will give you a fresh terminal, from which you can connect to the machine you want to run your code (remember not to run anything on the gateway itself.

To suspend the session press CTRL+A and then CTRL+D. Not those three buttons simultaneously, but CTRL+A first, and then CTRL+D.

You can now disconnect from the PPE gateway and go about your merry life. When you want to reconnect to your session go back to the gateway and type screen -r

To terminate a screen session type CTRL+D.

Fun 2 AtlasEdinburghGroup < Main < TWiki You can have multiple suspended screen sessions at once, but the management gets irritating fast. I suggest you just have one at a time, or investigate the documentation to learn more.

PRO TIP: screen doesn't save terminal output nicely, so make sure to send verbose program output to a logfile.

-- BenjaminWynne - 2020-03-20

This topic: Main > AtlasEdinburghCovidWFH Topic revision: r1 - 2020-03-20 - BenjaminWynne

Please put helpful ideas or requests for ideas here The VPN is slow, please help

If all you want inside the VPN is to ssh to another machine, you can connect to the PPE gateway machine using ssh instead: ssh -Y [email protected]

Please don't run code on the gateway itself. How do I keep my ssh session running?

If you have a patchy connection and need to keep some program running on a remote machine, I suggest you ssh to the PPE gateway (see above) and then start a screen session: just type screen

This will give you a fresh terminal, from which you can connect to the machine you want to run your code (remember not to run anything on the gateway itself.

To suspend the session press CTRL+A and then CTRL+D. Not those three buttons simultaneously, but CTRL+A first, and then CTRL+D.

You can now disconnect from the PPE gateway and go about your merry life. When you want to reconnect to your session go back to the gateway and type screen -r

To terminate a screen session type CTRL+D.

You can have multiple suspended screen sessions at once, but the management gets irritating fast. I suggest you just have one at a time, or investigate the documentation to learn more.

PRO TIP: screen doesn't save terminal output nicely, so make sure to send verbose program output to a logfile.

How do I keep my ssh session running? 3 AtlasEdinburghGroup < Main < TWiki -- BenjaminWynne - 2020-03-20

This topic: Main > AtlasEdinburghCovidWFH Topic revision: r1 - 2020-03-20 - BenjaminWynne

It's been a long time coming, but there's now a neat copy of my Centos7 container https://github.com/DruidFish/docker-cvmfs-athena

Old version below

So, you thought you should try out Docker

Yep, me too. It's buzz-wordy software and you don't want to be an old stick-in-the mud, right? It's a way to get a particular software environment set up quickly, and it's not clunky like a Virtual Machine, so you reckoned you could use it to run software on your own machine rather than dealing with LXPLUS or whatever.

Good news! It works! And I wrote a quick guide on how to use it, so you don't have to work this out for yourself.

Just tell me what to do already

OK, here's the zero-explanation recipe. First you'll have to install Docker. For me (using Ubuntu) this was just sudo apt install docker.io

But obviously this part will vary depending on your Operating System. The official guide is here

Now you need to start a Docker container. We want the CERN SLC6 environment, like you get on LXPLUS: docker pull cern/slc6-base mkdir MyDockerTest cd MyDockerTest mkdir workdir docker run --privileged -i -t -v $PWD/workdir:/workdir cern/slc6-base /bin/bash

You might need to run the Docker commands as root (i.e. sudo docker whatever).

Good news: now you're in a Docker container, as the root user, and it's pretending to be SLC6. Bad news: most of the software you want isn't there. Docker is lightweight because it comes with the bare minimum of things. First we need CVMFS, the networked filesystem that provides most of our software. The following assumes you work on ATLAS: yum install https://ecsft.cern.ch/dist/cvmfs/cvmfs-release/cvmfs-release-latest.noarch.rpm yum install cvmfs cvmfs-config-default yum install gcc.x86_64 echo 'CVMFS_REPOSITORIES=atlas.cern.ch,atlas-condb.cern.ch,grid.cern.ch,atlas-nightlies.cern.ch,sft.cern.ch' > /etc/cvmfs/default.local echo 'CVMFS_HTTP_PROXY="DIRECT"' >> /etc/cvmfs/default.local cvmfs_config setup cvmfs_config probe

How do I keep my ssh session running? 4 AtlasEdinburghGroup < Main < TWiki Assuming you got an "OK" message at the end of each of the CVMFS tests you're good to go! Set up your software environment as if you were on LXPLUS: export ATLAS_LOCAL_ROOT_BASE=/cvmfs/atlas.cern.ch/repo/ATLASLocalRootBase source $ATLAS_LOCAL_ROOT_BASE/user/atlasLocalSetup.sh

For LHCb you'll need to do this last part differently, obviously, as well as putting some different CVMFS repositories into your setup earlier. Also note that ATLAS software seems to need a local version of GCC as well as the one from CVMFS, so I installed that in the earlier section too.

How do I keep my shiny new container?

Docker has "images" that define an operating system or software environment, and "containers" that are one running copy of a particular image. While your container is running, open a new terminal on your host machine and try this: docker container ls

Again, you might need to try "sudo docker" instead.

Which will hopefully give you a result like this

CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES bb169f195cdc cern/slc6-base "/bin/bash" About an hour ago Up 9 minutes boring_hopper

The name at the end is the interesting part: it's a random name for the container you just made. Make a note of it! Mine is "boring_hopper" but yours will be something else.

You can now quit your running container with "exit" as though it was an SSH session, and restart it with docker start -ai boring_hopper

With your own container name instead of "boring_hopper".

I re-run the cvmfs_config commands (setup and probe) from earlier each time I restart my container, but I get the feeling it's not necessary.

Is that everything?

Hell no. There's a huge amount of functionality here that I haven't even looked at. A big part of Docker is the website DockerHub which is where you got your SLC6 environment from earlier. You can download different images, upload your own creations, and there's lots of other stuff too. Have fun!

One thing you might have noticed earlier is that I made a directory called "workdir" that exists on your host machine, but is mounted in your Docker container as "/workdir". I like to do all my work in this folder so I can access any code bits I want from the host machine later.

Missing Docker software

Try this if needed yum install zlib zlib-devel uuid uuid-devel freetype

I actually had to copy libuuid and uuid.h from LXPLUS, since the versions I got from yum weren't compatible with Gaudi.

Just tell me what to do already 5 AtlasEdinburghGroup < Main < TWiki Recently when building the whole of Athena, I also found that I needed yum install mesa-libGL-devel libxml2-devel patch

-- BenjaminWynne - 2017-11-01

This topic: Main > AtlasEdinburghDockerGuide Topic revision: r6 - 2021-04-21 - BenjaminWynne

It's been a long time coming, but there's now a neat copy of my Centos7 container https://github.com/DruidFish/docker-cvmfs-athena

Old version below

So, you thought you should try out Docker

Good news! It works! And I wrote a quick guide on how to use it, so you don't have to work this out for yourself.

Just tell me what to do already

OK, here's the zero-explanation recipe. First you'll have to install Docker. For me (using Ubuntu) this was just sudo apt install docker.io

But obviously this part will vary depending on your Operating System. The official guide is here

You might need to run the Docker commands as root (i.e. sudo docker whatever).

Missing Docker software 6 AtlasEdinburghGroup < Main < TWiki echo 'CVMFS_HTTP_PROXY="DIRECT"' >> /etc/cvmfs/default.local cvmfs_config setup cvmfs_config probe

Assuming you got an "OK" message at the end of each of the CVMFS tests you're good to go! Set up your software environment as if you were on LXPLUS: export ATLAS_LOCAL_ROOT_BASE=/cvmfs/atlas.cern.ch/repo/ATLASLocalRootBase source $ATLAS_LOCAL_ROOT_BASE/user/atlasLocalSetup.sh

How do I keep my shiny new container?

Again, you might need to try "sudo docker" instead.

Which will hopefully give you a result like this

CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES bb169f195cdc cern/slc6-base "/bin/bash" About an hour ago Up 9 minutes boring_hopper

The name at the end is the interesting part: it's a random name for the container you just made. Make a note of it! Mine is "boring_hopper" but yours will be something else.

You can now quit your running container with "exit" as though it was an SSH session, and restart it with docker start -ai boring_hopper

With your own container name instead of "boring_hopper".

I re-run the cvmfs_config commands (setup and probe) from earlier each time I restart my container, but I get the feeling it's not necessary.

Is that everything?

Missing Docker software

Try this if needed yum install zlib zlib-devel uuid uuid-devel freetype

Just tell me what to do already 7 AtlasEdinburghGroup < Main < TWiki I actually had to copy libuuid and uuid.h from LXPLUS, since the versions I got from yum weren't compatible with Gaudi.

Recently when building the whole of Athena, I also found that I needed yum install mesa-libGL-devel libxml2-devel patch

-- BenjaminWynne - 2017-11-01

This topic: Main > AtlasEdinburghDockerGuide Topic revision: r6 - 2021-04-21 - BenjaminWynne

This document is an attempt to help you understand what the Grid is and how to use it. It will not tell you how to do anything specifically, but I aim to give you some sense of direction so that you can start to find your own solutions.

I will not:

• Provide "recipes". There are hundreds of these already. Most of these are out of date, and none of them will help you understand what you are doing. • Attempt to be comprehensive. If a useful tutorial for a piece of software exists I will link to it, not replicate it. • Claim to know all the answers. These are the few useful pieces of information I have gleaned in 18 months of frustration.

I assume:

• You have an lxplus account, accessed via ssh. Unless I state otherwise, and code I include is to be used in this manner, and may not work otherwise. • You have a Grid certificate installed in your LXPLUS account. • Your Grid certificate is registered with the ATLAS virtual organisation.

This is a work in progress. What is the Grid for?

The Grid is required to store the vast amount of data produced by the LHC experiments - this much is obvious. The important point is how you interact with this data: the Grid is not there to move data to your analysis, the Grid is there to move your analysis to the data. Consequently, any use of the Grid can be reduced to two fundamental steps:

• Finding the data you want. • Sending your analysis to the data.

The software that sends your analysis to the data may incorporate finding the data first. Once your analysis has completed, its output will also be stored on the Grid.

Missing Docker software 8 AtlasEdinburghGroup < Main < TWiki Exploring the Grid

The computers that make up the Grid are spread over many countries. Ideally this would only be a curiousity - unfortunately this means that different Grid computers tend to behave in different ways. The only advice I can give is to try and design your analysis to be flexible about the environment that it is run in, or failing that to know precisely what it is that your analysis depends upon, and check that it is there.

Data is stored on the grid in data sets (i.e. folders) containing data files with some common origin or purpose. These files are primarily in ROOT format. The only tool you really need for finding and examining data sets is DQ2. On LXPLUS it is set up as follows:

This sets up your basic grid environment source /afs/cern.ch/project/gd/LCG-share/current/etc/profile.d/grid_env.sh

This sets up DQ2 source /afs/cern.ch/atlas/offline/external/GRID/ddm/DQ2Clients/setup.sh

This will create a temporary encrypted token (called a Grid proxy) allowing you to access the Grid. It will require you to type in the password you used when setting up your Grid certificate. voms-proxy-init -voms atlas

Now you have access to useful DQ2 commands such as:

• Search for data sets with

dq2-ls "Pattern to search for" • Find where a data set is stored with

dq2-ls -r "Data set name" • Download a data set with

dq2-get "Data set name" • Click here for more information

Note that dq2-get should be used with some thought. As stated above, the purpose of the grid is to move your analysis to the data, not the data to your analysis. Conseqently you should only really download a data set if it contains the output of your analysis, or if (for whatever reason) you don't want to run your analysis on the Grid. This is understandable given the difficulty of using the Grid! Using the Grid

Physics analysis software

Before tackling the topic of using the Grid, it is worth mentioning two pieces of software that will be relevant to your analysis.

ROOT

Exploring the Grid 9 AtlasEdinburghGroup < Main < TWiki analysis. When used as a simple library in this way, ROOT is extremely useful. However ROOT has many quirks, most obviously in the user interface called CINT. This interprets syntax very similar to C++, and so can run programs using the ROOT library. It may seem tempting to use CINT to run analysis code but it is almost certainly a bad idea, as the restrictions and strange behaviour of this interpreter will make all but the simplest tasks very frustrating.

Do:

• Use ROOT libraries linked to your analysis code. • Refer to the reasonably good documentation - simply Google search for the name of a ROOT class to bring up the appropriate page. • Use the TBrowser object to explore .root files.

Don't:

• Write code to run in CINT.

ATHENA

ATHENA comprises the bulk of ATLAS analysis software. It contains methods for generating simulated data and for reconstructing the properties of particles from data, as well providing tools for performing your analysis. However, if ROOT is quirky and occasionally frustrating, ATHENA is a nightmare. Development is (at the moment) very fast, and code that worked with one version of the framework may well not work with newer versions, or may work differently. Consequently at Grid sites there are many versions of ATHENA available, and you should specify the version you require. To make things worse, different Grid sites have different versions available, and if you need a very new or very old version you are probably out of luck.

While ATHENA should be the tool for use in all analyses, I have had no success with it on the Grid, and so can offer no help at this time.

Running your analysis on the Grid

There are many tools to help you do this, some are very complex, some are unreliable, some simply awkward. However, there is a tool called PANDA that I (and others) have found both intuitive and reliable. To set up PANDA on LXPLUS run the following (first you probably need to have set up the Grid environment and created a Grid proxy as described above): source /afs/cern.ch/atlas/offline/external/GRID/DA/panda-client/latest/etc/panda/panda_setup.sh

There are two aspects to PANDA:

PANDA without ATHENA

If your analysis does not require ATHENA (and the associated headaches) then the command "prun" is perfect for you. It will find the input data set(s) you specify, move your analysis code to the Grid site where the data is stored, compile your code, run it, and then store the output on the Grid. All your code needs to do is accept a comma-separated list of the names of files in the data set. It took me less than a day to have this command running to my satisfaction, and I need do little more than direct you to the excellent tutorial page.

PANDA with ATHENA

The command "pathena" can in theory be used instead of "athena" in most situations, running the job on the Grid instead of locally. I have not tested this, although I have heard many encouraging things about it.

ROOT 10 AtlasEdinburghGroup < Main < TWiki -- BenjaminWynne - 16-Mar-2010

This topic: Main > AtlasEdinburghGridGuide Topic revision: r1 - 2010-03-17 - BenjaminWynne

I will not:

I assume:

This is a work in progress. What is the Grid for?

• Finding the data you want. • Sending your analysis to the data.

The software that sends your analysis to the data may incorporate finding the data first. Once your analysis has completed, its output will also be stored on the Grid. Exploring the Grid

PANDA with ATHENA 11 AtlasEdinburghGroup < Main < TWiki Data is stored on the grid in data sets (i.e. folders) containing data files with some common origin or purpose. These files are primarily in ROOT format. The only tool you really need for finding and examining data sets is DQ2. On LXPLUS it is set up as follows:

This sets up your basic grid environment source /afs/cern.ch/project/gd/LCG-share/current/etc/profile.d/grid_env.sh

This sets up DQ2 source /afs/cern.ch/atlas/offline/external/GRID/ddm/DQ2Clients/setup.sh

Now you have access to useful DQ2 commands such as:

• Search for data sets with

dq2-ls "Pattern to search for" • Find where a data set is stored with

dq2-ls -r "Data set name" • Download a data set with

dq2-get "Data set name" • Click here for more information

Physics analysis software

Before tackling the topic of using the Grid, it is worth mentioning two pieces of software that will be relevant to your analysis.

ROOT

Most data on the Grid is stored in the ROOT file format, and within these files as tables of data (TNtuples) and histograms (TH1 and derived classes). ROOT provides software libraries to create and access these files and the objects within them, as well as a vast number of statistical functions and methods of numerical analysis. When used as a simple library in this way, ROOT is extremely useful. However ROOT has many quirks, most obviously in the user interface called CINT. This interprets syntax very similar to C++, and so can run programs using the ROOT library. It may seem tempting to use CINT to run analysis code but it is almost certainly a bad idea, as the restrictions and strange behaviour of this interpreter will make all but the simplest tasks very frustrating.

Do:

Exploring the Grid 12 AtlasEdinburghGroup < Main < TWiki

Don't:

• Write code to run in CINT.

ATHENA

While ATHENA should be the tool for use in all analyses, I have had no success with it on the Grid, and so can offer no help at this time.

Running your analysis on the Grid

There are two aspects to PANDA:

PANDA without ATHENA

PANDA with ATHENA

-- BenjaminWynne - 16-Mar-2010

This topic: Main > AtlasEdinburghGridGuide Topic revision: r1 - 2010-03-17 - BenjaminWynne

ROOT 13 AtlasEdinburghGroup < Main < TWiki Edinburgh Group Administration

Here's who has overall responsible for the different areas we are working on. Names in brackets have secondary responsibility.

Physics and Operations

• H-->bb: Victoria, Wahid (Phil) • H-->4l: Phil, Robert (Christos) • HLT: Victoria • L1Track: Christos • Pixel Hardware: Stephan (Andreas K) • Simulation: Phil • Generators: Andy B • Distributed Computing: Wahid • Future Computing: ?

Administration

• Travel Claims: Victoria (Phil) • PhD students: their supervisor (Victoria for general issues) • MPhys students: their supervisor (Victoria for general issues) • Shifts: Victoria (Phil) • New staff recruitment: Christos • Student requirement: Victoria • CERN specific issues: Phil

-- VictoriaMartin - 31-Oct-2012

This topic: Main > AtlasEdinburghGroupAdministration Topic revision: r2 - 2012-11-01 - VictoriaMartin

Here's who has overall responsible for the different areas we are working on. Names in brackets have secondary responsibility.

Physics and Operations

Edinburgh Group Administration 14 AtlasEdinburghGroup < Main < TWiki

Administration

-- VictoriaMartin - 31-Oct-2012

This topic: Main > AtlasEdinburghGroupAdministration Topic revision: r2 - 2012-11-01 - VictoriaMartin

CERN Accomodation

This topic: Main > AtlasEdinburghGroupCalendar Topic revision: r5 - 2011-06-01 - KarolineSelbach

CERN Accomodation

This topic: Main > AtlasEdinburghGroupCalendar Topic revision: r5 - 2011-06-01 - KarolineSelbach

ATLAS simulation mailing lists (e-groups)

• ATLAS simulation e-group forums

ATLAS simulation meetings

• Simulation meetings

ATLAS simulation TWiki page

• AtlasSimulation

Zach Marshall's Twiki page

• ZacharyMarshall

Administration 15 AtlasEdinburghGroup < Main < TWiki

Tracking of particles in Electromagnetic Field -- JamesHenderson

Tracking of particles in Electromagnetic Field

Geant4 Links

CUDA and parallisation Links

Geant4 Volume Studies -- Ben Jones

Muon mass studies with Geant4

Stepper Dispatcher work

Atlas.G4StepperDispatcher

Useful Talks

Simulation Performance -- Zach Marshall (open EB 17/09/09)

-- PhilipClark - 2009-09-22

This topic: Main > AtlasEdinburghGroupCoreSimulation Topic revision: r5 - 2010-07-30 - JamesHenderson

• NVIDIA's CUDA training page

• Illinois University Parallel Course

This university course link has some very helpful video lectures, linked in 'Syllabus/ Lectures' and under 'Materials'.

• NVIDIA's Online Seminars Page Previously recorded seminars can be found at the bottom of the page.

• Italian GPU HPC course suggested by Gene Cooperman

• OpenCL Video Lectures As far as I can tell, to date OpenCL only runs on Apple Macs as it was developed by Apple.

• Advice on integrating C++ with CUDA

• CuPP Home Page - Framework for C++/CUDA integration

• Jens Breitbart paper on CuPP

-- JamesHenderson - 30-Jul-2010

This topic: Main > AtlasEdinburghGroupTPCudaLinks Topic revision: r2 - 2010-08-09 - JamesHenderson

Tracking of particles in Electromagnetic Field -- JamesHenderson 16 AtlasEdinburghGroup < Main < TWiki

• NVIDIA's CUDA training page

• Illinois University Parallel Course

This university course link has some very helpful video lectures, linked in 'Syllabus/ Lectures' and under 'Materials'.

• NVIDIA's Online Seminars Page Previously recorded seminars can be found at the bottom of the page.

• Italian GPU HPC course suggested by Gene Cooperman

• OpenCL Video Lectures As far as I can tell, to date OpenCL only runs on Apple Macs as it was developed by Apple.

• Advice on integrating C++ with CUDA

• CuPP Home Page - Framework for C++/CUDA integration

• Jens Breitbart paper on CuPP

-- JamesHenderson - 30-Jul-2010

This topic: Main > AtlasEdinburghGroupTPCudaLinks Topic revision: r2 - 2010-08-09 - JamesHenderson

• Geant4 Home Page

• G4 Tutorials

• G4 Source Code Browser

• ParGeant4 Home Page - Parallel Geant4 Version make by Gene Cooperman (Institute for Complex Scientific Software)

• CERN's ParGeant4 page - clear explaination

• Mixing C and C++ - useful for combining G4 (C++) and CUDA (C)

• G4 (4.9.3.p01) Directory Reference

• G4 Application Developers User Guide

Useful Talks 17 AtlasEdinburghGroup < Main < TWiki

• G4 Software Reference Manual

-- JamesHenderson - 30-Jul-2010

This topic: Main > AtlasEdinburghGroupTPGeant4Links Topic revision: r2 - 2010-08-09 - JamesHenderson

• Geant4 Home Page

• G4 Tutorials

• G4 Source Code Browser

• ParGeant4 Home Page - Parallel Geant4 Version make by Gene Cooperman (Institute for Complex Scientific Software)

• CERN's ParGeant4 page - clear explaination

• Mixing C and C++ - useful for combining G4 (C++) and CUDA (C)

• G4 (4.9.3.p01) Directory Reference

• G4 Application Developers User Guide

• G4 Software Reference Manual

-- JamesHenderson - 30-Jul-2010

This topic: Main > AtlasEdinburghGroupTPGeant4Links Topic revision: r2 - 2010-08-09 - JamesHenderson

- Numerical Recipes in C

- Will Hossack's Java example page including Runge-Kutta integrator examples

List

Schedule for next 2 weeks (30/07 - 14/08)

• Read around and understand Runge-Kutta 4 (RK4) integration method and its computational implementation.

Useful resources 18 AtlasEdinburghGroup < Main < TWiki 1. Consider attempt to integrate a self-regulating stepsize control into RK4 functions. eg. Variable stepsize depending on difference between k2 and k3 (2nd and 3rd gradients calculated). 2. Adaptive step-size achieved through error analysis during RK4 loop

• Research and work through Electromagnetic equation of motion involving RK4 method. • Understand RK4 in reference to a parabolic path. • Understand errors in all of above (accuracy of method). • Write and run through C++ program showing electron trajectory in simple EM field.

1. C++ RK4 integrator up and running using Lorentz differential equation to track particle in EM field. Seems to be accurate to 0.07% in 14 million steps.

• Create simple EM field Geant4 example in vacumn (or very low density gas) and run electrons through it to compare trajectories with previous C++ code. • Port current C++ RK4 version to CUDA.

1. Above involves deciding how to change RK4 algorithm to parallel, what to put in CUDA kernal. 2. Investigate speed ups from port.

• Fully understand G4ClassicalRK4 and G4ConstRK4 and Richardson Extrapolation error correction method in G4MagErrorStepper, as well as ( 1 << IntegrationOrder()) section in MagErrorStepper (possible bitwise operator?) • Investigate and understand Nystrom RK4 method for time indep fields and read ATLAS paper on Nystrom method.

-- PhilipClark - 30-Jul-2010

This topic: Main > AtlasEdinburghGroupTrackingParticles Topic revision: r7 - 2010-11-11 - MatthiasStein

- Numerical Recipes in C

- Will Hossack's Java example page including Runge-Kutta integrator examples

List

Schedule for next 2 weeks (30/07 - 14/08)

• Read around and understand Runge-Kutta 4 (RK4) integration method and its computational implementation.

1. Consider attempt to integrate a self-regulating stepsize control into RK4 functions. eg. Variable stepsize depending on difference between k2 and k3 (2nd and 3rd gradients calculated). 2. Adaptive step-size achieved through error analysis during RK4 loop

• Research and work through Electromagnetic equation of motion involving RK4 method. • Understand RK4 in reference to a parabolic path. • Understand errors in all of above (accuracy of method).

Schedule for next 2 weeks (30/07 - 14/08) 19 AtlasEdinburghGroup < Main < TWiki

• Write and run through C++ program showing electron trajectory in simple EM field.

1. C++ RK4 integrator up and running using Lorentz differential equation to track particle in EM field. Seems to be accurate to 0.07% in 14 million steps.

• Create simple EM field Geant4 example in vacumn (or very low density gas) and run electrons through it to compare trajectories with previous C++ code. • Port current C++ RK4 version to CUDA.

1. Above involves deciding how to change RK4 algorithm to parallel, what to put in CUDA kernal. 2. Investigate speed ups from port.

-- PhilipClark - 30-Jul-2010

This topic: Main > AtlasEdinburghGroupTrackingParticles Topic revision: r7 - 2010-11-11 - MatthiasStein

ATLAS simulation mailing lists (e-groups)

• ATLAS simulation e-group forums

ATLAS simulation meetings

• Simulation meetings

ATLAS simulation TWiki page

• AtlasSimulation

Zach Marshall's Twiki page

• ZacharyMarshall

Tracking of particles in Electromagnetic Field -- JamesHenderson

Tracking of particles in Electromagnetic Field

Geant4 Links

CUDA and parallisation Links

Schedule for next 2 weeks (30/07 - 14/08) 20 AtlasEdinburghGroup < Main < TWiki

Geant4 Volume Studies -- Ben Jones

Muon mass studies with Geant4

Stepper Dispatcher work

Atlas.G4StepperDispatcher

Useful Talks

Simulation Performance -- Zach Marshall (open EB 17/09/09)

-- PhilipClark - 2009-09-22

This topic: Main > AtlasEdinburghGroupCoreSimulation Topic revision: r5 - 2010-07-30 - JamesHenderson

• NVIDIA's CUDA training page

• Illinois University Parallel Course

This university course link has some very helpful video lectures, linked in 'Syllabus/ Lectures' and under 'Materials'.

• NVIDIA's Online Seminars Page Previously recorded seminars can be found at the bottom of the page.

• Italian GPU HPC course suggested by Gene Cooperman

• OpenCL Video Lectures As far as I can tell, to date OpenCL only runs on Apple Macs as it was developed by Apple.

• Advice on integrating C++ with CUDA

• CuPP Home Page - Framework for C++/CUDA integration

• Jens Breitbart paper on CuPP

-- JamesHenderson - 30-Jul-2010

This topic: Main > AtlasEdinburghGroupTPCudaLinks Topic revision: r2 - 2010-08-09 - JamesHenderson

• NVIDIA's CUDA training page

Geant4 Volume Studies -- Ben Jones 21 AtlasEdinburghGroup < Main < TWiki

• Illinois University Parallel Course

This university course link has some very helpful video lectures, linked in 'Syllabus/ Lectures' and under 'Materials'.

• NVIDIA's Online Seminars Page Previously recorded seminars can be found at the bottom of the page.

• Italian GPU HPC course suggested by Gene Cooperman

• OpenCL Video Lectures As far as I can tell, to date OpenCL only runs on Apple Macs as it was developed by Apple.

• Advice on integrating C++ with CUDA

• CuPP Home Page - Framework for C++/CUDA integration

• Jens Breitbart paper on CuPP

-- JamesHenderson - 30-Jul-2010

This topic: Main > AtlasEdinburghGroupTPCudaLinks Topic revision: r2 - 2010-08-09 - JamesHenderson

• Geant4 Home Page

• G4 Tutorials

• G4 Source Code Browser

• ParGeant4 Home Page - Parallel Geant4 Version make by Gene Cooperman (Institute for Complex Scientific Software)

• CERN's ParGeant4 page - clear explaination

• Mixing C and C++ - useful for combining G4 (C++) and CUDA (C)

• G4 (4.9.3.p01) Directory Reference

• G4 Application Developers User Guide

• G4 Software Reference Manual

-- JamesHenderson - 30-Jul-2010

This topic: Main > AtlasEdinburghGroupTPGeant4Links Topic revision: r2 - 2010-08-09 - JamesHenderson

Useful Talks 22 AtlasEdinburghGroup < Main < TWiki

• Geant4 Home Page

• G4 Tutorials

• G4 Source Code Browser

• ParGeant4 Home Page - Parallel Geant4 Version make by Gene Cooperman (Institute for Complex Scientific Software)

• CERN's ParGeant4 page - clear explaination

• Mixing C and C++ - useful for combining G4 (C++) and CUDA (C)

• G4 (4.9.3.p01) Directory Reference

• G4 Application Developers User Guide

• G4 Software Reference Manual

-- JamesHenderson - 30-Jul-2010

This topic: Main > AtlasEdinburghGroupTPGeant4Links Topic revision: r2 - 2010-08-09 - JamesHenderson

- Numerical Recipes in C

- Will Hossack's Java example page including Runge-Kutta integrator examples

List

Schedule for next 2 weeks (30/07 - 14/08)

• Read around and understand Runge-Kutta 4 (RK4) integration method and its computational implementation.

Useful resources 23 AtlasEdinburghGroup < Main < TWiki 1. C++ RK4 integrator up and running using Lorentz differential equation to track particle in EM field. Seems to be accurate to 0.07% in 14 million steps.

• Create simple EM field Geant4 example in vacumn (or very low density gas) and run electrons through it to compare trajectories with previous C++ code. • Port current C++ RK4 version to CUDA.

1. Above involves deciding how to change RK4 algorithm to parallel, what to put in CUDA kernal. 2. Investigate speed ups from port.

-- PhilipClark - 30-Jul-2010

This topic: Main > AtlasEdinburghGroupTrackingParticles Topic revision: r7 - 2010-11-11 - MatthiasStein

- Numerical Recipes in C

- Will Hossack's Java example page including Runge-Kutta integrator examples

List

Schedule for next 2 weeks (30/07 - 14/08)

• Read around and understand Runge-Kutta 4 (RK4) integration method and its computational implementation.

1. C++ RK4 integrator up and running using Lorentz differential equation to track particle in EM field. Seems to be accurate to 0.07% in 14 million steps.

• Create simple EM field Geant4 example in vacumn (or very low density gas) and run electrons through it to compare trajectories with previous C++ code. • Port current C++ RK4 version to CUDA.

Schedule for next 2 weeks (30/07 - 14/08) 24 AtlasEdinburghGroup < Main < TWiki 1. Above involves deciding how to change RK4 algorithm to parallel, what to put in CUDA kernal. 2. Investigate speed ups from port.

-- PhilipClark - 30-Jul-2010

This topic: Main > AtlasEdinburghGroupTrackingParticles Topic revision: r7 - 2010-11-11 - MatthiasStein

The Edinburgh group's work on Atlas Distributed Computing has so far focused in three areas:

1. Supporting sites involved in DDM with a focus on UK and /or DPM centres.

We have built expertise in the widely used storage resource (SRM) solution DPM and used this to support sites in the UK through UK (GridPP) wiki pages and discussion forums. In addition we are developing and maintaining dpm tools to assist sites in supporting ATLAS specific requirements, such as a recent tool to replicate files within the new ATLASHOTDISK spacetoken, and ongoing work to determine missing or corrupted files within ATLAS spacetokens at DPM sites. We are also building capacity within the UK to support the alternative SRM StoRM. Other work in this area included supporting the development of tools to check file integrity - including the checksums of ATLAS data at UK Tier 2 sites.

2. Developing monitoring tools for DDM monitoring

Edinburgh have begun working within the DDM dashboard "sandbox" to develop new plots to aid DDM operations. It is expected that these will be integrated into existing plans for DDM monitoring development .

3. Supporting general ADC operations through shifts and other distributed production support.

Members of the group are undertaking ADCoS shifts - now as "senior" shifters. We expect, through experience gained, that we will play a significant role in supporting ADC operations in the future either as ADCoS "experts" or through direct support to sites in, for example, optimising their storage systems for ATLAS analysis. Useful Links

ADC Twiki page

HNT Operations

-- WahidBhimji - 2009-09-25

This topic: Main > AtlasEdinburghGroupDistributedComputing Topic revision: r3 - 2012-03-07 - AndrewWashbrook

Schedule for next 2 weeks (30/07 - 14/08) 25 AtlasEdinburghGroup < Main < TWiki

-- AndrewWashbrook - 07-Mar-2012

This topic: Main > AtlasEdinburghHNTOperations Topic revision: r1 - 2012-03-07 - AndrewWashbrook

-- AndrewWashbrook - 07-Mar-2012

This topic: Main > AtlasEdinburghHNTOperations Topic revision: r1 - 2012-03-07 - AndrewWashbrook

The Edinburgh group's work on Atlas Distributed Computing has so far focused in three areas:

1. Supporting sites involved in DDM with a focus on UK and /or DPM centres.

2. Developing monitoring tools for DDM monitoring

3. Supporting general ADC operations through shifts and other distributed production support.

ADC Twiki page

Useful Links 26 AtlasEdinburghGroup < Main < TWiki HNT Operations

-- WahidBhimji - 2009-09-25

This topic: Main > AtlasEdinburghGroupDistributedComputing Topic revision: r3 - 2012-03-07 - AndrewWashbrook

-- AndrewWashbrook - 07-Mar-2012

This topic: Main > AtlasEdinburghHNTOperations Topic revision: r1 - 2012-03-07 - AndrewWashbrook

-- AndrewWashbrook - 07-Mar-2012

This topic: Main > AtlasEdinburghHNTOperations Topic revision: r1 - 2012-03-07 - AndrewWashbrook

Copyright &© 2008-2021 by the contributing authors. All material on this collaboration platform is the property of the contributing authors. or Ideas, requests, problems regarding TWiki? use Discourse or Send feedback Edinburgh Information, including pub and restaurant recommendations

A Map!

A Custom Google Map

Getting to, and around, Edinburgh

Getting to and from the Airport

Take the tram or Airlink number 100 bus from the airport. The tram stops on Princes Street and St Andrews Square. The bus terminates at Waverley Bridge, next to the Edinburgh Waverley train station. Check the current ticket prices here .

Taxis are also available and cost £20 - £25 to get to the city centre.

Arriving and leaving by train

All mainline trains arrive into Edinburgh Waverley.

Useful Links 27 AtlasEdinburghGroup < Main < TWiki

Local Buses and Trams

Transport for Edinburgh runs a comprehensive bus service around Edinburgh.

• Transport for Edinburgh operate a "flat fare" system - the same fare covers any distance (except on the Airlink airport bus service, and on the tram to the airport). • The current fare can be found here . • A day ticket is available, which is better value for money if you plan to make more than two trips in one day. • Tickets are available from the driver when boarding the bus or using the Transport for Edinburgh app . Note that no change is given when paying by cash, except on the Airlink service.

• Pollock halls is served by Lothian buses 2, 14, 30 and 33. Alight at "Royal Commonwealth Pool". Services leave from Princes Street and North Bridge. • Ten Hill place is served by Lothian buses 3, 5, 7, 8, 14, 29, 30, 31, 37 and 49. Alight at "Surgeons' Hall".

• Online Edinburgh bus tracker • Mobile online Edinburgh bus tracker

Walking

The central part of Edinburgh is very compact, and easily traversed on foot.

Apps

We find these apps useful!

• Lothian buses apps . One for the bus maps/times etc and one to buy bus tickets! • Edinbus - the orignal bus tracker for Apple • My Bus Edinburgh - the orignal bus tracker for Android • World Heritage City app • Edinburgh (not so) Secrets £1.49, but all good recommendations!

Eating and Drinking

We use The List a lot. Reviewers are not anonymous, but they do give good description of the establishment.

Pubs

Near Pollock Halls / Ten Hill place

Local Buses and Trams 28 AtlasEdinburghGroup < Main < TWiki

• Brew Dog name says it all! (YY) • Ushers great selection of draft beers and nice fish and chips (SO) • The Blind Poet Upstairs from Ushers, with lots of Open Mic nights including excellent monthly poetry (events calender on the website) (XH) • Boteco Great bar to dance senorita (AT)

Restaurants

• Budget-friendly recommendations from the Guardian. I've not tried them all, but the ones I have I like (VJM)

Near Appleton Tower

• Tanjore Small, budget-friendly South Indian (Tamil). Dosa for around £7. They have no licence, BYO wine and beer, no corkage. (VJM) • David Bann Edinburgh's best vegetarian resturant. Omnivore-friendly. (VJM) • The Tower in the National Museam of Scotland. £££ modern European. Booking essential. Seems to be the current favourite place of the Uni to celebrate Higgsteria. Also PPE Christmas dinner 2013! (VJM) • Spoon One of my favourite places in Edinburgh, but lots of people disagree with me ("food is a bit odd"). (VJM) • Mother India's Cafe Indian Tapas. The food is good, but personally I don't like the atmosphere. But don't listen to me, everyone else loves it! (VJM) • Howies The place we went for dinner during the Atlas UK Higgs meeting. European/Scottish (VJM) • Kalpna All-veggie Indian, a favourite of our theory colleagues. (VJM) • Vittoria The Standard Italian, friendly service, even for big groups (VJM) Definitely one of the best pizza places in town (CL) • Kim's mini meals, 5 Buccleuch St, Edinburgh EH8 9JN, One of the best korean restaurants, family run, no reservation, close at 8:30 (YY) • Cafe lucano , decent little italian restaurant, home-made pasta, best tiramisu in town (YY) • Tasty noodles, 36 Buccleuch St, Edinburgh, UK EH8 9LP, tiny Chinese restaurant, specialise in home-made noodles and dumplings (YY)

Near Pollock Halls / 10 Hill Place

• Blonde Small, but perfectly formed, slightly funky modern European near Pollock halls. Main courses about £14. (VJM) • Stac Polly Modern Scottish. There are two venues, the bistro of which is just around the corner from the Holyrood 9A pub. (BHS) • Kismot Trip Advisor's No. 1 UK Curry House 2013 . They do a wide selection of curry from mild to extremely hot (they have hospitalised people in the past), including some unusual options (Irn Bru'nha anyone?). (NE) • The Salisbury Arms Large but homely pub that does a great Sunday roast, and more (XH)

(Slightly) Further Afield

• The Witchery Multiple-award winning restaurant just in front of the castle. Booking essential. (BHS) • Wildfire Specialises in Scottish steak and seafood. Really fantastic steak, and if you phone about 3 or more days in advance they say they can get any size and any cut of meat you would like. Booking recommended. (BHS) • Hanams Kurdish and Middle Eastern. They have no licence, BYO wine and beer, no corkage. (VJM) • Steak Edinburgh . Three restaurants for meat-lovers (fancy steak, more affordable steak, and burgers). "Where beauty meats the beast" (CL)

Near Pollock Halls / Ten Hill place 29 AtlasEdinburghGroup < Main < TWiki

• Ghillie-Dhu . Restaurant/ pub that also has a ceilidh every Friday! (TMB) • El-Cartel One of the best mexican food place in town, fish taco! (YY) • Cafe Andaluz Good Tapas near prince street (YY)

Coffee

Near Appleton Tower

• Brew Lab , 6-8 South College Street . Different beans and different brewing methods; cake, pastries sandwiches; slightly student-y vibe. (VJM) • Press Coffee . Probably the closest good coffee place to Appleton Tower, popular with academics (VJM) • Kilimanjaro Run by the same guys as Press Coffee, same good coffee, more studenty-feel. En route between Pollock Halls and Appleton Tower.(VJM) • Hula Smoothies too! Very close to the Grassmarket Hotel (VJM)

Further Afield

• Wellington Coffee Run by the same guys as Press Coffee, best place for coffee when on Princes Street (VJM) • Artisan Roast IMHO Edinburgh's best coffee roaster. Very chilled out (VJM)

Whisky shopping

• Don't buy whisky at the airport, it'll be overpriced at best and disappointing most of the time • Go to WM Cadenhead near the bottom of the royal mile, and either pick something from the "big board" or just ask the big ginger guy what he's drinking and get that

Accommodation

• An interactive google map with hotels around the Pollocks Halls area • (Recommended:) The TripAdvisor page with all Edinburgh hotels ♦ If you are interested in B&B rooms or budget options (e.g. for students), make sure to check the accommodation options given by TripAdvisor on Minto St/A701 (click on "Open-Map" option).

...

This topic: Main > AtlasEdinburghGroupEdinburghRecommendations Topic revision: r31 - 2015-12-04 - BenjaminWynne

A Map!

A Custom Google Map

(Slightly) Further Afield 30 AtlasEdinburghGroup < Main < TWiki Getting to, and around, Edinburgh

Getting to and from the Airport

Taxis are also available and cost £20 - £25 to get to the city centre.

Arriving and leaving by train

All mainline trains arrive into Edinburgh Waverley.

Local Buses and Trams

Transport for Edinburgh runs a comprehensive bus service around Edinburgh.

• Online Edinburgh bus tracker • Mobile online Edinburgh bus tracker

Walking

The central part of Edinburgh is very compact, and easily traversed on foot.

Apps

We find these apps useful!

Eating and Drinking

We use The List a lot. Reviewers are not anonymous, but they do give good description of the establishment.

Getting to, and around, Edinburgh 31 AtlasEdinburghGroup < Main < TWiki Pubs

Near Pollock Halls / Ten Hill place

• The Old Bell • Cask and Barrell • The John Leslie • The Southern • The Auld Hoose - good ales, rock jukebox and for a tenner you can get the biggest bowl of nachos ever seem - feeds 3 super hungry people or 4-5 normal people. (NE) • Holyrood 9A (BHS) Also great selection of burgers - include 4 vegetarian options! (VJM) • The Bow Bar Big selection of real ale and single malts. No music. (VJM) • Royal Dick at Summerhall Fringe atmosphere, 365 days a year. Food too. Half way between Appleton Tower and Pollock Halls (VJM) • Pear Tree Bar Nice selection of beers (YY) • Brew Dog name says it all! (YY) • Ushers great selection of draft beers and nice fish and chips (SO) • The Blind Poet Upstairs from Ushers, with lots of Open Mic nights including excellent monthly poetry (events calender on the website) (XH) • Boteco Great bar to dance senorita (AT)

Restaurants

• Budget-friendly recommendations from the Guardian. I've not tried them all, but the ones I have I like (VJM)

Near Appleton Tower

Near Pollock Halls / 10 Hill Place

Pubs 32 AtlasEdinburghGroup < Main < TWiki

• Kismot Trip Advisor's No. 1 UK Curry House 2013 . They do a wide selection of curry from mild to extremely hot (they have hospitalised people in the past), including some unusual options (Irn Bru'nha anyone?). (NE) • The Salisbury Arms Large but homely pub that does a great Sunday roast, and more (XH)

(Slightly) Further Afield

Coffee

Near Appleton Tower

Further Afield

• Wellington Coffee Run by the same guys as Press Coffee, best place for coffee when on Princes Street (VJM) • Artisan Roast IMHO Edinburgh's best coffee roaster. Very chilled out (VJM)

Whisky shopping

Accommodation

...

Near Pollock Halls / 10 Hill Place 33 AtlasEdinburghGroup < Main < TWiki This topic: Main > AtlasEdinburghGroupEdinburghRecommendations Topic revision: r31 - 2015-12-04 - BenjaminWynne

We are involved in development, use and maintenance of event generators and related tools in Atlas. In particular...

Rivet MC validation tool

Rivet is a standalone library and command line program for generator-independent validation of simulated events against a large (and growing) number of historically important experimental analyses. Data is primarily supplied via direct export from the HepData database. Rivet is used by Atlas and generator authors for continuous validation of generator physics performance, and as part of the Professor and Atlas generator tuning programmes.

Herwig++ event generator

Herwig++ is the successor to the venerable HERWIG MC simulation programe. H++ is a globally improved version of HERWIG, including

• Improved parton shower • Much-improved hadron decays • Built-in QED radiation (cf. PHOTOS) and tau decays (cf. TAUOLA) • Built-in multiple partonic interactions model for underlying event (cf. JIMMY), plus hotspot and non-perturbative extension to allow UE simulation at min bias scales (< ~2 GeV) • Generalised new physics modelling (MSSM, UED and Randall-Sundrum models as standard) • POWHEG positive-weight NLO matrix element-parton shower matching for selected processes

We maintain the Athena interface to Herwig++, coordinate the various validation and tuning efforts within Atlas, and act as a contact point for Atlas members with H++ physics or technical questions.

Herwig++ NNLO studies - IanBruce

Herwig++ NNLO studies

Professor tuning framework

Professor is a system for tuning of event generator parameters (and other complex high-dimensional systems) based on deterministic fitting of bin-wise response functions to correlated changes in parameters. Professor tunes of Pythia 6 helped to drive the Atlas MC09 production tune, and are among the best-performing tunes of Pythia 6 for hadron collider processes from min bias to Drell-Yan, based on existing data. The current Pythia 6 default settings are based on Professor results. Professor is in use within Atlas for studies of early data MC retuning, among other uses.

-- AndyBuckley - 2009-09-30

This topic: Main > AtlasEdinburghGroupEventGenerators Topic revision: r2 - 2010-07-30 - PhilipClark

Accommodation 34 AtlasEdinburghGroup < Main < TWiki

We are involved in development, use and maintenance of event generators and related tools in Atlas. In particular...

Rivet MC validation tool

Herwig++ event generator

Herwig++ is the successor to the venerable HERWIG MC simulation programe. H++ is a globally improved version of HERWIG, including

We maintain the Athena interface to Herwig++, coordinate the various validation and tuning efforts within Atlas, and act as a contact point for Atlas members with H++ physics or technical questions.

Herwig++ NNLO studies - IanBruce

Herwig++ NNLO studies

Professor tuning framework

-- AndyBuckley - 2009-09-30

This topic: Main > AtlasEdinburghGroupEventGenerators Topic revision: r2 - 2010-07-30 - PhilipClark

Professor tuning framework 35 AtlasEdinburghGroup < Main < TWiki Exotic Searches at Edinburgh

Analyses & tools

Right-handed W (WR) and heavy neutrinos NR

• Working twiki • MC samples from Run-1 survey: txt file

VV->JJ (diboson fully hadronic channel)

• MC samples from Run-1 survey (common with VZ): pdf file

VZ->Jll (diboson semileptonic channel)

• MC samples from Run-1 survey (common with VV): pdf file

Boosted jet performance

• Working twiki

Software

• xAOD Analyser, see the dedicated twiki page: EdinburghVVXAOD • Statistical tool, see the dedicated twiki page ExoticStat • Old instructions on exotic signal productgion (WR, VV, VZ) ♦ Generators: Generator-page twiki (summary in text file) ♦ Simulation (17.7.3.9.6): pdf file

Useful links

• ATLAS Edinburgh meetings on indico • ATLAS Edinburgh Exotic searches e-group page (access to email archives, meeting minutes, etc)

-- ChristosLeonidopoulos - 29 Jul 2014

This topic: Main > AtlasEdinburghGroupExoticSearches Topic revision: r11 - 2016-10-22 - ChristosLeonidopoulos

Copyright &© 2008-2021 by the contributing authors. All material on this collaboration platform is the property of the contributing authors. or Ideas, requests, problems regarding TWiki? use Discourse or Send feedback https://twiki.cern.ch/twiki/bin/oops/Main/AtlasEdinburghGroupExoticSearchesGenerators?template=oopsaccessdenied;def=topic_access;param1=VIEW;param2=access%20not%20allowed%20on%20topic

This topic: Main > AtlasEdinburghGroupExoticSearchesGenerators Topic revision: r3 - 2015-03-17 - XantheHoad

Copyright &© 2008-2021 by the contributing authors. All material on this collaboration platform is the property of the contributing authors. or Ideas, requests, problems regarding TWiki? use Discourse or Send feedback https://twiki.cern.ch/twiki/bin/oops/Main/AtlasEdinburghGroupExoticSearchesGenerators?template=oopsaccessdenied;def=topic_access;param1=VIEW;param2=access%20not%20allowed%20on%20topic

Exotic Searches at Edinburgh 36 AtlasEdinburghGroup < Main < TWiki This topic: Main > AtlasEdinburghGroupExoticSearchesGenerators Topic revision: r3 - 2015-03-17 - XantheHoad

Physics studies

Look at performance of chose tagger(s) for sensitivity in prototype analysis.

Background Rejection studies

Jet mass responses

Try smaller R jets ?

MVA performance

Try and revive our TaggerMVA code once 'single tagger' studies completed. Just quickly to see if BG rejection can be improved upon with multivariate.

Technical details

Synchronising with UGeneva

Compare latest bg rejectoin numbers with bug fixes. If not matching use their mass windows etc. directly (very sensitive to those values).

MC event weights

• QCD ♦ event weight are calculated by xsec * filter_efficiency * mc_event_weight / NEVENTS. Note that the NEVENTS are the number of events processed in the grid. This is not essentially the same as the generated events, as you might have 0.1% unfinished grid jobs. ♦ In the Edinburgh ntuple, this corresponds to evt_scale1fb * mc_event_weight[0] • Signal MC ♦ Need to apply jet pt reweighting to match to the QCD jet spectrum, this is done by the leading ungroomed CA 1.2 truth jet pt Binning

• Ungroomed CA 1.2 truth jets |eta|<1.2, and present studies in different bins of this jet pT

Truth matching

• applying a W parton matching ∆R < 0.75R and is matched to truth groomed jet (∆R < 0.75R, where R is the jet radius parameter)

68% mass window

• How is this being determined?

Useful links 37 AtlasEdinburghGroup < Main < TWiki documentations

Talks

• Reina's summary Reina's summary on mass/d2 responses

-- YanyanGao - 2015-03-18

This topic: Main > BoostedJetPerformance Topic revision: r3 - 2015-03-27 - YanyanGao

Physics studies

Look at performance of chose tagger(s) for sensitivity in prototype analysis.

Background Rejection studies

Jet mass responses

Try smaller R jets ?

MVA performance

Try and revive our TaggerMVA code once 'single tagger' studies completed. Just quickly to see if BG rejection can be improved upon with multivariate.

Technical details

Synchronising with UGeneva

Compare latest bg rejectoin numbers with bug fixes. If not matching use their mass windows etc. directly (very sensitive to those values).

MC event weights

• Ungroomed CA 1.2 truth jets |eta|<1.2, and present studies in different bins of this jet pT

documentations 38 AtlasEdinburghGroup < Main < TWiki

Truth matching

• applying a W parton matching ∆R < 0.75R and is matched to truth groomed jet (∆R < 0.75R, where R is the jet radius parameter)

68% mass window

• How is this being determined? documentations

Talks

• Reina's summary Reina's summary on mass/d2 responses

-- YanyanGao - 2015-03-18

This topic: Main > BoostedJetPerformance Topic revision: r3 - 2015-03-27 - YanyanGao

Copyright &© 2008-2021 by the contributing authors. All material on this collaboration platform is the property of the contributing authors. or Ideas, requests, problems regarding TWiki? use Discourse or Send feedback This page documents the details of the common xAOD ntuples for the VV exotic analysis at University of Edinburgh.

Instructions and developments

Instructions

• Please contact either Ben Wynne or Yanyan Gao for comments/questions • Instructions: VVXAOD README ♦ Default: AthAnalysisRelease ◊ ⋅ 20.7 install_bash_AthAnalysisBase-2.4.11.sh, supports tag since VXAOD-00-00-44 and trunk ⋅ 20.1 install_bash_AthAnalysisBase-2.3.34.sh, supports tag up to VXAOD-00-00-43 ♦ Option of Derivation release, only use this if you need to remake the fat jets ◊ Latest tag VVXAOD-00-00-16, matching share/install_bash_Derivation.20.1.5.3.sh ◊ do not support trunk, make sure put the right tag in the installation script before executation • See the ChangeLog for the details of changes.

On-going developments for release 20.7

Instructions on the PC recommendations link to release 20 recommendations

• electron and photon ♦ ElectronRun2 ♦ Photon ID Run2 ♦ calibration ♦ Electron selections ♦ Electron calibrations

Truth matching 39 AtlasEdinburghGroup < Main < TWiki

♦ Photon calibrations ◊ Photon calibration does not work in the EXOT12 error message is missing auxdata x ♦ Electron trigger efficiency ◊ Off for the moment as the package does not compile for 2.4.9 (ElectronEfficiencyCorrection-00-01-52) • muons ♦ calibrations ♦ selections ♦ efficiency scale factors • MET Met20p7 • small R jet calibrations • large R jets JetMet2016 ♦ recommendations have not available yet • jet cleaning • overlap removal, implemented but not yet tested • b-tagging ♦ btag recommendation ♦ need to use MV2c10 instead of MV2c20 (change in the configuration file is needed)

Notes for developers

Please stick to these procedures for bookkeeping.

• Any change on the trunk must be tagged • For a new tag make sure the following changes are applied ♦ Document the changes in ChangeLog ♦ Update version in cmt/versions ♦ Update version at the top of the src/TestAlg.cxx • Example for tagging command (note avn.py does not work for institute code for some reason) svn cp svn+ssh://svn.cern.ch/reps/atlasinst/Institutes/Edinburgh/VVXAOD/trunk svn+ssh://svn.cern.ch/reps/atlasinst/Institutes/Edinburgh/VVXAOD/tags/VVXAOD-00-00-14 -m "loverly comments"

• Any new release must be paired with installation script, see example: install_bash_AthAnalysisBase-2.3.21.sh

• Before checking out a specific tag check the version of the package in the release by pkgco.py -s PACKAGE. If the version in the release is higher than the recommended, do nothing.

Show details Not needed Special instructions for Edinburgh PPE machines

Before doing any asetup commands on the PPE machines you have to asetup an old release first. I do not know why. Try something like this: asetup 17.8.0,here asetup WhatYouActuallyWanted,here

More on running locally at PPE machines:

List of files on ECDF (this should be changed to the FAX method but those paths don't seem to work with athena at the moment while this does. ) dq2-ls -f -p -L UKI-SCOTGRID-ECDF_LOCALGROUPDISK mc14_13TeV.147914.Pythia8_AU2CT10_jetjet_JZ4W.recon.AOD.e2743_s1982_s2008_r5787/ | grep srm | sed 's/srm:\/\/srm.glite.ecdf.ed.ac.uk/root:\/\/srm.glite.ecdf.ed.ac.uk\//g' > xrootdfilelist

Setup

On-going developments for release 20.7 40 AtlasEdinburghGroup < Main < TWiki setupATLAS localSetupEmi voms-proxy-init -voms atlas --valid 48:0 localSetupXRootD cd VVAnalysis/ asetup 17.0.2,slc5,here asetup 19.2.0,here cd VVXAOD/share/

Execute over all the files in the list. For this changed runTrimmingfromxAOD.py to svcMgr.EventSelector.InputCollections = [os.getenv('FNAME)] (athena -c FNAME=$line also probably works) while read line ; do export FNAME=$line ; athena runTrimmingfromxAOD.py >& /Disk/ecdf-nfs-ppe/atlas/users/wbhimji/xAODOutputs/`echo "$line" | cut -d '.' -f 11`.log; mv output.root /Disk/ecdf-nfs-ppe/atlas/users/wbhimji/xAODOutputs/`echo "$line" | cut -d '.' -f 11`.root; done < ~/xrootdfilelist

Output ntuple Contents

• Cross-sections ♦ Check with AMI for the value and update the python script cross-sections code ♦ Follow the share/addmcweight.py to add the weights after the gridHarvest.sh ♦ branches are evt_scale1fb, evt_kfactor, evt_filtereff, evt_nEvts calculated by mcweight calculation code • Physics objects follow instructions from the data15 Data 15 CP Recommendations • Electrons (calibrated) ♦ Impact parameters ♦ Likelihood ID: el_id_medium, el_id_tight, el_id_tight ♦ Isolation: el_iso_loosetrackonly, el_iso_loose, el_iso_tight • Muons (Calibrated) ♦ Selected muons ♦ Likelihood ID: el_id_medium, el_id_tight, el_id_tight ♦ Isolation: el_iso_loosetrackonly, el_iso_loose, el_iso_tight • Ungroomed Large R jets both LCtopo and truth = AntiKt10LCTopo, CamKt12LCTopo = • groomed Large R Jets both LCTopo and Truth ♦ Jet substructure variables, check the wishlist from Run-1 CP group Run-1 W-tagging variable list

Show details Hide details Implemented

Angularity Dip12, Dip13, Dip23, DipExcl12 PlanarFlow PullMag, PullPhi, Pull_C00, Pull_C01, Pull_C10, Pull_C11 SPLIT12, SPLIT23, SPLIT34 Tau1, Tau2, Tau3 TauWTA1, TauWTA2, TauWTA3 WIDTH ZCUT12 ECF1, ECF2, ECF3

** You can calculate the c2 d2 from the ECF1->3 oss << "Energy Correlator observable C2 ECF(3,beta)*ECF(1,beta)/ECF(2,beta)^2 for "; oss << "Energy Correlator observable D2 ECF(3,beta)*ECF(1,beta)^3/ECF(2,beta)^3 for ";

-- YanyanGao - 08 Aug 2014

This topic: Main > EdinburghVVXAOD

Notes for developers 41 AtlasEdinburghGroup < Main < TWiki Topic revision: r110 - 2016-06-21 - YanyanGao

Copyright &© 2008-2021 by the contributing authors. All material on this collaboration platform is the property of the contributing authors. or Ideas, requests, problems regarding TWiki? use Discourse or Send feedback This page documents the details of the common xAOD ntuples for the VV exotic analysis at University of Edinburgh.

Instructions and developments

Instructions

On-going developments for release 20.7

Instructions on the PC recommendations link to release 20 recommendations

• electron and photon ♦ ElectronRun2 ♦ Photon ID Run2 ♦ calibration ♦ Electron selections ♦ Electron calibrations ♦ Photon calibrations ◊ Photon calibration does not work in the EXOT12 error message is missing auxdata x ♦ Electron trigger efficiency ◊ Off for the moment as the package does not compile for 2.4.9 (ElectronEfficiencyCorrection-00-01-52) • muons ♦ calibrations ♦ selections ♦ efficiency scale factors • MET Met20p7 • small R jet calibrations • large R jets JetMet2016 ♦ recommendations have not available yet • jet cleaning • overlap removal, implemented but not yet tested • b-tagging ♦ btag recommendation ♦ need to use MV2c10 instead of MV2c20 (change in the configuration file is needed)

Output ntuple Contents 42 AtlasEdinburghGroup < Main < TWiki

Notes for developers

Please stick to these procedures for bookkeeping.

• Any new release must be paired with installation script, see example: install_bash_AthAnalysisBase-2.3.21.sh

• Before checking out a specific tag check the version of the package in the release by pkgco.py -s PACKAGE. If the version in the release is higher than the recommended, do nothing.

Show details Not needed Special instructions for Edinburgh PPE machines

Before doing any asetup commands on the PPE machines you have to asetup an old release first. I do not know why. Try something like this: asetup 17.8.0,here asetup WhatYouActuallyWanted,here

More on running locally at PPE machines:

Setup setupATLAS localSetupEmi voms-proxy-init -voms atlas --valid 48:0 localSetupXRootD cd VVAnalysis/ asetup 17.0.2,slc5,here asetup 19.2.0,here cd VVXAOD/share/

Output ntuple Contents

• Cross-sections ♦ Check with AMI for the value and update the python script cross-sections code

Notes for developers 43 AtlasEdinburghGroup < Main < TWiki

♦ Follow the share/addmcweight.py to add the weights after the gridHarvest.sh ♦ branches are evt_scale1fb, evt_kfactor, evt_filtereff, evt_nEvts calculated by mcweight calculation code • Physics objects follow instructions from the data15 Data 15 CP Recommendations • Electrons (calibrated) ♦ Impact parameters ♦ Likelihood ID: el_id_medium, el_id_tight, el_id_tight ♦ Isolation: el_iso_loosetrackonly, el_iso_loose, el_iso_tight • Muons (Calibrated) ♦ Selected muons ♦ Likelihood ID: el_id_medium, el_id_tight, el_id_tight ♦ Isolation: el_iso_loosetrackonly, el_iso_loose, el_iso_tight • Ungroomed Large R jets both LCtopo and truth = AntiKt10LCTopo, CamKt12LCTopo = • groomed Large R Jets both LCTopo and Truth ♦ Jet substructure variables, check the wishlist from Run-1 CP group Run-1 W-tagging variable list

Show details Hide details Implemented

-- YanyanGao - 08 Aug 2014

This topic: Main > EdinburghVVXAOD Topic revision: r110 - 2016-06-21 - YanyanGao

Copyright &© 2008-2021 by the contributing authors. All material on this collaboration platform is the property of the contributing authors. or Ideas, requests, problems regarding TWiki? use Discourse or Send feedback https://twiki.cern.ch/twiki/bin/oops/Main/EdinburghWRSearches?template=oopsaccessdenied;def=topic_access;param1=VIEW;param2=access%20not%20allowed%20on%20topic

This topic: Main > EdinburghWRSearches Topic revision: r81 - 2017-07-11 - XantheHoad

Copyright &© 2008-2021 by the contributing authors. All material on this collaboration platform is the property of the contributing authors. or Ideas, requests, problems regarding TWiki? use Discourse or Send feedback https://twiki.cern.ch/twiki/bin/oops/Main/EdinburghWRSearches?template=oopsaccessdenied;def=topic_access;param1=VIEW;param2=access%20not%20allowed%20on%20topic

This topic: Main > EdinburghWRSearches Topic revision: r81 - 2017-07-11 - XantheHoad

Output ntuple Contents 44 AtlasEdinburghGroup < Main < TWiki

Copyright &© 2008-2021 by the contributing authors. All material on this collaboration platform is the property of the contributing authors. or Ideas, requests, problems regarding TWiki? use Discourse or Send feedback This page documents the details of the common statistical tool.

-- YanyanGao - 2015-03-19

This topic: Main > ExoticStat Topic revision: r1 - 2015-03-19 - YanyanGao

Copyright &© 2008-2021 by the contributing authors. All material on this collaboration platform is the property of the contributing authors. or Ideas, requests, problems regarding TWiki? use Discourse or Send feedback This page documents the details of the common statistical tool.

-- YanyanGao - 2015-03-19

This topic: Main > ExoticStat Topic revision: r1 - 2015-03-19 - YanyanGao

Analyses & tools

Right-handed W (WR) and heavy neutrinos NR

• Working twiki • MC samples from Run-1 survey: txt file

VV->JJ (diboson fully hadronic channel)

• MC samples from Run-1 survey (common with VZ): pdf file

VZ->Jll (diboson semileptonic channel)

• MC samples from Run-1 survey (common with VV): pdf file

Boosted jet performance

• Working twiki

Software

Exotic Searches at Edinburgh 45 AtlasEdinburghGroup < Main < TWiki

♦ Simulation (17.7.3.9.6): pdf file

Useful links

• ATLAS Edinburgh meetings on indico • ATLAS Edinburgh Exotic searches e-group page (access to email archives, meeting minutes, etc)

-- ChristosLeonidopoulos - 29 Jul 2014

This topic: Main > AtlasEdinburghGroupExoticSearches Topic revision: r11 - 2016-10-22 - ChristosLeonidopoulos

Copyright &© 2008-2021 by the contributing authors. All material on this collaboration platform is the property of the contributing authors. or Ideas, requests, problems regarding TWiki? use Discourse or Send feedback https://twiki.cern.ch/twiki/bin/oops/Main/AtlasEdinburghGroupExoticSearchesGenerators?template=oopsaccessdenied;def=topic_access;param1=VIEW;param2=access%20not%20allowed%20on%20topic

This topic: Main > AtlasEdinburghGroupExoticSearchesGenerators Topic revision: r3 - 2015-03-17 - XantheHoad

Copyright &© 2008-2021 by the contributing authors. All material on this collaboration platform is the property of the contributing authors. or Ideas, requests, problems regarding TWiki? use Discourse or Send feedback https://twiki.cern.ch/twiki/bin/oops/Main/AtlasEdinburghGroupExoticSearchesGenerators?template=oopsaccessdenied;def=topic_access;param1=VIEW;param2=access%20not%20allowed%20on%20topic

This topic: Main > AtlasEdinburghGroupExoticSearchesGenerators Topic revision: r3 - 2015-03-17 - XantheHoad

Physics studies

Look at performance of chose tagger(s) for sensitivity in prototype analysis.

Background Rejection studies

Jet mass responses

Try smaller R jets ?

MVA performance

Try and revive our TaggerMVA code once 'single tagger' studies completed. Just quickly to see if BG rejection can be improved upon with multivariate.

Technical details

Software 46 AtlasEdinburghGroup < Main < TWiki Synchronising with UGeneva

Compare latest bg rejectoin numbers with bug fixes. If not matching use their mass windows etc. directly (very sensitive to those values).

MC event weights

• Ungroomed CA 1.2 truth jets |eta|<1.2, and present studies in different bins of this jet pT

Truth matching

• applying a W parton matching ∆R < 0.75R and is matched to truth groomed jet (∆R < 0.75R, where R is the jet radius parameter)

68% mass window

• How is this being determined? documentations

Talks

• Reina's summary Reina's summary on mass/d2 responses

-- YanyanGao - 2015-03-18

This topic: Main > BoostedJetPerformance Topic revision: r3 - 2015-03-27 - YanyanGao

Physics studies

Look at performance of chose tagger(s) for sensitivity in prototype analysis.

Background Rejection studies

Synchronising with UGeneva 47 AtlasEdinburghGroup < Main < TWiki Jet mass responses

Try smaller R jets ?

MVA performance

Try and revive our TaggerMVA code once 'single tagger' studies completed. Just quickly to see if BG rejection can be improved upon with multivariate.

Technical details

Synchronising with UGeneva

Compare latest bg rejectoin numbers with bug fixes. If not matching use their mass windows etc. directly (very sensitive to those values).

MC event weights

• Ungroomed CA 1.2 truth jets |eta|<1.2, and present studies in different bins of this jet pT

Truth matching

• applying a W parton matching ∆R < 0.75R and is matched to truth groomed jet (∆R < 0.75R, where R is the jet radius parameter)

68% mass window

• How is this being determined? documentations

Talks

• Reina's summary Reina's summary on mass/d2 responses

-- YanyanGao - 2015-03-18

This topic: Main > BoostedJetPerformance Topic revision: r3 - 2015-03-27 - YanyanGao

Jet mass responses 48 AtlasEdinburghGroup < Main < TWiki This page documents the details of the common xAOD ntuples for the VV exotic analysis at University of Edinburgh.

Instructions and developments

Instructions

On-going developments for release 20.7

Instructions on the PC recommendations link to release 20 recommendations

Notes for developers

Please stick to these procedures for bookkeeping.

Talks 49 AtlasEdinburghGroup < Main < TWiki

• Any new release must be paired with installation script, see example: install_bash_AthAnalysisBase-2.3.21.sh

• Before checking out a specific tag check the version of the package in the release by pkgco.py -s PACKAGE. If the version in the release is higher than the recommended, do nothing.

Show details Not needed Special instructions for Edinburgh PPE machines

Before doing any asetup commands on the PPE machines you have to asetup an old release first. I do not know why. Try something like this: asetup 17.8.0,here asetup WhatYouActuallyWanted,here

More on running locally at PPE machines:

Setup setupATLAS localSetupEmi voms-proxy-init -voms atlas --valid 48:0 localSetupXRootD cd VVAnalysis/ asetup 17.0.2,slc5,here asetup 19.2.0,here cd VVXAOD/share/

Output ntuple Contents

Notes for developers 50 AtlasEdinburghGroup < Main < TWiki

• Electrons (calibrated) ♦ Impact parameters ♦ Likelihood ID: el_id_medium, el_id_tight, el_id_tight ♦ Isolation: el_iso_loosetrackonly, el_iso_loose, el_iso_tight • Muons (Calibrated) ♦ Selected muons ♦ Likelihood ID: el_id_medium, el_id_tight, el_id_tight ♦ Isolation: el_iso_loosetrackonly, el_iso_loose, el_iso_tight • Ungroomed Large R jets both LCtopo and truth = AntiKt10LCTopo, CamKt12LCTopo = • groomed Large R Jets both LCTopo and Truth ♦ Jet substructure variables, check the wishlist from Run-1 CP group Run-1 W-tagging variable list

Show details Hide details Implemented

-- YanyanGao - 08 Aug 2014

This topic: Main > EdinburghVVXAOD Topic revision: r110 - 2016-06-21 - YanyanGao

Copyright &© 2008-2021 by the contributing authors. All material on this collaboration platform is the property of the contributing authors. or Ideas, requests, problems regarding TWiki? use Discourse or Send feedback This page documents the details of the common xAOD ntuples for the VV exotic analysis at University of Edinburgh.

Instructions and developments

Instructions

Output ntuple Contents 51 AtlasEdinburghGroup < Main < TWiki

share/install_bash_Derivation.20.1.5.3.sh ◊ do not support trunk, make sure put the right tag in the installation script before executation • See the ChangeLog for the details of changes.

On-going developments for release 20.7

Instructions on the PC recommendations link to release 20 recommendations

Notes for developers

Please stick to these procedures for bookkeeping.

• Any new release must be paired with installation script, see example: install_bash_AthAnalysisBase-2.3.21.sh

• Before checking out a specific tag check the version of the package in the release by pkgco.py -s PACKAGE. If the version in the release is higher than the recommended, do nothing.

Show details Not needed

Instructions 52 AtlasEdinburghGroup < Main < TWiki Special instructions for Edinburgh PPE machines

Before doing any asetup commands on the PPE machines you have to asetup an old release first. I do not know why. Try something like this: asetup 17.8.0,here asetup WhatYouActuallyWanted,here

More on running locally at PPE machines:

Setup setupATLAS localSetupEmi voms-proxy-init -voms atlas --valid 48:0 localSetupXRootD cd VVAnalysis/ asetup 17.0.2,slc5,here asetup 19.2.0,here cd VVXAOD/share/

Output ntuple Contents

Show details Hide details Implemented

Angularity Dip12, Dip13, Dip23, DipExcl12

Notes for developers 53 AtlasEdinburghGroup < Main < TWiki

PlanarFlow PullMag, PullPhi, Pull_C00, Pull_C01, Pull_C10, Pull_C11 SPLIT12, SPLIT23, SPLIT34 Tau1, Tau2, Tau3 TauWTA1, TauWTA2, TauWTA3 WIDTH ZCUT12 ECF1, ECF2, ECF3

-- YanyanGao - 08 Aug 2014

This topic: Main > EdinburghVVXAOD Topic revision: r110 - 2016-06-21 - YanyanGao

Copyright &© 2008-2021 by the contributing authors. All material on this collaboration platform is the property of the contributing authors. or Ideas, requests, problems regarding TWiki? use Discourse or Send feedback https://twiki.cern.ch/twiki/bin/oops/Main/EdinburghWRSearches?template=oopsaccessdenied;def=topic_access;param1=VIEW;param2=access%20not%20allowed%20on%20topic

This topic: Main > EdinburghWRSearches Topic revision: r81 - 2017-07-11 - XantheHoad

Copyright &© 2008-2021 by the contributing authors. All material on this collaboration platform is the property of the contributing authors. or Ideas, requests, problems regarding TWiki? use Discourse or Send feedback https://twiki.cern.ch/twiki/bin/oops/Main/EdinburghWRSearches?template=oopsaccessdenied;def=topic_access;param1=VIEW;param2=access%20not%20allowed%20on%20topic

This topic: Main > EdinburghWRSearches Topic revision: r81 - 2017-07-11 - XantheHoad

Copyright &© 2008-2021 by the contributing authors. All material on this collaboration platform is the property of the contributing authors. or Ideas, requests, problems regarding TWiki? use Discourse or Send feedback This page documents the details of the common statistical tool.

-- YanyanGao - 2015-03-19

This topic: Main > ExoticStat Topic revision: r1 - 2015-03-19 - YanyanGao

Copyright &© 2008-2021 by the contributing authors. All material on this collaboration platform is the property of the contributing authors. or Ideas, requests, problems regarding TWiki? use Discourse or Send feedback This page documents the details of the common statistical tool.

-- YanyanGao - 2015-03-19

This topic: Main > ExoticStat Topic revision: r1 - 2015-03-19 - YanyanGao

Output ntuple Contents 54 AtlasEdinburghGroup < Main < TWiki

• To be able to view, or edit all of these pages, please join the atlas-edinburgh e-group • It helps everyone if we can keep these pages up to date, so please feel free to add new tips and correct mistakes, also to document your work as much as possible. ♦ Please avoid re-recreating documentation though, instead it is better to link to the official ATLAS docs, and if necessary, update those too! • In case it is useful, you can also get a full pdf (with subpages) of the entire AtlasEdinburghGroup TWiki with this link. ♦ Note: if your own topics need such a link, just copy the PDF link (top right of all pages) and add ?pdfrecursive=on to the url.

Bureaucratic details

You'll need to fill in the ATLAS registration form using the link below, get it signed and give/fax to the ATLAS secretariat . Register as an external user until you are able to come to CERN to register as a user. This will initiate computing accounts being created etc.

• Registration and Access

If you want to do anything distributed-computing-ish, you'll need a grid certificate from here

• National Grid Service

You will need Virtual Organisation membership (but you'll need the certificate first to access it, and it won't work if you're not registered with ATLAS)

• ATLAS VO Registration Service

Here is a useful list of upcoming ATLAS meetings (one of which may require traveling to CERN and you register as a user at that point)

• ATLAS meetings

This page has useful forms for when you go to CERN (e.g. reserving a open desk space, bicycle, registering laptop etc)

• Forms and services

The UK liaison office are always on hand to help with the logistics of being at CERN.

• UK liaison office

Getting Started

Linux tutorials

For those of you who are new to linux, these tutorials are a good source for learning the basics (tutorial 1), then improving on the skills learned in the first tutorial in the second and third. The exercises provided at the end of each section give the user a chance to consolidate the skills previously learned.

Before you start 55 AtlasEdinburghGroup < Main < TWiki

• Some very good unix/linux tutorials

Note: when asked to complete the exercise at the end of the first unix tutorial, click on the following link: ftp://ftp.ed.ac.uk/pub/Unix1/ and save "murder.tar" to your local machine, this can then be accessed as required. (This can be repeated for the exercise at the end of the second section by clicking on: ftp://ftp.ed.ac.uk/pub/Unix2/ and saving "mcgfiles.tar")

ATLAS software

To get going with the software follow the ATLAS Computing workbook

• Atlas.WorkBook

To learn about root, you many find this basic tutorial useful

• ATLAS Root Basic Tutorial

You should familiarise yourself with the ATLAS Twiki, in particular the computing portal where you will find Computing, Physics and Software workbooks.

• ATLAS Twiki pages

CERN VM

If you want to install the ATLAS software on your laptop or home computer, you can try to use the CERN VM (Virtual Machine) within Virtual Box or VMWare. However, you should ensure that the machine you use is not slow (e.g. due scheduled virus scans, conflicting software etc) and that you have a good network connection. The virtual machine will also give you access to Linux and you can use this to gain familiarity it (if you have not used Linux before). The instructions are in a state of flux, and don't always work, if you find you have to do anything special then please add to the Tips and Tricks section.

• ATLAS CERN VM instructions • Tips and tricks

Geant4 software

Geant4 VM instructions

• Geant 4 VM instructions

If you want to use the local PPE Linux installation

1. Find out what shell you are using echo $SHELL, check it is bash 2. These following lines can be added to your .bash_profile file in your home directory 3. source /Disk/lochnagar0/general/geant4/geant4.9.3.p01/env.sh 4. export ROOTSYS=/opt/root/5.18.00 5. export PATH=/opt/root/5.18.00/bin:$ROOTSYS/bin:$PATH 6. export LD_LIBRARY_PATH=${LD_LIBRARY_PATH}:$ROOTSYS/lib:/opt/root/5.18.00/lib:$LD_LIBRARY_PATH 7. export PYTHONPATH=$PYTHONPATH:$ROOTSYS/lib 8. unset G4UI_USE_XM 9. unset G4UI_USE_TCSH 10. You may need to re-login to get the bash_profile working

Or, you can copy my own bash_profile from the attachments at the bottom of the page - save into home directory with filename .bash_profile

Linux tutorials 56 AtlasEdinburghGroup < Main < TWiki Latest Geant4 User tutorial

• Geant4 Feb 2010 tutorial

GPU software

Go here AtlasEdinburghGPUComputing

• bash_profile: Bash profile for use on linux machines for GEANT4

This topic: Main > AtlasEdinburghGroupGettingStarted Topic revision: r16 - 2012-02-20 - WahidBhimji

Bureaucratic details

• Registration and Access

If you want to do anything distributed-computing-ish, you'll need a grid certificate from here

• National Grid Service

You will need Virtual Organisation membership (but you'll need the certificate first to access it, and it won't work if you're not registered with ATLAS)

• ATLAS VO Registration Service

Here is a useful list of upcoming ATLAS meetings (one of which may require traveling to CERN and you register as a user at that point)

• ATLAS meetings

This page has useful forms for when you go to CERN (e.g. reserving a open desk space, bicycle, registering laptop etc)

Geant4 software 57 AtlasEdinburghGroup < Main < TWiki

• Forms and services

The UK liaison office are always on hand to help with the logistics of being at CERN.

• UK liaison office

Getting Started

Linux tutorials

• Some very good unix/linux tutorials

ATLAS software

To get going with the software follow the ATLAS Computing workbook

• Atlas.WorkBook

To learn about root, you many find this basic tutorial useful

• ATLAS Root Basic Tutorial

You should familiarise yourself with the ATLAS Twiki, in particular the computing portal where you will find Computing, Physics and Software workbooks.

• ATLAS Twiki pages

CERN VM

• ATLAS CERN VM instructions • Tips and tricks

Geant4 software

Geant4 VM instructions

• Geant 4 VM instructions

Bureaucratic details 58 AtlasEdinburghGroup < Main < TWiki If you want to use the local PPE Linux installation

Or, you can copy my own bash_profile from the attachments at the bottom of the page - save into home directory with filename .bash_profile

Latest Geant4 User tutorial

• Geant4 Feb 2010 tutorial

GPU software

Go here AtlasEdinburghGPUComputing

• bash_profile: Bash profile for use on linux machines for GEANT4

This topic: Main > AtlasEdinburghGroupGettingStarted Topic revision: r16 - 2012-02-20 - WahidBhimji

Copyright &© 2008-2021 by the contributing authors. All material on this collaboration platform is the property of the contributing authors. or Ideas, requests, problems regarding TWiki? use Discourse or Send feedback https://twiki.cern.ch/twiki/bin/oops/Main/AtlasEdinburghGroupHLT?template=oopsaccessdenied;def=topic_access;param1=VIEW;param2=access%20not%20allowed%20on%20topic

This topic: Main > AtlasEdinburghGroupHLT Topic revision: r5 - 2013-02-15 - AndrewWashbrook

Copyright &© 2008-2021 by the contributing authors. All material on this collaboration platform is the property of the contributing authors. or Ideas, requests, problems regarding TWiki? use Discourse or Send feedback https://twiki.cern.ch/twiki/bin/oops/Main/AtlasEdinburghHLTDataPreparationTiming?template=oopsaccessdenied;def=topic_access;param1=VIEW;param2=access%20not%20allowed%20on%20topic

This topic: Main > AtlasEdinburghHLTDataPreparationTiming Topic revision: r6 - 2013-02-22 - AndrewWashbrook

Copyright &© 2008-2021 by the contributing authors. All material on this collaboration platform is the property of the contributing authors. or Ideas, requests, problems regarding TWiki? use Discourse or Send feedback https://twiki.cern.ch/twiki/bin/oops/Main/AtlasEdinburghHLTDataPreparationTiming?template=oopsaccessdenied;def=topic_access;param1=VIEW;param2=access%20not%20allowed%20on%20topic

This topic: Main > AtlasEdinburghHLTDataPreparationTiming Topic revision: r6 - 2013-02-22 - AndrewWashbrook

Geant4 software 59 AtlasEdinburghGroup < Main < TWiki

Copyright &© 2008-2021 by the contributing authors. All material on this collaboration platform is the property of the contributing authors. or Ideas, requests, problems regarding TWiki? use Discourse or Send feedback https://twiki.cern.ch/twiki/bin/oops/Main/AtlasEdinburghHLTEdMeetings?template=oopsaccessdenied;def=topic_access;param1=VIEW;param2=access%20not%20allowed%20on%20topic

This topic: Main > AtlasEdinburghHLTEdMeetings Topic revision: r45 - 2016-05-22 - ChristosLeonidopoulos

Copyright &© 2008-2021 by the contributing authors. All material on this collaboration platform is the property of the contributing authors. or Ideas, requests, problems regarding TWiki? use Discourse or Send feedback https://twiki.cern.ch/twiki/bin/oops/Main/ATLASEdinburghHLTEdMeetings2013?template=oopsaccessdenied;def=topic_access;param1=VIEW;param2=access%20not%20allowed%20on%20topic

This topic: Main > ATLASEdinburghHLTEdMeetings2013 Topic revision: r1 - 2014-10-14 - ChristosLeonidopoulos

Copyright &© 2008-2021 by the contributing authors. All material on this collaboration platform is the property of the contributing authors. or Ideas, requests, problems regarding TWiki? use Discourse or Send feedback https://twiki.cern.ch/twiki/bin/oops/Main/ATLASEdinburghHLTEdMeetings2013?template=oopsaccessdenied;def=topic_access;param1=VIEW;param2=access%20not%20allowed%20on%20topic

This topic: Main > ATLASEdinburghHLTEdMeetings2013 Topic revision: r1 - 2014-10-14 - ChristosLeonidopoulos

Copyright &© 2008-2021 by the contributing authors. All material on this collaboration platform is the property of the contributing authors. or Ideas, requests, problems regarding TWiki? use Discourse or Send feedback https://twiki.cern.ch/twiki/bin/oops/Main/ATLASEdinburghHLTEdMeetings2014?template=oopsaccessdenied;def=topic_access;param1=VIEW;param2=access%20not%20allowed%20on%20topic

This topic: Main > ATLASEdinburghHLTEdMeetings2014 Topic revision: r1 - 2015-02-08 - ChristosLeonidopoulos

Copyright &© 2008-2021 by the contributing authors. All material on this collaboration platform is the property of the contributing authors. or Ideas, requests, problems regarding TWiki? use Discourse or Send feedback https://twiki.cern.ch/twiki/bin/oops/Main/ATLASEdinburghHLTEdMeetings2014?template=oopsaccessdenied;def=topic_access;param1=VIEW;param2=access%20not%20allowed%20on%20topic

This topic: Main > ATLASEdinburghHLTEdMeetings2014 Topic revision: r1 - 2015-02-08 - ChristosLeonidopoulos

Summary of 25SEP-15 meeting

News:

Attendance at future events:

GPU software 60 AtlasEdinburghGroup < Main < TWiki

• ATLAS UK HLT meeting, 3-4 Nov (RAL): Ben S, Ben W, Christos (PLEASE REGISTER) • Technical Interchange Meeting, 9-12 Nov (Berkeley): Ben W • TDAQ week, 30 Nov-04 Dec (Embra): Ben W, Yanyan, Victoria, Christos (PLEASE REGISTER)

Other news:

• Ben S has accepted a new job at Annecy! Congrats Ben! • Happy birthday Yanyan!

Online operations (Yanyan)

• Busy with online shifts • Had discussion at CERN with Joerg & Anna on dynamic pre-scaling scheme. Latest mood is not to implement this year. A less ambitious plan it to have software calculate rates and notify trigger to push new set of (pre-calculated) triggers. Install by February?

Future framework (Ben W)

• Busy with event views; Level-1 reader algorithm to be creating views (corresponding to RoIs) • Next on to-do list: algorithms scheduler (currently: static) and sequence concept.

Cool DB (Ben S)

• Version 1.2 in the pipeline. Gave presentations & tutorials at CERN • Need to discuss deployment & commissioning plan over next month with Joerg/Martin.

Displaced vertex tracking and triggers (Christos)

• Trying to get tracking CP conveners to agree on authorship task

Next scheduled meeting: Friday 23 October (11:00 AM UK) **NOTE UNUSUAL TIME**

Summary of 28AUG-15 meeting

Online operations (Yanyan)

Busy with online shifts

Cool DB (Ben S)

First version of Menu-Aware-monitorng interface to COOL DB released to the masses; TrigHLTMonitoring-00-07-02 to be included in next T0 release

Future framework (Ben W)

• Have been working with event views, in the context of roadmap for demonstrator (to be delivered by end of year) • Will be attending November TIM meeting at Berkeley (https://indico.cern.ch/event/395887/ )

Displaced vertex tracking and triggers (Christos)

Have been discussing with Physics coordination about R&D trigger studies coupled with GPU proof-of-principle prototype. This is currently organised under Tracker CP umbrella, and can be followed through: https://its.cern.ch/jira/browse/ATLASRECTS-2220

Next scheduled meeting: Friday 11 September (10:30 AM UK)

News: 61 AtlasEdinburghGroup < Main < TWiki Summary of 31JUL-15 meeting

Rulebook and online operations (Yanyan)

Mostly busy with on-call shifts

Dynamic-prescaling: not much happening till end of the year(?)

Future framework (Ben W)

Have been working with trigger elements (event-views equivalent on storegate) and trying to make them work in athena; Effort to reduce # of views by keeping ~same trigger elements but by introducing versioning

Next steps:

• minimal set of working test by end of September • full mini-HLT demonstrator (read L1 info, create 2-3 event views, run real trigger algorithms) by end of year

Interface of menu-aware monitoring () with DB (Ben S)

• v0 version is (almost) ready: have oracle DB running at CERN; uploaded default T0 monitoring configuration • Last(?) remaining problem: how to deal with old configurations (made by Tatsiana, obsolete by now): talk to Joerg for a safe solution

GPU HLT demonstrator (Andy)

Have started working on this, profiling to follow

T0 monitoring (Christos)

Mostly quiet period; small monitoring updates by some slice groups

Next scheduled meeting: Friday 13 August (10:30 AM UK)

Summary of 03JUL-15 virtual meeting

Rulebook and online operations (Yanyan)

Mainly working on rulebook bug fixes/improvements, as a menu expert, and online operations. Will be at CERN this coming week for online on-call shifts and menu work.

Future framework (Ben W)

Working on EventViews. Big framework design/development workshop next week, will present latest progress on Athena integration.

Interface of menu-aware monitoring () with DB (Ben S)

At CERN this week, meeting with trigger, trigger-DB experts and monitoring customers. Good progress on the MaM has been made: working on suggestions to underlying code made by Joerg. Prepared proposal covering extra features for MaM version 2.

Summary of 31JUL-15 meeting 62 AtlasEdinburghGroup < Main < TWiki

T0 monitoring (Christos)

Updating monitoring categories for muon and egamma as requested by DQ and trigger groups.

Next scheduled meeting: Friday 31 June (10:30 AM UK)

Summary of 05JUN-15 meeting

Attending:

Ben W, Ben S, Andy, Christos

Minute scribe: Christos

Future framework (Ben W)

Have been busy discussing Views prototypes at various meetings in the last 2 weeks

Interface of menu-aware monitoring with DB (Ben S)

Working on implementation/storing of diffs of monitoring configurations wrt default one (to be taken from release); Have been discussing technical details with Alex Martyniuk (trigger monitoring DB expert)

Expect to have first prototype released to T0 monitoring experts for testing in a week

T0 monitoring (Christos)

Updating tests and recipes to incorporate new 13 TeV data as input

Summary of 22MAY-15 meeting

Attending:

Ben W, Ben S, Tim, Yanyan, Christos

Minute scribe: Christos

Future framework (Ben W)

Has been working on Views prototypes; gave status report at TDAQ week, see: https://indico.cern.ch/event/328404/session/14/contribution/49/material/slides/0.pdf

Will be focusing on multi-threaded work.

Interface of menu-aware monitoring with DB (Ben S)

Aiming to have 1st prototype ready in time for Trigger Offline Monitoring meeting (29 May).

Menu-expert (Yanyan)

Has been taking trigger online on-call shifts; busy with operations

T0 monitoring (Christos) 63 AtlasEdinburghGroup < Main < TWiki

Triggering on displaced vertices and GPU (Ben W)

Has prepared trigger menu running on cosmic data as input for Tims tests

Next scheduled meeting: Friday 5 June (10:30 AM UK)

Summary of 08MAY-15 meeting

Attending: Ben W, Ben S, Tim, Andy, Yanyan, Christos

Minute scribe: Christos

Future framework (Ben)

• See talk from Thursdays ATLAS UK HLT meeting: https://indico.cern.ch/event/358238/contribution/2/material/slides/0.pdf

Interface of menu-aware monitoring with DB (Ben S)

• See talk from Thursdays ATLAS UK HLT meeting: https://indico.cern.ch/event/358238/contribution/5/material/slides/0.pdf

Future framework (Andy)

• Busy with CHEP/other conferences & proceedings writing • FSTF: plans for HLT profiling

Menu-expert (Yanyan)

• Taking menu-expert training course

Triggering on displaced vertices and GPU (Tim)

• No progress recently • Next steps: ♦ Find signal MC sample with displaced vertexes ♦ Confirm that vanilla tracking algorithm can reconstruct signal tracks by augmenting beamspot uncertainty ♦ Use FastTrackFinder to find all tracks originating from PV; then run displaced-track finder using GPUs with orphan tracker hits

Offline Trigger (and Menu-aware) monitoring (Christos)

• Migration of python configuration for Menu-aware monitoring successfully completed; Provides central monitoring functionality for slice groups & DQ

Next scheduled meeting: Friday 22 May (10:30 AM UK)

Summary of 24APR-15 meeting

Attending: Ben W, Ben S, Tim, Victoria, Christos

Minute scribe: Christos

Triggering on displaced vertices and GPU (Ben W) 64 AtlasEdinburghGroup < Main < TWiki

Future framework (Ben)

• EventViews (aka: trigger elements) prototype is in place (looks quite nice) . • Still working on comments for draft note (https://cds.cern.ch/record/1974156 ) • Hope to use semi-realistic trigger menu (in discussions with Francesca Pastore) to show performance numbers with athena at June workshop at CERN

Triggering on displaced vertices and GPU (Ben W, Tim)

• Have implemented python-based event display to visualise signatures & debug displaced tracking (Tim) • Next steps: ♦ Find MC sample with displaced vertexes ♦ Confirm that vanilla tracking algorithm can reconstruct signal tracks by augmenting beamspot uncertainty ♦ Use FastTrackFinder to find all tracks originating from PV; then run displaced-track finder using GPUs with orphan tracker hits

Interface of menu-aware monitoring with DB (Ben S)

• New activity by Ben: interface menu-aware monitoring with DB; expect to work in collaboration with Yanyan (rulebook) and Christos (offline trigger monitoring) • Working on python scripts for managing monitoring configurations (use the one from release as baseline configuration, and manage changes wrt default one) • Next steps: release prototype to slice experts

Offline Trigger (and Menu-aware) monitoring (Christos)

• Working on redesign of python class to provide central monitoring functionality for slice groups & DQ (with help from Tim);

Next scheduled meeting: Friday 8 May (10:30 AM UK) (TBC)

Summary of 20MAR-15 meeting

Attending: Ben W, Ben S, Tim, Christos

Minute scribe: Christos

Software performance (Ben & Andy)

• Stewart (Martin-Haugh) has requested some help from us on profiling and interpretation of Cuda output; (Ben promised that) minimal time is devoted on this

Future framework (Ben)

• Work continues on the EventViews (aka: trigger elements) prototype. Current focus is on static polymorphism of code (aka: templates) • Also working on comments for draft note (https://cds.cern.ch/record/1974156 ); Comments still welcome

Triggering on displaced vertices and GPU (Ben S, Tim)

• Discussion on simple tracking algorithm demonstrating proof-of-principle • Goals for next meeting:

Future framework (Ben) 65 AtlasEdinburghGroup < Main < TWiki

♦ Implement python-based event display to visualise signatures (Tim) ♦ Investigate potential tracking options from Run-1 and/or the market (Ben S)

Offline Trigger (and Menu-aware) monitoring (Christos)

• Redesign of python class to provide central monitoring functionality for slice groups & DQ (with help from Tim); Proposal sent to Data Quality group

Next scheduled meeting: TENTATIVELY on Friday 24 April (10:30 AM UK) (TBC)

Summary of 06MAR-15 meeting

Attending: Ben W, Yanyan, Andy, Tim, Christos

Minute scribe: Christos

Future framework (Ben)

• Work continues on the EventViews prototype. We have some more test cases, and an example that satisfies all tests thus far.

Andy

• GPU work for CHEP using Nvidia Kepler and (Release Candidate) Cuda 7; project is on decision forests & machine learning; Relevant for trigger algorithms on GPUs? • FSTF: Performance measurements for low-power CPUs with Glasgow • Some help offered to Stewart on profiling jobs

Rulebook (Yanyan)

• Monitoring triggers implemented separately in cosmic menu • Validation of pre-scale calculations • Discussions for involvement with jet trigger performance group (relevant for VV exotic search)

Offline Trigger (and Menu-aware) monitoring (Christos)

• Discussions with Data Quality group on access to trigger monitoring categories • Redesign of python class to provide central monitoring functionality for slice groups & DQ (with help from Tim)

Next scheduled meeting: Friday 20 March (10:30 AM UK)

Summary of 20FEB-15 meeting

Attending: Ben W, Yanyan, Andy, Christos Apologies: Tim

Minute scribe: Christos

Future framework (Ben)

• Discussions with Tomasz (Bold), John (Baines) on how to go about HLT framework prototype; Opinions on how to get started vary between from storegate and athena (Ben John) and from scratch (Tomasz). Will probably try both approaches

Triggering on displaced vertices and GPU (Ben S, Tim) 66 AtlasEdinburghGroup < Main < TWiki

Andy

• Started new role as co-convener of the ATLAS Future Software and Technology Forum. Looking for people to join effort; Run-2 preparations understandably a major distraction

Trigger menu & dynamic prescales (Yanyan)

• Working on rulebook script for the Run-2 data-taking. In particular: ♦ Commissioning of current script (introducing new trigger tools and CTP) at M8 ♦ Development of tools for prescale calculation for MC15 in preparation for physics

Offline Trigger (and Menu-aware) monitoring (Christos)

• Migration of trigger chains from source code to python configuration files complete • Next steps include interface with DB, and preparation for adaption of functionality by DQ groups • Also helping with online monitoring (why?)

GPU algorithm proof-of-principle for displaced vertices (Ben, Andy, Tim)

• No progress recently

Next scheduled meeting: Friday 6 March (10:30 AM UK)

Summary of 06FEB-15 meeting

Attending: Ben W, Yanyan, Christos

Apologies: Andy, Tim

Minute scribe: Christos

Future framework (Ben)

• A draft of requirements report available for comments: https://cds.cern.ch/record/1974156 ? • Ben & Tomasz Bold to look at providing trigger demonstrators in new software framework

Trigger menu & dynamic prescales (Yanyan)

• Taking trigger online on-call shifts for M8 • Work on rule-book script continues

Menu-aware monitoring (Christos)

• Preparations for M8

GPU algorithm proof-of-principle for displaced vertices (Ben & Tim)

• No progress recently

Next scheduled meeting: Friday 20 February (10:30 AM UK)

-- ChristosLeonidopoulos - 2016-01-15

This topic: Main > ATLASEdinburghHLTEdMeetings2015 Topic revision: r1 - 2016-01-15 - ChristosLeonidopoulos

Andy 67 AtlasEdinburghGroup < Main < TWiki

Summary of 25SEP-15 meeting

News:

Attendance at future events:

Other news:

• Ben S has accepted a new job at Annecy! Congrats Ben! • Happy birthday Yanyan!

Online operations (Yanyan)

Future framework (Ben W)

• Busy with event views; Level-1 reader algorithm to be creating views (corresponding to RoIs) • Next on to-do list: algorithms scheduler (currently: static) and sequence concept.

Cool DB (Ben S)

• Version 1.2 in the pipeline. Gave presentations & tutorials at CERN • Need to discuss deployment & commissioning plan over next month with Joerg/Martin.

Displaced vertex tracking and triggers (Christos)

• Trying to get tracking CP conveners to agree on authorship task

Next scheduled meeting: Friday 23 October (11:00 AM UK) **NOTE UNUSUAL TIME**

Summary of 28AUG-15 meeting

Online operations (Yanyan)

Busy with online shifts

Cool DB (Ben S)

First version of Menu-Aware-monitorng interface to COOL DB released to the masses; TrigHLTMonitoring-00-07-02 to be included in next T0 release

GPU algorithm proof-of-principle for displaced vertices (Ben & Tim) 68 AtlasEdinburghGroup < Main < TWiki

Future framework (Ben W)

Displaced vertex tracking and triggers (Christos)

Next scheduled meeting: Friday 11 September (10:30 AM UK)

Summary of 31JUL-15 meeting

Rulebook and online operations (Yanyan)

Mostly busy with on-call shifts

Dynamic-prescaling: not much happening till end of the year(?)

Future framework (Ben W)

Next steps:

• minimal set of working test by end of September • full mini-HLT demonstrator (read L1 info, create 2-3 event views, run real trigger algorithms) by end of year

Interface of menu-aware monitoring () with DB (Ben S)

GPU HLT demonstrator (Andy)

Have started working on this, profiling to follow

T0 monitoring (Christos)

Mostly quiet period; small monitoring updates by some slice groups

Next scheduled meeting: Friday 13 August (10:30 AM UK)

Summary of 03JUL-15 virtual meeting

Future framework (Ben W) 69 AtlasEdinburghGroup < Main < TWiki

Rulebook and online operations (Yanyan)

Mainly working on rulebook bug fixes/improvements, as a menu expert, and online operations. Will be at CERN this coming week for online on-call shifts and menu work.

Future framework (Ben W)

Working on EventViews. Big framework design/development workshop next week, will present latest progress on Athena integration.

Interface of menu-aware monitoring () with DB (Ben S)

T0 monitoring (Christos)

Updating monitoring categories for muon and egamma as requested by DQ and trigger groups.

Next scheduled meeting: Friday 31 June (10:30 AM UK)

Summary of 05JUN-15 meeting

Attending:

Ben W, Ben S, Andy, Christos

Minute scribe: Christos

Future framework (Ben W)

Have been busy discussing Views prototypes at various meetings in the last 2 weeks

Interface of menu-aware monitoring with DB (Ben S)

Expect to have first prototype released to T0 monitoring experts for testing in a week

T0 monitoring (Christos)

Updating tests and recipes to incorporate new 13 TeV data as input

Summary of 22MAY-15 meeting

Attending:

Ben W, Ben S, Tim, Yanyan, Christos

Minute scribe: Christos

Rulebook and online operations (Yanyan) 70 AtlasEdinburghGroup < Main < TWiki

Future framework (Ben W)

Has been working on Views prototypes; gave status report at TDAQ week, see: https://indico.cern.ch/event/328404/session/14/contribution/49/material/slides/0.pdf

Will be focusing on multi-threaded work.

Interface of menu-aware monitoring with DB (Ben S)

Aiming to have 1st prototype ready in time for Trigger Offline Monitoring meeting (29 May).

Menu-expert (Yanyan)

Has been taking trigger online on-call shifts; busy with operations

Triggering on displaced vertices and GPU (Ben W)

Has prepared trigger menu running on cosmic data as input for Tims tests

Next scheduled meeting: Friday 5 June (10:30 AM UK)

Summary of 08MAY-15 meeting

Attending: Ben W, Ben S, Tim, Andy, Yanyan, Christos

Minute scribe: Christos

Future framework (Ben)

• See talk from Thursdays ATLAS UK HLT meeting: https://indico.cern.ch/event/358238/contribution/2/material/slides/0.pdf

Interface of menu-aware monitoring with DB (Ben S)

• See talk from Thursdays ATLAS UK HLT meeting: https://indico.cern.ch/event/358238/contribution/5/material/slides/0.pdf

Future framework (Andy)

• Busy with CHEP/other conferences & proceedings writing • FSTF: plans for HLT profiling

Menu-expert (Yanyan)

• Taking menu-expert training course

Triggering on displaced vertices and GPU (Tim)

• No progress recently • Next steps: ♦ Find signal MC sample with displaced vertexes ♦ Confirm that vanilla tracking algorithm can reconstruct signal tracks by augmenting beamspot uncertainty

Future framework (Ben W) 71 AtlasEdinburghGroup < Main < TWiki

♦ Use FastTrackFinder to find all tracks originating from PV; then run displaced-track finder using GPUs with orphan tracker hits

Offline Trigger (and Menu-aware) monitoring (Christos)

• Migration of python configuration for Menu-aware monitoring successfully completed; Provides central monitoring functionality for slice groups & DQ

Next scheduled meeting: Friday 22 May (10:30 AM UK)

Summary of 24APR-15 meeting

Attending: Ben W, Ben S, Tim, Victoria, Christos

Minute scribe: Christos

Future framework (Ben)

Triggering on displaced vertices and GPU (Ben W, Tim)

Interface of menu-aware monitoring with DB (Ben S)

Offline Trigger (and Menu-aware) monitoring (Christos)

• Working on redesign of python class to provide central monitoring functionality for slice groups & DQ (with help from Tim);

Next scheduled meeting: Friday 8 May (10:30 AM UK) (TBC)

Summary of 20MAR-15 meeting

Attending: Ben W, Ben S, Tim, Christos

Minute scribe: Christos

Triggering on displaced vertices and GPU (Tim) 72 AtlasEdinburghGroup < Main < TWiki

Software performance (Ben & Andy)

• Stewart (Martin-Haugh) has requested some help from us on profiling and interpretation of Cuda output; (Ben promised that) minimal time is devoted on this

Future framework (Ben)

Triggering on displaced vertices and GPU (Ben S, Tim)

• Discussion on simple tracking algorithm demonstrating proof-of-principle • Goals for next meeting: ♦ Implement python-based event display to visualise signatures (Tim) ♦ Investigate potential tracking options from Run-1 and/or the market (Ben S)

Offline Trigger (and Menu-aware) monitoring (Christos)

• Redesign of python class to provide central monitoring functionality for slice groups & DQ (with help from Tim); Proposal sent to Data Quality group

Next scheduled meeting: TENTATIVELY on Friday 24 April (10:30 AM UK) (TBC)

Summary of 06MAR-15 meeting

Attending: Ben W, Yanyan, Andy, Tim, Christos

Minute scribe: Christos

Future framework (Ben)

• Work continues on the EventViews prototype. We have some more test cases, and an example that satisfies all tests thus far.

Andy

Rulebook (Yanyan)

Offline Trigger (and Menu-aware) monitoring (Christos)

• Discussions with Data Quality group on access to trigger monitoring categories • Redesign of python class to provide central monitoring functionality for slice groups & DQ (with help from Tim)

Software performance (Ben & Andy) 73 AtlasEdinburghGroup < Main < TWiki Next scheduled meeting: Friday 20 March (10:30 AM UK)

Summary of 20FEB-15 meeting

Attending: Ben W, Yanyan, Andy, Christos Apologies: Tim

Minute scribe: Christos

Future framework (Ben)

Andy

• Started new role as co-convener of the ATLAS Future Software and Technology Forum. Looking for people to join effort; Run-2 preparations understandably a major distraction

Trigger menu & dynamic prescales (Yanyan)

Offline Trigger (and Menu-aware) monitoring (Christos)

GPU algorithm proof-of-principle for displaced vertices (Ben, Andy, Tim)

• No progress recently

Next scheduled meeting: Friday 6 March (10:30 AM UK)

Summary of 06FEB-15 meeting

Attending: Ben W, Yanyan, Christos

Apologies: Andy, Tim

Minute scribe: Christos

Future framework (Ben)

• A draft of requirements report available for comments: https://cds.cern.ch/record/1974156 ? • Ben & Tomasz Bold to look at providing trigger demonstrators in new software framework

Trigger menu & dynamic prescales (Yanyan)

• Taking trigger online on-call shifts for M8 • Work on rule-book script continues

Offline Trigger (and Menu-aware) monitoring (Christos) 74 AtlasEdinburghGroup < Main < TWiki