JOURNÉE DE RENCONTRE DES UTILISATEURS DU PÔLE DE CALCUL INTENSIF POUR LA MER
PIERRE COTTY Le programme de la journée
• 9 h 40 - 12 h 10 DATARMOR: nouveau périmètre, nouvelles perspectives
• Pause déjeuner : buffet
• 14 h 00 - 16 h 30 DATARMOR: nouveaux champs d'applications scientifiques
• Poster et Discussions autour d’un pot
17/05/2018 2 DATARMOR AND N E W T O O L S Tina ODAKA DATARMOR
17/05/2018 4 ACCES CLIENTS (10 Gigabit Ethernet connected to IFREMER and INFUSER network (SHOM / IUEM / ENSTA Bretagne Cluster HPC
426 Tflops 11 088 cores 396 Nodes Login nodes
PBS Pro; sharing computing Batch system: resources PBS Pro
InfiniBand FDR 17/05/2018 5 DATARMOR: not only HPC
Cluster SMP Cluster Cluster HPC VIS
High speed Cluster SCRATCH Network WEB Infini Band
DATA DATAREF HOME DATA 17/05/2018 WORK 6 DISK • DATAREF (LUSTRE, 1.5PB = 1395TiB) • Reference data (next presentation) • DATAWORK (GPFS, 5PB = 4500TiB) • Work data • User space and project space • SCRATCH (LUSTRE 0.5PB) PB ? TiB?? • Scratch file for HPCcomparisons computation. with International System of Units (SI) prefixes • 15 days max one kibibit 1 Kibit = 210 bit = 1024 bit one kilobit 1 kbit = 103 bit = 1000 bit • DATAHOME (NFS, 0.04PB)one mebibyte 1 MiB = (210)2 B = 1 048 576 B • Source codes and softwaresone megabyte 1 MB = (103)2 B = 1 000 000 B • with backup ( tape, inone a gibibytedifferent1 GiBbuilding= (210)3 B) = 1 073 741 824 B one gigabyte 1 GB = (103)3 B = 1 000 000 000 B byte = octet( French) TiB (tebibyte) = Tio (French tébioctet) 17/05/2018 7 Clustre WEB, SMP, VIS • Cluster SMP • 1 node with 240 cores, 5 TB RAM • PBS Pro • Jobs only for huge memory, or many CPU cores. • Cluster VIS • 2 nodes each with: • 2 GPU (NVIDIA Quadro K6000: 2880 cuda cores, 12GB memory) • 2 Intel Cpu 2.2 Ghz each with 10 cores • PBS Pro • Visualisation. • Cluster WEB • 10 servers • Based on vmware virtual machine, and soon in docker/kubernetes • Hosting web services for datarmor, like VRE
17/05/2018 8 New tools on DATARMOR
17/05/2018 9 VRE: virtual research enviroment Complex system but simple access
SeaDatacloud, Emodnet …
17/05/2018 10 Traditional access
‘ssh’ : terminal, command line,,, Must have basic linux knowledge.
17/05/2018 11 Challenge DATARMOR more flexible (web, click, ,, ) access Less of : vi, ssh, fortran, mpi
Flexible, and easy access should speed up the learning/development/analysis time for users. It can lower the barrier for ‘new users’ non traditional users.
It might slowdown computing time, but if it globally wins the time from development through having ‘result’ in a graph to be putted in a paper, whats the harm of slowing down a bit of computing time?
How to co-habite traditional HPC users and new users?
17/05/2018 12 https://datarmor-vis.Ifremer.fr first step for VRE: example Visit
Remote access to GPU Co-working possibilities PBS Pro controls the access. Cohabitation with traditional usage 17/05/2018 13 https://datarmor-web.Ifremer.fr
• Jupyter notebook: interactive usage of computing power through PBS Pro • Netcdf related graphical tools (python) • Julia https://julialang.org • high performance, altenative of python?? • DIVA (fortran-mpi to Julia) • Pyspark • session spark end of this morning! • Machine learning tools through conda • Or other GUI tools…
Compmression of image: interface by
17/05/2018 ‘nomachine’ software. 14 Virtual environment: integration with PBSPRO
GARAXY @ DATARMOR Benefits: Bioinformatics web-tools • Light weight • Can share environment between different architectures. • Keep same environments as your PC/datarmor
Implementations @datamor • conda • IFREMER developed Docker integration to PBS pro.
PBS Pro controls the access. Cohabitation with traditional usage DATARMOR: status of use
17/05/2018 16 Reserved resources en K hours/month
6000
5000
4000
3000
2000
1000
0 mai-17 juin-17 juil.-17 août-17 sept.-17 oct.-17 nov.-17 déc.-17 janv.-18 févr.-18 mars-18 avr.-18
17/05/2018 17 Reserved CPU cores resources (%)
80,00%
70,00%
60,00%
50,00%
40,00%
30,00%
20,00%
10,00%
0,00% juil.-17 août-17 sept.-17 oct.-17 nov.-17 déc.-17 janv.-18 févr.-18 mars-18 avr.-18
HPCSIMPLE HPC HYPERHREAD SMP VISU
17/05/2018 18 Use of DATAWORK (TiB)
4000 MAX
3500 4500 TiB
3000
2500
2000
1500
1000
500
0 juil.-17 août-17 sept.-17 oct.-17 nov.-17 déc.-17 janv.-18 févr.-18 mars-18 avr.-18
Datawork alloué (Tio) Datawork occupé (Tio)
17/05/2018 19 Upgrade 2018
• Increase the capacity of datawork 1.5PB =1364TiB • cluster-web • Summer 2018
17/05/2018 20 DATARMOR is not only HPC DATARMOR and (Virtual) research environment Upgrade 2018 coming SOON
THANK YOU
17/05/2018 21