DOCSLIB.ORG

Zabbix 4.2 Data Processing and More Sponsors Gold Sponsors Co-Organizer

Total Page：16

File Type：pdf, Size：1020Kb

Download full-text PDF Read full-text
Zabbix 4.2 Data Processing and More Sponsors Gold Sponsors Co-Organizer Zabbix 4.2 data processing and more Sponsors Gold sponsors Co-organizer 2 What is Zabbix? Zabbix is a universal Open Source enterprise level monitoring solution 3 4 We have found a good balance between giving away free software and having a sustainable growth 5 Free Software Services Services that save your time and money Free Software Services Services that save your time and money Customers in 75+ countries 8 Some of our users 9 Zabbix Real-time Alerting & Data collection problem Visualization Remediation detection 10 Where we are currently? 3.0 LTS 3.2 3.4 4.0 LTS 11 Zabbix 4.0 LTS 12 Data preprocessing { “host": { "name": "Linux #2356", "vms": [{ “name”: “vm034”, “network": { "read": “0xfa673”, "write": “0x45b30” } }, { “name”: “vm076”, “network": { "read": “0x76ab”, “write": “0xff3a” } }] } } 13 Data preprocessing "write": “0x45b30” } }, { “name”: “vm076”, “network": { "read": “0x76ab”, 0x76ab “write": “0xff3a” } }] JSON Path: .host.vms[1].network.read } } 14 Data preprocessing 0x76ab JSON Path: .host.vms[1].network.read 15 Data preprocessing 0x76ab 76ab Regexp: 0x(.*) 16 Data preprocessing 0x76ab 76ab 330379 Hex to Decimal 17 Data preprocessing 0x76ab 76ab 330379 338308096 KB -> bytes 18 Data preprocessing 19 Efficiency Zabbix server mysql[status] 20 Efficiency Master item 21 Efficiency Dependent items 22 Efficiency mysql[questions] mysql[status] Zabbix server mysql[reads] 23 Efficiency mysql[questions] mysql[status] Zabbix server mysql[reads] Performance, less user parameters, all logic in templates 24 Limitations 4.0 LTS 4.2 Not flexible enough for all use cases Relies on user parameters Not anymore! No support of preprocessing for LLD 25 Zabbix 4.2 ETA: March, 2019 26 What is the ultimate goal? 4.2 4.4 5.0 LTS No limits for data processing Versioning for templates Self-contained templates Host and template tags Official guidelines Official templates 27 Validation, discarding 1 values and setting errors 28 Validation In range Matches regular expression Does not match regular expression Check for error in JSON Check for error in XML Check for error using regular expression 29 On fail Preprocessing Discard value Set value to Set error to 30 Discard incorrect values N/A N/A (dropped!) 34 C 34 C 33 C 33 C 32 C 32 C 30 C 30 C 123 F Zabbix 123 F(dropped!) 31 Discard out of range values N/A N/A (dropped!) 34 34 33 33 999 999 (dropped!) 32 32 30 Zabbix 30 32 Use default if does not match OK OK ERR2 NOT OK(default!) OK OK OK OK ERR4 NOT OK(default!) NOT OK Zabbix NOT OK 33 Set error message if not in range 34 34 33 33 32 32 30 30 999 NOT SUPPORTED Zabbix Error:sensor hardware failure, out of range temperature. 34 Extract error message { “status”: “on”} on { “status”: “off”} off { “status”: “off”} off { “err”: “Node no NOT SUPPORTED longer exists”} Zabbix Error: Node no longer exists 35 2 Throttling 36 Process on value change 0 0 0 (dropped) 1 1 1 (dropped) 1 (dropped) 0 Zabbix 0 0 (dropped) 37 Subsampling 0s 0 0s 0 1s 1 1s 1 2s 0 2s 0 (dropped) 3s 0 (dropped) 4s 0 (dropped) 5s 0 6s 0 Zabbix (dropped) 7s 0 7s 0 (dropped) 8s 0 (dropped) 9s 0 38 Who is doing throttling 0 0 0 0 0 0 0 (dropped) 1 1 1 1 1 1 1 (dropped) 1 1 1 (dropped) 0 Agent 0 Proxy 0 0 0 0 0 Server (dropped) 39 Prometheus: 3 JS is not enough 40 Prometheus # HELP cpu_usage_system Telegraf collected metric # TYPE cpu_usage_system gauge cpu_usage_system{cpu="cpu-total",host="host1"} 1.1940298507220641 cpu_usage_system{cpu="cpu0",host="host1"} 1.1940298507220641 cpu_usage_system{cpu="cpu1",host="host1"} 1.1340298507220641 41 Prometheus Prometheus PromQL cpu_usage_system{cpu=“cpu-total"} # HELP cpu_usage_system Telegraf collected metric # TYPE cpu_usage_system gauge cpu_usage_system{cpu="cpu-total",host="host1"} 1.1940298507220641 1.1940298507220641 cpu_usage_system{cpu="cpu0",host="host1"} 1.1940298507220641 cpu_usage_system{cpu="cpu1",host="host1"} 1.1340298507220641 42 Discovery Prometheus PromQL wmi_logical_disk_free_bytes{volume =~”[A-C]:”} [ # HELP wmi_logical_disk_free_bytes Free space in bytes { (LogicalDisk.PercentFreeSpace) "name": "wmi_logical_disk_free_bytes", # TYPE wmi_logical_disk_free_bytes gauge "help": "Free space in bytes wmi_logical_disk_free_bytes{volume="C:"} 3.5180249088e+11 (LogicalDisk.PercentFreeSpace)", wmi_logical_disk_free_bytes{volume="D:"} 2.627731456e+09 "type": "gauge", wmi_logical_disk_free_bytes{volume="HarddiskVolume4"} 4.598e+08 "labels": { "volume": "C:" }, "value": "3.5180249088e+11", "line_raw": "wmi_logical_disk_free_bytes{volume=\"C:\"} 3.5180249088e+11" } ] 43 HTTP endpoint monitoring TEXT HTML JSON HTTP check XML Pre-processing History Prometheus Multiple metrics HTTP data processing 44 4 Ultimate flexibility 45 Challenges Converting C to F return (input - 32 ) * 5 / 9; 46 Challenges return (input.match(new RegExp( Word count param, 'g')) || []).length; 47 Challenges var data = JSON.parse(input); var count = 0; function iterate(obj) { for (var key in obj) { if (typeof(obj[key]) == 'object') { iterate(obj[key]); continue; JSON filtering } if (key == 'id' && obj[key] == param) count++; } } iterate(data); return count; 48 Ultimate test 49 50 No user parameters, no shell scripts, thus easy maintenance Super efficient, less impact on monitored devices due to bulk requests All complex logic is part of the template Templates becomes self-contained Services 5 TimescaleDB 52 Storage options MySQL PostgreSQL Oracle History DB2 ElasticSearch Zabbix 53 Getting performance TimescaleDB MySQL PostgreSQL Oracle DB2 Partitioning 54 And much more! 55 Zabbix 4.2 roadmap Zabbix 4.2 56 Zabbix capabilities 57 58 More than 300 integrations 59 60 61 62 It is a moderated list of all known solutions from community, vendors and partners! 63 https://share.zabbix.com https://www.zabbix.com/integrations 64 Thank you! Some of the used icons made by Freepik from www.flaticon.com.
Load more

Recommended publications
  • 5. Zabbix Appliance 5
    2021/07/12 12:09 1/8 5. Zabbix appliance 5. Zabbix appliance As an alternative to setting up manually or reusing existing server for Zabbix, users may download Zabbix appliance. To get started, boot the appliance and point your browser at the IP it has received over DHCP. Booting Zabbix appliance Zabbix appliance versions are based upon the following OpenSUSE versions: Zabbix appliance version OpenSUSE version 2.2.0 12.3 It is available in the following formats: vmdk (VMware/Virtualbox) OVF (Open Virtualisation Format) KVM CD ISO HDD/flash image Preload ISO Xen guest Microsoft VHD Preload USB Zabbix Documentation 2.2 - https://www.zabbix.com/documentation/2.2/ Last update: 2018/09/04 11:39 manual:appliance https://www.zabbix.com/documentation/2.2/manual/appliance It has Zabbix server configured and running on MySQL, as well as frontend available. The appliance has been built using SUSE Studio. 1 Changes to SUSE configuration There are some changed applied to the base OpenSUSE configuration. 1.1 MySQL configuration changes Binary log is disabled; InnoDB is configured to store data for each table in a separate file. 1.2 Using a static IP address By default the appliance uses DHCP to obtain IP address. To specify a static IP address: Log in as root user; Open file /etc/sysconfig/network/ifcfg-eth0 in your favourite editor; Set BOOTPROTO variable to static; Set IPADDR, NETMASK and any other parameters as required for your network; Create file /etc/sysconfig/network/routes. For the default route, use default 192.168.1.1 - - (replacing with your gateway address).
    [Show full text]
  • 5 Installation from Containers Docker
    2021/09/23 12:33 1/9 5 Installation from containers 5 Installation from containers Docker Zabbix provides Docker images for each Zabbix component as portable and self-sufficient containers to speed up deployment and update procedure. Zabbix components come with MySQL and PostgreSQL database support, Apache2 and Nginx web server support. These images are separated into different images. Docker base images Zabbix components are provided on Ubuntu, Alpine Linux and CentOS base images: Image Version alpine 3.9 ubuntu bionic centos latest All images are configured to rebuild latest images if base images are updated. Zabbix appliance images are based on Alpine Linux version 3.4, all other images are based on Alpine Linux 3.9. Docker file sources Everyone can follow Docker file changes using the Zabbix official repository on github.com. You can fork the project or make your own images based on official Docker files. Structure All Zabbix components are available in the following Docker repositories: Zabbix appliance with MySQL database support and Nginx web-server - zabbix/zabbix-appliance Zabbix agent - zabbix/zabbix-agent Zabbix server Zabbix server with MySQL database support - zabbix/zabbix-server-mysql Zabbix server with PostgreSQL database support - zabbix/zabbix-server-pgsql Zabbix web-interface Zabbix web-interface based on Apache2 web server with MySQL database support - zabbix/zabbix-web-apache-mysql Zabbix web-interface based on Apache2 web server with PostgreSQL database support - zabbix/zabbix-web-apache-pgsql Zabbix web-interface based on
    [Show full text]
  • Mysql Performance Monitoring with Zabbix an Alternative
    MySQL Performance Monitoring with Zabbix An alternative to the MySQL Enterprise Monitor? by Oli Sennhauser [email protected] http://www.fromdual.com www.fromdual.com 1 How many of you ... ● ¼ monitor their database servers? ● ¼ monitor their (MySQL) databases? ● ¼ monitor performance metrics? ● ¼ all the others: Why not? www.fromdual.com 2 Linux monitoring ● Question: What is your favourite Linux monitoring application? ● 1187 votes, April 2010 ● Manipulated? ● Lit: Linux Journal, [1] www.fromdual.com 3 What to monitor? ● Devices / Software ● Server, Router, Switches, I/O systems etc. ● Operating System, Networks, Applications, etc. ● Incidents ● DB down, Replication stopped, Server not reachable, etc. ● Critical Events ● Disk more than n% full or less than m Gbyte free, Replication more than n seconds lagging, Data node down, 100% CPU utilization, etc. → Alert, immediate intervention, fire fighting www.fromdual.com 4 What to monitor? ● Trends (includes time!) → Graphs ● How long does it take until ¼ ● ¼ my disk is full? ● ¼ my Index Memory is filled up? ● When does it happen? ● Peak? Backup? ● How often does it happen? Does it happen periodically? ● Once a day? Always at Sunday night? ● How does it correlate to other informations? ● I/O problems during our backup window? ● Reading the patterns! → this can help us to find the root cause of problems¼ www.fromdual.com 5 How to monitor? ● Basic solutions: ● top, vmstat, iostat, mytop, innotop, SHOW GLOBAL STATUS, SHOW INNODB STATUS ● CLI!, no graphs, no log term information, but good for adhoc analysis! ● Graphical solutions ● Nagios, Cactii, Zabbix, ¼ ● Typically NOT specialised in DB monitoring... www.fromdual.com 6 Focus ● Database + Server ● Trends Not the other stuff..
    [Show full text]
  • Clúster, Cloud Y Devops
    Clúster, Cloud y DevOps Remo Suppi Boldrito PID_00212475 GNUFDL • PID_00212475 Clúster, Cloud y DevOps Índice Introducción .......................................................... 5 Objetivos ............................................................... 8 1. Clusterización ..................................................... 9 1.1. Virtualización ................................................. 9 1.1.1. Plataformas de virtualización ......................... 10 1.2. Beowulf ....................................................... 12 1.2.1. ¿Cómo configurar los nodos? ......................... 14 1.3. Beneficios del cómputo distribuido ........................... 15 1.3.1. ¿Cómo hay que programar para aprovechar la concurrencia? ........................................ 17 1.4. Memoria compartida. Modelos de hilos (threading) ........... 19 1.4.1. Multihilos (multithreading)............................ 19 1.5. OpenMP ...................................................... 23 1.6. MPI, Message Passing Interface ................................. 27 1.6.1. Configuración de un conjunto de máquinas para hacer un clúster adaptado a OpenMPI ................ 28 1.7. Rocks Cluster ................................................. 31 1.7.1. Guía rápida de instalación ............................ 32 1.8. FAI ............................................................ 33 1.8.1. Guía rápida de instalación ............................ 34 1.9. Logs ........................................................... 36 1.9.1. Octopussy ...........................................
    [Show full text]
  • Centralized and Structured Log File Analysis with Open Source and Free Software Tools
    Bachelor Thesis Summer Semester 2013 at Fachhochschule Frankfurt am Main University of Applied Sciences Department of Computer Science and Engineering towards Bachelor of Science Computer Science submitted by Jens Kühnel Centralized and structured log file analysis with Open Source and Free Software tools 1. Supervisor: Prof. Dr. Jörg Schäfer 2. Supervisor: Prof. Dr. Matthias Schubert topic received: 11. 07. 2013 thesis delivered: 30. 08. 2013 Abstract This thesis gives an overview on the Open Source and Free Software tools available for a centralized and structured log file analysis. This includes the tools to convert unstructured logs into structured log and different possibilities to transport this log to a central analyzing and storage station. The different storage and analyzing tools will be introduced, as well as the different web front ends to be used by the system administrator. At the end different tool chains will be introduced, that are well tested in this field. Revisions Rev. 269: Official Bachelor these sent to FH Rev. 273: Removal of Affidavit, fix of Pagenumber left/right II Table of Contents 1 Introduction.......................................................................................................................................1 1.1 Selection criteria........................................................................................................................1 1.2 Programs that are included in this thesis...................................................................................2 1.3 What
    [Show full text]
  • The Open-‐Source Monitoring Landscape
    The Open-Source Monitoring Landscape Michael Merideth Sr. Director of IT, VictorOps [email protected], @vo_mike My History and Background • Working in IT since the mid 90’s • Mostly at startups in the Colorado Front Range area • Along for the ride during the “dot com boom” • Build my career using open-source tools Since the 90’s now, there’s been a sharp division in tools and methodology between the enterprise space and the startup and small business communi;es. Obviously, smaller businesses, especially in the tech sector, were early and eager adopters of open- source technology, and much quicker to learn to rely on open-source tool chains in business-cri;cal applica;ons. Up at the enterprise level, at the public companies, they’re only now fully-embracing Linux as a business-cri;cal tool, and I think that’s largely because “the enterprise” is star;ng to be defined by companies that either came up in the dot com era, like Google, or built the dot com era, like Sun, or Dell, or let’s say RedHat. So, the “enterprise” had their toolchain, built on commercial solu;ons like HPUX and OpenView and so on, and the startup community, the “dot com” community had a completely different toolchain, based on Linux, based on open standards and protocols, built with open-source components like GNU, and Apache, and ISC Bind and so on. I’m lucky enough that I’ve been able to spend my career in the startup sphere, working with that open-source toolchain. I started working in IT in the mid 90’s in the Colorado front range, and I’ve spent my ;me since then working for and consul;ng at early-stage startups and other “non enterprise” shops.
    [Show full text]
  • Gil André +33 (0)6 60 07 25 36
    ARCHITECT AND SYSTEM ADMINISTRATOR LINUX, UNIX, OPEN-SOURCE [email protected] GIL ANDRÉ +33 (0)6 60 07 25 36 PROFILE Architect and system administrator Linux, UNIX (Solaris, AIX, HP-UX), BSD and Mac OS X. More than 10 years of experience in demanding production environments. Excellent knowledge of the most common network protocols (SSH, SFTP, FTP, HTTP, etc), as well as CISCO hardware and virtualization technologies (VMWARE, VirtualBox, LXC). Programming in shell, Perl, Python. I am looking for a new position. Dynamic, bilingual in English, passionate about new technologies, I am able to bring perspective and energy to a new position. Result and service oriented, I am willing to relocate, looking for new challenges and new experiences. EXPERIENCE SENIOR LINUX ARCHITECT SAP Concur January 2019 – Today – Tasked with migrating internal services and applications to SAP products. – Task automation and infrastructure creation on Azure and AWS in an IaaS and PaaS mode. – DevOps team, applying Agile methodologies, with a Scrum Mas- ter certification obtained early 2019. – Creation of the main ELK platform in order to manage logs for several applications. – Management of the connections between internal applications and applications hosted on Azure. – Management of the application connections through internal certificate authorities. – Migration management from internal infrastructure to hyper scale suppliers such as AWS and Azure. – Technology environment: AWS, Azure, Ansible, Terraform, Docker, Linux, Python and Groovy. GIL ANDRE 166 RUE MONTMARTRE 75002 PARIS WWW.GILANDRE.NET ARCHITECT AND SYSTEM ADMINISTRATOR LINUX, UNIX, OPEN-SOURCE GIL ANDRÉ SENIOR LINUX SYSTEM ENGINEER SAP Concur Jan. 2016 – December 2018 – Responsible for part of the Production environment (EMEA/ US).
    [Show full text]
  • 1 Database Creation 1 Database Creation
    2021/03/24 23:50 1/3 1 Database creation 1 Database creation Overview A Zabbix database must be created during the installation of Zabbix server or proxy. This section provides instructions for creating a Zabbix database. A separate set of instructions is available for each supported database. schema.sql, images.sql and data.sql files are located in the database subdirectory of Zabbix sources. If Zabbix was installed from distribution packages, refer to the distribution documentation. For a Zabbix proxy database, only schema.sql should be imported (no images.sql nor data.sql) UTF-8 is the only encoding supported by Zabbix. It is known to work without any security flaws. Users should be aware that there are known security issues if using some of the other encodings. MySQL Character set utf8 and utf8_bin collation is required for Zabbix server to work properly with MySQL database. shell> mysql -uroot -p<password> mysql> create database zabbix character set utf8 collate utf8_bin; mysql> create user 'zabbix'@'localhost' identified by '<password>'; mysql> grant all privileges on zabbix.* to 'zabbix'@'localhost'; mysql> quit; Zabbix server prior to 4.4 cannot work correctly with newer MariaDB versions out of the box. See Known issues for required database modifications. If you are installing from Zabbix packages, stop here and continue with instructions for Debian/Ubuntu or RHEL/CentOS to import the data into the database. If you are installing Zabbix from sources, proceed to import the data into the database: shell> cd database/mysql shell> mysql -uzabbix -p<password> zabbix < schema.sql # stop here if you are creating database for Zabbix proxy shell> mysql -uzabbix -p<password> zabbix < images.sql shell> mysql -uzabbix -p<password> zabbix < data.sql PostgreSQL You need to have database user with permissions to create database objects.
    [Show full text]
  • Zabbix Agent
    Installation of Zabbix server for Ubuntu 16.04 and ubuntu 16.10 Zabbix server : Zabbix is an Open Source, high-level enterprise software designed to monitor and keep track of networks, servers and applications in real time. Build in a server-client model, Zabbix can collect different type of data than are used to create historical graphics and output performance or load trends of the monitored targets. The server has the ability to check standard networking services (HTTP, FTP, SMTP, IMAP etc) without the need to install extra software on the monitored hosts. However, in order to gather data and create statistics about local services or other specific system resources that run on remote instances, such as CPU, disks, internal system process, RAM, etc, you need to install and configure a Zabbix agent. 1. Install a LAMP stack : Zabbix will need web server, a data base and PHP in order to correctly function,setting up a LAMP stack (linux, Apache,MySQL,and PHP) fulfills all of these requirements. sudo apt-get install lamp-server^ 2. Adding Apt Repository Before installing Zabbix first configure zabbixzone rpm repository in our system using following commands. Latest version of Zabbix 3.2 a. wget http://repo.zabbix.com/zabbix/3.2/ubuntu/pool/main/z/zabbix- release/zabbix-release_3.2-1+xenial_all.deb b. sudo dpkg -i zabbix-release_3.2-1+xenial_all.deb c. sudo apt-get update 3. Install Zabbix Server After adding zabbix apt repository in your system use following command to install Zabbix using mysql database. sudo apt-get install zabbix-server-mysql zabbix-frontend-php 4.
    [Show full text]
  • Self-Service Monitoring Through Versioned Infrastructure and Configuration As Code
    NADOG Self-Service Monitoring through versioned Infrastructure and Configuration as Code February 24th, 2021 Self-Service Monitoring through versioned Infrastructure and Configuration as Code ABOUT ME Carlos Munoz Robles Global e2e Monitoring Lead [email protected] https://www.linkedin.com/in/carlosmur What I love about my current job position as a Global e2e monitoring lead is the chance to foster the DevOps culture across Allianz, and make impact on our developer’s day-to- day work, offering them a state of the art solution in order to apply the DevOps principles in an easier way. © Copyright Allianz 2 MONITORING LEGACY © Copyright Allianz 3 Self-Service Monitoring through versioned Infrastructure and Configuration as Code COMPLEX MONITORING ECOSYSTEM DCS – HC DCS- HC DCS AZ AT DCS - IBM AGCS on prem public cloud Mainframe AZ Applications Nagios Nagios Cloud watch System AZ Applications AZ Italy Tivoli vROPS Azure automation, Prometheus/ Grafana / Netcool Icinga AZELK Applications Nagios monitoring Netview, ZIS Telematics Prometheus/ Grafana / AZELK Applications Planed: Planed Nagios Prometheus/ Grafana / Applications AZELK Applications AZ UK Infrastructure ZENOSS ZENOSS Prometheus/ Grafana / - AZ Tech Branches ELK Prometheus/ Grafana / BAC AZ FR ELK OE IT Network devices Network QoS Tivoli V5 Traps & metrics FPI Oracle Zabbix Grafana RFP/PoC ongoing Exadata ELK netscout …… APM APM Filenet Oracle Dynatrace Appdymamics (AZ (AZD, AZ FR, AZ Tech, AZ Australia) Nagios Cloud control AZ Tech aplications UK, AZ Italy, Euler Fileservice
    [Show full text]
  • 1 Database Creation Scripts 1 Database Creation Scripts
    2021/09/15 10:48 1/3 1 Database creation scripts 1 Database creation scripts Overview A Zabbix database must be created during the installation of Zabbix server or proxy. This section provides scripts for creating a Zabbix database. A separate schema script is provided for each supported database. schema.sql, images.sql and data.sql files are located in the database subdirectory of Zabbix sources. If Zabbix was installed from distribution packages, refer to the distribution documentation. For a Zabbix proxy database, only schema.sql should be imported (no images.sql nor data.sql) UTF-8 is the only encoding supported by Zabbix. It is known to work without any security flaws. Users should be aware that there are known security issues if using some of the other encodings. Scripts MySQL Character set utf8 and utf8_bin collation is required for Zabbix server to work properly with MySQL database. We assume that a username user with password password exists and has permissions to create database objects. shell> mysql -u<username> -p<password> mysql> create database zabbix character set utf8 collate utf8_bin; mysql> quit; shell> mysql -u<username> -p<password> zabbix < database/mysql/schema.sql # stop here if you are creating database for Zabbix proxy shell> mysql -u<username> -p<password> zabbix < database/mysql/images.sql shell> mysql -u<username> -p<password> zabbix < database/mysql/data.sql PostgreSQL We assume that a username user exists and has permissions to create database objects. shell> psql -U <username> psql> create database 'zabbix'
    [Show full text]
  • Cern Controls Open Source Monitoring System F
    17th Int. Conf. on Acc. and Large Exp. Physics Control Systems ICALEPCS2019, New York, NY, USA JACoW Publishing ISBN: 978-3-95450-209-7 ISSN: 2226-0358 doi:10.18429/JACoW-ICALEPCS2019-MOPHA085 CERN CONTROLS OPEN SOURCE MONITORING SYSTEM F. Locci*, F. Ehm, L. Gallerani, J. Lauener, J. Palluel, R. Voirin CERN, Geneva, Switzerland Abstract The CERN accelerator controls infrastructure spans sev- eral thousands of computers and devices used for Acceler- ator control and data acquisition. In 2009, a fully in-house, CERN-specific solution was developed (DIAMON) to monitor and diagnose the complete controls infrastructure. The adoption of the solution by a large community of users, followed by its rapid expansion, led to a final product that became increasingly difficult to operate and maintain. This was predominantly due to the multiplicity and redundancy of services, centralized management of data acquisition and visualization software, its complex configuration and its intrinsic scalability limits. At the end of 2017, a com- pletely new monitoring system for the beam controls infra- structure was launched. The new "COSMOS" system was developed with two main objectives in mind: firstly, de- tecting instabilities and preventing breakdowns of the con- trol system infrastructure. Secondly, providing users with Figure 1: Main types of control system hosts. a more coherent and efficient solution for development of their specific data monitoring agents and related dash- OBJECTIVES AND SCOPE boards. This paper describes the overall architecture of Reviewing the existing system and evaluating major COSMOS, focusing on the conceptual and technological products in the monitoring field (collectd, Icinga2, Zabbix, choices for the system.
    [Show full text]