Grafana + InfluxDB
Introduction
In order to monitor the HELIOS system, for example, the threshold, the tigger rate, the buffer size, etc. We monitor and save those data into a database managed by InfluxDB. The database is further read by Grafana for display.
For more information on InfluxDB and Grafana, see:
Present setting
Since we move the database and grafana from HELIOSDB to MAC2017 from Jan, 2021
The idea is the same, the MAC2017 host the influxDB and Grafana.
Both of them in installed by homebrew
brew install influxdb@1 brew install grafana
After installation, to make the influxdb and grafana start on boot
brew service start influxdb@1 brew service start grafana
setting for HELIOSDB (obsolete)
The data (e.g. trigger Rate, threshold, Buffer ) must be taking in digios1, the DAQ.
Since the DAQ is running on a 32-bit system. the influxDB is unstable.
The database was installed in heliosDB.onenet or heliosDB.
Thus, the data will be push to heliosDB.
To run the monitor program, login to the DAQ (digios1.onenet)
digios1$ Helios_Database Start
To stop the monitor program,
digios1$ Helios_Database Stop
Grafana was also installed in heliosDB.
To run Grafana, from any browser, within onenet, type
http://heliosDB.onenet:3000
if no webpage found, probably the Grafana server is not started. To start the Grafana server
sudo service grafana-server start
Setup InfluxDB
MAC2017
to install
brew install influxdb@1
it is important to use the 1.8.x version of the influxdb, unless someone update the whole DAQ for 2.X version.
to run the influxDB server
brew service start influxdb@1
to restart the server
brew service restart influxdb@1
64-bit linux
For 64bit-linux, the setup is straight forward.
For example, in Ubuntu-18.x, simply type
sudo apt-get install influxdb
The influxdb contains 2 main programs,
- influx, for interactive database operations
- influxd, a daemon run in background, for receiving query from port 8086
To run the influxd
sudo service influxdb start
Setup Grafana
MAC
brew install grafana brew services start grafana
in case need to restart
brew services restart grafana
linux
sudo apt-get update sudo apt-get install grafana
Or see Grafana webpage, straight forward.
SSH Tunneling to mac2017 from outside
Since the Grafana is installed in heliosDB inside onenet. There is no simple way to check the Grafana from outside.
One solution is using sonata.phy.anl.gov via ssh tunneling.
ssh -L 9000:localhost:3000 -J <userName>@login.phy.anl.gov heliosdigios@mac2017
This command let you port forwarding from mac2017:3000 to localhost:9000.
After typing this in terminal, use any browser, type http://localhost:9000
To push the Grafana screenshot to ANL web page
we store a screenshot in http://www.phy.anl.gov/atlas/helios/grafanaElog.jpg
A bash script in heliosDB is coded to take the screenshot and push it to the webpage.
In order to run for every 60 sec, we use the "watch" command
heliosDB:~>watch -n 60 ./GrafanaWeb.sh
Edit login timeout
Grafana will logout user after 7 days. To change that, edit
linux :/etc/grafana/grafana.ini Mac : /usr/local/etc/grafana/grafana.ini
under the section [auth]. change the
login_maximum_inactive_lifetime_days = 300 login_maximum_lifetime_days = 300 token_rotation_interval_minutes = 432000
and restart Grafana.
To use dramatic sound alarm for Grafana
heliosDB:~>./NewSoundAlarm.sh