Hi,
We have tried to install netdata on our offline node as it is described in below link.
Installation completes. But we experience several issue with this installation.
First of all installation is done to “/opt” directory as default instead of “/etc”.
Secondly, netdata commands are not functional after the netdata installation.
[root@compute08 netdata-offline]# netdata -v
-bash: netdata: command not found
And finally, we receive an error in the outputs of netdata agent which is in below.
Error message in agent;
Mar 02 13:59:13 caucpcpt08.turkcell.tgc [496411]: running: exec /opt/netdata/usr/libexec/netdata/plugins.d/cgroup-network-helper.sh --cgroup ‘/sys/fs/cgroup/cpu,cpuacct/machine.slice/machine-qemu\x2d2\x2dinstance\x2d00001056.scope’
Mar 02 13:59:13 caucpcpt08.turkcell.tgc [496411]: child pid 496412 exited with code 1.
Total output of netdata agent;
[root@caucpcpt08 netdata-offline]# systemctl status netdata
● netdata.service - Real time performance monitoring
Loaded: loaded (/usr/lib/systemd/system/netdata.service; enabled; vendor preset: disabled)
Active: active (running) since Thu 2023-03-02 13:59:01 +03; 17min ago
Process: 495586 ExecStartPre=/bin/chown -R netdata /run/netdata (code=exited, status=0/SUCCESS)
Process: 495584 ExecStartPre=/bin/mkdir -p /run/netdata (code=exited, status=0/SUCCESS)
Process: 495582 ExecStartPre=/bin/chown -R netdata /opt/netdata/var/cache/netdata (code=exited, status=0/SUCCESS)
Process: 495580 ExecStartPre=/bin/mkdir -p /opt/netdata/var/cache/netdata (code=exited, status=0/SUCCESS)
Main PID: 495588 (netdata)
Tasks: 187 (limit: 112716)
Memory: 212.6M
CGroup: /system.slice/netdata.service
├─495588 /opt/netdata/bin/srv/netdata -P /run/netdata/netdata.pid -D
├─495591 /opt/netdata/bin/srv/netdata --special-spawn-server
├─495842 /opt/netdata/usr/libexec/netdata/plugins.d/go.d.plugin 1
├─495853 /usr/bin/python3 /opt/netdata/usr/libexec/netdata/plugins.d/python.d.plugin 1
├─495856 bash /opt/netdata/usr/libexec/netdata/plugins.d/tc-qos-helper.sh 1
├─495879 /opt/netdata/usr/libexec/netdata/plugins.d/apps.plugin 1
└─518470 /usr/sbin/tc -s qdisc show dev ens5f3
Mar 02 13:59:01 caucpcpt08.turkcell.tgc [495857]: thread created with task id 495921
Mar 02 13:59:01 caucpcpt08.turkcell.tgc [495857]: set name of thread 495921 to EBPF FD
Mar 02 13:59:01 caucpcpt08.turkcell.tgc [495857]: thread created with task id 495919
Mar 02 13:59:01 caucpcpt08.turkcell.tgc [495857]: set name of thread 495919 to EBPF SWAP
Mar 02 13:59:01 caucpcpt08.turkcell.tgc [495857]: thread created with task id 495917
Mar 02 13:59:01 caucpcpt08.turkcell.tgc [495857]: set name of thread 495917 to EBPF CACHESTAT
Mar 02 13:59:01 caucpcpt08.turkcell.tgc [495857]: thread with task id 495924 finished
Mar 02 13:59:02 caucpcpt08.turkcell.tgc [495879]: Using now_boottime_usec() for uptime (dt is 8 ms)
Mar 02 13:59:13 caucpcpt08.turkcell.tgc [496411]: running: exec /opt/netdata/usr/libexec/netdata/plugins.d/cgroup-network-helper.sh --cgroup ‘/sys/fs/cgroup/cpu,cpuacct/machine.slice/machine-qemu\x2d2\x2dinstance\x2d00001056.scope’
Mar 02 13:59:13 caucpcpt08.turkcell.tgc [496411]: child pid 496412 exited with code 1.
We are also using netdata 1.18 version in out environment. They are also installed with offline installation with following command.
bash kickstart.sh --local-files netdata-v1.18.1.tar.gz sha256sums.txt go.d.plugin-v0.10.0.linux-amd64.tar.gz config.tar.gz install-required-packages.sh --dont-wait
But we noticed that “–local-files” option can no longer be used with new release of kickstart.sh.
With our previous installation method, netdata is installed under “/etc” directory as default. Netadata command can be used without manual adjusment. And we dont see any error in the outputs of netdata agent. I am sharing that outputs as well.
[root@compute66 ~]# netdata -v
netdata v1.18.1
[root@compute66 ~]# systemctl status netdata
● netdata.service - Real time performance monitoring
Loaded: loaded (/usr/lib/systemd/system/netdata.service; enabled; vendor preset: disabled)
Active: active (running) since Fri 2023-02-24 14:02:41 +03; 5 days ago
Main PID: 58759 (netdata)
Tasks: 39 (limit: 283269)
Memory: 290.6M
CGroup: /system.slice/netdata.service
├─ 58759 /usr/sbin/netdata -P /var/run/netdata/netdata.pid -D -W set global process scheduling policy keep -W set global OOM score keep
├─ 58792 /usr/bin/python /usr/libexec/netdata/plugins.d/python.d.plugin 1
├─ 58799 /usr/libexec/netdata/plugins.d/go.d.plugin 1
└─680103 bash /usr/libexec/netdata/plugins.d/tc-qos-helper.sh 1
Feb 24 14:02:41 caucpcpt66.turkcell.tgc systemd[1]: Starting Real time performance monitoring…
Feb 24 14:02:41 caucpcpt66.turkcell.tgc systemd[1]: Started Real time performance monitoring.
Feb 24 14:02:41 caucpcpt66.turkcell.tgc netdata[58759]: SIGNAL: Not enabling reaper
Feb 24 14:02:41 caucpcpt66.turkcell.tgc netdata[58759]: 2023-02-24 14:02:41: netdata INFO : MAIN : SIGNAL: Not enabling reaper
Can you please guide us in this matter ? Is there any alternative way to install netdata with newer version than what we have tried ? Can we correct installation path during the installation in order to install netdata to “/etc” directory to make it functional as default ? Is there any way to use “–local-files” option with netdata 1.38 ?
Or what we have experience with this installation of netdata version 1.38 is expected ? If it is expected outcome how should we approach to correct it ?
Thank you in advance.
Kubilay