Two problems with Netdata on Manjaro Linux

peracchi · May 2, 2024, 1:51pm

Netdata is an amazing program! And when I discovered that its creator is none other than the “father” of Firehol, that’s when I said to myself: I have to know this software!

I installed Netdata on Manjaro Linux. “Install” is the way to say, just copy and paste a command line and that’s it!

I know that Manjaro Linux is not one of the approved distributions but even so the “installation” went apparently without any problems and everything seems to work with the exception of two problems:

no log is displayed in the “Logs” tab, there is only the Netdata logo pulsing above “Loading logs…”
integration with Fail2ban is not working although the fail2ban program is working perfectly; I found two lines indicating an error but I couldn’t figure out what the problem could be on my own.

Below are the two error lines related to fail2ban and the complete output of the Netdata installation process on Manjaro Linux.

ERR fail2ban/fail2ban.go:83 error on '/opt/netdata/usr/libexec/netdata/plugins.d/ndsudo fail2ban-client-status': exit status 255 collector=fail2ban job=fail2ban
ERR module/job.go:238 check failed collector=fail2ban job=fail2ban

[peracchi@vps ~]$ curl https://get.netdata.cloud/kickstart.sh > /tmp/netdata-kickstart.sh && sh /tmp/netdata-kickstart.sh --nightly-channel --claim-token Iz5ykGYQdVeMRDrrO65Rn5rfPubIoomNfCTg7lJjFI0PwOroh-7LwSmZB5f5mtaWRxCk0uR1MuyTcmi-jDtE8IYhE7njlXff7HUUQK_t-rgv0rVcvlyeTudharHxGoN_mXWX4bQ --claim-rooms c7712580-24af-4cbc-9c05-7196e3214052 --claim-url https://app.netdata.cloud
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
100 90871  100 90871    0     0   453k      0 --:--:-- --:--:-- --:--:--  455k

 --- Using /tmp/netdata-kickstart-MniY1esn5B as a temporary directory. ---
 --- Checking for existing installations of Netdata... ---
 --- No existing installations of netdata found, assuming this is a fresh install. ---
 --- Attempting to install using native packages... ---
 WARNING  We do not provide native packages for manjaro.

 WARNING  Could not install native binary packages, falling back to alternative installation method.

[/tmp/netdata-kickstart-MniY1esn5B]$ sh -c /usr/bin/curl https://github.com/netdata/netdata-nightlies/releases/latest -s -L -I -o /dev/null -w '%{url_effective}' | grep -Eo '[^/]+$'
 OK

 --- Attempting to install using static build... ---
[/tmp/netdata-kickstart-MniY1esn5B]$ /usr/bin/curl --fail -q -sSL --connect-timeout 10 --retry 3 --output /tmp/netdata-kickstart-MniY1esn5B/netdata-x86_64-latest.gz.run https://github.com/netdata/netdata-nightlies/releases/download/v1.45.0-326-nightly/netdata-x86_64-latest.gz.run
 OK

[/tmp/netdata-kickstart-MniY1esn5B]$ /usr/bin/curl --fail -q -sSL --connect-timeout 10 --retry 3 --output /tmp/netdata-kickstart-MniY1esn5B/sha256sum.txt https://github.com/netdata/netdata-nightlies/releases/download/v1.45.0-326-nightly/sha256sums.txt
 OK

 --- Installing netdata ---
Root privileges required to run sh /tmp/netdata-kickstart-MniY1esn5B/netdata-x86_64-latest.gz.run --
[/tmp/netdata-kickstart-MniY1esn5B]$ sudo sh /tmp/netdata-kickstart-MniY1esn5B/netdata-x86_64-latest.gz.run --

  ^
  |.-.   .-.   .-.   .-.   .  netdata
  |   '-'   '-'   '-'   '-'   real-time performance monitoring, done right!
  +----+-----+-----+-----+-----+-----+-----+-----+-----+-----+-----+-----+--->

  (C) Copyright 2017-2023, Costa Tsaousis
  All rights reserved
  Released under GPL v3+

  You are about to install netdata to this system.
  netdata will be installed at:

                    /opt/netdata

  The following changes will be made to your system:

  # USERS / GROUPS
  User 'netdata' and group 'netdata' will be added, if not present.

  # LOGROTATE
  This file will be installed if logrotate is present.

   - /etc/logrotate.d/netdata

  # SYSTEM INIT
  If a supported init system is detected, appropriate configuration will be
  installed to allow Netdata to run as a system service. We currently support
  systemd, OpenRC, LSB init scripts, and traditional init.d setups, as well as
  having experimental support for runit.


  This package can also update a netdata installation that has been
  created with another version of it.

  Your netdata configuration will be retained.
  After installation, netdata will be (re-)started.

  netdata re-distributes a lot of open source software components.
  Check its full license at:
  https://github.com/netdata/netdata/blob/master/LICENSE
Please type y to accept, n otherwise: y
Creating directory /opt/netdata
Verifying archive integrity...  100%   MD5 checksums are OK. All good.
Uncompressing netdata, the real-time performance and health monitoring system  100%
 --- Attempt to create user/group netdata/netadata ---
Adding netdata user group ...
[/opt/netdata]# groupadd -r netdata
 OK  ''

Adding netdata user account with home /opt/netdata ...
[/opt/netdata]# useradd -r -g netdata -c netdata -s /usr/bin/nologin --no-create-home -d /opt/netdata netdata
 OK  ''

 --- Add user netdata to required user groups ---
Adding netdata user to the docker group ...
[/opt/netdata]# usermod -a -G docker netdata
 OK  ''

Group 'nginx' does not exist.
Group 'varnish' does not exist.
Group 'haproxy' does not exist.
Adding netdata user to the adm group ...
[/opt/netdata]# usermod -a -G adm netdata
 OK  ''

Group 'nsd' does not exist.
Group 'proxy' does not exist.
Group 'squid' does not exist.
Group 'ceph' does not exist.
Adding netdata user to the nobody group ...
[/opt/netdata]# usermod -a -G nobody netdata
 OK  ''

Group 'I2C' does not exist.
 --- Install logrotate configuration for netdata ---
[/opt/netdata]# cp /opt/netdata/usr/lib/netdata/system/logrotate/netdata /etc/logrotate.d/netdata
 OK  ''

[/opt/netdata]# chmod 644 /etc/logrotate.d/netdata
 OK  ''

 --- Telemetry configuration ---
You can opt out from anonymous statistics via the --disable-telemetry option, or by creating an empty file /opt/netdata/etc/netdata/.opt-out-from-anonymous-statistics

 --- Install netdata at system init ---
Installing systemd service...
Created symlink /etc/systemd/system/multi-user.target.wants/netdata.service -> /usr/lib/systemd/system/netdata.service.
 --- Install (but not enable) netdata updater tool ---
Update script is located at /opt/netdata/usr/libexec/netdata/netdata-updater.sh

 --- creating quick links ---
[/opt/netdata]# ln -s bin sbin
 OK  ''

[/opt/netdata/usr]# ln -s ../bin bin
 OK  ''

[/opt/netdata/usr]# ln -s ../bin sbin
 OK  ''

[/opt/netdata/usr]# ln -s . local
 OK  ''

[/opt/netdata]# ln -s etc/netdata netdata-configs
 OK  ''

[/opt/netdata]# ln -s usr/share/netdata/web netdata-web-files
 OK  ''

[/opt/netdata]# ln -s usr/libexec/netdata netdata-plugins
 OK  ''

[/opt/netdata]# ln -s var/lib/netdata netdata-dbs
 OK  ''

[/opt/netdata]# ln -s var/cache/netdata netdata-metrics
 OK  ''

[/opt/netdata]# ln -s var/log/netdata netdata-logs
 OK  ''

[/opt/netdata/etc/netdata]# rm orig
 OK  ''

[/opt/netdata/etc/netdata]# ln -s ../../usr/lib/netdata/conf.d orig
 OK  ''

 --- fix permissions ---
[/opt/netdata]# chmod g+rx,o+rx /opt
 OK  ''

[/opt/netdata]# find /opt/netdata -type d -exec chmod go+rx {} +
 OK  ''

[/opt/netdata]# chown -R netdata:netdata /opt/netdata/var
 OK  ''

[/opt/netdata]# chown -R root:netdata /opt/netdata/usr/libexec/netdata/plugins.d/ebpf.d
 OK  ''

 --- changing plugins ownership and permissions ---
[/opt/netdata]# chown root:netdata usr/libexec/netdata/plugins.d/ndsudo
 OK  ''

[/opt/netdata]# chown root:netdata usr/libexec/netdata/plugins.d/apps.plugin
 OK  ''

[/opt/netdata]# chown root:netdata usr/libexec/netdata/plugins.d/perf.plugin
 OK  ''

[/opt/netdata]# chown root:netdata usr/libexec/netdata/plugins.d/slabinfo.plugin
 OK  ''

[/opt/netdata]# chown root:netdata usr/libexec/netdata/plugins.d/debugfs.plugin
 OK  ''

[/opt/netdata]# chown root:netdata usr/libexec/netdata/plugins.d/ioping
 OK  ''

[/opt/netdata]# chown root:netdata usr/libexec/netdata/plugins.d/cgroup-network
 OK  ''

[/opt/netdata]# chown root:netdata usr/libexec/netdata/plugins.d/local-listeners
 OK  ''

[/opt/netdata]# chown root:netdata usr/libexec/netdata/plugins.d/network-viewer.plugin
 OK  ''

[/opt/netdata]# chown root:netdata usr/libexec/netdata/plugins.d/ebpf.plugin
 OK  ''

[/opt/netdata]# chown root:netdata usr/libexec/netdata/plugins.d/nfacct.plugin
 OK  ''

[/opt/netdata]# chown root:netdata usr/libexec/netdata/plugins.d/python.d.plugin
 OK  ''

[/opt/netdata]# chown root:netdata usr/libexec/netdata/plugins.d/charts.d.plugin
 OK  ''

[/opt/netdata]# chown root:netdata usr/libexec/netdata/plugins.d/go.d.plugin
 OK  ''

[/opt/netdata]# chown root:netdata usr/libexec/netdata/plugins.d/ioping.plugin
 OK  ''

[/opt/netdata]# chown root:netdata usr/libexec/netdata/plugins.d/cgroup-network-helper.sh
 OK  ''

[/opt/netdata]# setcap cap_dac_read_search,cap_sys_ptrace=ep usr/libexec/netdata/plugins.d/apps.plugin
 OK  ''

[/opt/netdata]# setcap cap_dac_read_search=ep usr/libexec/netdata/plugins.d/slabinfo.plugin
 OK  ''

[/opt/netdata]# setcap cap_dac_read_search=ep usr/libexec/netdata/plugins.d/debugfs.plugin
 OK  ''

[/opt/netdata]# setcap cap_perfmon=ep usr/libexec/netdata/plugins.d/perf.plugin
 OK  ''

[/opt/netdata]# setcap cap_dac_read_search+epi cap_net_admin+epi cap_net_raw=eip usr/libexec/netdata/plugins.d/go.d.plugin
 OK  ''

[/opt/netdata]# chmod 4750 usr/libexec/netdata/plugins.d/ioping
 OK  ''

[/opt/netdata]# chmod 4750 usr/libexec/netdata/plugins.d/cgroup-network
 OK  ''

[/opt/netdata]# chmod 4750 usr/libexec/netdata/plugins.d/local-listeners
 OK  ''

[/opt/netdata]# chmod 4750 usr/libexec/netdata/plugins.d/network-viewer.plugin
 OK  ''

[/opt/netdata]# chmod 4750 usr/libexec/netdata/plugins.d/ebpf.plugin
 OK  ''

[/opt/netdata]# chmod 4750 usr/libexec/netdata/plugins.d/nfacct.plugin
 OK  ''

Configure TLS certificate paths
Using /etc/ssl for TLS configuration and certificates
Save install options
 --- starting netdata ---
 --- Restarting netdata instance ---

Stopping all netdata threads
[/opt/netdata]# stop_all_netdata
 OK  ''

Starting netdata using command 'systemctl start netdata'
[/opt/netdata]# systemctl start netdata
 OK  ''

Downloading default configuration from netdata...
[/opt/netdata]# /usr/bin/curl -sSL --connect-timeout 10 --retry 3 http://localhost:19999/netdata.conf
 OK  ''

[/opt/netdata]# mv /opt/netdata/etc/netdata/netdata.conf.new /opt/netdata/etc/netdata/netdata.conf
 OK  ''

 OK  New configuration saved for you to edit at /opt/netdata/etc/netdata/netdata.conf


  ^
  |.-.   .-.   .-.   .-.   .-.   .  netdata  .-.   .-.   .-.   .-.   .-.   .-
  |   '-'   '-'   '-'   '-'   '-'               '-'   '-'   '-'   '-'   '-'
  +----+-----+-----+-----+-----+-----+-----+-----+-----+-----+-----+-----+--->

[/opt/netdata]# chmod 0644 /opt/netdata/etc/netdata/netdata.conf
 OK  ''

 OK

Root privileges required to run sh -c cat "/opt/netdata/etc/netdata/.install-type" > "/tmp/netdata-kickstart-MniY1esn5B/install-type"
[/tmp/netdata-kickstart-MniY1esn5B]$ sudo sh -c cat "/opt/netdata/etc/netdata/.install-type" > "/tmp/netdata-kickstart-MniY1esn5B/install-type"
 OK

Root privileges required to run chown 1000:1000 /tmp/netdata-kickstart-MniY1esn5B/install-type
[/tmp/netdata-kickstart-MniY1esn5B]$ sudo chown 1000:1000 /tmp/netdata-kickstart-MniY1esn5B/install-type
 OK

Root privileges required to run chown netdata:netdata /tmp/netdata-kickstart-MniY1esn5B/install-type
[/tmp/netdata-kickstart-MniY1esn5B]$ sudo chown netdata:netdata /tmp/netdata-kickstart-MniY1esn5B/install-type
 OK

Root privileges required to run cp /tmp/netdata-kickstart-MniY1esn5B/install-type /opt/netdata/etc/netdata/.install-type
[/tmp/netdata-kickstart-MniY1esn5B]$ sudo cp /tmp/netdata-kickstart-MniY1esn5B/install-type /opt/netdata/etc/netdata/.install-type
 OK

 --- Attempting to claim agent to https://app.netdata.cloud ---
9292
9296
Root privileges required to run /opt/netdata/bin/netdata-claim.sh -token=Iz5ykGYQdVeMRDrrO65Rn5rfPubIoomNfCTg7lJjFI0PwOroh-7LwSmZB5f5mtaWRxCk0uR1MuyTcmi-jDtE8IYhE7njlXff7HUUQK_t-rgv0rVcvlyeTudharHxGoN_mXWX4bQ -rooms=c7712580-24af-4cbc-9c05-7196e3214052 -url=https://app.netdata.cloud
[/tmp/netdata-kickstart-MniY1esn5B]$ sudo /opt/netdata/bin/netdata-claim.sh -token=Iz5ykGYQdVeMRDrrO65Rn5rfPubIoomNfCTg7lJjFI0PwOroh-7LwSmZB5f5mtaWRxCk0uR1MuyTcmi-jDtE8IYhE7njlXff7HUUQK_t-rgv0rVcvlyeTudharHxGoN_mXWX4bQ -rooms=c7712580-24af-4cbc-9c05-7196e3214052 -url=https://app.netdata.cloud
Token: ****************
Base URL: https://app.netdata.cloud
Id: 413638ea-07e0-11ef-a680-00505641dcaf
Rooms: c7712580-24af-4cbc-9c05-7196e3214052
Hostname: vps
Proxy:
Netdata user: netdata
Generating private/public key for the first time.
Extracting public key from private key.
writing RSA key
Connection attempt 1 successful
Node was successfully claimed.
 OK

 --- Successfully claimed node ---
Root privileges required to run test -x /opt/netdata/usr/libexec/netdata/netdata-updater.sh
[/tmp/netdata-kickstart-MniY1esn5B]$ sudo test -x /opt/netdata/usr/libexec/netdata/netdata-updater.sh
 OK

Root privileges required to run grep -q \-\-enable-auto-updates /opt/netdata/usr/libexec/netdata/netdata-updater.sh
[/tmp/netdata-kickstart-MniY1esn5B]$ sudo grep -q \-\-enable-auto-updates /opt/netdata/usr/libexec/netdata/netdata-updater.sh
grep: warning: stray \ before -
 OK

Root privileges required to run /opt/netdata/usr/libexec/netdata/netdata-updater.sh --enable-auto-updates
[/tmp/netdata-kickstart-MniY1esn5B]$ sudo /opt/netdata/usr/libexec/netdata/netdata-updater.sh --enable-auto-updates
qua 01 mai 2024 14:28:56 -03 : INFO: netdata-updater.sh:  Auto-updating has been ENABLED through cron, updater script linked to /etc/cron.daily/netdata-updater\n
qua 01 mai 2024 14:28:56 -03 : INFO: netdata-updater.sh:  If the update process fails and you have email notifications set up correctly for cron on this system, you should receive an email notification of the failure.
qua 01 mai 2024 14:28:56 -03 : INFO: netdata-updater.sh:  Successful updates will not send an email.
 OK

Successfully installed the Netdata Agent.

The following non-fatal warnings or errors were encountered:

  - We do not provide native packages for manjaro.
  - Could not install native binary packages, falling back to alternative installation method.

To view your system's real-time performance metrics, open your web browser and enter http://NODE:19999.
Replace NODE with the IP address or hostname of your Netdata server to access the dashboard.

Official documentation can be found online at https://learn.netdata.cloud/docs/.

Looking to monitor all of your infrastructure with Netdata? Check out Netdata Cloud at https://app.netdata.cloud.

Join our community and connect with us on:
  - GitHub: https://github.com/netdata/netdata/discussions
  - Discord: https://discord.gg/5ygS846fR6
  - Our community forums: https://community.netdata.cloud/
Root privileges required to run rm -rf /tmp/netdata-kickstart-MniY1esn5B
[/home/peracchi]$ sudo rm -rf /tmp/netdata-kickstart-MniY1esn5B
 OK

[peracchi@vps ~]$

ilyam8 · May 2, 2024, 2:28pm

Hi, @peracchi.

integration with Fail2ban is not working

The problem is missing setuid bit on a Netdata helper binary (ndsudo) designed to run privileged commands securely.

It should be fixed in the next nightly release (tomorrow), you can fix it now by executing:

sudo chmod 4750 /opt/netdata/usr/libexec/netdata/plugins.d/ndsudo

And restart netdata service.

no log is displayed in the “Logs” tab, there is only the Netdata logo pulsing above “Loading logs…”

This is expected because you installed static build:

WARNING Could not install native binary packages, falling back to alternative installation method.
— Attempting to install using static build… —

The static build doesn’t have systemd-journal.plugin. If you need it the only way is to compile Netdata from source.

libsystemd-dev

peracchi · May 2, 2024, 2:54pm

Thanks @ilyam8, Fail2ban working perfectly!

Maybe I’ll try compiling Netdata from source over the weekend. I need to research/relearn how to do this (it’s been a long time since I compiled something from source).

Is there any intention/planning to make packages available for Arch Linux and, consequently, for Manjaro?

ilyam8 · May 2, 2024, 3:45pm

No, we don’t. There is netdata package for Arch but it is not maintained by us and is outdated.

Maybe I’ll try compiling Netdata from source over the weekend

To do it:

git clone --recursive https://github.com/netdata/netdata
cd netdata
sudo packaging/installer/install-required-packages.sh netdata

sudo  ./netdata-installer.sh --install-prefix /opt

Topic		Replies	Views
Netdata not working! Help agent , cloud , installation , platform	5	1646	January 10, 2023
Where i find fail2ban? Help agent	8	1333	December 6, 2021
Automatic netdata Updater fails Help agent-health , agent	11	1838	January 20, 2022
Tried uninstalling netdata, it failed Help agent , installation , update	23	910	November 17, 2023
Ubuntu 20.04 installation fails Help linux , platform	5	1149	April 3, 2023

Two problems with Netdata on Manjaro Linux

Related topics