I have very strange problem when running netdata agent on machine that runs docker containers. I have configured netdata agent with httpcheck plugin to monitor specific external api endpoint. Also i want to docker container have access to this endpoint simultaneously. But when running netdata agent on host machine ( or only httpcheck plugin for that matter) docker instance lost connection to external api. With stopped netdata or plugin - all of a sudden connection is restored. When I remove api endpoint from httpcheck config file and run it - it also works. I double checked firewall rules, docker network configurations etc. with no luck. It seems that httpcheck plugin somehow ( or plugin host process ) block or intercepts ? docker network traffic.
I tried to read plugin source in go, and what its only do is to create http request in specific intervals. I don’t see how it affects docker container.
I tried to disable in netdata.conf cgroup entry to stop monitoring docker instances - it did not help.
Tried to monitor network trafic, tcpdump or debug socket function calls for plugin and all seems ok and normal. For what i can tell packets are going out from docker container, but are lost way back on host machine.
Any idea ?