# eBPF plugin crashed on update to v1.28.0-143-nightly

**URL:** <https://community.netdata.cloud/t/ebpf-plugin-crashed-on-update-to-v1-28-0-143-nightly/781>\
**Category:** Help\
**Tags:** agent, agent-health\
**Created:** [January 17, 2021, 9:52pm UTC](https://community.netdata.cloud/t/ebpf-plugin-crashed-on-update-to-v1-28-0-143-nightly/781 "2021-01-17T21:52:19Z")\
**Posts on this page:** 13\
**Page:** 1

<div class="post-metadata">

**Author:** ![chris.pollock](https://yyz1.discourse-cdn.com/flex029/user_avatar/community.netdata.cloud/chris.pollock/32/193_2.png) [@chris.pollock](https://community.netdata.cloud/u/chris.pollock)\
**Post date:** [January 17, 2021, 9:52pm UTC](https://community.netdata.cloud/t/ebpf-plugin-crashed-on-update-to-v1-28-0-143-nightly/781/1 "2021-01-17T21:52:19Z")

</div>

Ubuntu 20.04.1, kernel 5.4.0-62-generic. After the update to the above nightly this morning I noticed a crash report generated. Here is a link to the generated crash report [eBPF Plugin crash 01172021](https://pastebin.com/QMHTvJCY) and the error log [Netdata error log 01172021](https://pastebin.com/C0mzcU1x)

---

<div class="post-metadata">

**Author:** ![OdysLam](https://yyz1.discourse-cdn.com/flex029/user_avatar/community.netdata.cloud/odyslam/32/98_2.png) [@OdysLam](https://community.netdata.cloud/u/OdysLam)\
**Post date:** [January 18, 2021, 10:12am UTC](https://community.netdata.cloud/t/ebpf-plugin-crashed-on-update-to-v1-28-0-143-nightly/781/2 "2021-01-18T10:12:59Z")

</div>

Thank you @chris.pollock for reporting this.

Pinging @Thiago_Marques_0 who is the main driver behind our ebpf functinality. As always you help us tons in improving and fixing our product in a rapid manner. We thank you 🙇‍♂️

Best,  
Odysseas

---

<div class="post-metadata">

**Author:** ![Thiago\_Marques\_0](https://yyz1.discourse-cdn.com/flex029/user_avatar/community.netdata.cloud/thiago_marques_0/32/281_2.png) [@Thiago\_Marques\_0](https://community.netdata.cloud/u/Thiago_Marques_0)\
**Post date:** [January 19, 2021, 2:18am UTC](https://community.netdata.cloud/t/ebpf-plugin-crashed-on-update-to-v1-28-0-143-nightly/781/3 "2021-01-19T02:18:46Z")

</div>

Hello @chris.pollock ,

I hope everything is ok with your fingers.

I tried to replicate the problem on two different VMs and this time I could not recreate them. On the other hand, we discovered that we have a problem with our installer and probably this can affect the update, I will take a look tomorrow and let you know.

best regards!

---

<div class="post-metadata">

**Author:** ![chris.pollock](https://yyz1.discourse-cdn.com/flex029/user_avatar/community.netdata.cloud/chris.pollock/32/193_2.png) [@chris.pollock](https://community.netdata.cloud/u/chris.pollock)\
**Post date:** [January 19, 2021, 2:38am UTC](https://community.netdata.cloud/t/ebpf-plugin-crashed-on-update-to-v1-28-0-143-nightly/781/4 "2021-01-19T02:38:51Z")

</div>

Good evening @Thiago_Marques_0, i had the same crash this morning. The update went fine for a few days with no issues.

---

<div class="post-metadata">

**Author:** ![Thiago\_Marques\_0](https://yyz1.discourse-cdn.com/flex029/user_avatar/community.netdata.cloud/thiago_marques_0/32/281_2.png) [@Thiago\_Marques\_0](https://community.netdata.cloud/u/Thiago_Marques_0)\
**Post date:** [March 3, 2021, 4:13am UTC](https://community.netdata.cloud/t/ebpf-plugin-crashed-on-update-to-v1-28-0-143-nightly/781/5 "2021-03-03T04:13:21Z")

</div>

Hello @chris.pollock ,

Firstly I really apologize for the big delay, but the pandemic has been hard with my family. And this was affecting me so much, unfortunately I only discovered this last Thursday.  
I hope your fingers are fine now.  
I detected a problem on CentOS that I also think is also affecting Ubuntu, because both distributions are changing their file `/proc/sys/kernel/osrelease`.  
The PR that can fix the problem is [this](https://github.com/netdata/netdata/pull/10704).

Again I apologize!

Best regards!

---

<div class="post-metadata">

**Author:** ![chris.pollock](https://yyz1.discourse-cdn.com/flex029/user_avatar/community.netdata.cloud/chris.pollock/32/193_2.png) [@chris.pollock](https://community.netdata.cloud/u/chris.pollock)\
**Post date:** [March 17, 2021, 12:22am UTC](https://community.netdata.cloud/t/ebpf-plugin-crashed-on-update-to-v1-28-0-143-nightly/781/6 "2021-03-17T00:22:53Z")

</div>

Good afternoon Thiago, I also have to apologize for taking so long to reply. I had an arterial bypass done on 24 Feb to try and correct the blood clot in my hand and my left hand was in a large brace so I couldn’t use it at all. Finally got it off yesterday so I can type again. I’m still getting the eBPF crashes almost daily and there are days when I have to manually start Netdata from the command line. The crashes I’m pretty much ignoring as Netdata seems to be running fine and the plugin seems to be working correctly as far as I can see. If you’d like the most current crash info which was yesterday I can upload to pastebin and send you the link.

---

<div class="post-metadata">

**Author:** ![OdysLam](https://yyz1.discourse-cdn.com/flex029/user_avatar/community.netdata.cloud/odyslam/32/98_2.png) [@OdysLam](https://community.netdata.cloud/u/OdysLam)\
**Post date:** [March 17, 2021, 9:33am UTC](https://community.netdata.cloud/t/ebpf-plugin-crashed-on-update-to-v1-28-0-143-nightly/781/7 "2021-03-17T09:33:09Z")

</div>

Ooof buddy, I hope that you are better now. ✌

That pastebin should be useful for @Thiago_Marques_0 , so please do upload it!

---

<div class="post-metadata">

**Author:** ![Thiago\_Marques\_0](https://yyz1.discourse-cdn.com/flex029/user_avatar/community.netdata.cloud/thiago_marques_0/32/281_2.png) [@Thiago\_Marques\_0](https://community.netdata.cloud/u/Thiago_Marques_0)\
**Post date:** [March 17, 2021, 4:46pm UTC](https://community.netdata.cloud/t/ebpf-plugin-crashed-on-update-to-v1-28-0-143-nightly/781/8 "2021-03-17T16:46:06Z")

</div>

Hello @chris.pollock ,

Firstly I hope that your fingers are good nowadays.  
We merged a new eBPF release today an we also have another PR [eBPF plugin (fixes 10727) by thiagoftsm · Pull Request #10756 · netdata/netdata · GitHub](https://github.com/netdata/netdata/pull/10756) that is expected to fix these problems. When Ubuntu is running the kernel `4.18` we observed different problems on it, on the other hand the kernels `4.15` and `5.4` are more stable. Somehow the modifications the Ubuntu team is doing for `4.18` is creating some problems.

If you can upload to pastebin it will be great for me to debug.

Best regards!

---

<div class="post-metadata">

**Author:** ![chris.pollock](https://yyz1.discourse-cdn.com/flex029/user_avatar/community.netdata.cloud/chris.pollock/32/193_2.png) [@chris.pollock](https://community.netdata.cloud/u/chris.pollock)\
**Post date:** [March 18, 2021, 3:56pm UTC](https://community.netdata.cloud/t/ebpf-plugin-crashed-on-update-to-v1-28-0-143-nightly/781/9 "2021-03-18T15:56:10Z")

</div>

@Thiago_Marques_0 I’m uploading three files  
[03-15-21 crash report](https://pastebin.com/KU1hh0Pq)  
[updater-log-03152021](https://pastebin.com/xXwAV748)  
[error-log-03152021](https://pastebin.com/UXPt8LPK)

I’m currently running kernel 5.4.0-67-generic

---

<div class="post-metadata">

**Author:** ![Thiago\_Marques\_0](https://yyz1.discourse-cdn.com/flex029/user_avatar/community.netdata.cloud/thiago_marques_0/32/281_2.png) [@Thiago\_Marques\_0](https://community.netdata.cloud/u/Thiago_Marques_0)\
**Post date:** [March 20, 2021, 1:48pm UTC](https://community.netdata.cloud/t/ebpf-plugin-crashed-on-update-to-v1-28-0-143-nightly/781/10 "2021-03-20T13:48:36Z")

</div>

thank you @chris.pollock ,

I took a look in the log files, but the crash report is saying that it is private, please, can you send it for my email thiago@netdata.cloud? Thanks.

Another thing, please, can you run the command `ls -l /usr/libexec/netdata/plugins.d/ebpf.d`? I wanna confirm that you are using the latest version of `ebpf.plugin`, if this directory is not present, it is possible there is a problem with the updater.

Finally I discovered the motive I cannot recreate the reported problem 😕 , I run every week the commands `apt-get update; apt-get upgrade`, but somehow on my VM the kernel was not upgraded, I was using `5.4.0-65`. I imagined that Ubuntu followed the same pattern of Slackware and CentOS. I will try to recreate the problem right now.

Best Regards,

Thiago

---

<div class="post-metadata">

**Author:** ![ilyam8](https://yyz1.discourse-cdn.com/flex029/user_avatar/community.netdata.cloud/ilyam8/32/134_2.png) [@ilyam8](https://community.netdata.cloud/u/ilyam8)\
**Post date:** [March 20, 2021, 5:38pm UTC](https://community.netdata.cloud/t/ebpf-plugin-crashed-on-update-to-v1-28-0-143-nightly/781/11 "2021-03-20T17:38:34Z")

</div>

> [@Thiago\_Marques\_0](#):
>
> but somehow on my VM the kernel was not upgraded

apt-get dist-upgrade

---

<div class="post-metadata">

**Author:** ![Thiago\_Marques\_0](https://yyz1.discourse-cdn.com/flex029/user_avatar/community.netdata.cloud/thiago_marques_0/32/281_2.png) [@Thiago\_Marques\_0](https://community.netdata.cloud/u/Thiago_Marques_0)\
**Post date:** [March 20, 2021, 5:57pm UTC](https://community.netdata.cloud/t/ebpf-plugin-crashed-on-update-to-v1-28-0-143-nightly/781/12 "2021-03-20T17:57:03Z")

</div>

Thank you, I never run this command ☹

---

<div class="post-metadata">

**Author:** ![Thiago\_Marques\_0](https://yyz1.discourse-cdn.com/flex029/user_avatar/community.netdata.cloud/thiago_marques_0/32/281_2.png) [@Thiago\_Marques\_0](https://community.netdata.cloud/u/Thiago_Marques_0)\
**Post date:** [March 22, 2021, 2:11am UTC](https://community.netdata.cloud/t/ebpf-plugin-crashed-on-update-to-v1-28-0-143-nightly/781/13 "2021-03-22T02:11:05Z")

</div>

Hello @chris.pollock ,

Thank you to send me the core dump, after to study it, I tried to recreate the problem and I could not, I gave to you some commands for you compile Netdata with debug flags that will help us to understand the problem with socket thread.

Best regards,

Thiago
