Yes, absolutely.
Check out this topic for a number of very helpful resources on creating configuration alarms. What you really want is to create an alarm using the $last_collected_t variable.
So, if the container is killed, then that variable will have the timestamp of the last time when Netdata was able to collect data from that container.
What I would do, is I would use the resources to understand how the alarms syntax works (+ the reference documentation at Agent alert notifications | Learn Netdata) and then I would create an alarm just like the one with apache, shown in the forum topic I linked before. Finally, instead of using the apache chart, I would use a chart from that particular container.
That should work. Pinging @ilyam8 to verify my thinking.
Cheers!