MongoDB stats dont show up

Help
, , , , ,
1

I have configured the mongodb collector as described in the docs.
Sadly no mongodb chart shows up in the netdata console.
Here is my debug mode log:

[ DEBUG ] main[main] main.go:115 plugin: name=go.d, version=v0.54.1
[ DEBUG ] main[main] main.go:117 current user: name=netdata, uid=201
[ INFO  ] main[main] main.go:121 env HTTP_PROXY '', HTTPS_PROXY '' (both upper and lower case are respected)
[ INFO  ] main[main] agent.go:140 instance is started
[ INFO  ] main[main] setup.go:43 loading config file
[ INFO  ] main[main] setup.go:51 looking for 'go.d.conf' in [/etc/netdata /usr/lib/netdata/conf.d]
[ INFO  ] main[main] setup.go:58 found '/etc/netdata/go.d.conf
[ INFO  ] main[main] setup.go:65 config successfully loaded
[ INFO  ] main[main] agent.go:144 using config: enabled 'true', default_run 'true', max_procs '0'
[ INFO  ] main[main] setup.go:70 loading modules
[ INFO  ] main[main] setup.go:89 enabled/registered modules: 1/79
[ INFO  ] main[main] setup.go:94 building discovery config
[ INFO  ] main[main] setup.go:141 looking for 'mongodb.conf' in [/etc/netdata/go.d /usr/lib/netdata/conf.d/go.d]
[ INFO  ] main[main] setup.go:157 found '/etc/netdata/go.d/mongodb.conf
[ INFO  ] main[main] setup.go:162 dummy/read/watch paths: 0/1/0
[ INFO  ] discovery[manager] manager.go:92 registered discoverers: [file discovery: [file reader]]
[ INFO  ] main[main] setup.go:176 looking for 'vnodes/' in [/etc/netdata /usr/lib/netdata/conf.d]
[ INFO  ] main[main] setup.go:188 found '/usr/lib/netdata/conf.d/vnodes' (0 vhosts)
[ INFO  ] discovery[manager] manager.go:97 instance is started
[ INFO  ] run[manager] run.go:32 instance is started
[ INFO  ] build[manager] build.go:117 instance is started
[ INFO  ] discovery[file manager] discovery.go:73 instance is started
[ INFO  ] discovery[file reader] read.go:41 instance is started
[ INFO  ] discovery[file reader] read.go:42 instance is stopped
[ DEBUG ] build[manager] build.go:164 received config group ('/etc/netdata/go.d/mongodb.conf'): 1 jobs (added: 1, removed: 0)
[ DEBUG ] build[manager] build.go:313 building mongodb[caseclicker] job, config: map[__provider__:file reader __source__:/etc/netdata/go.d/mongodb.conf autodetection_retry:0 databases:map[includes:[* *]] module:mongodb name:caseclicker priority:70000 update_every:1 uri:mongodb://netdata:pwd@ip:27017]
[ DEBUG ] mongodb[caseclicker] collect_dbstats.go:23 all databases on the server: '[admin caseclicker caseclickerbeta config local restore]'
[ DEBUG ] mongodb[caseclicker] collect_dbstats.go:57 new database 'admin': creating charts
[ DEBUG ] mongodb[caseclicker] collect_dbstats.go:57 new database 'caseclicker': creating charts
[ DEBUG ] mongodb[caseclicker] collect_dbstats.go:57 new database 'caseclickerbeta': creating charts
[ DEBUG ] mongodb[caseclicker] collect_dbstats.go:57 new database 'config': creating charts
[ DEBUG ] mongodb[caseclicker] collect_dbstats.go:57 new database 'local': creating charts
[ DEBUG ] mongodb[caseclicker] collect_dbstats.go:57 new database 'restore': creating charts
[ INFO  ] mongodb[caseclicker] job.go:208 check success
[ INFO  ] mongodb[caseclicker] job.go:228 started, data collection interval 1s

after that every second something like this gets printed out:

BEGIN 'netdata.execution_time_of_mongodb_caseclicker' 1000189
SET 'time' = 140
END

[ DEBUG ] run[manager] run.go:43 tick 2
[ DEBUG ] mongodb[caseclicker] collect_dbstats.go:23 all databases on the server: '[admin caseclicker caseclickerbeta config local restore]'
BEGIN 'mongodb_caseclicker.operations_by_type_rate' 1000504
SET 'insert' = 192610985
SET 'query' = 811535093
SET 'update' = 69569168
SET 'delete' = 1605426
SET 'getmore' = 812361
SET 'command' = 183029792
END

BEGIN 'mongodb_caseclicker.document_operations_rate' 1000504
SET 'inserted' = 192610960
SET 'deleted' = 192111211
SET 'returned' = 4978351180
SET 'updated' = 174047036
END

BEGIN 'mongodb_caseclicker.scanned_indexes_rate' 1000504
SET 'scanned' = 119125195599
END

BEGIN 'mongodb_caseclicker.scanned_documents_rate' 1000504
SET 'scanned' = 27794881703
END

BEGIN 'mongodb_caseclicker.connections_usage' 1000504
SET 'available' = 51041
SET 'used' = 159
END

BEGIN 'mongodb_caseclicker.connections_by_state_count' 1000504
SET 'active' = 10
SET 'threaded' = 159
SET 'exhaust_is_master' = 0
SET 'exhaust_hello' = 8
SET 'awaiting_topology_changes' = 9
END

BEGIN 'mongodb_caseclicker.connections_rate' 1000504
SET 'created' = 9952
END

BEGIN 'mongodb_caseclicker.network_traffic' 1000504
SET 'in' = 429873199492
SET 'out' = 4269925353362
END

BEGIN 'mongodb_caseclicker.network_requests_rate' 1000504
SET 'requests' = 1086415887
END

BEGIN 'mongodb_caseclicker.memory_resident_size' 1000504
SET 'used' = 3596615680
END

BEGIN 'mongodb_caseclicker.memory_virtual_size' 1000504
SET 'used' = 6830424064
END

BEGIN 'mongodb_caseclicker.memory_page_faults' 1000504
SET 'pgfaults' = 1492105
END

BEGIN 'mongodb_caseclicker.asserts_rate' 1000504
SET 'regular' = 0
SET 'warning' = 0
SET 'msg' = 0
SET 'user' = 57791
SET 'tripwire' = 0
SET 'rollovers' = 0
END

BEGIN 'mongodb_caseclicker.operations_rate' 1000504
SET 'reads' = 887604469
SET 'writes' = 193049934
SET 'commands' = 5761473
END

BEGIN 'mongodb_caseclicker.operations_latency_time' 1000504
SET 'reads' = 422721796728
SET 'writes' = 270187171244
SET 'commands' = 466180493
END

BEGIN 'mongodb_caseclicker.wiredtiger_concurrent_read_transactions_usage' 1000504
SET 'available' = 128
SET 'used' = 0
END

BEGIN 'mongodb_caseclicker.wiredtiger_concurrent_write_transactions_usage' 1000504
SET 'available' = 128
SET 'used' = 0
END

BEGIN 'mongodb_caseclicker.wiredtiger_cache_usage' 1000504
SET 'used' = 2848158837
END

BEGIN 'mongodb_caseclicker.wiredtiger_cache_dirty_space_size' 1000504
SET 'dirty' = 67631438
END

BEGIN 'mongodb_caseclicker.wiredtiger_cache_io_rate' 1000504
SET 'read' = 94567724
SET 'written' = 893601529
END

BEGIN 'mongodb_caseclicker.wiredtiger_cache_eviction_rate' 1000504
SET 'unmodified' = 32590174
SET 'modified' = 722628748
END

BEGIN 'mongodb_caseclicker.memory_tcmalloc_stats' 1000504
SET 'allocated' = 2905926760
SET 'central_cache_freelist' = 139078816
SET 'transfer_cache_freelist' = 0
SET 'thread_cache_freelists' = 165047288
SET 'pageheap_freelist' = 689082368
SET 'pageheap_unmapped' = 117895168
END

BEGIN 'mongodb_caseclicker.active_clients_count' 1000504
SET 'readers' = 0
SET 'writers' = 0
END

BEGIN 'mongodb_caseclicker.queued_operations' 1000504
SET 'readers' = 0
SET 'writers' = 0
END

BEGIN 'mongodb_caseclicker.network_slow_dns_resolutions_rate' 1000504
SET 'slow_dns' = 0
END

BEGIN 'mongodb_caseclicker.network_slow_ssl_handshakes_rate' 1000504
SET 'slow_ssl' = 0
END

BEGIN 'mongodb_caseclicker.cursors_opened_rate' 1000504
SET 'opened' = 75666736
END

BEGIN 'mongodb_caseclicker.cursors_timed_out_rate' 1000504
SET 'timed_out' = 0
END

BEGIN 'mongodb_caseclicker.cursors_open_count' 1000504
SET 'open' = 0
END

BEGIN 'mongodb_caseclicker.cursors_open_no_timeout_count' 1000504
SET 'open_no_timeout' = 0
END

BEGIN 'mongodb_caseclicker.cursors_by_lifespan_count' 1000504
SET 'le_1s' = 75664356
SET '1s_5s' = 1529
SET '5s_15s' = 106
SET '15s_30s' = 104
SET '30s_1m' = 95
SET '1m_10m' = 465
SET 'ge_10m' = 81
END

BEGIN 'mongodb_caseclicker.transactions_count' 1000504
SET 'active' = 0
SET 'inactive' = 0
SET 'open' = 0
SET 'prepared' = 0
END

BEGIN 'mongodb_caseclicker.transactions_rate' 1000504
SET 'started' = 0
SET 'aborted' = 0
SET 'committed' = 0
SET 'prepared' = 0
END

BEGIN 'mongodb_caseclicker.global_lock_acquisitions_rate' 1000504
SET 'shared' = 0
SET 'exclusive' = 5
SET 'intent_shared' = 1078508396
SET 'intent_exclusive' = 209537312
END

BEGIN 'mongodb_caseclicker.database_lock_acquisitions_rate' 1000504
SET 'shared' = 1
SET 'exclusive' = 2
SET 'intent_shared' = 172770
SET 'intent_exclusive' = 209537255
END

BEGIN 'mongodb_caseclicker.collection_lock_acquisitions_rate' 1000504
SET 'shared' = 20
SET 'exclusive' = 70
SET 'intent_shared' = 329793
SET 'intent_exclusive' = 209537165
END

BEGIN 'mongodb_caseclicker.mutex_lock_acquisitions_rate' 1000504
SET 'shared' = 0
SET 'exclusive' = 0
SET 'intent_shared' = 1160805063
SET 'intent_exclusive' = 0
END

BEGIN 'mongodb_caseclicker.database_admin_collections_count' 1000504
SET 'collections' = 2
END

BEGIN 'mongodb_caseclicker.database_admin_indexes_count' 1000504
SET 'indexes' = 3
END

BEGIN 'mongodb_caseclicker.database_admin_views_count' 1000504
SET 'views' = 0
END

BEGIN 'mongodb_caseclicker.database_admin_documents_count' 1000504
SET 'documents' = 7
END

BEGIN 'mongodb_caseclicker.database_admin_data_size' 1000504
SET 'data_size' = 3341
END

BEGIN 'mongodb_caseclicker.database_admin_storage_size' 1000504
SET 'storage_size' = 73728
END

BEGIN 'mongodb_caseclicker.database_admin_index_size' 1000504
SET 'index_size' = 110592
END

BEGIN 'mongodb_caseclicker.database_caseclicker_collections_count' 1000504
SET 'collections' = 26
END

BEGIN 'mongodb_caseclicker.database_caseclicker_indexes_count' 1000504
SET 'indexes' = 123
END

BEGIN 'mongodb_caseclicker.database_caseclicker_views_count' 1000504
SET 'views' = 0
END

BEGIN 'mongodb_caseclicker.database_caseclicker_documents_count' 1000504
SET 'documents' = 1398973
END

BEGIN 'mongodb_caseclicker.database_caseclicker_data_size' 1000504
SET 'data_size' = 5896919320
END

BEGIN 'mongodb_caseclicker.database_caseclicker_storage_size' 1000504
SET 'storage_size' = 1566818304
END

BEGIN 'mongodb_caseclicker.database_caseclicker_index_size' 1000504
SET 'index_size' = 867004416
END
2

Hi @HermesDE ,

Welcome to Netdata Community Forums.

Could you provide some more details on your setup? Please share the following information:

  1. Configuration you have on go.d/mongodb.conf
  2. Netdata build info
netdata -W buildinfo
# If get "netdata: command not found", try (required running Netdata)
$(ps aux | grep -m1 -E -o "[a-zA-Z/]+netdata ") -W buildinfo
3

Sure

mongodb.conf:

jobs:                                                                                                                   
  - name: caseclicker                                                                                                   
    uri: mongodb://netdata:pwd@82.165.xxx.xxx:27017                                                            
#    timeout: 2                                                                                                         
    databases:                                                                                                          
      includes:                                                                                                         
        - "* *"

With “timeout” it didn’t work

netdata build info:

Packaging:
    Netdata Version ____________________________________________ : v1.42.0-107-nightly
    Installation Type __________________________________________ : oci
    Package Architecture _______________________________________ : x86_64
    Package Distro _____________________________________________ : unknown
    Configure Options __________________________________________ :  '--prefix=/usr' '--sysconfdir=/etc' '--localstatedir=/var' '--libexecdir=/usr/libexec' '--libdir=/usr/lib' '--with-math' '--with-user=netdata' '--without-bundled-protobuf' '--disable-dependency-tracking' '--enable-lto' '--disable-ebpf' 'CFLAGS=-ffunction-sections -fdata-sections -O2 -funroll-loops -pipe' 'LDFLAGS=-Wl,--gc-sections'
Default Directories:
    User Configurations ________________________________________ : /etc/netdata
    Stock Configurations _______________________________________ : /usr/lib/netdata/conf.d
    Ephemeral Databases (metrics data, metadata) _______________ : /var/cache/netdata
    Permanent Databases ________________________________________ : /var/lib/netdata
    Plugins ____________________________________________________ : /usr/libexec/netdata/plugins.d
    Static Web Files ___________________________________________ : /usr/share/netdata/web
    Log Files __________________________________________________ : /var/log/netdata
    Lock Files _________________________________________________ : /var/lib/netdata/lock
    Home _______________________________________________________ : /var/lib/netdata
Operating System:
    Kernel _____________________________________________________ : Linux
    Kernel Version _____________________________________________ : 6.1.38-Unraid
    Operating System ___________________________________________ : unknown
    Operating System ID ________________________________________ : unknown
    Operating System ID Like ___________________________________ : unknown
    Operating System Version ___________________________________ : unknown
    Operating System Version ID ________________________________ : 3.18.3
    Detection __________________________________________________ : unknown
Hardware:
    CPU Cores __________________________________________________ : 6
    CPU Frequency ______________________________________________ : 3000000000
    CPU Architecture ___________________________________________ : 8208052224
    RAM Bytes __________________________________________________ : 24516810694656
    Disk Capacity ______________________________________________ : x86_64
    Virtualization Technology __________________________________ : none
    Virtualization Detection ___________________________________ : none
Container:
    Container __________________________________________________ : docker
    Container Detection ________________________________________ : dockerenv
    Container Orchestrator _____________________________________ : none
    Container Operating System _________________________________ : Alpine Linux
    Container Operating System ID ______________________________ : alpine
    Container Operating System ID Like _________________________ : unknown
    Container Operating System Version _________________________ : unknown
    Container Operating System Version ID ______________________ : 3.18.3
    Container Operating System Detection _______________________ : /etc/os-release
Features:
    Built For __________________________________________________ : Linux
    Netdata Cloud ______________________________________________ : YES
    Health (trigger alerts and send notifications) _____________ : YES
    Streaming (stream metrics to parent Netdata servers) _______ : YES
    Replication (fill the gaps of parent Netdata servers) ______ : YES
    Streaming and Replication Compression ______________________ : YES (lz4)
    Contexts (index all active and archived metrics) ___________ : YES
    Tiering (multiple dbs with different metrics resolution) ___ : YES (5)
    Machine Learning ___________________________________________ : YES
Database Engines:
    dbengine ___________________________________________________ : YES
    alloc ______________________________________________________ : YES
    ram ________________________________________________________ : YES
    map ________________________________________________________ : YES
    save _______________________________________________________ : YES
    none _______________________________________________________ : YES
Connectivity Capabilities:
    ACLK (Agent-Cloud Link: MQTT over WebSockets over TLS) _____ : YES
    static (Netdata internal web server) _______________________ : YES
    h2o (web server) ___________________________________________ : NO
    WebRTC (experimental) ______________________________________ : NO
    Native HTTPS (TLS Support) _________________________________ : YES
    TLS Host Verification ______________________________________ : YES
Libraries:
    LZ4 (extremely fast lossless compression algorithm) ________ : YES
    zlib (lossless data-compression library) ___________________ : YES
    Judy (high-performance dynamic arrays and hashtables) ______ : YES (bundled)
    dlib (robust machine learning toolkit) _____________________ : YES (bundled)
    protobuf (platform-neutral data serialization protocol) ____ : YES (system)
    OpenSSL (cryptography) _____________________________________ : YES
    libdatachannel (stand-alone WebRTC data channels) __________ : NO
    JSON-C (lightweight JSON manipulation) _____________________ : YES
    libcap (Linux capabilities system operations) ______________ : NO
    libcrypto (cryptographic functions) ________________________ : YES
    libm (mathematical functions) ______________________________ : YES
    jemalloc ___________________________________________________ : NO
    TCMalloc ___________________________________________________ : NO
Plugins:
    apps (monitor processes) ___________________________________ : YES
    cgroups (monitor containers and VMs) _______________________ : YES
    cgroup-network (associate interfaces to CGROUPS) ___________ : YES
    proc (monitor Linux systems) _______________________________ : YES
    tc (monitor Linux network QoS) _____________________________ : YES
    diskspace (monitor Linux mount points) _____________________ : YES
    freebsd (monitor FreeBSD systems) __________________________ : NO
    macos (monitor MacOS systems) ______________________________ : NO
    statsd (collect custom application metrics) ________________ : YES
    timex (check system clock synchronization) _________________ : YES
    idlejitter (check system latency and jitter) _______________ : YES
    bash (support shell data collection jobs - charts.d) _______ : YES
    debugfs (kernel debugging metrics) _________________________ : YES
    cups (monitor printers and print jobs) _____________________ : NO
    ebpf (monitor system calls) ________________________________ : NO
    freeipmi (monitor enterprise server H/W) ___________________ : YES
    nfacct (gather netfilter accounting) _______________________ : NO
    perf (collect kernel performance events) ___________________ : YES
    slabinfo (monitor kernel object caching) ___________________ : YES
    Xen ________________________________________________________ : NO
    Xen VBD Error Tracking _____________________________________ : NO
Exporters:
    AWS Kinesis ________________________________________________ : NO
    GCP PubSub _________________________________________________ : NO
    MongoDB ____________________________________________________ : YES
    Prometheus (OpenMetrics) Exporter __________________________ : YES
    Prometheus Remote Write ____________________________________ : YES
    Graphite ___________________________________________________ : YES
    Graphite HTTP / HTTPS ______________________________________ : YES
    JSON _______________________________________________________ : YES
    JSON HTTP / HTTPS __________________________________________ : YES
    OpenTSDB ___________________________________________________ : YES
    OpenTSDB HTTP / HTTPS ______________________________________ : YES
    All Metrics API ____________________________________________ : YES
    Shell (use metrics in shell scripts) _______________________ : YES
Debug/Developer Features:
    Trace All Netdata Allocations (with charts) ________________ : NO
    Developer Mode (more runtime checks, slower) _______________ : NO

it’s installed as a docker container on Unraid 6.12.3

4

I just checked the local space and Mongodb shows up there with the configured remote database. but it doesn’t show it in the remote space where the database is installed