Gaps in SNMP Graph, because of data not getting indexed on time via the snmp input plugin

[gauravubnare]

Hi @kaisecheng,

As requested here is the information

1. SNMP Sample config file

input {
snmp {
get => ["1.3.6.1.2.1.1.5.0","1.3.6.1.4.1.9.9.48.1.1.1.6.1","1.3.6.1.4.1.9.9.48.1.1.1.5.1"]
tables => [{"name" => "interfaces" "columns" => ["1.3.6.1.2.1.2.2.1.2","1.3.6.1.2.1.31.1.1.1.18","1.3.6.1.2.1.2.2.1.10","1.3.6.1.2.1.2.2.1.16","1.3.6.1.2.1.2.2.1.5","1.3.6.1.2.1.2.2.1.6","1.3.6.1.2.1.2.2.1.8","1.3.6.1.2.1.2.2.1.7","1.3.6.1.2.1.31.1.1.1.6","1.3.6.1.2.1.31.1.1.1.10","1.3.6.1.2.1.2.2.1.9"]}]
type => "snmp"
oid_path_length => 2
interval => 300
hosts => [{host => "udp:10.0.0.1/161" version => "3" retries => 1 timeout => 1000}, {host => "udp:10.0.0.2/161" version => "3" retries => 1 timeout => 1000}, {host => "udp:10.0.0.3/161" version => "3" retries => 1 timeout => 1000}, {host => "udp:10.0.0.4/161" version => "3" retries => 1 timeout => 1000}, {host => "udp:10.0.0.5/161" version => "3" retries => 1 timeout => 1000}, {host => "udp:10.0.0.6/161" version => "3" retries => 1 timeout => 1000}, {host => "udp:10.0.0.7/161" version => "3" retries => 1 timeout => 1000}, {host => "udp:10.0.0.8/161" version => "3" retries => 1 timeout => 1000}, {host => "udp:10.0.0.9/161" version => "3" retries => 1 timeout => 1000}, {host => "udp:10.0.0.10/161" version => "3" retries => 1 timeout => 1000}]
security_name => "security_name"
auth_protocol => "sha"
auth_pass => " auth_pass"
priv_protocol => "aes"
priv_pass => "priv_pass"
security_level => "authPriv"
}
}

filter {
split {
field => "interfaces"
}
}

output {
elasticsearch {
id => "snmp_hosts"
hosts => [ "https://elasticendpoint" ]
ssl => "true"
ssl_certificate_verification => "true"
index => "snmp-testing-%{+YYYY.MM}"
user => "username"
password => "password"
}
}

2. Have you confirmed that there are no network issues at the time?

• I am 100% sure. there are no network issues...

Let me know if you need anything else. please help us resolve this issue. Thanks!!

[gauravubnare]

@kaisecheng @colinsurprenant please help me solve this

[kaisecheng]

@gauravubnare please update the issue with a problem description, logs during the timeframe and steps to reproduce to allow the community to help.

[gauravubnare]

Hi,

can anyone please help us with this. we have around 100+ routers and we are facing lots of issues with the SNMP plugin like the data plotted on the dashboard has lots of gaps and dips in the inbound/outbound utilization graph we have. polling interval is 5 mins...

to solve this problem. we had one pipeline with 100 hosts earlier we split the pipeline to 1 pipeline with - 5 hosts that actually solved lots of issues... but still, it is not fully stable.. and also ending up using a lot of resources on the logstash server because of the multiple pipelines...

@kaisecheng @colinsurprenant pls help us resolve this.

Thanks

[gauravubnare]

SNMP Sample config file
input {
snmp {
get => ["1.3.6.1.2.1.1.5.0","1.3.6.1.4.1.9.9.48.1.1.1.6.1","1.3.6.1.4.1.9.9.48.1.1.1.5.1"]
tables => [{"name" => "interfaces" "columns" => ["1.3.6.1.2.1.2.2.1.2","1.3.6.1.2.1.31.1.1.1.18","1.3.6.1.2.1.2.2.1.10","1.3.6.1.2.1.2.2.1.16","1.3.6.1.2.1.2.2.1.5","1.3.6.1.2.1.2.2.1.6","1.3.6.1.2.1.2.2.1.8","1.3.6.1.2.1.2.2.1.7","1.3.6.1.2.1.31.1.1.1.6","1.3.6.1.2.1.31.1.1.1.10","1.3.6.1.2.1.2.2.1.9"]}]
type => "snmp"
oid_path_length => 2
interval => 300
hosts => [{host => "udp:10.0.0.1/161" version => "3" retries => 1 timeout => 1000}, {host => "udp:10.0.0.2/161" version => "3" retries => 1 timeout => 1000}, {host => "udp:10.0.0.3/161" version => "3" retries => 1 timeout => 1000}, {host => "udp:10.0.0.4/161" version => "3" retries => 1 timeout => 1000}, {host => "udp:10.0.0.5/161" version => "3" retries => 1 timeout => 1000}, {host => "udp:10.0.0.6/161" version => "3" retries => 1 timeout => 1000}, {host => "udp:10.0.0.7/161" version => "3" retries => 1 timeout => 1000}, {host => "udp:10.0.0.8/161" version => "3" retries => 1 timeout => 1000}, {host => "udp:10.0.0.9/161" version => "3" retries => 1 timeout => 1000}, {host => "udp:10.0.0.10/161" version => "3" retries => 1 timeout => 1000}]
security_name => "security_name"
auth_protocol => "sha"
auth_pass => " auth_pass"
priv_protocol => "aes"
priv_pass => "priv_pass"
security_level => "authPriv"
}
}

filter {
split {
field => "interfaces"
}
}

output {
elasticsearch {
id => "snmp_hosts"
hosts => [ "https://elasticendpoint" ]
ssl => "true"
ssl_certificate_verification => "true"
index => "snmp-testing-%{+YYYY.MM}"
user => "username"
password => "password"
}
}

[gauravubnare]

please help @kaisecheng