Sensu-Plugins-mesos

Functionality

Files

• bin/check-chronos.rb
• bin/check-metronome.rb
• bin/check-marathon.rb
• bin/check-marathon-apps.rb
• bin/check-mesos.rb
• bin/check-mesos-cpu-balance.rb
• bin/check-mesos-disk-balance.rb
• bin/check-mesos-gpu-balance.rb
• bin/check-mesos-mem-balance.rb
• bin/metrics-marathon.rb
• bin/metrics-mesos.rb

Usage

bin/check-marathon-apps.rb

Note: This check is an unconventional one. It won't output a check result as many other conventional check scripts, and will publish multiple check results via the local sensu agent endpoint, effectively breaks the expectation of 1:1 mapping between check-definition and check-results.

This plugin checks Marathon apps based on https://mesosphere.github.io/marathon/docs/marathon-ui.html#application-status-reference . It produces two check results per application. One for the apps health and another check result for the apps status.

Check results can be customised by two ways:

1. Default check result fields thats applied to all will be provided by a default check config. Please see the source code to see the whole defaults. Since the whole default check config tends to be big, you can also use check-config-overrides flag just to provide few new fields or override existing defaults.
2. Application owners can override check results by using marathon labels. This allows each application to have different fields in the published result. e.g. per app escalation or aggregate can be controlled by applying Marathon labels to the apps.

SENSU_MARATHON_CONTACT = team_a_rotation
SENSU_MARATHON_AGGREGATE = this_apps_aggregate  # will be applied to both `status` and `health` check results
SENSU_MARATHON_STATUS_AGGREGATE = status_aggregate  # status result of the app have different aggregate
SENSU_MARATHON_HEALTH_AGGREGATE = health_aggregate  # health result of the app have different aggregate
SENSU_MARATHON_STATUS_UNSCHEDULED_STATUS = 0  # Disable the check's fail status for this app when it's in unscheduled state.

The override templates that could be used in marathon app labels are:

SENSU_MARATHON_<check_result_field>  # will be applied all below if not overridden
SENSU_MARATHON_STATUS_<check_result_field>  # will be applied all status states if not overridden
SENSU_MARATHON_STATUS_<status_state>_<check_result_field>
SENSU_MARATHON_HEALTH_<check_result_field>  # will be applied all healt states if not overridden
SENSU_MARATHON_RESULT_<result_state>_<check_result_field>

Where:

• check_result_field could be any field in json.
• status_state is one of "waiting", "delayed", "suspended", "deploying" or "running".
• health_state is one of "unscheduled", "overcapacity", "staged", "unknown", "unhealthy" or "healthy".

Example run:

$ check-marathon-task.rb
heckMarathonApps OK: Marathon Apps Status and Health check is running properly

The command output of the check script will always be same independently from which apps are being checked, but you'll see 2 check-results per app like these in sensu:

{
  "name": "check_marathon_app_test_status",
  "executed": 1519305736,
  "marathon": {
    "id": "/test",
    "version": "2018-02-20T15:09:43.086Z",
    "versionInfo": {
      "lastScalingAt": "2018-02-20T15:09:43.086Z",
      "lastConfigChangeAt": "2018-02-20T15:09:43.086Z"
    },
    "tasksStaged": 0,
    "tasksRunning": 1,
    "tasksHealthy": 1,
    "tasksUnhealthy": 0
  },
  "output": "STATUS Unscheduled - tasksRunning(1), tasksStaged(0), tasksHealthy(1), tasksUnhealthy(0)",
  "ttl": 10,
  "source": "marathon",
  "status": 2
}
{
  "name": "check_marathon_app_test_health",
  "executed": 1519305736,
  "marathon": {
    "id": "/test",
    "version": "2018-02-20T15:09:43.086Z",
    "versionInfo": {
      "lastScalingAt": "2018-02-20T15:09:43.086Z",
      "lastConfigChangeAt": "2018-02-20T15:09:43.086Z"
    },
    "tasksStaged": 0,
    "tasksRunning": 1,
    "tasksHealthy": 1,
    "tasksUnhealthy": 0
  },
  "output": "HEALTH Healthy - tasksRunning(1), tasksStaged(0), tasksHealthy(1), tasksUnhealthy(0)",
  "ttl": 10,
  "source": "marathon",
  "status": 0
}

Installation

Installation and Setup

Notes