ProbeDown - vrts1001
Closed, ResolvedPublic
Actions

Assigned To

Authored By

	phaultfinder
	Jan 27 2024, 3:41 PM

Description

dashboard: https://grafana.wikimedia.org/d/O0nHhdhnz/network-probes-overview?var-job=probes/custom&var-module=All
description: vrts1001:1443 failed when probed by http_ticket_wikimedia_org_ip4 from eqiad. Availability is 0%.
logs: https://logstash.wikimedia.org/app/dashboards#/view/f3e709c0-a5f8-11ec-bf8e-43f1807d5bc2?_g=(filters:!((query:(match_phrase:(service.name:http_ticket_wikimedia_org_ip4)))))
runbook: https://wikitech.wikimedia.org/wiki/Runbook#vrts1001:1443
summary: Service vrts1001:1443 has failed probes (http_ticket_wikimedia_org_ip4)

dashboard: https://grafana.wikimedia.org/d/O0nHhdhnz/network-probes-overview?var-job=probes/custom&var-module=All
description: vrts1001:1443 failed when probed by http_ticket_wikimedia_org_ip4 from eqiad. Availability is 0%.
logs: https://logstash.wikimedia.org/app/dashboards#/view/f3e709c0-a5f8-11ec-bf8e-43f1807d5bc2?_g=(filters:!((query:(match_phrase:(service.name:http_ticket_wikimedia_org_ip4)))))
runbook: https://wikitech.wikimedia.org/wiki/Runbook#vrts1001:1443
summary: Service vrts1001:1443 has failed probes (http_ticket_wikimedia_org_ip4)
address: 10.64.48.12
alertname: ProbeDown
family: ip4
instance: vrts1001:1443
job: probes/custom
module: http_ticket_wikimedia_org_ip4
prometheus: ops
severity: task
site: eqiad
source: prometheus
team: collaboration-services
Source

Mentioned In: T356140: blackbox alerts: add instance names to tickets created by alerting
Mentioned Here: T355976: VRTS Performance Improvements tracking

Peachey88 renamed this task from ProbeDown to ProbeDown - vrts1001.Jan 28 2024, 7:28 AM

Peachey88 added a project: Znuny.

Looking at the dashboards it was the usual memory spike followed by service restart. These are expected to occur until T355976: VRTS Performance Improvements tracking is implemented.