ops.foreversorted.com

Operations Watchdog

Hybrid watchdog foundation for Northbridge-first operational monitoring.

Watchdog Help

Critical

Current watchdog summary across generated artifacts: 8 healthy, 0 warning, 5 critical, 0 unknown.

Generated
2026-05-06 23:22
Watchdog Path
/home/shared/webprojects/operations/watchdog/output
Output Path Exists
Yes

Devices & Telemetry

Heartbeat and freshness for non-server operational dependencies.

CRITICAL
Latest Artifact
solar-inverter.json
Last Updated
2026-05-06 23:15
Artifacts
2

Live Check Summary

Artifact Healthy
0
Artifact Warning
0
Artifact Critical
2
Artifact Unknown
0
Maintained Artifacts
0
Maintained Criticals
0
Checks Healthy
0
Checks Warning
0
Checks Critical
2
Checks Unknown
0
Maintained Checks
0

Operator Notes

  • Track Arduino heartbeat, pool-pump state freshness, and inverter telemetry age.
  • Alert on stale or implausibly frozen telemetry even when the host is reachable.

Collected Artifacts

Latest artifact details and the individual checks reported for this section.

Solar Inverter

Solar Inverter heartbeat and freshness checks.

CRITICAL
Artifact File
solar-inverter.json
Updated
2026-05-06 23:15
Checks
1
Raw File
Open raw file
Maintenance
Off
Enter Maintenance Mode

This writes a maintenance rule into the watchdog config so the issue remains visible but no longer pages as an active critical.

  • Solar Inverter CRITICAL
    Freshness age is 77089 minutes for /home/shared/webprojects/operations/watchdog/heartbeats/solar-inverter.heartbeat.

Arduino Pool Controller

Arduino Pool Controller heartbeat and freshness checks.

CRITICAL
Artifact File
arduino-pool.json
Updated
2026-05-06 23:15
Checks
1
Raw File
Open raw file
Maintenance
Off
Enter Maintenance Mode

This writes a maintenance rule into the watchdog config so the issue remains visible but no longer pages as an active critical.

  • Arduino Pool Controller CRITICAL
    Freshness file not found: /home/shared/webprojects/operations/watchdog/heartbeats/arduino-pool.heartbeat

Summary Artifact

{
    "label": "Critical",
    "tone": "critical",
    "detail": "Watchdog collector completed with 11 artifacts, including 0 warning, 3 critical, 0 maintained critical, and 0 unknown states.",
    "updated_at": "2026-05-06T13:15:01+00:00",
    "counts": {
        "healthy": 8,
        "warning": 0,
        "critical": 3,
        "unknown": 0,
        "suppressed_critical": 0,
        "maintained": 0
    },
    "alert_items": [
        {
            "kind": "check",
            "id": "backuppc_last_success",
            "label": "BackupPC / BackupPC host homefile-data",
            "detail": "Latest completed successful backup for BackupPC host homefile-data is full #2685 from 2026-04-30 22:02 (age 6.1 days). Recent successful backups: #2685 full 2026-04-30 22:02 (6.1 days old); #2683 incr 2026-03-16 22:17 (51.1 days old); #2682 incr 2026-03-15 22:18 (52.1 days old)."
        },
        {
            "kind": "check",
            "id": "arduino-pool_freshness",
            "label": "Arduino Pool Controller / Arduino Pool Controller",
            "detail": "Freshness file not found: /home/shared/webprojects/operations/watchdog/heartbeats/arduino-pool.heartbeat"
        },
        {
            "kind": "check",
            "id": "solar-inverter_freshness",
            "label": "Solar Inverter / Solar Inverter",
            "detail": "Freshness age is 77089 minutes for /home/shared/webprojects/operations/watchdog/heartbeats/solar-inverter.heartbeat."
        }
    ],
    "maintained_items": []
}