Skip to main content

Queue alerts

Enoch includes an optional queue alert checker in deploy/enoch_queue_alert_check.py plus systemd units and timers. It can send Pushover notifications when queue health suggests a hang or stoppage.

Enable config fields

{
  "pushover_alerts_enabled": true,
  "pushover_app_token": "replace-with-app-token",
  "pushover_user_key": "replace-with-user-key",
  "queue_alert_cooldown_sec": 1800,
  "queue_alert_hang_after_sec": 3600
}
Do not commit Pushover credentials.

Install the timer

When installed through scripts/install-control-plane.sh, the timer unit is available as enoch-queue-alert-check.timer.
sudo systemctl enable --now enoch-queue-alert-check.timer
systemctl list-timers enoch-queue-alert-check.timer
Run a one-shot check on the control-plane host (see current runtime snapshot for topology):
sudo ENOCH_CONFIG=/etc/enoch-control-plane/config.json \
  /opt/enoch-control-plane/deploy/enoch_queue_alert_check.py

Dispatch pump note

When "queue_pump_enabled": true, the queue alert checker can also dispatch queued work when the lane is safe. Optional flags control follow-up launch and paper drafting:
  • queue_pump_followup_launch_enabled — dry-run and launch one bounded follow-up when no queued candidate exists (defaults off).
  • queue_pump_paper_draft_enabled — draft one eligible paper before dispatch (defaults off; compatibility path).
Treat queue pumping as live automation: test status, preflight, and dry-run dispatch first.