Tag · 7 posts
#observability
Everything I've written tagged Observability.
Seconds of Work, Hours of Residency
My morning briefing started failing. Ollama was up and returned HTTP 500, because a 21-second image render was still holding 6.6 GB of VRAM hours later.
What Deserves Attention Today
My homelab produces one verdict each morning: something needs you, or nothing does. Getting the second half honest was much harder than the first.
The Alert That Named a Thing and Called It Evidence
Five high-severity alerts from my own monitoring. All five were the same defect: a record that names something being read as an observation of a property it never measured.
A Sandbox for Demos You Throw Away
One box runs every client demo I have live. The pattern is unremarkable; the interesting part was my monitoring reporting four healthy demos as missing.
The Network Is the Layer I Documented Last
My homelab has an IPAM, metrics from every access point, and a config file for the network that is entirely placeholders — with a warning at the top admitting it.
The Outage Was Never the Thing I Was Debugging
A homelab-wide outage at 01:45. I blamed the reverse proxy, then the IPS, then the SSO layer. The root cause was a network port down at the switch — everything I suspected was a symptom.
Daily Note: Debugging a Production API Flow
Integration test green, staging green, prod failing for 1% of callers. The bug was in a place I would never have guessed.