Baselines & N-sigma

Fixed thresholds rarely fit every hour: 60 % CPU is normal on Monday morning but suspicious at 3 a.m. on Sunday. Baselines solve this by learning each server's normal behaviour.

How the baseline is built

The monitor computes a rolling average and standard deviation per day-of-week × hour-of-day. Every metric gets an expected band that reflects the real daily and weekly rhythm.

N-sigma deviation

An alert can be based on an N-sigma deviation instead of a fixed value: it fires when the current reading is more than N standard deviations away from the baseline average for that time window.

  • Small N (e.g. 2) → more sensitive, more alerts.
  • Large N (e.g. 4) → only pronounced outliers.

Example: if CPU on Sunday night is typically 10 % ± 5 %, a value of 40 % trips at N = 3 – even though 40 % as a fixed threshold would never have stood out.

Working with hysteresis

N-sigma alerts use the same hysteresis and silences as fixed rules, so they behave just as quietly.

Baselines need some history to be meaningful. Right after adding a server the band is still wide; it tightens as the days go by.