berrybyte - VPS Elder avalliability issue. – Incident details

VPS Elder avalliability issue.

Resolved
Major outage
Started 5 months agoLasted 20 minutes
Updates
  • Postmortem
    UTC
    Postmortem

    On 2026-05-12 at approximately 04:02 UTC, the rene: vps-dfw-7950X hypervisor became unreachable due to a kernel fault on the host. The host was recovered via power cycle and all VMs returned to service automatically.

    Timeline (UTC)

    • 04:02 - Hypervisor (and subsequent VMs) stopped responding to network and console.

    • 04:07 - NOC alerted; investigation began.

    • 04:16 - Out-of-band investigation confirmed the host was wedged at the kernel level and not recoverable in software.

    • 04:25 - Host was forcefully power-cycled. Boot and VM auto-start completed within a few minutes.

    • 04:29 - All VMs confirmed running.

    We've identified the kernel condition that caused the host to hang and applied a configuration change to prevent it from recurring. Additional monitoring has been added to detect early warning signs of this class of issue across our fleet.

    We're sorry for the disruption. If you're still experiencing issues with your VM, please contact support and we'll take a look.

  • Resolved
    UTC
    Resolved
    This incident has been resolved.
  • Monitoring
    UTC
    Monitoring
    We implemented a fix and are currently monitoring the result.
  • Investigating
    UTC
    Investigating
    We are currently investigating this incident.