Cloudflare Global Network Experiaencing issues

Resolved
Resolved

Status: Resolved

Our services are now operating normally.

Between 11:20 and 17:06 UTC on 18 November, some users experienced errors due to an issue with Cloudflare network. No data was lost, and we are continuing to monitor performance. Thank you for your patience.

What happened

At approximately 11:20 UTC on 18 November, a change in Cloudflare’s systems caused critical failures in parts of their network. Many sites using Cloudflare, including ours, began returning Cloudflare error pages and HTTP 500 internal server errors.

Root cause

Cloudflare has attributed the incident to a bug in how a Bot Management “feature file” was generated following a database permissions change. The file, which is distributed globally to help detect and manage bot traffic, became significantly larger than expected and caused the software handling core network traffic to crash in multiple locations. This led to elevated error rates for sites behind Cloudflare until they reverted to a stable configuration. Cloudflare has confirmed this was not the result of a cyberattack or data breach.

Timeline

  • 11:20 UTC – First significant failures in Cloudflare’s network delivering core traffic.

  • 14:30 UTC – Correct Bot Management configuration file deployed globally; most services operating normally again.

  • 17:06 UTC – Cloudflare reported all systems functioning as normal and the incident as resolved.

Avatar for Stripe21 Support
Stripe21 Support
Investigating

Cloudflare is aware and investigating an issue that potentially impacts multiple customers ,and more information will be provided when it becomes available.

Avatar for Stripe21 Support
Stripe21 Support
Began at:

Affected components
  • S21 Voice Services
    • PBX Services
    • SIP Trunks
    • Voice Database Services
    • SBCs
    • Voice Radius Services
  • Hosted Services
    • Hosted Database
  • S21 Network Services
    • National Ethernet Services
    • Supplier Services
      • Voice Networks
      • Data Networks