Mahiru - Major outage of all services – Incident details

All systems operational

Major outage of all services

Resolved
Major outage
Started over 2 years agoLasted about 14 hours

Affected

Bot

Major outage from 3:25 AM to 5:25 PM

Website

Major outage from 3:25 AM to 5:25 PM

API

Major outage from 3:25 AM to 5:25 PM

Updates
  • Resolved
    UTC
    Resolved

    Everything works as intended. The incident has been resolved.

  • Monitoring
    UTC
    Monitoring

    The fix has been deployed. We are monitoring activity of all services to make sure everything works as intended.

  • Identified
    UTC
    Identified

    We have finally identified the issue. Deploying final fix.

  • Update
    UTC
    Update

    All services are now in a maintenance mode. You won't be able to use bot or website until we identify and fix the issue.

  • Investigating
    UTC
    Investigating

    Unfortunately, the fix was unsuccessful. We have to shut down everything, until the issue is resolved, in order to prevent any further errors.

  • Identified
    UTC
    Identified

    Looks like we've found the issue. Deploying a fix.

  • Update
    UTC
    Update

    Doing full restart of all services now.

  • Investigating
    UTC
    Investigating

    Because of evaluated error rate on Anime News/Releases servers, other services are experiencing issues as well. Investigating.