Azure - West Europe (Netherlands): INC0125110
Incident
Report for Snowflake
Postmortem
Snowflake Engineering has completed the postmortem of this service incident. A detailed Root Cause Analysis (RCA) is available on the Snowflake Community site: https://community.snowflake.com/s/article/INC0125110
Resolved
Current status: We've implemented the fix for this issue and monitored the environment to confirm that service was restored. If you experience additional issues or have questions, please open a support case via Snowflake Community.
Customer experience: Customers may have experienced delays or been unable to resume Virtual Warehouses.
Incident start time: 12:00 UTC January 28, 2025
Incident end time: 17:43 UTC January 28, 2025
Preliminary root cause: A system responsible for infrastructure management entered a degraded state, causing a queue of requests to form related to warehouse provisioning.
A root cause analysis (RCA) document will be published within seven business days.
Customer experience: Customers may have experienced delays or been unable to resume Virtual Warehouses.
Incident start time: 12:00 UTC January 28, 2025
Incident end time: 17:43 UTC January 28, 2025
Preliminary root cause: A system responsible for infrastructure management entered a degraded state, causing a queue of requests to form related to warehouse provisioning.
A root cause analysis (RCA) document will be published within seven business days.
Monitoring
Current status: We've implemented an additional mitigation to speed up processing the backlog of requests, and warehouse resume latency has returned to normal as of 17:45 UTC. We'll continue to monitor the environment until we're confident all services are functioning properly.
Customer experience: Customers may have experienced delays or been unable to resume Virtual Warehouses.
Incident start time: 12:00 UTC January 28, 2025
Incident end time: 17:45 UTC January 28, 2025
Preliminary root cause: A system responsible for infrastructure management entered a degraded state, causing a queue of requests to form related to warehouse provisioning.
Customer experience: Customers may have experienced delays or been unable to resume Virtual Warehouses.
Incident start time: 12:00 UTC January 28, 2025
Incident end time: 17:45 UTC January 28, 2025
Preliminary root cause: A system responsible for infrastructure management entered a degraded state, causing a queue of requests to form related to warehouse provisioning.
Update
Current status: We have observed an improvement after scaling up associated infrastructure provisioning systems; however, we still expect an extended period of time required to process the backlog of requests. We are attempting to implement additional mitigation options to help speed up the processing of requests. We'll provide another update within 90 minutes.
Customer experience: Customers may not be able to resume Virtual Warehouses.
Incident start time: 12:00 UTC January 28, 2025
Customer experience: Customers may not be able to resume Virtual Warehouses.
Incident start time: 12:00 UTC January 28, 2025
Update
Current status: We've identified a system responsible for infrastructure management entered a degraded state, causing a queue of requests to form related to warehouse provisioning. We have scaled up associated provisioning systems to help process the backlog of requests while we continue to investigate the source of the issue. We'll provide another update within 60 minutes.
Customer experience: Customers may not be able to resume Virtual Warehouses.
Incident start time: 12:00 UTC January 28, 2025
Customer experience: Customers may not be able to resume Virtual Warehouses.
Incident start time: 12:00 UTC January 28, 2025
Identified
Current status: We have an indication of the source of the issue, and we're developing a fix to restore service. We'll provide another update within 60 minutes.
Customer experience: Customers might not be able to resume Virtual Warehouses.
Incident start time: 12:00 UTC January 28, 2025
Customer experience: Customers might not be able to resume Virtual Warehouses.
Incident start time: 12:00 UTC January 28, 2025
Investigating
Current status: We're investigating an issue with Snowflake Data Cloud. We'll provide an update within 60 minutes.
Customer experience: Customers might not be able to resume Virtual Warehouses.
Incident start time: 12:00 UTC January 28, 2025
Customer experience: Customers might not be able to resume Virtual Warehouses.
Incident start time: 12:00 UTC January 28, 2025
This incident affected: Azure - West Europe (Netherlands) (Snowflake Data Warehouse (Database)).