Azure - East US 2 (Virginia): INC0100501
Incident
Report for Snowflake
Postmortem
Snowflake Engineering has completed the postmortem of this service incident. A detailed Root Cause Analysis (RCA) is available on the Snowflake Community site: https://community.snowflake.com/s/article/INC0100501-and-INC0100718
Resolved
Current status: We've implemented the fix for this issue and monitored the environment to confirm that service was restored. If you experience additional issues or have questions, please open a support case via Snowflake Community.
Customer experience: Customers hosted in the specified regions may have experienced delays while attempting to access or use Snowflake services and features. If you are continuing to experience issues accessing the Snowflake user interface, please attempt to clear your browser cache and sign in again.
Incident start time: 14:38 UTC January 17, 2024
Incident end time: 17:32 UTC January 17, 2024
Preliminary root cause: We identified that subsystems related to request-routing infrastructure for our cloud services and query-processing layers entered a degraded state, and we restarted affected systems to mitigate impact.
A root cause analysis (RCA) document will be published within seven business days.
Customer experience: Customers hosted in the specified regions may have experienced delays while attempting to access or use Snowflake services and features. If you are continuing to experience issues accessing the Snowflake user interface, please attempt to clear your browser cache and sign in again.
Incident start time: 14:38 UTC January 17, 2024
Incident end time: 17:32 UTC January 17, 2024
Preliminary root cause: We identified that subsystems related to request-routing infrastructure for our cloud services and query-processing layers entered a degraded state, and we restarted affected systems to mitigate impact.
A root cause analysis (RCA) document will be published within seven business days.
Monitoring
Current status: We've implemented the fix for this issue, and we'll continue to monitor the environment until we're confident all services are functioning properly.
Customer experience: Customers hosted in the specified regions may have experienced delays while attempting to access or use Snowflake services and features. If you are continuing to experience issues accessing the Snowflake user interface, please attempt to clear your browser cache and sign in again.
Incident start time: 14:38 UTC January 17, 2024
Incident end time: 17:32 UTC January 17, 2024
Preliminary root cause: We identified that subsystems related to request-routing infrastructure for our cloud services and query-processing layers entered a degraded state, and we restarted affected systems to mitigate impact.
Customer experience: Customers hosted in the specified regions may have experienced delays while attempting to access or use Snowflake services and features. If you are continuing to experience issues accessing the Snowflake user interface, please attempt to clear your browser cache and sign in again.
Incident start time: 14:38 UTC January 17, 2024
Incident end time: 17:32 UTC January 17, 2024
Preliminary root cause: We identified that subsystems related to request-routing infrastructure for our cloud services and query-processing layers entered a degraded state, and we restarted affected systems to mitigate impact.
Update
Current status: We have correlated an identified increase in error rates with subsystems related to request-routing infrastructure, and we are restarting affected components as a potential mitigation.
Customer experience: Customers hosted in the specified regions may experience delays while attempting to access or use Snowflake services and features.
Customer experience: Customers hosted in the specified regions may experience delays while attempting to access or use Snowflake services and features.
Update
Current status: We identified an increase in error rates between our cloud services and query processing layers, and are rolling back all recent environment changes as a precaution as we continue to investigate. We'll provide another update within 60 minutes.
Customer experience: Customers hosted in the specified regions may experience delays while attempting to access or use Snowflake services and features.
Customer experience: Customers hosted in the specified regions may experience delays while attempting to access or use Snowflake services and features.
Investigating
Current status: We're investigating an issue with Snowflake Data Cloud. We'll provide an update within 60 minutes.
Customer experience: Customers hosted in the specified regions may experience delays while attempting to access or use Snowflake services and features.
Customer experience: Customers hosted in the specified regions may experience delays while attempting to access or use Snowflake services and features.
This incident affected: Azure - East US 2 (Virginia) (Snowflake Data Warehouse (Database), Snowsight).