13 Deployments Affected: INC0110718
Incident
Report for Snowflake
Postmortem
Snowflake Engineering has completed the postmortem of this service incident. A detailed Root Cause Analysis (RCA) is available on the Snowflake Community site:
https://community.snowflake.com/s/article/INC0110718
Resolved
Current status: We've implemented the fix for this issue and monitored the environment to confirm that service was restored. If you experience additional issues or have questions, please open a support case via Snowflake Community.
Customer experience: Customers hosted in the specified regions may have been unable to execute queries or may have experienced delays resuming virtual warehouses. Additionally, customers hosted in the AWS - US East (N. Virginia) region saw errors attempting to sign in to Snowsight.
Incident start time: 18:25 UTC June 25, 2024
Incident end time: 20:10 UTC June 25, 2024
Preliminary root cause: A recently updated system configuration caused impact to provisioning systems, resulting in an availability issue due to new infrastructure and virtual warehouses not being able to deploy as expected.
A root cause analysis (RCA) document will be published within seven business days.
Customer experience: Customers hosted in the specified regions may have been unable to execute queries or may have experienced delays resuming virtual warehouses. Additionally, customers hosted in the AWS - US East (N. Virginia) region saw errors attempting to sign in to Snowsight.
Incident start time: 18:25 UTC June 25, 2024
Incident end time: 20:10 UTC June 25, 2024
Preliminary root cause: A recently updated system configuration caused impact to provisioning systems, resulting in an availability issue due to new infrastructure and virtual warehouses not being able to deploy as expected.
A root cause analysis (RCA) document will be published within seven business days.
Update
Current status: We've implemented the fix for this issue, and we'll continue to monitor the environment until we're confident all services are functioning properly.
Customer experience: Customers hosted in the specified regions may have been unable to execute queries or may have experienced delays resuming virtual warehouses. Additionally, customers hosted in the AWS - US East (N. Virginia) region saw errors attempting to sign in to Snowsight.
Incident start time: 18:25 UTC June 25, 2024
Incident end time: 20:10 UTC June 25, 2024
Preliminary root cause: A recently updated system configuration caused impact to provisioning systems, resulting in an availability issue due to new infrastructure and virtual warehouses not being able to deploy as expected.
Customer experience: Customers hosted in the specified regions may have been unable to execute queries or may have experienced delays resuming virtual warehouses. Additionally, customers hosted in the AWS - US East (N. Virginia) region saw errors attempting to sign in to Snowsight.
Incident start time: 18:25 UTC June 25, 2024
Incident end time: 20:10 UTC June 25, 2024
Preliminary root cause: A recently updated system configuration caused impact to provisioning systems, resulting in an availability issue due to new infrastructure and virtual warehouses not being able to deploy as expected.
Monitoring
Current status: We've implemented the fix for this issue, and we'll continue to monitor the environment until we're confident all services are functioning properly.
Customer experience: Customers hosted in the specified regions may have been unable to execute queries or may experience delays resuming virtual warehouses. Additionally, customers hosted in the AWS - US East (N. Virginia) region saw errors attempting to sign in to Snowsight.
Incident start time: 18:25 UTC June 25, 2024
Incident end time: 20:10 UTC June 25, 2024
Preliminary root cause: A recently updated system configuration caused impact to provisioning systems, resulting in an availability issue due to new infrastructure and virtual warehouses not being able to deploy as expected.
Customer experience: Customers hosted in the specified regions may have been unable to execute queries or may experience delays resuming virtual warehouses. Additionally, customers hosted in the AWS - US East (N. Virginia) region saw errors attempting to sign in to Snowsight.
Incident start time: 18:25 UTC June 25, 2024
Incident end time: 20:10 UTC June 25, 2024
Preliminary root cause: A recently updated system configuration caused impact to provisioning systems, resulting in an availability issue due to new infrastructure and virtual warehouses not being able to deploy as expected.
Identified
Current status: We've identified the source of the issue, and we're developing and implementing a fix to restore service. We'll provide another update within 60 minutes.
Customer experience: Customers hosted in the specified regions may be unable to execute queries or access Snowsight.
Incident start time: 18:25 UTC June 25, 2024
Customer experience: Customers hosted in the specified regions may be unable to execute queries or access Snowsight.
Incident start time: 18:25 UTC June 25, 2024
Investigating
Current status: We're investigating an issue with Snowflake Data Cloud. We'll provide an update within 60 minutes.
Customer experience: Customers hosted in the specified regions may be unable to execute queries or access Snowsight.
Incident start time: 18:25 UTC June 25, 2024
Customer experience: Customers hosted in the specified regions may be unable to execute queries or access Snowsight.
Incident start time: 18:25 UTC June 25, 2024
This incident affected: Azure - Canada Central (Toronto) (Snowflake Data Warehouse (Database)), Azure - UAE North (Dubai) (Snowflake Data Warehouse (Database)), AWS - Asia Pacific (Mumbai) (Snowflake Data Warehouse (Database)), Azure - Switzerland North (Zürich) (Snowflake Data Warehouse (Database)), GCP - Europe West 2 (London) (Snowflake Data Warehouse (Database)), AWS - Europe (London) (Snowflake Data Warehouse (Database)), Azure - Central US (Iowa) (Snowflake Data Warehouse (Database)), Azure - North Europe (Ireland) (Snowflake Data Warehouse (Database)), Azure - Southeast Asia (Singapore) (Snowflake Data Warehouse (Database)), Azure - South Central US (Texas) (Snowflake Data Warehouse (Database)), AWS - Asia Pacific (Jakarta) (Snowflake Data Warehouse (Database)), AWS - US East (N. Virginia) (Snowflake Data Warehouse (Database), Snowsight), and AWS - Europe (Frankfurt) (Snowflake Data Warehouse (Database)).