3 Deployments Affected: INC0105296
Incident
Report for Snowflake
Postmortem
Snowflake Engineering has completed the postmortem of this service incident. A detailed Root Cause Analysis (RCA) is available on the Snowflake Community site:
https://community.snowflake.com/s/article/INC0105296
Resolved
Current status: We've implemented the fix for this issue and monitored the environment to confirm that service was restored. If you experience additional issues or have questions, please open a support case via Snowflake Community.
Customer experience: Customers hosted in the specified regions may have been intermittently unable to execute queries.
Incident start time: 09:00 UTC March 25, 2024
Incident end time: 12:15 UTC March 25, 2024
Preliminary root cause: An update to Snowflake's back-end infrastructure data collection tools, intended to improve system performance, caused unexpected disruption to the Cloud Services Layer systems resulting in intermittent impact to queries.
A root cause analysis (RCA) document will be published within seven business days.
Customer experience: Customers hosted in the specified regions may have been intermittently unable to execute queries.
Incident start time: 09:00 UTC March 25, 2024
Incident end time: 12:15 UTC March 25, 2024
Preliminary root cause: An update to Snowflake's back-end infrastructure data collection tools, intended to improve system performance, caused unexpected disruption to the Cloud Services Layer systems resulting in intermittent impact to queries.
A root cause analysis (RCA) document will be published within seven business days.
Monitoring
Current status: We've implemented the fix for this issue, and we'll continue to monitor the environment until we're confident all services are functioning properly.
Customer experience: Customers hosted in the specified regions may have been intermittently unable to execute queries.
Incident start time: 09:00 UTC March 25, 2024
Incident end time: 12:15 UTC March 25, 2024
Preliminary root cause: An update to Snowflake's back-end infrastructure data collection tools, intended to improve system performance, caused unexpected disruption to the Cloud Services Layer systems resulting in intermittent impact to queries.
Customer experience: Customers hosted in the specified regions may have been intermittently unable to execute queries.
Incident start time: 09:00 UTC March 25, 2024
Incident end time: 12:15 UTC March 25, 2024
Preliminary root cause: An update to Snowflake's back-end infrastructure data collection tools, intended to improve system performance, caused unexpected disruption to the Cloud Services Layer systems resulting in intermittent impact to queries.
Identified
Current status: We're continuing to develop and implement a fix to restore service. We'll provide another update within 60 minutes.
Customer experience: Customers hosted in the specified regions may be intermittently unable to execute queries.
Workaround: Customers experiencing intermittent issues with queries in the noted regions should manually re-run them.
Incident start time: 09:00 UTC March 25, 2024
Customer experience: Customers hosted in the specified regions may be intermittently unable to execute queries.
Workaround: Customers experiencing intermittent issues with queries in the noted regions should manually re-run them.
Incident start time: 09:00 UTC March 25, 2024
Update
Current status: We've confirmed that this issue impacts service, and we're continuing to investigate to determine the source of the issue. We'll provide another update within 60 minutes.
Customer experience: Customers hosted in the specified regions may be intermittently unable to execute queries.
Workaround: Customers experiencing intermittent issues with queries in the noted regions should manually re-run them.
Incident start time: 09:00 UTC March 25, 2024
Customer experience: Customers hosted in the specified regions may be intermittently unable to execute queries.
Workaround: Customers experiencing intermittent issues with queries in the noted regions should manually re-run them.
Incident start time: 09:00 UTC March 25, 2024
Investigating
Current status: We're investigating an issue with Snowflake Data Cloud. We'll provide an update within 60 minutes.
Customer experience: Customers hosted in the specified regions may be intermittently unable to execute queries.
Workaround: Customers experiencing intermittent issues with queries in this region should manually re-run them.
Customer experience: Customers hosted in the specified regions may be intermittently unable to execute queries.
Workaround: Customers experiencing intermittent issues with queries in this region should manually re-run them.
This incident affected: AWS - Europe (Ireland) (Snowflake Data Warehouse (Database)), AWS - US West (Oregon) (Snowflake Data Warehouse (Database)), and AWS - Asia Pacific (Sydney) (Snowflake Data Warehouse (Database)).