Azure - Southeast Asia (Singapore): INC0079436
Incident
Report for Snowflake
Postmortem
Snowflake Engineering has completed the postmortem of this service incident. A detailed Root Cause Analysis (RCA) is available on the Snowflake Community site:
https://community.snowflake.com/s/article/INC0079436
Resolved
Current status: We've coordinated with our third-party service provider to implement the fix for this issue, and we've monitored the environment to confirm that service was restored. If you experience additional issues or have questions, please open a support case via Snowflake Community.
Customer experience: Customers hosted in the specified regions may have experienced delays while attempting to execute queries. Affected customers might have encountered query failures.
Incident start time: 02:44 UTC March 01, 2023
Incident end time: 09:05 UTC March 01, 2023
A root cause analysis (RCA) document will be published within ten business days.
Customer experience: Customers hosted in the specified regions may have experienced delays while attempting to execute queries. Affected customers might have encountered query failures.
Incident start time: 02:44 UTC March 01, 2023
Incident end time: 09:05 UTC March 01, 2023
A root cause analysis (RCA) document will be published within ten business days.
Monitoring
Current status: We've implemented the fix for this issue, and we'll continue to monitor the environment until we're confident all services are functioning properly.
Customer experience: Customers hosted in the specified regions may have experienced delays while attempting to execute queries. Affected customers might have encountered query failures.
Incident start time: 02:44 UTC March 01, 2023
Incident end time: 09:05 UTC March 01, 2023
Customer experience: Customers hosted in the specified regions may have experienced delays while attempting to execute queries. Affected customers might have encountered query failures.
Incident start time: 02:44 UTC March 01, 2023
Incident end time: 09:05 UTC March 01, 2023
Update
Current status: The Networking Team from the Cloud Service Provider has identified a potential workaround for the connectivity issues between the Query Processing layer and the Storage layer system which is currently being implemented. The Cloud Service Provider continues the investigation towards the root cause. We'll provide an update within 60 minutes.
Customer experience: Customers hosted in the specified regions may experience delays while attempting to execute queries. Affected customers may encounter query failures.
Incident start time: 02:44 UTC March 01, 2023
Customer experience: Customers hosted in the specified regions may experience delays while attempting to execute queries. Affected customers may encounter query failures.
Incident start time: 02:44 UTC March 01, 2023
Update
Current status: The Networking Team from the Cloud Service Provider continue to investigate the connectivity issues between the Query Processing layer and the Storage layer system. An internal esalation has been triggered within the Cloud Service Provider's teams to expedite a resolution. We'll provide an update within 60 minutes.
Customer experience: Customers hosted in the specified regions may experience delays while attempting to execute queries. Affected customers may encounter query failures.
Incident start time: 02:44 UTC March 01, 2023
Customer experience: Customers hosted in the specified regions may experience delays while attempting to execute queries. Affected customers may encounter query failures.
Incident start time: 02:44 UTC March 01, 2023
Update
Current status: The Networking Team from the Cloud Service Provider is continuing to investigate the connectivity issues between the Query Processing layer and the Storage layer system. An internal esalation has been triggered within the Cloud Service Provider's teams to expedite a resolution. We'll provide an update within 60 minutes.
Customer experience: Customers hosted in the specified regions may experience delays while attempting to execute queries. Affected customers may encounter query failures.
Incident start time: 02:44 UTC March 01, 2023
Customer experience: Customers hosted in the specified regions may experience delays while attempting to execute queries. Affected customers may encounter query failures.
Incident start time: 02:44 UTC March 01, 2023
Update
Current status: The Networking Team from the Cloud Service Provider is continuing to investigate the connectivity issues between the Query Processing layer and the Storage layer system. We'll provide an update within 60 minutes.
Customer experience: Customers hosted in the specified regions may experience delays while attempting to execute queries. Affected customers may encounter query failures.
Incident start time: 02:44 UTC March 01, 2023
Customer experience: Customers hosted in the specified regions may experience delays while attempting to execute queries. Affected customers may encounter query failures.
Incident start time: 02:44 UTC March 01, 2023
Update
Current status: We're observing connectivity issues between the Query Processing layer and the Storage layer systems and have engaged networking teams from our Cloud Service Provider and internal to Snowflake to investigate further. We'll provide an update within 60 minutes.
Customer experience: Customers hosted in the specified regions may experience delays while attempting to execute queries. Affected customers may encounter query failures.
Incident start time: 02:44 UTC March 01, 2023
Customer experience: Customers hosted in the specified regions may experience delays while attempting to execute queries. Affected customers may encounter query failures.
Incident start time: 02:44 UTC March 01, 2023
Update
Current status: We're seeing elevated error rates in establishing connectivity with the storage layer and are working with our Cloud Service Provider to determine the cause. We'll provide an update within 60 minutes.
Customer experience: Customers hosted in the specified regions may experience delays while attempting to execute queries. Affected customers may encounter query failures.
Incident start time: 02:44 UTC March 01, 2023
Customer experience: Customers hosted in the specified regions may experience delays while attempting to execute queries. Affected customers may encounter query failures.
Incident start time: 02:44 UTC March 01, 2023
Investigating
Current status: We're investigating an issue with Snowflake Data Cloud. We'll provide an update within 60 minutes.
Customer experience: Customers hosted in the specified regions may experience delays while attempting to execute queries. Affected customers may encounter query failures.
Incident start time: 02:44 UTC March 01, 2023
Customer experience: Customers hosted in the specified regions may experience delays while attempting to execute queries. Affected customers may encounter query failures.
Incident start time: 02:44 UTC March 01, 2023
This incident affected: Azure - Southeast Asia (Singapore) (Snowflake Data Warehouse (Database)).