AWS - US East (N. Virginia): MI-20210927

Incident Report for Snowflake

Postmortem

Dear Customer,

Snowflake Engineering has completed the postmortem of this service incident. A detailed Root Cause Analysis is made available on the Snowflake Community site.

https://community.snowflake.com/s/article/MI-20210927

We apologize for the service incident and the impact on your applications.

If you have any questions or difficulty accessing the Snowflake community site, please send feedback by submitting a support case or calling Snowflake Technical Support.

Thank you,

Snowflake Support

Posted Oct 11, 2021 - 18:03 UTC

Resolved

The Service Incident is now closed.

A Root Cause Analysis (RCA) will be posted within the next ten business days.

We apologize for the inconvenience caused by this incident.

If you have any questions or experience any related issues, please open a support case via the Snowflake Community Site.
Posted Sep 27, 2021 - 11:35 UTC

Update

We applied a measure to mittigate the issue reported on the AWS status page ( https://status.aws.amazon.com ) regarding Degraded EBS Volume Performance in the Amazon Elastic Compute Cloud (N. Virginia).

Symptom(s): Warehouses intermittently not resuming, general performance degradation
Incident Start Time: 00:25 PT September 27, 2021
Incident End Time: 02:30 PT September 27, 2021

We continue monitoring the system for any further recurrence of the problem. We will remain in this state until the alert on the AWS status page is still present.
We will post our following update once the alert is gone, or in 2 hours, whichever comes first.

If you have any questions or experience any related issues, please open a support case via the Snowflake Community Site.
Posted Sep 27, 2021 - 11:16 UTC

Monitoring

We applied a measure to mitigate the issue reported on the AWS status page ( https://status.aws.amazon.com ) regarding Degraded EBS Volume Performance in the Amazon Elastic Compute Cloud (N. Virginia).

Symptom(s): Warehouses intermittently not resuming, general performance degradation
Incident Start Time: 00:25 PT September 27, 2021
Incident End Time: 02:30 PT September 27, 2021

We are now monitoring the system for any further recurrence of the problem. We will remain in this state for 60 minutes.

If you have any questions or experience any related issues, please open a support case via the Snowflake Community Site.
Posted Sep 27, 2021 - 10:21 UTC

Update

The issue is related to the incident reported on the AWS status page ( https://status.aws.amazon.com ) regarding Degraded EBS Volume Performance in the Amazon Elastic Compute Cloud (N. Virginia)

Update:
We've applied a measure to avoid the problematic zone AWS has identified and we are monitoring the recovery

Customer Action:
If possible, don't suspend your warehouses for improved performance

Symptom(s): Warehouses intermittently not resuming, general performance degradation
Incident Start Time: 00:25 PT September 27, 2021

We are working on mitigating the problem. We will update the status as soon as the issue is resolved or provide an update within 30 minutes.
Posted Sep 27, 2021 - 10:08 UTC

Identified

We have identified the problem with the Snowflake Service that is causing the following symptom(s):

Symptom(s): Warehouses intermittently not resuming, general performance degradation
Incident Start Time: 00:25 PT September 27, 2021

Customer Action:
If possible, don't suspend your warehouses for improved performance

The issue is related to the incident reported on the AWS status page ( https://status.aws.amazon.com ) regarding Degraded EBS Volume Performance in the Amazon Elastic Compute Cloud (N. Virginia)

We are working on mitigating the problem.

We will update the status as soon as the issue is resolved or provide an update within 30 minutes.
Posted Sep 27, 2021 - 09:37 UTC

Update

We are continuing to investigate the issue with Snowflake services.

Symptom(s): Warehouses intermittently not resuming, general performance degradation
Incident Start Time: 00:25 PT September 27, 2021

Customer Action:
If possible, don't suspend your warehouses for improved performance

We will provide more information on the problem investigation status as soon as we have identified the problem or provide an update within 30 minutes.
Posted Sep 27, 2021 - 09:08 UTC

Update

We are investigating an issue with one of the Snowflake services.

Symptom(s): Warehouses not resuming, general performance degradation
Incident Start Time: 00:25 PT September 27, 2021

We will provide more information on the problem investigation status as soon as we have identified the problem or provide an update within 30 minutes.
Posted Sep 27, 2021 - 08:38 UTC

Investigating

We are currently investigating a potential issue with the following:

AWS - US East (N. Virginia) - Snowflake Data Warehouse (Database)

This message is provided for informational purposes. If the investigation identifies that an Incident exists, we will post an update. Otherwise, we will remove this message.
Posted Sep 27, 2021 - 08:22 UTC
This incident affected: AWS - US East (N. Virginia) (Databases, Tables, and Views).