AWS - US East (N. Virginia): INC0110871
Incident
Report for Snowflake
Postmortem
Snowflake Engineering has completed the postmortem of this service incident. A detailed Root Cause Analysis (RCA) is available on the Snowflake Community site:
https://community.snowflake.com/s/article/INC0110718-INC0110871-INC0111066-INC0111213
Resolved
Current status: We've implemented the fix for this issue and monitored the environment to confirm that service was restored. If you experience additional issues or have questions, please open a support case via Snowflake Community.
Customer experience: Users in the affected region(s) may have been intermittently unable to sign in or use the Snowflake service via Snowsight. As the issue was intermittent in nature, attempting to reload the page or sign in again may have succeeded.
Incident start time: 13:48 UTC June 27, 2024
Incident end time: 14:30 UTC June 28, 2024
Preliminary root cause: A significant increase in connection requests against a primary database supporting Snowsight application infrastructure caused the service to experience intermittent periods of degraded performance.
A root cause analysis (RCA) document will be published within seven business days.
Customer experience: Users in the affected region(s) may have been intermittently unable to sign in or use the Snowflake service via Snowsight. As the issue was intermittent in nature, attempting to reload the page or sign in again may have succeeded.
Incident start time: 13:48 UTC June 27, 2024
Incident end time: 14:30 UTC June 28, 2024
Preliminary root cause: A significant increase in connection requests against a primary database supporting Snowsight application infrastructure caused the service to experience intermittent periods of degraded performance.
A root cause analysis (RCA) document will be published within seven business days.
Update
Current status: Since implementing the latest database infrastructure optimizations, service performance has remained stable. We are continuing to closely monitor the environment, and we'll provide another update within 4 hours.
Customer experience: Users in the affected region(s) may have been intermittently unable to sign in or use the Snowflake service via Snowsight. As the issue was intermittent in nature, attempting to reload the page or sign in again may have succeeded.
Incident start time: 13:48 UTC June 27, 2024
Incident end time: 18:50 UTC June 27, 2024
Preliminary root cause: A significant increase in connection requests against a primary database supporting Snowsight application infrastructure caused the service to experience intermittent periods of degraded performance.
Customer experience: Users in the affected region(s) may have been intermittently unable to sign in or use the Snowflake service via Snowsight. As the issue was intermittent in nature, attempting to reload the page or sign in again may have succeeded.
Incident start time: 13:48 UTC June 27, 2024
Incident end time: 18:50 UTC June 27, 2024
Preliminary root cause: A significant increase in connection requests against a primary database supporting Snowsight application infrastructure caused the service to experience intermittent periods of degraded performance.
Update
Current status: While the initial mitigations we implemented have increased overall stability on the affected database infrastructure, we have continued to observe some brief periods of intermittent service impact during peak traffic. We are closely monitoring the environment while continuing to implement additional optimizations to more effectively balance periods of increased connection requests. We'll provide another update within 2 hours.
Customer experience: Users in the affected region(s) may have been intermittently unable to sign in or use the Snowflake service via Snowsight. As the issue was intermittent in nature, attempting to reload the page or sign in again may have succeeded.
Incident start time: 13:48 UTC June 27, 2024
Incident end time: 18:50 UTC June 27, 2024
Preliminary root cause: A significant increase in connection requests against a primary database supporting Snowsight application infrastructure caused the service to experience intermittent periods of degraded performance.
Customer experience: Users in the affected region(s) may have been intermittently unable to sign in or use the Snowflake service via Snowsight. As the issue was intermittent in nature, attempting to reload the page or sign in again may have succeeded.
Incident start time: 13:48 UTC June 27, 2024
Incident end time: 18:50 UTC June 27, 2024
Preliminary root cause: A significant increase in connection requests against a primary database supporting Snowsight application infrastructure caused the service to experience intermittent periods of degraded performance.
Monitoring
Current status: We've implemented an additional fix for this issue, and we'll continue to monitor the environment over an extended period of time until we're confident all services are functioning properly. We'll provide another update by June 28, 2024, or earlier should there be a significant change in status.
Customer experience: Users in the affected region(s) may have been intermittently unable to sign in or use the Snowflake service via Snowsight. As the issue was intermittent in nature, attempting to reload the page or sign in again may have succeeded.
Incident start time: 13:48 UTC June 27, 2024
Incident end time: 18:50 UTC June 27, 2024
Preliminary root cause: A significant increase in connection requests against a primary database supporting Snowsight application infrastructure caused the service to experience intermittent periods of degraded performance.
Customer experience: Users in the affected region(s) may have been intermittently unable to sign in or use the Snowflake service via Snowsight. As the issue was intermittent in nature, attempting to reload the page or sign in again may have succeeded.
Incident start time: 13:48 UTC June 27, 2024
Incident end time: 18:50 UTC June 27, 2024
Preliminary root cause: A significant increase in connection requests against a primary database supporting Snowsight application infrastructure caused the service to experience intermittent periods of degraded performance.
Identified
Current status: Following our initial mitigation, we've identified that intermittent impact continues to occur during peak periods of increased connection counts. We are continuing to work on immediate mitigation actions to help alleviate the impact on the affected infrastructure. We'll provide another update within 2 hours.
Customer experience: Users in the affected region(s) may be intermittently unable to sign in or use the Snowflake service via Snowsight. As the issue was intermittent in nature, attempting to reload the page or sign in again may succeed.
Incident start time: 13:48 UTC June 27, 2024
Customer experience: Users in the affected region(s) may be intermittently unable to sign in or use the Snowflake service via Snowsight. As the issue was intermittent in nature, attempting to reload the page or sign in again may succeed.
Incident start time: 13:48 UTC June 27, 2024
Monitoring
Current status: We've implemented the fix for this issue, and we'll continue to monitor the environment until we're confident all services are functioning properly.
Customer experience: Users in the affected region(s) may have been intermittently unable to sign in or use the Snowflake service via Snowsight. As the issue was intermittent in nature, attempting to reload the page or sign in again may have succeeded.
Incident start time: 13:48 UTC June 27, 2024
Incident end time: 16:30 UTC June 27, 2024
Preliminary root cause: A significant increase in connection requests against a primary database supporting Snowsight application infrastructure caused the service to experience intermittent periods of degraded performance during peak traffic.
Customer experience: Users in the affected region(s) may have been intermittently unable to sign in or use the Snowflake service via Snowsight. As the issue was intermittent in nature, attempting to reload the page or sign in again may have succeeded.
Incident start time: 13:48 UTC June 27, 2024
Incident end time: 16:30 UTC June 27, 2024
Preliminary root cause: A significant increase in connection requests against a primary database supporting Snowsight application infrastructure caused the service to experience intermittent periods of degraded performance during peak traffic.
Identified
Current status: We've identified the source of the issue, and we're developing and implementing a fix to restore service. We'll provide another update within 60 minutes.
Customer experience: Users in the affected region(s) may be intermittently unable to sign in to the Snowflake service via Snowsight. As the issue is intermittent in nature, attempting to reload the page or sign in again may succeed.
Incident start time: 13:48 UTC June 27, 2024
Customer experience: Users in the affected region(s) may be intermittently unable to sign in to the Snowflake service via Snowsight. As the issue is intermittent in nature, attempting to reload the page or sign in again may succeed.
Incident start time: 13:48 UTC June 27, 2024
Investigating
Current status: We're investigating an issue with Snowflake Data Cloud. We'll provide an update within 60 minutes.
Customer experience: Users in the affected region(s) may be intermittently unable to sign in to the Snowflake service via Snowsight. As the issue is intermittent in nature, attempting to reload the page or sign in again may succeed.
Incident start time: 13:48 UTC June 27, 2024
Customer experience: Users in the affected region(s) may be intermittently unable to sign in to the Snowflake service via Snowsight. As the issue is intermittent in nature, attempting to reload the page or sign in again may succeed.
Incident start time: 13:48 UTC June 27, 2024
This incident affected: AWS - US East (N. Virginia) (Snowsight).