Apr <var data-var='date'> 2</var>, <var data-var='time'>19:53</var> UTC Resolved - Replication complete, incident resolved.Apr <var data-var='date'> 2</var>, <var data-var='time'>18:45</var> UTC Identified - Servers in the iad region experienced unexpected disk load, resulting in elevated latencies and a temporary read-only state. We are migrating replicas to new instances to mitigate the issue and expect to have it fully resolved shortly.

Fly.io Upstash Redis – iad Region Elevated Latency and Temporary Read-Only State

Mar <var data-var='date'>27</var>, <var data-var='time'>15:30</var> UTC Resolved - Due to a race condition in a process that attaches static IPs to nodes, some of the IPs in the dns were detached from the nodes, causing timeouts.

Upstash Redis: GCP Global Connectivity Problems

Mar <var data-var='date'> 6</var>, <var data-var='time'>14:49</var> UTC Resolved - This incident has been resolved.Mar <var data-var='date'> 6</var>, <var data-var='time'>14:08</var> UTC Monitoring - A fix has been implemented and we are monitoring the results.Mar <var data-var='date'> 6</var>, <var data-var='time'>13:50</var> UTC Investigating - We are currently investigating this issue.

Region ap-northeast-1 outage on Upstash Global

Jan <var data-var='date'>23</var>, <var data-var='time'>15:30</var> UTC Resolved - We identified the cause of elevated latency impacting some databases in us-east-1 region between 15:30–15:35 UTC as a sudden surge of connection attempts that hit OS-level connection limits on our proxy layer. This resulted in slower new connection establishment and increased latency for some requests. Databases were not impacted. We are implementing additional proxy-level metrics and safeguards to detect and manage similar edge cases earlier.

Upstash Redis: Intermittent latency on us-east-1

Dec <var data-var='date'>10</var>, <var data-var='time'>12:08</var> UTC Resolved - Issue has been identified and replicas were successfully reconnected.Dec <var data-var='date'>10</var>, <var data-var='time'>11:50</var> UTC Investigating - We identified an issue in Regional Databases in US-East-1 where database replicase have connectivity issues with each other. Other regions are not impacted. Global databases are not impacted. We are working on the issue.

Connectivity issue impacting Regional Databases in US-East-1

Dec <var data-var='date'> 5</var>, <var data-var='time'>09:18</var> UTC Resolved - This incident has been resolved.Dec <var data-var='date'> 5</var>, <var data-var='time'>09:03</var> UTC Investigating - Upstream provider confirmed an incident. We are investigating the impact and potential resolutions.

Upstash Console and Context7 Console is Currently Experiencing issues

Dec <var data-var='date'> 1</var>, <var data-var='time'>07:00</var> UTC Resolved - We identified and fixed a bug that could cause messages with Flow Control enabled to be delayed longer than their configured delay, resulting in unexpectedly long pending times. The fix is in place and the issue should not recur. If you’re still seeing unusually long-delayed messages, please contact support@upstash.com and we can help with remediation.

QStash - Message delays for Flow Control configurations

Oct <var data-var='date'>20</var>, <var data-var='time'>18:50</var> UTC Resolved - A fix has been deployed as a workaround so that our systems are not affected from the ongoing incident of the cloud providerOct <var data-var='date'>20</var>, <var data-var='time'>18:07</var> UTC Update - Developer API (api.upstash.com) is having availability issues alongside Upstash Console. While we are monitoring the underlying cloud provider's status updates, we are also working on a remediation.Oct <var data-var='date'>20</var>, <var data-var='time'>15:05</var> UTC Monitoring - Console is back to normal again. We are currently monitoring.Oct <var data-var='date'>20</var>, <var data-var='time'>14:52</var> UTC Investigating - We are currently experiencing errors in the Upstash Console due to issues with one of our upstream providers. This may affect access to the dashboard and related operations. Our team is actively monitoring the situation and working to mitigate the impact. We will provide updates as soon as more information becomes available.

Upstash Console issues

Oct <var data-var='date'>20</var>, <var data-var='time'>07:00</var> UTC Resolved - As a side effect of an incident on the underlying cloud provider, Upstash Console has had availability issues between 07:00UTC and 09:23UTC. Only Upstash Console is impacted, Upstash products remained operational.

Login Issues on Upstash Console

Oct <var data-var='date'>10</var>, <var data-var='time'>15:46</var> UTC Resolved - Between 15:46–15:55 UTC, some client connection attempts to databases in us-east-1 timed out due to unexpected high load on a server. The node was recovered at 15:50 UTC, and the updated DNS record propagated by 15:55 UTC. Services are operating normally.

Connectivity issue on us-east-1

Sep <var data-var='date'> 9</var>, <var data-var='time'>12:00</var> UTC Resolved - Impact: A subset of clients connecting through the eu-central-1 region experienced increased error rates and timeouts when accessing certain databases. Clients in us-west-2 were also briefly affected. The issue was limited in scope and did not impact other regions. Root Cause: During an ongoing migration to improve database routing reliability, a configuration step was applied inconsistently across regions. Resolution: Our monitoring alerted us within minutes, and the migration was promptly rolled back for the affected regions. Service definitions were restored, and normal database connectivity resumed by 15:08 UTC. Next Steps: We are reviewing our migration process to ensure consistency across all regions and adding additional safeguards to prevent similar issues in the future.

Temporary Database Routing Issue

Aug <var data-var='date'>18</var>, <var data-var='time'>12:37</var> UTC Resolved - Between 12:37 UTC and 12:50 UTC, an overload in the connection proxying system resulted in instability for a subset of databases. The root cause was identified as a misconfiguration in the routing rules, which caused certain requests to experience timeouts during the initial phase of a gradual deployment. Upon detection, the deployment was immediately rolled back, restoring normal service. We are reviewing our deployment and configuration validation processes to prevent similar issues in the future.

Connectivity Issues in us-east-1

Jun <var data-var='date'>26</var>, <var data-var='time'>07:34</var> UTC Resolved - This incident has been resolved.Jun <var data-var='date'>26</var>, <var data-var='time'>07:12</var> UTC Monitoring - A fix has been implemented and we are monitoring the results.Jun <var data-var='date'>26</var>, <var data-var='time'>06:53</var> UTC Identified - Some users may experience login issues due to a disruption in our authentication provider. We’re actively monitoring the situation.

Login problems on Upstash Console

Jun <var data-var='date'>12</var>, <var data-var='time'>16:07</var> UTC Resolved - This incident has been resolved.Jun <var data-var='date'>12</var>, <var data-var='time'>14:40</var> UTC Monitoring - A fix has been implemented and we are monitoring the results.Jun <var data-var='date'>12</var>, <var data-var='time'>14:28</var> UTC Investigating - We are currently investigating this issue.

QStash: Degraded performance

Jun <var data-var='date'>11</var>, <var data-var='time'>10:02</var> UTC Resolved - This incident has been resolved.Jun <var data-var='date'>11</var>, <var data-var='time'>09:20</var> UTC Monitoring - A fix has been implemented and we are monitoring the results.Jun <var data-var='date'>11</var>, <var data-var='time'>08:24</var> UTC Update - We are continuing to investigate this issue.Jun <var data-var='date'>11</var>, <var data-var='time'>06:51</var> UTC Investigating - We are currently investigating this issue.

Degraded Performance

Jun <var data-var='date'>10</var>, <var data-var='time'>12:08</var> UTC Resolved - This incident has been resolved.Jun <var data-var='date'>10</var>, <var data-var='time'>07:45</var> UTC Monitoring - A fix has been implemented and we are monitoring the results.Jun <var data-var='date'>10</var>, <var data-var='time'>07:23</var> UTC Investigating - We are currently investigating this issue.

Performance Degradation

May <var data-var='date'>22</var>, <var data-var='time'>17:41</var> UTC Resolved - This incident has been resolved.May <var data-var='date'>22</var>, <var data-var='time'>16:44</var> UTC Monitoring - A fix has been implemented and we are monitoring the results.

Global Ireland (eu-west-1) Degraded Performance

Apr <var data-var='date'>18</var>, <var data-var='time'>13:18</var> UTC Resolved - This incident has been resolved.Apr <var data-var='date'>18</var>, <var data-var='time'>12:46</var> UTC Monitoring - A fix has been implemented and we are monitoring the results.Apr <var data-var='date'>18</var>, <var data-var='time'>12:36</var> UTC Update - We are continuing to investigate this issue.Apr <var data-var='date'>18</var>, <var data-var='time'>12:36</var> UTC Investigating - We are currently investigating this issue.

Apr <var data-var='date'> 2</var>, <var data-var='time'>21:12</var> UTC Resolved - QStash service and Event logs are fully functional without any remaning issues.Apr <var data-var='date'> 2</var>, <var data-var='time'>20:20</var> UTC Update - Monitoring: Main QStash service is back to normal. Event logs service is back online but events will be lagging a few mins.Apr <var data-var='date'> 2</var>, <var data-var='time'>17:33</var> UTC Monitoring - Main QStash service is back to normal. Event logs are still temporarily unavailable.Apr <var data-var='date'> 2</var>, <var data-var='time'>16:33</var> UTC Update - We are continuing to investigate this issue.Apr <var data-var='date'> 2</var>, <var data-var='time'>16:29</var> UTC Update - We are continuing to investigate this issue.Apr <var data-var='date'> 2</var>, <var data-var='time'>16:21</var> UTC Investigating - We are currently investigating this issue.Apr <var data-var='date'> 2</var>, <var data-var='time'>08:15</var> UTC Monitoring - A fix has been implemented and we are monitoring the results.Apr <var data-var='date'> 2</var>, <var data-var='time'>07:15</var> UTC Investigating - We are currently investigating this issue.

QStash: Degraded performance in request processing and event logs

Mar <var data-var='date'>12</var>, <var data-var='time'>10:16</var> UTC Resolved - This incident has been resolved.Mar <var data-var='date'>12</var>, <var data-var='time'>10:08</var> UTC Monitoring - A fix has been implemented and we are monitoring the results.Mar <var data-var='date'>12</var>, <var data-var='time'>09:43</var> UTC Investigating - We are currently investigating this issue.

Performance degradation on QStash

Feb <var data-var='date'>25</var>, <var data-var='time'>21:23</var> UTC Resolved - This incident has been resolved.Feb <var data-var='date'>25</var>, <var data-var='time'>20:54</var> UTC Monitoring - A fix has been implemented and we are monitoring the results.Feb <var data-var='date'>25</var>, <var data-var='time'>14:03</var> UTC Identified - Regional AWS eu-west-1 cluster is experiencing performance degradation, and we are adding more resources to the cluster.

Regional AWS eu-west-1 Cluster Performance Degradation Issue

Feb <var data-var='date'>20</var>, <var data-var='time'>08:00</var> UTC Resolved - We experienced a very short period of API downtime for the incoming requests to QStash due to urgent maintenance to ensure the stability and performance of our services. Our team acted quickly to address the issue, and everything is now fully operational.

We experienced a very short period of API downtime for the incoming requests to QStash due to urgent maintenance to ensure the stability and performance of our services. Our team acted quickly to address the issue, and everything is now fully operational.

Feb <var data-var='date'> 6</var>, <var data-var='time'>10:10</var> UTC Resolved - Latest QStash release caused some Workflow runs to fail due to a bug in Workflow URL detection mechanism. Affected workflows did not start at all and moved directly to DLQ. These workflow runs, which show "detected non-workflow destination" message in the response body, can be retried from DLQ. This was a partial failure, lasted from 10:10 to 11:00 UTC, not all users' workflows were affected.

QStash Workflow Run Failure

Jan <var data-var='date'>29</var>, <var data-var='time'>18:03</var> UTC Resolved - We observed a disk failure on some instances on 16:52 UTC and restarted affected components to bring them back online. Issue is resolved on 17:13 UTC. During the time of the issue databases reachability are affected, no data is lost.

Disk failure in some Regional Databases

Nov <var data-var='date'>13</var>, <var data-var='time'>17:27</var> UTC Resolved - We will be sharing a postmortem about the incident soon.Nov <var data-var='date'>13</var>, <var data-var='time'>15:38</var> UTC Identified - The issue has been identified and a fix is being implemented.Nov <var data-var='date'>13</var>, <var data-var='time'>14:14</var> UTC Investigating - We are currently investigating this issue.

Is Upstash down?

Upstash status is UP

Lastest published events

Fly.io Upstash Redis – iad Region Elevated Latency and Temporary Read-Only State

Upstash Redis: GCP Global Connectivity Problems

Region ap-northeast-1 outage on Upstash Global

Upstash Services, Components and Regions

Recent Upstash events

Fly.io Upstash Redis – iad Region Elevated Latency and Temporary Read-Only State

Upstash Redis: GCP Global Connectivity Problems

Region ap-northeast-1 outage on Upstash Global

Upstash Redis: Intermittent latency on us-east-1

Connectivity issue impacting Regional Databases in US-East-1

Upstash Console and Context7 Console is Currently Experiencing issues

Get your FREE account now,
5 monitors included!

Is Upstash down?

Upstash status is UP

Lastest published events

Fly.io Upstash Redis – iad Region Elevated Latency and Temporary Read-Only State

Upstash Redis: GCP Global Connectivity Problems

Region ap-northeast-1 outage on Upstash Global

Upstash Services, Components and Regions

Recent Upstash events

Fly.io Upstash Redis – iad Region Elevated Latency and Temporary Read-Only State

Upstash Redis: GCP Global Connectivity Problems

Region ap-northeast-1 outage on Upstash Global

Upstash Redis: Intermittent latency on us-east-1

Connectivity issue impacting Regional Databases in US-East-1

Upstash Console and Context7 Console is Currently Experiencing issues

Get your FREE account now,5 monitors included!

Get your FREE account now,
5 monitors included!