Aug <var data-var='date'>22</var>, <var data-var='time'>04:47</var> UTC Resolved - This incident has been resolved. Aug <var data-var='date'>22</var>, <var data-var='time'>03:32</var> UTC Monitoring - A fix has been implemented, and we are monitoring the results. All publish requests are now succeeding. Aug <var data-var='date'>22</var>, <var data-var='time'>03:17</var> UTC Investigating - We are investigating an increased error rate affecting the us2 cluster. All services remain operational, but a subset of customers may experience intermittent issues.

Elevated errors on us2 cluster

Apr <var data-var='date'> 6</var>, <var data-var='time'>02:55</var> UTC Resolved - This incident has been resolved. Apr <var data-var='date'> 6</var>, <var data-var='time'>02:32</var> UTC Monitoring - A fix has been implemented and we are monitoring the results. Apr <var data-var='date'> 6</var>, <var data-var='time'>02:01</var> UTC Identified - The issue has been identified and a fix is being implemented. Apr <var data-var='date'> 6</var>, <var data-var='time'>01:52</var> UTC Investigating - We are currently investigating an issue with intermittent errors for the Channels API in US2 cluster.

Intermittent API errors in US2 cluster

Mar <var data-var='date'>31</var>, <var data-var='time'>12:44</var> UTC Resolved - This incident has been resolved. Mar <var data-var='date'>31</var>, <var data-var='time'>12:42</var> UTC Monitoring - A fix has been implemented and we are monitoring the results. Mar <var data-var='date'>31</var>, <var data-var='time'>12:33</var> UTC Identified - Customers on the SA1 cluster may have experienced delayed or missed webhook deliveries, including cache channel webhooks.

Cluster SA1: Delayed Channels webhook delivery on SA1 cluster

Mar <var data-var='date'>15</var>, <var data-var='time'>06:30</var> UTC Completed - The scheduled maintenance has been completed. Mar <var data-var='date'>15</var>, <var data-var='time'>06:00</var> UTC In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary. Mar <var data-var='date'>10</var>, <var data-var='time'>15:31</var> UTC Scheduled - Scheduled maintenance will be performed on cluster us3. During this window, a subset of API requests may experience intermittent failures.

Maintenance on cluster US3

Feb <var data-var='date'>15</var>, <var data-var='time'>22:14</var> UTC Resolved - This incident has been resolved. Feb <var data-var='date'>15</var>, <var data-var='time'>21:38</var> UTC Monitoring - The fix has been implemented and we are monitoring the results. The issue affected only part of the cluster traffic. All services are currently operational Feb <var data-var='date'>15</var>, <var data-var='time'>20:33</var> UTC Investigating - We are currently investigating this issue.

Increased error rate on the US2 cluster

Feb <var data-var='date'> 6</var>, <var data-var='time'>12:25</var> UTC Completed - The scheduled maintenance has been completed. Feb <var data-var='date'> 6</var>, <var data-var='time'>10:20</var> UTC In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary. Feb <var data-var='date'> 6</var>, <var data-var='time'>10:18</var> UTC Scheduled - We will be performing maintenance to increase cluster capacity. Some clients may experience reconnections.

Maintenance on the Channels US3 cluster

Feb <var data-var='date'> 5</var>, <var data-var='time'>14:58</var> UTC Completed - The scheduled maintenance has been completed. Feb <var data-var='date'> 5</var>, <var data-var='time'>10:45</var> UTC In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary. Feb <var data-var='date'> 5</var>, <var data-var='time'>10:41</var> UTC Scheduled - We will be performing scheduled maintenance during this time to increase cluster capacity. Some clients may experience reconnections.

Jan <var data-var='date'>29</var>, <var data-var='time'>10:58</var> UTC Resolved - This incident has been resolved. Jan <var data-var='date'>29</var>, <var data-var='time'>10:55</var> UTC Monitoring - A fix has been implemented and we are monitoring the situation Jan <var data-var='date'>29</var>, <var data-var='time'>10:38</var> UTC Investigating - We are currently investigating the issue with increased error rate for the Channels API in cluster us3

Errors increase for API in cluster us3

Jan <var data-var='date'>26</var>, <var data-var='time'>22:43</var> UTC Resolved - This incident has been resolved. Jan <var data-var='date'>26</var>, <var data-var='time'>22:29</var> UTC Investigating - We are currently investigating this issue.

Increased error rate on the US2 cluster impacting presence events

Jan <var data-var='date'>23</var>, <var data-var='time'>11:58</var> UTC Resolved - All affected accounts have been restored to their correct subscription levels. We sent an email yesterday to all impacted customers. If you notice any issues with your subscription, please contact us. Jan <var data-var='date'>22</var>, <var data-var='time'>16:38</var> UTC Identified - We’ve been made aware of an issue caused by our billing provider, Maxio, where a limited number of our customer accounts were incorrectly downgraded due to an incident on their side. We are actively working with Maxio to restore all affected accounts to their correct subscription levels.

Incorrect subscription changes affecting some accounts

Jan <var data-var='date'>16</var>, <var data-var='time'>12:41</var> UTC Resolved - This incident has been resolved. Jan <var data-var='date'>16</var>, <var data-var='time'>11:10</var> UTC Monitoring - A fix has been implemented and we are monitoring the results. Jan <var data-var='date'>16</var>, <var data-var='time'>10:56</var> UTC Identified - The issue has been identified and a fix is being implemented. Jan <var data-var='date'>16</var>, <var data-var='time'>08:48</var> UTC Investigating - We are currently investigating this issue.

Intermittent errors with message delivery on cluster us2

Jan <var data-var='date'>16</var>, <var data-var='time'>01:37</var> UTC Resolved - This incident has been resolved. Jan <var data-var='date'>16</var>, <var data-var='time'>01:16</var> UTC Monitoring - A fix has been implemented and we are monitoring the results. Jan <var data-var='date'>16</var>, <var data-var='time'>01:07</var> UTC Investigating - We are currently investigating this issue.

Intermittent errors with message delivery

Jan <var data-var='date'>14</var>, <var data-var='time'>20:57</var> UTC Completed - The scheduled maintenance has been completed. Jan <var data-var='date'>14</var>, <var data-var='time'>20:16</var> UTC Verifying - Verification is currently underway for the maintenance items. Jan <var data-var='date'>14</var>, <var data-var='time'>20:00</var> UTC In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary. Jan <var data-var='date'>14</var>, <var data-var='time'>09:44</var> UTC Scheduled - We will be performing maintenance on the Pusher Channels Stats Integration (Datadog & Librato). Some users may notice brief disruptions during this rollout. We’ll keep you updated on progress.

Maintenance on Pusher Channels Stats Integration

Jan <var data-var='date'> 8</var>, <var data-var='time'>09:58</var> UTC Completed - The scheduled maintenance has been completed. Jan <var data-var='date'> 8</var>, <var data-var='time'>09:15</var> UTC Verifying - Verification is currently underway for the maintenance items. Jan <var data-var='date'> 8</var>, <var data-var='time'>08:00</var> UTC In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary. Jan <var data-var='date'> 7</var>, <var data-var='time'>16:53</var> UTC Scheduled - We will be performing maintenance on the Pusher Channels Stats Integration (Datadog & Librato). Some users may notice brief disruptions during this rollout. We’ll keep you updated on progress.

Dec <var data-var='date'>16</var>, <var data-var='time'>13:44</var> UTC Completed - The scheduled maintenance has been completed. Dec <var data-var='date'>16</var>, <var data-var='time'>13:06</var> UTC Verifying - Verification is currently underway for the maintenance items. Dec <var data-var='date'>16</var>, <var data-var='time'>10:18</var> UTC Update - Scheduled maintenance is still in progress. We will provide updates as necessary. Dec <var data-var='date'>16</var>, <var data-var='time'>10:00</var> UTC In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary. Dec <var data-var='date'>16</var>, <var data-var='time'>08:45</var> UTC Scheduled - We’re currently performing maintenance on the Pusher Channels Stats Integration (Datadog & Librato). Some users may notice brief disruptions during this rollout. We’ll keep you updated on progress.

Dec <var data-var='date'>15</var>, <var data-var='time'>16:36</var> UTC Completed - The scheduled maintenance has been completed. Dec <var data-var='date'>15</var>, <var data-var='time'>14:05</var> UTC In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary. Dec <var data-var='date'>15</var>, <var data-var='time'>14:03</var> UTC Scheduled - We’re currently performing maintenance on the Pusher Channels Stats Integration (Datadog & Librato). Some users may notice brief disruptions during this rollout. We’ll keep you updated on progress.

Oct <var data-var='date'>27</var>, <var data-var='time'>13:34</var> UTC Resolved - This incident has been resolved. Oct <var data-var='date'>27</var>, <var data-var='time'>12:53</var> UTC Update - All services are now fully operational. We continue to monitor the cluster. Oct <var data-var='date'>27</var>, <var data-var='time'>12:41</var> UTC Monitoring - We observed unusual activity on the cluster, likely caused by at least one customer experiencing a cyber attack. Our team is mitigating the issue while simultaneously increasing cluster resources to minimize impact on other customers. The cluster availability is returning to normal. We continue to monitor closely. Oct <var data-var='date'>27</var>, <var data-var='time'>12:22</var> UTC Identified - A fix is implemented. We are seeing improvements and continue to actively monitor the situation to ensure full stability. During the incident, many clients successfully connected using fallback protocols. Oct <var data-var='date'>27</var>, <var data-var='time'>11:50</var> UTC Investigating - We are currently experiencing disruptions with socket connections in AP1 cluster, which began at 10:00 UTC. Clients may experience reconnections. Our team is actively investigating the issue and working to restore full connectivity as quickly as possible.

AP1 cluster - Socket connection failures

Oct <var data-var='date'>21</var>, <var data-var='time'>17:43</var> UTC Resolved - This incident has been resolved. Oct <var data-var='date'>21</var>, <var data-var='time'>17:39</var> UTC Monitoring - A fix has been implemented and we are monitoring the results. Oct <var data-var='date'>21</var>, <var data-var='time'>17:32</var> UTC Identified - We are currently investigating an issue affecting the Channels API. A large number of customers may be unable to publish new messages through the API in the AP4 cluster. Oct <var data-var='date'>21</var>, <var data-var='time'>15:29</var> UTC Monitoring - A fix has been implemented and we are monitoring. The cluster will take a few more minutes to fully stabilize across all nodes. Oct <var data-var='date'>21</var>, <var data-var='time'>15:27</var> UTC Update - The team continues to make progress restoring the cache services. We anticipate full resolution in the next 10-15 minutes. Oct <var data-var='date'>21</var>, <var data-var='time'>15:09</var> UTC Identified - The team has identified the issue with one of our backend caching servers. The team is working to restore the connections to the server. Oct <var data-var='date'>21</var>, <var data-var='time'>15:06</var> UTC Investigating - We're experiencing an elevated level of API errors and latency in AP4 and are currently looking into the issue.

Elevated API Errors in AP4 Cluster

Oct <var data-var='date'>21</var>, <var data-var='time'>07:14</var> UTC Resolved - This incident has been resolved. Oct <var data-var='date'>20</var>, <var data-var='time'>17:26</var> UTC Investigating - Our cloud provider is currently experiencing an incident that's causing increased latency on Pusher Channels main cluster `mt1` . This issue is external to our systems and is not related to our infrastructure. Our team is actively investigating to determine if there are any additional impacts and working to minimize downstream effects while our provider implements a fix.

MT1 cluster - increased latency

Oct <var data-var='date'>21</var>, <var data-var='time'>07:13</var> UTC Resolved - This incident has been resolved. Oct <var data-var='date'>20</var>, <var data-var='time'>17:21</var> UTC Investigating - Our cloud provider is currently experiencing an incident that's affecting Pusher Beams operations. This issue is external to our systems and is not related to our infrastructure. Our team is actively investigating to determine if there are any additional impacts and working to minimize downstream effects while our provider implements a fix.

Pusher Beams degradation

Oct <var data-var='date'>20</var>, <var data-var='time'>20:41</var> UTC Resolved - This incident has been resolved. Oct <var data-var='date'>20</var>, <var data-var='time'>20:20</var> UTC Monitoring - All services are now fully operational. Our team continues to monitor the system closely to ensure ongoing stability and performance. Oct <var data-var='date'>20</var>, <var data-var='time'>19:59</var> UTC Update - Our team has identified the root cause of the issue and implemented a fix. The affected cluster is now in the process of recovering, and performance is gradually returning to normal. We will continue to closely monitor the situation until full recovery is confirmed. Oct <var data-var='date'>20</var>, <var data-var='time'>19:04</var> UTC Update - We are currently experiencing a major outage in US3 cluster. Our engineering team is actively working to restore full functionality as quickly as possible. In the meantime, we recommend customers temporarily switch to an alternative cluster to minimize service disruption. Oct <var data-var='date'>20</var>, <var data-var='time'>19:01</var> UTC Identified - We are continuing to investigate this issue. Oct <var data-var='date'>20</var>, <var data-var='time'>19:01</var> UTC Update - We are continuing to investigate this issue. Oct <var data-var='date'>20</var>, <var data-var='time'>18:36</var> UTC Investigating - We're seeing an increased latency and a number of 503 errors on us3 cluster. The team is investigating.

US3 cluster - major outage

Oct <var data-var='date'>20</var>, <var data-var='time'>12:57</var> UTC Resolved - This incident has been resolved. Oct <var data-var='date'>20</var>, <var data-var='time'>10:17</var> UTC Update - Our cloud provider is reporting recovery across most affected services. On our side, we haven’t noticed any issues in the past hour, and all services are operating normally. We continue to monitor the situation closely and will provide updates if anything changes. Oct <var data-var='date'>20</var>, <var data-var='time'>09:33</var> UTC Monitoring - The impact on our services is decreasing and we have not observed any additional issues with other services. We continue to monitor the situation closely. Oct <var data-var='date'>20</var>, <var data-var='time'>08:10</var> UTC Investigating - Our cloud provider is currently experiencing an incident that's causing increased latency and webhook delivery failures. This issue is external to our systems and is not related to our infrastructure. Our team is actively investigating to determine if there are any additional impacts and working to minimize downstream effects while our provider implements a fix.

MT1 cluster - increased latency and webhook delivery failures

Oct <var data-var='date'>20</var>, <var data-var='time'>10:18</var> UTC Resolved - Our cloud provider is reporting recovery across most affected services. On our side, we haven’t noticed any issues in the past hour, and all services are operating normally. We continue to monitor the situation closely and will provide updates if anything changes. Oct <var data-var='date'>20</var>, <var data-var='time'>09:34</var> UTC Monitoring - The impact on our services is decreasing and we have not observed any additional issues with other services. We continue to monitor the situation closely. Oct <var data-var='date'>20</var>, <var data-var='time'>08:19</var> UTC Investigating - Our cloud provider is currently experiencing an incident affecting webhook deliveries in Beams. This issue is external to our infrastructure and is limited to webhooks. Other Beams functionality remains operational. Our team is actively investigating to identify any additional impacts while monitoring the provider's resolution progress.

Beams - webhook delivery issues

Oct <var data-var='date'>19</var>, <var data-var='time'>08:17</var> UTC Resolved - Latency has remained stable over the past three hours. Our investigation identified multiple contributing factors to the earlier latency increase, including network saturation and capacity limits at our cloud providers affecting the US2 cluster. The US3 cluster issue was resolved quickly through autoscaling, while the US2 cluster experienced scaling delays that required manual intervention. We are implementing corrective measures to prevent recurrence and improve system resilience. Oct <var data-var='date'>19</var>, <var data-var='time'>04:03</var> UTC Update - We have scaled all three clusters out to handle the increased traffic. We anticipate the latency to slowly improve. Oct <var data-var='date'>19</var>, <var data-var='time'>03:11</var> UTC Identified - The issue has been identified and we are applying mitigations. We are seeing improved latency in main and us3 clusters. us2 still has elevated latency. Oct <var data-var='date'>19</var>, <var data-var='time'>00:44</var> UTC Investigating - Increased latency and degraded performance on clusters main, us2 and us3.

Increased latency - US2 cluster

Sep <var data-var='date'>21</var>, <var data-var='time'>07:54</var> UTC Resolved - This incident has been resolved. Sep <var data-var='date'>20</var>, <var data-var='time'>09:57</var> UTC Monitoring - A fix has been implemented and we are monitoring the results. Sep <var data-var='date'>19</var>, <var data-var='time'>21:15</var> UTC Identified - The issue has been identified and a fix is being implemented.

Is Pusher down?

Pusher status is UP

Lastest published events

Elevated errors on us2 cluster

Intermittent API errors in US2 cluster

Cluster SA1: Delayed Channels webhook delivery on SA1 cluster

Pusher Services, Components and Regions

Recent Pusher events

Elevated errors on us2 cluster

Intermittent API errors in US2 cluster

Cluster SA1: Delayed Channels webhook delivery on SA1 cluster

Maintenance on cluster US3

Increased error rate on the US2 cluster

Maintenance on the Channels US3 cluster