Sep <var data-var='date'>30</var>, <var data-var='time'>22:56</var> EDT Resolved - The issue has been resolved by the Shopify team. Sep <var data-var='date'>29</var>, <var data-var='time'>12:50</var> EDT Investigating - We are investigating a slightly elevated error rate for recurring order placement. The issue appears to be related to an update within the Shopify platform and we are working with the Shopify team to help identify and remediate the root cause of this issue.

Slightly elevated error rate for Shopify recurring order placement

Sep <var data-var='date'>22</var>, <var data-var='time'>16:59</var> EDT Resolved - All pending orders have been successfully processed. Sep <var data-var='date'>22</var>, <var data-var='time'>13:47</var> EDT Monitoring - This morning, starting at approximately 5:00 AM CST, we experienced slower than normal order processing rates. The issue was addressed and fully resolved by approximately 12:30 PM CST. Orders are now processing at the normal rate and the system is working through the backlog.

Order Placement was slow

Sep <var data-var='date'> 8</var>, <var data-var='time'>14:12</var> EDT Resolved - This incident has been resolved. Sep <var data-var='date'> 3</var>, <var data-var='time'>08:44</var> EDT Update - We are continuing to monitor this issue as the analytics page is still experiencing some instability. There is no data loss in the process since collector is working properly. Sep <var data-var='date'> 2</var>, <var data-var='time'>17:07</var> EDT Monitoring - A fix has been implemented and we are monitoring the results. Sep <var data-var='date'> 2</var>, <var data-var='time'>13:20</var> EDT Investigating - We're investigating reports of the RC3 analytics page experiencing issues while loading metrics. The issue doesn't affect metrics collection. Reporting has not been affected.

Analytics page not loading on Ordergroove Dashboard

Sep <var data-var='date'> 1</var>, <var data-var='time'>12:19</var> EDT Resolved - Our hosting provider has implemented a network-level mitigation and our systems are back in full operational order. We are going to continue to monitor our systems and provide further updates as needed. Sep <var data-var='date'> 1</var>, <var data-var='time'>11:49</var> EDT Investigating - Our hosting provider is experiencing a system-wide network degradation which is affecting Ordergroove systems. All systems are still operational but are experiencing additional latency. We are actively working through this incident and will provide further updates shortly.

Hosting provider network degradation

Aug <var data-var='date'>27</var>, <var data-var='time'>20:45</var> EDT Resolved - A compatibility issue with our analytics provider was causing dashboards to fail to load. We've applied a fix and verified Analytics is working as expected. Thank you for your patience. Aug <var data-var='date'>27</var>, <var data-var='time'>14:27</var> EDT Investigating - We're investigating reports of the RC3 analytics page experiencing issues while loading metrics. The issue doesn't affect metrics collection. Reporting has not been affected.

Jul <var data-var='date'>21</var>, <var data-var='time'>08:00</var> EDT Completed - The scheduled maintenance has been completed. Jul <var data-var='date'>21</var>, <var data-var='time'>07:00</var> EDT In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary. Jul <var data-var='date'>17</var>, <var data-var='time'>17:32</var> EDT Scheduled - On July 21st, 7 AM ET we will be performing a scheduled maintenance on the Admin Dashboard platform - rc3.ordergroove.com. No downtime is expected. Response times may be slightly affected for the duration of the maintenance.

Admin Dashboard (rc3.ordergroove.com) scheduled maintenance - no impact expected

Jul <var data-var='date'>14</var>, <var data-var='time'>09:00</var> EDT Completed - The scheduled maintenance has been completed. Jul <var data-var='date'>14</var>, <var data-var='time'>06:00</var> EDT In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary. Jul <var data-var='date'> 8</var>, <var data-var='time'>13:45</var> EDT Scheduled - As part of our ongoing security and performance improvements, we’ll be conducting scheduled network maintenance on the Ordergroove Platform (Ordergroove admin and Shopify integration systems). No service interruption is expected and no action is required on your part.

Platform maintenance - Jul 14 2026

Jul <var data-var='date'>12</var>, <var data-var='time'>05:30</var> EDT Completed - The scheduled maintenance has been completed. Jul <var data-var='date'>12</var>, <var data-var='time'>04:30</var> EDT In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary. Jun <var data-var='date'>29</var>, <var data-var='time'>12:23</var> EDT Scheduled - We will be performing scheduled platform maintenance on July 12th between 4:30 AM and 5:30 AM EDT to enhance our platform’s scalability and security. No merchant or customer action is required, and we do not expect any system downtime. What to expect: - Dashboard & APIs: The Admin Dashboard and standard API endpoints will remain fully accessible. However, you may experience a brief 10–15 second window where some write operations see temporary error rates. - Subscription Creation: If you utilize the synchronous subscription creation method, a tiny fraction of requests might return a 400 error during this brief window. Ordergroove automatically reprocesses these requests. You do not need to implement any client-side retry logic or take manual action.

Platform maintenance - Jul 12 2026

Jul <var data-var='date'> 6</var>, <var data-var='time'>09:30</var> EDT Resolved - The Ordergroove team performed a scheduled, security related maintenance on our admin backend system. During this upgrade, we temporarily moved all admin traffic to our servers hosted in a different region. After the maintenance was completed, all admin traffic was moved back to servers hosted in our primary region. Unfortunately, some admin users that opened the Ordergroove application or tried to use the login-on-behalf of feature during this cut-over period were denied access due to an app misconfiguration. We addressed the configuration issue and admin users were able to login again. We also noticed that delay in DNS propagation caused some users to continue to experience issues beyond our maintenance window but full access should have been restored by 9:55 AM ET Importantly, this issue impacted merchant staff/admin users and no customer impact has been found. Maintenance window: July 6 9:18AM ET - July 6 9:48AM ET Configuration change: July 6 9:53AM ET

Ordergroove Shopify admin application and features unaccessible

Jun <var data-var='date'>22</var>, <var data-var='time'>17:30</var> EDT Resolved - A compatibility issue with our analytics provider was causing dashboards to fail to load. We've applied a fix and verified Analytics is working as expected. Thank you for your patience. Jun <var data-var='date'>22</var>, <var data-var='time'>15:13</var> EDT Update - The incident is still under investigation. Jun <var data-var='date'>22</var>, <var data-var='time'>14:08</var> EDT Investigating - We're investigating reports of the RC3 analytics page experiencing issues while loading metrics. The issue doesn't affect metrics collection. Reporting has not been affected.

Apr <var data-var='date'>16</var>, <var data-var='time'>08:44</var> EDT Resolved - The issue causing delays in our data pipelines has been fully resolved. Analytics data is now processing as expected, and users should see data updating within the normal up to 4 hour latency window. We will continue to monitor the system to ensure stability, but no further impact is expected. Thank you for your patience. Apr <var data-var='date'>15</var>, <var data-var='time'>13:11</var> EDT Identified - We are currently experiencing a delay in our data pipelines. As a result, Analytics data is not updating at the usual 4 hour latency. At this time, the latest available data reflects activity up to 8:50 AM EST on April 15. Our team is actively working to resolve the issue, and we expect data freshness to return to normal within the next few hours. We will provide another update as soon as more information is available.

Analytics Data Delay

Apr <var data-var='date'> 6</var>, <var data-var='time'>23:12</var> EDT Resolved - Webhook delivery delays have been fully resolved, and all queues have been successfully cleared. Event processing has returned to normal levels, and all pending events have been delivered, no data was lost. Thank you for your patience while we worked through this. Apr <var data-var='date'> 6</var>, <var data-var='time'>21:15</var> EDT Investigating - We are currently experiencing delays in webhook event delivery. Our team is actively investigating the issue and working to identify the root cause. No events are expected to be lost, but delivery may be delayed. We will provide an update as soon as we have more information or once mitigation steps are in place. Thank you for your patience.

Webhook Delivery Delays

Mar <var data-var='date'>11</var>, <var data-var='time'>15:00</var> EDT Resolved - The bulk of the delayed subscriptions have been identified and are queued up for delivery. We will provide additional details as they become available. Mar <var data-var='date'>11</var>, <var data-var='time'>10:30</var> EDT Update - We are continuing to work on delayed events and will provide another update once all the events have gone through. Mar <var data-var='date'>11</var>, <var data-var='time'>08:43</var> EDT Identified - We have resumed normal operation of sending real-time subscription events into Ordergroove and are now working on delayed events. Another update will be provided within 1 hour. Mar <var data-var='date'>11</var>, <var data-var='time'>07:25</var> EDT Investigating - We are currently investigating a delay with sending subscription data into Ordergroove for some of our Shopify stores. We will provide another update within the next 1 hour.

Subscription creation delayed

Jan <var data-var='date'>21</var>, <var data-var='time'>15:18</var> EST Resolved - The issue is resolved, and all services are operating normally. We apologize for the inconvenience and will publish a post-mortem within 24 hours which will be available via our CS team. Jan <var data-var='date'>21</var>, <var data-var='time'>14:45</var> EST Monitoring - We have identified a secondary cause of latency and addressed the issue. We are monitoring the system and will post an update shortly. Jan <var data-var='date'>21</var>, <var data-var='time'>14:05</var> EST Investigating - There is an ongoing spike in failed API responses. We are investigating again. Jan <var data-var='date'>21</var>, <var data-var='time'>13:32</var> EST Monitoring - We have identified and mitigated the effects of the latency. We are monitoring the performance of the system. Jan <var data-var='date'>21</var>, <var data-var='time'>13:22</var> EST Investigating - We are currently investigating response latency and will have an update in about 30 minutes.

We are experiencing a performance degradation in the API response times

Dec <var data-var='date'> 5</var>, <var data-var='time'>20:26</var> EST Resolved - We have replayed previously rejected orders. Dec <var data-var='date'> 5</var>, <var data-var='time'>15:14</var> EST Monitoring - On December 5th, 3:45 AM EST Shopify GraphQL APIs experienced an elevated error rate. The issue was resolved by 4:15 AM EST. During the duration of this issue recurring subscription orders failed to place and went into Rejected status. The root cause of this outage within Shopify was due to a CloudFlare issue which impacted a lot of other service providers that rely on this service. The steps for remediation is to safely retry these rejected orders from our side. We are continuing to run this recovery efforts on all impacted orders and will provide another update as soon as all recurring orders have been retried by our system.

Shopify Order Placement

Dec <var data-var='date'> 2</var>, <var data-var='time'>16:27</var> EST Resolved - This incident has been resolved. Dec <var data-var='date'> 2</var>, <var data-var='time'>16:26</var> EST Update - We are continuing to monitor for any further issues. Dec <var data-var='date'> 1</var>, <var data-var='time'>17:31</var> EST Monitoring - We have identified the issue, applied mitigating steps, and are monitoring Dec <var data-var='date'> 1</var>, <var data-var='time'>15:48</var> EST Investigating - We’re currently experiencing a partial outage affecting SFTP report generation. Some scheduled reports are not being generated or delivered as expected. Our team is actively investigating and working to restore functionality as quickly as possible.

Partial Outage: SFTP Report Generation Delays

Nov <var data-var='date'> 5</var>, <var data-var='time'>17:49</var> EST Resolved - The incident has been resolved, and analytics is loading correctly for all accounts now. Nov <var data-var='date'> 5</var>, <var data-var='time'>12:16</var> EST Investigating - We are currently investigation the issue. For some people the Analytics page is not currently loading on the Ordergroove dashboard

Analytics page not loading consistently on Ordergroove Dashboard

Nov <var data-var='date'> 5</var>, <var data-var='time'>01:54</var> EST Resolved - The short-term fix has been rolled out to all affected merchants and product status is actively being updated in our system back to in stock for products where inventory is not tracked within Shopify. Nov <var data-var='date'> 4</var>, <var data-var='time'>18:44</var> EST Monitoring - On November 1st, there was an update to the data being sent over from Shopify which negatively impacted our ability to mark products as in stock in our system. The issue only affects products where inventory is not tracked within Shopify. We have been working since then to implement a short-term solutions and have been rolling it out gradually to all merchants who we found to have been impacted by this change. This short-term fix requires our platform to pull additional product details from Shopify so we have been very gradually rolling it out and measuring system performance. We are going to provide another update as soon as this short-term fix has been rolled out to all stores.

Products showing as out of stock in Ordergroove

Oct <var data-var='date'>29</var>, <var data-var='time'>15:55</var> EDT Resolved - The incident was caused by elevated I/O latency in GCE Persistent Disk within a single region, which impacted our database performance and led to increased application response times. We mitigated the issue by relocating our database instances out of the affected zone. Our team is continuing to work with Google to ensure the underlying issue is fully resolved, but this is no longer impacting Ordergroove services. The incident began at 2:20 PM EST, mitigation was completed by 2:59 PM EST, and full recovery was achieved at 3:18 PM EST. Oct <var data-var='date'>29</var>, <var data-var='time'>15:22</var> EDT Update - We’ve identified and resolved the root cause of the issue. Latency levels are steadily improving, and we’re closely monitoring system performance to ensure continued stability. We’ll provide another update by 4 PM EST. Oct <var data-var='date'>29</var>, <var data-var='time'>14:47</var> EDT Investigating - We're investigating the issue affecting multiple services. We're seeing increased latencies and some requests fail to complete. We'll provide an update by 3:15PM EST.

Intermittent performance degradation

Sep <var data-var='date'>16</var>, <var data-var='time'>23:08</var> EDT Resolved - The remediation has been successfully completed. All missed Order Reminder events for the September 15 run have been replayed, with safeguards in place to prevent any stale actions. The September 16 run has executed successfully as well, and we expect future runs to proceed smoothly starting tomorrow. We will conduct a post mortem to strengthen monitoring for this process going forward. Thank you for your patience as we resolved this issue. Sep <var data-var='date'>16</var>, <var data-var='time'>15:40</var> EDT Monitoring - Order Reminder Events 9/15/2025: Yesterday, on 9/15/2025, Order Reminder events were not sent to Klaviyo or delivered through Ordergroove Webhook system What happened We upgraded our queueing system for the application that produces Order Reminder events. During the upgrade, a subset of consumers did not update correctly and were listening to the wrong system, which caused events to be missed. What we’re doing We are carefully replaying all missed Order Reminder events today. To avoid outdated actions, reminders will only be sent if the related order has not already been attempted. We expect the remediation will be fully completed today Next steps Once remediation is complete, we will run an internal post mortem to strengthen monitoring and ensure full coverage of the process going forward.

Order Reminder Events were missed on 9/15/2025

Aug <var data-var='date'>21</var>, <var data-var='time'>07:00</var> EDT Resolved - Between 7:04 AM - 9:05 AM ET we noticed degraded performance in our async workflow for creating Subscriptions. All subscriptions were created successfully. We have identified the root cause and are working on solutions to prevent this from happening again.

Degraded Subscription Creation Performance

Aug <var data-var='date'> 4</var>, <var data-var='time'>02:41</var> EDT Resolved - Our APIs were experiencing slow response time between 1:50am EST to 2:28am EST

API response time degradation

Jun <var data-var='date'>12</var>, <var data-var='time'>17:07</var> EDT Resolved - Google Cloud Platform has confirmed that the incident is now resolved and we're starting to see recovery across all affected systems. GCP incident: https://status.cloud.google.com/incidents/ow5i3PPK96RduMcb1SsW Jun <var data-var='date'>12</var>, <var data-var='time'>15:18</var> EDT Update - Although we do not have an exact ETA on recovery, it appears that Google Cloud Platform is starting to recover. Jun <var data-var='date'>12</var>, <var data-var='time'>15:10</var> EDT Update - Although we do not have an exact ETA on recovery, it appears that Google Cloud Platform is starting to recover. Jun <var data-var='date'>12</var>, <var data-var='time'>14:21</var> EDT Investigating - We are experiencing some connectivity issues related to our cloud hosting provider. We are investigating this incident and will provide further updates as soon as they become available. This issue is impacting some internal systems that are responsible for migrating data into Ordergroove and delivering events. This issue also has implications on our Shopify integration. More details regarding this outage can be found here: https://status.cloud.google.com/incidents/ow5i3PPK96RduMcb1SsW

The google cloud platform is experiencing issues

Apr <var data-var='date'>20</var>, <var data-var='time'>05:30</var> EDT Completed - The scheduled maintenance has been completed. Apr <var data-var='date'>20</var>, <var data-var='time'>04:30</var> EDT In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary. Apr <var data-var='date'> 8</var>, <var data-var='time'>14:03</var> EDT Scheduled - Scheduled maintenance will occur on April 20th between 4:30 AM and 5:30 AM EST to enhance platform scalability and security. We do not expect downtime, and no user action is required. Please note: a short period of approximately 10–15 seconds may occur during which some write operations to the api, restapi, data, and sc API endpoints might experience higher than normal error rates. For merchants using the sync subscription creation method, a small fraction of requests may return a 400 error code, but these are expected to retry automatically without intervention.

Platform maintenance - April 20 2025

Mar <var data-var='date'>24</var>, <var data-var='time'>07:00</var> EDT Completed - The scheduled maintenance has been completed. Mar <var data-var='date'>24</var>, <var data-var='time'>06:00</var> EDT In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary. Feb <var data-var='date'> 4</var>, <var data-var='time'>13:42</var> EST Scheduled - Please note that the TLS ciphers TLS_RSA_WITH_AES_128_GCM_SHA256 and TLS_RSA_WITH_AES_256_GCM_SHA384 will be decommissioned in 45 days as part of our ongoing efforts to enhance the security and stability of our platform. These ciphers are being phased out to align with modern cryptographic best practices and ensure stronger protection for data in transit. The ciphers will be removed from the following domains: - rc3.ordergroove.com - sc.ordergroove.com - api.ordergroove.com - restapi.ordergroove.com - om.ordergroove.com - offers.ordergroove.com We recommend updating your configurations to use more secure cipher suites to avoid any service disruptions. The above ciphers will be disabled on March 24, 2025. Please make all necessary changes prior to that date. If you have any questions or require assistance, please reach out to our support team.

Is Ordergroove down?

Ordergroove status is UP

Lastest published events

Slightly elevated error rate for Shopify recurring order placement

Order Placement was slow

Analytics page not loading on Ordergroove Dashboard

Ordergroove Services, Components and Regions

Recent Ordergroove events

Slightly elevated error rate for Shopify recurring order placement

Order Placement was slow

Analytics page not loading on Ordergroove Dashboard

Hosting provider network degradation

Analytics page not loading on Ordergroove Dashboard

Admin Dashboard (rc3.ordergroove.com) scheduled maintenance - no impact expected