THIS IS A SCHEDULED EVENT Aug <var data-var='date'>23</var>, <var data-var='time'>21:00</var> CDT &nbsp;-&nbsp; Aug <var data-var='date'>24</var>, <var data-var='time'>01:00</var> CDT Aug <var data-var='date'>19</var>, <var data-var='time'>09:57</var> CDT Scheduled - ChargeOver will undergo scheduled maintenance at this time. Some ChargeOver accounts may be unavailable for a short amount of time.

Scheduled maintenance

THIS IS A SCHEDULED EVENT Aug <var data-var='date'>22</var>, <var data-var='time'>21:00</var> CDT &nbsp;-&nbsp; Aug <var data-var='date'>23</var>, <var data-var='time'>01:00</var> CDT Aug <var data-var='date'>19</var>, <var data-var='time'>09:55</var> CDT Scheduled - ChargeOver will undergo scheduled maintenance at this time. Some ChargeOver accounts may be unavailable for a short amount of time.

Aug <var data-var='date'>21</var>, <var data-var='time'>21:00</var> CDT In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary. Aug <var data-var='date'>19</var>, <var data-var='time'>09:54</var> CDT Scheduled - ChargeOver will undergo scheduled maintenance at this time. Some ChargeOver accounts may be unavailable for a short amount of time.

Aug <var data-var='date'> 9</var>, <var data-var='time'>00:00</var> CDT Completed - The scheduled maintenance has been completed. Aug <var data-var='date'> 8</var>, <var data-var='time'>20:00</var> CDT In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary. Aug <var data-var='date'> 6</var>, <var data-var='time'>10:27</var> CDT Scheduled - We will be undergoing scheduled maintenance at this time. A small percentage of accounts may be inaccessible for short (a few minutes) amounts of time. We are performing database upgrades to improve redundancy/fail-over (related to incident https://status.chargeover.com/incidents/lmnjlsgdvbgc )

Scheduled maintenance window

Aug <var data-var='date'> 8</var>, <var data-var='time'>00:00</var> CDT Completed - The scheduled maintenance has been completed. Aug <var data-var='date'> 7</var>, <var data-var='time'>20:00</var> CDT In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary. Aug <var data-var='date'> 6</var>, <var data-var='time'>10:28</var> CDT Scheduled - We will be undergoing scheduled maintenance at this time. A small percentage of accounts may be inaccessible for short (a few minutes) amounts of time. We are performing database upgrades to improve redundancy/fail-over (related to incident https://status.chargeover.com/incidents/lmnjlsgdvbgc )

Aug <var data-var='date'> 1</var>, <var data-var='time'>09:58</var> CDT Resolved - This incident has been resolved, and all services are functioning normally now. A postmortem will follow. Aug <var data-var='date'> 1</var>, <var data-var='time'>05:44</var> CDT Update - We are continuing to monitor for any further issues. Automated processes (creating invoices; running payments; syncing to QuickBooks/Xero/Salesforce) continue to catch up. Aug <var data-var='date'> 1</var>, <var data-var='time'>04:46</var> CDT Update - We are continuing to monitor for any further issues. Aug <var data-var='date'> 1</var>, <var data-var='time'>04:45</var> CDT Monitoring - ChargeOver service has been restored. Automated invoice generation, and automated payment processing is delayed, but will catch up rapidly and will not require any manual action by merchants. Sync of data to other platforms (QuickBooks, Xero, Salesforce) will be delayed, but will catch up rapidly, and will not require any manual re-sync. More updates and a postmortem will be posted later. Aug <var data-var='date'> 1</var>, <var data-var='time'>01:24</var> CDT Identified - ChargeOver is currently inaccessible. We are working on a resolution ASAP.

ChargeOver is inaccessible

May <var data-var='date'>16</var>, <var data-var='time'>21:00</var> CDT Completed - The scheduled maintenance has been completed. May <var data-var='date'>16</var>, <var data-var='time'>17:00</var> CDT In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary. May <var data-var='date'>13</var>, <var data-var='time'>05:52</var> CDT Scheduled - We will be undergoing scheduled network maintenance at this time. Some very short (less than 3 minutes) network degradation periods may occur while front-end load balancers are upgraded.

Apr <var data-var='date'>14</var>, <var data-var='time'>07:45</var> CDT Resolved - Connectivity issues have been resolved. Some payments may need to be re-attempted. Some syncs to external platforms (QuickBooks, Xero, Salesforce, etc.) may need re-sync. Apr <var data-var='date'>14</var>, <var data-var='time'>05:50</var> CDT Monitoring - We are continuing to monitor connectivity, and await an update from our primary data center (Flexential). ChargeOver is operating normally at this time. Some payments may need to be re-attempted. Some syncs to external platforms (QuickBooks, Xero, Salesforce, etc.) may be delayed or need re-sync. Apr <var data-var='date'>14</var>, <var data-var='time'>03:59</var> CDT Update - ChargeOver is accessible again. Flexential has restored network connectivity to our data center and we are actively monitoring performance and stability. We have not yet received an official all-clear from Flexential. We will post a final update once we have confirmed full resolution. Apr <var data-var='date'>14</var>, <var data-var='time'>03:00</var> CDT Update - No change in status. This continues to be a network connectivity issue upstream of our infrastructure. Next update in 60 minutes or sooner if status changes. Apr <var data-var='date'>14</var>, <var data-var='time'>01:48</var> CDT Update - Progress has been made in identifying the cause. Flexential's carrier vendor has isolated a faulty optical component on the affected circuit and a technician is en route to replace it. No restoration ETA has been provided yet. This continues to be a network connectivity issue upstream of our infrastructure. Next update in 60 minutes or sooner if status changes. Apr <var data-var='date'>14</var>, <var data-var='time'>00:58</var> CDT Update - No change in status. Flexential has confirmed that carrier circuits at their Chaska, MN facility remain down. Their network engineers are engaged with the carrier vendor, who is actively investigating. No restoration ETA has been provided. Our systems remain online and operational. This continues to be a network connectivity issue upstream of our infrastructure. Next update in 60 minutes or sooner if status changes. Apr <var data-var='date'>13</var>, <var data-var='time'>23:46</var> CDT Investigating - ChargeOver is currently unreachable. Our upstream network provider is experiencing an outage affecting connectivity to our data center. Our systems are online and operational; this is a network issue outside of our infrastructure. Our provider is aware of the issue and is actively working toward a resolution. We do not have an ETA at this time. We will post an update every 60 minutes until this is resolved.

Network provider outage

Apr <var data-var='date'> 4</var>, <var data-var='time'>23:00</var> CDT Completed - The scheduled maintenance has been completed. Apr <var data-var='date'> 4</var>, <var data-var='time'>20:00</var> CDT In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary. Apr <var data-var='date'> 2</var>, <var data-var='time'>11:06</var> CDT Scheduled - ChargeOver will undergo short maintenance window: * Re-balancing background processing queues (performance improvements for Salesforce, QuickBooks, and Xero syncing) * Frontend routing maintenance (improve performance/enhance malicious bot protection) Performance may be degraded during the maintenance window.

Scheduled maintenance (rebalancing background processing queues; frontend routing maintenance)

Mar <var data-var='date'>26</var>, <var data-var='time'>12:18</var> CDT Resolved - This has been resolved. We are investigating what occurred here still. A postmortem will follow. Mar <var data-var='date'>26</var>, <var data-var='time'>11:57</var> CDT Investigating - We are investigating the issue. We are expecting to have this resolved within the next 30 minutes.

ChargeOver unavailable for some users

Mar <var data-var='date'> 8</var>, <var data-var='time'>00:00</var> CST Completed - The scheduled maintenance has been completed. Mar <var data-var='date'> 7</var>, <var data-var='time'>19:00</var> CST In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary. Mar <var data-var='date'> 5</var>, <var data-var='time'>16:40</var> CST Scheduled - ChargeOver will be undergoing scheduled maintenance to upgrade caching and background-processing infrastructure. Performance may be degraded, and some background jobs (webhooks, syncing to integrations like QuickBooks, Xero, etc.) may be delayed during the maintenance window. We are not expecting any impact to payment processing.

ChargeOver scheduled maintenance

Jan <var data-var='date'>29</var>, <var data-var='time'>22:00</var> CST Completed - The scheduled maintenance has been completed. Jan <var data-var='date'>29</var>, <var data-var='time'>21:00</var> CST In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary. Jan <var data-var='date'>29</var>, <var data-var='time'>07:19</var> CST Scheduled - ChargeOver will undergo scheduled maintenance. ChargeOver may be unavailable, or performance may be degraded, for several short amounts of time (less than 5 minutes each).

ChargeOver scheduled network maintenance

Dec <var data-var='date'>26</var>, <var data-var='time'>17:29</var> CST Resolved - This incident has been resolved. Dec <var data-var='date'>26</var>, <var data-var='time'>17:07</var> CST Monitoring - A fix has been implemented and we are monitoring the results. Dec <var data-var='date'>26</var>, <var data-var='time'>17:01</var> CST Update - We are continuing to investigate this issue. Dec <var data-var='date'>26</var>, <var data-var='time'>16:57</var> CST Investigating - We are currently investigating this issue.

Problem accessing our help documentation

Nov <var data-var='date'>30</var>, <var data-var='time'>00:00</var> CST Completed - The scheduled maintenance has been completed. Nov <var data-var='date'>29</var>, <var data-var='time'>18:00</var> CST In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary. Nov <var data-var='date'>27</var>, <var data-var='time'>07:38</var> CST Scheduled - ChargeOver will perform scheduled network maintenance at this time. A short amount of downtime (less than 15 minutes) is expected.

Scheduled network maintenance

Nov <var data-var='date'>29</var>, <var data-var='time'>00:00</var> CST Completed - The scheduled maintenance has been completed. Nov <var data-var='date'>28</var>, <var data-var='time'>18:00</var> CST In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary. Nov <var data-var='date'>27</var>, <var data-var='time'>07:37</var> CST Scheduled - ChargeOver will perform scheduled network maintenance at this time. A short amount of downtime (less than 15 minutes) is expected.

Nov <var data-var='date'>11</var>, <var data-var='time'>14:12</var> CST Resolved - This incident has been resolved. A postmortem will follow. Nov <var data-var='date'>11</var>, <var data-var='time'>13:35</var> CST Update - We are continuing to monitor for any further issues. Nov <var data-var='date'>11</var>, <var data-var='time'>13:35</var> CST Monitoring - This issue should be resolved now. We are monitoring this for any further action. A postmortem will follow. Nov <var data-var='date'>11</var>, <var data-var='time'>13:10</var> CST Identified - We have identified the problem, and are expecting a resolution within the next 30 minutes. We will provide an update here again shortly. Nov <var data-var='date'>11</var>, <var data-var='time'>12:21</var> CST Investigating - We are currently investigating this issue. Some emails are not sending, instead triggering a "Invalid handle provided" message. Payment processing and integrations are unaffected.

Emails failing to send with a "Invalid handle provided" error message

Oct <var data-var='date'>30</var>, <var data-var='time'>14:34</var> CDT Resolved - Syncing for all affected integrations is complete now. A postmortem will follow. Oct <var data-var='date'>30</var>, <var data-var='time'>09:17</var> CDT Monitoring - Syncing has completely caught up for all but approximately 10% of ChargeOver accounts. The remaining ChargeOver accounts continue to catch up quickly, but are still delayed. We are continuing to monitor the situation, and a postmortem will follow. Oct <var data-var='date'>30</var>, <var data-var='time'>08:41</var> CDT Identified - We have identified a component failure which is delaying the sync of data to some systems for approximately 30% of ChargeOver accounts. The affected integrations are: * QuickBooks Online * Xero * Salesforce Syncing will catch up automatically, but may be delayed. We are still investigating root cause and will follow up with a postmortem.

Delayed sync of data to QuickBooks Online, Xero, and Salesforce for approximately 30% of accounts

Oct <var data-var='date'>28</var>, <var data-var='time'>10:04</var> CDT Resolved - ChargeOver was inaccessible for most users from approximately 9:44am CT to 9:58am CT, due to a database connection issue. No data loss occurred. Scheduled subscription invoice creation and payment processing were not affected - all scheduled payments processed normally. We are still investigating root cause. A postmortem will follow. Oct <var data-var='date'>28</var>, <var data-var='time'>09:55</var> CDT Monitoring - ChargeOver is accessible again. We are investigating root cause and investigating the outage. Oct <var data-var='date'>28</var>, <var data-var='time'>09:51</var> CDT Investigating - ChargeOver is down for some users. We are investigating.

ChargeOver outage

Jul <var data-var='date'>18</var>, <var data-var='time'>15:14</var> CDT Resolved - ChargeOver had longer than expected wait times from 14:11 CDT to 15:07 CDT. We're monitoring the solution to the root cause. A postmortem will follow. Jul <var data-var='date'>18</var>, <var data-var='time'>15:07</var> CDT Monitoring - Our third party analytics service was not being responsive and we've implemented a fix to bypass this issue. Logins should resume as expected. We're monitoring and will update with information as it becomes available. Jul <var data-var='date'>18</var>, <var data-var='time'>14:44</var> CDT Identified - We believe we have identified an issue with third party analytics service causing the login process to take longer than expected to give users access to their instance. Jul <var data-var='date'>18</var>, <var data-var='time'>14:11</var> CDT Investigating - We are currently investigating this issue.

Login outage

Jul <var data-var='date'> 5</var>, <var data-var='time'>03:30</var> CDT Resolved - ChargeOver was inaccessible from approx 3:27 CDT, to 4:57 CDT. This was a networking-system related outage. We are still investigating root cause. A postmortem will follow.

ChargeOver inaccessible / network outage

Jun <var data-var='date'>17</var>, <var data-var='time'>00:00</var> CDT Completed - The scheduled maintenance has been completed. Jun <var data-var='date'>16</var>, <var data-var='time'>21:00</var> CDT In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary. Jun <var data-var='date'>16</var>, <var data-var='time'>09:49</var> CDT Scheduled - ChargeOver will undergo scheduled network maintenance on 6/16 from 9am to midnight central time. We anticipate minimal, if any, downtime.

Jun <var data-var='date'> 8</var>, <var data-var='time'>18:23</var> CDT Resolved - This incident has been resolved. A postmortem will follow. Jun <var data-var='date'> 8</var>, <var data-var='time'>13:54</var> CDT Identified - We are working with our primary data center to resolve the issue. At this time, we believe this to be a carrier networking issue at the data center itself, outside of ChargeOver's infrastructure.

ChargeOver inaccessible

Jun <var data-var='date'> 7</var>, <var data-var='time'>17:21</var> CDT Resolved - This incident has been resolved. A postmortem will follow. Jun <var data-var='date'> 7</var>, <var data-var='time'>17:11</var> CDT Update - We are continuing to monitor for any further issues. Jun <var data-var='date'> 7</var>, <var data-var='time'>17:11</var> CDT Monitoring - A networking fix has been applied, and services are coming back up. We are monitoring to ensure everything is accessible. Jun <var data-var='date'> 7</var>, <var data-var='time'>16:42</var> CDT Identified - We have identified a networking issue, and are working on a resolution. Jun <var data-var='date'> 7</var>, <var data-var='time'>16:00</var> CDT Investigating - We are currently investigating this issue.

System inaccessible

Mar <var data-var='date'>10</var>, <var data-var='time'>19:00</var> CDT Resolved - We have identified an issue where some emails sent the evening of March 10 / the morning of March 11 appear to be stuck in a SENDING state, instead of being delivered. We have identified and resolved an issue where an internal network attached storage device became disconnected, causing some emails to get stuck in a SENDING... state, instead of actually being delivered. We are still investigating root cause further.

Some emails are stuck in a SENDING... state

Jan <var data-var='date'> 8</var>, <var data-var='time'>18:27</var> CST Resolved - This issue has been resolved. All data syncs to Xero, QuickBooks Online, and Salesforce have caught up and fully synced. Jan <var data-var='date'> 8</var>, <var data-var='time'>14:24</var> CST Update - Data syncs to QuickBooks Online, Xero, and Salesforce are catching up quickly, and are almost fully caught up. Data will still be synced to QuickBooks Online, Xero, and Salesforce automatically, but the sync to those systems may be delayed by a few more hours. Manual syncing of data will not be required. We anticipate syncing being fully caught up within the next ~8 hours. Jan <var data-var='date'> 8</var>, <var data-var='time'>09:24</var> CST Monitoring - Data syncs to QuickBooks Online, Xero, and Salesforce are catching up quickly, but there is a significant number of items to sync before everything has fully caught up. Data will still be synced to QuickBooks Online, Xero, and Salesforce automatically, but the sync to those systems may be delayed by several hours. Manual syncing of data will not be required. We are continuing to monitor the situation. Jan <var data-var='date'> 8</var>, <var data-var='time'>06:52</var> CST Identified - We have identified an issue causing delayed syncs of data to QuickBooks Online, Xero, and Salesforce for a small subset of accounts. Data will still be synced to QuickBooks Online, Xero, and Salesforce automatically, but the sync to those systems may be delayed by several hours. Manual syncing of data will not be required. We are working on a resolution.

Is ChargeOver down?

ChargeOver status is UNDER MAINTENANCE

Components with issues

Lastest published events

Scheduled maintenance

Scheduled maintenance window

Scheduled maintenance window

ChargeOver Services, Components and Regions

Recent ChargeOver events

Scheduled maintenance

Scheduled maintenance

Scheduled maintenance

Scheduled maintenance window

Scheduled maintenance window

ChargeOver is inaccessible