Apr <var data-var='date'> 5</var>, <var data-var='time'>17:00</var> PDT Resolved - This incident has been resolved.Apr <var data-var='date'> 5</var>, <var data-var='time'>13:30</var> PDT Monitoring - A fix has been implemented and we are monitoring the results.Apr <var data-var='date'> 5</var>, <var data-var='time'>12:32</var> PDT Identified - The issue has been identified and a fix is being implemented.Apr <var data-var='date'> 5</var>, <var data-var='time'>12:11</var> PDT Investigating - We are currently investigating this issue.

Amperity is experiencing an outage to all services on our Azure platform

Mar <var data-var='date'>30</var>, <var data-var='time'>19:50</var> PDT Resolved - We have successfully restarted all failed workflows and the incident has been resolved.Mar <var data-var='date'>30</var>, <var data-var='time'>16:29</var> PDT Update - Databricks has confirmed that their incident is resolved. Amperity is unpausing all Predictive tasks and will be restarting the workflows that failed due to this issue.Mar <var data-var='date'>30</var>, <var data-var='time'>15:34</var> PDT Monitoring - Amperity is tracking a Databricks outage that might cause Predictive workflows to fail. We are monitoring the status of resolution on the Databricks side. In the meantime, we are pausing all Predictive tasks and will re-enable them once the Databricks incident is resolved. During this time, the workflows will remain in the Running state, even if all the other tasks succeed. The Databricks incident status can be tracked here: https://status.databricks.com/ If the Databricks incident is resolved within 24 hours, most customers should not see any observable impact to their operations that rely on Predictive inference.

Amperity is experiencing failing Predictive workflows due to a Databricks outage

Mar <var data-var='date'>12</var>, <var data-var='time'>17:45</var> PDT Resolved - The AmpAI service has been fully restored, and the incident is now resolved.Mar <var data-var='date'>12</var>, <var data-var='time'>17:29</var> PDT Identified - We have identified the cause of the AmpAI issue and have implemented a partial fix. Our team is continuing work to fully resolve the problem and expects to have it resolved shortly. We will provide further updates as they become available.Mar <var data-var='date'>12</var>, <var data-var='time'>16:36</var> PDT Investigating - Amperity AmpAI is currently experiencing an outage. This may impact AI functionality in Queries, Segments, Journeys, and other areas of the platform that rely on AmpAI. The issue has been identified, and our Platform Engineering team is actively deploying a fix. We will provide further updates as they become available.

Amperity AmpAI Outage

Mar <var data-var='date'>12</var>, <var data-var='time'>12:59</var> PDT Resolved - The code change that caused the issue has been reverted and Segments are loading across all tenants now. The incident is now resolved.Mar <var data-var='date'>12</var>, <var data-var='time'>12:47</var> PDT Identified - We're experiencing a partial outage that is impacting the loading of Segments. We're working on the issue and expect to resolve it shortly.

Amperity is experiencing a partial outage impacting the loading of Segments

Feb <var data-var='date'> 2</var>, <var data-var='time'>12:27</var> PST Resolved - All the failed tasks have been restarted and every failed workflow has either succeeded or is running past the point of previous failure. The incident is considered resolved.Feb <var data-var='date'> 2</var>, <var data-var='time'>12:07</var> PST Monitoring - A fix has been applied and we are now seeing retries succeed. The Amperity Engineering team is retrying the failed queries now.Feb <var data-var='date'> 2</var>, <var data-var='time'>10:52</var> PST Investigating - Amperity is tracking an issue with Queries in the AWS North America tenants. We're working on the problem.

Amperity is experiencing performance issues with Queries

Jan <var data-var='date'>26</var>, <var data-var='time'>08:09</var> PST Resolved - This morning at 7:00am PST, the Amperity UI stopped loading on all tenants in all stacks, except for AWS US. The issue was quickly identified and resolved by 7:40am PST. The impact was limited to the UI only, so users would not have been able to access the platform, however all backend processes were operational. Amperity is performing an after action review to identify the root cause and preventative measures.

Amperity experienced an outage

Sep <var data-var='date'>10</var>, <var data-var='time'>13:31</var> PDT Resolved - Azure has resolved their incident and Amperity has failed over back to the fixed cluster and this incident is now resolved.Sep <var data-var='date'>10</var>, <var data-var='time'>10:11</var> PDT Monitoring - We have successfully failed over to a working region and we are restarting all jobs, but queries may be slow as we work with Azure to resolve.Sep <var data-var='date'>10</var>, <var data-var='time'>08:44</var> PDT Identified - We have confirmed that this is an incident at Azure and we are in the process of failing over to a working regionSep <var data-var='date'>10</var>, <var data-var='time'>08:00</var> PDT Investigating - We are currently investigating and also implementing a failover to a working region

Amperity is experiencing an incident with Azure

Sep <var data-var='date'> 6</var>, <var data-var='time'>10:47</var> PDT Resolved - All failed workflows have been retried, Campaigns and Orchestrations to Meta are now succeeding, and the incident is now closed.Sep <var data-var='date'> 6</var>, <var data-var='time'>08:58</var> PDT Update - Our monitoring shows that the Meta Replace User endpoint is now responding without errors and the workflows are succeeding. We are retrying the workflows that failed yesterday, but were not scheduled to run again today. We will update this notification once all failed workflows are retried.Sep <var data-var='date'> 5</var>, <var data-var='time'>19:54</var> PDT Update - Our monitoring shows that workflows are still failing. We are continuing to monitor the situation.Sep <var data-var='date'> 5</var>, <var data-var='time'>11:57</var> PDT Update - We are seeing some workflows succeeding, but we do not see a 100% recovery yet. We are continuing to monitor the situation.Sep <var data-var='date'> 5</var>, <var data-var='time'>08:38</var> PDT Monitoring - We are experiencing a partial outage at Meta that is causing some of our API calls to the Replace User endpoint to fail with 500s. We are monitoring Meta and will keep you apprised of any changes. Our tasks will retry until the requests are successful or retries are exhausted. Tasks can be manually restarted as well.

Amperity is experiencing a partial outage with Campaigns and Orchestrations sending to Meta's Replace User endpoint

Jun <var data-var='date'>13</var>, <var data-var='time'>13:31</var> PDT Resolved - AWS has confirmed that the issue is resolved. Amperity monitored and restarted all the failed workflows and has confirmed that this incident is resolved.Jun <var data-var='date'>13</var>, <var data-var='time'>10:42</var> PDT Monitoring - The issue is due to performance issues in the underlying AWS platform. AWS has identified the problem and are on the path to recovery. Amperity is continuing to monitor the AWS resolution actions.Jun <var data-var='date'>13</var>, <var data-var='time'>09:57</var> PDT Investigating - The query service of the Amperity platform in AWS are experiencing performance issues. We're working on the problem and expect it to be resolved shortly.

Amperity is experiencing performance issues in AWS with the query service

Jun <var data-var='date'>12</var>, <var data-var='time'>18:34</var> PDT Resolved - Amperity has confirmed that the incident is resolved.Jun <var data-var='date'>12</var>, <var data-var='time'>15:02</var> PDT Monitoring - We have implemented a fix and monitoring the results.Jun <var data-var='date'>12</var>, <var data-var='time'>14:47</var> PDT Investigating - Many parts of the Amperity platform are currently experiencing an outage. We’re working to fix the problem as quickly as we can. We’ll share another update shortly.

Amperity is experiencing an outage

Jun <var data-var='date'> 6</var>, <var data-var='time'>11:06</var> PDT Resolved - Between 4:30 PM PT on June 5th and 10:30 AM PT on June 6th, the Amperity AI assistant was unavailable. This issue has now been resolved. We’re taking steps to improve our monitoring and recovery processes to prevent future disruptions. Thank you for your patience, and please don’t hesitate to contact our Support team if you have any questions.

Amperity AI Assistant Outage - Resolved

May <var data-var='date'>19</var>, <var data-var='time'>13:00</var> PDT Completed - The scheduled maintenance has been completed.May <var data-var='date'>19</var>, <var data-var='time'>11:00</var> PDT In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.May <var data-var='date'>14</var>, <var data-var='time'>16:52</var> PDT Scheduled - Azure has informed Amperity that they will be performing scheduled maintenance on the PostgreSQL servers in the Azure North America region on Monday, May 19th at 11am PT. Amperity will utilize this same maintenance window to upgrade the PostgreSQL server version. This is an in-place upgrade, so there will be some downtime ranging from 15-30 minutes during the maintenance window. The maintenance window will end at 1pm PT. During the maintenance window, some orchestrations may fail and customers may have to monitor and retry the tasks that may fail.

Azure and Amperity planned maintenance - postgresql

May <var data-var='date'> 6</var>, <var data-var='time'>19:00</var> PDT Completed - The scheduled maintenance has been completed.May <var data-var='date'> 6</var>, <var data-var='time'>10:00</var> PDT In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.Apr <var data-var='date'>29</var>, <var data-var='time'>15:23</var> PDT Scheduled - Amperity will be performing a planned maintenance on Tuesday, May 6th, to upgrade the PostgreSQL databases. This is an in-place upgrade, so there will be some downtime ranging from 15-30 minutes during the maintenance window. The maintenance windows for each region will be as follows: * European region: 10 AM - 12 PM Pacific Time / 5 PM - 7 PM GMT * North American region: 5 PM - 7 PM Pacific Time During the maintenance window, some workflows or orchestrations may fail and customers may have to monitor and retry the tasks that may fail.

Amperity planned maintenance - postgresql upgrade

Apr <var data-var='date'>21</var>, <var data-var='time'>12:00</var> PDT Completed - The scheduled maintenance has been completed.Apr <var data-var='date'>21</var>, <var data-var='time'>11:00</var> PDT In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.Apr <var data-var='date'>16</var>, <var data-var='time'>16:42</var> PDT Scheduled - Microsoft Azure has notified us that they will be performing a maintenance on the PostgreSQL databases in Azure East US 2 region. Tenants on other Azure regions, or on AWS will not be a part of this maintenance. During this maintenance there might be a brief drop in connectivity to the database, and some workflows or orchestrations may fail. Customers would have to monitor and retry the tasks that may fail.

Azure planned maintenance - Azure East US 2 region

Apr <var data-var='date'> 3</var>, <var data-var='time'>10:10</var> PDT Resolved - All failed workflows have been retried and the incident is now closed.Apr <var data-var='date'> 3</var>, <var data-var='time'>10:10</var> PDT Update - We are continuing to monitor for any further issues.Apr <var data-var='date'> 3</var>, <var data-var='time'>08:28</var> PDT Monitoring - Amperity has identified an issue with tik-tok campaign executions in AWS. The issue was identified as having started 20 hours ago, and the cause has been fixed. We are monitoring and restarting any failed workflows. No action is required from our customers at this time.

Amperity is tracking an issue with tik-tok campaign executions in AWS

Mar <var data-var='date'>24</var>, <var data-var='time'>12:00</var> PDT Completed - The scheduled maintenance has been completed.Mar <var data-var='date'>24</var>, <var data-var='time'>11:00</var> PDT In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.Mar <var data-var='date'>20</var>, <var data-var='time'>10:13</var> PDT Scheduled - Microsoft Azure has notified us that they will be performing a maintenance on the PostgreSQL databases in Azure North Europe 1 region. Tenants on other Azure regions, or on AWS will not be a part of this maintenance. During this maintenance there might be a brief drop in connectivity to the database, and some workflows or orchestrations may fail. Customers would have to monitor and retry the tasks that may fail.

Azure planned maintenance - Azure North Europe region

Mar <var data-var='date'>20</var>, <var data-var='time'>19:00</var> PDT Completed - The scheduled maintenance has been completed.Mar <var data-var='date'>20</var>, <var data-var='time'>14:00</var> PDT In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.Mar <var data-var='date'>18</var>, <var data-var='time'>13:27</var> PDT Scheduled - Amperity will be performing a planned maintenance to apply some configuration changes to our PostgreSQL database instances in each production stack. This might result in a short downtime while the database instances are being restarted after the changes. The following are the windows for each stack: Azure North Europe: 2pm PT - 3pm PT AWS Canada Central-1: 3pm PT - 4pm PT AWS US West-2 and Azure US East-2: 6pm PT - 7pm PT During the maintenance window, some workflows or orchestrations may fail and customers may have to monitor and retry the tasks that may fail.

Amperity planned maintenance

Mar <var data-var='date'>18</var>, <var data-var='time'>13:00</var> PDT Completed - The scheduled maintenance has been completed.Mar <var data-var='date'>18</var>, <var data-var='time'>12:00</var> PDT In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.Mar <var data-var='date'>13</var>, <var data-var='time'>16:25</var> PDT Scheduled - Amperity will be performing scheduled maintenance to our AWS SFTP servers on Tuesday, March 18th, starting at 12PM Pacific Time. The maintenance should last no more than one hour, during which time we anticipate a brief outage where SFTP connections will fail, with potential impacts on courier or orchestration tasks. Customers may need to monitor and manually restart certain tasks during this time, for example if files are sent to an SFTP server during the outage the task will fail and have to be retried after the service is available. This maintenance will not affect Azure tenants.

Planned Maintenance

Mar <var data-var='date'> 6</var>, <var data-var='time'>13:30</var> PST Completed - The scheduled maintenance has been completed.Mar <var data-var='date'> 6</var>, <var data-var='time'>12:58</var> PST Update - The scheduled maintenance is in progress, and we require and additional 30 minutes to wrap up the maintenance activities. Please note that the maintenance will run through 1:30pm PST.Mar <var data-var='date'> 6</var>, <var data-var='time'>12:00</var> PST In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.Mar <var data-var='date'> 4</var>, <var data-var='time'>15:27</var> PST Scheduled - Amperity will be performing scheduled maintenance to our Azure SFTP servers on Thursday, March 6th, starting at 12 PM Pacific Time. The maintenance should last no more than one hour, during which time we anticipate a brief outage where SFTP connections will fail, with potential impacts on courier or orchestration tasks. Customers may need to monitor and manually restart certain tasks during this time, for example if files are sent to an SFTP server during the outage the task will fail and have to be retried after the service is available. This maintenance will not affect AWS tenants.

Feb <var data-var='date'>26</var>, <var data-var='time'>17:00</var> PST Completed - The scheduled maintenance has been completed.Feb <var data-var='date'>26</var>, <var data-var='time'>16:00</var> PST In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.Feb <var data-var='date'>26</var>, <var data-var='time'>11:30</var> PST Scheduled - Amperity will be performing emergency infrastructure maintenance on Wednesday Feb 26th, between 4pm and 5pm PST to address pending activities that could not be completed during yesterday's maintenance to address some CVEs. This maintenance is expected to require zero downtime and during the maintenance, our engineering teams will be monitoring and restarting any workflows that might fail.

Amperity emergency maintenance

Feb <var data-var='date'>25</var>, <var data-var='time'>17:00</var> PST Completed - The scheduled maintenance has been completed.Feb <var data-var='date'>25</var>, <var data-var='time'>16:00</var> PST In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.Feb <var data-var='date'>24</var>, <var data-var='time'>10:38</var> PST Update - Please note that the maintenance has been rescheduled to start at 4pm PST. Our review has found that there are fewer workflows starting at 4pm compared to at 5pm PST. This would minimize the impact of an outage during the maintenance window.Feb <var data-var='date'>21</var>, <var data-var='time'>13:38</var> PST Scheduled - Amperity will be performing infrastructure maintenance on Tuesday Feb 25th, between 5pm and 6pm PST to address some CVEs. This maintenance is expected to require zero downtime, however if there are issues with the update, there may be a 5-10 minute outage. During the maintenance, our engineering teams will be monitoring and restarting any workflows that might fail.

Feb <var data-var='date'>12</var>, <var data-var='time'>10:32</var> PST Resolved - This incident has been resolved.Feb <var data-var='date'>12</var>, <var data-var='time'>09:34</var> PST Monitoring - A fix has been implemented and we are monitoring the results.Feb <var data-var='date'>12</var>, <var data-var='time'>09:27</var> PST Identified - The issue has been identified and a fix is being implemented.Feb <var data-var='date'>12</var>, <var data-var='time'>09:23</var> PST Investigating - Some parts of the Amperity platform are experiencing performance issues. We're working on the problem and expect it to be resolved shortly.

Amperity is experiencing performance issues

Feb <var data-var='date'>11</var>, <var data-var='time'>13:58</var> PST Resolved - This incident has been resolved. If you have any questions, please submit a ticket to Support and we will follow up. Thank you for your patience.Feb <var data-var='date'>11</var>, <var data-var='time'>13:31</var> PST Monitoring - A fix has been implemented and we are monitoring the results.Feb <var data-var='date'>11</var>, <var data-var='time'>13:24</var> PST Identified - The issue has been identified and a fix is being implemented.Feb <var data-var='date'>11</var>, <var data-var='time'>13:17</var> PST Investigating - Most parts of the Amperity platform are experiencing an outage. We’re working to fix the problem as quickly as we can. We’ll share another update shortly.

Jan <var data-var='date'>23</var>, <var data-var='time'>18:00</var> PST Completed - The scheduled maintenance has been completed.Jan <var data-var='date'>23</var>, <var data-var='time'>17:00</var> PST In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.Jan <var data-var='date'>21</var>, <var data-var='time'>15:07</var> PST Scheduled - Amperity will be performing scheduled system maintenance on Thursday, January 23rd, starting at 5PM Pacific Time. We anticipate a brief period of increased error rates in the application, with potential impacts on workflow tasks. Customers will be notified about any workflow failures, and may need to manually restart the affected workflows during this time. This maintenance will not affect Amperity customers on the Azure platform.

Amperity planned maintenance for AWS platform

Jan <var data-var='date'>12</var>, <var data-var='time'>12:34</var> PST Resolved - We’re back! Amperity should be up and running normally. Thanks for bearing with us.Jan <var data-var='date'>12</var>, <var data-var='time'>10:03</var> PST Monitoring - A fix has been implemented to recover orchestration scheduling and we are monitoring the results.Jan <var data-var='date'>12</var>, <var data-var='time'>09:45</var> PST Investigating - We're experiencing an issue with scheduling Orchestration jobs which may impact our customers on Azure. We're working on the issue and expect to resolve it shortly.

Is Amperity down?

Amperity status is UP

Lastest published events

Amperity is experiencing an outage to all services on our Azure platform

Amperity is experiencing failing Predictive workflows due to a Databricks outage

Amperity AmpAI Outage

Amperity Services, Components and Regions

Recent Amperity events

Amperity is experiencing an outage to all services on our Azure platform

Amperity is experiencing failing Predictive workflows due to a Databricks outage

Amperity AmpAI Outage

Amperity is experiencing a partial outage impacting the loading of Segments

Amperity is experiencing performance issues with Queries

Amperity experienced an outage

Get your FREE account now,
5 monitors included!

Is Amperity down?

Amperity status is UP

Lastest published events

Amperity is experiencing an outage to all services on our Azure platform

Amperity is experiencing failing Predictive workflows due to a Databricks outage

Amperity AmpAI Outage

Amperity Services, Components and Regions

Recent Amperity events

Amperity is experiencing an outage to all services on our Azure platform

Amperity is experiencing failing Predictive workflows due to a Databricks outage

Amperity AmpAI Outage

Amperity is experiencing a partial outage impacting the loading of Segments

Amperity is experiencing performance issues with Queries

Amperity experienced an outage

Get your FREE account now,5 monitors included!

Get your FREE account now,
5 monitors included!