Jun <var data-var='date'> 2</var>, <var data-var='time'>08:49</var> PDT Resolved - The issue affecting the Salesforce (SFDC) integration has been resolved. As part of the remediation, all customers are required to reconnect their Salesforce instance in our application to restore integration functionality. We apologize for the inconvenience and appreciate your patience. Jun <var data-var='date'> 2</var>, <var data-var='time'>04:36</var> PDT Identified - We are currently experiencing an issue with our Salesforce (SFDC) integration, and the service is temporarily unavailable. Our team is actively investigating the issue and working to restore functionality as quickly as possible. We will provide updates as more information becomes available.

Salesforce (SFDC) Integration Incident

Apr <var data-var='date'>20</var>, <var data-var='time'>17:33</var> PDT Resolved - This incident has been resolved. Apr <var data-var='date'>20</var>, <var data-var='time'>17:33</var> PDT Update - We are continuing to work on a fix for this issue. Apr <var data-var='date'>20</var>, <var data-var='time'>15:56</var> PDT Identified - We’ve identified an issue affecting Sales Copilot and are actively working on a fix. We expect full recovery within approximately 90 minutes.

Sales Copilot Unavailable

Apr <var data-var='date'> 3</var>, <var data-var='time'>10:31</var> PDT Resolved - This incident has been resolved. Apr <var data-var='date'> 3</var>, <var data-var='time'>10:12</var> PDT Identified - The issue has been identified and a fix is being implemented.

Feb <var data-var='date'>27</var>, <var data-var='time'>04:01</var> PST Resolved - This incident has been resolved. Feb <var data-var='date'>26</var>, <var data-var='time'>03:51</var> PST Monitoring - A fix has been implemented and we are monitoring the results. Feb <var data-var='date'>24</var>, <var data-var='time'>05:48</var> PST Identified - We’re currently investigating an issue affecting our ability to load new data from a subset of customers. Updates to follow.

Delayed CRM Integration

Dec <var data-var='date'>15</var>, <var data-var='time'>08:38</var> PST Resolved - The service used to provide transformation and updating of extracted data in the platform ("Data Workers") was degraded causing instability on the service and delays in refreshing data loaded from external integrations. This has been fixed and services are resuming although some delays in seeing updated data in copilot and scores in linked CRM tools may be experienced still.

Data Processing (Data Workers) Instability

Oct <var data-var='date'>21</var>, <var data-var='time'>00:52</var> PDT Resolved - This incident has been resolved. Oct <var data-var='date'>21</var>, <var data-var='time'>00:51</var> PDT Monitoring - Service functionality has been restored. We are continuing to monitor it to ensure full stability. Oct <var data-var='date'>20</var>, <var data-var='time'>18:52</var> PDT Update - We're still monitoring our dependent services. Oct <var data-var='date'>20</var>, <var data-var='time'>18:39</var> PDT Identified - Sales Copilot is currently experiencing renewed service disruption as some of our dependent services are facing issues again Oct <var data-var='date'>20</var>, <var data-var='time'>17:13</var> PDT Monitoring - Service functionality has been restored. We are continuing to monitor it to ensure full stability. Oct <var data-var='date'>20</var>, <var data-var='time'>12:58</var> PDT Identified - Sales Copilot is currently experiencing service degradation due to widespread outages affecting multiple online services, including our infrastructure providers. Our team is actively monitoring the situation and implementing mitigations as providers restore functionality. We will provide updates as more information becomes available.

Sales Copilot service disruption

Oct <var data-var='date'> 6</var>, <var data-var='time'>10:30</var> PDT Resolved - This incident has been resolved. Oct <var data-var='date'> 6</var>, <var data-var='time'>10:08</var> PDT Monitoring - A fix has been released, and we are monitoring the results. Oct <var data-var='date'> 6</var>, <var data-var='time'>09:54</var> PDT Identified - The issue has been identified and a fix is currently being released. Oct <var data-var='date'> 6</var>, <var data-var='time'>09:53</var> PDT Investigating - An issue has appeared on app.madkudu.com preventing people to access any pages of it.

app.madkudu.com not available

Jun <var data-var='date'>16</var>, <var data-var='time'>07:41</var> PDT Resolved - This incident has been resolved. MadKudu is pulling data normally again. Expect any remaining scoring delay backlog to clear in the next 12 hours. Jun <var data-var='date'>16</var>, <var data-var='time'>04:16</var> PDT Monitoring - A fix has been implemented and we are monitoring the results. Jun <var data-var='date'>16</var>, <var data-var='time'>02:51</var> PDT Identified - The issue has been identified and a fix is being implemented. Jun <var data-var='date'>16</var>, <var data-var='time'>02:23</var> PDT Investigating - Our infrastructure has been experiencing delays in pulling new data from our customers' systems over the weekend. Our team has been notified and is actively looking into the issue.

Delays with pulling data

May <var data-var='date'>30</var>, <var data-var='time'>00:46</var> PDT Resolved - This incident has been resolved. May <var data-var='date'>27</var>, <var data-var='time'>08:52</var> PDT Monitoring - The LaunchDarkly outage triggered an overload on our production database by one of our systems, which in turn prevented the Copilot service from handling some requests. After restarting the database and with LaunchDarkly gradually recovering, the load has decreased and Copilot is now functioning normally. We are closely monitoring the situation and are developing a plan to improve our resilience to similar incidents, which will be implemented in the coming weeks. May <var data-var='date'>27</var>, <var data-var='time'>07:21</var> PDT Investigating - One of our provider, LaunchDarkly, is experiencing a major outage: https://status.launchdarkly.com/ We use Launchdarkly for our feature flag infrastructure (i.e. control how features are released). We are looking for a way to fix the situation without having to wait for Launchdarkly to fix their service.

Copilot Partial Outage

Apr <var data-var='date'>19</var>, <var data-var='time'>06:00</var> PDT Resolved - During April 19th 2025 07:00 AM - April 22nd 2025 our Push ECS agent experienced intermittent disconnections, causing push delivery to be unstable. This was due to the agent becoming unresponsive, likely from machine lock or CPU overload. Actions taken: • Identified and rebooted the affected instance • Doubled CPU and memory reservations for the push tasks • Push service is now stable and under close monitoring Next steps to prevent recurrence: • Continue monitoring agent status and container performance

Scoring Push to CRM Outage

Feb <var data-var='date'> 4</var>, <var data-var='time'>09:53</var> PST Resolved - This incident has been resolved. Feb <var data-var='date'> 4</var>, <var data-var='time'>09:13</var> PST Identified - The explore view is experiencing outage and the message "It seems that there are some problems loading your data. Please update the rules or contact support if the issue persists." is displayed on some request. We are currently working on solving it and the system should be back very soon.

Explore View Degradation

Jan <var data-var='date'>29</var>, <var data-var='time'>22:21</var> PST Resolved - This incident has been resolved. Jan <var data-var='date'>29</var>, <var data-var='time'>11:03</var> PST Monitoring - The service is back and we upscaled the machines to make sure you don't experience degraded performance. We will keep monitoring the situation for 24 hours. Jan <var data-var='date'>29</var>, <var data-var='time'>09:55</var> PST Identified - The service in charge of executing explore queries is experiencing an outage due to an overload. We are restarting the service and scaling up the machines to bring it back online.

Explore views outage

Dec <var data-var='date'>17</var>, <var data-var='time'>01:12</var> PST Resolved - This incident has been resolved. Dec <var data-var='date'>12</var>, <var data-var='time'>23:25</var> PST Monitoring - The issue has been identified and the fix has been released. We are actively monitoring the platform. Dec <var data-var='date'>11</var>, <var data-var='time'>23:17</var> PST Identified - We identified the issue and are actively working on fixing it. We expect the performances to go back to normal before 6:00 UTC Dec <var data-var='date'>11</var>, <var data-var='time'>10:26</var> PST Investigating - Our AWS infrastructure is suffering partial outage that cause Intermittent 504 Errors on the public API and can prevent new attributes mapping from being published. We are actively investigating the issue but due to its complexity, we don't expect it to be completely fixed before 24h

Intermittent 504 Errors

Dec <var data-var='date'>10</var>, <var data-var='time'>08:51</var> PST Resolved - This incident has been resolved. Dec <var data-var='date'>10</var>, <var data-var='time'>06:36</var> PST Monitoring - The fix has been deployed and the error rate dropped significantly. We are monitoring the systems to ensure stability. Dec <var data-var='date'>10</var>, <var data-var='time'>06:28</var> PST Update - We are continuing to work on a fix for this issue. Dec <var data-var='date'>10</var>, <var data-var='time'>06:28</var> PST Identified - The AWS region where the public API is hosted is having issues. We are redeploying the instances.

Public API is returning 504

Nov <var data-var='date'>29</var>, <var data-var='time'>00:17</var> PST Resolved - This incident has been resolved. Nov <var data-var='date'>28</var>, <var data-var='time'>05:43</var> PST Monitoring - A fix has been implemented and we are monitoring the results. Nov <var data-var='date'>28</var>, <var data-var='time'>00:41</var> PST Update - We are continuing to work on a fix for this issue. Nov <var data-var='date'>28</var>, <var data-var='time'>00:40</var> PST Identified - A major database migration created disturbance in our explore views. As a result, these views are empty. The problem has been identified and we are working to fix the problem.

Explore views are empty

Aug <var data-var='date'> 5</var>, <var data-var='time'>00:02</var> PDT Resolved - This incident has been resolved. Aug <var data-var='date'> 4</var>, <var data-var='time'>12:00</var> PDT Investigating - Our API endpoints are experiencing higher latencies or error rates. We are investigating.

Downtime & Slowness on api.madkudu.com

Jul <var data-var='date'>29</var>, <var data-var='time'>12:00</var> PDT Resolved - This incident has been resolved. Jul <var data-var='date'>29</var>, <var data-var='time'>10:08</var> PDT Monitoring - Issue AWS on Saturday 27 degraded our ability to push scores into destination systems (e.g. SFDC). We identified the issues and push resumed. We expect every score to be up-to-date in a few hours.

Delay with score push

Feb <var data-var='date'> 5</var>, <var data-var='time'>13:45</var> PST Resolved - This incident has been resolved. Feb <var data-var='date'> 5</var>, <var data-var='time'>07:20</var> PST Investigating - Our infrastructure is experiencing delays. This is affecting fit and behavioral scoring, the refresh of the MSI as well as the publication of new mappings. Our team has been notified and is looking into the issue

Delays with batch scoring (fit, behavioral), refresh of MSI and publication of mappings

Jan <var data-var='date'>24</var>, <var data-var='time'>05:11</var> PST Resolved - This incident has been resolved. Jan <var data-var='date'>24</var>, <var data-var='time'>05:08</var> PST Investigating - Our API endpoints are experiencing higher latencies or error rates. We are investigating.

Degraded performance on api.madkudu.com

Jan <var data-var='date'>23</var>, <var data-var='time'>09:49</var> PST Resolved - This incident has been resolved. Jan <var data-var='date'>23</var>, <var data-var='time'>09:37</var> PST Investigating - Our API endpoints are experiencing higher latencies or error rates. We are investigating.

Jan <var data-var='date'>17</var>, <var data-var='time'>10:44</var> PST Resolved - This incident has been resolved. Jan <var data-var='date'>17</var>, <var data-var='time'>10:41</var> PST Investigating - Our API endpoints are experiencing higher latencies or error rates. We are investigating.

Jan <var data-var='date'>16</var>, <var data-var='time'>09:27</var> PST Resolved - This incident has been resolved. Jan <var data-var='date'>16</var>, <var data-var='time'>09:22</var> PST Investigating - Our API endpoints are experiencing higher latencies or error rates. We are investigating.

Nov <var data-var='date'>22</var>, <var data-var='time'>03:41</var> PST Resolved - This incident has been resolved. Nov <var data-var='date'>22</var>, <var data-var='time'>03:41</var> PST Investigating - Our data.madkudu.com endpoint is experiencing degraded performance. Data from Segment may be delayed. We are investigating the issue.

Degraded Performance with Data Endpoint

Nov <var data-var='date'>22</var>, <var data-var='time'>03:04</var> PST Resolved - This incident has been resolved. Nov <var data-var='date'>22</var>, <var data-var='time'>03:02</var> PST Investigating - Our data.madkudu.com endpoint is experiencing degraded performance. Data from Segment may be delayed. We are investigating the issue.

Nov <var data-var='date'>14</var>, <var data-var='time'>05:21</var> PST Resolved - This incident has been resolved. Nov <var data-var='date'>14</var>, <var data-var='time'>05:11</var> PST Investigating - Our API endpoints are experiencing higher latencies or error rates. We are investigating.

Is MadKudu down?

MadKudu status is UP

Lastest published events

Salesforce (SFDC) Integration Incident

Sales Copilot Unavailable

Sales Copilot Unavailable

MadKudu Services, Components and Regions

Recent MadKudu events

Salesforce (SFDC) Integration Incident

Sales Copilot Unavailable

Sales Copilot Unavailable

Delayed CRM Integration

Data Processing (Data Workers) Instability

Sales Copilot service disruption