Sep <var data-var='date'>25</var>, <var data-var='time'>08:54</var> PDT Resolved - This incident has been resolved. Sep <var data-var='date'>24</var>, <var data-var='time'>12:30</var> PDT Identified - We have identified an issue with S3 stream upload and are working to resolve.

Incident detected with the S3 stream uploader

Sep <var data-var='date'>23</var>, <var data-var='time'>12:48</var> PDT Resolved - This incident has been resolved. Sep <var data-var='date'>23</var>, <var data-var='time'>12:43</var> PDT Update - We are continuing to work on a fix for this issue. Sep <var data-var='date'>23</var>, <var data-var='time'>12:36</var> PDT Update - We are continuing to work on a fix for this issue. Sep <var data-var='date'>23</var>, <var data-var='time'>11:35</var> PDT Update - There is increased query failure + delay in event processing Sep <var data-var='date'>23</var>, <var data-var='time'>11:34</var> PDT Identified - The issue has been identified and a fix is being implemented.

Incident detected with the Stream Service

Mar <var data-var='date'>11</var>, <var data-var='time'>11:07</var> PDT Resolved - This incident has been resolved. Mar <var data-var='date'>11</var>, <var data-var='time'>11:06</var> PDT Update - The issue is resolved. Mar <var data-var='date'>11</var>, <var data-var='time'>07:41</var> PDT Identified - The issue has been identified and a fix is being implemented.

Nov <var data-var='date'> 4</var>, <var data-var='time'>04:01</var> PST Completed - The scheduled maintenance has been completed. Nov <var data-var='date'> 4</var>, <var data-var='time'>03:22</var> PST Verifying - Verification is currently underway for the maintenance items. Nov <var data-var='date'> 4</var>, <var data-var='time'>03:05</var> PST In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary. Nov <var data-var='date'> 4</var>, <var data-var='time'>03:03</var> PST Scheduled - The previous database maintenance is prolonged. Create and Delete Access Keys operations may return errors during the maintenance.

Prolonged database maintenance

Nov <var data-var='date'> 4</var>, <var data-var='time'>03:00</var> PST Completed - The scheduled maintenance has been completed. Nov <var data-var='date'> 4</var>, <var data-var='time'>02:00</var> PST In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary. Oct <var data-var='date'>28</var>, <var data-var='time'>07:30</var> PDT Update - We will be undergoing scheduled maintenance during this time. Create and Delete Access Keys operations may return errors during the maintenance. Oct <var data-var='date'>28</var>, <var data-var='time'>07:20</var> PDT Scheduled - We will be undergoing scheduled maintenance during this time.

Database maintenance

Oct <var data-var='date'>21</var>, <var data-var='time'>23:55</var> PDT Completed - The scheduled maintenance has been completed. Oct <var data-var='date'>21</var>, <var data-var='time'>21:00</var> PDT In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary. Oct <var data-var='date'>18</var>, <var data-var='time'>01:40</var> PDT Scheduled - We will update our Zookeeper cluster. Delays in processing messages from Kafka Inbound and Outbound clusters are expected. Short connectivity issues might occur for producers/consumers.

Kafka maintenance

Oct <var data-var='date'> 3</var>, <var data-var='time'>04:09</var> PDT Completed - The scheduled maintenance has been completed. Oct <var data-var='date'> 3</var>, <var data-var='time'>02:00</var> PDT In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary. Sep <var data-var='date'>30</var>, <var data-var='time'>07:55</var> PDT Scheduled - We will be undergoing scheduled maintenance during this time.

Jun <var data-var='date'>29</var>, <var data-var='time'>00:51</var> PDT Resolved - This incident has been resolved. Jun <var data-var='date'>28</var>, <var data-var='time'>10:55</var> PDT Investigating - We are observing degraded performance of Compute API due to increased volume of queries. We are investigating the issue.

Degraded performance of Compute API

Apr <var data-var='date'>29</var>, <var data-var='time'>05:56</var> PDT Completed - The scheduled maintenance has been completed. Apr <var data-var='date'>29</var>, <var data-var='time'>05:56</var> PDT Update - Scheduled maintenance is still in progress. We will provide updates as necessary. Apr <var data-var='date'>29</var>, <var data-var='time'>00:00</var> PDT In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary. Apr <var data-var='date'>24</var>, <var data-var='time'>08:33</var> PDT Scheduled - We will be undergoing scheduled maintenance during this time. We expect that the write event response time might be higher than usual.

Write Path Maintenance

Apr <var data-var='date'> 4</var>, <var data-var='time'>01:00</var> PDT Completed - The scheduled maintenance has been completed. Apr <var data-var='date'> 4</var>, <var data-var='time'>00:51</var> PDT Verifying - Verification is currently underway for the maintenance items. Apr <var data-var='date'> 4</var>, <var data-var='time'>00:30</var> PDT In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary. Apr <var data-var='date'> 3</var>, <var data-var='time'>05:01</var> PDT Scheduled - We will be undergoing scheduled database maintenance during this time. To be clear, we will be rotating certificates and we do not expect any downtimes.

Database Maintenance

Jan <var data-var='date'>30</var>, <var data-var='time'>10:21</var> PST Completed - The scheduled maintenance has been completed. Jan <var data-var='date'>30</var>, <var data-var='time'>09:01</var> PST In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary. Jan <var data-var='date'>16</var>, <var data-var='time'>00:43</var> PST Scheduled - We will move our services to a new Kubernetes cluster.

Service migration

Jan <var data-var='date'> 8</var>, <var data-var='time'>18:16</var> PST Resolved - This incident has been resolved. Jan <var data-var='date'> 8</var>, <var data-var='time'>18:00</var> PST Monitoring - A fix has been implemented and we are monitoring the results. Jan <var data-var='date'> 8</var>, <var data-var='time'>17:40</var> PST Identified - The issue has been identified and a fix is being implemented. Jan <var data-var='date'> 8</var>, <var data-var='time'>16:56</var> PST Investigating - We are currently investigating this issue.

Writing events might be delayed

Nov <var data-var='date'>24</var>, <var data-var='time'>02:31</var> PST Resolved - This incident has been resolved. Nov <var data-var='date'>24</var>, <var data-var='time'>02:04</var> PST Monitoring - A fix has been implemented and we are monitoring the results. Nov <var data-var='date'>24</var>, <var data-var='time'>01:54</var> PST Identified - The issue has been identified and a fix is being implemented. Nov <var data-var='date'>24</var>, <var data-var='time'>01:48</var> PST Investigating - We are currently investigating this issue.

Writing events might be delayed and some queries might fail

Sep <var data-var='date'> 2</var>, <var data-var='time'>03:47</var> PDT Resolved - This incident has been resolved. Sep <var data-var='date'> 2</var>, <var data-var='time'>03:01</var> PDT Monitoring - A fix has been implemented and we are monitoring the results. Sep <var data-var='date'> 2</var>, <var data-var='time'>01:48</var> PDT Update - We are continuing to work on a fix for this issue. Sep <var data-var='date'> 2</var>, <var data-var='time'>01:27</var> PDT Identified - The issue has been identified and a fix is being implemented. Sep <var data-var='date'> 2</var>, <var data-var='time'>01:06</var> PDT Update - We are continuing to investigate this issue. Sep <var data-var='date'> 2</var>, <var data-var='time'>00:50</var> PDT Investigating - We are currently investigating this issue.

Aug <var data-var='date'> 7</var>, <var data-var='time'>11:06</var> PDT Resolved - This incident has been resolved. Aug <var data-var='date'> 7</var>, <var data-var='time'>10:48</var> PDT Monitoring - A fix has been implemented and we are monitoring the results. Aug <var data-var='date'> 7</var>, <var data-var='time'>09:59</var> PDT Investigating - We are currently investigating this issue.

Some events streamed to S3 may be delayed

Jul <var data-var='date'>20</var>, <var data-var='time'>03:14</var> PDT Resolved - This incident has been resolved. Jul <var data-var='date'>19</var>, <var data-var='time'>17:20</var> PDT Monitoring - Big backlog of data is being processed and some indexes updates might be delayed.

Cached Datasets updates might be delayed

May <var data-var='date'>23</var>, <var data-var='time'>01:08</var> PDT Resolved - This incident has been resolved. May <var data-var='date'>22</var>, <var data-var='time'>23:17</var> PDT Monitoring - A fix has been implemented and we are monitoring the results. May <var data-var='date'>22</var>, <var data-var='time'>22:59</var> PDT Investigating - We are currently investigating this issue.

May <var data-var='date'> 9</var>, <var data-var='time'>10:57</var> PDT Resolved - This incident has been resolved. May <var data-var='date'> 9</var>, <var data-var='time'>10:52</var> PDT Monitoring - A fix has been implemented and we are monitoring the results. May <var data-var='date'> 9</var>, <var data-var='time'>10:44</var> PDT Identified - The issue has been identified and a fix is being implemented. May <var data-var='date'> 9</var>, <var data-var='time'>10:13</var> PDT Investigating - Some actions, especially ones that use access keys, may return errors. We're investigating the issue.

Some actions may return errors

Apr <var data-var='date'>27</var>, <var data-var='time'>23:30</var> PDT Resolved - This incident has been resolved. Apr <var data-var='date'>27</var>, <var data-var='time'>16:03</var> PDT Monitoring - A fix has been implemented and we are monitoring the results. Apr <var data-var='date'>27</var>, <var data-var='time'>14:51</var> PDT Update - We are continuing to investigate this issue. Apr <var data-var='date'>27</var>, <var data-var='time'>13:56</var> PDT Investigating - We are currently investigating this issue.

Query durations are higher than usual and some queries might fail

Feb <var data-var='date'>27</var>, <var data-var='time'>02:03</var> PST Completed - The scheduled maintenance has been completed. Feb <var data-var='date'>27</var>, <var data-var='time'>01:30</var> PST In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary. Feb <var data-var='date'>21</var>, <var data-var='time'>04:42</var> PST Scheduled - We will be undergoing scheduled database maintenance during this time. We’re expecting partial outage of the UI. Create/Delete Access Keys operations may return errors as well. APIs might be slower than usual.

Database upgrade

Feb <var data-var='date'>23</var>, <var data-var='time'>12:47</var> PST Resolved - This incident has been resolved. Feb <var data-var='date'>23</var>, <var data-var='time'>10:33</var> PST Monitoring - A fix has been implemented and we are monitoring the results. Feb <var data-var='date'>23</var>, <var data-var='time'>08:59</var> PST Identified - The issue has been identified and a fix is being implemented. Feb <var data-var='date'>23</var>, <var data-var='time'>07:37</var> PST Investigating - We are currently investigating the issue.

Kafka Inbound - messages are delayed

Feb <var data-var='date'>23</var>, <var data-var='time'>12:35</var> PST Resolved - This incident has been resolved. Feb <var data-var='date'>23</var>, <var data-var='time'>10:36</var> PST Monitoring - A fix has been implemented and we are monitoring the results. Feb <var data-var='date'>23</var>, <var data-var='time'>10:14</var> PST Identified - The issue has been identified and a fix is being implemented.

Feb <var data-var='date'>23</var>, <var data-var='time'>03:11</var> PST Completed - The scheduled maintenance has been completed. Feb <var data-var='date'>23</var>, <var data-var='time'>02:00</var> PST In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary. Feb <var data-var='date'>21</var>, <var data-var='time'>02:35</var> PST Scheduled - We will be undergoing scheduled database maintenance during this time. We’re expecting partial outage of Dashboards for a short period. Other components won't be affected.

Dashboards database upgrade

Feb <var data-var='date'> 9</var>, <var data-var='time'>11:39</var> PST Resolved - This incident has been resolved. Feb <var data-var='date'> 9</var>, <var data-var='time'>11:13</var> PST Monitoring - A fix has been implemented and we are monitoring the results. Feb <var data-var='date'> 9</var>, <var data-var='time'>10:24</var> PST Identified - The issue has been identified and a fix is being implemented. Feb <var data-var='date'> 9</var>, <var data-var='time'>10:20</var> PST Investigating - We are currently investigating this issue.

Events streaming to S3 buckets may be delayed

Feb <var data-var='date'> 9</var>, <var data-var='time'>09:45</var> PST Resolved - This incident has been resolved. Feb <var data-var='date'> 9</var>, <var data-var='time'>09:40</var> PST Monitoring - A fix has been implemented and we are monitoring the results. Feb <var data-var='date'> 9</var>, <var data-var='time'>09:30</var> PST Investigating - We are currently investigating this issue.

Is Keen down?

Keen status is UP

Lastest published events

Incident detected with the S3 stream uploader

Incident detected with the Stream Service

Incident detected with the S3 stream uploader

Keen Services, Components and Regions

Recent Keen events

Incident detected with the S3 stream uploader

Incident detected with the Stream Service

Incident detected with the S3 stream uploader

Prolonged database maintenance

Database maintenance

Kafka maintenance