Sep <var data-var='date'> 8</var>, <var data-var='time'>08:40</var> UTC Resolved - This incident has been resolved. Sep <var data-var='date'> 8</var>, <var data-var='time'>08:28</var> UTC Monitoring - We've implemented a fix and are monitoring the situation. Sep <var data-var='date'> 8</var>, <var data-var='time'>08:09</var> UTC Investigating - We are investigating an issue with editor not loading.

Stonly editor not loading

Aug <var data-var='date'>17</var>, <var data-var='time'>13:55</var> UTC Resolved - This incident has been resolved. Aug <var data-var='date'>17</var>, <var data-var='time'>13:30</var> UTC Monitoring - Things have stabilized, but we continue monitoring the issue Aug <var data-var='date'>17</var>, <var data-var='time'>13:23</var> UTC Investigating - We're investigating an issue with guides taking a long time or failing to load

Intermittent failures when loading guides

Jul <var data-var='date'>27</var>, <var data-var='time'>12:30</var> UTC Resolved - Any modifications to the triggers, including enablement, disablement, and updates, are applied with a delay. This is due to widget servers losing an established connection to the main server and the self-healing process being defective.

Changes to triggers are applied with a Delay

Jul <var data-var='date'>16</var>, <var data-var='time'>10:45</var> UTC Resolved - This incident has been resolved. Jul <var data-var='date'>16</var>, <var data-var='time'>10:30</var> UTC Monitoring - We've implemented a workaround. Things are working as expected and we continue to monitor the situation. Jul <var data-var='date'>16</var>, <var data-var='time'>08:48</var> UTC Update - We were able to restore access to content hosted via stonly.com and it's subdomains. We're still evaluating how to restore access to knowledge bases hosted under custom domains. Jul <var data-var='date'>16</var>, <var data-var='time'>08:42</var> UTC Update - We're rolling back the workaround, restoring our services one after another Jul <var data-var='date'>16</var>, <var data-var='time'>08:32</var> UTC Identified - While we're working on resolving the underlying issue, we're actively working on implementing a workaround that should bring us back in the next 20 minutes Jul <var data-var='date'>16</var>, <var data-var='time'>08:17</var> UTC Update - The issue seems to be our cloud provider network problem. We've escalated the issue to their support and are trying to build a temporary workaround to restore services in parallel. Jul <var data-var='date'>16</var>, <var data-var='time'>08:02</var> UTC Investigating - We're currently investing an issue with Stonly not loading and returning 504 Gateway Timeout error.

Platform outage

Jun <var data-var='date'> 9</var>, <var data-var='time'>16:08</var> UTC Resolved - This incident has been resolved. Jun <var data-var='date'> 9</var>, <var data-var='time'>16:01</var> UTC Monitoring - We've identified the source of errors to be related to ongoing scan on our infrastructure. We've blocked the offending traffic and our error rates are back to normal. We continue monitoring the case. Jun <var data-var='date'> 9</var>, <var data-var='time'>15:43</var> UTC Investigating - We're investigating an elevated number of AI Answers errors

AI Answers partial outage

Jun <var data-var='date'> 5</var>, <var data-var='time'>10:45</var> UTC Resolved - This incident has been resolved. Jun <var data-var='date'> 5</var>, <var data-var='time'>10:45</var> UTC Monitoring - A fix has been implemented and we are monitoring the results. Jun <var data-var='date'> 3</var>, <var data-var='time'>09:19</var> UTC Identified - We've identified and issue and put some mitigations in place. AI AGent assist is now fully functional. We're working on resolving the guide summary issue and process the backlog of jobs to process. Jun <var data-var='date'> 3</var>, <var data-var='time'>08:12</var> UTC Investigating - We are investigating an issue with guide summaries not being generated and AI Agent assist returning errors.

Guide Summary generation and AI Agent assist issues

May <var data-var='date'>28</var>, <var data-var='time'>06:50</var> UTC Completed - The scheduled maintenance has been completed. May <var data-var='date'>28</var>, <var data-var='time'>06:40</var> UTC Verifying - Verification is currently underway for the maintenance items. May <var data-var='date'>28</var>, <var data-var='time'>06:00</var> UTC In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary. May <var data-var='date'>20</var>, <var data-var='time'>10:28</var> UTC Scheduled - We will be conducting infrastructure updates. You can expect brief (under 15 minutes) interruptions to the service within that timeframe.

Infrastructure updates

May <var data-var='date'> 6</var>, <var data-var='time'>10:30</var> UTC Resolved - Between 12:29 and 13:27 we've seen increased amount of errors when loading guides.

Intermittent guide loading timeouts

May <var data-var='date'> 4</var>, <var data-var='time'>16:29</var> UTC Resolved - This incident has been resolved. May <var data-var='date'> 4</var>, <var data-var='time'>15:35</var> UTC Monitoring - A fix has been implemented and we are monitoring the results. May <var data-var='date'> 4</var>, <var data-var='time'>14:50</var> UTC Investigating - We are currently investigating this issue.

Intermittent platform outages

Apr <var data-var='date'>30</var>, <var data-var='time'>14:18</var> UTC Resolved - This incident has been resolved. Apr <var data-var='date'>30</var>, <var data-var='time'>14:05</var> UTC Monitoring - A fix has been implemented and we are monitoring the results. Apr <var data-var='date'>30</var>, <var data-var='time'>13:28</var> UTC Identified - The issue has been identified and a fix is being implemented.

Performance degradation on KBs and Guides

Apr <var data-var='date'>28</var>, <var data-var='time'>10:05</var> UTC Resolved - This incident has been resolved. Apr <var data-var='date'>28</var>, <var data-var='time'>09:00</var> UTC Monitoring - A fix has been implemented and we are monitoring the results. Apr <var data-var='date'>28</var>, <var data-var='time'>08:23</var> UTC Identified - The issue has been identified and a fix is being implemented.

Due to service provider networking issues, Automation and Segment integration is down

Mar <var data-var='date'>30</var>, <var data-var='time'>12:41</var> UTC Resolved - This incident has been resolved. Mar <var data-var='date'>30</var>, <var data-var='time'>12:36</var> UTC Update - We are continuing to monitor for any further issues. Mar <var data-var='date'>30</var>, <var data-var='time'>12:35</var> UTC Monitoring - A fix has been implemented and we are monitoring the results. Mar <var data-var='date'>30</var>, <var data-var='time'>12:35</var> UTC Update - We are continuing to work on a fix for this issue. Mar <var data-var='date'>30</var>, <var data-var='time'>12:32</var> UTC Identified - The issue has been identified and a fix is being implemented.

Problem with the Guide publish functionality

Jan <var data-var='date'>27</var>, <var data-var='time'>15:04</var> UTC Resolved - This incident has been resolved. Jan <var data-var='date'>27</var>, <var data-var='time'>12:05</var> UTC Monitoring - We've rerouted traffic to endpoints that are not affected. All functionality should now be restored. We continue monitoring the situation. Jan <var data-var='date'>27</var>, <var data-var='time'>11:37</var> UTC Identified - The issue is caused by Azure OpenAI issues. More details can be found on Azure status page. We're currently monitoring the status of Azure incident and looking into remediation options. Jan <var data-var='date'>27</var>, <var data-var='time'>11:35</var> UTC Investigating - We are currently investigating this issue.

AI Answers not returning results

Jan <var data-var='date'>19</var>, <var data-var='time'>14:21</var> UTC Resolved - This incident has been resolved. Jan <var data-var='date'>19</var>, <var data-var='time'>14:06</var> UTC Monitoring - A fix has been implemented and we are monitoring the results. Jan <var data-var='date'>19</var>, <var data-var='time'>14:02</var> UTC Update - We are rolling back to the previous version. Jan <var data-var='date'>19</var>, <var data-var='time'>13:57</var> UTC Investigating - After deplying new version of the application, we are observing some instability for some customers.

Problem with new release package

Dec <var data-var='date'>11</var>, <var data-var='time'>15:58</var> UTC Resolved - This incident has been resolved. Dec <var data-var='date'>11</var>, <var data-var='time'>15:15</var> UTC Monitoring - A fix was deployed and we're seeing embeddings being properly processed now. All data returned by AI bot should be up to date now. Dec <var data-var='date'>11</var>, <var data-var='time'>14:36</var> UTC Identified - We've found an issue and we're preparing a fix, that should go out in the next 15 minutes. Dec <var data-var='date'>11</var>, <var data-var='time'>14:21</var> UTC Investigating - We're investigating an issue where data used by our AI Bot is not updated after a guide is modified. That may lead to AI bot answering based on outdated guide content. All guide modifications will be automatically processed without additional actions after we restore the functionality.

Guide updates not reflected in AI Bot answers

Nov <var data-var='date'> 6</var>, <var data-var='time'>08:00</var> UTC Completed - The scheduled maintenance has been completed. Nov <var data-var='date'> 6</var>, <var data-var='time'>06:00</var> UTC In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary. Oct <var data-var='date'>30</var>, <var data-var='time'>14:10</var> UTC Scheduled - During this maintenance window, we will upgrade the OpenSearch cluster that supports search-related Stonly functions. As a result, there may be a brief disruption. Additionally, to ensure synchronization, access to the Stonly editor at app.stonly.com will be temporarily disabled.

Upgrade of underlying infrastructure

Nov <var data-var='date'> 5</var>, <var data-var='time'>14:24</var> UTC Resolved - This incident has been fully resolved. Nov <var data-var='date'> 5</var>, <var data-var='time'>13:02</var> UTC Monitoring - Once the fix was effectively deployed, we observed a decrease in the error rate. This issue is now moved to the monitoring state. Nov <var data-var='date'> 5</var>, <var data-var='time'>12:26</var> UTC Identified - We know what the issue is, we are implementing a temporary fix, ETA around 10 minutes Nov <var data-var='date'> 5</var>, <var data-var='time'>11:52</var> UTC Investigating - We are experiencing an increased rate of errors connected to the loading on embedded guides. We are actively investigating the situation.

Increased error rate for embedded guides

Nov <var data-var='date'> 4</var>, <var data-var='time'>16:22</var> UTC Resolved - The incident was fully resolved. Nov <var data-var='date'> 4</var>, <var data-var='time'>13:43</var> UTC Monitoring - A fix has been implemented and we are monitoring the results. Nov <var data-var='date'> 4</var>, <var data-var='time'>13:43</var> UTC Update - We are observing recovery symptoms, and will keep updating in the next 15 minutes Nov <var data-var='date'> 4</var>, <var data-var='time'>13:32</var> UTC Investigating - We are under a huge load, and some of our databases have degraded performance. We are applying modifications to the database systems. We will be back with further information in 15 minutes.

General database performance degradation

Oct <var data-var='date'>28</var>, <var data-var='time'>12:26</var> UTC Resolved - Our metrics are back to normal and monitoring confirms that the issue is fully resolved now. Oct <var data-var='date'>28</var>, <var data-var='time'>12:20</var> UTC Monitoring - A fix was implemented and things should be back to normal. Oct <var data-var='date'>28</var>, <var data-var='time'>12:05</var> UTC Identified - We've identified an issue affecting ability to display stonly guide and knowledgebases and we're working on a fix, which should be deployed in the next 15 minutes.

Stonly guides and Knowledge Bases unavailable

Sep <var data-var='date'>30</var>, <var data-var='time'>06:45</var> UTC Completed - The scheduled maintenance has been completed. Sep <var data-var='date'>30</var>, <var data-var='time'>06:00</var> UTC In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary. Sep <var data-var='date'>24</var>, <var data-var='time'>12:32</var> UTC Scheduled - Stonly will be performing scheduled maintenance to enhance your experience. The maintenance is expected to take approximately 45 minutes. During this time, our services may be temporarily unavailable or experience reduced performance.

Scheduled Maintenance Notification

Sep <var data-var='date'>12</var>, <var data-var='time'>13:34</var> UTC Resolved - This incident has been resolved. Sep <var data-var='date'>12</var>, <var data-var='time'>13:32</var> UTC Monitoring - Dear Customer, In response to the issue with, we have taken corrective actions. The system is currently under monitoring to ensure its stability.We appreciate your patience and understanding. Sincerely, The Stonly Team Sep <var data-var='date'>12</var>, <var data-var='time'>13:22</var> UTC Investigating - Dear Customer, We are currently investigating an issue impacting: Stonly Website.Our technical team is working to identify the cause and restore service as quickly as possible. We apologize for this disruption and appreciate your patience.As soon as we have more information, we will post updates on our status page. Sincerely, The Stonly Team

Service Issue

Sep <var data-var='date'>11</var>, <var data-var='time'>07:31</var> UTC Resolved - The issue is now fully resolved - uploading and viewing images should work as expected. Sep <var data-var='date'>10</var>, <var data-var='time'>14:43</var> UTC Update - We are continuing to work on a fix for this issue and restoring full functionality. Sep <var data-var='date'>10</var>, <var data-var='time'>14:42</var> UTC Update - While we continue to resolve the underlying issue with our Image service provider, we've implemented a workaround that allows displaying original images in the Stonly guides. Since original images are not being resized, it may result in content looking different and images taking longer time to load. Sep <var data-var='date'>10</var>, <var data-var='time'>13:39</var> UTC Identified - We are currently experiencing image service provider issues. The fixes are underway.

Images unavaliable globally

Aug <var data-var='date'>12</var>, <var data-var='time'>06:25</var> UTC Resolved - This incident has been resolved. Aug <var data-var='date'> 8</var>, <var data-var='time'>21:46</var> UTC Monitoring - Dear Customer, In response to the issue with, we have taken corrective actions. The system is currently under monitoring to ensure its stability.We appreciate your patience and understanding. Sincerely, The Stonly Team Aug <var data-var='date'> 8</var>, <var data-var='time'>21:40</var> UTC Investigating - Dear Customer, We are currently investigating an issue impacting: Stonly customers KB's - location C.Our technical team is working to identify the cause and restore service as quickly as possible. We apologize for this disruption and appreciate your patience.As soon as we have more information, we will post updates on our status page. Sincerely, The Stonly Team

Aug <var data-var='date'> 3</var>, <var data-var='time'>19:00</var> UTC Completed - The scheduled maintenance has been completed. Aug <var data-var='date'> 3</var>, <var data-var='time'>07:00</var> UTC In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary. Aug <var data-var='date'> 1</var>, <var data-var='time'>10:14</var> UTC Scheduled - For 12 hours starting Aug 3rd, 7:00 AM (UTC) adding new external knowledge sources and guided answers for AI Answers will be disabled for maintenance

Guided answers for AI answers and external knowledge sources ingestion maintenance

Jul <var data-var='date'>17</var>, <var data-var='time'>19:16</var> UTC Resolved - This incident has been resolved. Jul <var data-var='date'>17</var>, <var data-var='time'>15:45</var> UTC Monitoring - Dear Customer, In response to the issue with, we have taken corrective actions. The system is currently under monitoring to ensure its stability.We appreciate your patience and understanding. Sincerely, The Stonly Team Jul <var data-var='date'>17</var>, <var data-var='time'>15:31</var> UTC Investigating - Dear Customer, We are currently investigating an issue impacting: Stonly Website.Our technical team is working to identify the cause and restore service as quickly as possible. We apologize for this disruption and appreciate your patience.As soon as we have more information, we will post updates on our status page. Sincerely, The Stonly Team

Is Stonly down?

Stonly status is UP

Lastest published events

Stonly editor not loading

Intermittent failures when loading guides

Changes to triggers are applied with a Delay

Stonly Services, Components and Regions

Recent Stonly events

Stonly editor not loading

Intermittent failures when loading guides

Changes to triggers are applied with a Delay

Platform outage

AI Answers partial outage

Guide Summary generation and AI Agent assist issues