Mar <var data-var='date'>29</var>, <var data-var='time'>21:00</var> CEST Completed - The scheduled maintenance has been completed.Mar <var data-var='date'>29</var>, <var data-var='time'>20:00</var> CEST In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.Mar <var data-var='date'>23</var>, <var data-var='time'>14:20</var> CET Scheduled - We will be undergoing scheduled maintenance to optimize database performance. During this time the Cluvio app and API will be unavailable.

Database Maintenance

Feb <var data-var='date'>11</var>, <var data-var='time'>10:03</var> CET Resolved - This incident has been resolved.Feb <var data-var='date'>11</var>, <var data-var='time'>10:01</var> CET Update - The issue has been resolved by AWS.Feb <var data-var='date'>10</var>, <var data-var='time'>23:02</var> CET Monitoring - From out server logs we observe only a small fraction of users being impacted. AWS just provided an update on the issue recovery: Feb 10 1:58 PM PST We can confirm significant recovery for the DNS resolution errors for Cloudfront distributions. Customers are still experiencing delays propagating changes to Cloudfront distributions. We continue to work toward full recovery and will provide additional information in the next 30-60 minutes.Feb <var data-var='date'>10</var>, <var data-var='time'>22:51</var> CET Identified - We are tracking intermittent issues accessing Cluvio web app and embeds, showing DNS resolution errors. The root cause seems to be ongoing AWS Route53 issue: https://health.aws.amazon.com/health/status We continue to monitor the situation, the impact so far seems to be limited and intermittent.

Intermittent DNS Resolution issues

Jan <var data-var='date'>26</var>, <var data-var='time'>10:00</var> CET Completed - The scheduled maintenance has been completed.Jan <var data-var='date'>26</var>, <var data-var='time'>09:31</var> CET In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.Jan <var data-var='date'>21</var>, <var data-var='time'>21:40</var> CET Scheduled - We will be undergoing scheduled database maintenance.

Database maintenance

Jan <var data-var='date'>26</var>, <var data-var='time'>09:30</var> CET Completed - The scheduled maintenance has been completed.Jan <var data-var='date'>26</var>, <var data-var='time'>09:00</var> CET In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.Jan <var data-var='date'>21</var>, <var data-var='time'>21:38</var> CET Scheduled - We will be undergoing scheduled database maintenance.

Jul <var data-var='date'>21</var>, <var data-var='time'>09:30</var> CEST Completed - The scheduled maintenance has been completed.Jul <var data-var='date'>21</var>, <var data-var='time'>08:00</var> CEST In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.Jul <var data-var='date'>16</var>, <var data-var='time'>10:34</var> CEST Scheduled - We will be performing database maintenance & upgrades. There may be short periods of intermittent errors as a result of automatic fail-over during this time period.

Jan <var data-var='date'> 6</var>, <var data-var='time'>19:00</var> CET Completed - The scheduled maintenance has been completed.Jan <var data-var='date'> 6</var>, <var data-var='time'>18:00</var> CET In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.Jan <var data-var='date'> 3</var>, <var data-var='time'>18:42</var> CET Scheduled - We will be undergoing a scheduled maintenance to upgrade and optimize our database servers. During the maintenance, the Cluvio app, sharing links and embeds will display a maintenance message and an estimated remaining time. Dashboards viewed in the Cluvio app or sharing links will update automatically once the maintenance is complete. The expected duration of the maintenance is about 30 minutes per region (EU and US).

Cluvio Database Maintenance

Aug <var data-var='date'> 1</var>, <var data-var='time'>23:09</var> CEST Resolved - A fix for the issue has been deployed to our production environments and reports with R script work correctly again.Aug <var data-var='date'> 1</var>, <var data-var='time'>21:07</var> CEST Identified - We have identified an issue with a change deployed today, where reports saved on dashboard with an R script do not finish running the query execution. A fix is being implemented and will be deployed morning UTC tomorrow (2022-08-02).

Reports with R script are not finishing

Feb <var data-var='date'>20</var>, <var data-var='time'>12:00</var> CET Completed - The scheduled maintenance has been completed.Feb <var data-var='date'>20</var>, <var data-var='time'>11:00</var> CET In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.Feb <var data-var='date'>19</var>, <var data-var='time'>11:06</var> CET Scheduled - We will be undergoing a short scheduled maintenance of our server infrastructure in the EU location, expected to last 30-60 minutes. During this time: - for about 25-50 minutes, all accounts in the EU will be read-only. The query execution, viewer experience, sharing links, embeds, sql alerts and dashboard schedules will continue to work as usual, but analysts will not be able to create new items (dashboards, reports,...) or save edits. - for about 5-10 minutes, the servers in the EU location will be in maintenance mode, with open dashboards not updating and maintenance message with countdown to the estimated completion time will be displayed. Any open dashboards or embeds will automatically resume operation once complete.

Scheduled low-impact maintenance for EU location

Jan <var data-var='date'>20</var>, <var data-var='time'>15:43</var> CET Resolved - The issue has been resolved and the PDF/Image rendering is working correctly again.Jan <var data-var='date'>20</var>, <var data-var='time'>15:27</var> CET Identified - The root cause has been identified and a fix is being deployed.Jan <var data-var='date'>20</var>, <var data-var='time'>15:02</var> CET Investigating - We are currently investigating an issue causing rendering of dashboards as PDF or image to fail

Investigating an issue rendering dashboard PDF/Image

Dec <var data-var='date'>11</var>, <var data-var='time'>11:27</var> CET Completed - The maintenance has been successfully completed and Cluvio is fully back online.Dec <var data-var='date'>11</var>, <var data-var='time'>11:01</var> CET In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.Dec <var data-var='date'> 7</var>, <var data-var='time'>16:10</var> CET Scheduled - We will be undergoing a scheduled maintenance. During the maintenance, the Cluvio app, sharing links and embeds will display a maintenance message and a countdown with the estimated remaining time, and will update automatically once the maintenance is complete. We expect the duration of the maintenance to be about 30 minutes.

Scheduled maintenance

Jul <var data-var='date'> 5</var>, <var data-var='time'>10:43</var> CEST Resolved - The email sending and dashboard exporting are working properly again. The slowdown was caused by clogging of the dashboard schedule job queue from an attempted abuse for distribution of spam. We have disabled the spamming account and will deploy better protection against this type of abuse later today.Jul <var data-var='date'> 5</var>, <var data-var='time'>10:18</var> CEST Investigating - We are investigating an issue with dashboard schedule emails being delayed and exporting PDF/PNG not completing

Sending schedules and exporting as PDF/PNG delayed

Jul <var data-var='date'> 2</var>, <var data-var='time'>22:38</var> CEST Resolved - The incident has been resolved and the Cluvio service is back to nominal.Jul <var data-var='date'> 2</var>, <var data-var='time'>19:52</var> CEST Monitoring - We have addressed the core issue of the slowdown and the service should be back to nominal for all customers, we will continue to monitor the situation closely.Jul <var data-var='date'> 2</var>, <var data-var='time'>13:30</var> CEST Investigating - We have been investigating serious performance issues, that affect most customers. The cause is still unknown, we will provide an update as soon as we know more.

Major service performance degradation and outage

Apr <var data-var='date'>12</var>, <var data-var='time'>13:47</var> CEST Resolved - The issue has been resolved and the service is fully restored. Apologies for the ~12-minute downtime!Apr <var data-var='date'>12</var>, <var data-var='time'>13:43</var> CEST Identified - We have identified the root cause of the issue and a fix is being deployedApr <var data-var='date'>12</var>, <var data-var='time'>13:38</var> CEST Investigating - We are currently investigating a database issue that affects the availability of Cluvio dashboards and API.

Cluvio service outage

Feb <var data-var='date'>18</var>, <var data-var='time'>10:28</var> CET Resolved - The query queue processing issues were identified and fixed, query execution now flows correctly again. Apologies for the issues!Feb <var data-var='date'>18</var>, <var data-var='time'>06:00</var> CET Investigating - Query queue processing is causing delays or internal errors for some customers.

Query queue processing is causing delays or internal errors for some customers.

Dec <var data-var='date'> 8</var>, <var data-var='time'>11:58</var> CET Resolved - This incident has been resolved.Dec <var data-var='date'> 8</var>, <var data-var='time'>10:38</var> CET Update - The performance is back to normal, we continue to monitor the server traffic and capacity.Dec <var data-var='date'> 8</var>, <var data-var='time'>09:45</var> CET Monitoring - We are currently investigating a reduced performance due to an unusual spike in usage, which we are addressing via increased server capacity while investigating the root cause.

Degraded performance of dashboards

Sep <var data-var='date'>30</var>, <var data-var='time'>17:22</var> CEST Resolved - This incident has been resolved.Sep <var data-var='date'>30</var>, <var data-var='time'>14:31</var> CEST Monitoring - A fix has been implemented and the performance is back to normal again, we will continue to investigate the root cause to avoid further service disruptions.Sep <var data-var='date'>30</var>, <var data-var='time'>14:07</var> CEST Investigating - We are investigating performance issues that reappeared.

Further performance issues

Sep <var data-var='date'>30</var>, <var data-var='time'>12:46</var> CEST Resolved - The performance issues have been resolved. Apologies for the ~22 mins of availability issues!Sep <var data-var='date'>30</var>, <var data-var='time'>12:23</var> CEST Identified - The issue has been identified and a fix is currently being deployed.Sep <var data-var='date'>30</var>, <var data-var='time'>12:19</var> CEST Investigating - We are currently investigating performance issues that cause the Clvuio dashboards to not load for most users.

Performance issues affecting most users

Sep <var data-var='date'> 4</var>, <var data-var='time'>20:30</var> CEST Resolved - This incident has been resolved.Sep <var data-var='date'> 4</var>, <var data-var='time'>18:29</var> CEST Monitoring - Our monitoring shows performance has returned to nominal for all customers, we are continuing to monitor the situation.Sep <var data-var='date'> 4</var>, <var data-var='time'>18:20</var> CEST Identified - We have identified the issue and a fix has been deployed, the performance should return to nominal in the next 10 minutes.Sep <var data-var='date'> 4</var>, <var data-var='time'>18:06</var> CEST Update - We are continuing to investigate this issue.Sep <var data-var='date'> 4</var>, <var data-var='time'>17:40</var> CEST Investigating - We are currently investigating intermittent performance issues with our main database cluster, affecting the performance of dashboards for most customers

Investigating intermittent performance issues on Cluvio backend

Jul <var data-var='date'>28</var>, <var data-var='time'>19:09</var> CEST Resolved - This incident has been resolved.Jul <var data-var='date'>28</var>, <var data-var='time'>19:05</var> CEST Monitoring - The fix has been applied and performance is back to nominal for all customers. We will continue to closely monitor the systems.Jul <var data-var='date'>28</var>, <var data-var='time'>18:59</var> CEST Identified - We identified the root cause of the issue in a database cluster and a fix is being applied, we expect the availability back to normal in the next 5-10 minutes.Jul <var data-var='date'>28</var>, <var data-var='time'>18:53</var> CEST Investigating - We are currently investigating server-side problems affecting the availability of Cluvio for most customers.

Intermittent availability issues

Jun <var data-var='date'> 2</var>, <var data-var='time'>15:27</var> CEST Resolved - The fix has been deployed and the performance is fully restored. We will continue to monitor the situation, apologies for the issues.Jun <var data-var='date'> 2</var>, <var data-var='time'>15:15</var> CEST Identified - The performance impact was caused by a change recently deployed, we are in the process of deploying a fix, which should finish in ~10 minutes. In the meantime a database-level mitigation was performed to reduce the latency, so the performance will be back to normal until the fix is deployed.Jun <var data-var='date'> 2</var>, <var data-var='time'>15:15</var> CEST Update - The performance impact was caused by a change recently deployed, we are in the process of deploying a fix, which should finish in ~10 minutes. In the meantime a database-level mitigation was performed to reduce the latency, so the performance will be back to normal until the fix is deployed.Jun <var data-var='date'> 2</var>, <var data-var='time'>14:52</var> CEST Investigating - We are currently investigating reduced performance accessing dashboards

Performance degradation

Apr <var data-var='date'>30</var>, <var data-var='time'>12:04</var> CEST Resolved - The database issue has been now correctly identified and fully resolved. The performance should be back to normal for all customers. We will continue to monitor the situation, apologies for the issues.Apr <var data-var='date'>30</var>, <var data-var='time'>11:41</var> CEST Identified - We are continuing to investigate performance issues loading and displaying dashboards.

Intermittent performance issues loading dashboards

Apr <var data-var='date'>30</var>, <var data-var='time'>10:30</var> CEST Resolved - We have identified and resolved a performance issue that was causing long load times for dashboards

Long load times for dashboards

Mar <var data-var='date'>24</var>, <var data-var='time'>16:41</var> CET Resolved - We have resolved the issue with a primary database that was causing the performance degradation and the operation is back to normal. We will continue to monitor the situation, apologies for the issues.Mar <var data-var='date'>24</var>, <var data-var='time'>16:01</var> CET Identified - We are investigating an issue that causes increased error rate and latency for Cluvio dashboards.

Increased error rate and latency

Feb <var data-var='date'>22</var>, <var data-var='time'>19:01</var> CET Resolved - The bugfix has been deployed and all dashboard schedules will work correctly again, we apologize for the inconvenience.Feb <var data-var='date'>22</var>, <var data-var='time'>18:45</var> CET Identified - We discovered a bug in a new code deployed earlier today that caused a small number of dashboard schedules to be sent without the rendered image / PDF. A bugfix is ready and being deployed.

Small number of dashboard schedules are sent without rendered PDF

Dec <var data-var='date'>19</var>, <var data-var='time'>16:30</var> CET Resolved - We fixed and issue that was causing random degraded performance for loading dashboards and that has been occurring over last 48 hours.  The performance is now back to normal.

Is Cluvio down?

Cluvio status is UP

Lastest published events

Database Maintenance

Intermittent DNS Resolution issues

Database maintenance

Cluvio Services, Components and Regions

Recent Cluvio events

Database Maintenance

Intermittent DNS Resolution issues

Database maintenance

Database Maintenance

Database Maintenance

Cluvio Database Maintenance

Get your FREE account now,
5 monitors included!

Is Cluvio down?

Cluvio status is UP

Lastest published events

Database Maintenance

Intermittent DNS Resolution issues

Database maintenance

Cluvio Services, Components and Regions

Recent Cluvio events

Database Maintenance

Intermittent DNS Resolution issues

Database maintenance

Database Maintenance

Database Maintenance

Cluvio Database Maintenance

Get your FREE account now,5 monitors included!

Get your FREE account now,
5 monitors included!