Nov <var data-var='date'> 5</var>, <var data-var='time'>04:54</var> UTC Completed - The scheduled maintenance has been completed.Nov <var data-var='date'> 5</var>, <var data-var='time'>04:53</var> UTC Update - We are continuing to verify the maintenance items.Nov <var data-var='date'> 5</var>, <var data-var='time'>04:51</var> UTC Verifying - Verification is currently underway for the maintenance items.Nov <var data-var='date'> 5</var>, <var data-var='time'>04:45</var> UTC In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.Nov <var data-var='date'> 5</var>, <var data-var='time'>04:36</var> UTC Scheduled - We will be restarting postgres db for cloudbees unify to enable pg_cron

Postgres DB Restart

Oct <var data-var='date'>20</var>, <var data-var='time'>10:52</var> UTC Resolved - This incident has been resolved.Oct <var data-var='date'>20</var>, <var data-var='time'>10:19</var> UTC Monitoring - Some components might experience slowness due to issue with upstream Cloud Provider. We are working on mitigations

Cloud Provider issues affecting our services

Oct <var data-var='date'> 5</var>, <var data-var='time'>08:30</var> UTC Resolved - Customer(s) could not login to the https://app.rollout.io/cloudbees/login due to an FM outage

Customer(s) could not login to the https://app.rollout.io/cloudbees/login

Sep <var data-var='date'>26</var>, <var data-var='time'>16:30</var> UTC Resolved - We're experiencing an elevated level of API errors related to the timescale database outage. https://status.timescale.com/

CloudBees Feature Management analytics

Jul <var data-var='date'>16</var>, <var data-var='time'>02:45</var> UTC Resolved - Incident has been migrated to cloudbeesstatus.io status site - https://www.cloudbeesstatus.io/Jul <var data-var='date'>16</var>, <var data-var='time'>02:35</var> UTC Investigating - We are currently investigating an issue in delivering services on the CloudBees platform

Platform services down

Jun <var data-var='date'> 7</var>, <var data-var='time'>16:11</var> UTC Resolved - We have verified our fix is working.Jun <var data-var='date'> 7</var>, <var data-var='time'>15:49</var> UTC Monitoring - A fix has been implemented and we are monitoring the results.Jun <var data-var='date'> 7</var>, <var data-var='time'>15:49</var> UTC Update - We are continuing to investigate this issue.Jun <var data-var='date'> 7</var>, <var data-var='time'>14:32</var> UTC Update - We have identified the root cause of the issue and working towards a fix. Logins are currently working.Jun <var data-var='date'> 7</var>, <var data-var='time'>14:18</var> UTC Investigating - We are receiving errors affecting logins. We are currently investigating with our provider.

Issues with authentication

Jun <var data-var='date'> 7</var>, <var data-var='time'>14:44</var> UTC Resolved - A configuration setting caused specific traffic to be rejected by our firewall, causing issues with authentication. The problem has been corrected and the incident is now resolved.Jun <var data-var='date'> 7</var>, <var data-var='time'>14:34</var> UTC Update - Logins to the web interface are working again. We are continuing to investigate.Jun <var data-var='date'> 7</var>, <var data-var='time'>14:16</var> UTC Investigating - We are aware that there are issues logging in to the CloudBees Feature Management web interface. We are investigating.

Can't log in to the CloudBees Feature Management web interface.

Mar <var data-var='date'>13</var>, <var data-var='time'>16:52</var> UTC Resolved - This incident has been resolved.Mar <var data-var='date'>13</var>, <var data-var='time'>16:45</var> UTC Monitoring - Our provider has implemented a fix and we are monitoring.Mar <var data-var='date'>13</var>, <var data-var='time'>16:10</var> UTC Investigating - We are seeing extreme latency and timeouts on our authentication service that is causing login failures. We are currently investigating this with our provider.

Authentication latency and timeouts

Dec <var data-var='date'> 3</var>, <var data-var='time'>04:30</var> UTC Resolved - Earlier today, for a few hours, we experienced an infrastructure problem which effected flag updates This problem is now fixed, and all flags should be updated with the latest configurations

Problem updating configurations

Nov <var data-var='date'>17</var>, <var data-var='time'>14:43</var> UTC Resolved - This incident has been resolved.Nov <var data-var='date'>17</var>, <var data-var='time'>11:28</var> UTC Monitoring - We have found the cause of the connectivity problems and applied a fix. The web interface and API are fully functional again and we will continue to monitor.Nov <var data-var='date'>17</var>, <var data-var='time'>10:34</var> UTC Identified - We have identified some connectivity (DNS) errors in our infrastructure and are working on a fix for this.Nov <var data-var='date'>17</var>, <var data-var='time'>09:59</var> UTC Update - On further investigation, some API requests are failing. We are continuing to investigate the cause and identify a solution!Nov <var data-var='date'>17</var>, <var data-var='time'>09:24</var> UTC Update - The CloudBees Feature Management API is operating normally. Whilst the web interface is unavailable, you can continue to make updates to Flags using the API: https://docs.cloudbees.com/docs/cloudbees-feature-management-rest-api/latest/introductionNov <var data-var='date'>17</var>, <var data-var='time'>09:20</var> UTC Investigating - We are aware of a problem logging into CloudBees Feature Management and are investigating the cause. Flag use by SDK and delivery of your targeting is unaffected.

Unable to login to CloudBees Feature Management

Nov <var data-var='date'>17</var>, <var data-var='time'>14:43</var> UTC Resolved - This incident has been resolved.Nov <var data-var='date'>17</var>, <var data-var='time'>14:42</var> UTC Monitoring - We have identified the source of the problems that required taking analytics offline temporarily. Analytics functionality is now restored.Nov <var data-var='date'>17</var>, <var data-var='time'>11:32</var> UTC Investigating - Following the earlier incident with the CloudBees Feature Management web interface, the impression analytics capability is temporarily offline whilst we investigate infrastructure problems.

CloudBees Feature Management impression recording suspended

Nov <var data-var='date'>11</var>, <var data-var='time'>14:52</var> UTC Resolved - All systems healthy again, and this incident is now resolved.Nov <var data-var='date'>11</var>, <var data-var='time'>14:39</var> UTC Monitoring - We have identified the source of the issue and resolved it. User login is back to stable behavior, and currently monitoring before closing the incident.Nov <var data-var='date'>11</var>, <var data-var='time'>13:53</var> UTC Update - We are continuing to investigate this issue.Nov <var data-var='date'>11</var>, <var data-var='time'>13:48</var> UTC Investigating - We have noticed sporadic failures in user login to our website app.cloudbees.com and Zendesk. Other apps such as app.rollout.io do not seem affected, but we're determining the extent of this issue.

Failures on User Login

Sep <var data-var='date'> 9</var>, <var data-var='time'>19:29</var> UTC Resolved - This incident has been resolved.Sep <var data-var='date'> 9</var>, <var data-var='time'>16:06</var> UTC Update - We are continuing to investigate this issue.Sep <var data-var='date'> 9</var>, <var data-var='time'>15:47</var> UTC Investigating - CloudBees Feature Management functionality is degraded due to an AWS outage. Affected are: - Delivery of flags configuration updates - GitHub Configuration-as-Code - Subscription management We, and Amazon are investigating.

CloudBees Feature Management

Sep <var data-var='date'> 3</var>, <var data-var='time'>18:37</var> UTC Completed - The scheduled maintenance has been completed.Sep <var data-var='date'> 3</var>, <var data-var='time'>17:00</var> UTC In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.Sep <var data-var='date'> 3</var>, <var data-var='time'>16:56</var> UTC Scheduled - Authentication may be unavailable during this window.

Scheduled authentication maintenance

Jul <var data-var='date'>20</var>, <var data-var='time'>19:19</var> UTC Resolved - Fix for the root cause has been rolled out to production. Email verification is working for all users again.Jul <var data-var='date'>20</var>, <var data-var='time'>16:54</var> UTC Investigating - We've found out that re-sending the email via the button in email-verify page is continuously throwing an error, impacting new users signing up who click it. We've identified the root cause and rolling out a fix.

Email-verification page having issues with re-send email button

Jun <var data-var='date'>21</var>, <var data-var='time'>07:25</var> UTC Resolved - This incident has been resolved.Jun <var data-var='date'>21</var>, <var data-var='time'>07:22</var> UTC Monitoring - A fix has been implemented and CloudFlare is monitoring the results.Jun <var data-var='date'>21</var>, <var data-var='time'>07:01</var> UTC Identified - The issue has been identified and a fix is being implemented.Jun <var data-var='date'>21</var>, <var data-var='time'>06:59</var> UTC Investigating - Cloudflare is investigating wide-spread issues with their services and/or network. Users may experience errors or timeouts reaching Cloudflare’s network or services.

Cloudflare Service Issues

May <var data-var='date'>25</var>, <var data-var='time'>15:30</var> UTC Resolved - This incident has been resolved.May <var data-var='date'>25</var>, <var data-var='time'>15:14</var> UTC Monitoring - A fix has been implemented and we are monitoring the results.May <var data-var='date'>25</var>, <var data-var='time'>15:04</var> UTC Investigating - We are currently investigating this issue.

CloudBees Feature Management Dashboard is not loading

May <var data-var='date'>19</var>, <var data-var='time'>15:48</var> UTC Resolved - This incident has been resolved.May <var data-var='date'>19</var>, <var data-var='time'>15:08</var> UTC Update - We are continuing to investigate this issue.May <var data-var='date'>19</var>, <var data-var='time'>15:07</var> UTC Investigating - We are in the process of running a short production infrastructure test that may result in flag impression metrics/analytics not updating for a short time period. We do not expect this to last for more than 15 to 30 minutes. During this time all other services will function as normal. We apologize in advance for any inconvenience caused.

Flag impression metrics/analytics may stop counting for a brief time period

Apr <var data-var='date'>11</var>, <var data-var='time'>15:06</var> UTC Resolved - This incident has been resolved.Apr <var data-var='date'>11</var>, <var data-var='time'>14:59</var> UTC Monitoring - A fix has been implemented and we are monitoring the results.Apr <var data-var='date'>11</var>, <var data-var='time'>14:15</var> UTC Identified - New feature flag configuration changes are not being propagated to SDK clients.

Feature flag configurations not propagating to SDK clients

Mar <var data-var='date'> 8</var>, <var data-var='time'>09:24</var> UTC Resolved - This incident has been resolved.Mar <var data-var='date'> 8</var>, <var data-var='time'>08:09</var> UTC Investigating - Advisor is under maintenance.

Advisor GCP Migration

Dec <var data-var='date'>24</var>, <var data-var='time'>05:35</var> UTC Resolved - This incident has been resolved.Dec <var data-var='date'>24</var>, <var data-var='time'>03:43</var> UTC Monitoring - We performed percussive maintenance on some of our infrastructure, and are now monitoring the system.Dec <var data-var='date'>23</var>, <var data-var='time'>22:50</var> UTC Investigating - We are investigating intermittent issues with the web interface for the DevOptics platform.

DevOptics intermittent issues

Dec <var data-var='date'>15</var>, <var data-var='time'>16:19</var> UTC Resolved - This incident has been resolved.Dec <var data-var='date'>15</var>, <var data-var='time'>16:13</var> UTC Monitoring - Now monitoring major providers statusDec <var data-var='date'>15</var>, <var data-var='time'>16:05</var> UTC Identified - Issue caused by major providers outageDec <var data-var='date'>15</var>, <var data-var='time'>15:57</var> UTC Update - We are continuing to investigate this issue.Dec <var data-var='date'>15</var>, <var data-var='time'>15:47</var> UTC Investigating - There has been a provider outage and we're investigating right now. Currently our authentication service is down, affecting the web interface for most of our products.

Major provider outage

Dec <var data-var='date'> 7</var>, <var data-var='time'>22:02</var> UTC Resolved - This incident has been resolved.Dec <var data-var='date'> 7</var>, <var data-var='time'>19:56</var> UTC Update - Some Feature Management services are beginning to return to normal. We are continuing to work on this.Dec <var data-var='date'> 7</var>, <var data-var='time'>19:54</var> UTC Update - Some Feature Management services are beginning to return to normal. We are continuing to work on this.Dec <var data-var='date'> 7</var>, <var data-var='time'>16:35</var> UTC Identified - Some Feature Management services are beginning to return to normal. Working to restore the rest.

Feature Management partially down

Nov <var data-var='date'>23</var>, <var data-var='time'>01:23</var> UTC Resolved - A fix for the underlying issue has been released and the system is now performing normally.Nov <var data-var='date'>23</var>, <var data-var='time'>00:15</var> UTC Identified - The root cause has been identified - a fix is being developed.Nov <var data-var='date'>22</var>, <var data-var='time'>23:32</var> UTC Investigating - The CloudBees CI update center (jenkins-updates.cloudbees.com) is timing out due to increased load. Engineers are working to resolve the issue.

CloudBees CI Update Center timing out

Sep <var data-var='date'>28</var>, <var data-var='time'>16:18</var> UTC Resolved - This incident has been resolved.Sep <var data-var='date'>28</var>, <var data-var='time'>16:10</var> UTC Update - EU is recovering and error rates are less than 1%. US-1 is still experiencing partial outage. Our team is working on mitigation actions and estimated time for resolution. We apologize for the impact this is having on you and your users. Next update will be in 15 minutesSep <var data-var='date'>28</var>, <var data-var='time'>16:09</var> UTC Update - We are continuing to investigate this issue.Sep <var data-var='date'>28</var>, <var data-var='time'>16:04</var> UTC Investigating - Investigating elevated login error rate

Is CloudBees down?

CloudBees status is UP

Lastest published events

Postgres DB Restart

Cloud Provider issues affecting our services

Customer(s) could not login to the https://app.rollout.io/cloudbees/login

CloudBees Services, Components and Regions

Recent CloudBees events

Postgres DB Restart

Cloud Provider issues affecting our services

Customer(s) could not login to the https://app.rollout.io/cloudbees/login

CloudBees Feature Management analytics

Platform services down

Issues with authentication

Get your FREE account now,
5 monitors included!

Is CloudBees down?

CloudBees status is UP

Lastest published events

Postgres DB Restart

Cloud Provider issues affecting our services

Customer(s) could not login to the https://app.rollout.io/cloudbees/login

CloudBees Services, Components and Regions

Recent CloudBees events

Postgres DB Restart

Cloud Provider issues affecting our services

Customer(s) could not login to the https://app.rollout.io/cloudbees/login

CloudBees Feature Management analytics

Platform services down

Issues with authentication

Get your FREE account now,5 monitors included!

Get your FREE account now,
5 monitors included!