Aug <var data-var='date'>13</var>, <var data-var='time'>12:18</var> PDT Resolved - This incident has been resolved. Aug <var data-var='date'>12</var>, <var data-var='time'>14:04</var> PDT Investigating - We are currently investigating issues with Iron dashboard (hud-e). IronMQ, IronWorker and IronCache services should work fine. If you have any questions - write us to support@iron.io

HUD-e outage

May <var data-var='date'>28</var>, <var data-var='time'>02:00</var> PDT Completed - The scheduled maintenance has been completed. May <var data-var='date'>27</var>, <var data-var='time'>22:00</var> PDT In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary. May <var data-var='date'>25</var>, <var data-var='time'>15:08</var> PDT Scheduled - Our network provider will be performing a router hardware upgrade to improve security and stability. While we do not expect extended downtime, there may be brief connectivity interruptions during the maintenance

Infrastructure Maintenance

Jan <var data-var='date'>26</var>, <var data-var='time'>13:36</var> PST Resolved - This incident has been resolved. Jan <var data-var='date'>18</var>, <var data-var='time'>22:01</var> PST Update - We are continuing to monitor for any further issues. Jan <var data-var='date'>18</var>, <var data-var='time'>22:01</var> PST Monitoring - A fix has been implemented and we are monitoring the results. Jan <var data-var='date'>18</var>, <var data-var='time'>14:47</var> PST Investigating - We are experiencing issues with upstream provider. Currently in touch with them.

IronWorker degraded performance

Oct <var data-var='date'>18</var>, <var data-var='time'>00:09</var> PDT Completed - The scheduled maintenance has been completed. Oct <var data-var='date'>16</var>, <var data-var='time'>06:06</var> PDT In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary. Oct <var data-var='date'>16</var>, <var data-var='time'>06:05</var> PDT Scheduled - We will be undergoing scheduled maintenance during this time.

IronMQ Maintenance (public cluster)

Sep <var data-var='date'>29</var>, <var data-var='time'>13:05</var> PDT Completed - The scheduled maintenance has been completed. Sep <var data-var='date'>28</var>, <var data-var='time'>04:00</var> PDT In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary. Sep <var data-var='date'>27</var>, <var data-var='time'>07:54</var> PDT Scheduled - Our cloud provider will be upgrading the Kubernetes version on the infrastructure where our IronWorker and IronCache services are running. We may expect some minor instability during the maintenance.

IronWorker and IronCache Maintenance

Jul <var data-var='date'>13</var>, <var data-var='time'>15:00</var> PDT Completed - The scheduled maintenance has been completed. Jul <var data-var='date'>13</var>, <var data-var='time'>12:00</var> PDT In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary. Jul <var data-var='date'>13</var>, <var data-var='time'>07:52</var> PDT Scheduled - Our cloud provider will be upgrading the infrastructure. We expect a possible 5-10 mins downtime.

Apr <var data-var='date'>19</var>, <var data-var='time'>03:49</var> PDT Resolved - This incident has been resolved. Apr <var data-var='date'>16</var>, <var data-var='time'>16:38</var> PDT Monitoring - A fix has been implemented and we are monitoring the results Apr <var data-var='date'>16</var>, <var data-var='time'>15:57</var> PDT Investigating - We are currently investigating this issue.

Mar <var data-var='date'>30</var>, <var data-var='time'>07:18</var> PDT Completed - The scheduled maintenance has been completed. Mar <var data-var='date'>29</var>, <var data-var='time'>10:36</var> PDT Scheduled - New IronWorker backend has been deployed

IronWorker Maintenance

Feb <var data-var='date'> 6</var>, <var data-var='time'>12:10</var> PST Completed - The scheduled maintenance has been completed. Feb <var data-var='date'> 6</var>, <var data-var='time'>02:05</var> PST Scheduled - We will be undergoing scheduled maintenance during this time.

IronMQ Infrastructure Improvements

Feb <var data-var='date'> 1</var>, <var data-var='time'>20:56</var> PST Resolved - Our engineering team is actively resolving the situation, and undertaking necessary steps to recover the system. We expect to post an update momentarily.

IronCache issue

Mar <var data-var='date'>16</var>, <var data-var='time'>07:57</var> PDT Resolved - This incident has been resolved. Mar <var data-var='date'>16</var>, <var data-var='time'>05:04</var> PDT Update - We are continuing to monitor for any further issues. Mar <var data-var='date'>16</var>, <var data-var='time'>04:54</var> PDT Monitoring - A fix has been implemented and we are monitoring the results. Mar <var data-var='date'>16</var>, <var data-var='time'>04:45</var> PDT Investigating - We are currently investigating this issue.

IronWorker and IronMQ Outage

Jan <var data-var='date'>27</var>, <var data-var='time'>16:15</var> PST Completed - The scheduled maintenance has been completed. Jan <var data-var='date'>27</var>, <var data-var='time'>16:00</var> PST In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary. Jan <var data-var='date'>27</var>, <var data-var='time'>15:57</var> PST Scheduled - Our IronWorker "Scheduled Tasks" service will be migrated to new infrastructure. During the maintenance our api will work fine but there can be small delays while processing "Scheduled Tasks".

IronWorker Maintenance ("Scheduled Tasks" service)

Dec <var data-var='date'>13</var>, <var data-var='time'>13:59</var> PST Resolved - Iron has completed a review of its systems and the Log4j security issue does not affect Iron's services.

Log4j System Analysis

Oct <var data-var='date'> 5</var>, <var data-var='time'>17:36</var> PDT Resolved - This incident has been resolved. Oct <var data-var='date'> 5</var>, <var data-var='time'>17:22</var> PDT Monitoring - A fix has been implemented and we are monitoring the results. Oct <var data-var='date'> 5</var>, <var data-var='time'>17:16</var> PDT Identified - The issue has been identified and a fix is being implemented.

IronWorker Degraded Performance

Sep <var data-var='date'> 7</var>, <var data-var='time'>09:12</var> PDT Resolved - This incident has been resolved. Sep <var data-var='date'> 7</var>, <var data-var='time'>07:35</var> PDT Monitoring - A fix has been implemented and we are monitoring the results. Sep <var data-var='date'> 7</var>, <var data-var='time'>05:58</var> PDT Investigating - IronWorker customers may experience delays while pushing the tasks. We are currently investigating the issue.

Jun <var data-var='date'>26</var>, <var data-var='time'>22:51</var> PDT Resolved - This incident has been resolved. Jun <var data-var='date'>26</var>, <var data-var='time'>20:37</var> PDT Investigating - We are currently investigating this issue.

IronWorker outage

Apr <var data-var='date'> 8</var>, <var data-var='time'>12:08</var> PDT Completed - The scheduled maintenance has been completed. Apr <var data-var='date'> 1</var>, <var data-var='time'>06:24</var> PDT Scheduled - Our Amazon RDS DB instances are scheduled to receive maintenance on the underlying hardware. This database stores logins, passwords, tokens and other important information about our customers. During the maintenance our api can respond with HTTP 401 "invalid project/token combination".

Database Maintenance

Mar <var data-var='date'>13</var>, <var data-var='time'>23:21</var> PST Resolved - IronWorker customers could experience issues while pushing tasks to Public Cluster on March 14 between 12:00 am UTC and 6:30 am UTC. We've resolved the issue. Our development team is monitoring the situation.

Mar <var data-var='date'> 3</var>, <var data-var='time'>01:30</var> PST Resolved - Amazon performed an upgrade of our PostgreSQL DB version. This DB stores logins, passwords, tokens and other information about our customers. While upgrading they shutted down the database instance, performed the upgrade, and restarted the database instance. As a result, you could see HTTP 401 errors in your logs between 09:28 am UTC and 09:45 am UTC. Here is more information: https://forums.aws.amazon.com/ann.jspa?annID=8176

Database Upgrade

Dec <var data-var='date'>10</var>, <var data-var='time'>07:01</var> PST Completed - The scheduled maintenance has been completed. Dec <var data-var='date'>10</var>, <var data-var='time'>03:21</var> PST In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary. Dec <var data-var='date'>10</var>, <var data-var='time'>03:20</var> PST Scheduled - During the maintenance, none of the messages will be lost and there will be no downtime.

Apr <var data-var='date'>30</var>, <var data-var='time'>16:00</var> PDT Resolved - On May 1, at 11 am UTC we identified the issue with our autoscale functionality: there were errors while starting our IronWorker service on new instances but it was working fine on existing ones. After investigating into the errors thrown, we found the issue was happening while pulling our docker images from DockerHub. The root cause was problems on dockerhub side information about which you can find on their status page: https://status.docker.com/ In order to resolve the issue, we have manually launched our service on new instances and temporarily disabled the autoscale functionality.

Oct <var data-var='date'>25</var>, <var data-var='time'>04:53</var> PDT Resolved - This incident has been resolved. Oct <var data-var='date'>25</var>, <var data-var='time'>04:53</var> PDT Identified - The issue has been identified and a fix is being implemented. Oct <var data-var='date'>25</var>, <var data-var='time'>04:00</var> PDT Investigating - We are currently investigating this issue.

IronCache Issue

Jul <var data-var='date'>29</var>, <var data-var='time'>02:16</var> PDT Completed - The scheduled maintenance has been completed. Jul <var data-var='date'>29</var>, <var data-var='time'>00:00</var> PDT In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary. Jul <var data-var='date'>24</var>, <var data-var='time'>15:19</var> PDT Scheduled - This maintenance should not generate any downtime, but services may be taken down for up to an hour in an emergency situation. In the case of necessary downtime, another notification will be sent out. We're migrating IronCache service to Amazon's DocumentDB. We've been working closely with the AWS team to make this happen. The internal benefits are heightened security by moving yet another service under the AWS Cloud Security umbrella. Externally, there will be a small performance benefit for our customers as we'll be dealing with a lower latency network configuration and an optimized query engine.

IronCache Infrastructure Improvements

Jul <var data-var='date'>17</var>, <var data-var='time'>00:34</var> PDT Completed - The scheduled maintenance has been completed. Jul <var data-var='date'>17</var>, <var data-var='time'>00:01</var> PDT In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary. Jun <var data-var='date'>18</var>, <var data-var='time'>12:45</var> PDT Scheduled - This maintenance should not generate any downtime, but services may be taken down for up to an hour in an emergency situation. In the case of necessary downtime, another notification will be sent out. We're migrating the rest of our third-party hosted MongoDB services to Amazon's DocumentDB. We've been working closely with the AWS team to make this happen. The internal benefits are heightened security by moving yet another service under the AWS Cloud Security umbrella. Externally, there will be a small performance benefit for our customers as we'll be dealing with a lower latency network configuration and an optimized query engine. We appreciate your support as we make moves to improve the Iron platform!

Iron Infrastructure Improvements

Jul <var data-var='date'> 9</var>, <var data-var='time'>15:51</var> PDT Resolved - This incident has been resolved. Jul <var data-var='date'> 9</var>, <var data-var='time'>15:49</var> PDT Identified - The issue has been identified and a fix is being implemented. Jul <var data-var='date'> 9</var>, <var data-var='time'>14:17</var> PDT Investigating - We are currently investigating this issue.

Is Iron.io down?

Iron.io status is UP

Lastest published events

HUD-e outage

Infrastructure Maintenance

IronWorker degraded performance

Iron.io Services, Components and Regions

Recent Iron.io events

HUD-e outage

Infrastructure Maintenance

IronWorker degraded performance

IronMQ Maintenance (public cluster)

IronWorker and IronCache Maintenance

Infrastructure Maintenance