Aug <var data-var='date'>25</var>, <var data-var='time'>06:17</var> UTC Resolved - High 500 rates on SkillEngine API across all environments between 6:17 and 6:43 UTC.

Elevated API Errors

Jul <var data-var='date'>22</var>, <var data-var='time'>10:00</var> UTC Completed - The scheduled maintenance has been completed. Jul <var data-var='date'>22</var>, <var data-var='time'>08:00</var> UTC In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary. Jul <var data-var='date'> 7</var>, <var data-var='time'>07:28</var> UTC Scheduled - We will be undergoing scheduled maintenance during this time.

Skillengine API Database Upgrade

Mar <var data-var='date'> 6</var>, <var data-var='time'>10:28</var> UTC Resolved - This incident has been resolved. Mar <var data-var='date'> 6</var>, <var data-var='time'>09:15</var> UTC Update - We are continuing to monitor for any further issues. Mar <var data-var='date'> 6</var>, <var data-var='time'>09:15</var> UTC Monitoring - A fix has been applied and we are in monitoring mode. If you still encounter authentication issues, click on the "logging in" link in the error message. Mar <var data-var='date'> 6</var>, <var data-var='time'>08:41</var> UTC Identified - The issue has been identified and a fix is being implemented. Mar <var data-var='date'> 6</var>, <var data-var='time'>07:58</var> UTC Investigating - We are currently investigating the issue.

TechWolf Console authentication issues

Feb <var data-var='date'>16</var>, <var data-var='time'>11:05</var> UTC Completed - The scheduled maintenance has been completed. Feb <var data-var='date'>16</var>, <var data-var='time'>10:00</var> UTC In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary. Feb <var data-var='date'> 2</var>, <var data-var='time'>08:29</var> UTC Scheduled - We will be undergoing scheduled maintenance during this time.

Nov <var data-var='date'>18</var>, <var data-var='time'>20:08</var> UTC Resolved - This incident has been resolved. Nov <var data-var='date'>18</var>, <var data-var='time'>16:00</var> UTC Monitoring - The root cause has been identified as an issue with JWK hosting by our authentication provider. The issue has been mitigated and all services are now operational. We continue to monitor the situation closely. Nov <var data-var='date'>18</var>, <var data-var='time'>15:27</var> UTC Investigating - All requests to SEAPI fail for US tenants with 401 Unauthorized. Engineers are looking into the root cause, more information will be provided when available.

US SEAPI requests fail with 401 Unauthorized

Oct <var data-var='date'>21</var>, <var data-var='time'>06:18</var> UTC Resolved - This incident has been resolved. Oct <var data-var='date'>20</var>, <var data-var='time'>16:39</var> UTC Monitoring - Standard exports and Skill Assistant suggestions can suffer from degraded performance for US customers. More information about the AWS incident can be found at the following URL: https://health.aws.amazon.com/health/status?eventID=arn:aws:health:us-east-1::event/MULTIPLE_SERVICES/AWS_MULTIPLE_SERVICES_OPERATIONAL_ISSUE/AWS_MULTIPLE_SERVICES_OPERATIONAL_ISSUE_BA540_514A652BE1A

Degraded performance for Standard Exports and Skill Assistant for US customers

Oct <var data-var='date'>20</var>, <var data-var='time'>07:00</var> UTC Resolved - A major outage impacted multiple services for US-based customers due to an incident with our cloud provider, AWS. The disruption originated from an issue in AWS DynamoDB, which became temporarily unavailable. As several of our systems rely on DynamoDB for core operations, this led to widespread service degradation and unavailability during the incident window. AWS has since resolved the underlying problem, and all services have been restored to normal operation. More information about the AWS incident can be found at the following URL: https://health.aws.amazon.com/health/status?eventID=arn:aws:health:us-east-1::event/MULTIPLE_SERVICES/AWS_MULTIPLE_SERVICES_OPERATIONAL_ISSUE/AWS_MULTIPLE_SERVICES_OPERATIONAL_ISSUE_BA540_514A652BE1A

Major outage across services for US customers

Oct <var data-var='date'> 3</var>, <var data-var='time'>08:36</var> UTC Resolved - This incident has been resolved. Oct <var data-var='date'> 3</var>, <var data-var='time'>08:29</var> UTC Update - We are continuing to monitor for any further issues. Oct <var data-var='date'> 3</var>, <var data-var='time'>08:27</var> UTC Monitoring - The issue affecting our EU environment has been resolved. Root cause was identified and a fix has been implemented. All services are now fully accessible. No further impact expected, we will continue monitoring. Oct <var data-var='date'> 3</var>, <var data-var='time'>08:24</var> UTC Identified - The issue has been identified and a fix is being implemented. Oct <var data-var='date'> 3</var>, <var data-var='time'>08:20</var> UTC Investigating - We are currently experiencing an outage in our EU environment. Services in this region are inaccessible. Our engineering team is investigating the issue.

EU environment is currently inaccessible

Sep <var data-var='date'> 2</var>, <var data-var='time'>07:23</var> UTC Completed - The scheduled maintenance has been completed. Sep <var data-var='date'> 2</var>, <var data-var='time'>07:21</var> UTC Verifying - Verification is currently underway for the maintenance items. Sep <var data-var='date'> 2</var>, <var data-var='time'>07:00</var> UTC In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary. Aug <var data-var='date'>25</var>, <var data-var='time'>14:29</var> UTC Scheduled - We will be undergoing scheduled maintenance during this time.

Skill Engine API Database upgrade

Aug <var data-var='date'>21</var>, <var data-var='time'>19:59</var> UTC Resolved - Failure rates have subsided. Aug <var data-var='date'>21</var>, <var data-var='time'>19:15</var> UTC Monitoring - Authentication failures may occur during login attempts due to issues on the side of our authentication provider in our US region https://status.auth0.com/incidents/pmsqxcfwfk00

Degraded authentication performance

Apr <var data-var='date'>17</var>, <var data-var='time'>17:00</var> UTC Completed - The scheduled maintenance has been completed. Apr <var data-var='date'>17</var>, <var data-var='time'>16:00</var> UTC In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary. Apr <var data-var='date'>14</var>, <var data-var='time'>13:00</var> UTC Update - We will be undergoing scheduled maintenance during this time. Apr <var data-var='date'>14</var>, <var data-var='time'>13:00</var> UTC Scheduled - We will be undergoing maintenance during this period. Due to the maintenance, expect downtime or login issues on all affected components.

Authentication maintenance EU

Apr <var data-var='date'>17</var>, <var data-var='time'>09:00</var> UTC Completed - The scheduled maintenance has been completed. Apr <var data-var='date'>17</var>, <var data-var='time'>08:00</var> UTC In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary. Apr <var data-var='date'>14</var>, <var data-var='time'>12:57</var> UTC Update - We will be undergoing maintenance during this period. Due to the maintenance, expect downtime or login issues on all affected components. Apr <var data-var='date'>14</var>, <var data-var='time'>12:56</var> UTC Scheduled - We will be undergoing maintenance during this period. Due to the maintenance, expect downtime or login issues on all affected components.

Authentication maintenance US

Jan <var data-var='date'>15</var>, <var data-var='time'>08:21</var> UTC Completed - The scheduled maintenance has been completed. Jan <var data-var='date'>15</var>, <var data-var='time'>08:20</var> UTC Update - Scheduled maintenance is still in progress. We will provide updates as necessary. Jan <var data-var='date'>15</var>, <var data-var='time'>08:00</var> UTC In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary. Jan <var data-var='date'> 7</var>, <var data-var='time'>15:12</var> UTC Scheduled - We will be undergoing scheduled maintenance during this time to upgrade our database.

Database upgrade US environment

Jul <var data-var='date'>28</var>, <var data-var='time'>19:09</var> UTC Completed - The scheduled maintenance has been completed. Jul <var data-var='date'>28</var>, <var data-var='time'>18:20</var> UTC Verifying - Verification is currently underway for the maintenance items. Jul <var data-var='date'>28</var>, <var data-var='time'>17:00</var> UTC In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary. Jul <var data-var='date'>23</var>, <var data-var='time'>10:07</var> UTC Scheduled - we will be performing an upgrade of our database systems. During this maintenance window, the Skill Engine API will be unavailable on both the EU as the US environments.

Jul <var data-var='date'>19</var>, <var data-var='time'>22:00</var> UTC Completed - The scheduled maintenance has been completed. Jul <var data-var='date'>19</var>, <var data-var='time'>20:00</var> UTC In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary. Jul <var data-var='date'>16</var>, <var data-var='time'>08:23</var> UTC Update - We will be undergoing scheduled maintenance during this time. Jul <var data-var='date'>16</var>, <var data-var='time'>08:22</var> UTC Update - We will be undergoing scheduled maintenance during this time. Jul <var data-var='date'>11</var>, <var data-var='time'>12:52</var> UTC Update - We will be undergoing scheduled maintenance during this time. Jul <var data-var='date'>11</var>, <var data-var='time'>12:51</var> UTC Scheduled - We will be performing an upgrade of our database systems. During this maintenance window, the Skill Engine API will be unavailable.

Jan <var data-var='date'>29</var>, <var data-var='time'>09:43</var> UTC Resolved - This incident has been resolved. Jan <var data-var='date'>29</var>, <var data-var='time'>09:24</var> UTC Monitoring - A fix has been implemented and we are monitoring the results. Jan <var data-var='date'>29</var>, <var data-var='time'>09:20</var> UTC Identified - The issue has been identified and a fix is being implemented. Jan <var data-var='date'>29</var>, <var data-var='time'>08:43</var> UTC Investigating - We're experiencing an elevated level of API errors and are currently looking into the issue.

Jan <var data-var='date'>19</var>, <var data-var='time'>08:42</var> UTC Resolved - This incident has been resolved. Jan <var data-var='date'>19</var>, <var data-var='time'>08:34</var> UTC Monitoring - A fix has been implemented and we are monitoring the results. Jan <var data-var='date'>19</var>, <var data-var='time'>08:31</var> UTC Identified - The issue has been identified and a fix is being implemented. Jan <var data-var='date'>19</var>, <var data-var='time'>08:16</var> UTC Investigating - We are currently investigating this issue.

Skills Hub Authentication issues

Oct <var data-var='date'>13</var>, <var data-var='time'>10:00</var> UTC Resolved - Between 12:00 PM and 1:00 PM (UTC+2), users experienced errors while loading dashboards on the Skills Hub. The issue was caused by a service unavailability of Microsoft Fabric. We apologize for the inconvenience.

PowerBI outage on Skills Hub

Oct <var data-var='date'>11</var>, <var data-var='time'>14:15</var> UTC Resolved - This incident has been resolved. Oct <var data-var='date'>11</var>, <var data-var='time'>14:07</var> UTC Monitoring - A fix has been implemented and we are monitoring the results. Oct <var data-var='date'>11</var>, <var data-var='time'>13:59</var> UTC Identified - The issue has been identified and a fix is being implemented. Oct <var data-var='date'>11</var>, <var data-var='time'>13:38</var> UTC Investigating - We are currently investigating this issue.

Skill Engine API Authentication issues

Sep <var data-var='date'>12</var>, <var data-var='time'>09:00</var> UTC Resolved - Between 11:00 AM and 1:00 PM (UTC+2), users experienced errors while loading dashboards on the Skills Hub. The issue was caused by a service unavailability of Microsoft Fabric. We apologize for the inconvenience.

Sep <var data-var='date'> 7</var>, <var data-var='time'>06:30</var> UTC Resolved - Between 8:30 and 9:30 (UTC+2), users experienced intermittent errors and extremely high latency on all matching operations. A temporary fix has been applied, while we work on a permanent solution. Entity management and other functionalities remained fully operational.

Elevated Error Rate on Skill Engine API Matching

Sep <var data-var='date'> 1</var>, <var data-var='time'>20:38</var> UTC Completed - The scheduled maintenance has been completed. Sep <var data-var='date'> 1</var>, <var data-var='time'>20:30</var> UTC Verifying - Verification is currently underway for the maintenance items. Sep <var data-var='date'> 1</var>, <var data-var='time'>20:00</var> UTC In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary. Aug <var data-var='date'>29</var>, <var data-var='time'>09:34</var> UTC Scheduled - At 22:00 (UTC+2), we will be performing an upgrade of our database systems. During this maintenance window, the Skill Engine API will be unavailable.

Apr <var data-var='date'>24</var>, <var data-var='time'>12:00</var> UTC Resolved - Between 11:45 and 12:30 (UTC), the performance of the SkillEngine API degraded. Customers experienced a higher-than-usual latency on requests, sporadic timeouts and 502 errors. The issue has been investigated and resolved.

Slow API responses and timeouts

Feb <var data-var='date'>21</var>, <var data-var='time'>22:39</var> UTC Completed - The scheduled maintenance has been completed. Feb <var data-var='date'>21</var>, <var data-var='time'>22:12</var> UTC Verifying - Verification is currently underway for the maintenance items. Feb <var data-var='date'>21</var>, <var data-var='time'>21:50</var> UTC Update - The scheduled maintenance is still ongoing and may take a bit more time, but please be assured that our services remain available. Our team is closely monitoring the situation and will provide updates as soon as the maintenance is completed. Feb <var data-var='date'>21</var>, <var data-var='time'>21:00</var> UTC In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary. Feb <var data-var='date'>16</var>, <var data-var='time'>12:11</var> UTC Scheduled - We will be applying upgrades to our production infrastructure during this window. The Skill Engine API will be unavailable for short periods.

Infrastructure Upgrades

Jan <var data-var='date'>12</var>, <var data-var='time'>15:30</var> UTC Resolved - Between 15:10 and 15:37 (UTC), the geocoding service experienced an issue. As a result, geocoding operations were unavailable. The team has identified the root cause and a hotfix has been applied. No other services were impacted.

Is TechWolf down?

TechWolf status is UP

Lastest published events

Elevated API Errors

Skillengine API Database Upgrade

TechWolf Console authentication issues

TechWolf Services, Components and Regions

Recent TechWolf events

Elevated API Errors

Skillengine API Database Upgrade

TechWolf Console authentication issues

Skillengine API Database Upgrade

US SEAPI requests fail with 401 Unauthorized

Degraded performance for Standard Exports and Skill Assistant for US customers