May <var data-var='date'>12</var>, <var data-var='time'>16:25</var> UTC Resolved - Starting around 16:25 UTC, we were alerted that the average request handle time had increase substantially and some connections to our API were timing out. An increase in CPU-bound database queries due to outdated PostgreSQL statistics caused the issue.

Intermittent connection timeouts

Feb <var data-var='date'>16</var>, <var data-var='time'>13:03</var> UTC Completed - The scheduled maintenance has been completed. Feb <var data-var='date'>16</var>, <var data-var='time'>11:25</var> UTC Verifying - Verification is currently underway for the maintenance items. Feb <var data-var='date'>16</var>, <var data-var='time'>07:00</var> UTC In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary. Feb <var data-var='date'> 1</var>, <var data-var='time'>16:22</var> UTC Scheduled - Our community product will be offline during this period while we conduct some necessary infrastructure work including moving to a new more performant database server. None of the other TINT products will be affected.

Community infrastructure maintenance

May <var data-var='date'>11</var>, <var data-var='time'>11:30</var> UTC Completed - The scheduled maintenance has been completed. May <var data-var='date'>11</var>, <var data-var='time'>09:00</var> UTC In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary. Apr <var data-var='date'>17</var>, <var data-var='time'>15:16</var> UTC Scheduled - We will be undergoing scheduled maintenance during this time. There may be some downtime, which we'll try our best to minimize, when our servers restart.

Database server maintenance

Dec <var data-var='date'> 5</var>, <var data-var='time'>21:30</var> UTC Resolved - We're currently seeing slow response times and requests timing out to some API endpoints.

Some API endpoints are slow or timing out

Oct <var data-var='date'>31</var>, <var data-var='time'>16:01</var> UTC Completed - The scheduled maintenance has been completed. Oct <var data-var='date'>31</var>, <var data-var='time'>15:30</var> UTC Verifying - Verification is currently underway for the maintenance items. Oct <var data-var='date'>31</var>, <var data-var='time'>10:01</var> UTC In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary. Oct <var data-var='date'>17</var>, <var data-var='time'>12:38</var> UTC Scheduled - We will upgrade the software we use on our search servers. The maintenance will not require 24 hours but because the process of upgrading is managed by AWS and there is no way to know exactly when the procedure will complete, we're scheduling an extended maintenance window. There may be a few seconds of downtime as the servers restart.

Search cluster maintenance

Sep <var data-var='date'>22</var>, <var data-var='time'>20:30</var> UTC Resolved - Due to much larger than normal processing volume, content ingestion is currently taking a little longer than normal.

Content ingestion delayed

Jul <var data-var='date'>26</var>, <var data-var='time'>08:56</var> UTC Resolved - Between 08:56 UTC and 09:05 UTC, connections between our API servers and our caching servers were timing out. This resulted in some API calls taking longer than usual or failing.

Caching server connection timeouts

Jun <var data-var='date'> 7</var>, <var data-var='time'>11:25</var> UTC Completed - The scheduled maintenance has been completed. Jun <var data-var='date'> 7</var>, <var data-var='time'>11:16</var> UTC Verifying - Verification is currently underway for the maintenance items. Jun <var data-var='date'> 7</var>, <var data-var='time'>10:01</var> UTC In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary. Jun <var data-var='date'> 6</var>, <var data-var='time'>17:23</var> UTC Update - We will be undergoing scheduled maintenance during this time. Jun <var data-var='date'> 6</var>, <var data-var='time'>17:11</var> UTC Scheduled - We will be undergoing scheduled maintenance during this time.

Is TINT down?

TINT status is UP

Lastest published events

Intermittent connection timeouts

Community infrastructure maintenance

Database server maintenance

TINT Services, Components and Regions

Recent TINT events

Intermittent connection timeouts

Community infrastructure maintenance

Database server maintenance

Some API endpoints are slow or timing out

Search cluster maintenance

Content ingestion delayed