Mar <var data-var='date'>30</var>, <var data-var='time'>14:03</var> UTC Resolved - This incident has been resolved.Mar <var data-var='date'>30</var>, <var data-var='time'>13:52</var> UTC Identified - The issue has been identified and a fix is being implemented.Mar <var data-var='date'>30</var>, <var data-var='time'>13:41</var> UTC Investigating - We are currently investigating this issue.

Delayed file processing for ILM models in app.nanonets.com

Mar <var data-var='date'>10</var>, <var data-var='time'>15:58</var> UTC Resolved - This incident has been resolved.Mar <var data-var='date'>10</var>, <var data-var='time'>15:34</var> UTC Monitoring - A fix has been implemented and we are monitoring the results.Mar <var data-var='date'>10</var>, <var data-var='time'>15:19</var> UTC Identified - The issue has been identified and a fix is being implemented.Mar <var data-var='date'>10</var>, <var data-var='time'>14:43</var> UTC Investigating - We are currently investigating this issue.

Delayed file processing for all ILM models on app.nanonets.com

Mar <var data-var='date'> 4</var>, <var data-var='time'>11:00</var> UTC Resolved - On 04th March between 11:00 AM and 1:10 PM UTC, we experienced a service degradation that affected Instant Learning models hosted on app.nanonets.com During this time window, the secondary database serving part of the processing workload experienced unusually high load. This temporarily reduced our overall processing capacity to approximately 50%. As a result Asynchronous uploads may have experienced increased response times and delayed file processing. Synchronous uploads may have encountered intermittent failures. Only Instant Learning models on app.nanonets.com were affected. Other model types and other regions remained fully operational. Our engineering team identified the source of the elevated database load and implemented corrective actions to stabilize the system. Processing capacity was restored and services returned to normal by 1:10 PM UTC. We are implementing additional optimizations to improve database performance and resilience. These improvements will be deployed over this week and will not require any downtime. We sincerely apologize for the inconvenience caused and appreciate your patience while we worked to resolve the issue. Please feel free to reach out if you have any questions.

RCA for Processing Delays for Instant Learning Models on app.nanonets.com – 04 Mar

Feb <var data-var='date'>15</var>, <var data-var='time'>19:09</var> UTC Completed - The scheduled maintenance has been completed.Feb <var data-var='date'>15</var>, <var data-var='time'>19:02</var> UTC Verifying - Verification is currently underway for the maintenance items.Feb <var data-var='date'>15</var>, <var data-var='time'>18:40</var> UTC In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.Feb <var data-var='date'>13</var>, <var data-var='time'>10:37</var> UTC Scheduled - On Sunday, 15th Feb from 18:40 UTC to 18:50 UTC, outbound traffic from app.nanonets.com will temporarily originate from a different public IP address: 52.34.203.195. Previously, traffic originated from 52.10.8.255. After the maintenance window, traffic will revert back to this original IP. If you enforce IP allowlisting, please ensure 52.34.203.195 is permitted during this maintenance window. Alternatively, you may choose to refrain from sending traffic during this 10-minute period. No services will be down during this maintenance window.

Network Maintenance Notice in US Region

Feb <var data-var='date'>11</var>, <var data-var='time'>09:26</var> UTC Resolved - This incident has been resolved.Feb <var data-var='date'>11</var>, <var data-var='time'>09:15</var> UTC Monitoring - A fix has been implemented and we are monitoring the results.Feb <var data-var='date'>11</var>, <var data-var='time'>09:10</var> UTC Investigating - We are currently investigating this issue.

Post-Processing Failures Impacting app.nanonets.com Models

Feb <var data-var='date'> 3</var>, <var data-var='time'>15:35</var> UTC Resolved - This incident has been resolved.Feb <var data-var='date'> 3</var>, <var data-var='time'>15:22</var> UTC Monitoring - A fix has been implemented and we are monitoring the results.Feb <var data-var='date'> 3</var>, <var data-var='time'>15:13</var> UTC Identified - One of our GPU service provider is facing issues. We are working on resolving the issue with them.

Delayed File Processing and Intermittent Failures Across Regions

Jan <var data-var='date'>28</var>, <var data-var='time'>16:59</var> UTC Resolved - This incident has been resolved.Jan <var data-var='date'>28</var>, <var data-var='time'>16:39</var> UTC Monitoring - A fix has been implemented and we are monitoring the results.Jan <var data-var='date'>28</var>, <var data-var='time'>16:20</var> UTC Update - We have recovered the db. Processing has resumed and we are working on clearing the backlog.Jan <var data-var='date'>28</var>, <var data-var='time'>15:35</var> UTC Identified - We have identified the issue. A secondary database migration impacted indexes on a few core tables, leading to the current disruption. Our engineering team is actively working on restoring the database and we expect processing to resume once recovery is complete. We apologize for this unanticipated issue and will share an update as soon as services are fully restored.Jan <var data-var='date'>28</var>, <var data-var='time'>15:09</var> UTC Investigating - We are currently investigating this issue.

Delayed file processing for all ILM models in app.nanonets.com

Jan <var data-var='date'>27</var>, <var data-var='time'>22:12</var> UTC Resolved - This incident has been resolved.Jan <var data-var='date'>27</var>, <var data-var='time'>21:32</var> UTC Monitoring - A fix has been implemented and we are monitoring the results.Jan <var data-var='date'>27</var>, <var data-var='time'>18:27</var> UTC Identified - The issue has been identified and a fix is being implemented.Jan <var data-var='date'>27</var>, <var data-var='time'>17:24</var> UTC Investigating - We are currently investigating this issue.

Delayed file processing for models using async api in EU region

Jan <var data-var='date'>23</var>, <var data-var='time'>19:04</var> UTC Resolved - This incident has been resolved.Jan <var data-var='date'>23</var>, <var data-var='time'>18:48</var> UTC Monitoring - A fix has been implemented and we are monitoring the results.Jan <var data-var='date'>23</var>, <var data-var='time'>18:25</var> UTC Identified - The issue has been identified and a fix is being implemented.Jan <var data-var='date'>23</var>, <var data-var='time'>17:55</var> UTC Investigating - We are currently investigating this issue.

Delayed File Processing in EU & EU-Open Region

Jan <var data-var='date'>21</var>, <var data-var='time'>09:34</var> UTC Resolved - This incident has been resolved.Jan <var data-var='date'>21</var>, <var data-var='time'>09:07</var> UTC Monitoring - A fix has been implemented and we are monitoring the results.Jan <var data-var='date'>21</var>, <var data-var='time'>08:58</var> UTC Investigating - We are currently investigating this issue.

Async file processing & Extract data section file visibility issue for users using app.nanonets.com

Dec <var data-var='date'>11</var>, <var data-var='time'>09:52</var> UTC Resolved - This incident has been resolved.Dec <var data-var='date'>11</var>, <var data-var='time'>09:30</var> UTC Monitoring - Our sync API is now operating normally. For async uploads, most results are already available and any remaining pending results will be processed within the next few minutes as we clear the backlog. Our team is addressing the issue on priority. We sincerely apologize for the inconvenience caused.Dec <var data-var='date'>11</var>, <var data-var='time'>07:56</var> UTC Investigating - We are currently investigating this issue.

Delay in file processing for Instant learning models in US region

Dec <var data-var='date'> 8</var>, <var data-var='time'>07:59</var> UTC Resolved - This incident has been resolved.Dec <var data-var='date'> 8</var>, <var data-var='time'>07:58</var> UTC Identified - The issue has been identified and a fix is being implemented.Dec <var data-var='date'> 8</var>, <var data-var='time'>07:52</var> UTC Investigating - Service Disruption on https://in.nanonets.com US and EU regions are not affected

IN region Outage

Dec <var data-var='date'> 3</var>, <var data-var='time'>21:10</var> UTC Resolved - This incident has been resolved.Dec <var data-var='date'> 3</var>, <var data-var='time'>20:50</var> UTC Monitoring - Our sync prediction API for instant learning models is now operating normally. Async results for older files are available for most users and for few users we see some backlog which is getting clearedDec <var data-var='date'> 3</var>, <var data-var='time'>17:08</var> UTC Update - We have identified the issue and increased our throughput to process requests faster. However, clearing the backlog may take some additional time. Our team is continuously monitoring the situation. We apologize for the inconvenience and appreciate your patience.Dec <var data-var='date'> 3</var>, <var data-var='time'>16:35</var> UTC Identified - The issue has been identified and a fix is being implemented.Dec <var data-var='date'> 3</var>, <var data-var='time'>15:08</var> UTC Investigating - We are currently investigating this issue.

High Response Times for Instant learning models in US region

Nov <var data-var='date'> 8</var>, <var data-var='time'>20:46</var> UTC Resolved - This incident has been resolved.Nov <var data-var='date'> 8</var>, <var data-var='time'>20:04</var> UTC Update - We are continuing to monitor for any further issues.Nov <var data-var='date'> 8</var>, <var data-var='time'>20:04</var> UTC Monitoring - A fix has been implemented and we are monitoring the results.Nov <var data-var='date'> 8</var>, <var data-var='time'>18:33</var> UTC Identified - The issue has been identified and a fix is being implemented.

Failures in some instant learning models

Oct <var data-var='date'>20</var>, <var data-var='time'>21:43</var> UTC Resolved - This incident has been resolved.Oct <var data-var='date'>20</var>, <var data-var='time'>21:29</var> UTC Update - We are continuing to monitor for any further issues.Oct <var data-var='date'>20</var>, <var data-var='time'>21:28</var> UTC Monitoring - A fix has been implemented and we are monitoring the results.Oct <var data-var='date'>20</var>, <var data-var='time'>21:11</var> UTC Identified - On 20th Oct, a global AWS outage impacted one of our feature flag service providers, resulting in intermittent failures for some of our models. The issue originated from the provider's infrastructure dependency on affected AWS regions, which caused disruptions in feature flag evaluations within our system. Our engineering team promptly identified the root cause and implemented mitigation measures to restore functionality. We are continuously monitoring the situation and working with our partners to ensure full stability. We apologize for the inconvenience caused and appreciate your patience and understanding.

Service Disruption Due to Global AWS Outage

Sep <var data-var='date'>22</var>, <var data-var='time'>12:17</var> UTC Resolved - This incident has been resolved.Sep <var data-var='date'>22</var>, <var data-var='time'>12:09</var> UTC Monitoring - A fix has been implemented and we are monitoring the results.Sep <var data-var='date'>22</var>, <var data-var='time'>12:07</var> UTC Identified - The issue has been identified and a fix is being implemented.Sep <var data-var='date'>22</var>, <var data-var='time'>12:01</var> UTC Investigating - We are currently investigating this issue.

app.nanonets.com down

Sep <var data-var='date'> 4</var>, <var data-var='time'>05:51</var> UTC Resolved - At 1:00 AM UTC on September 4th, we posted an incident titled “Zero learning model file processing failures.” Upon further investigation, we identified that the issue was isolated to a single model and was not platform-wide. No other models or regions were impacted. The previously posted incident has been removed. We would like to clarify that there has been no platform-wide downtime in any region. Thank you for your understanding.

Clarification: No Platform-wide Downtime on September 4th

Aug <var data-var='date'>20</var>, <var data-var='time'>12:13</var> UTC Resolved - During a planned migration activity, users were unexpectedly logged out of the platform between 11:50 UTC and 12:05 UTC. The disruption occurred because database reads failed for old pods during the migration, while new pods came up late, leading to temporary session validation failures. The issue was resolved once the new pods were fully operational. We sincerely apologize for the inconvenience caused and will ensure future migrations are executed with better coordination to avoid service disruption.

app.nanonets.com – User Logout Issue

Jul <var data-var='date'>26</var>, <var data-var='time'>09:13</var> UTC Resolved - This incident has been resolved.Jul <var data-var='date'>26</var>, <var data-var='time'>09:08</var> UTC Monitoring - A fix has been implemented and we are monitoring the results.Jul <var data-var='date'>26</var>, <var data-var='time'>09:07</var> UTC Identified - The issue has been identified and a fix is being implemented.

India region services affected

Jul <var data-var='date'>23</var>, <var data-var='time'>16:02</var> UTC Resolved - Between 15:05 UTC and 15:40 UTC on July 23, 2025, a small subset of users using the Sync API for Instant Learning models on app.nanonets.com may have experienced intermittent prediction failures. We identified an edge case in our system that triggered this issue under specific conditions. The issue was resolved promptly with a fix, and the system has been stable since. All other regions and services remained unaffected and continue to operate normally. We apologize for the inconvenience caused and appreciate your understanding.

Intermittent Prediction Failures on Instant Learning Models

Jul <var data-var='date'>22</var>, <var data-var='time'>10:21</var> UTC Resolved - On July 22nd, 2025, users of app.nanonets.com may have experienced intermittent slowness during the periods 08:45–08:56 UTC and 10:03–10:11 UTC. This issue was caused by an unusually high load on our primary database. Our engineering team promptly identified the root cause and deployed a fix. The system has since stabilized and is functioning normally. We appreciate your patience during this time. All other regions remained fully operational without any downtime.

Temporary Slowness on app.nanonets.com due to High Load on DB

Jun <var data-var='date'>24</var>, <var data-var='time'>13:58</var> UTC Resolved - Between 13:33 UTC and 13:44 UTC on June 24th 2025, we observed intermittent failures in the Prediction API for our EU region due to a critical infrastructure issue. Our alerting systems flagged the anomaly, and our engineers quickly identified and resolved the problem. Services in the EU region were fully restored by 13:44 UTC. Other regions remained stable and were not impacted during this period. We appreciate your patience and understanding.

EU Region Prediction API Failures

Jun <var data-var='date'>12</var>, <var data-var='time'>19:41</var> UTC Resolved - This incident has been resolved.Jun <var data-var='date'>12</var>, <var data-var='time'>19:10</var> UTC Update - We are continuing to monitor for any further issues.Jun <var data-var='date'>12</var>, <var data-var='time'>19:08</var> UTC Monitoring - There is a major GCP global outage ongoing at the moment. We have ensured that all our critical dependencies have been redirected to fallbacks, and we are currently not impacted. GCP incident: https://status.cloud.google.com/incidents/ow5i3PPK96RduMcb1SsW We are closely monitoring the situation and will take any necessary actions if the situation evolves. Thanks for your continued support and vigilance. We'll keep you posted with any updates.

GCP Global Outage – No Impact to Our Systems

Jun <var data-var='date'> 2</var>, <var data-var='time'>16:59</var> UTC Resolved - This incident has been resolved.Jun <var data-var='date'> 2</var>, <var data-var='time'>15:17</var> UTC Identified - Between 1 PM and 7 PM IST on June 2nd, very few users in our EU-Open region (https://eu-open.nanonets.com) experienced delayed file processing via the Async Prediction API due to a critical infrastructure issue that caused a backlog. This issue was limited to the EU-Open region, with all other regions operating normally. We have identified and resolved the root cause, scaled up the system, and are working to clear the backlog as quickly as possible.

Degraded async file processing for few users on https://eu-open.nanonets.com

May <var data-var='date'>23</var>, <var data-var='time'>12:55</var> UTC Resolved - On May 23rd, 2025, between 11:45 AM UTC and 12:10 PM UTC, we experienced a brief disruption affecting file information retrieval and related actions such as verification. The issue was promptly identified and resolved. All services are now fully operational, and we have implemented measures to prevent a recurrence. We apologize for the inconvenience caused and appreciate your patience.

Is Nanonets down?

Nanonets status is UP

Lastest published events

Delayed file processing for ILM models in app.nanonets.com

Delayed file processing for all ILM models on app.nanonets.com

RCA for Processing Delays for Instant Learning Models on app.nanonets.com – 04 Mar

Nanonets Services, Components and Regions

Recent Nanonets events

Delayed file processing for ILM models in app.nanonets.com

Delayed file processing for all ILM models on app.nanonets.com

RCA for Processing Delays for Instant Learning Models on app.nanonets.com – 04 Mar

Network Maintenance Notice in US Region

Post-Processing Failures Impacting app.nanonets.com Models

Delayed File Processing and Intermittent Failures Across Regions

Get your FREE account now,
5 monitors included!

Is Nanonets down?

Nanonets status is UP

Lastest published events

Delayed file processing for ILM models in app.nanonets.com

Delayed file processing for all ILM models on app.nanonets.com

RCA for Processing Delays for Instant Learning Models on app.nanonets.com – 04 Mar

Nanonets Services, Components and Regions

Recent Nanonets events

Delayed file processing for ILM models in app.nanonets.com

Delayed file processing for all ILM models on app.nanonets.com

RCA for Processing Delays for Instant Learning Models on app.nanonets.com – 04 Mar

Network Maintenance Notice in US Region

Post-Processing Failures Impacting app.nanonets.com Models

Delayed File Processing and Intermittent Failures Across Regions

Get your FREE account now,5 monitors included!

Get your FREE account now,
5 monitors included!