Jul <var data-var='date'>21</var>, <var data-var='time'>19:40</var> UTC Resolved - This incident has been resolved. Jul <var data-var='date'>21</var>, <var data-var='time'>19:39</var> UTC Identified - The issue has been identified and a fix is being implemented. Jul <var data-var='date'>21</var>, <var data-var='time'>19:10</var> UTC Investigating - We are currently investigating this issue.

[SERVERLESS][Azure][eastus2] 5xx errors for some namespaces

Jul <var data-var='date'>20</var>, <var data-var='time'>18:00</var> UTC Resolved - This incident has been resolved. Jul <var data-var='date'>20</var>, <var data-var='time'>17:46</var> UTC Identified - The issue has been identified and a fix is being implemented. Jul <var data-var='date'>20</var>, <var data-var='time'>16:44</var> UTC Investigating - We are currently investigating this issue.

[SERVERLESS][AWS][us-east-1] Increased latency and 5xx errors for some indexes

Jul <var data-var='date'>13</var>, <var data-var='time'>04:15</var> UTC Resolved - This incident has been resolved. Jul <var data-var='date'>12</var>, <var data-var='time'>23:46</var> UTC Identified - The issue has been identified and a fix is being implemented. Jul <var data-var='date'>12</var>, <var data-var='time'>23:21</var> UTC Investigating - We are observing freshness lag affecting a small number of indexes in AWS us-east-1, resulting in some queries not serving fresh data. We are actively investigating.

[Serverless][AWS][us-east-1] Increase in freshness lag for some namespaces

Jul <var data-var='date'> 9</var>, <var data-var='time'>14:37</var> UTC Resolved - This incident has been resolved. Jul <var data-var='date'> 9</var>, <var data-var='time'>14:26</var> UTC Monitoring - A fix has been implemented and we are monitoring the results. Jul <var data-var='date'> 9</var>, <var data-var='time'>09:50</var> UTC Investigating - We are currently investigating this issue.

[Serverless][Azure][eastus2] 5xx errors on some requests for some indexes

Jun <var data-var='date'>18</var>, <var data-var='time'>18:23</var> UTC Resolved - This incident has been resolved. Jun <var data-var='date'>18</var>, <var data-var='time'>10:00</var> UTC Investigating - We are currently investigating this issue.

Some initial queries to infrequently read namespaces incorrectly returning empty results

Jun <var data-var='date'>16</var>, <var data-var='time'>17:05</var> UTC Resolved - This incident has been resolved. Jun <var data-var='date'>16</var>, <var data-var='time'>14:11</var> UTC Identified - The issue has been identified and a fix is being implemented. Jun <var data-var='date'>16</var>, <var data-var='time'>13:05</var> UTC Investigating - We are currently investigating this issue.

[Serverless][AWS][us-east-1] Metrics tab in the console not showing graphs

Jun <var data-var='date'> 6</var>, <var data-var='time'>20:40</var> UTC Resolved - This incident has been resolved. Jun <var data-var='date'> 6</var>, <var data-var='time'>17:05</var> UTC Investigating - We are currently investigating this issue.

[Serverless][AWS][us-west-2] 5xx errors for some requests on some indexes

Jun <var data-var='date'> 6</var>, <var data-var='time'>15:50</var> UTC Resolved - This incident has been resolved. Jun <var data-var='date'> 6</var>, <var data-var='time'>13:05</var> UTC Investigating - We are currently investigating this issue.

[Serverless][AWS][us-west-2] Read path operations for some indexes may experience elevated latency and timeouts

Jun <var data-var='date'> 6</var>, <var data-var='time'>01:15</var> UTC Resolved - This incident has been resolved. Jun <var data-var='date'> 6</var>, <var data-var='time'>01:00</var> UTC Monitoring - A fix has been implemented and we are monitoring the results. Jun <var data-var='date'> 6</var>, <var data-var='time'>00:53</var> UTC Identified - The issue has been identified and a fix is being implemented. Jun <var data-var='date'> 6</var>, <var data-var='time'>00:52</var> UTC Update - We are continuing to investigate this issue. Jun <var data-var='date'> 6</var>, <var data-var='time'>00:48</var> UTC Investigating - We are currently investigating this issue.

[AWS][us-east-1] 5xx errors for some requests on some indexes

May <var data-var='date'>25</var>, <var data-var='time'>15:00</var> UTC Resolved - This incident has been resolved. May <var data-var='date'>25</var>, <var data-var='time'>14:32</var> UTC Monitoring - A fix has been implemented and we are monitoring the results. May <var data-var='date'>25</var>, <var data-var='time'>14:06</var> UTC Identified - The issue has been identified and a fix is being implemented. May <var data-var='date'>25</var>, <var data-var='time'>13:41</var> UTC Investigating - We are currently investigating this issue.

[Serverless][AWS][us-west-2] 5xx errors and longer response times on upsert requests for some indexes.

May <var data-var='date'>13</var>, <var data-var='time'>21:15</var> UTC Resolved - This incident has been resolved. May <var data-var='date'>13</var>, <var data-var='time'>20:16</var> UTC Identified - The issue has been identified and a fix is being implemented. May <var data-var='date'>13</var>, <var data-var='time'>20:14</var> UTC Investigating - We are currently investigating this issue.

[AWS][us-east-1] 5xx errors on read and write operations for some indexes

May <var data-var='date'> 6</var>, <var data-var='time'>20:30</var> UTC Resolved - This incident has been resolved. May <var data-var='date'> 6</var>, <var data-var='time'>20:14</var> UTC Monitoring - A fix has been implemented and we are monitoring the results. May <var data-var='date'> 6</var>, <var data-var='time'>20:08</var> UTC Identified - The issue has been identified and a fix is being implemented. May <var data-var='date'> 6</var>, <var data-var='time'>20:02</var> UTC Investigating - We are currently investigating this issue.

May <var data-var='date'> 6</var>, <var data-var='time'>15:20</var> UTC Resolved - This incident has been resolved. May <var data-var='date'> 6</var>, <var data-var='time'>15:15</var> UTC Monitoring - The hosting provider for app.pinecone.io experienced increased errors and latency starting at 15:00 UTC. At 15:15 UTC, they implemented a fix and are continuing to monitor the impact. This incident did not impact Pinecone APIs or services. May <var data-var='date'> 6</var>, <var data-var='time'>15:00</var> UTC Investigating - We are currently investigating this issue.

Pinecone Console loading slowly for some users

Mar <var data-var='date'>13</var>, <var data-var='time'>09:53</var> UTC Resolved - This incident has been resolved. Mar <var data-var='date'>13</var>, <var data-var='time'>09:23</var> UTC Monitoring - A fix has been implemented and we are monitoring the results. Mar <var data-var='date'>13</var>, <var data-var='time'>08:50</var> UTC Investigating - We are currently investigating this issue.

[GCP][europe-west4] Errors for upsert operations on some indexes

Mar <var data-var='date'> 5</var>, <var data-var='time'>23:02</var> UTC Resolved - This incident has been resolved. Mar <var data-var='date'> 5</var>, <var data-var='time'>22:34</var> UTC Identified - The issue has been identified and a fix is being implemented. Mar <var data-var='date'> 5</var>, <var data-var='time'>21:57</var> UTC Investigating - We are currently investigating this issue.

[AWS][us-east-1] Prometheus metrics are unavailable through the Pinecone console or the metric proxy

Mar <var data-var='date'> 4</var>, <var data-var='time'>22:16</var> UTC Resolved - This incident has been resolved. Mar <var data-var='date'> 4</var>, <var data-var='time'>22:11</var> UTC Monitoring - A fix has been implemented and we are monitoring the results. Mar <var data-var='date'> 4</var>, <var data-var='time'>21:06</var> UTC Investigating - We are currently investigating this issue.

[Serverless][GCP][us-central1] 5xx errors on some read operations for some indexes

Feb <var data-var='date'>24</var>, <var data-var='time'>01:52</var> UTC Resolved - This incident has been resolved. Feb <var data-var='date'>24</var>, <var data-var='time'>01:09</var> UTC Identified - The issue has been identified and a fix is being implemented. Feb <var data-var='date'>24</var>, <var data-var='time'>01:08</var> UTC Monitoring - The impact was related to a Google Cloud Storage incident (Event ID: WDVVRMB). Feb <var data-var='date'>23</var>, <var data-var='time'>23:14</var> UTC Investigating - We are currently investigating this issue.

[GCP][us-central1][europe-west4] Errors on some read operations

Feb <var data-var='date'> 5</var>, <var data-var='time'>21:57</var> UTC Resolved - This incident has been resolved. Feb <var data-var='date'> 5</var>, <var data-var='time'>21:01</var> UTC Monitoring - A fix has been implemented and we are monitoring the results. Feb <var data-var='date'> 5</var>, <var data-var='time'>14:29</var> UTC Identified - The issue has been identified and a fix is being implemented. Feb <var data-var='date'> 5</var>, <var data-var='time'>10:55</var> UTC Investigating - We are currently investigating this issue.

Jan <var data-var='date'>15</var>, <var data-var='time'>15:30</var> UTC Resolved - This incident has been resolved. Jan <var data-var='date'>15</var>, <var data-var='time'>14:30</var> UTC Monitoring - A fix has been implemented and we are monitoring the results. Jan <var data-var='date'>15</var>, <var data-var='time'>13:57</var> UTC Identified - The issue has been identified and a fix is being implemented. Jan <var data-var='date'>15</var>, <var data-var='time'>12:12</var> UTC Investigating - We are currently investigating this issue.

[Serverless][AWS][us-east-1] 5xx errors on read operations for some indexes

Jan <var data-var='date'> 2</var>, <var data-var='time'>17:58</var> UTC Resolved - This incident has been resolved. Jan <var data-var='date'> 2</var>, <var data-var='time'>17:18</var> UTC Monitoring - A fix has been implemented and we are monitoring the results. Jan <var data-var='date'> 2</var>, <var data-var='time'>16:31</var> UTC Investigating - We are currently investigating this issue.

Intermittent unavailability across all environments for some indexes

Dec <var data-var='date'>31</var>, <var data-var='time'>03:29</var> UTC Resolved - This incident has been resolved. Dec <var data-var='date'>31</var>, <var data-var='time'>03:25</var> UTC Monitoring - A fix has been implemented and we are monitoring the results. Dec <var data-var='date'>31</var>, <var data-var='time'>03:17</var> UTC Identified - The issue has been identified and a fix is being implemented. Dec <var data-var='date'>31</var>, <var data-var='time'>03:13</var> UTC Investigating - We are currently investigating this issue.

[Serverless][AWS][us-west-2] 5xx errors on some read path operations

Dec <var data-var='date'>19</var>, <var data-var='time'>01:15</var> UTC Resolved - From 8:15 PM to 8:50 PM UTC, some users experienced partial control plane unavailability.

[Serverless][GCP][us-central1] Partial control plane unavailability for some users

Dec <var data-var='date'>15</var>, <var data-var='time'>22:02</var> UTC Resolved - This incident has been resolved. Dec <var data-var='date'>15</var>, <var data-var='time'>21:20</var> UTC Monitoring - A fix has been implemented and we are monitoring the results. Dec <var data-var='date'>15</var>, <var data-var='time'>14:34</var> UTC Identified - The issue has been identified and a fix is being implemented. Dec <var data-var='date'>15</var>, <var data-var='time'>10:39</var> UTC Investigating - We are currently investigating this issue.

[Serverless][GCP][europe-west4] 5xx errors on read and write operations for some indexes

Dec <var data-var='date'>10</var>, <var data-var='time'>01:50</var> UTC Resolved - This incident has been resolved. Dec <var data-var='date'> 9</var>, <var data-var='time'>23:40</var> UTC Monitoring - A fix has been implemented and we are monitoring the results. Dec <var data-var='date'> 9</var>, <var data-var='time'>20:30</var> UTC Identified - The issue has been identified and a fix is being implemented. Dec <var data-var='date'> 9</var>, <var data-var='time'>20:15</var> UTC Investigating - Files uploaded to an assistant may take longer than expected to appear in chat and context requests during this time.

Increased file processing time for Assistant

Dec <var data-var='date'> 8</var>, <var data-var='time'>20:43</var> UTC Resolved - From 3:43 PM EST to 3:50 PM EST, some embed and rerank requests were unavailable.

Is Pinecone down?

Pinecone status is UP

Lastest published events

[SERVERLESS][Azure][eastus2] 5xx errors for some namespaces

[SERVERLESS][AWS][us-east-1] Increased latency and 5xx errors for some indexes

[Serverless][AWS][us-east-1] Increase in freshness lag for some namespaces

Pinecone Services, Components and Regions

Recent Pinecone events

[SERVERLESS][Azure][eastus2] 5xx errors for some namespaces

[SERVERLESS][AWS][us-east-1] Increased latency and 5xx errors for some indexes

[Serverless][AWS][us-east-1] Increase in freshness lag for some namespaces

[Serverless][Azure][eastus2] 5xx errors on some requests for some indexes

Some initial queries to infrequently read namespaces incorrectly returning empty results

[Serverless][AWS][us-east-1] Metrics tab in the console not showing graphs