Sep <var data-var='date'>28</var>, <var data-var='time'>04:20</var> UTC Resolved - The third party dependency recovered, this incident has resolved. Sep <var data-var='date'>28</var>, <var data-var='time'>04:13</var> UTC Identified - A shared dependency is having issues. Determining mitigation

[Pods][AWS][us-east-1] Write failures and high latency

Sep <var data-var='date'>23</var>, <var data-var='time'>00:32</var> UTC Resolved - This incident has been resolved. Sep <var data-var='date'>23</var>, <var data-var='time'>00:05</var> UTC Monitoring - We have mitigated the errors and are monitoring to ensure there is no reoccurrence. Sep <var data-var='date'>22</var>, <var data-var='time'>23:34</var> UTC Identified - The issue has been identified and mitigation is being actioned. A small percentage of read requests are impacted.

[Serverless][AWS][eu-west-1] 5xx on read requests

Sep <var data-var='date'>17</var>, <var data-var='time'>16:44</var> UTC Resolved - This incident has been resolved. Sep <var data-var='date'>17</var>, <var data-var='time'>06:14</var> UTC Monitoring - We are recovering and are monitoring to ensure no further errors occur. Sep <var data-var='date'>17</var>, <var data-var='time'>05:37</var> UTC Investigating - We have identified the issue and we are in the process of mitigating.

[Serverless][AWS][us-west-2] 5xx errors on the readpath

Sep <var data-var='date'> 1</var>, <var data-var='time'>19:40</var> UTC Resolved - This incident has been resolved. Sep <var data-var='date'> 1</var>, <var data-var='time'>17:00</var> UTC Monitoring - Error rates have subsided, we are monitoring the results. Sep <var data-var='date'> 1</var>, <var data-var='time'>15:39</var> UTC Update - This is likely related to ongoing issues in GCP. Affected services include Console, Index management, Assistant management, and APIs served at api.pinecone.io Sep <var data-var='date'> 1</var>, <var data-var='time'>15:04</var> UTC Investigating - We are currently investigating this issue.

5xx errors on some control plane operations

Aug <var data-var='date'>25</var>, <var data-var='time'>16:11</var> UTC Resolved - This incident has been resolved. Aug <var data-var='date'>25</var>, <var data-var='time'>16:11</var> UTC Monitoring - A fix has been implemented and we are monitoring the results. Aug <var data-var='date'>25</var>, <var data-var='time'>15:50</var> UTC Investigating - We are currently investigating this issue.

[SERVERLESS][GCP][us-central1] 5xx errors on some read and write requests

Jul <var data-var='date'>21</var>, <var data-var='time'>19:40</var> UTC Resolved - This incident has been resolved. Jul <var data-var='date'>21</var>, <var data-var='time'>19:39</var> UTC Identified - The issue has been identified and a fix is being implemented. Jul <var data-var='date'>21</var>, <var data-var='time'>19:10</var> UTC Investigating - We are currently investigating this issue.

[SERVERLESS][Azure][eastus2] 5xx errors for some namespaces

Jul <var data-var='date'>20</var>, <var data-var='time'>18:00</var> UTC Resolved - This incident has been resolved. Jul <var data-var='date'>20</var>, <var data-var='time'>17:46</var> UTC Identified - The issue has been identified and a fix is being implemented. Jul <var data-var='date'>20</var>, <var data-var='time'>16:44</var> UTC Investigating - We are currently investigating this issue.

[SERVERLESS][AWS][us-east-1] Increased latency and 5xx errors for some indexes

Jul <var data-var='date'>13</var>, <var data-var='time'>04:15</var> UTC Resolved - This incident has been resolved. Jul <var data-var='date'>12</var>, <var data-var='time'>23:46</var> UTC Identified - The issue has been identified and a fix is being implemented. Jul <var data-var='date'>12</var>, <var data-var='time'>23:21</var> UTC Investigating - We are observing freshness lag affecting a small number of indexes in AWS us-east-1, resulting in some queries not serving fresh data. We are actively investigating.

[Serverless][AWS][us-east-1] Increase in freshness lag for some namespaces

Jul <var data-var='date'> 9</var>, <var data-var='time'>14:37</var> UTC Resolved - This incident has been resolved. Jul <var data-var='date'> 9</var>, <var data-var='time'>14:26</var> UTC Monitoring - A fix has been implemented and we are monitoring the results. Jul <var data-var='date'> 9</var>, <var data-var='time'>09:50</var> UTC Investigating - We are currently investigating this issue.

[Serverless][Azure][eastus2] 5xx errors on some requests for some indexes

Jun <var data-var='date'>18</var>, <var data-var='time'>18:23</var> UTC Resolved - This incident has been resolved. Jun <var data-var='date'>18</var>, <var data-var='time'>10:00</var> UTC Investigating - We are currently investigating this issue.

Some initial queries to infrequently read namespaces incorrectly returning empty results

Jun <var data-var='date'>16</var>, <var data-var='time'>17:05</var> UTC Resolved - This incident has been resolved. Jun <var data-var='date'>16</var>, <var data-var='time'>14:11</var> UTC Identified - The issue has been identified and a fix is being implemented. Jun <var data-var='date'>16</var>, <var data-var='time'>13:05</var> UTC Investigating - We are currently investigating this issue.

[Serverless][AWS][us-east-1] Metrics tab in the console not showing graphs

Jun <var data-var='date'> 6</var>, <var data-var='time'>20:40</var> UTC Resolved - This incident has been resolved. Jun <var data-var='date'> 6</var>, <var data-var='time'>17:05</var> UTC Investigating - We are currently investigating this issue.

[Serverless][AWS][us-west-2] 5xx errors for some requests on some indexes

Jun <var data-var='date'> 6</var>, <var data-var='time'>15:50</var> UTC Resolved - This incident has been resolved. Jun <var data-var='date'> 6</var>, <var data-var='time'>13:05</var> UTC Investigating - We are currently investigating this issue.

[Serverless][AWS][us-west-2] Read path operations for some indexes may experience elevated latency and timeouts

Jun <var data-var='date'> 6</var>, <var data-var='time'>01:15</var> UTC Resolved - This incident has been resolved. Jun <var data-var='date'> 6</var>, <var data-var='time'>01:00</var> UTC Monitoring - A fix has been implemented and we are monitoring the results. Jun <var data-var='date'> 6</var>, <var data-var='time'>00:53</var> UTC Identified - The issue has been identified and a fix is being implemented. Jun <var data-var='date'> 6</var>, <var data-var='time'>00:52</var> UTC Update - We are continuing to investigate this issue. Jun <var data-var='date'> 6</var>, <var data-var='time'>00:48</var> UTC Investigating - We are currently investigating this issue.

[AWS][us-east-1] 5xx errors for some requests on some indexes

May <var data-var='date'>25</var>, <var data-var='time'>15:00</var> UTC Resolved - This incident has been resolved. May <var data-var='date'>25</var>, <var data-var='time'>14:32</var> UTC Monitoring - A fix has been implemented and we are monitoring the results. May <var data-var='date'>25</var>, <var data-var='time'>14:06</var> UTC Identified - The issue has been identified and a fix is being implemented. May <var data-var='date'>25</var>, <var data-var='time'>13:41</var> UTC Investigating - We are currently investigating this issue.

[Serverless][AWS][us-west-2] 5xx errors and longer response times on upsert requests for some indexes.

May <var data-var='date'>13</var>, <var data-var='time'>21:15</var> UTC Resolved - This incident has been resolved. May <var data-var='date'>13</var>, <var data-var='time'>20:16</var> UTC Identified - The issue has been identified and a fix is being implemented. May <var data-var='date'>13</var>, <var data-var='time'>20:14</var> UTC Investigating - We are currently investigating this issue.

[AWS][us-east-1] 5xx errors on read and write operations for some indexes

May <var data-var='date'> 6</var>, <var data-var='time'>20:30</var> UTC Resolved - This incident has been resolved. May <var data-var='date'> 6</var>, <var data-var='time'>20:14</var> UTC Monitoring - A fix has been implemented and we are monitoring the results. May <var data-var='date'> 6</var>, <var data-var='time'>20:08</var> UTC Identified - The issue has been identified and a fix is being implemented. May <var data-var='date'> 6</var>, <var data-var='time'>20:02</var> UTC Investigating - We are currently investigating this issue.

May <var data-var='date'> 6</var>, <var data-var='time'>15:20</var> UTC Resolved - This incident has been resolved. May <var data-var='date'> 6</var>, <var data-var='time'>15:15</var> UTC Monitoring - The hosting provider for app.pinecone.io experienced increased errors and latency starting at 15:00 UTC. At 15:15 UTC, they implemented a fix and are continuing to monitor the impact. This incident did not impact Pinecone APIs or services. May <var data-var='date'> 6</var>, <var data-var='time'>15:00</var> UTC Investigating - We are currently investigating this issue.

Pinecone Console loading slowly for some users

Mar <var data-var='date'>13</var>, <var data-var='time'>09:53</var> UTC Resolved - This incident has been resolved. Mar <var data-var='date'>13</var>, <var data-var='time'>09:23</var> UTC Monitoring - A fix has been implemented and we are monitoring the results. Mar <var data-var='date'>13</var>, <var data-var='time'>08:50</var> UTC Investigating - We are currently investigating this issue.

[GCP][europe-west4] Errors for upsert operations on some indexes

Mar <var data-var='date'> 5</var>, <var data-var='time'>23:02</var> UTC Resolved - This incident has been resolved. Mar <var data-var='date'> 5</var>, <var data-var='time'>22:34</var> UTC Identified - The issue has been identified and a fix is being implemented. Mar <var data-var='date'> 5</var>, <var data-var='time'>21:57</var> UTC Investigating - We are currently investigating this issue.

[AWS][us-east-1] Prometheus metrics are unavailable through the Pinecone console or the metric proxy

Mar <var data-var='date'> 4</var>, <var data-var='time'>22:16</var> UTC Resolved - This incident has been resolved. Mar <var data-var='date'> 4</var>, <var data-var='time'>22:11</var> UTC Monitoring - A fix has been implemented and we are monitoring the results. Mar <var data-var='date'> 4</var>, <var data-var='time'>21:06</var> UTC Investigating - We are currently investigating this issue.

[Serverless][GCP][us-central1] 5xx errors on some read operations for some indexes

Feb <var data-var='date'>24</var>, <var data-var='time'>01:52</var> UTC Resolved - This incident has been resolved. Feb <var data-var='date'>24</var>, <var data-var='time'>01:09</var> UTC Identified - The issue has been identified and a fix is being implemented. Feb <var data-var='date'>24</var>, <var data-var='time'>01:08</var> UTC Monitoring - The impact was related to a Google Cloud Storage incident (Event ID: WDVVRMB). Feb <var data-var='date'>23</var>, <var data-var='time'>23:14</var> UTC Investigating - We are currently investigating this issue.

[GCP][us-central1][europe-west4] Errors on some read operations

Feb <var data-var='date'> 5</var>, <var data-var='time'>21:57</var> UTC Resolved - This incident has been resolved. Feb <var data-var='date'> 5</var>, <var data-var='time'>21:01</var> UTC Monitoring - A fix has been implemented and we are monitoring the results. Feb <var data-var='date'> 5</var>, <var data-var='time'>14:29</var> UTC Identified - The issue has been identified and a fix is being implemented. Feb <var data-var='date'> 5</var>, <var data-var='time'>10:55</var> UTC Investigating - We are currently investigating this issue.

Jan <var data-var='date'>15</var>, <var data-var='time'>15:30</var> UTC Resolved - This incident has been resolved. Jan <var data-var='date'>15</var>, <var data-var='time'>14:30</var> UTC Monitoring - A fix has been implemented and we are monitoring the results. Jan <var data-var='date'>15</var>, <var data-var='time'>13:57</var> UTC Identified - The issue has been identified and a fix is being implemented. Jan <var data-var='date'>15</var>, <var data-var='time'>12:12</var> UTC Investigating - We are currently investigating this issue.

[Serverless][AWS][us-east-1] 5xx errors on read operations for some indexes

Jan <var data-var='date'> 2</var>, <var data-var='time'>17:58</var> UTC Resolved - This incident has been resolved. Jan <var data-var='date'> 2</var>, <var data-var='time'>17:18</var> UTC Monitoring - A fix has been implemented and we are monitoring the results. Jan <var data-var='date'> 2</var>, <var data-var='time'>16:31</var> UTC Investigating - We are currently investigating this issue.

Is Pinecone down?

Pinecone status is UP

Lastest published events

[Pods][AWS][us-east-1] Write failures and high latency

[Serverless][AWS][eu-west-1] 5xx on read requests

[Serverless][AWS][us-west-2] 5xx errors on the readpath

Pinecone Services, Components and Regions

Recent Pinecone events

[Pods][AWS][us-east-1] Write failures and high latency

[Serverless][AWS][eu-west-1] 5xx on read requests

[Serverless][AWS][us-west-2] 5xx errors on the readpath

5xx errors on some control plane operations

[SERVERLESS][GCP][us-central1] 5xx errors on some read and write requests

[SERVERLESS][Azure][eastus2] 5xx errors for some namespaces