Status: Resolved We were impacted by a spike of requests to the v0/events endpoint which bypass our protections in our load balancers causing a saturation of them which impacted on the rest of the requests. 

We have added extra resources to be able to handle any news spikes and we started to work on better protections to avoid any new incident

Load balance unresponsive in GCP US East

Status: Resolved Everything should be working now Affected components
 <ul>
 <li>Events API (Operational)</li>
<li>API Endpoints (Operational)</li>
<li>BI Connector (Operational)</li>
<li>Sinks (Operational)</li>
<li>GCS Connector (Operational)</li>
<li>Kafka (Operational)</li>
<li>Query API (Operational)</li>
<li>CSV Imports (Operational)</li>
<li>Copy (Operational)</li>
<li>S3 Connector (Operational)</li>
 </ul>

Public cluster in GCP us east down

Status: Resolved UI is fully restored and operative Affected components
 <ul>
 <li>Tinybird UI (Operational)</li>
 </ul>

UI is not accessible

Status: Resolved The region is recovered. Affected components
 <ul>
 <li>S3 Connector (Operational)</li>
<li>GCS Connector (Operational)</li>
<li>API Endpoints (Operational)</li>
<li>Query API (Operational)</li>
<li>CSV Imports (Operational)</li>
<li>Copy (Operational)</li>
<li>Events API (Operational)</li>
<li>Kafka (Operational)</li>
<li>Sinks (Operational)</li>
 </ul>

GCP us-east4 region degraded

Status: Resolved All systems back to normal. No remaining lag to process Affected components
 <ul>
 <li>Kafka (Operational)</li>
<li>Kafka (Operational)</li>
 </ul>

Kafka service degradation

Status: Resolved Service is back to normal. Affected components
 <ul>
 <li>API Endpoints (Operational)</li>
<li>BI Connector (Operational)</li>
<li>Copy (Operational)</li>
<li>S3 Connector (Operational)</li>
<li>Events API (Operational)</li>
<li>Query API (Operational)</li>
<li>CSV Imports (Operational)</li>
<li>Sinks (Operational)</li>
<li>Login (Operational)</li>
<li>GCS Connector (Operational)</li>
 </ul>

Service is back to normal in gcp-us-east4

Status: Resolved The incident was caused by a sudden spike of requests. This is now resolved. Affected components
 <ul>
 <li>Events API (Operational)</li>
<li>Kafka (Operational)</li>
<li>API Endpoints (Operational)</li>
<li>Query API (Operational)</li>
<li>BI Connector (Operational)</li>
<li>S3 Connector (Operational)</li>
<li>CSV Imports (Operational)</li>
<li>Copy (Operational)</li>
<li>Sinks (Operational)</li>
<li>Login (Operational)</li>
<li>GCS Connector (Operational)</li>
 </ul>

Degradation in GCP-us-east4

Status: Resolved There was a degradation in the ingestion on gcp-us-east due to some integrity checks, we identified the issue and fixed it. So now we are finishing processing retries and the situation is stable. Affected components
 <ul>
 <li>API Endpoints (Operational)</li>
<li>Events API (Operational)</li>
 </ul>

Degraded performance in gcp-us-east

Status: Resolved Tinybird Dashboard is recovered, the incident in Auth0: https://status.auth0.com/incidents/kknl0nbdzbvx, our identity provider, is now resolved. Affected components
 <ul>
 <li>Tinybird UI (Operational)</li>
 </ul>

Tinybird Dashboard degraded due to Auth0 incident

Status: Resolved The issue was fully resolved at 15:10 UTC Affected components
 <ul>
 <li>API Endpoints (Operational)</li>
<li>BI Connector (Operational)</li>
<li>Events API (Operational)</li>
<li>Query API (Operational)</li>
<li>CSV Imports (Operational)</li>
<li>Copy (Operational)</li>
<li>Sinks (Operational)</li>
<li>S3 Connector (Operational)</li>
<li>Kafka (Operational)</li>
<li>Login (Operational)</li>
<li>Tinybird UI (Operational)</li>
<li>DynamoDB Connector (Operational)</li>
<li>GCS Connector (Operational)</li>
 </ul>

Degraded performance in aws-us-east-1

Status: Resolved Since 10.50 UTC, some service data sources in 4 of our regions have not been reporting data, causing queries to those sources to fail. A fix was deployed, and all queries are working as expected now. Affected components
 <ul>
 <li>API Endpoints (Operational)</li>
<li>API Endpoint (Operational)</li>
<li>API Endpoints (Operational)</li>
<li>API Endpoints (Operational)</li>
<li>API Endpoints (Operational)</li>
<li>API Endpoints (Operational)</li>
<li>API Endpoints (Operational)</li>
<li>API Endpoints (Operational)</li>
 </ul>

Service datasources stop ingesting data and queries using them are failing

Status: Resolved The kafka connector services are now restored

kafka connector malfunction in regions AWS ap-east-1, eu-central-1, eu-west-1 GCP europe-west2, northamerica--northeast2

Status: Resolved We've been monitoring the platform and everything is stable now. We will keep monitoring Affected components
 <ul>
 <li>Events API (Operational)</li>
<li>BI Connector (Operational)</li>
<li>GCS Connector (Operational)</li>
<li>Kafka (Operational)</li>
<li>API Endpoints (Operational)</li>
<li>Query API (Operational)</li>
<li>CSV Imports (Operational)</li>
<li>Copy (Operational)</li>
<li>Sinks (Operational)</li>
<li>S3 Connector (Operational)</li>
 </ul>

Outage in the GCP US EAST region

Status: Resolved The platform is stable again and everything is working as expected Affected components
 <ul>
 <li>API Endpoints (Operational)</li>
<li>Copy (Operational)</li>
<li>CSV Imports (Operational)</li>
<li>S3 Connector (Operational)</li>
<li>GCS Connector (Operational)</li>
<li>Query API (Operational)</li>
<li>Sinks (Operational)</li>
<li>BI Connector (Operational)</li>
 </ul>

Is Tinybird down?

Tinybird status is UP

Lastest published events

Load balance unresponsive in GCP US East

Public cluster in GCP us east down

UI is not accessible

Tinybird Services, Components and Regions

Recent Tinybird events

Load balance unresponsive in GCP US East

Public cluster in GCP us east down

UI is not accessible

GCP us-east4 region degraded

Kafka service degradation

Service is back to normal in gcp-us-east4

Get your FREE account now,
5 monitors included!

Is Tinybird down?

Tinybird status is UP

Lastest published events

Load balance unresponsive in GCP US East

Public cluster in GCP us east down

UI is not accessible

Tinybird Services, Components and Regions

Recent Tinybird events

Load balance unresponsive in GCP US East

Public cluster in GCP us east down

UI is not accessible

GCP us-east4 region degraded

Kafka service degradation

Service is back to normal in gcp-us-east4

Get your FREE account now,5 monitors included!

Get your FREE account now,
5 monitors included!