Scheduled infrastructure maintenance

We will be performing scheduled maintenance on our infrastructure.

During the maintenance window, some Stellate services may experience brief interruptions or temporary degraded performance. We will closely monitor the system throughout the maintenance and work to minimize any impact.

No action is required from customers.

We will perform scheduled maintenance to upgrade internal platform services and authentication infrastructure. A brief service interruption may occur for a small percentage of Stellate Dashboard users while underlying infrastructure components are updated and rotated. DNS names and public API endpoints will remain unchanged.

Scheduled maintenance for internal authentication systems and platform infrastructure.

We will perform scheduled maintenance to upgrade internal agents and Kafka connectors. A brief service interruption may occur while underlying IP addresses are rotated. DNS names will remain unchanged.

Aiven Kafka – Scheduled Maintenance

Our edge provider also rolling out additional updates to infra that should fix any issues left. If you see any issues please reach out to us.

Cache service is experiencing degraded performance for a small percentage of users

Mitigation deployed for garbled responses issue

We have deployed a mitigation for the issue where some GraphQL responses were previously returned as garbled (compressed/binary) data.

The mitigation decodes gzip-encoded responses at the edge if necessary, ensuring that clients consistently receive valid JSON GraphQL responses.

Initial testing with multiple repeated requests confirms that all responses are now correctly parsed and no garbled responses are observed.

We have continued investigating this issue together with our infrastructure partners and have been able to further narrow down the root cause.

The issue is related to intermittent inconsistencies in how compressed responses are handled at the edge. In affected cases, responses may be delivered in a compressed format (e.g. gzip) without the appropriate Content-Encoding header, or may undergo unintended transformations that corrupt the compressed payload. This results in garbled or unreadable responses in the browser.

While initial findings suggested a possible correlation with Cloudflare proxying, we have since observed similar behavior in scenarios where Cloudflare is not involved. This indicates the issue may occur across multiple layers of the delivery path, and we are continuing to work closely with partners including Fastly to isolate and resolve it.

The overall error rate remains low (a small percentage of requests), but we understand the impact of these intermittent failures and are treating this with high priority.

We are actively working on mitigation strategies and will provide another update as soon as we have confirmed improvements or a full resolution.

We are continuing to closely monitor the situation together with our infrastructure partners to ensure the issue is fully resolved and stable.

At this point, the rate of garbled (compressed) responses has significantly decreased, but we are keeping the incident open until we are confident the behavior has fully subsided.

We will provide another update once monitoring confirms full resolution.

**Investigating**

We are currently investigating an issue where a small percentage of requests may return garbled (compressed) responses.

Our analysis indicates this may occur when traffic is proxied through Cloudflare. We are in contact with the provider and awaiting further clarification to ensure a stable resolution.

As a temporary workaround, users can switch their DNS records to **DNS only** (disable Cloudflare proxying), which appears to mitigate the issue.

We will provide further updates as soon as more information becomes available.

Our internal caching service is partially impacted, causing some requests (including those to the Dashboard) to experience delayed or incorrectly compressed responses.

We will perform scheduled maintenance on our Aiven Kafka cluster to apply recommended connector and security updates. A brief service interruption may occur. No impact beyond a short interruption is expected.

Aiven Kafka – Scheduled Maintenance (Connector & Security Updates)

https://www.cloudflarestatus.com/incidents/8gmgl950y3h7

Cloudflare Global Network experiencing issues

We’ve monitored the system for several hours after applying the patch, and everything appears stable — the issue should now be resolved.

Kafka Connectivity Issues Causing Delayed Metrics

We’ve applied the vendor patch to our infrastructure and are currently monitoring system stability and performance.

Our vendor has identified an underlying issue in the Kafka infrastructure affecting SASL connections, and a fix has been released. We’re currently reviewing how to apply the patch and will proceed once confirmed.

We’re currently experiencing connectivity issues between our Clickpipe instances and the Kafka cluster. This is causing backlogs in data processing, which may result in metrics appearing with delays on your dashboard. We are actively working with our Kafka vendor to identify and resolve the underlying network issue.

Is Stellate down?

Stellate status is UP

Lastest published events

Scheduled infrastructure maintenance

Scheduled infrastructure maintenance

Scheduled maintenance for internal authentication systems and platform infrastructure.

Stellate Services, Components and Regions

Recent Stellate events

Scheduled infrastructure maintenance

Scheduled infrastructure maintenance

Scheduled maintenance for internal authentication systems and platform infrastructure.

Aiven Kafka – Scheduled Maintenance

Cache service is experiencing degraded performance for a small percentage of users

Cache service is experiencing degraded performance for a small percentage of users