Status: Resolved All systems are operational. Affected components
 <ul>
 <li>Northern Virginia, US (Operational)</li>
 </ul>

Increase in GitHub queue time

Status: Resolved All systems are operational. Affected components
 <ul>
 <li>GitHub Runners (Operational)</li>
 </ul>

Increase in queue time across GitHub jobs

Elevated queue time for GitHub Actions

Status: Resolved All systems are operational. Affected components
 <ul>
 <li>Container Registry (Operational)</li>
 </ul>

Elevated error rate for container registry

Status: Resolved We've confirmed recovery, jobs are being picked up as normal. Affected components
 <ul>
 <li>GitHub Runners (Operational)</li>
 </ul>

Increased queue time for GitHub Jobs

Status: Resolved All systems are operational.

Invalid GitHub events leading to job queuing

Elevated error rate in GitHub event ingestion

Delayed webhook deliveries from GitHub

Status: Resolved We're seeing delays from GitHub going down, and almost all jobs are now starting without increased latency. Affected components
 <ul>
 <li>GitHub Runners (Operational)</li>
 </ul>

Delayed webhook delivery from GitHub resulting in increased queue time

Status: Resolved All systems are operational. A change performed during a maintenance window was rolled back. Affected components
 <ul>
 <li>MacOS arm64 (Operational)</li>
<li>Northern Virginia, US (Operational)</li>
<li>Support (Operational)</li>
<li>Devboxes (Operational)</li>
<li>Dashboard (Operational)</li>
<li>Western Europe (Operational)</li>
<li>GitHub Runners (Operational)</li>
<li>Artifacts (Operational)</li>
<li>Windows amd64 (Operational)</li>
<li>SAML SSO (Operational)</li>
<li>Linux arm64 on Apple Silicon (Operational)</li>
<li>Gradle (Operational)</li>
<li>Container Registry (Operational)</li>
<li>Linux arm64 (Operational)</li>
<li>Linux amd64 (Operational)</li>
<li>Turborepo (Operational)</li>
<li>Metrics (Operational)</li>
<li>Social SSO (Operational)</li>
<li>Remote Builders (Operational)</li>
<li>Illinois, US (Operational)</li>
<li>Bazel (Operational)</li>
<li>Previews (Operational)</li>
<li>Partner UI (Operational)</li>
<li>Logging (Operational)</li>
<li>HTTP Cache (Operational)</li>
 </ul>

Queue time during maintenance window

Status: Resolved We're seeing delays from GitHub going down, and almost all jobs are now starting without increased latency.

Status: Resolved New jobs are starting as normal.

Jobs started during the period of degraded deliveries are slowly getting picked up as GitHub is working its way through the backlog.

Delayed job notifications from GitHub causing increased queue time

Status: Resolved We applied a mitigation to prioritize a different issuer, certificate issuing has recovered. Affected components
 <ul>
 <li>Previews (Operational)</li>
 </ul>

Subset of certificates for Previews are failing to be issued

Status: Resolved We've confirmed the alternative transit path has fully resolved the connectivity issues. Affected components
 <ul>
 <li>Western Europe (Operational)</li>
 </ul>

Degraded connectivity to GitHub in Europe

Status: Resolved All systems are operational. Affected components
 <ul>
 <li>Previews (Operational)</li>
<li>Western Europe (Operational)</li>
<li>GitHub Runners (Operational)</li>
<li>Bazel (Operational)</li>
<li>SAML SSO (Operational)</li>
<li>Logging (Operational)</li>
<li>Remote Builders (Operational)</li>
<li>Linux arm64 (Operational)</li>
<li>HTTP Cache (Operational)</li>
<li>Devboxes (Operational)</li>
<li>Social SSO (Operational)</li>
<li>Dashboard (Operational)</li>
<li>Container Registry (Operational)</li>
<li>Linux amd64 (Operational)</li>
<li>MacOS arm64 (Operational)</li>
<li>Linux arm64 on Apple Silicon (Operational)</li>
<li>Metrics (Operational)</li>
<li>Illinois, US (Operational)</li>
<li>Windows amd64 (Operational)</li>
<li>Support (Operational)</li>
<li>Partner UI (Operational)</li>
<li>Turborepo (Operational)</li>
<li>Gradle (Operational)</li>
<li>Northern Virginia, US (Operational)</li>
<li>Artifacts (Operational)</li>
 </ul>

Increased error rate and queue time

Status: Resolved All systems are operational. Affected components
 <ul>
 <li>Social SSO (Operational)</li>
 </ul>

Degraded performance of social SSO logins

Status: Resolved We confirm seeing full recovery https://www.githubstatus.com/incidents/gnftqj9htp0g

Delayed GitHub events resulting in increased queue time

Status: Resolved All systems are operational. Affected components
 <ul>
 <li>Devboxes (Operational)</li>
 </ul>

Devboxes unavailable in the Bay Area

Status: Resolved All systems are operational. Affected components
 <ul>
 <li>Western Europe (Operational)</li>
<li>Devboxes (Operational)</li>
 </ul>

Degraded availablity in Western Europe

Status: Resolved We've confirmed jobs are reliably getting picked up again, and queue time has recovered for all workspaces.

Elevated queue time for GitHub Jobs

Status: Resolved We've confirmed the applied mitigation is working and are seeing recovery across the board

Increased queue time

Status: Resolved We've worked through the backlog of jobs, and new jobs have been picked up as normal for a while. Affected components
 <ul>
 <li>GitHub Runners (Operational)</li>
 </ul>

Increased queue time for GitHub jobs

Status: Resolved We've processed the backlog of jobs, and any missed jobs have been picked up in the meantime.

Interruption in webhook processing resulting in a subset of GitHub jobs queuing

Delayed webhook notification from GitHub

Status: Resolved New job events were not ingested which led to perceived queue time. Ingestion has recovered. Affected components
 <ul>
 <li>GitHub Runners (Operational)</li>
<li>Illinois, US (Operational)</li>
<li>Container Registry (Operational)</li>
<li>SAML SSO (Operational)</li>
<li>HTTP Cache (Operational)</li>
<li>Social SSO (Operational)</li>
<li>Western Europe (Operational)</li>
<li>MacOS arm64 (Operational)</li>
<li>Previews (Operational)</li>
<li>Windows amd64 (Operational)</li>
<li>Metrics (Operational)</li>
<li>Dashboard (Operational)</li>
<li>Linux arm64 (Operational)</li>
<li>Linux amd64 (Operational)</li>
<li>Artifacts (Operational)</li>
<li>Support (Operational)</li>
<li>Gradle (Operational)</li>
<li>Devboxes (Operational)</li>
<li>Remote Builders (Operational)</li>
<li>Bazel (Operational)</li>
<li>Northern Virginia, US (Operational)</li>
<li>Partner UI (Operational)</li>
<li>Linux arm64 on Apple Silicon (Operational)</li>
<li>Turborepo (Operational)</li>
<li>Logging (Operational)</li>
 </ul>

GitHub job ingestion failure

Status: Resolved All systems are operational. Affected components
 <ul>
 <li>GitHub Runners (Operational)</li>
<li>Container Registry (Operational)</li>
<li>Artifacts (Operational)</li>
 </ul>

Errors related to "failed to persist audit log entry"

Status: Resolved All systems are operational. Affected components
 <ul>
 <li>Northern Virginia, US (Operational)</li>
<li>Artifacts (Operational)</li>
<li>Previews (Operational)</li>
<li>Devboxes (Operational)</li>
<li>GitHub Runners (Operational)</li>
<li>Remote Builders (Operational)</li>
<li>Container Registry (Operational)</li>
 </ul>

We've been alerted about partial unavailability in one of our regions

Finalized metrics shown in Insights are not fully up to date

Status: Resolved All systems are operational. Affected components
 <ul>
 <li>Logging (Operational)</li>
 </ul>

Partial logs missing

Status: Resolved We've confirmed the applied mitigation resolved the issue, and are seeing recovery across the board. Affected components
 <ul>
 <li>GitHub Runners (Operational)</li>
<li>Northern Virginia, US (Operational)</li>
 </ul>

Ubuntu's package archives report outage affecting Docker builds

Elevated queue time for instance creations

Status: Resolved All systems are operational. Affected components
 <ul>
 <li>GitHub Runners (Operational)</li>
<li>Linux arm64 (Operational)</li>
<li>Bazel (Operational)</li>
<li>Northern Virginia, US (Operational)</li>
<li>Logging (Operational)</li>
<li>Metrics (Operational)</li>
<li>Gradle (Operational)</li>
<li>HTTP Cache (Operational)</li>
<li>Remote Builders (Operational)</li>
<li>Linux amd64 (Operational)</li>
<li>Windows amd64 (Operational)</li>
<li>Partner UI (Operational)</li>
<li>Illinois, US (Operational)</li>
<li>Container Registry (Operational)</li>
<li>Artifacts (Operational)</li>
<li>Previews (Operational)</li>
<li>Social SSO (Operational)</li>
<li>Dashboard (Operational)</li>
<li>Western Europe (Operational)</li>
<li>MacOS arm64 (Operational)</li>
<li>SAML SSO (Operational)</li>
<li>Support (Operational)</li>
<li>Linux arm64 on Apple Silicon (Operational)</li>
<li>Turborepo (Operational)</li>
 </ul>

Is Namespace down?

Namespace status is UP

Lastest published events

Increase in GitHub queue time

Increase in queue time across GitHub jobs

Elevated queue time for GitHub Actions

Namespace Services, Components and Regions

Recent Namespace events

Increase in GitHub queue time

Increase in queue time across GitHub jobs

Elevated queue time for GitHub Actions

Elevated error rate for container registry

Increased queue time for GitHub Jobs

Invalid GitHub events leading to job queuing

Get your FREE account now,
5 monitors included!

Is Namespace down?

Namespace status is UP

Lastest published events

Increase in GitHub queue time

Increase in queue time across GitHub jobs

Elevated queue time for GitHub Actions

Namespace Services, Components and Regions

Recent Namespace events

Increase in GitHub queue time

Increase in queue time across GitHub jobs

Elevated queue time for GitHub Actions

Elevated error rate for container registry

Increased queue time for GitHub Jobs

Invalid GitHub events leading to job queuing

Get your FREE account now,5 monitors included!

Get your FREE account now,
5 monitors included!