Duration: 5 days, 1 hour and 52 minutes

Affected Components: Database

Sep 24, 16:23:54 GMT+0
Identified - All projects affected by the upstream infrastructure issues, and mitigation efforts are underway internally. These affected projects will be brought back up on new hardware as quickly as possible..

Sep 24, 15:36:10 GMT+0
Investigating - We are investigating project lifecycle operation issues in eu-west-1..

Sep 24, 15:50:26 GMT+0
Identified - We have isolated the scope of the problem to a specific upstream incident. We are working to address the upstream incident and determine mitigations..

Sep 24, 16:56:04 GMT+0
Identified - Most projects have been brought back up, and the team is working on the remaining projects, which should be completed soon. This issue was related to specific underlying hardware in the region, so this was isolated to only projects on that hardware. Project lifecycle operations (restarts, upgrades, etc) broadly across the region remain available..

Sep 24, 17:03:16 GMT+0
Identified - The remaining projects have now been brought back up, and we have no projects remaining on the unhealthy underlying hardware in the upstream infrastructure. We are monitoring to ensure ongoing stability..

Sep 24, 17:12:33 GMT+0
Monitoring - We are continuing to monitor to ensure ongoing stability..

Sep 24, 17:38:02 GMT+0
Resolved - This incident has been resolved..

Duration: 3 days and 16 hours

Affected Components: Database

Sep 23, 09:21:14 GMT+0
Investigating - We are currently investigating this issue.

Sep 23, 09:39:45 GMT+0
Identified - We've identified the issue affecting project creation and are implementing a fix. Users may experience delays when creating new projects while we work to resolve this..

Sep 23, 09:54:10 GMT+0
Monitoring - A fix has been implemented and we are monitoring the results..

Sep 23, 10:49:14 GMT+0
Resolved - This incident has been resolved..

Duration: 5 days and 26 minutes

Affected Components: Database

Aug 24, 13:52:42 GMT+0
Investigating - We are investigating an issue affecting automatic disk resizing. Some projects may experience delays before a resize is completed, while others may see repeated or duplicate resize operations. We are working to identify the cause and will provide an update as soon as we have more information..

Aug 24, 14:47:53 GMT+0
Monitoring - A fix has been applied, and the issue is now resolved. We are moving the incident to monitoring. We will continue to follow up directly with affected users who opened a support ticket..

Aug 24, 15:53:09 GMT+0
Resolved - The issue affecting automatic disk resizing has been resolved. We will continue to follow up directly with affected users who opened a support ticket..

Duration: 22 days, 3 hours and 31 minutes

Affected Components: Database

Jul 1, 03:23:43 GMT+0
Identified - We are continuing to remediate the capacity constraints affecting multiple regions (ap-northeast-1, ap-northeast-2, ap-south-1, ap-southeast-1, ap-southeast-2, eu-central-2, eu-north-1, sa-east-1, us-east-1, us-east-2). Project operations that require capacity in these regions may continue to fail or require a re-try. We will provide another update as soon as more information is available..

Jun 30, 02:38:13 GMT+0
Investigating - We are currently investigating an issue affecting project creation in multiple regions..

Jun 30, 02:43:49 GMT+0
Investigating - Project creation is impacted across multiple regions, we are investigating the root cause..

Jun 30, 03:08:41 GMT+0
Investigating - We have identified the issue and confirmed that impact extends beyond project creation. Project creation, project resizing, branch provisioning, and project restarts are currently affected across multiple regions. We will share another update as soon as we have more information..

Jun 30, 03:38:57 GMT+0
Identified - We have identified the issue and are working on a fix. Impact is currently affecting project creation, project resizing, branch provisioning, and project restarts across multiple regions. We will provide another update as soon as we have more information..

Jun 30, 04:32:20 GMT+0
Identified - We are continuing to work on a fix for the issue and will provide updates as more information is available..

Jun 30, 05:11:59 GMT+0
Identified - We are still working to resolve the issue affecting project creation, project resizing, branch provisioning, and project restarts across multiple regions. We will continue to provide updates as our work progresses..

Jun 30, 06:49:02 GMT+0
Identified - We are still working to resolve the issue affecting project creation, project resizing, branch provisioning, and project restarts across multiple regions. We will continue to provide updates as our work progresses..

Jun 30, 11:20:04 GMT+0
Identified - Additional capacity has been made available in the majority of regions, and we're seeing reduced failure rates in terms of project creation, project resizing, branch provisioning, and project restarts. We are still experiencing limited instance capacity in ap-northeast-2, ap-south-1, and eu-north-1. As a result, project operations that require capacity in these regions, including project creation, resizing, branch provisioning, restarts, may continue to fail. We are actively working to restore full capacity and will provide another update as soon as more information is available..

Jun 30, 18:58:41 GMT+0
Identified - We are continuing to investigate the remaining capacity constraints affecting ap-northeast-2, ap-south-1, and eu-north-1. Project operations that require capacity in these regions may continue to fail. We will provide another update as soon as more information is available..

Jun 30, 22:22:56 GMT+0
Identified - We are continuing to investigate the remaining capacity constraints affecting ap-northeast-2, ap-south-1, and eu-north-1. Project operations that require capacity in these regions may continue to fail. We will provide another update as soon as more information is available..

Jul 1, 16:58:37 GMT+0
Identified - We continue to experience widespread capacity constraints across most regions, affecting project creation, project resizing, project restarts, branch provisioning, and restores. As a result, some users may experience repeated failures when attempting these operations. Our team is actively implementing mitigation measures to increase capacity and restore normal service. We will provide further updates as the situation evolves. If you're attempting to create a new project, we recommend waiting until the incident has progressed and the status page indicates that additional capacity has been made available before retrying. This issue does not affect existing running projects or their availability..

Jul 1, 10:12:44 GMT+0
Identified - We continue to experience intermittent capacity related issues across all regions, impacting operations such as project creation, project resizing, branch provisioning, and project restarts. These operations may fail intermittently or require one or more retries to complete successfully. Our team is actively investigating ways to improve the situation and is implementing a number of mitigation measures to reduce the impact on affected operations. We will provide another update as soon as more information becomes available..

Jul 2, 01:30:02 GMT+0
Identified - We continue to experience widespread capacity constraints across most regions, affecting project creation, project resizing, project restarts, branch provisioning, and restores. As a result, some users may experience repeated failures when attempting these operations. Our team is actively implementing mitigation measures to increase capacity and restore normal service. We will provide further updates as the situation evolves. If you're attempting to create a new project, we recommend waiting until the incident has progressed and the status page indicates that additional capacity has been made available before retrying. This issue does not affect existing projects or their availability unless the instance undergoes restarts, restores, or database upgrades..

Jul 2, 05:53:07 GMT+0
Identified - We are seeing capacity improvements across all regions, but are continuing to work on a full mitigation for all users. Project creation, project resizing, project restarts, branch provisioning, and restores are slowly recovering and we are asking users to re-try their database actions. Please reach out to our Support if you continue to fail. Running projects are unaffected and stay available. The issue has only surfaced during a restart, restore, or database upgrade. We are still addressing an issue with Read Replicas and continuing to increase capacity to restore normal service in full with highest priority..

Jul 2, 10:40:45 GMT+0
Identified - We continue to see capacity improvements across all regions and have implemented mitigation measures to sustain capacity. Project creation, resizing, restarts, branch revisioning, and restores are continuing to recover, and we ask users to retry their database actions. Please reach out to our support if you continue to see failures. Our team is actively working to restore the remaining affected projects. We will provide further updates as this work progresses. This issue does not affect existing projects or their availability unless the instance has undergone restarts with stores or database upgrades while the incident has been in progress.

Jul 2, 15:08:17 GMT+0
Identified - We continue to see capacity improvements across all regions and have implemented mitigation measures to sustain capacity. Project creation, resizing, restarts, and branch operations are continuing to recover, and we ask users to retry their database actions. Please reach out to our support if you continue to see failures. We are working to recover subset of projects which are still down due to infrastructure compatibility constraints. Our team is actively working on solutions to restore these remaining affected projects and will provide further updates as this work progresses. This issue does not affect existing projects or their availability unless the instance has undergone restarts or resizes while the incident has been in progress..

Jul 3, 09:43:42 GMT+0
Identified - We currently have capacity available across all regions and are continuing to make progress on our remaining mitigation work, primarily by bringing additional capacity online. This is currently our top priority. We are also recovering a subset of projects which are still down due to infrastructure compatibility constraints. Our team is continuing to restore these remaining affected projects and will provide further updates as this work progresses. This issue does not affect existing projects or their availability unless the instance has undergone restarts or resizes while the incident has been in progress..

Jul 3, 16:03:14 GMT+0
Identified - Capacity is currently available across all regions, and we are continuing to progress the remaining mitigation work, including bringing additional capacity online. This remains our highest priority. We have recovered most projects that were unavailable due to infrastructure compatibility constraints. Our team is continuing to restore the remaining affected projects and will provide further updates as this work progresses. The remaining impact is primarily limited to Medium instances running PostgreSQL versions earlier than 17.6.1.121. New project deployments should succeed, but restarts or resizes for projects matching this profile may fail. Existing projects are not affected unless they have been restarted or resized during this incident..

Jul 3, 19:57:30 GMT+0
Identified - We're continuing to work through elevated capacity errors affecting some restart and resize operations. Availability for smaller compute sizes has improved across most regions, and error rates are trending down. Capacity for some smaller compute sizes remains constrained in a number of regions, most notably Medium. We are actively adding capacity across all regions to relieve this. If your project is on Postgres 17.6.1.121 or earlier, upgrading to 17.6.1.121 or higher gives it access to additional machine types, which improves the likelihood of a successful restart or resize in affected regions. You can check your current version and start an upgrade from your project's infrastructure settings: https://supabase.com/dashboard/project/_/settings/infrastructure If your project is affected and you're unable to resize or restart, our support team can help. We'll update this page as the situation materially changes..

Jul 4, 04:34:48 GMT+0
Identified - Update - Availability for smaller compute sizes has improved across most regions, and error rates are trending down. We are continuing to monitor available capacity in all regions. If your project is on a version older than Postgres 17.6.1.121, upgrading to 17.6.1.121 and above will grant access to additional machine types, which improves the likelihood of a successful restart or resize. You can check your current version and start an upgrade from your project's infrastructure settings here: https://supabase.com/dashboard/project/_/settings/infrastructure If your project is affected and you're unable to resize or restart, our support team can help. We'll update this page as the situation materially changes..

Jul 4, 22:40:14 GMT+0
Identified - We are continuing to monitor available capacity in all regions. If your project is on a version older than Postgres 17.6.1.121, upgrading to 17.6.1.121 and above will grant access to additional machine types, which improves the likelihood of a successful restart or resize. You can check your current version and start an upgrade from your project's infrastructure settings here: https://supabase.com/dashboard/project/_/settings/infrastructure If your project is affected and you're unable to resize or restart, our support team can help. We'll update this page as the situation materially changes..

Jul 6, 11:32:36 GMT+0
Identified - Capacity has continued to recover across all regions, and the large majority of restart, resize, and project-creation operations are now completing normally. We are continuing to monitor the system. The remaining impact is limited to projects running a Postgres version older than 17.6.1.121. These older versions can only run on a narrower set of instance types, which are the ones still under capacity pressure, so a restart or resize may fail or need a retry. Projects on 17.6.1.121 or newer can run on a wider set of instance types and are much less likely to be affected. If a restart or resize is failing, upgrading to Postgres 17.6.1.121 or newer resolves it in most cases. You can check your current version and start an upgrade from your project's infrastructure settings here: https://supabase.com/dashboard/project/_/settings/infrastructure If you're still unable to resize or restart after upgrading, our support team can help. We will update this page as the situation materially changes..

Jul 6, 16:36:49 GMT+0
Monitoring - Capacity has continued to recover across all regions, and the large majority of restart, resize, and project-creation operations are now completing normally. We are continuing to monitor the system. We have added additional mitigations and machine types available to all Postgres versions, and we are also seeing error rates for these users stabilize. While there is still ongoing work behind the scenes to continue to improve our resiliency, users should no longer be affected by capacity issues stemming from this incident. We are showing stable capacity across all regions on all machine sizes and types. We will be monitoring this for the next day or two at least just to ensure the ongoing work is effective and we don't have any re-occurrence of these or similar issues before we resolve this entirely. If you continue to receive errors relating to capacity, please notify our support team via https://supabase.help and reference this status page..

Jul 13, 16:00:12 GMT+0
Resolved - Capacity availability and project creation, resize, and restart operations have returned to normal and have remained stable for an extended period of time. We are resolving this incident. Out of an abundance of caution, and out of respect for the impact this incident had for our users, we held the incident open for a considerable amount of time after the observed impact was mitigated. We wanted to be certain any residual potential impact was fully cleared before formally resolving the statuspage..

Jul 8, 16:41:39 GMT+0
Monitoring - We continue to monitor capacity recovery across all regions. We have added additional mitigations and machine types available to all Postgres versions, and we are also seeing error rates for these users stabilize. While there is still ongoing work behind the scenes to continue to improve our resiliency, users should no longer be affected by capacity issues stemming from this incident. We are showing stable capacity across all regions on all machine sizes and types. We will be monitoring this thru the rest of the week to ensure ongoing work is effective and we don't have any re-occurrence of these or similar issues before we resolve this entirely..

Jul 10, 18:41:44 GMT+0
Monitoring - We continue to monitor capacity across all regions. The additional mitigations and machine types available to all Postgres versions are contributing to capacity stability. We continue to work to improve our resiliency. We will continue monitoring closely to ensure ongoing work is effective and we don't have any re-occurrence of these or similar issues before we resolve this entirely..

Duration: 3 days, 3 hours and 41 minutes

Affected Components: Database

Jun 23, 15:16:57 GMT+0
Investigating - We are investigating errors in creating and unpausing projects in the eu-west-1 region..

Jun 23, 15:26:40 GMT+0
Identified - We have identified the issue is related to keys and are preparing a mitigation..

Jun 23, 15:43:13 GMT+0
Identified - Multiple mitigations have been deployed and project create performance is improving..

Jun 23, 15:46:38 GMT+0
Identified - During this incident, postgres upgrade functionality has also been affected. The key updates are being deployed and other mitigations continue to take effect..

Jun 23, 16:01:57 GMT+0
Monitoring - Key updates and other mitigations have been fully deployed and project creation and unpause functionality is returning to normal. We will continue to monitor this region for stability for the next 30 minutes..

Jun 23, 16:32:38 GMT+0
Resolved - Project create and unpause operations have returned to normal and remained stable for the past 30 minutes..

Duration: 2 hours

Affected Components: Internal Authentication, Dashboard, External Authentication, Documentation, Landing Page

May 15, 08:00:00 GMT+0
Identified - We are planning to move all web operations to Vercel, for improved security and faster content delivery. Website delivery during this time may be affected and you may not be able to create new accounts for services using James Auth. The website will be offline and unaccessible for aprox. 2 hours..

May 15, 08:00:01 GMT+0
Identified - Maintenance is now in progress.

May 15, 10:00:00 GMT+0
Completed - Maintenance has completed successfully.

Duration: 5 days and 57 minutes

Affected Components: Internal Authentication

May 5, 14:21:21 GMT+0
Investigating - When clicking the reset password link in the password reset email, it does not prompt you to reset your password. We are currently investigating this incident further..

May 10, 15:18:08 GMT+0
Resolved - This incident has been resolved. In future, please contact us to reset your password..