Fedora Service Status

One of our datacenters primary network link is down. A secondary link is up, but some providers are still trying to route over the down link, resulting in connectivity problems. Affected fedora...

https://status.fedoraproject.org/2024-04-10-datacenter-network.html

The fedora.im / chat.fedoraproject.org and fedoraproject.org matrix servers will be down for 30-45minutes for database maintainance. Messages sent during the outage should arrive after the outage...

https://status.fedoraproject.org/2024-03-14-matrix-updates.html

We're updating copr packages to the new versions which will bring new features and bugfixes. This outage impacts the copr-frontend and the copr-backend .

https://status.fedoraproject.org/2024-03-07-coprupgrade.html

There is an kerberos authentication outage happening right now. Affected is authentication using kinit or fkinit with Fedora kerberos realm.

https://status.fedoraproject.org/2024-02-26-ipa.html

koji will be upgraded to 1.34.0, which requires a schema update that touches many rows. We estimate this will take about 45minutes to complete and during that time, koji will be completely offlin...

https://status.fedoraproject.org/2024-02-20-koji-upgrade.html

Koji is unavailable during F40 mass branching. All builds that will be running at that time for the rawhide will be canceled and can be resubmitted by maintainers after the branching. Once Fedo...

https://status.fedoraproject.org/2024-02-13-koji.html

Incoming emails to fedoraproject.org aliases are currently being rejected. Hopefully service will be restored soon. Service has been restored.

https://status.fedoraproject.org/2024-02-11-email-aliases.html

Koji is currently down due a problem with it's sending of tag events to the fedora message bus. Once we have this corrected, we will bring things back up. Sorry for any trouble. koji should be ...

https://status.fedoraproject.org/2024-02-08-koji-outage.html

We will be applying updates and rebooting servers. No one service should be down long, but may be up and down in the outage window. Additionally, as time permits we will be doing the following ad...

https://status.fedoraproject.org/2024-02-07-server-updates.html

ssh access to fedorapeople.org is currently blocked. We are working with the datacenter to restore access. ssh access should be restored.

https://status.fedoraproject.org/2024-01-26-fedorapeople.html

The bodhi web interface is not working properly. We are working on debugging the issue and bringing the service back online. The bodhi application should be fully back online and working.

https://status.fedoraproject.org/2024-01-26-bodhi.html

The account system is currently down due to a backend server issue. We are working to bring it back up. This also impacts the ability to sign in to most Fedora services with Single Sign On (ips...

https://status.fedoraproject.org/2024-01-22-accounts.html

The ISP related to the Fedora community cage is likely affected by a fiber cut in North Carolina. This situation appears to be causing routing issues from certain locations to the hosted machines...

https://status.fedoraproject.org/2023-12-04-community-cage-network-issues.html

This outage will take approximately 4 hours, and will impact the Fedora Copr Frontend and Fedora Copr Backend services.

https://status.fedoraproject.org/2023-11-28-copr-update.html

The ISP related to the Fedora community cage is likely affected by a fiber cut in North Carolina. This situation appears to be causing routing issues from certain locations to the hosted machines...

https://status.fedoraproject.org/2023-11-22-community-cage-ipv4-issues.html

Switches in the datacenter where pagure.io is will be updated and rebooted. There will be a short outage sometime during the outage window and during this time pagure.io will not be reachable. ...

https://status.fedoraproject.org/2023-11-17-pagure-io.html

We will be updating/rebooting various servers. Services may be up and down in this outage window. All services should be up and working, please report any problems via the ticketing system.

https://status.fedoraproject.org/2023-11-15-mass-updates.html

This outage impacts performance ppc64le tasks in Fedora Copr frontend

https://status.fedoraproject.org/2023-09-08-copr-ppc64le.html

We will be updating/rebooting various servers. Services may be up and down in this outage window.

https://status.fedoraproject.org/2023-08-16-mass-updates.html

This outage impacts the Fedora Copr Frontend .

https://status.fedoraproject.org/2023-08-17-copr-update.html

The Matrix / libera.chat IRC bridge is unavailable currently. See ticket for more information. At this point the bridge doesn't seem like it will be back anytime soon, and everything is moving ...

https://status.fedoraproject.org/2023-08-06-matrix-irc-bridge.html

This outage impacts s390x builds in Fedora Coprfrontend

https://status.fedoraproject.org/2023-08-02-copr-s390x.html

The s390x cluster at the Red Hat Westford location required emergency work on storage which brought down the z15 server which the Fedora and CentOS Stream builders are on. Work is expected to be ...

https://status.fedoraproject.org/2023-06-23-s390x.html

A networking device pagure.io uses to communicate with the world needs an urgent reboot to correct errors. pagure.io will be down for 10-20min as this device is fixed.

https://status.fedoraproject.org/2023-06-20-pagure-outage.html

We are being hit with a Distributed Denial of Service attack on our dns infrastructure. We are working to mitigate it. Update 2023-06-14 22:00UTC: The attack seems over, and we have added mitig...

https://status.fedoraproject.org/2023-06-14-dns-ddos.html

Various network switches and routers will be updated and rebooted. This will result in short times of no connectivity, possibly lasting 20minutes at a time during the outage window.

https://status.fedoraproject.org/2023-06-13-network-upgrades.html

We will be moving the koji buildsystem database (and the virthost it runs on) to RHEL9 and postgresql 15 (from RHEL8 and postgresql 12). This outage will happen while the outage of s390x builders...

https://status.fedoraproject.org/2023-06-01-koji-database.html

The Red Hat Westford location will have more power line work done. This will require the building to be powered down in places which will affect various services like network connections and s390...

https://status.fedoraproject.org/2023-06-01-s390x.html

We will be upgrading our wiki and it's database server along with the virthosts they are hosted on. Update: upgrade is taking longer than expected, so we are extending the outage window to comp...

https://status.fedoraproject.org/2023-05-31-wiki.html

We're updating copr packages to the new versions which will bring new features and bugfixes. This outage impacts the copr-frontend and the copr-backend .

https://status.fedoraproject.org/2023-05-25-coprupgrade.html

We are seeing instability and issues with various web applications. We are investigating the problem. Update: The problem database server has been identified and is being fixed. The database ...

https://status.fedoraproject.org/2023-05-23-web-instablity.html

The virthost running the koji database has stopped responding. We are working on restoring service to koji. The koji database is back up and working

https://status.fedoraproject.org/2023-05-17-kojidb-outage.html

We will be applying updates and rebooting various servers as well as re-installing some. Services may be up and down in the outage window and package maintainers are advised to avoid submmiting b...

https://status.fedoraproject.org/2023-05-17-server-reboots.html

FMN's web interface will be inaccessible during the outage, but the backend service that sends notifications will keep running. No notification will be lost.

https://status.fedoraproject.org/2023-04-26-fmn.html

Element Matrix services are performing maintenance on chat.fedoraproject.org. During the maintenance window the service will be affected as follows: Media uploads and downloads will stop working ...

https://status.fedoraproject.org/2023-04-25-chatoutage.html

Fedora Magazine's WordPress instance is reporting a critical error. This was due to an system error at the provider , which has been resolved.

https://status.fedoraproject.org/2023-04-21-magazine.html

We're updating copr packages to the new versions which will bring new features and bugfixes. This outage impacts the copr-frontend and the copr-backend .

https://status.fedoraproject.org/2023-04-05-coprupgrade.html

https://pagure.io is currently down. There were some issues causing email loops of comments that are being investigated. Update: Pagure services restarted.

https://status.fedoraproject.org/2023-04-04-pagureoutage.html

We will be applying updates and rebooting various servers as well as re-installing some. Services may be up and down in the outage window and package maintainers are advised to avoid submmiting b...

https://status.fedoraproject.org/2023-03-29-server-reboots.html

Power is out in the datacenter with Fedora's s390x builders. All builds will queue until they are back online. update: Power has been restored, but storage is being worked on. update: Storage...

https://status.fedoraproject.org/2023-02-10-s390x-outage.html

We're updating copr packages to the new versions which will bring new features and bugfixes. This outage impacts the copr-frontend and the copr-backend .

https://status.fedoraproject.org/2023-01-25-coproutage.html

We will be upgrading and rebooting various servers. Services may be down during the outage window. Servers were updated and rebooted. A few issues, but everything should be back up and running ...

https://status.fedoraproject.org/2022-11-30-server-updates-reboots.html

We'll just reboot copr-backend into a more powerful machine type. This outage impacts the copr-backend .

https://status.fedoraproject.org/2022-11-30-coproutage.html

We're updating copr packages to the new versions which will bring new features and bugfixes. We are also upgrading our servers to F37. This outage impacts the copr-frontend and the copr-backen...

https://status.fedoraproject.org/2022-11-28-coproutage.html

At about 8UTC the koji database server became unresponsive. We have rebooted it, but load is not coming back under control. We are intestigating the loading issues. Until them koji and associated...

https://status.fedoraproject.org/2022-11-16-koji-db.html

THE PERFORMANCE IS DEGRADED. If possible, please delay your long-running builds and larger rebuilds till Sunday evening. For more info see the outage schedule . Fedora Copr RPM/DNF/YUM storag...

https://status.fedoraproject.org/2022-10-28-copr-storage-change.html

We need to increase the power of one of the Copr VMs. The machine needs to be rebooted, so we expect a several minutes outage. This will affect the copr-backend machine, so RPM repositories wi...

https://status.fedoraproject.org/2022-10-17-copr-backend-reboot.html

The s390x builders are down due to a power issue at the facility they are located in. There are teams onsite working to replace a main breaker. No ETA at this time for completion. During this out...

https://status.fedoraproject.org/s390-builder-outage.html

On 2022-09-27 1gb internal switches will be upgraded. 30min outage is likely during this time period.

https://status.fedoraproject.org/2022-09-27-networking.html

On 2022-09-26 internet edge routers and switches will be upgraded. During this time period various Fedora services will be down as switches and routers are rebooted.

https://status.fedoraproject.org/2022-09-26-networking.html

We're updating copr packages to the new versions which will bring new features and bugfixes. This outage impacts the copr-frontend and the copr-backend .

https://status.fedoraproject.org/2022-09-21-coproutage.html

We're updating copr packages to the new versions which will bring new features and bugfixes. This outage impacts the copr-frontend and the copr-backend .

https://status.fedoraproject.org/2022-08-18-coproutage.html

We will be updating and rebooting various servers to bring them up to date. During the outage window any services may be up and down as proxies and gateways are rebooted. Any fedoraproject servic...

https://status.fedoraproject.org/2022-08-17-serverreboots.html

We're updating copr packages to the new versions which will bring new features and bugfixes. This outage impacts the copr-frontend and the copr-backend .

https://status.fedoraproject.org/2022-07-27-coproutage.html

We're updating copr packages to the new versions which will bring new features and bugfixes. This outage impacts the copr-frontend and the copr-backend .

https://status.fedoraproject.org/2022-06-23-coproutage.html

We're updating copr packages to the new versions which will bring new features and bugfixes. This outage impacts the copr-frontend and the copr-backend .

https://status.fedoraproject.org/2022-06-22-coproutage.html

Updating the host for the Fedora Wiki to Fedora 36, which bumps the version of MediaWiki to 1.37.1

https://status.fedoraproject.org/2022-06-16-wikiupdate.html

We will be deploying a new release of Bodhi with a number of upgrades with openid connect authentication among those. This outage has now started This outage has now finished successfully

https://status.fedoraproject.org/2022-06-09-bodhiupgrades.html

We will be updating and rebooting various servers to bring them up to date. During the outage window any services may be up and down as proxies and gateways are rebooted. Any fedoraproject servic...

https://status.fedoraproject.org/2022-05-18-serverreboots.html

There is an ongoing outage of our main IAD2 datacenter. All servers may be down. We are working on fixing things. This outage is over and everything should be back online.

https://status.fedoraproject.org/2022-05-15-iad2-outage.html

We're updating copr packages to the new versions which will bring new features and bugfixes. This outage impacts the copr-frontend and the copr-backend .

https://status.fedoraproject.org/2022-04-05-coproutage.html

We will be updating and rebooting various servers to bring them up to date. During the outage window any services may be up and down as proxies and gateways are rebooted. Any fedoraproject servic...

https://status.fedoraproject.org/2022-03-31-serverreboots.html

Serveral virthosts (including the one running pagure.io) are not responding. We are working with datacenter staff to evaluate the issue and bring it back on line. There is no ETA at the moment. ...

https://status.fedoraproject.org/2022-03-29-pagure-outage.html

We're updating copr packages to the new versions which will bring new features and bugfixes. This outage affects the copr-frontend and copr-backend

https://status.fedoraproject.org/2022-03-21-coprupgrade.html

There is some unspecified network provider issue in the community cage in our lab. One of know issues is that we can not clone from (and thus build packages hosted on) GitHub on the majority of o...

https://status.fedoraproject.org/2022-02-22-copr-connectivity-problems.html

We will be updating and rebooting various servers to bring them up to date. During the outage window any services may be up and down as proxies and gateways are rebooted. Any fedoraproject servic...

https://status.fedoraproject.org/20220216-serverreboots.html

Copr is going to be migrated from an assigned DigiCert certificate (expires very soon) to the automated Let's Encrypt certificate. We expect that some HTTPD service hiccups can occur, but shouldn...

https://status.fedoraproject.org/2022-02-04-copr-be-letsencrypt.html

We're updating copr packages to the new versions which will bring new features and bugfixes. This outage affects the copr-frontend and copr-backend

https://status.fedoraproject.org/2022-02-03-coprupgrade.html

We're updating copr packages to the new versions which will bring new features and bugfixes. This outage impacted the copr-frontend and the copr-backend

https://status.fedoraproject.org/2022-01-28-coprupgrade.html

We are making some improvements to the performance of the Datanommer database including adding the Timescaledb plugin, a migration to a new database was required as this involved some breaking ch...

https://status.fedoraproject.org/20220117-datanommermigration.html

Copr aarch64 builders are temporarily down due to the Amazon AWS outage - https://status.aws.amazon.com/

https://status.fedoraproject.org/20211207-copr-aarch64-builders.html

Our copr-dist-git proxy is down, and overloaded for some reason. Issue is being debugged. This outage impacts the copr-frontend and the copr-backend .

https://status.fedoraproject.org/20211130-coproutage.html

We're updating Copr servers from Fedora 33 to Fedora 35. The copr-backend storage (Copr build results) will stay mostly online during this outage but some downtime is expected. This outage impa...

https://status.fedoraproject.org/20211130-coprupdate.html

We will be updating and rebooting various servers to bring them up to date. During the outage window any services may be up and down as proxies and gateways are rebooted. Any fedoraproject servic...

https://status.fedoraproject.org/20211117-serverreboots.html

We're updating copr packages to the new versions which will bring new features and bugfixes. This outage impacts the copr-frontend and the copr-backend

https://status.fedoraproject.org/20211111-coprupdate.html

Bodhi (The fedora updates system) will be upgraded to 5.7.1 (This is a reschedule of a previous outage on 2021-11-08)

https://status.fedoraproject.org/20211110-bodhiupgrade.html

Update: s390x builders were not able to be moved for a variety of reasons. We are going to fix those issues and retry next week. We will be doing several maint tasks during this outage: All ...

https://status.fedoraproject.org/20211109-buildsystem.html

We're updating copr packages to the new versions which will bring new features and bugfixes. This outage impacted the copr-frontend and the copr-backend

https://status.fedoraproject.org/2021-10-01-coprupgrade.html

The retrace server https://retrace.fedoraproject.org/faf/ is currently unreachable. This is being worked on currently We are investigating this issue. Please see the ticket below: https://pagure....

https://status.fedoraproject.org/20210924-retrace.html

We're updating copr packages to the new versions which will bring new features and bugfixes. This outage impacts the copr-frontend and the copr-backend

https://status.fedoraproject.org/20210826-coprupgrade.html

There are ongoing issues at our primary datacenter with networking. Many services are unreachable, or are dropping on and off the network. We are working with networking staff to isolate and fix ...

https://status.fedoraproject.org/20210824-network-issues.html

We're updating fedoraproject.org/wiki mediawiki instance. During this outage the wiki will be down.

https://status.fedoraproject.org/20210819-wiki.html

Sporadically, a process on our authentication servers fails, causing user logins to fedora applications to fail until restarted. We are investigating this issue. Please see the ticket below and i...

https://status.fedoraproject.org/20210802-auth.html

We will be applying updates and rebooting servers into new kernels. During the outage window some services may be up and down, but we will try and keep downtime as minimal as possible. MOST SER...

https://status.fedoraproject.org/20210706-systemupgrades.html

We're updating copr packages to the new versions which will bring new features and bugfixes. This outage impacts the copr-frontend and the copr-backend

https://status.fedoraproject.org/20210616-coprupgrade.html

The facility hosting the fedora s390x builders has a site wide power outage scheduled for June 4th to June 6th. We will be powering off these builders at 22UTC on 2021-06-04. It's likely that the...

https://status.fedoraproject.org/20210604-s390x.html

There are ongoing issues using Fedora's authentication system to login to various applications. We are investigating. The authentication issues have been fixed.

https://status.fedoraproject.org/20210526-auth.html

The host for the Blockerbugs web application is being updated from Fedora Linux 32 to Fedora Linux 33. During this time, the Blockerbugs web applcation may not respond.

https://status.fedoraproject.org/20210518-blockerbugs.html

The Fedora project production OpenShift cluster is not processing new connections. We are investiaging. In the mean time accounts, bodhi and many other applications will be down. This was due t...

https://status.fedoraproject.org/20210518-openshift.html

Bodhi (The fedora updates system) will be upgraded to 5.7.0 as well as it's underlaying OS to Fedora 34.

https://status.fedoraproject.org/20210513-bodhiupgrade.html

We're updating copr packages to the new versions which will bring new features and bugfixes. This outage impacted the copr-frontend and the copr-backend

https://status.fedoraproject.org/20210428-coprupgrade.html

A number of updates and patches are pending on our taiga instance teams.fedoraproject.org . During this time the service may be down or unresponsive.

https://status.fedoraproject.org/20210413-teams-fpo-o.html

We will be updating and rebooting various servers to bring them up to date and confirm changes from the recent account system migration. During the outage window services may be up or down as var...

https://status.fedoraproject.org/20210401-systemupgrades.html

Replacement of FAS2 with the new Fedora Accounts All Fedora Services will be affected. As this is the authentication system there may be issues logging in to some services. Users may not be abl...

https://status.fedoraproject.org/20210324-fas-replacement.html

We're updating copr packages to the new versions which will bring new features and bugfixes. This outage impacts the copr-frontend and the copr-backend

https://status.fedoraproject.org/20210317-coprupgrade.html

mbs-backend01.iad2.fedoraproject.org keeps reaching disk full so the disk needs to be grown. This involves a brief shutdown of the instance to enlarge the logical volume. This only affects the Fe...

https://status.fedoraproject.org/20210204-mbsbackend.html

We will be Moving the project from its temporary server to the final, production hosting. Affected Services include: FEDORA PACKAGER DASHBOARD - you can use staging instance for the time being...

https://status.fedoraproject.org/20210202-packagerdashboard.html

We're updating copr packages to the new versions which will bring new features and bugfixes. This outage impacted the copr-frontend and the copr-backend

https://status.fedoraproject.org/20210121-coprupgrade.html

Upgrade to a more recent/patched taiga. Only affected service is taiga (ie: https://teams.fedoraproject.org )

https://status.fedoraproject.org/20210105-taigaupgrade.html

We're updating copr packages to the new versions which will bring new features and bugfixes. This outage impacted the copr-frontend and the copr-backend

https://status.fedoraproject.org/20201201-coprupgrade.html