<@zlopez:fedora.im>
17:00:09
!startmeeting Infrastructure (2025-01-08)
<@meetbot:fedora.im>
17:00:10
Meeting started at 2026-01-08 17:00:09 UTC
<@meetbot:fedora.im>
17:00:10
The Meeting name is 'Infrastructure (2025-01-08)'
<@zlopez:fedora.im>
17:00:18
!topic Hola y bienvenido
<@zlopez:fedora.im>
17:00:18
!info Fedora Infra documentation: https://docs.fedoraproject.org/en-US/infra
<@zlopez:fedora.im>
17:00:18
!info About our team: https://docs.fedoraproject.org/en-US/cle/
<@zlopez:fedora.im>
17:00:18
!info Agenda is at: https://board.net/p/fedora-infra
<@zlopez:fedora.im>
17:00:18
!chair @nirik:matrix.scrye.com @zlopez:fedora.im @jnsamyak:matrix.org @james:fedora.im @gwmngilfen:fedora.im
<@zlopez:fedora.im>
17:00:18
!meetingname infrastructure
<@meetbot:fedora.im>
17:00:18
The Meeting Name is now infrastructure
<@zlopez:fedora.im>
17:00:22
!hi
<@zodbot:fedora.im>
17:00:23
Michal Konecny (zlopez)
<@zlopez:fedora.im>
17:00:33
Welcome everyone on weekly infra meeting
<@patrikp:matrix.org>
17:00:37
Good evening. π
<@james:fedora.im>
17:01:39
Hey, I'm kind of around but distracted by the other meeting.
<@zlopez:fedora.im>
17:01:46
As this is first meeting in 2026 we will see how much folks will join us
<@paolinsky:fedora.im>
17:01:50
Hello, how can I join the meeting? is there a google meet link or something?
<@paolinsky:fedora.im>
17:01:59
It is my first time here ποΈ
<@zlopez:fedora.im>
17:02:12
It's just text only, so you just joined
<@paolinsky:fedora.im>
17:02:20
Amazing π
<@smooge:fedora.im>
17:03:06
morning
<@smooge:fedora.im>
17:03:27
i am here as sysadmin-emeritus
<@zlopez:fedora.im>
17:03:39
Hi smooge
<@zlopez:fedora.im>
17:03:52
Let's start with first topic
<@zlopez:fedora.im>
17:04:00
!topic New folks introductions
<@zlopez:fedora.im>
17:04:00
!info Getting Started Guide: https://docs.fedoraproject.org/en-US/infra/gettingstarted/
<@zlopez:fedora.im>
17:04:00
!info This is a place where people who are interested in Fedora Infrastructure can introduce themselves
<@zlopez:fedora.im>
17:04:16
Paolinsky: Do you want to say something?
<@paolinsky:fedora.im>
17:04:20
Sure!
<@paolinsky:fedora.im>
17:05:02
My name is Paolo, I am a Colombian software developer, with almost 6 years of experience. I want to contribute to the fedora project to improve my skills and do something that actually matters and impact people. I already checked some repositories on github and found one I think I can contribute too soon
<@paolinsky:fedora.im>
17:05:26
I am studying systems administration so I hope I can contribute there as well in the future
<@paolinsky:fedora.im>
17:05:30
I am so excited!
<@paolinsky:fedora.im>
17:06:12
My name is Paolo, I am a Colombian software developer, with almost 6 years of experience. I want to contribute to the fedora project to improve my skills and do something that actually matters and impact people. I already checked some repositories on github and found one I think I can contribute to soon, during this weekend probably
<@zlopez:fedora.im>
17:06:24
Welcome in Fedora Infra, feel free to reach with questions in #admin:fedoraproject.org channel
<@zlopez:fedora.im>
17:06:53
What you want to work on from GitHub repositories?
<@patrikp:matrix.org>
17:07:02
Welcome!
<@amedvede:fedora.im>
17:07:25
Good evening folks
<@paolinsky:fedora.im>
17:08:00
I found a repository with an API for RPM packages metadata, there is an issue for QoL improvements I can work on
<@paolinsky:fedora.im>
17:08:17
But I have not started yet, I am just reading the code and understanding how the metadata is obtained in first place
<@zlopez:fedora.im>
17:08:45
It takes some time to get used to new project
<@paolinsky:fedora.im>
17:09:12
Sure, I am taking my time to properly understand how things are done. It is my first time contributing to opensource
<@paolinsky:fedora.im>
17:09:25
https://github.com/fedora-infra/mdapi this is the repo btw
<@zlopez:fedora.im>
17:10:14
Akashdeep Dhar did some work on it recently, so he should be able to help if you need help
<@zlopez:fedora.im>
17:10:31
But let's continue with next topic
<@t0xic0der:fedora.im>
17:11:12
Paolinsky, Michal KoneΔnΓ½, Anton Medvedev: hello and happy new year!
<@zlopez:fedora.im>
17:11:16
!info magic eight ball says:
<@zlopez:fedora.im>
17:11:16
!info chair 2026-01-22 - ???
<@zlopez:fedora.im>
17:11:16
!info chair 2026-01-15 - ???
<@zlopez:fedora.im>
17:11:16
!info chair 2026-01-08 - zlopez
<@zlopez:fedora.im>
17:11:16
!topic Next chair
<@t0xic0der:fedora.im>
17:11:27
!hi
<@zodbot:fedora.im>
17:11:28
Akashdeep Dhar (t0xic0der) - he / him / his
<@zlopez:fedora.im>
17:11:32
Welcome Akashdeep Dhar
<@zlopez:fedora.im>
17:11:56
So we are looking for volunteers to chair the next meetings
<@zlopez:fedora.im>
17:12:35
Anybody?
<@amedvede:fedora.im>
17:13:16
hmmm, i'm not really often here on infra meetings but i can take it
<@zlopez:fedora.im>
17:13:50
It's yours
<@zlopez:fedora.im>
17:14:04
!info chair 2026-01-15 - amedvede
<@zlopez:fedora.im>
17:14:36
Anybody want to go for 2026-01-22?
<@patrikp:matrix.org>
17:15:07
I can take 22.
<@zlopez:fedora.im>
17:15:14
Nice
<@zlopez:fedora.im>
17:15:25
!info chair 2026-01-22 - patrikp
<@zodbot:fedora.im>
17:15:29
t0xic0der gave a cookie to amedvede. They now have 2 cookies, 1 of which were obtained in the Fedora 43 release cycle
<@zodbot:fedora.im>
17:15:36
t0xic0der gave a cookie to patrikp. They now have 11 cookies, 3 of which were obtained in the Fedora 43 release cycle
<@amedvede:fedora.im>
17:16:01
!commands
<@zlopez:fedora.im>
17:16:20
That should be enough for now, let's go to next topic
<@zlopez:fedora.im>
17:16:27
!info CLE Infra&Releng NA-hours team has a Monday through Thursday 30 minute meeting going through tickets at 1900 UTC in https://matrix.to/#/#meeting-3:fedoraproject.org
<@zlopez:fedora.im>
17:16:27
!topic announcements and information
<@zlopez:fedora.im>
17:16:40
Anything else to announce?
<@amedvede:fedora.im>
17:18:00
I heard that Rodney want to merge releng and infra sprint meeting, but not sure if it happend from next week or not
<@amedvede:fedora.im>
17:18:16
I heard that Rodney want to merge releng and infra sprint meetings, but not sure if it happen from next week or not
<@zlopez:fedora.im>
17:18:30
I assume this will happen once the migration to forge.fedoraproject.org is finished
<@zlopez:fedora.im>
17:18:50
Infra still isn't completely moved, just documentation for now
<@zlopez:fedora.im>
17:18:55
Which reminds me
<@zlopez:fedora.im>
17:19:34
!info Infra documentation is now living in new repository https://forge.fedoraproject.org/infra/docs
<@zlopez:fedora.im>
17:20:23
It doesn't seem we have anything else to announce now, so let's continue to next thing
<@zlopez:fedora.im>
17:20:29
!info on call from 2026-01-16 to 2026-01-22 - ???
<@zlopez:fedora.im>
17:20:29
!topic Oncall
<@zlopez:fedora.im>
17:20:29
!info https://docs.fedoraproject.org/en-US/infra/day_to_day_fedora/#_the_oncall_role_in_our_team
<@zlopez:fedora.im>
17:20:29
!info on call from 2025-12-19 to 2026-01-08 - Holidays
<@zlopez:fedora.im>
17:20:29
!info on call from 2026-01-09 to 2026-01-15 - greg
<@gwmngilfen:fedora.im>
17:21:01
oh right, meeting, sorry, was writing up QC stuf π
<@gwmngilfen:fedora.im>
17:21:04
oh right, meeting, sorry, was writing up QC stuff π
<@zlopez:fedora.im>
17:21:10
No problem
<@zlopez:fedora.im>
17:22:05
!oncall
<@zodbot:fedora.im>
17:22:06
The following people are oncall:
<@zodbot:fedora.im>
17:22:06
If they do not respond, please file a ticket (https://pagure.io/fedora-infrastructure/issues)
<@zodbot:fedora.im>
17:22:06
β @gwmngilfen:matrix.org (gwmngilfen) Current Time for them: 17:22 (Europe/London)
<@zodbot:fedora.im>
17:22:06
<@zlopez:fedora.im>
17:22:11
Set π
<@gwmngilfen:fedora.im>
17:22:18
ποΈ
<@zlopez:fedora.im>
17:22:27
I can take the oncall duty for the week after
<@zlopez:fedora.im>
17:22:40
!info on call from 2026-01-16 to 2026-01-22 - zlopez
<@zlopez:fedora.im>
17:22:59
!info Summary of last week: (from current oncall)
<@zlopez:fedora.im>
17:23:33
So I found out I was still set as oncall, but nobody reacted if there was any oncall ping, so nothing to report here
<@gwmngilfen:fedora.im>
17:23:57
holidays++
<@zodbot:fedora.im>
17:24:02
Sorry, but Fedora Accounts user 'holidays' does not exist
<@gwmngilfen:fedora.im>
17:24:09
oh shush you
<@zlopez:fedora.im>
17:24:18
Ouch π
<@gwmngilfen:fedora.im>
17:24:42
oh, forgot my hi
<@james:fedora.im>
17:24:43
Also, a few cases of nirik popping in to fix something.
<@gwmngilfen:fedora.im>
17:24:46
!hi
<@zodbot:fedora.im>
17:24:47
Greg Sutcliffe (gwmngilfen) - he / him / his
<@zlopez:fedora.im>
17:25:17
I noticed that π
<@zlopez:fedora.im>
17:25:40
So let's go through backlog refinement
<@zlopez:fedora.im>
17:25:46
!info Refine oldest tickets on Fedora Infra tracker
<@zlopez:fedora.im>
17:25:46
!topic Fedora Infra backlog refinement
<@zlopez:fedora.im>
17:25:46
!link https://pagure.io/fedora-infrastructure/issues?status=Open&order_key=last_updated&order=asc
<@zlopez:fedora.im>
17:26:18
!ticket 11884
<@zodbot:fedora.im>
17:26:19
β **Last Updated:** 9 months ago
<@zodbot:fedora.im>
17:26:19
**fedora-infrastructure #11884** (https://pagure.io/fedora-infrastructure/issue/11884):**RFE: Add a role for deploying through OpenShift deployment**
<@zodbot:fedora.im>
17:26:19
β **Opened:** a year ago by svashisht
<@zodbot:fedora.im>
17:26:19
<@zodbot:fedora.im>
17:26:19
β **Assignee:** Not Assigned
<@gwmngilfen:fedora.im>
17:27:04
wait did we miss monitoring?
<@gwmngilfen:fedora.im>
17:27:23
i mean we can do it after I guess π
<@zlopez:fedora.im>
17:27:38
I don't think we have anything new to add, we would still like the users to have a way to rollout new deployment by themselves
<@zlopez:fedora.im>
17:27:59
Oh sorry, I must have missed it in agenda
<@zlopez:fedora.im>
17:28:14
Let's go through few tickets and let's get back to it
<@gwmngilfen:fedora.im>
17:28:20
sure
<@zlopez:fedora.im>
17:29:59
!ticket 11958
<@zodbot:fedora.im>
17:30:00
<@zodbot:fedora.im>
17:30:00
β **Assignee:** x3mboy
<@zodbot:fedora.im>
17:30:00
β **Last Updated:** 9 months ago
<@zodbot:fedora.im>
17:30:00
**fedora-infrastructure #11958** (https://pagure.io/fedora-infrastructure/issue/11958):**Add fedora-l10n pagure group as an admin to the fedora-l10n-docs namespace projects**
<@zodbot:fedora.im>
17:30:00
β **Opened:** a year ago by peartown
<@zlopez:fedora.im>
17:30:56
Last comment is from x3mboy, I will ping him in the ticket and ask about the progress
<@zlopez:fedora.im>
17:31:37
!ticket 12181
<@zodbot:fedora.im>
17:31:38
**fedora-infrastructure #12181** (https://pagure.io/fedora-infrastructure/issue/12181):**maubot-meetings bot multi line paste is cut**
<@zodbot:fedora.im>
17:31:38
β **Last Updated:** 9 months ago
<@zodbot:fedora.im>
17:31:38
<@zodbot:fedora.im>
17:31:38
β **Opened:** a year ago by man2dev
<@zodbot:fedora.im>
17:31:38
β **Assignee:** ryanlerch
<@zlopez:fedora.im>
17:32:34
Does anybody know if this is still happening?
<@gwmngilfen:fedora.im>
17:33:18
seems easy enough to test
<@zlopez:fedora.im>
17:34:13
It should be visible in the logs for this meeting as I was pasting multiple lines several times already
<@gwmngilfen:fedora.im>
17:34:23
exactly
<@zlopez:fedora.im>
17:34:59
Let me wait for the end of meeting than and I will update the ticket
<@x3mboy:fedora.im>
17:35:21
Oh I totally forgot about this, let me retake the work and I'll share feedback on the ticket
<@zlopez:fedora.im>
17:35:21
!ticket 11950
<@zodbot:fedora.im>
17:35:22
β **Assignee:** dkirwan
<@zodbot:fedora.im>
17:35:22
**fedora-infrastructure #11950** (https://pagure.io/fedora-infrastructure/issue/11950):**vmhost-x86-copr01.rdu-cc.fedoraproject.org DOWN**
<@zodbot:fedora.im>
17:35:22
<@zodbot:fedora.im>
17:35:22
β **Opened:** a year ago by praiskup
<@zodbot:fedora.im>
17:35:22
β **Last Updated:** 9 months ago
<@zodbot:fedora.im>
17:35:31
zlopez gave a cookie to x3mboy. They now have 186 cookies, 2 of which were obtained in the Fedora 43 release cycle
<@zlopez:fedora.im>
17:36:19
Is this still down?
<@gwmngilfen:fedora.im>
17:36:41
atm yes, though probably not for the same reason
<@zlopez:fedora.im>
17:36:42
We did a migration from rdu-cc to rdu3 meanwhile
<@zlopez:fedora.im>
17:37:05
Gwmngilfen: Could you update the ticket?
<@zlopez:fedora.im>
17:37:38
Just add the current state
<@gwmngilfen:fedora.im>
17:37:43
sure
<@james:fedora.im>
17:37:56
Only copr01 machines are p08 (has rdu-cc subdomain) and p09
<@gwmngilfen:fedora.im>
17:39:43
its called vmhost-x8-copr01.rdu3 now
<@gwmngilfen:fedora.im>
17:39:48
its called vmhost-x86-copr01.rdu3 now
<@gwmngilfen:fedora.im>
17:39:51
ticket updated
<@zlopez:fedora.im>
17:40:08
Let's look at the last one
<@zlopez:fedora.im>
17:40:21
!ticket 12388
<@zodbot:fedora.im>
17:40:21
β **Opened:** 11 months ago by vigrond
<@zodbot:fedora.im>
17:40:21
β **Last Updated:** 8 months ago
<@zodbot:fedora.im>
17:40:21
<@zodbot:fedora.im>
17:40:21
β **Assignee:** Not Assigned
<@zodbot:fedora.im>
17:40:21
**fedora-infrastructure #12388** (https://pagure.io/fedora-infrastructure/issue/12388):**Pagure completely broke after re-forking fedora-server**
<@gwmngilfen:fedora.im>
17:41:04
i guess we need to check if it's still an issue, and then check with AurΓ©lien B after that
<@zlopez:fedora.im>
17:41:52
I just checked it now and the fork went through
<@zlopez:fedora.im>
17:42:03
https://pagure.io/fork/zlopez/fedora-server
<@gwmngilfen:fedora.im>
17:42:13
check-n-close then?
<@zlopez:fedora.im>
17:42:16
So I assume whatever the issue was, it's no longer there
<@zlopez:fedora.im>
17:42:31
Let me update the ticket and close it as fixed
<@zlopez:fedora.im>
17:44:38
I will recheck with the user if it's working for him as well
<@zlopez:fedora.im>
17:45:06
That is all regarding tickets for today
<@zlopez:fedora.im>
17:45:26
!info https://nagios.fedoraproject.org/nagios & https://zabbix.fedoraproject.org (top 100 triggers: https://zabbix.fedoraproject.org/zabbix.php?action=toptriggers.list)
<@zlopez:fedora.im>
17:45:26
!info Go over existing items and fix them
<@zlopez:fedora.im>
17:45:26
!topic Monitoring discussion [nirik]
<@gwmngilfen:fedora.im>
17:45:31
i have to dash in a moment, so quickly from me on monitoring...
<@gwmngilfen:fedora.im>
17:45:46
as per our discussion before the break, Zabbix bot is now in the noc channel
<@gwmngilfen:fedora.im>
17:46:00
please do pay attention to it and ack/suppress/close as needed
<@zlopez:fedora.im>
17:46:20
I'm checking both zabbix and nagios right now
<@gwmngilfen:fedora.im>
17:46:23
i've dropped the priority of the cpu load alerts to "Warning" so that we don't get swamped by them
<@gwmngilfen:fedora.im>
17:46:34
(Warning and lower don't go to Matrix)
<@gwmngilfen:fedora.im>
17:46:52
I'm also trialling a trned-based alert for that, though I don't think I have it right yet
<@gwmngilfen:fedora.im>
17:46:57
I'm also trialling a trend-based alert for that, though I don't think I have it right yet
<@gwmngilfen:fedora.im>
17:47:18
I've up the threshold on openqa disk alerts after a chat with AdamW, so that should go off less too
<@gwmngilfen:fedora.im>
17:47:40
thats all for this week i think. I hope to delete the first few things from Nagios soon π
<@zlopez:fedora.im>
17:49:39
We currently have a lot of alerts in Nagios, but most of them are related to recent move from rdu-cc to rdu3 and the machines slowly being redeployed again
<@zlopez:fedora.im>
17:50:36
Other than that there are two alerts about SSL certs being expired soon, but we still have some time
<@zlopez:fedora.im>
17:50:49
That should be all regarding monitoring
<@zlopez:fedora.im>
17:51:07
!topic Open Floor
<@zlopez:fedora.im>
17:51:16
Anything for open floor?
<@amedvede:fedora.im>
17:51:34
I have one idea to discuss
<@zlopez:fedora.im>
17:51:46
Go on
<@amedvede:fedora.im>
17:53:59
sometimes I need to test some scripts on actual pkg on pkgs machine, and for this reason Its nice to use staging servers, but the problem is that for staging servers you also need to be in `sysadmin-main`. So I would like to hear your opinion about idea to create group `sysadmin-main-stg` which gives you same permissions as `sysadmin-main` but only for staging servers
<@zlopez:fedora.im>
17:55:02
Isn't `sysadmin-main` in staging FAS enough?
<@amedvede:fedora.im>
17:55:36
and it makes a sense it case when we would like to promote someone to `sysadmin-main` he or she needs to be in `sysadmin-main-stg` for a half of year as a proof that person won't break anything
<@zlopez:fedora.im>
17:57:04
I think we have specialized sysadmin groups as the sysadmin-main has access to everything
<@james:fedora.im>
17:57:11
Yeh, I was pretty sure I could ssh into random staging servers and `sudo -s` before I got into `sysadmin-main`
<@amedvede:fedora.im>
17:57:17
it's enough, but it's too much risk, but lots of tasks requires access that it gives, so the idea that person with `sysadmin-main-stg` can test his solution on test server and after that provide solution to person who is in `sysadmin-main` to actually run solution
<@zlopez:fedora.im>
17:57:27
Not sure if for dist-git, but for some we do
<@amedvede:fedora.im>
17:57:47
for some yes but for others not
<@amedvede:fedora.im>
17:58:05
for example pkgs.stg pagure-stg02
<@amedvede:fedora.im>
17:58:10
and others
<@james:fedora.im>
17:58:53
Yeh, but I think those are special in some way ... so they also couldn't be in a new `sysadmin-main-stg`
<@zlopez:fedora.im>
17:59:08
I assume we can create group for that on staging FAS
<@amedvede:fedora.im>
18:00:07
because it doesn't seems right to me to request e.g. sysadmin-noc to access pagure-stg if i don't wanna to work with main pagure server
<@zlopez:fedora.im>
18:00:39
Although I'm not sure if this is taken into account on staging servers, will need to test that out
<@amedvede:fedora.im>
18:00:40
the idea is to use only 1 group for accessing all staging infrastructure
<@zlopez:fedora.im>
18:01:32
We have fi-apprentice, it has read-only access to most of the things
<@zlopez:fedora.im>
18:02:06
But the idea isn't bad, to have something that will allow people access to staging
<@zlopez:fedora.im>
18:02:38
We are already overtime, so let us end it here, we can discuss it in #admin:fedoraproject.org channel
<@zlopez:fedora.im>
18:02:48
Thanks everybody for coming today
<@zlopez:fedora.im>
18:02:56
!endmeeting