2026-01-08 17:00:09 <@zlopez:fedora.im> !startmeeting Infrastructure (2025-01-08)
2026-01-08 17:00:10 <@meetbot:fedora.im> Meeting started at 2026-01-08 17:00:09 UTC
2026-01-08 17:00:10 <@meetbot:fedora.im> The Meeting name is 'Infrastructure (2025-01-08)'
2026-01-08 17:00:18 <@zlopez:fedora.im> !topic Hola y bienvenido
2026-01-08 17:00:18 <@zlopez:fedora.im> !info Fedora Infra documentation: https://docs.fedoraproject.org/en-US/infra
2026-01-08 17:00:18 <@zlopez:fedora.im> !info About our team: https://docs.fedoraproject.org/en-US/cle/
2026-01-08 17:00:18 <@zlopez:fedora.im> !info Agenda is at: https://board.net/p/fedora-infra
2026-01-08 17:00:18 <@zlopez:fedora.im> !chair @nirik:matrix.scrye.com @zlopez:fedora.im  @jnsamyak:matrix.org  @james:fedora.im @gwmngilfen:fedora.im
2026-01-08 17:00:18 <@zlopez:fedora.im> !meetingname infrastructure
2026-01-08 17:00:18 <@meetbot:fedora.im> The Meeting Name is now infrastructure
2026-01-08 17:00:22 <@zlopez:fedora.im> !hi
2026-01-08 17:00:23 <@zodbot:fedora.im> Michal Konecny (zlopez)
2026-01-08 17:00:33 <@zlopez:fedora.im> Welcome everyone on weekly infra meeting
2026-01-08 17:00:37 <@patrikp:matrix.org> Good evening. 👋
2026-01-08 17:01:39 <@james:fedora.im> Hey, I'm kind of around but distracted by the other meeting.
2026-01-08 17:01:46 <@zlopez:fedora.im> As this is first meeting in 2026 we will see how much folks will join us
2026-01-08 17:01:50 <@paolinsky:fedora.im> Hello, how can I join the meeting? is there a google meet link or something?
2026-01-08 17:01:59 <@paolinsky:fedora.im> It is my first time here 👁️
2026-01-08 17:02:12 <@zlopez:fedora.im> It's just text only, so you just joined
2026-01-08 17:02:20 <@paolinsky:fedora.im> Amazing 💃
2026-01-08 17:03:06 <@smooge:fedora.im> morning
2026-01-08 17:03:27 <@smooge:fedora.im> i am here as sysadmin-emeritus
2026-01-08 17:03:39 <@zlopez:fedora.im> Hi smooge
2026-01-08 17:03:52 <@zlopez:fedora.im> Let's start with first topic
2026-01-08 17:04:00 <@zlopez:fedora.im> !topic New folks introductions
2026-01-08 17:04:00 <@zlopez:fedora.im> !info Getting Started Guide: https://docs.fedoraproject.org/en-US/infra/gettingstarted/
2026-01-08 17:04:00 <@zlopez:fedora.im> !info This is a place where people who are interested in Fedora Infrastructure can introduce themselves
2026-01-08 17:04:16 <@zlopez:fedora.im> Paolinsky: Do you want to say something?
2026-01-08 17:04:20 <@paolinsky:fedora.im> Sure!
2026-01-08 17:05:02 <@paolinsky:fedora.im> My name is Paolo, I am a Colombian software developer, with almost 6 years of experience. I want to contribute to the fedora project to improve my skills and do something that actually matters and impact people. I already checked some repositories on github and found one I think I can contribute too soon
2026-01-08 17:05:26 <@paolinsky:fedora.im> I am studying systems administration so I hope I can contribute there as well in the future
2026-01-08 17:05:30 <@paolinsky:fedora.im> I am so excited!
2026-01-08 17:06:12 <@paolinsky:fedora.im> My name is Paolo, I am a Colombian software developer, with almost 6 years of experience. I want to contribute to the fedora project to improve my skills and do something that actually matters and impact people. I already checked some repositories on github and found one I think I can contribute to soon, during this weekend probably
2026-01-08 17:06:24 <@zlopez:fedora.im> Welcome in Fedora Infra, feel free to reach with questions in #admin:fedoraproject.org channel
2026-01-08 17:06:53 <@zlopez:fedora.im> What you want to work on from GitHub repositories?
2026-01-08 17:07:02 <@patrikp:matrix.org> Welcome!
2026-01-08 17:07:25 <@amedvede:fedora.im> Good evening folks
2026-01-08 17:08:00 <@paolinsky:fedora.im> I found a repository with an API for RPM packages metadata, there is an issue for QoL improvements I can work on
2026-01-08 17:08:17 <@paolinsky:fedora.im> But I have not started yet, I am just reading the code and understanding how the metadata is obtained in first place
2026-01-08 17:08:45 <@zlopez:fedora.im> It takes some time to get used to new project
2026-01-08 17:09:12 <@paolinsky:fedora.im> Sure, I am taking my time to properly understand how things are done. It is my first time contributing to opensource
2026-01-08 17:09:25 <@paolinsky:fedora.im> https://github.com/fedora-infra/mdapi this is the repo btw
2026-01-08 17:10:14 <@zlopez:fedora.im> Akashdeep Dhar did some work on it recently, so he should be able to help if you need help
2026-01-08 17:10:31 <@zlopez:fedora.im> But let's continue with next topic
2026-01-08 17:11:12 <@t0xic0der:fedora.im> Paolinsky, Michal Konečný, Anton Medvedev: hello and happy new year! 
2026-01-08 17:11:16 <@zlopez:fedora.im> !info magic eight ball says:
2026-01-08 17:11:16 <@zlopez:fedora.im> !info chair 2026-01-22 - ???
2026-01-08 17:11:16 <@zlopez:fedora.im> !info chair 2026-01-15 - ???
2026-01-08 17:11:16 <@zlopez:fedora.im> !info chair 2026-01-08 - zlopez
2026-01-08 17:11:16 <@zlopez:fedora.im> !topic Next chair
2026-01-08 17:11:27 <@t0xic0der:fedora.im> !hi
2026-01-08 17:11:28 <@zodbot:fedora.im> Akashdeep Dhar (t0xic0der) - he / him / his
2026-01-08 17:11:32 <@zlopez:fedora.im> Welcome Akashdeep Dhar 
2026-01-08 17:11:56 <@zlopez:fedora.im> So we are looking for volunteers to chair the next meetings
2026-01-08 17:12:35 <@zlopez:fedora.im> Anybody?
2026-01-08 17:13:16 <@amedvede:fedora.im> hmmm, i'm not really often here on infra meetings but i can take it
2026-01-08 17:13:50 <@zlopez:fedora.im> It's yours
2026-01-08 17:14:04 <@zlopez:fedora.im> !info chair 2026-01-15 - amedvede
2026-01-08 17:14:36 <@zlopez:fedora.im> Anybody want to go for 2026-01-22?
2026-01-08 17:15:07 <@patrikp:matrix.org> I can take 22.
2026-01-08 17:15:14 <@zlopez:fedora.im> Nice
2026-01-08 17:15:25 <@zlopez:fedora.im> !info chair 2026-01-22 - patrikp
2026-01-08 17:15:29 <@zodbot:fedora.im> t0xic0der gave a cookie to amedvede. They now have 2 cookies, 1 of which were obtained in the Fedora 43 release cycle
2026-01-08 17:15:36 <@zodbot:fedora.im> t0xic0der gave a cookie to patrikp. They now have 11 cookies, 3 of which were obtained in the Fedora 43 release cycle
2026-01-08 17:16:01 <@amedvede:fedora.im> !commands
2026-01-08 17:16:20 <@zlopez:fedora.im> That should be enough for now, let's go to next topic
2026-01-08 17:16:27 <@zlopez:fedora.im> !info CLE Infra&Releng NA-hours team has a Monday through Thursday 30 minute meeting going through tickets at 1900 UTC in https://matrix.to/#/#meeting-3:fedoraproject.org
2026-01-08 17:16:27 <@zlopez:fedora.im> !topic announcements and information
2026-01-08 17:16:40 <@zlopez:fedora.im> Anything else to announce?
2026-01-08 17:18:00 <@amedvede:fedora.im> I heard that Rodney want to merge releng and infra sprint meeting, but not sure if it happend from next week or not
2026-01-08 17:18:16 <@amedvede:fedora.im> I heard that Rodney want to merge releng and infra sprint meetings, but not sure if it happen from next week or not
2026-01-08 17:18:30 <@zlopez:fedora.im> I assume this will happen once the migration to forge.fedoraproject.org is finished
2026-01-08 17:18:50 <@zlopez:fedora.im> Infra still isn't completely moved, just documentation for now
2026-01-08 17:18:55 <@zlopez:fedora.im> Which reminds me
2026-01-08 17:19:34 <@zlopez:fedora.im> !info Infra documentation is now living in new repository https://forge.fedoraproject.org/infra/docs
2026-01-08 17:20:23 <@zlopez:fedora.im> It doesn't seem we have anything else to announce now, so let's continue to next thing
2026-01-08 17:20:29 <@zlopez:fedora.im> !info on call from 2026-01-16 to 2026-01-22 - ???
2026-01-08 17:20:29 <@zlopez:fedora.im> !topic Oncall
2026-01-08 17:20:29 <@zlopez:fedora.im> !info https://docs.fedoraproject.org/en-US/infra/day_to_day_fedora/#_the_oncall_role_in_our_team
2026-01-08 17:20:29 <@zlopez:fedora.im> !info on call from 2025-12-19 to 2026-01-08 - Holidays
2026-01-08 17:20:29 <@zlopez:fedora.im> !info on call from 2026-01-09 to 2026-01-15 - greg
2026-01-08 17:21:01 <@gwmngilfen:fedora.im> oh right, meeting, sorry, was writing up QC stuf 😛
2026-01-08 17:21:04 <@gwmngilfen:fedora.im> oh right, meeting, sorry, was writing up QC stuff 😛
2026-01-08 17:21:10 <@zlopez:fedora.im> No problem
2026-01-08 17:22:05 <@zlopez:fedora.im> !oncall
2026-01-08 17:22:06 <@zodbot:fedora.im> The following people are oncall:
2026-01-08 17:22:06 <@zodbot:fedora.im> If they do not respond, please file a ticket (https://pagure.io/fedora-infrastructure/issues)
2026-01-08 17:22:06 <@zodbot:fedora.im> ● @gwmngilfen:matrix.org (gwmngilfen) Current Time for them: 17:22 (Europe/London)
2026-01-08 17:22:06 <@zodbot:fedora.im> 
2026-01-08 17:22:11 <@zlopez:fedora.im> Set 🙂
2026-01-08 17:22:18 <@gwmngilfen:fedora.im> 👍️
2026-01-08 17:22:27 <@zlopez:fedora.im> I can take the oncall duty for the week after
2026-01-08 17:22:40 <@zlopez:fedora.im> !info on call from 2026-01-16 to 2026-01-22 - zlopez
2026-01-08 17:22:59 <@zlopez:fedora.im> !info Summary of last week: (from current oncall)
2026-01-08 17:23:33 <@zlopez:fedora.im> So I found out I was still set as oncall, but nobody reacted if there was any oncall ping, so nothing to report here
2026-01-08 17:23:57 <@gwmngilfen:fedora.im> holidays++
2026-01-08 17:24:02 <@zodbot:fedora.im> Sorry, but Fedora Accounts user 'holidays' does not exist
2026-01-08 17:24:09 <@gwmngilfen:fedora.im> oh shush you
2026-01-08 17:24:18 <@zlopez:fedora.im> Ouch 😄
2026-01-08 17:24:42 <@gwmngilfen:fedora.im> oh, forgot my hi
2026-01-08 17:24:43 <@james:fedora.im> Also, a few cases of nirik popping in to fix something.
2026-01-08 17:24:46 <@gwmngilfen:fedora.im> !hi
2026-01-08 17:24:47 <@zodbot:fedora.im> Greg Sutcliffe (gwmngilfen) - he / him / his
2026-01-08 17:25:17 <@zlopez:fedora.im> I noticed that 😕
2026-01-08 17:25:40 <@zlopez:fedora.im> So let's go through backlog refinement
2026-01-08 17:25:46 <@zlopez:fedora.im> !info Refine oldest tickets on Fedora Infra tracker
2026-01-08 17:25:46 <@zlopez:fedora.im> !topic Fedora Infra backlog refinement
2026-01-08 17:25:46 <@zlopez:fedora.im> !link https://pagure.io/fedora-infrastructure/issues?status=Open&order_key=last_updated&order=asc
2026-01-08 17:26:18 <@zlopez:fedora.im> !ticket 11884
2026-01-08 17:26:19 <@zodbot:fedora.im> ● **Last Updated:** 9 months ago
2026-01-08 17:26:19 <@zodbot:fedora.im> **fedora-infrastructure #11884** (https://pagure.io/fedora-infrastructure/issue/11884):**RFE: Add a role for deploying through OpenShift deployment**
2026-01-08 17:26:19 <@zodbot:fedora.im> ● **Opened:** a year ago by svashisht
2026-01-08 17:26:19 <@zodbot:fedora.im> 
2026-01-08 17:26:19 <@zodbot:fedora.im> ● **Assignee:** Not Assigned
2026-01-08 17:27:04 <@gwmngilfen:fedora.im> wait did we miss monitoring?
2026-01-08 17:27:23 <@gwmngilfen:fedora.im> i mean we can do it after I guess 😛
2026-01-08 17:27:38 <@zlopez:fedora.im> I don't think we have anything new to add, we would still like the users to have a way to rollout new deployment by themselves
2026-01-08 17:27:59 <@zlopez:fedora.im> Oh sorry, I must have missed it in agenda
2026-01-08 17:28:14 <@zlopez:fedora.im> Let's go through few tickets and let's get back to it
2026-01-08 17:28:20 <@gwmngilfen:fedora.im> sure
2026-01-08 17:29:59 <@zlopez:fedora.im> !ticket 11958
2026-01-08 17:30:00 <@zodbot:fedora.im> 
2026-01-08 17:30:00 <@zodbot:fedora.im> ● **Assignee:** x3mboy
2026-01-08 17:30:00 <@zodbot:fedora.im> ● **Last Updated:** 9 months ago
2026-01-08 17:30:00 <@zodbot:fedora.im> **fedora-infrastructure #11958** (https://pagure.io/fedora-infrastructure/issue/11958):**Add fedora-l10n pagure group as an admin to the fedora-l10n-docs namespace projects**
2026-01-08 17:30:00 <@zodbot:fedora.im> ● **Opened:** a year ago by peartown
2026-01-08 17:30:56 <@zlopez:fedora.im> Last comment is from x3mboy, I will ping him in the ticket and ask about the progress
2026-01-08 17:31:37 <@zlopez:fedora.im> !ticket 12181
2026-01-08 17:31:38 <@zodbot:fedora.im> **fedora-infrastructure #12181** (https://pagure.io/fedora-infrastructure/issue/12181):**maubot-meetings bot multi line paste is cut**
2026-01-08 17:31:38 <@zodbot:fedora.im> ● **Last Updated:** 9 months ago
2026-01-08 17:31:38 <@zodbot:fedora.im> 
2026-01-08 17:31:38 <@zodbot:fedora.im> ● **Opened:** a year ago by man2dev
2026-01-08 17:31:38 <@zodbot:fedora.im> ● **Assignee:** ryanlerch
2026-01-08 17:32:34 <@zlopez:fedora.im> Does anybody know if this is still happening?
2026-01-08 17:33:18 <@gwmngilfen:fedora.im> seems easy enough to test
2026-01-08 17:34:13 <@zlopez:fedora.im> It should be visible in the logs for this meeting as I was pasting multiple lines several times already
2026-01-08 17:34:23 <@gwmngilfen:fedora.im> exactly
2026-01-08 17:34:59 <@zlopez:fedora.im> Let me wait for the end of meeting than and I will update the ticket
2026-01-08 17:35:21 <@x3mboy:fedora.im> Oh I totally forgot about this, let me retake the work and I'll share feedback on the ticket
2026-01-08 17:35:21 <@zlopez:fedora.im> !ticket 11950
2026-01-08 17:35:22 <@zodbot:fedora.im> ● **Assignee:** dkirwan
2026-01-08 17:35:22 <@zodbot:fedora.im> **fedora-infrastructure #11950** (https://pagure.io/fedora-infrastructure/issue/11950):**vmhost-x86-copr01.rdu-cc.fedoraproject.org DOWN**
2026-01-08 17:35:22 <@zodbot:fedora.im> 
2026-01-08 17:35:22 <@zodbot:fedora.im> ● **Opened:** a year ago by praiskup
2026-01-08 17:35:22 <@zodbot:fedora.im> ● **Last Updated:** 9 months ago
2026-01-08 17:35:31 <@zodbot:fedora.im> zlopez gave a cookie to x3mboy. They now have 186 cookies, 2 of which were obtained in the Fedora 43 release cycle
2026-01-08 17:36:19 <@zlopez:fedora.im> Is this still down?
2026-01-08 17:36:41 <@gwmngilfen:fedora.im> atm yes, though probably not for the same reason
2026-01-08 17:36:42 <@zlopez:fedora.im> We did a migration from rdu-cc to rdu3 meanwhile
2026-01-08 17:37:05 <@zlopez:fedora.im> Gwmngilfen: Could you update the ticket?
2026-01-08 17:37:38 <@zlopez:fedora.im> Just add the current state
2026-01-08 17:37:43 <@gwmngilfen:fedora.im> sure
2026-01-08 17:37:56 <@james:fedora.im> Only copr01 machines are p08 (has rdu-cc subdomain) and p09
2026-01-08 17:39:43 <@gwmngilfen:fedora.im> its called vmhost-x8-copr01.rdu3 now
2026-01-08 17:39:48 <@gwmngilfen:fedora.im> its called vmhost-x86-copr01.rdu3 now
2026-01-08 17:39:51 <@gwmngilfen:fedora.im> ticket updated
2026-01-08 17:40:08 <@zlopez:fedora.im> Let's look at the last one
2026-01-08 17:40:21 <@zlopez:fedora.im> !ticket 12388
2026-01-08 17:40:21 <@zodbot:fedora.im> ● **Opened:** 11 months ago by vigrond
2026-01-08 17:40:21 <@zodbot:fedora.im> ● **Last Updated:** 8 months ago
2026-01-08 17:40:21 <@zodbot:fedora.im> 
2026-01-08 17:40:21 <@zodbot:fedora.im> ● **Assignee:** Not Assigned
2026-01-08 17:40:21 <@zodbot:fedora.im> **fedora-infrastructure #12388** (https://pagure.io/fedora-infrastructure/issue/12388):**Pagure completely broke after re-forking fedora-server**
2026-01-08 17:41:04 <@gwmngilfen:fedora.im> i guess we need to check if it's still an issue, and then check with Aurélien B after that
2026-01-08 17:41:52 <@zlopez:fedora.im> I just checked it now and the fork went through
2026-01-08 17:42:03 <@zlopez:fedora.im> https://pagure.io/fork/zlopez/fedora-server
2026-01-08 17:42:13 <@gwmngilfen:fedora.im> check-n-close then?
2026-01-08 17:42:16 <@zlopez:fedora.im> So I assume whatever the issue was, it's no longer there
2026-01-08 17:42:31 <@zlopez:fedora.im> Let me update the ticket and close it as fixed
2026-01-08 17:44:38 <@zlopez:fedora.im> I will recheck with the user if it's working for him as well
2026-01-08 17:45:06 <@zlopez:fedora.im> That is all regarding tickets for today
2026-01-08 17:45:26 <@zlopez:fedora.im> !info https://nagios.fedoraproject.org/nagios & https://zabbix.fedoraproject.org (top 100 triggers: https://zabbix.fedoraproject.org/zabbix.php?action=toptriggers.list)
2026-01-08 17:45:26 <@zlopez:fedora.im> !info Go over existing items and fix them
2026-01-08 17:45:26 <@zlopez:fedora.im> !topic Monitoring discussion [nirik]
2026-01-08 17:45:31 <@gwmngilfen:fedora.im> i have to dash in a moment, so quickly from me on monitoring...
2026-01-08 17:45:46 <@gwmngilfen:fedora.im> as per our discussion before the break, Zabbix bot is now in the noc channel
2026-01-08 17:46:00 <@gwmngilfen:fedora.im> please do pay attention to it and ack/suppress/close as needed
2026-01-08 17:46:20 <@zlopez:fedora.im> I'm checking both zabbix and nagios right now
2026-01-08 17:46:23 <@gwmngilfen:fedora.im> i've dropped the priority of the cpu load alerts to "Warning" so that we don't get swamped by them
2026-01-08 17:46:34 <@gwmngilfen:fedora.im> (Warning and lower don't go to Matrix)
2026-01-08 17:46:52 <@gwmngilfen:fedora.im> I'm also trialling a trned-based alert for that, though I don't think I have it right yet
2026-01-08 17:46:57 <@gwmngilfen:fedora.im> I'm also trialling a trend-based alert for that, though I don't think I have it right yet
2026-01-08 17:47:18 <@gwmngilfen:fedora.im> I've up the threshold on openqa disk alerts after a chat with AdamW, so that should go off less too
2026-01-08 17:47:40 <@gwmngilfen:fedora.im> thats all for this week i think. I hope to delete the first few things from Nagios soon 😉
2026-01-08 17:49:39 <@zlopez:fedora.im> We currently have a lot of alerts in Nagios, but most of them are related to recent move from rdu-cc to rdu3 and the machines slowly being redeployed again
2026-01-08 17:50:36 <@zlopez:fedora.im> Other than that there are two alerts about SSL certs being expired soon, but we still have some time
2026-01-08 17:50:49 <@zlopez:fedora.im> That should be all regarding monitoring
2026-01-08 17:51:07 <@zlopez:fedora.im> !topic Open Floor
2026-01-08 17:51:16 <@zlopez:fedora.im> Anything for open floor?
2026-01-08 17:51:34 <@amedvede:fedora.im> I have one idea to discuss
2026-01-08 17:51:46 <@zlopez:fedora.im> Go on
2026-01-08 17:53:59 <@amedvede:fedora.im> sometimes I need to test some scripts on actual pkg on pkgs machine, and for this reason Its nice to use staging servers, but the problem is that for staging servers you also need to be in `sysadmin-main`. So I would like to hear your opinion about idea to create group `sysadmin-main-stg` which gives you same permissions as `sysadmin-main` but only for staging servers
2026-01-08 17:55:02 <@zlopez:fedora.im> Isn't `sysadmin-main` in staging FAS enough?
2026-01-08 17:55:36 <@amedvede:fedora.im> and it makes a sense it case when we would like to promote someone to `sysadmin-main` he or she needs to be in `sysadmin-main-stg` for a half of year as a proof that person won't break anything
2026-01-08 17:57:04 <@zlopez:fedora.im> I think we have specialized sysadmin groups as the sysadmin-main has access to everything
2026-01-08 17:57:11 <@james:fedora.im> Yeh, I was pretty sure I could ssh into random staging servers and `sudo -s` before I got into `sysadmin-main`
2026-01-08 17:57:17 <@amedvede:fedora.im> it's enough, but it's too much risk, but lots of tasks requires access that it gives, so the idea that person with `sysadmin-main-stg` can test his solution on test server and after that provide solution to person who is in `sysadmin-main` to actually run solution
2026-01-08 17:57:27 <@zlopez:fedora.im> Not sure if for dist-git, but for some we do
2026-01-08 17:57:47 <@amedvede:fedora.im> for some yes but for others not
2026-01-08 17:58:05 <@amedvede:fedora.im> for example pkgs.stg pagure-stg02
2026-01-08 17:58:10 <@amedvede:fedora.im> and others
2026-01-08 17:58:53 <@james:fedora.im> Yeh, but I think those are special in some way ... so they also couldn't be in  a new `sysadmin-main-stg`
2026-01-08 17:59:08 <@zlopez:fedora.im> I assume we can create group for that on staging FAS
2026-01-08 18:00:07 <@amedvede:fedora.im> because it doesn't seems right to me to request e.g. sysadmin-noc to access pagure-stg if i don't wanna to work with main pagure server
2026-01-08 18:00:39 <@zlopez:fedora.im> Although I'm not sure if this is taken into account on staging servers, will need to test that out
2026-01-08 18:00:40 <@amedvede:fedora.im> the idea is to use only 1 group for accessing all staging infrastructure
2026-01-08 18:01:32 <@zlopez:fedora.im> We have fi-apprentice, it has read-only access to most of the things
2026-01-08 18:02:06 <@zlopez:fedora.im> But the idea isn't bad, to have something that will allow people access to staging
2026-01-08 18:02:38 <@zlopez:fedora.im> We are already overtime, so let us end it here, we can discuss it in #admin:fedoraproject.org channel
2026-01-08 18:02:48 <@zlopez:fedora.im> Thanks everybody for coming today
2026-01-08 18:02:56 <@zlopez:fedora.im> !endmeeting