2026-02-05 17:00:36 <@nirik:matrix.scrye.com> !startmeeting Infrastructure (2026-02-05)
2026-02-05 17:00:38 <@meetbot:fedora.im> Meeting started at 2026-02-05 17:00:36 UTC
2026-02-05 17:00:38 <@meetbot:fedora.im> The Meeting name is 'Infrastructure (2026-02-05)'
2026-02-05 17:00:51 <@nirik:matrix.scrye.com> !info About our team: https://docs.fedoraproject.org/en-US/cle/
2026-02-05 17:00:51 <@nirik:matrix.scrye.com> !chair @nirik:matrix.scrye.com @zlopez:fedora.im  @jnsamyak:matrix.org  @james:fedora.im @gwmngilfen:fedora.im
2026-02-05 17:00:51 <@nirik:matrix.scrye.com> !topic Hola y bienvenido
2026-02-05 17:00:51 <@nirik:matrix.scrye.com> !info Fedora Infra documentation: https://docs.fedoraproject.org/en-US/infra
2026-02-05 17:00:51 <@nirik:matrix.scrye.com> !meetingname infrastructure
2026-02-05 17:00:51 <@nirik:matrix.scrye.com> !info Agenda is at: https://board.net/p/fedora-infra
2026-02-05 17:00:52 <@meetbot:fedora.im> The Meeting Name is now infrastructure
2026-02-05 17:01:51 <@nirik:matrix.scrye.com> hey folks, anyone around for meeting today?
2026-02-05 17:02:00 <@patrikp:matrix.org> Hi. 👋
2026-02-05 17:04:30 <@nirik:matrix.scrye.com> hey. just us it seems...
2026-02-05 17:04:47 <@nirik:matrix.scrye.com> will wait a few to see if others arrive
2026-02-05 17:05:46 <@nirik:matrix.scrye.com> if any new folks...
2026-02-05 17:05:48 <@nirik:matrix.scrye.com> !info Getting Started Guide: https://docs.fedoraproject.org/en-US/infra/gettingstarted/
2026-02-05 17:05:48 <@nirik:matrix.scrye.com> !info This is a place where people who are interested in Fedora Infrastructure can introduce themselves
2026-02-05 17:05:48 <@nirik:matrix.scrye.com> !topic New folks introductions
2026-02-05 17:08:13 <@nirik:matrix.scrye.com> I guess I can quickly run thru the rest of the meeting...
2026-02-05 17:08:16 <@nirik:matrix.scrye.com> !topic announcements and information
2026-02-05 17:08:16 <@nirik:matrix.scrye.com> !info CLE Infra&Releng NA-hours team has a Monday through Thursday 30 minute meeting going through tickets at 1900 UTC in https://matrix.to/#/#meeting-3:fedoraproject.org
2026-02-05 17:08:31 <@nirik:matrix.scrye.com> !topic fedora 44 branching (today!)
2026-02-05 17:09:06 <@nirik:matrix.scrye.com> I had 2 topics to bring up:
2026-02-05 17:09:13 <@nirik:matrix.scrye.com> more announcements really I guess...
2026-02-05 17:09:15 <@nirik:matrix.scrye.com> !topic please review deploymentconfig -> deployment pr's for your apps
2026-02-05 17:09:15 <@nirik:matrix.scrye.com> !topic reorg of infra sops: https://forge.fedoraproject.org/infra/docs/pulls/486
2026-02-05 17:09:58 <@nirik:matrix.scrye.com> wanted to get feedback on those. So, if you maintain/work with an app/are an appowner for it, please review pr's that phsmoura has been doing to migrate from deploymentconfig to deployment
2026-02-05 17:10:10 <@james:fedora.im> I'm kind of here, but distracted ... speed running the meeting is fine ;)
2026-02-05 17:10:11 <@patrikp:matrix.org> Always nice to see doc improvements. 👏
2026-02-05 17:10:31 <@nirik:matrix.scrye.com> and please take a look at the sop reorg pr... I think it will make things easier for new folks, but might confuse us old timers.
2026-02-05 17:10:39 <@nirik:matrix.scrye.com> Of course we are used to being confused.
2026-02-05 17:10:58 <@nirik:matrix.scrye.com> !info on call from 2026-02-05 to 2026-02-12 - ???
2026-02-05 17:10:58 <@nirik:matrix.scrye.com> !topic Oncall
2026-02-05 17:10:58 <@nirik:matrix.scrye.com> !info https://docs.fedoraproject.org/en-US/infra/day_to_day_fedora/#_the_oncall_role_in_our_team
2026-02-05 17:10:58 <@nirik:matrix.scrye.com> !info on call from 2026-01-30 to 2026-02-05 - Michal Konečný
2026-02-05 17:11:07 <@nirik:matrix.scrye.com> I can take it over...
2026-02-05 17:11:35 <@nirik:matrix.scrye.com> !oncall
2026-02-05 17:11:36 <@zodbot:fedora.im> The following people are oncall:
2026-02-05 17:11:36 <@zodbot:fedora.im> 
2026-02-05 17:11:36 <@zodbot:fedora.im> ● @nirik:matrix.scrye.com (kevin) Current Time for them: 09:11 (US/Pacific)
2026-02-05 17:11:36 <@zodbot:fedora.im> If they do not respond, please file a ticket (https://pagure.io/fedora-infrastructure/issues)
2026-02-05 17:11:45 <@nirik:matrix.scrye.com> !info Summary of last week: (from current oncall)
2026-02-05 17:11:58 <@nirik:matrix.scrye.com> I don't think there were any oncall calls. At least nothing I saw.
2026-02-05 17:12:09 <@nirik:matrix.scrye.com> !topic Monitoring discussion [nirik]
2026-02-05 17:12:09 <@nirik:matrix.scrye.com> !info https://nagios.fedoraproject.org/nagios & https://zabbix.fedoraproject.org (top 100 triggers: https://zabbix.fedoraproject.org/zabbix.php?action=toptriggers.list)
2026-02-05 17:12:09 <@nirik:matrix.scrye.com> !info Go over existing items and fix them
2026-02-05 17:12:27 <@gwmngilfen:fedora.im> !hi
2026-02-05 17:12:28 <@zodbot:fedora.im> Greg Sutcliffe (gwmngilfen) - he / him / his
2026-02-05 17:12:28 <@nirik:matrix.scrye.com> nothing new in nagios. same ol
2026-02-05 17:12:31 <@nirik:matrix.scrye.com> hey!
2026-02-05 17:12:54 <@nirik:matrix.scrye.com> nice.
2026-02-05 17:13:14 <@nirik:matrix.scrye.com> anyhow, on zabbix we have been getting alerts from proxy11. Those are anoying but hard to isolate.
2026-02-05 17:13:37 <@gwmngilfen:fedora.im> i've been looking at it today but yeah, its annoying
2026-02-05 17:13:44 <@gwmngilfen:fedora.im> tempted to geive it more cpu and be done
2026-02-05 17:13:59 <@nirik:matrix.scrye.com> yeah, thats worth trying for sure.
2026-02-05 17:14:16 <@nirik:matrix.scrye.com> I can do that later today? or leave it for you
2026-02-05 17:14:24 <@gwmngilfen:fedora.im> it only started after the reboot/update cycle but the load was still high before, so I suspect a newer kernel or maybe crypto package is using more cycles now
2026-02-05 17:14:49 <@gwmngilfen:fedora.im> i wont get to it today, can do it tomorrow if you don't
2026-02-05 17:15:27 <@gwmngilfen:fedora.im> i had a look at the alert for crond on p09-copr01 - it's actually running 3 processes, so the alert is badly worded
2026-02-05 17:15:27 <@nirik:matrix.scrye.com> sure
2026-02-05 17:15:55 <@gwmngilfen:fedora.im> however, i don't think 3 i a problem? so I can adjust the template to be >0 instead of <>1
2026-02-05 17:16:24 <@nirik:matrix.scrye.com> I think it forks off new ones to run jobs? but then why is there jobs that are not finishing
2026-02-05 17:16:58 <@gwmngilfen:fedora.im> i dont see much in ps, and all 3 came back after a restart
2026-02-05 17:17:03 <@gwmngilfen:fedora.im> 2509827 ?        S      0:00  \_ /usr/sbin/crond -n
2026-02-05 17:17:03 <@gwmngilfen:fedora.im> 2480531 ?        Ss     0:00 /usr/sbin/crond -n
2026-02-05 17:17:03 <@gwmngilfen:fedora.im> 2509865 ?        S      0:00  \_ /usr/sbin/crond -n
2026-02-05 17:17:34 <@nirik:matrix.scrye.com> does pstree show them having any child processes?
2026-02-05 17:18:20 <@gwmngilfen:fedora.im> not that i can see
2026-02-05 17:18:27 <@gwmngilfen:fedora.im> crond───2*[crond]
2026-02-05 17:18:27 <@gwmngilfen:fedora.im> # pstree 2480531
2026-02-05 17:18:30 <@gwmngilfen:fedora.im> crond───2\*\[crond\]
2026-02-05 17:18:30 <@gwmngilfen:fedora.im> ```
2026-02-05 17:18:30 <@gwmngilfen:fedora.im> # pstree 2480531
2026-02-05 17:18:30 <@gwmngilfen:fedora.im> 
2026-02-05 17:18:55 <@gwmngilfen:fedora.im> anyway, not urgent since it's running. I can poke at it more
2026-02-05 17:19:29 <@gwmngilfen:fedora.im> i see log01 is still basically full, but I assume you know that. also the distrobuild queue is groing and I don't know what/if we do about that
2026-02-05 17:19:38 <@gwmngilfen:fedora.im> i see log01 is still basically full, but I assume you know that. also the distrobuild queue is growing and I don't know what/if we do about that
2026-02-05 17:20:01 <@nirik:matrix.scrye.com> yes, thats #eln:fedoraproject.org but it's because it's paused for us to do branching which we keep getting delayed on. ;)
2026-02-05 17:20:12 <@gwmngilfen:fedora.im> well that makes sense
2026-02-05 17:20:15 <@gwmngilfen:fedora.im> maybe ack it?
2026-02-05 17:21:02 <@nirik:matrix.scrye.com> ah, indeed.
2026-02-05 17:21:07 <@gwmngilfen:fedora.im> not much else. no prises for guessing whats in the top 100 this week, but also there was a misconfg of the rabbitmq agent which caused a bunch of errors, i fixed it this morning
2026-02-05 17:21:15 <@gwmngilfen:fedora.im> not much else. no prizes for guessing whats in the top 100 this week, but also there was a misconfg of the rabbitmq agent which caused a bunch of errors, i fixed it this morning
2026-02-05 17:22:11 <@gwmngilfen:fedora.im> should be possible to silence *some* alerts during known heavy-stress times
2026-02-05 17:22:38 <@gwmngilfen:fedora.im> fin
2026-02-05 17:24:33 <@nirik:matrix.scrye.com> cool.
2026-02-05 17:24:52 <@nirik:matrix.scrye.com> I'm pressed for time, so unless there's objections...
2026-02-05 17:24:56 <@nirik:matrix.scrye.com> !topic Open Floor
2026-02-05 17:25:01 <@nirik:matrix.scrye.com> anyone have anything for open floor?
2026-02-05 17:26:19 <@gwmngilfen:fedora.im> i'm short on time too, nothing here
2026-02-05 17:26:53 <@nirik:matrix.scrye.com> ok, thanks everyone!
2026-02-05 17:26:55 <@nirik:matrix.scrye.com> !endmeeting