2025-10-23 16:00:08 <@phsmoura:fedora.im> !startmeeting Infrastructure (2025-10-23)
2025-10-23 16:00:10 <@meetbot:fedora.im> Meeting started at 2025-10-23 16:00:08 UTC
2025-10-23 16:00:11 <@meetbot:fedora.im> The Meeting name is 'Infrastructure (2025-10-23)'
2025-10-23 16:00:16 <@phsmoura:fedora.im> !info Agenda is at: https://board.net/p/fedora-infra
2025-10-23 16:00:16 <@phsmoura:fedora.im> !info Fedora Infra documentation: https://docs.fedoraproject.org/en-US/infra
2025-10-23 16:00:16 <@phsmoura:fedora.im> !topic Hola y bienvenido
2025-10-23 16:00:16 <@phsmoura:fedora.im> !info About our team: https://docs.fedoraproject.org/en-US/cle/
2025-10-23 16:00:16 <@phsmoura:fedora.im> !chair @nirik:matrix.scrye.com @zlopez:fedora.im  @jnsamyak:matrix.org  @james:fedora.im
2025-10-23 16:00:16 <@phsmoura:fedora.im> !meetingname infrastructure
2025-10-23 16:00:17 <@meetbot:fedora.im> The Meeting Name is now infrastructure
2025-10-23 16:00:35 <@phsmoura:fedora.im> hello
2025-10-23 16:00:38 <@zlopez:fedora.im> !hi
2025-10-23 16:00:39 <@zodbot:fedora.im> Michal Konecny (zlopez)
2025-10-23 16:00:40 <@james:fedora.im> Hey
2025-10-23 16:01:19 <@gwmngilfen:fedora.im> !hi
2025-10-23 16:01:22 <@zodbot:fedora.im> Greg Sutcliffe (gwmngilfen) - he / him / his
2025-10-23 16:02:10 <@phsmoura:fedora.im> !info Getting Started Guide: https://docs.fedoraproject.org/en-US/infra/gettingstarted/
2025-10-23 16:02:10 <@phsmoura:fedora.im> !info This is a place where people who are interested in Fedora Infrastructure can introduce themselves
2025-10-23 16:02:10 <@phsmoura:fedora.im> !topic New folks introductions
2025-10-23 16:02:25 <@phsmoura:fedora.im> lets see if we have new people
2025-10-23 16:03:45 <@nirik:matrix.scrye.com> morning
2025-10-23 16:03:51 <@nirik:matrix.scrye.com> not new, but here. ;)
2025-10-23 16:04:27 <@gwmngilfen:fedora.im> beat me to that joke
2025-10-23 16:04:46 <@phsmoura:fedora.im> !info magic eight ball says:
2025-10-23 16:04:46 <@phsmoura:fedora.im> !info chair 2025-11-13 - ???
2025-10-23 16:04:46 <@phsmoura:fedora.im> !info chair 2025-11-06 - ???
2025-10-23 16:04:46 <@phsmoura:fedora.im> !info chair 2025-10-30 - nirik
2025-10-23 16:04:46 <@phsmoura:fedora.im> !info chair 2025-10-23 - phsmoura
2025-10-23 16:04:46 <@phsmoura:fedora.im> !topic Next chair
2025-10-23 16:05:13 <@phsmoura:fedora.im> anyone would like to chair the meeting in the next weeks?
2025-10-23 16:05:33 <@zlopez:fedora.im> I can probably take the 11-06
2025-10-23 16:08:26 <@phsmoura:fedora.im> !topic announcements and information
2025-10-23 16:08:26 <@phsmoura:fedora.im> !info CLE Infra&Releng EU-hours team has a Monday through Thursday 30 minute meeting going through tickets at 0815 UTC in https://matrix.to/#/#meeting-3:fedoraproject.org
2025-10-23 16:08:26 <@phsmoura:fedora.im> !info CLE Infra&Releng NA-hours team has a Monday through Thursday 30 minute meeting going through tickets at 1900 UTC in https://matrix.to/#/#meeting-3:fedoraproject.org
2025-10-23 16:08:51 <@phsmoura:fedora.im> do we have any other announcement?
2025-10-23 16:09:54 <@zlopez:fedora.im> !info Final freeze for F43 is still in effect
2025-10-23 16:09:59 <@gwmngilfen:fedora.im> is my zabbix talk appropriate, or just a note for further own the logs?
2025-10-23 16:10:04 <@gwmngilfen:fedora.im> is my zabbix talk appropriate, or just a note for further down the logs?
2025-10-23 16:10:21 <@nirik:matrix.scrye.com> please link it. ;)
2025-10-23 16:11:06 <@gwmngilfen:fedora.im> !info there was a recent [CLE Tech talk on Zabbix](https://gwmngilfen.fedorapeople.org/recordings/Intro%20to%20Zabbix%20for%20users,%20devs%20&%20sysadmins%20(2025-10-13).mp4) for folks interacting with our monitoring
2025-10-23 16:11:41 <@gwmngilfen:fedora.im> i've opened a ticket on getting it up on YT, but for now, there it is 😛
2025-10-23 16:12:09 <@nirik:matrix.scrye.com> oh, and...
2025-10-23 16:12:38 <@nirik:matrix.scrye.com> !info nirik out tomorrow ( 2025-10-24) and monday ( 2025-10-27 ).
2025-10-23 16:13:22 <@gwmngilfen:fedora.im> i suspect you might not get a *lot* from it, given how much we've talked about it 😛
2025-10-23 16:13:43 <@gwmngilfen:fedora.im> i plan to record another one specifically on creating/testing/rolling out a set of checks
2025-10-23 16:14:24 <@zlopez:fedora.im> !info zlopez is out on 2025-10-27 and 2025-10-28
2025-10-23 16:16:29 <@phsmoura:fedora.im> !info https://docs.fedoraproject.org/en-US/infra/day_to_day_fedora/#_the_oncall_role_in_our_team
2025-10-23 16:16:29 <@phsmoura:fedora.im> !info on call from 2025-10-10 to 2025-10-16 - nirik
2025-10-23 16:16:29 <@phsmoura:fedora.im> !info on call from 2025-11-07 to 2025-11-13 - ???
2025-10-23 16:16:29 <@phsmoura:fedora.im> !info on call from 2025-10-24 to 2025-11-06 - ???
2025-10-23 16:16:29 <@phsmoura:fedora.im> !info on call from 2025-10-17 to 2025-10-23 - zlopez
2025-10-23 16:16:29 <@phsmoura:fedora.im> !topic Oncall
2025-10-23 16:16:49 <@phsmoura:fedora.im> anyone would like to be oncall in the next weeks?
2025-10-23 16:17:24 <@nirik:matrix.scrye.com> I can take it and I do still have on my list to start a discussion about it, just keep not getting to it.
2025-10-23 16:18:36 <@phsmoura:fedora.im> 2025-10-24 to 2025-11-06 nirik ?
2025-10-23 16:18:41 <@nirik:matrix.scrye.com> sure
2025-10-23 16:21:08 <@nirik:matrix.scrye.com> !oncall
2025-10-23 16:21:08 <@zodbot:fedora.im> 
2025-10-23 16:21:08 <@zodbot:fedora.im> The following people are oncall:
2025-10-23 16:21:08 <@zodbot:fedora.im> ● @nirik:matrix.scrye.com (kevin) Current Time for them: 09:21 (US/Pacific)
2025-10-23 16:21:08 <@zodbot:fedora.im> If they do not respond, please file a ticket (https://pagure.io/fedora-infrastructure/issues)
2025-10-23 16:21:46 <@phsmoura:fedora.im> !info Summary of last week: ( Zlopez  )
2025-10-23 16:22:12 <@zlopez:fedora.im> I didn't saw any ping
2025-10-23 16:22:26 <@zlopez:fedora.im> At least not oncall ping
2025-10-23 16:23:15 <@phsmoura:fedora.im> !info Go over existing items and fix them
2025-10-23 16:23:15 <@phsmoura:fedora.im> !topic Monitoring discussion [nirik]
2025-10-23 16:23:15 <@phsmoura:fedora.im> !info https://nagios.fedoraproject.org/nagios & https://zabbix.fedoraproject.org
2025-10-23 16:23:46 <@nirik:matrix.scrye.com> lets see
2025-10-23 16:23:51 <@gwmngilfen:fedora.im> so before I have to run
2025-10-23 16:24:21 <@gwmngilfen:fedora.im> I did a bit of digging on the frequent alerts on sundries. https://pagure.io/fedora-infrastructure/issue/12863 is a suggestion to maybe help
2025-10-23 16:24:22 <@nirik:matrix.scrye.com> nothing much new in nagios land... there's some vmhost-p09-copr alerts, but we were working on that this morning.
2025-10-23 16:24:42 <@nirik:matrix.scrye.com> yeah, I am not sure I like that for various reasons... but we can figure something out.
2025-10-23 16:24:49 <@gwmngilfen:fedora.im> fair enough
2025-10-23 16:25:02 <@gwmngilfen:fedora.im> i can think of one reason for sure
2025-10-23 16:25:20 <@nirik:matrix.scrye.com> ie, on release days we want docs all updating at the same time for release or the like... or to know when a change syncs out...
2025-10-23 16:25:20 <@gwmngilfen:fedora.im> which only occurred to me about an hour ago
2025-10-23 16:25:36 <@gwmngilfen:fedora.im> right, all the pages should be the same at the same time
2025-10-23 16:25:42 <@gwmngilfen:fedora.im> anyway, -> ticket for that
2025-10-23 16:26:22 <@gwmngilfen:fedora.im> otherwise zabbix looks pretty normal too. still a bunch of thresholds to tune but seems sane
2025-10-23 16:26:45 <@gwmngilfen:fedora.im> I've been testing some stuff for RAID and Anubis monitoring on stg too
2025-10-23 16:27:02 <@gwmngilfen:fedora.im> (and shortly HAProxy too, when I have a moment)
2025-10-23 16:27:49 <@gwmngilfen:fedora.im> fin
2025-10-23 16:28:26 <@nirik:matrix.scrye.com> I'm not sure when we can shut off nagios, but we are well on our way.
2025-10-23 16:28:40 <@nirik:matrix.scrye.com> Would be great to have it just as a backup role by the end of the year at least.
2025-10-23 16:29:14 <@gwmngilfen:fedora.im> definitely Q4 is my target to make it "official", but with nagios as the backup
2025-10-23 16:29:36 <@gwmngilfen:fedora.im> I was chatting with Anton today, he's going to dig into what is most essential for releng's monitoring needs
2025-10-23 16:29:55 <@nirik:matrix.scrye.com> excellent
2025-10-23 16:30:52 <@gwmngilfen:fedora.im> its been a long road, but as I hoped, I've learned a lot about our infra along the way 😛
2025-10-23 16:31:10 <@zodbot:fedora.im> james gave a cookie to gwmngilfen. They now have 12 cookies, 8 of which were obtained in the Fedora 42 release cycle
2025-10-23 16:31:25 <@zodbot:fedora.im> zlopez gave a cookie to gwmngilfen. They now have 13 cookies, 9 of which were obtained in the Fedora 42 release cycle
2025-10-23 16:32:07 <@zodbot:fedora.im> kevin gave a cookie to gwmngilfen. They now have 14 cookies, 10 of which were obtained in the Fedora 42 release cycle
2025-10-23 16:32:22 <@gwmngilfen:fedora.im> he, maybe I don't need to go cook after all
2025-10-23 16:32:24 <@nirik:matrix.scrye.com> cookie party
2025-10-23 16:32:25 <@gwmngilfen:fedora.im> heh, maybe I don't need to go cook after all
2025-10-23 16:32:35 <@gwmngilfen:fedora.im> so many cookies!
2025-10-23 16:32:47 <@gwmngilfen:fedora.im> but actually I do, so, laters folks 😛 
2025-10-23 16:33:02 <@phsmoura:fedora.im> !info Refine oldest tickets on Fedora Infra tracker
2025-10-23 16:33:02 <@phsmoura:fedora.im> !topic Fedora Infra backlog refinement https://pagure.io/fedora-infrastructure/report/weekly_refinement
2025-10-23 16:33:02 <@phsmoura:fedora.im> !link https://pagure.io/fedora-infrastructure/report/weekly_refinement
2025-10-23 16:34:02 <@nirik:matrix.scrye.com> a report eh? nice...
2025-10-23 16:34:42 <@nirik:matrix.scrye.com> so what is this sorted by...
2025-10-23 16:35:07 <@zlopez:fedora.im> Open date
2025-10-23 16:35:14 <@nirik:matrix.scrye.com> just oldest. Thats not what we want I don't think. I think we want oldest NOT updated
2025-10-23 16:35:45 <@zlopez:fedora.im> We had that before
2025-10-23 16:36:55 <@nirik:matrix.scrye.com> I am not sure how to fix it.
2025-10-23 16:37:24 <@zlopez:fedora.im> I don't know how the weekly_refinement link is even created
2025-10-23 16:37:33 <@zlopez:fedora.im> But here is the correct sorting
2025-10-23 16:37:34 <@zlopez:fedora.im> https://pagure.io/fedora-infrastructure/issues?status=Open&order_key=last_updated&order=asc
2025-10-23 16:38:27 <@zlopez:fedora.im> !ticket 12292
2025-10-23 16:38:28 <@nirik:matrix.scrye.com> I see where I can delete it, but not edit it.
2025-10-23 16:38:28 <@zodbot:fedora.im> ● **Opened:** 11 months ago by music
2025-10-23 16:38:28 <@zodbot:fedora.im> **fedora-infrastructure #12292** (https://pagure.io/fedora-infrastructure/issue/12292):**Pagure returns error 500 trying to open a PR on https://src.fedoraproject.org/rpms/python-setuptools-gettext**
2025-10-23 16:38:28 <@zodbot:fedora.im> 
2025-10-23 16:38:28 <@zodbot:fedora.im> ● **Last Updated:** 10 months ago
2025-10-23 16:38:28 <@zodbot:fedora.im> ● **Assignee:** kevin
2025-10-23 16:38:31 <@nirik:matrix.scrye.com> oh well.
2025-10-23 16:38:55 <@zlopez:fedora.im> This is the oldest update I can see
2025-10-23 16:39:14 <@nirik:matrix.scrye.com> oh man, I totally failed to do whatever I said I would there.
2025-10-23 16:39:36 <@nirik:matrix.scrye.com> I can update it, probibly want to wait until after freeze? or not I guess.
2025-10-23 16:40:00 <@nirik:matrix.scrye.com> added a comment
2025-10-23 16:40:21 <@zlopez:fedora.im> Let go for next one than
2025-10-23 16:40:31 <@zlopez:fedora.im> !ticket 12270
2025-10-23 16:40:32 <@zodbot:fedora.im> ● **Assignee:** Not Assigned
2025-10-23 16:40:32 <@zodbot:fedora.im> ● **Opened:** 11 months ago by horth
2025-10-23 16:40:32 <@zodbot:fedora.im> 
2025-10-23 16:40:32 <@zodbot:fedora.im> **fedora-infrastructure #12270** (https://pagure.io/fedora-infrastructure/issue/12270):**Define a more appropriate fallback for the UA mirror**
2025-10-23 16:40:32 <@zodbot:fedora.im> ● **Last Updated:** 10 months ago
2025-10-23 16:41:00 <@nirik:matrix.scrye.com> oh yeah, this one.
2025-10-23 16:41:10 <@nirik:matrix.scrye.com> I would really like to be able to do something here... but it's not easy
2025-10-23 16:44:06 <@nirik:matrix.scrye.com> So, I'm torn here...
2025-10-23 16:44:27 <@nirik:matrix.scrye.com> we could just close it and say sorry, we don't have any easy way to do this.
2025-10-23 16:45:05 <@zlopez:fedora.im> What is the benefit to have the fallback?
2025-10-23 16:45:06 <@nirik:matrix.scrye.com> or we could I guess refile it as a mirrormanager RFE and see if they can think of anything, but adrian already chimed in
2025-10-23 16:45:33 <@nirik:matrix.scrye.com> that users there don't get a bunch of 404/401/timeouts when updating
2025-10-23 16:45:49 <@james:fedora.im> Yeh, your initial comment seems like the best we can do unless someone wants to invest in MM development.
2025-10-23 16:45:56 <@nirik:matrix.scrye.com> I'm not sure which way they are blocking things... I guess that could weigh into how anoying it is.
2025-10-23 16:47:24 <@nirik:matrix.scrye.com> I guess I could ask them about that?
2025-10-23 16:48:26 <@nirik:matrix.scrye.com> let me ask them about that and ask for ways forward in the ticket? or do we think we should close it?
2025-10-23 16:49:27 <@zlopez:fedora.im> I'm not sure about this, it definitely seems like something useful and it would be helpful in future
2025-10-23 16:50:16 <@nirik:matrix.scrye.com> sure, but it would be work in mirrormanager for sure.
2025-10-23 16:50:46 <@nirik:matrix.scrye.com> I'll ask if they can refile upstream?
2025-10-23 16:50:57 <@zlopez:fedora.im> I assume that is the best option
2025-10-23 16:51:13 <@james:fedora.im> Yeh, can't hurt.
2025-10-23 16:51:26 <@nirik:matrix.scrye.com> (but note... Aurélien B did work on mirrormanager to port it to python3, but I don't know that he's 'maintaining' it... and adrian is very busy too, so I am not sure anyone is 'maintaining' it :)
2025-10-23 16:53:37 <@phsmoura:fedora.im> we have about 7 min should we revisit blocked tickets?
2025-10-23 16:54:23 <@zlopez:fedora.im> I think we can either switch to open floor or go to next ticket
2025-10-23 16:55:44 <@nirik:matrix.scrye.com> not much time left. ;)
2025-10-23 16:56:05 <@zlopez:fedora.im> Let's switch to open floor than
2025-10-23 16:56:15 <@zlopez:fedora.im> At least we checked out 2 tickets
2025-10-23 16:56:36 <@phsmoura:fedora.im> !topic Open Floor
2025-10-23 16:59:15 <@nirik:matrix.scrye.com> for any interested the f43 go/nogo is in a few minutes...
2025-10-23 17:00:23 <@phsmoura:fedora.im> ok, lets go back then
2025-10-23 17:00:30 <@phsmoura:fedora.im> thanks everyone :)
2025-10-23 17:00:34 <@phsmoura:fedora.im> !endmeeting