2025-03-27 19:02:25 <@james:fedora.im> !startmeeting Fedora Infrastructure Ops Daily Standup Meeting

2025-03-27 19:02:25 <@meetbot:fedora.im> Meeting started at 2025-03-27 19:02:25 UTC
2025-03-27 19:02:26 <@meetbot:fedora.im> The Meeting name is 'Fedora Infrastructure Ops Daily Standup Meeting'
2025-03-27 19:02:32 <@james:fedora.im> !chair nirik phsmoura james
2025-03-27 19:02:38 <@james:fedora.im> !meetingname fedora_infrastructure_ops_daily_standup_meeting
2025-03-27 19:02:38 <@meetbot:fedora.im> The Meeting Name is now fedora_infrastructure_ops_daily_standup_meeting
2025-03-27 19:02:45 <@james:fedora.im> !info meeting is 30 minutes MAX. At the end of 30, its stops
2025-03-27 19:02:48 <@james:fedora.im> !info agenda is at https://board.net/p/fedora-infra-daily
2025-03-27 19:02:51 <@james:fedora.im> !info reminder: speak up if you want to work on a ticket!
2025-03-27 19:02:55 <@nirik:matrix.scrye.com> morning
2025-03-27 19:03:18 <@james:fedora.im> !hi
2025-03-27 19:03:19 <@zodbot:fedora.im> James Antill (james)
2025-03-27 19:03:49 <@james:fedora.im> No new infra issues ... Pagure is trying to load releng issues now
2025-03-27 19:03:52 <@phsmoura:fedora.im> Im late.. sorry
2025-03-27 19:04:16 <@nirik:matrix.scrye.com> I got sidetracked by my zigbee network being down. :(
2025-03-27 19:04:44 <@james:fedora.im> No problem ... I thought the AI scrapper discussion was happening after the tickets in this meeting.
2025-03-27 19:04:58 <@nirik:matrix.scrye.com> load on pagure is kinda high, but not crazy high
2025-03-27 19:05:00 <@nirik:matrix.scrye.com> oh, sorry...
2025-03-27 19:05:01 <@james:fedora.im> So I completely missed that :(
2025-03-27 19:05:04 <@james:fedora.im> !releng 12658
2025-03-27 19:05:05 <@zodbot:fedora.im> **releng #12658** (https://pagure.io/releng/issue/12658):**Installability check in dist-git is failing to show results**
2025-03-27 19:05:05 <@zodbot:fedora.im> 
2025-03-27 19:05:05 <@zodbot:fedora.im> ● **Opened:** a day ago by jkonecny
2025-03-27 19:05:05 <@zodbot:fedora.im> ● **Last Updated:** 9 hours ago
2025-03-27 19:05:05 <@zodbot:fedora.im> ● **Assignee:** Not Assigned
2025-03-27 19:05:45 <@nirik:matrix.scrye.com> I think we can close this upstream now?
2025-03-27 19:05:47 <@james:fedora.im> This looks mostly fixed
2025-03-27 19:05:50 <@james:fedora.im> Yeh
2025-03-27 19:06:02 <@james:fedora.im> !topic Planning, Upcoming work and Open floor
2025-03-27 19:06:31 <@james:fedora.im> !info I'm off/unavailable Wed/Thu/Fri next week.
2025-03-27 19:06:41 <@nirik:matrix.scrye.com> So for me, need to catch up on a bunch of todos... hopefully everything will be in ok shape for freeze next tuesday.
2025-03-27 19:06:53 <@james:fedora.im> Hmm ... maybe "I'm" not the best thing to use for the notes there ;)
2025-03-27 19:07:29 <@nirik:matrix.scrye.com> we know what you meant. ;)
2025-03-27 19:07:31 <@james:fedora.im> Yeh, you'd know better than me but I haven't seen anything that would obviously delay GA from the 15th.
2025-03-27 19:08:33 <@nirik:matrix.scrye.com> There's been some instablitity on power9 hosts. I might try some newer kernels in staging to see if they are any better
2025-03-27 19:08:54 <@james:fedora.im> For the limiting in nftables ... There are tools you can use which allow you to limit number of connections and/or data usage: https://wiki.nftables.org/wiki-nftables/index.php/Rate_limiting_matchings
2025-03-27 19:09:46 <@james:fedora.im> I'm guessing we'd want a safe set of IPs which are "us" and get no limits, and then maybe a middle trust set of IPs?
2025-03-27 19:10:08 <@james:fedora.im> Do we have any canonical list of Fedora IPs?
2025-03-27 19:10:12 <@nirik:matrix.scrye.com> yeah, but it's so distributed... not sure a limit would catch them
2025-03-27 19:10:51 <@nirik:matrix.scrye.com> it's not 100 ip's hitting a lot, it's 100,000 ip's each hitting very small...but 100 of them at a time
2025-03-27 19:11:16 <@nirik:matrix.scrye.com> I could be wrong, we could try and gather more info... but not sure what to set the limits at
2025-03-27 19:12:22 <@nirik:matrix.scrye.com> I suppose we could look at httpd logs on pagure02? and see if we can figure out something?
2025-03-27 19:12:50 <@james:fedora.im> Yeh, I'm also very unsure what the limits should be set to ... but even if we could make it so all services can talk to each other quickly, then even though you and I are affected as much as random Fedora contributors if might be better enough that koji can easily speak to anything else.
2025-03-27 19:13:34 <@james:fedora.im> And obviously if we can put major Fedora contributors in a middle set that would help a huge amount, I think.
2025-03-27 19:14:16 <@james:fedora.im> But, still, no idea on what the limits should be for "RoW" and not sure where we can go to get a better idea (books? blogs? Just try it and see?;)
2025-03-27 19:14:17 <@nirik:matrix.scrye.com> sometimes it's hard to id those... I mean you can see redhat.com ip's... but an aws ip could be a crawler or something, or could be part of our ci :)
2025-03-27 19:14:48 <@nirik:matrix.scrye.com> It's probibly worth exploring tho... along with the other ideas we had in the meeting. ;)
2025-03-27 19:14:59 <@james:fedora.im> Can we do reverse IP stuff like the osbuild scripts?
2025-03-27 19:15:54 <@nirik:matrix.scrye.com> RoW?
2025-03-27 19:16:02 <@james:fedora.im> Rest of World
2025-03-27 19:16:07 <@nirik:matrix.scrye.com> ah. right
2025-03-27 19:16:46 <@nirik:matrix.scrye.com> yeah, it could even be legit crawlers that respect robots.txt and index things sanely.
2025-03-27 19:18:55 <@james:fedora.im> I don't have anything else. Anyone?
2025-03-27 19:18:55 <@james:fedora.im> Yeh.
2025-03-27 19:19:16 <@nirik:matrix.scrye.com> nothing more from me... I hope the scrapers just stay away. ;)
2025-03-27 19:19:28 <@james:fedora.im> That would be nice :)
2025-03-27 19:20:06 <@james:fedora.im> Okay, I'll let us get back to it...
2025-03-27 19:20:08 <@james:fedora.im> !endmeeting