2025-04-03 17:00:05 <@nirik:matrix.scrye.com> !startmeeting Infrastructure (2025-04-03)
2025-04-03 17:00:07 <@meetbot:fedora.im> Meeting started at 2025-04-03 17:00:05 UTC
2025-04-03 17:00:08 <@meetbot:fedora.im> The Meeting name is 'Infrastructure (2025-04-03)'
2025-04-03 17:00:13 <@nirik:matrix.scrye.com> !info Agenda is at: https://board.net/p/fedora-infra
2025-04-03 17:00:13 <@nirik:matrix.scrye.com> !chair nirik zlopez nb bodanel dtometzki jnsamyak lenkaseg patrikp
2025-04-03 17:00:13 <@nirik:matrix.scrye.com> !meetingname infrastructure
2025-04-03 17:00:13 <@nirik:matrix.scrye.com> !info About our team: https://docs.fedoraproject.org/en-US/cle/
2025-04-03 17:00:13 <@nirik:matrix.scrye.com> !info Fedora Infra documentation: https://docs.fedoraproject.org/en-US/infra
2025-04-03 17:00:13 <@nirik:matrix.scrye.com> !topic ahoy
2025-04-03 17:00:14 <@meetbot:fedora.im> The Meeting Name is now infrastructure
2025-04-03 17:00:23 <@nirik:matrix.scrye.com> morning everyone!
2025-04-03 17:01:11 <@markrosenbaum:fedora.im> Afternoon!
2025-04-03 17:01:13 <@Zlopez:matrix.org> !hi
2025-04-03 17:01:16 <@zodbot:fedora.im> Michal Konecny (zlopez)
2025-04-03 17:01:23 <@markrosenbaum:fedora.im> !hi
2025-04-03 17:01:23 <@zodbot:fedora.im> Mark Rosenbaum (markrosenbaum)
2025-04-03 17:01:54 <@phsmoura:fedora.im> hello
2025-04-03 17:02:31 <@nirik:matrix.scrye.com> will wait another minute or two for folks to come in.
2025-04-03 17:04:00 <@nirik:matrix.scrye.com> !info Getting Started Guide: https://docs.fedoraproject.org/en-US/infra/gettingstarted/
2025-04-03 17:04:00 <@nirik:matrix.scrye.com> !info This is a place where people who are interested in Fedora Infrastructure can introduce themselves
2025-04-03 17:04:00 <@nirik:matrix.scrye.com> !topic New folks introductions
2025-04-03 17:04:02 <@carlwgeorge:fedora.im> !hi
2025-04-03 17:04:03 <@zodbot:fedora.im> Carl George (carlwgeorge) - he / him / his
2025-04-03 17:04:20 <@nirik:matrix.scrye.com> any new folks around today? This is a safe place to introduce yourself.
2025-04-03 17:04:41 <@markrosenbaum:fedora.im> Jae "Awa" J4
2025-04-03 17:05:31 <@markrosenbaum:fedora.im> Jae "Awa" J4, if you want to introduce yourself here you can
2025-04-03 17:06:15 <@j:j4.lc> Hey there, don't mind me, I'm new around here, manifested my interest in contributing to Fedora today
2025-04-03 17:06:35 <@nirik:matrix.scrye.com> well, welcome. :) Feel free to lurk around and ask questions.
2025-04-03 17:07:06 <@nirik:matrix.scrye.com> !topic Next chair
2025-04-03 17:07:06 <@nirik:matrix.scrye.com> !info chair 2025-04-10 - @Zlopez
2025-04-03 17:07:06 <@nirik:matrix.scrye.com> !info magic eight ball says:
2025-04-03 17:07:06 <@nirik:matrix.scrye.com> !info chair 2025-04-24 - ???
2025-04-03 17:07:06 <@nirik:matrix.scrye.com> !info chair 2025-04-17 - ???
2025-04-03 17:07:17 <@nirik:matrix.scrye.com> anyone want to claim the 17th or 24th?
2025-04-03 17:07:46 <@nirik:matrix.scrye.com> If not, we could wait for next week...
2025-04-03 17:09:11 <@nirik:matrix.scrye.com> ok then, lets move on to announcements...
2025-04-03 17:09:26 <@nirik:matrix.scrye.com> !topic announcements and information
2025-04-03 17:09:26 <@nirik:matrix.scrye.com> !info CLE Infra&Releng EU-hours team has a Monday through Thursday 30 minute meeting going through tickets at 0815 UTC in https://matrix.to/#/#meeting-3:fedoraproject.org
2025-04-03 17:09:26 <@nirik:matrix.scrye.com> !info CLE Infra&Releng NA-hours team has a Monday through Thursday 30 minute meeting going through tickets at 1900 UTC in https://matrix.to/#/#meeting-3:fedoraproject.org
2025-04-03 17:09:26 <@nirik:matrix.scrye.com> !info OpenID EOL in Fedora Infra is set to 20-05-2025
2025-04-03 17:09:34 <@nirik:matrix.scrye.com> !info we are in f42 final freeze now
2025-04-03 17:09:50 <@nirik:matrix.scrye.com> oh right, it doesn't like topic with the rest?
2025-04-03 17:09:56 <@nirik:matrix.scrye.com> oh, just slow
2025-04-03 17:10:12 <@nirik:matrix.scrye.com> any other announcements from anyone?
2025-04-03 17:10:54 <@carlwgeorge:fedora.im> Is this the best section for freeze break requests?
2025-04-03 17:11:33 <@nirik:matrix.scrye.com> well, we don't really have one for those, but sure! :)
2025-04-03 17:12:25 <@carlwgeorge:fedora.im> !link https://lists.fedoraproject.org/archives/list/infrastructure@lists.fedoraproject.org/thread/O2WU6RDJ255PGYUW6H5MQK7VUT4SV4TE/
2025-04-03 17:13:01 <@nirik:matrix.scrye.com> I'm probibly happy to +1 it, but I haven't gotten to that pass on email yet
2025-04-03 17:14:08 <@carlwgeorge:fedora.im> Cool, mainly wanted to bring it up for awareness.  Will wait for that second +1
2025-04-03 17:14:15 <@nirik:matrix.scrye.com> should be pretty reasonable/easy to back out.
2025-04-03 17:14:22 <@nirik:matrix.scrye.com> will do so after the meeting. :)
2025-04-03 17:14:39 <@Zlopez:matrix.org> It looked straightforward, so I already acked it :-)
2025-04-03 17:15:09 <@nirik:matrix.scrye.com> oh, we should probibly adjust that openid announcement... if we have changed plans and are giving it more time...
2025-04-03 17:15:33 <@Zlopez:matrix.org> It's still in discussion right now
2025-04-03 17:15:41 <@nirik:matrix.scrye.com> ok, fair enough.
2025-04-03 17:16:07 <@Zlopez:matrix.org> But I will do another announcement once we decide to go with it
2025-04-03 17:16:29 <@nirik:matrix.scrye.com> ok
2025-04-03 17:16:36 <@nirik:matrix.scrye.com> lets move on to oncall then...
2025-04-03 17:16:41 <@nirik:matrix.scrye.com> !info ??? is on call from 2025-04-18 to 2025-04-24
2025-04-03 17:16:41 <@nirik:matrix.scrye.com> !topic Oncall
2025-04-03 17:16:41 <@nirik:matrix.scrye.com> !info https://docs.fedoraproject.org/en-US/infra/day_to_day_fedora/#_the_oncall_role_in_our_team
2025-04-03 17:16:41 <@nirik:matrix.scrye.com> !info @nirik is on call from 2025-03-21 to 2025-03-27
2025-04-03 17:16:41 <@nirik:matrix.scrye.com> !info @markrosenbaum is on call from 2025-03-28 to 2025-04-03
2025-04-03 17:16:41 <@nirik:matrix.scrye.com> !info @Zlopez is on call from 2025-04-04 to 2025-04-10
2025-04-03 17:16:41 <@nirik:matrix.scrye.com> !info ??? is on call from 2025-04-11 to 2025-04-17
2025-04-03 17:16:50 <@nirik:matrix.scrye.com> oops. Deleting those old ones.
2025-04-03 17:17:13 <@nirik:matrix.scrye.com> anyone want to claim those last 2? otherwise we can wait for next week...
2025-04-03 17:17:22 <@Zlopez:matrix.org> Let me switch the oncall
2025-04-03 17:17:42 <@markrosenbaum:fedora.im> So only one on call pings this week
2025-04-03 17:17:51 <@Zlopez:matrix.org> !oncall
2025-04-03 17:17:52 <@zodbot:fedora.im> The following people are oncall:
2025-04-03 17:17:52 <@zodbot:fedora.im> 
2025-04-03 17:17:52 <@zodbot:fedora.im> ● @Zlopez:matrix.org (zlopez) Current Time for them: 19:17 (Europe/Prague)
2025-04-03 17:17:52 <@zodbot:fedora.im> If they do not respond, please file a ticket (https://pagure.io/fedora-infrastructure/issues)
2025-04-03 17:17:57 <@Zlopez:matrix.org> Set :-)
2025-04-03 17:18:07 <@markrosenbaum:fedora.im> Was about Pagure and it resolved itself
2025-04-03 17:18:23 <@markrosenbaum:fedora.im> Also I can take  2025-04-11 to 2025-04-17
2025-04-03 17:18:33 <@markrosenbaum:fedora.im> Unless someone else wants it
2025-04-03 17:18:36 <@nirik:matrix.scrye.com> cool.
2025-04-03 17:18:59 <@nirik:matrix.scrye.com> updated.
2025-04-03 17:19:11 <@nirik:matrix.scrye.com> On to monitoring...
2025-04-03 17:19:13 <@nirik:matrix.scrye.com> !info https://nagios.fedoraproject.org/nagios 
2025-04-03 17:19:13 <@nirik:matrix.scrye.com> !info Go over existing items and fix them
2025-04-03 17:19:13 <@nirik:matrix.scrye.com> !topic Monitoring discussion [nirik]
2025-04-03 17:19:30 <@nirik:matrix.scrye.com> pretty much exactly the same as last week.
2025-04-03 17:20:09 <@nirik:matrix.scrye.com> we continue to see mailman alerts when package updates announce list gets things... I think it's due to invalid addresses on that list that don't bounce right in a way for mailman to handle
2025-04-03 17:20:35 <@nirik:matrix.scrye.com> Thats it from nagios that I can think of.
2025-04-03 17:21:08 <@Zlopez:matrix.org> There was the issue with docs returning 404
2025-04-03 17:21:24 <@nirik:matrix.scrye.com> Gwmngilfen and Mark Rosenbaum did some work on zabbix staging in the last week... hopefully thats going well.
2025-04-03 17:21:46 <@Zlopez:matrix.org> It was fixed by me, but it seems that I fixed it only partly and @darknao:fedora.im did the rest today
2025-04-03 17:22:02 <@nirik:matrix.scrye.com> yeah, hung rsync's. :( Not sure what to do about that... I guess we could look at a timer to kill them if they don't finish in X time. Or a check to make sure the backend docs match the proxy versions
2025-04-03 17:22:10 <@markrosenbaum:fedora.im> Ehhhh, some cursed stuff but it seems ok now
2025-04-03 17:22:36 <@markrosenbaum:fedora.im> Again I just want to confirm, we're not affected by freeze right?
2025-04-03 17:23:11 <@nirik:matrix.scrye.com> zabbix servers are definitely not. If you want to change agents that are on frozen machines... thats best avoided. Staging is never frozen at all...
2025-04-03 17:23:26 <@markrosenbaum:fedora.im> Yeah not agents, just the zabbix server
2025-04-03 17:24:07 <@Zlopez:matrix.org> I saw it happen for first time
2025-04-03 17:24:17 <@markrosenbaum:fedora.im> I had previously asked a while back but Gwmngilfen was asking again on the latest PR
2025-04-03 17:24:41 <@nirik:matrix.scrye.com> the servers are not frozen. They are not important for us to release fedora 42. ;)
2025-04-03 17:25:29 <@nirik:matrix.scrye.com> However, i now notice they don't actually have a 'frozen: false' variable. We can fix that.
2025-04-03 17:25:46 <@nirik:matrix.scrye.com> any other monitoring news?
2025-04-03 17:26:25 <@Zlopez:matrix.org> Not from me
2025-04-03 17:27:03 <@nirik:matrix.scrye.com> I had a few quick topics before we look at backlog or the like...
2025-04-03 17:27:10 <@nirik:matrix.scrye.com> !topic flock 2025
2025-04-03 17:27:31 <@nirik:matrix.scrye.com> Just wanted to note that flock is coming up in a few months... if anyone wants to try and plan to be there
2025-04-03 17:27:40 <@nirik:matrix.scrye.com> https://fedoraproject.org/flock/2025/
2025-04-03 17:27:40 <@x3mboy:fedora.im> Hello team
2025-04-03 17:27:44 <@x3mboy:fedora.im> .hello2
2025-04-03 17:27:48 <@x3mboy:fedora.im> .hello
2025-04-03 17:27:53 <@x3mboy:fedora.im> !hello
2025-04-03 17:27:53 <@nirik:matrix.scrye.com> My infra workshop wasn't accepted. ;(
2025-04-03 17:27:53 <@zodbot:fedora.im> Eduard Lucena (x3mboy) - he / him / his
2025-04-03 17:28:00 <@nirik:matrix.scrye.com> hey x3mboy!
2025-04-03 17:28:13 <@x3mboy:fedora.im> !cookies nirik
2025-04-03 17:28:36 <@Zlopez:matrix.org> None of my 3 talks were accepted as well
2025-04-03 17:28:49 <@nirik:matrix.scrye.com> I think the schedule will be out later this week or early next
2025-04-03 17:28:52 <@Zlopez:matrix.org> From what I heard they had a record amount of proposals
2025-04-03 17:29:03 <@markrosenbaum:fedora.im> Our join talk was accepted but I can’t go :(
2025-04-03 17:29:15 <@nirik:matrix.scrye.com> In any case I am always happy to meet up with anyone face to face who's there... (I plan to be there)
2025-04-03 17:29:27 <@nirik:matrix.scrye.com> Mark Rosenbaum bummer. ;(
2025-04-03 17:29:33 <@Zlopez:matrix.org> Me too, the hallway track is always best :-)
2025-04-03 17:29:53 <@nirik:matrix.scrye.com> ok, just wanted to mention it... next...
2025-04-03 17:30:03 <@nirik:matrix.scrye.com> !topic Datacenter Move
2025-04-03 17:31:40 <@nirik:matrix.scrye.com> Things have been pretty quiet on the DC move front... but they are likely to start heating up soon. The current plan is to switch to the new DC the week of june 16th. So, we have to have things all lined up before then. In the next few weeks I hope to gain out of band access to our new hardware. Then it's bootstrapping up things there, etc... I am sure I will need lots of help from everyone.
2025-04-03 17:32:05 <@nirik:matrix.scrye.com> I have a hackmd doc with plans (which I need to get back to updating): https://hackmd.io/54xmtW6IQoKNKnbRXySxSg?edit
2025-04-03 17:32:12 <@Zlopez:matrix.org> Let me know if you need any help with that
2025-04-03 17:32:16 <@nirik:matrix.scrye.com> if anyone has comments/questions, let me know
2025-04-03 17:33:42 <@nirik:matrix.scrye.com> ok, what shall we do with our 27min left?
2025-04-03 17:33:47 <@nirik:matrix.scrye.com> backlog refinement
2025-04-03 17:33:53 <@nirik:matrix.scrye.com> some learning topic
2025-04-03 17:34:00 <@nirik:matrix.scrye.com> end early and get some time back
2025-04-03 17:34:12 <@nirik:matrix.scrye.com> (feel free to vote with 👍 )
2025-04-03 17:34:25 <@markrosenbaum:fedora.im> Same here
2025-04-03 17:34:57 <@nirik:matrix.scrye.com> Definitely will do!
2025-04-03 17:36:00 <@nirik:matrix.scrye.com> ok, we can do backlog then? Zlopez you want to run it? or want me to?
2025-04-03 17:36:09 <@Zlopez:matrix.org> I can run it
2025-04-03 17:36:35 <@Zlopez:matrix.org> !topic Fedora Infra backlog refinement
2025-04-03 17:36:35 <@Zlopez:matrix.org> !info Refine oldest tickets on Fedora Infra tracker
2025-04-03 17:36:35 <@Zlopez:matrix.org> !link https://pagure.io/fedora-infrastructure/issues?status=Open&order_key=last_updated&order=asc
2025-04-03 17:37:03 <@Zlopez:matrix.org> !ticket 11884
2025-04-03 17:37:04 <@zodbot:fedora.im> ● **Opened:** 12 months ago by svashisht
2025-04-03 17:37:04 <@zodbot:fedora.im> ● **Assignee:** Not Assigned
2025-04-03 17:37:04 <@zodbot:fedora.im> ● **Last Updated:** 6 months ago
2025-04-03 17:37:04 <@zodbot:fedora.im> 
2025-04-03 17:37:04 <@zodbot:fedora.im> **fedora-infrastructure #11884** (https://pagure.io/fedora-infrastructure/issue/11884):**RFE: Add a role for deploying through OpenShift deployment**
2025-04-03 17:37:17 <@nirik:matrix.scrye.com> This just never got anyone willing to drive it...
2025-04-03 17:37:24 <@nirik:matrix.scrye.com> I think it's still a good idea.
2025-04-03 17:38:15 <@Zlopez:matrix.org> Right now only owner of the openshift project can do that, if I remember it correctly
2025-04-03 17:38:47 <@nirik:matrix.scrye.com> appowners manually yeah, but if there was a playbook anyone who can run the playbook could do so.
2025-04-03 17:38:58 <@Zlopez:matrix.org> That was the point
2025-04-03 17:39:10 <@nirik:matrix.scrye.com> and... we have playbooks like the bodhi one.
2025-04-03 17:39:34 <@nirik:matrix.scrye.com> it copies over all the templates, etc... but then at the end it scales down pods and back up and starts a build...
2025-04-03 17:40:14 <@nirik:matrix.scrye.com> could we do something a bit more clever here:
2025-04-03 17:40:22 <@Zlopez:matrix.org> We only need something for scaling pods down and back up
2025-04-03 17:40:31 <@nirik:matrix.scrye.com> have a manual playbook for every app, but mostly it just includes a generic one that they all use
2025-04-03 17:40:55 <@nirik:matrix.scrye.com> well, no, we need sometimes to start builds/rollout latest deployment.
2025-04-03 17:41:07 <@nirik:matrix.scrye.com> if you just scale down and up again it's still using the same version, not any new one...
2025-04-03 17:41:27 <@nirik:matrix.scrye.com> (as far as I recall)
2025-04-03 17:41:59 <@Zlopez:matrix.org> The build is usually part of normal playbook
2025-04-03 17:42:04 <@nirik:matrix.scrye.com> also, note that all our old apps that use deploymentconfig are slightly different that our newer stuff thats converted to deployment
2025-04-03 17:42:35 <@Zlopez:matrix.org> I need to check how the deployment one looks
2025-04-03 17:42:51 <@nirik:matrix.scrye.com> for 37/60 of them, yeah.
2025-04-03 17:42:54 <@Zlopez:matrix.org> I'm still mostly working with deploymentconfigs
2025-04-03 17:43:30 <@Zlopez:matrix.org> But doing something more general that could be shared by other playbooks sounds great
2025-04-03 17:43:56 <@nirik:matrix.scrye.com> I don't like that the playbook starts a build... it seems like to me the playbook should just handle the config... and then build/deployment rollout is decided seperately... but perhaps I am overcomplicating it.
2025-04-03 17:44:21 <@nirik:matrix.scrye.com> a build should rollout after it finishes.
2025-04-03 17:44:46 <@nirik:matrix.scrye.com> so, the openscanhub playbook doesn't do a build.
2025-04-03 17:44:50 <@Zlopez:matrix.org> That could be configured in build config
2025-04-03 17:45:02 <@nirik:matrix.scrye.com> so, just adding that for now would 'fix' this issue I guess.
2025-04-03 17:46:03 <@Zlopez:matrix.org> But it would still be neat to have something for just build and rollout
2025-04-03 17:47:50 <@nirik:matrix.scrye.com> I guess... but when would you want to build the new thing and not roll it out?
2025-04-03 17:48:58 <@Zlopez:matrix.org> We should probably write some of the OpenShift project best practices, so people know how the OpenShift project should look
2025-04-03 17:49:21 <@nirik:matrix.scrye.com> yeah, dkirwan did write up an initial version:
2025-04-03 17:49:32 <@Zlopez:matrix.org> I always have deployment triggered when image is changed, which means new build will automatically deploy new version
2025-04-03 17:49:43 <@nirik:matrix.scrye.com> https://docs.fedoraproject.org/en-US/infra/developer_guide/openshift/
2025-04-03 17:50:04 <@nirik:matrix.scrye.com> sorry, this one:
2025-04-03 17:50:30 <@nirik:matrix.scrye.com> https://docs.fedoraproject.org/en-US/infra/developer_guide/openshift_bestpractices/
2025-04-03 17:50:38 <@nirik:matrix.scrye.com> copy and paste was doing weird things there. ;(
2025-04-03 17:50:47 <@Zlopez:matrix.org> Nice
2025-04-03 17:51:25 <@nirik:matrix.scrye.com> anyhow, not sure what to do with this ticket and we have been talking about it for a while. ;)
2025-04-03 17:51:47 <@nirik:matrix.scrye.com> close for now? leave and try and find someone to work on playbooks? discuss more in a discussion thread or something?
2025-04-03 17:52:07 <@Zlopez:matrix.org> Let me just update it with what we talked about and go to next one
2025-04-03 17:52:18 <@nirik:matrix.scrye.com> ok
2025-04-03 17:52:23 <@Zlopez:matrix.org> I still think this is a nice feature to have
2025-04-03 17:52:42 <@Zlopez:matrix.org> !ticket 11958
2025-04-03 17:52:45 <@zodbot:fedora.im> 
2025-04-03 17:52:45 <@zodbot:fedora.im> **fedora-infrastructure #11958** (https://pagure.io/fedora-infrastructure/issue/11958):**Add fedora-l10n pagure group as an admin to the fedora-l10n-docs namespace projects**
2025-04-03 17:52:45 <@zodbot:fedora.im> ● **Assignee:** Not Assigned
2025-04-03 17:52:45 <@zodbot:fedora.im> ● **Last Updated:** 6 months ago
2025-04-03 17:52:45 <@zodbot:fedora.im> ● **Opened:** 11 months ago by peartown
2025-04-03 17:53:07 <@nirik:matrix.scrye.com> ugh, this one fell to the bottom of the pile
2025-04-03 17:53:41 <@nirik:matrix.scrye.com> I guess someone just needs to do this.
2025-04-03 17:53:51 <@Zlopez:matrix.org> I think it's a good easy ticket for anyone with admin rights for pagure
2025-04-03 17:54:04 <@nirik:matrix.scrye.com> thats 52 projects
2025-04-03 17:54:14 <@Zlopez:matrix.org> As it's not difficult just plenty manual work
2025-04-03 17:54:47 <@x3mboy:fedora.im> Is that something that I can do with my current permissions?
2025-04-03 17:55:12 <@Zlopez:matrix.org> Let me check
2025-04-03 17:55:17 <@nirik:matrix.scrye.com> I would think something could be done via the api? clicking on 52 projects seems error prone
2025-04-03 17:55:35 <@nirik:matrix.scrye.com> likely not, but you could make a script that uses the api and hand it to someone to run?
2025-04-03 17:55:58 <@Zlopez:matrix.org> That could work as well :-)
2025-04-03 17:55:59 <@x3mboy:fedora.im> Ok, I'll check it
2025-04-03 17:56:41 <@nirik:matrix.scrye.com> at least I hope it could be done via the api...
2025-04-03 17:56:46 <@Zlopez:matrix.org> Looking at your permissions you can't, but you can still write the script using API :-)
2025-04-03 17:56:53 <@nirik:matrix.scrye.com> thanks x3mboy... that would be helpful.
2025-04-03 17:57:30 <@Zlopez:matrix.org> @x3mboy:fedora.im Do you want to be assigned to this ticket?
2025-04-03 17:57:56 <@x3mboy:fedora.im> Sure
2025-04-03 17:58:17 <@nirik:matrix.scrye.com> we are getting low on time, lets hit open floor...
2025-04-03 17:58:21 <@nirik:matrix.scrye.com> !topic Open Floor
2025-04-03 17:58:29 <@nirik:matrix.scrye.com> Just a few bits from me:
2025-04-03 17:58:56 <@Zlopez:matrix.org> @x3mboy:fedora.im Done, have fun :-)
2025-04-03 17:59:18 <@nirik:matrix.scrye.com> There was a bit of a security scare with atop over the weekend. So to be paranoid I uninstalled it. Turned out to be not much of a issue, but I decided to replace atop with btop on our machines. So, btop should be there if you need it.
2025-04-03 17:59:51 <@Zlopez:matrix.org> The btop is great, I didn't even know it existed :-)
2025-04-03 18:00:10 <@Zlopez:matrix.org> I just saw it in command history when doing something on some of the machines :-)
2025-04-03 18:00:40 <@nirik:matrix.scrye.com> I also did some more blocking on pagure.io yesterday. There was a copy of the linux kernel that was 4-5years old labeled 'test' from someone, but all the crawlers were hitting it really hard. So, I gathered the ips (140,000 or so), collapsed them into /24's and created a 'spammers' ipset matching those nets. It seems to have helped a fair bit.
2025-04-03 18:01:11 <@zodbot:fedora.im> zlopez has already given cookies to kevin during the F41 timeframe
2025-04-03 18:01:35 <@nirik:matrix.scrye.com> we still do need a longer term solution, but hopefully this will tide us over for a bit at least
2025-04-03 18:01:47 <@nirik:matrix.scrye.com>  2679116 160575818 REJECT     tcp  --  *      *       0.0.0.0/0            0.0.0.0/0            match-set spammers src reject-with icmp-port-unreachable
2025-04-03 18:01:47 <@nirik:matrix.scrye.com> pkts      bytes target     prot opt in     out     source               destination         
2025-04-03 18:02:16 <@nirik:matrix.scrye.com> I figure anyone going to that project was likely a crawler.
2025-04-03 18:02:33 <@Zlopez:matrix.org> I need to look how does one work with ipsets
2025-04-03 18:02:54 <@nirik:matrix.scrye.com> I could do a learning/talk on it next week? or sometime else?
2025-04-03 18:03:08 <@nirik:matrix.scrye.com> anyhow, thats all I had...
2025-04-03 18:03:20 <@nirik:matrix.scrye.com> Thanks for coming everyone!
2025-04-03 18:03:23 <@nirik:matrix.scrye.com> !endmeeting