2024-04-04 16:00:06 <@lenkaseg:fedora.im> !startmeeting Infrastructure (2024-04-04)
2024-04-04 16:00:07 <@meetbot:fedora.im> Meeting started at 2024-04-04 16:00:06 UTC
2024-04-04 16:00:07 <@meetbot:fedora.im> The Meeting name is 'Infrastructure (2024-04-04)'
2024-04-04 16:00:14 <@lenkaseg:fedora.im> !meetingname infrastructure
2024-04-04 16:00:20 <@lenkaseg:fedora.im> !chair nirik zlopez nb bodanel dtometzki jnsamyak lenkaseg patrikp
2024-04-04 16:00:32 <@lenkaseg:fedora.im> !info Agenda is at: https://board.net/p/fedora-infra
2024-04-04 16:00:39 <@lenkaseg:fedora.im> About our team: https://docs.fedoraproject.org/en-US/cpe/
2024-04-04 16:00:45 <@lenkaseg:fedora.im> Fedora Infra documentation: https://docs.fedoraproject.org/en-US/infra
2024-04-04 16:00:50 <@lenkaseg:fedora.im> !topic namaste
2024-04-04 16:00:54 <@nirik:matrix.scrye.com> morning 🌄
2024-04-04 16:01:00 <@lenkaseg:fedora.im> Hello everybody!
2024-04-04 16:01:02 <@leo:fedora.im> hey!
2024-04-04 16:01:03 <@pcreech:matrix.org> !hello pcreech17
2024-04-04 16:01:05 <@zodbot:fedora.im> Patrick Creech (pcreech17)
2024-04-04 16:01:06 <@pcreech:matrix.org> mornin!
2024-04-04 16:01:13 <@leo:fedora.im> hope everyone is doing well
2024-04-04 16:01:44 <@Zlopez:matrix.org> !hi
2024-04-04 16:01:46 <@zodbot:fedora.im> Michal Konecny (zlopez)
2024-04-04 16:02:03 <@lenkaseg:fedora.im> !topic New folks introductions
2024-04-04 16:02:10 <@lenkaseg:fedora.im> Do we have any new folks here?
2024-04-04 16:02:28 <@lenkaseg:fedora.im> !info This is a place where people who are interested in Fedora Infrastructure can introduce themselves
Getting Started Guide: https://docs.fedoraproject.org/en-US/infra/gettingstarted/
2024-04-04 16:03:24 <@lenkaseg:fedora.im> Only old folks it seems
2024-04-04 16:03:35 <@lenkaseg:fedora.im> !topic Next chair
2024-04-04 16:03:46 <@aheath1992:matrix.org> !hi
2024-04-04 16:03:48 <@zodbot:fedora.im> Andrew Heath (aheath1992)
2024-04-04 16:03:56 <@lenkaseg:fedora.im> Hi aheath1992 !
2024-04-04 16:04:02 <@nirik:matrix.scrye.com> Hey! who you calling old? Oh wait, I _am_ old. ;)
2024-04-04 16:04:13 <@freedisch:matrix.org> for Next chair✋
2024-04-04 16:04:24 <@leo:fedora.im> well... young at heart. :D
2024-04-04 16:04:44 <@lenkaseg:fedora.im> nirik fedora infra veterans let's say 
2024-04-04 16:05:04 <@lenkaseg:fedora.im> Freedisch Thibaut Batale: Thanks for volunteering!
2024-04-04 16:05:15 <@lenkaseg:fedora.im> !info magic eight ball says:
2024-04-04 16:05:19 <@lenkaseg:fedora.im> !info chair 2024-04-11 zlopez
2024-04-04 16:05:31 <@lenkaseg:fedora.im> !info chair 2024-04-18 Freedisch Thibaut Batale 
2024-04-04 16:07:07 <@lenkaseg:fedora.im> ok, we have chairfolks for next 14 days, that's good
2024-04-04 16:07:11 <@lenkaseg:fedora.im> !topic announcements and information
2024-04-04 16:07:38 <@lenkaseg:fedora.im> !info CPE Infra&Releng EU-hours team has a Monday through Thursday 30 minute meeting going 
2024-04-04 16:07:45 <@lenkaseg:fedora.im> through tickets at 0800 UTC in https://matrix.to/#/#meeting-3:fedoraproject.org
2024-04-04 16:07:52 <@lenkaseg:fedora.im> !info CPE Infra&Releng NA-hours team has a Monday through Thursday 30 minute meeting going through tickets at 1800 UTC in #fedora-meeting-3
2024-04-04 16:08:01 <@pcreech:matrix.org> Old is in the eye of the beholder....
2024-04-04 16:08:02 <@lenkaseg:fedora.im> !info F40 final freeze started 2024-04-02
2024-04-04 16:08:16 <@lenkaseg:fedora.im> !info we are out of F40 Beta freeze, F40 Beta has been released!
2024-04-04 16:08:44 <@leo:fedora.im> hooray!
2024-04-04 16:09:08 <@lenkaseg:fedora.im> Do we have some more announcements?
2024-04-04 16:10:09 <@nirik:matrix.scrye.com> I'd like to ask folks to read and reply on:
2024-04-04 16:10:23 <@nirik:matrix.scrye.com> !info please provide feedback on https://discussion.fedoraproject.org/t/planning-for-infra-and-releng-hackfest-at-flock-2024/110244
2024-04-04 16:10:39 <@nirik:matrix.scrye.com> to plan a hackfest at flock later this year. ;)
2024-04-04 16:10:51 <@lenkaseg:fedora.im> Yup, I read it
2024-04-04 16:11:05 <@lenkaseg:fedora.im> Good ideas there
2024-04-04 16:11:14 <@Zlopez:matrix.org> I have it open, didn't get to it yet
2024-04-04 16:11:42 <@nirik:matrix.scrye.com> Cool. Just wanted to note it... feedback welcome/desired. ;)
2024-04-04 16:13:13 <@lenkaseg:fedora.im> let's move on to oncall!
2024-04-04 16:13:25 <@lenkaseg:fedora.im> !topic Oncall
2024-04-04 16:13:29 <@lenkaseg:fedora.im> !info https://fedoraproject.org/wiki/Infrastructure/Oncall
2024-04-04 16:13:34 <@lenkaseg:fedora.im> https://docs.fedoraproject.org/en-US/cpe/day_to_day_fedora/
2024-04-04 16:13:40 <@lenkaseg:fedora.im> ##!oncall add <fas_name>
2024-04-04 16:13:48 <@lenkaseg:fedora.im> !info nirik is on call from 2024-03-28 to 2024-04-04
2024-04-04 16:14:09 <@lenkaseg:fedora.im> Any volunteer for 2024-04-05 to 2024-04-11?
2024-04-04 16:14:14 <@leo:fedora.im> i'll take it
2024-04-04 16:14:20 <@lenkaseg:fedora.im> sold!
2024-04-04 16:14:30 <@lenkaseg:fedora.im> !info leo is on call from 2024-04-05 to 2024-04-11
2024-04-04 16:14:45 <@lenkaseg:fedora.im> !info Summary of last week: (from current oncall)
2024-04-04 16:14:52 <@lenkaseg:fedora.im> nirik, floor's yours!
2024-04-04 16:15:33 <@nirik:matrix.scrye.com> I had one oncall ping... about fedora review service not working because (it was thought) bugzilla messages were stuck... but they were not...
2024-04-04 16:15:43 <@nirik:matrix.scrye.com> I am not sure if the review side got sorted or not.
2024-04-04 16:15:48 <@nirik:matrix.scrye.com> That was all
2024-04-04 16:16:27 <@lenkaseg:fedora.im> Alright, thanks!
2024-04-04 16:16:32 <@lenkaseg:fedora.im> !topic Monitoring discussion [nirik]
2024-04-04 16:16:45 <@lenkaseg:fedora.im> Over to nirik again :)
2024-04-04 16:17:27 <@nirik:matrix.scrye.com> lets see...
2024-04-04 16:17:56 <@nirik:matrix.scrye.com> we have one machine down (because it was replaced with a new machine and they haven't setup the network ports yet on it)
2024-04-04 16:18:14 <@nirik:matrix.scrye.com> proxy14 has been misbehaving. ;(
2024-04-04 16:18:32 <@nirik:matrix.scrye.com> would be good to figure out whats happening there.
2024-04-04 16:19:00 <@nirik:matrix.scrye.com> Otherwise we have db01 and db-datanommer02 alerting on disk space as they have been for a while.
2024-04-04 16:19:26 <@nirik:matrix.scrye.com> I am going to move them to rhel9 and more space after freeze, because I am waiting on a new virthost in iad2 to put them on being racked.
2024-04-04 16:19:52 <@nirik:matrix.scrye.com> I think thats pretty much it. Things are looking better than they have in a while. ;)
2024-04-04 16:20:17 <@lenkaseg:fedora.im> Thanks for the updates!
2024-04-04 16:20:47 <@lenkaseg:fedora.im> I don't see any learning topic
2024-04-04 16:20:51 <@lenkaseg:fedora.im> Thas means
2024-04-04 16:20:55 <@lenkaseg:fedora.im> 
!topic Revisit blocked tickets
2024-04-04 16:21:01 <@lenkaseg:fedora.im> !info Check if any blocked ticket is unblocked
2024-04-04 16:21:11 <@lenkaseg:fedora.im> !link https://pagure.io/fedora-infrastructure/issues?status=Open&tags=blocked&priority=0&close_status=
2024-04-04 16:21:15 <@Zlopez:matrix.org> We did that last week, so I think we can end up early
2024-04-04 16:21:40 <@Zlopez:matrix.org> Or we can talk about anything
2024-04-04 16:21:43 <@nirik:matrix.scrye.com> Yeah, or... perhaps we could get a quick status on the rhel7 eol tickets?
2024-04-04 16:21:48 <@lenkaseg:fedora.im> Zlopez: you mean learning topic or blocked?
2024-04-04 16:21:54 <@leo:fedora.im> blocked
2024-04-04 16:22:16 <@Zlopez:matrix.org> nirik: Good idea
2024-04-04 16:22:58 <@lenkaseg:fedora.im> https://pagure.io/fedora-infrastructure/issues?status=Open&search_pattern=rhel7&priority=0&close_status=
2024-04-04 16:23:17 <@Zlopez:matrix.org> So we have the metaticket
2024-04-04 16:23:27 <@Zlopez:matrix.org> !ticket 11815
2024-04-04 16:23:29 <@zodbot:fedora.im> **fedora-infrastructure #11815** (https://pagure.io/fedora-infrastructure/issue/11815):**rhel7 eol**

● **Opened:** 4 weeks ago by zlopez
● **Last Updated:** 4 weeks ago
● **Assignee:** zlopez
2024-04-04 16:24:09 <@Zlopez:matrix.org> Some things are already closed: OSBS, kerneltest, os-control01, cloud-noc01
2024-04-04 16:24:47 <@Zlopez:matrix.org> There is progress being done on Badges, PDC, mirrormanager, Fedimg and mailman
2024-04-04 16:25:43 <@Zlopez:matrix.org> We still have few services using fedmsg instead of fedora-messaging and there should be outreachy project starting for replacement of github2fedmsg
2024-04-04 16:25:47 <@nirik:matrix.scrye.com> on mailman, you said you were doing a mailman3-fedmsg-plugin... is that really fedmsg? or moving to fedora-messaging?
2024-04-04 16:26:04 <@Zlopez:matrix.org> It's fedora-messaging, just the name is the same
2024-04-04 16:26:13 <@nirik:matrix.scrye.com> ah, ok.
2024-04-04 16:26:48 <@Zlopez:matrix.org> I will start looking in authentication tomorrow as it currently fails when trying to login with Fedora
2024-04-04 16:27:23 <@Zlopez:matrix.org> And I forgot to mention that MBS will go away with F38
2024-04-04 16:27:23 <@nirik:matrix.scrye.com> Yeah, I don't recall if it was openid or what... would be good to do oidc.
2024-04-04 16:27:36 <@Zlopez:matrix.org> It is openid
2024-04-04 16:27:50 <@Zlopez:matrix.org> It's using this library https://gitlab.com/mailman/django-mailman3
2024-04-04 16:27:58 <@nirik:matrix.scrye.com> ah... ;(
2024-04-04 16:28:26 <@Zlopez:matrix.org> I will discuss this with Aurélien B tomorrow as he is the one who added fedora provider
2024-04-04 16:30:21 <@Zlopez:matrix.org> So what remains in the list for rhel7 eol is
* db-fas01
* sundries servers
* Fedora people
2024-04-04 16:30:37 <@nirik:matrix.scrye.com> So, the first two I am planning on doing after freeze.
2024-04-04 16:31:05 <@nirik:matrix.scrye.com> the last one we need to start moving people to the new planet... I can look at what we need to communicate there.
2024-04-04 16:32:07 <@nirik:matrix.scrye.com> that will entail: asking people to check for issues with it, then asking contibutors to update their settings in accounts, then setting a 'old planet goes away on X date' date.
2024-04-04 16:32:37 <@Zlopez:matrix.org> Does this mean that we are running pluto now?
2024-04-04 16:32:52 <@nirik:matrix.scrye.com> yes, pluto is running in openshift.
2024-04-04 16:32:58 <@nirik:matrix.scrye.com> https://planet.apps.ocp.fedoraproject.org/
2024-04-04 16:33:21 <@nirik:matrix.scrye.com> Kudos to phsmoura on it. ;)
2024-04-04 16:33:36 <@Zlopez:matrix.org> I see the ticket is still open for the update
2024-04-04 16:33:43 <@nirik:matrix.scrye.com> I'd also like to tell people we will  only do https blogs. There's little excuse for http these days now
2024-04-04 16:33:43 <@Zlopez:matrix.org> !ticket 10383
2024-04-04 16:33:46 <@zodbot:fedora.im> **fedora-infrastructure #10383** (https://pagure.io/fedora-infrastructure/issue/10383):**Upgrade Venus to Pluto**

● **Opened:** 2 years ago by nerdsville
● **Last Updated:** a week ago
● **Assignee:** phsmoura
2024-04-04 16:33:52 <@nirik:matrix.scrye.com> yes, it's not done.
2024-04-04 16:33:59 <@nirik:matrix.scrye.com> we need to do the hard social part. ;)
2024-04-04 16:34:06 <@nirik:matrix.scrye.com> "that will entail: asking people to check for issues with it, then asking contibutors to update their settings in accounts, then setting a 'old planet goes away on X date' date."
2024-04-04 16:34:24 <@Zlopez:matrix.org> OK, so let's keep the ticket open
2024-04-04 16:34:24 <@nirik:matrix.scrye.com> if we just kill the old one now I think people will be mad that we didn't notify about it.
2024-04-04 16:34:48 <@nirik:matrix.scrye.com> but perhaps we don't need a ton of time... we can discuss that.
2024-04-04 16:35:27 <@nirik:matrix.scrye.com> after that, I can redo people as rhel9 easily. I already did deploy a rhel9 one before I saw planet needed moving...
2024-04-04 16:35:48 <@nirik:matrix.scrye.com> but venus (the current planet) is python2... and very very dead.
2024-04-04 16:36:00 <@Zlopez:matrix.org> It seems we are on the good track for RHEL7 EOL
2024-04-04 16:36:25 <@nirik:matrix.scrye.com> yeah, looking not too bad...
2024-04-04 16:37:08 <@Zlopez:matrix.org> Anything else we want to discuss?
2024-04-04 16:37:13 <@nirik:matrix.scrye.com> I had one more small item (not rhel7)...
2024-04-04 16:37:49 <@lenkaseg:fedora.im> Go on nirik 
2024-04-04 16:38:23 <@nirik:matrix.scrye.com> So, package retirements were broken for a while... from March 4th to April 1st. ;(
2024-04-04 16:38:41 <@nirik:matrix.scrye.com> This was fallout from disabling the git hook on src.fedoraproject.org.
2024-04-04 16:38:58 <@nirik:matrix.scrye.com> I re-enabled it, but if you talk to Aurélien B tomorrow, you might mention it to him...
2024-04-04 16:39:20 <@nirik:matrix.scrye.com> The toddler needs info in that hook currently... I don't know if the pagure hook will have enough info.
2024-04-04 16:39:31 <@nirik:matrix.scrye.com> https://pagure.io/releng/issue/12028 is the releng issue on it.
2024-04-04 16:40:11 <@Zlopez:matrix.org> It should contain the info now
2024-04-04 16:41:16 <@nirik:matrix.scrye.com> the toddler looks for 'files changed' and I don't think it has that.
2024-04-04 16:41:19 <@nirik:matrix.scrye.com> but I could be wrong
2024-04-04 16:41:44 <@Zlopez:matrix.org> I think it was disabled, because the same message was sent twice, but as we found out, that it wasn't quite same
2024-04-04 16:42:03 <@nirik:matrix.scrye.com> right, there's a git hook and a pagure hook...
2024-04-04 16:42:17 <@nirik:matrix.scrye.com> we thought we could disable the git hook, but... not until we fix retirements apparently. ;)
2024-04-04 16:42:25 <@Zlopez:matrix.org> The packit needed the info as well
2024-04-04 16:42:37 <@nirik:matrix.scrye.com> yeah, they were fixed...
2024-04-04 16:43:02 <@nirik:matrix.scrye.com> It might just be some bug in the toddler. It wasn't throwing any error, but it wasn't doing anything either.
2024-04-04 16:43:38 <@Zlopez:matrix.org> Looking at the ticket, I see that I was pinged there, I must have missed that :-/
2024-04-04 16:44:12 <@Zlopez:matrix.org> nils is currently working on toddlers, I will let him know
2024-04-04 16:44:30 <@nirik:matrix.scrye.com> cool. yeah, we just need to sort it out...
2024-04-04 16:45:38 <@nphilipp:fedora.im> There’s a message sent out by fedora-messaging-git-hook and one sent out by Pagure directly
2024-04-04 16:45:53 <@nirik:matrix.scrye.com> yep
2024-04-04 16:45:58 <@nphilipp:fedora.im> Different schemas of course 😂
2024-04-04 16:47:21 <@nphilipp:fedora.im> Right now, not if you want mails being sent to scm-commits (eventually), as the Pagure message doesn’t have the required information
2024-04-04 16:47:22 <@Zlopez:matrix.org> And now nils know :-D
2024-04-04 16:47:58 <@nirik:matrix.scrye.com> perhaps we could make the pagure one better?
2024-04-04 16:48:06 <@nirik:matrix.scrye.com> and yeah, this looks like a schema problem.
2024-04-04 16:48:17 <@Zlopez:matrix.org> I think that is already done, just not deployed yet
2024-04-04 16:48:18 <@nphilipp:fedora.im> Not sure if I know anything about that other toddler, I’m happy that mine seems to do what it should (according to unit tests 😁) 
2024-04-04 16:48:49 <@nirik:matrix.scrye.com> I don't think the pagure messages have this: if "dead.package" not in msg["commit"]["stats"]["files"]:
2024-04-04 16:48:56 <@nirik:matrix.scrye.com> anyhow.
2024-04-04 16:49:03 <@nphilipp:fedora.im> I talked with Aurélien B before and there are existing consumers for both message topics (and schemas)
2024-04-04 16:49:13 <@nphilipp:fedora.im> So nixing either one will be trouble
2024-04-04 16:49:38 <@nirik:matrix.scrye.com> we thought we got all the ones for the src.fedoraproject.org git hook, but we were wrong. :)
2024-04-04 16:49:47 <@nirik:matrix.scrye.com> and I know! Lets make a 3rd one!
2024-04-04 16:50:03 <@Zlopez:matrix.org> Now let's make 2 more!
2024-04-04 16:50:05 <@nphilipp:fedora.im> Yeah, the git hook msg has this
2024-04-04 16:50:36 <@nirik:matrix.scrye.com> right, which is why the retirement toddler broke. ;(
2024-04-04 16:50:43 <@nphilipp:fedora.im> We have the option of introducing new versions to message schemas too, just in case THINGS ARE TOO SIMPLE
2024-04-04 16:51:43 <@Zlopez:matrix.org> That is because you don't want to broke the old ones just deprecate them
2024-04-04 16:52:11 <@Zlopez:matrix.org> I already needed that for Anitya messaging schema
2024-04-04 16:52:21 <@nirik:matrix.scrye.com> I'd love for the pagure messages to have more data for gatwaying to matrix too...
2024-04-04 16:52:31 <@nphilipp:fedora.im> The Pagure message has "changed_files" in the body…
2024-04-04 16:53:06 <@nphilipp:fedora.im> If only people would notice deprecation before you eventually remove things 🤷
2024-04-04 16:53:34 <@Zlopez:matrix.org> It's usually just a warning, so most people ignore it
2024-04-04 16:54:07 <@Zlopez:matrix.org> Solving every warning you see is not really productive
2024-04-04 16:54:52 <@Zlopez:matrix.org> And not sure if you even notice that when running consumer
2024-04-04 16:55:09 <@nphilipp:fedora.im> `-Werror` or equivalent should be default for developer envs 😛
2024-04-04 16:55:18 <@nphilipp:fedora.im> Otherwise nothing will happen
2024-04-04 16:55:32 <@nphilipp:fedora.im> (IMO, no need to debate 😂)
2024-04-04 16:55:55 <@Zlopez:matrix.org> I agree with everything :-D
2024-04-04 16:57:24 <@Zlopez:matrix.org> I think we are nearing the end of this meeting
2024-04-04 16:58:18 <@lenkaseg:fedora.im> Do we have something more to discuss in 3 minutes or let's end the meeting? 
2024-04-04 16:59:31 <@lenkaseg:fedora.im> I added a topic RHEL7 EOL to the meeting template. No need to run it every week, just as a reminder to stay on track
2024-04-04 16:59:53 <@lenkaseg:fedora.im> Thanks everyone for joining today!
2024-04-04 16:59:58 <@lenkaseg:fedora.im> !endmeeting