2024-09-12 16:00:45 <@Zlopez:matrix.org> !startmeeting Infrastructure (2024-09-12)
2024-09-12 16:00:50 <@meetbot:fedora.im> Meeting started at 2024-09-12 16:00:45 UTC
2024-09-12 16:00:50 <@meetbot:fedora.im> The Meeting name is 'Infrastructure (2024-09-12)'
2024-09-12 16:00:57 <@Zlopez:matrix.org> !meetingname infrastructure
2024-09-12 16:01:03 <@meetbot:fedora.im> The Meeting Name is now infrastructure
2024-09-12 16:01:05 <@Zlopez:matrix.org> !info Fedora Infra documentation: https://docs.fedoraproject.org/en-US/infra
2024-09-12 16:01:05 <@Zlopez:matrix.org> !info About our team: https://docs.fedoraproject.org/en-US/cpe/
2024-09-12 16:01:05 <@Zlopez:matrix.org> !chair nirik zlopez nb bodanel dtometzki jnsamyak lenkaseg patrikp
2024-09-12 16:01:05 <@Zlopez:matrix.org> !info Agenda is at: https://board.net/p/fedora-infra
2024-09-12 16:01:05 <@Zlopez:matrix.org> !topic ahoy
2024-09-12 16:01:22 <@Zlopez:matrix.org> Hi everyone and welcome to today weekly meeting
2024-09-12 16:01:29 <@patrikp:matrix.org> !hi
2024-09-12 16:01:52 <@nirik:matrix.scrye.com> morning
2024-09-12 16:01:55 <@smilner:fedora.im> !hi
2024-09-12 16:01:56 <@zodbot:fedora.im> None (smilner)
2024-09-12 16:02:00 <@Zlopez:matrix.org> Hopefully you are ready for some infrastructure in our life
2024-09-12 16:02:52 <@james:fedora.im> !hi
2024-09-12 16:02:53 <@zodbot:fedora.im> James Antill (james)
2024-09-12 16:03:43 <@nirik:matrix.scrye.com> 🌉
2024-09-12 16:04:01 <@Zlopez:matrix.org> Let's start
2024-09-12 16:04:14 <@Zlopez:matrix.org> !info Getting Started Guide: https://docs.fedoraproject.org/en-US/infra/gettingstarted/
2024-09-12 16:04:14 <@Zlopez:matrix.org> !topic New folks introductions
2024-09-12 16:04:14 <@Zlopez:matrix.org> !info This is a place where people who are interested in Fedora Infrastructure can introduce themselves
2024-09-12 16:04:18 <@Zlopez:matrix.org> Anybody new around?
2024-09-12 16:04:20 <@seddik:fedora.im> !hi
2024-09-12 16:04:20 <@lenkaseg:matrix.org> .hi
2024-09-12 16:04:21 <@zodbot:fedora.im> seddik alaouiismaili (seddik)
2024-09-12 16:04:27 <@lenkaseg:matrix.org> !hi
2024-09-12 16:04:28 <@zodbot:fedora.im> No Fedora Accounts users have the @lenkaseg:matrix.org Matrix Account defined
2024-09-12 16:06:01 <@Zlopez:matrix.org> It doesn't seem so
2024-09-12 16:06:16 <@Zlopez:matrix.org> Let's look at the comfy chair then
2024-09-12 16:06:22 <@Zlopez:matrix.org> !topic Next chair
2024-09-12 16:06:22 <@Zlopez:matrix.org> !info magic eight ball says:
2024-09-12 16:06:31 <@Zlopez:matrix.org> !info chair 2024-09-12 - zlopez
2024-09-12 16:06:31 <@Zlopez:matrix.org> !info chair 2024-09-19 - lenkaseq
2024-09-12 16:06:31 <@Zlopez:matrix.org> !info chair 2024-09-26 - ?
2024-09-12 16:07:04 <@Zlopez:matrix.org> Does anybody wants to chair at 2024-09-26?
2024-09-12 16:07:21 <@Zlopez:matrix.org> The chair is comfy and fun to sit on :-)
2024-09-12 16:09:01 <@nirik:matrix.scrye.com> it's quite a nice chair...
2024-09-12 16:09:31 <@Zlopez:matrix.org> And plenty of room for friends :-)
2024-09-12 16:10:48 <@smilner:fedora.im> We have a lot of the same folks chairing ... is anyone who isn't in the normal rotation up for it?
2024-09-12 16:11:45 <@patrikp:matrix.org> I can chair it.
2024-09-12 16:11:56 <@smilner:fedora.im> Thank you patrikp! 
2024-09-12 16:12:06 <@nirik:matrix.scrye.com> Thanks patrikp
2024-09-12 16:12:25 <@Zlopez:matrix.org> It's yours @patrikp:matrix.org, probably the best chair around :-)
2024-09-12 16:12:39 <@Zlopez:matrix.org> !info chair 2024-09-26 - patrikp
2024-09-12 16:13:00 <@Zlopez:matrix.org> Let's move on than
2024-09-12 16:13:08 <@Zlopez:matrix.org> !info F41 Beta freeze started ( 2024-08-27 )
2024-09-12 16:13:08 <@Zlopez:matrix.org> !topic announcements and information
2024-09-12 16:13:08 <@Zlopez:matrix.org> !info CPE Infra&Releng EU-hours team has a Monday through Thursday 30 minute meeting going through tickets at 0800 UTC in https://matrix.to/#/#meeting-3:fedoraproject.org
2024-09-12 16:13:08 <@Zlopez:matrix.org> !info CPE Infra&Releng NA-hours team has a Monday through Thursday 30 minute meeting going through tickets at 1800 UTC in #fedora-meeting-3
2024-09-12 16:13:30 <@Zlopez:matrix.org> Do we have anything else to announce?
2024-09-12 16:13:59 <@nirik:matrix.scrye.com> !info F41 Beta go/no-go meeting right after this one today in #meeting:fedoraproject.org
2024-09-12 16:16:36 <@nirik:matrix.scrye.com> nothing else announcement wise from me.
2024-09-12 16:16:53 <@Zlopez:matrix.org> Ok, let's move on
2024-09-12 16:17:07 <@Zlopez:matrix.org> !info https://docs.fedoraproject.org/en-US/cpe/day_to_day_fedora/
2024-09-12 16:17:07 <@Zlopez:matrix.org> !info https://fedoraproject.org/wiki/Infrastructure/Oncall
2024-09-12 16:17:07 <@Zlopez:matrix.org> !topic Oncall
2024-09-12 16:17:13 <@Zlopez:matrix.org> !info ? is on call from 2024-09-20 to 2024-09-27
2024-09-12 16:17:13 <@Zlopez:matrix.org> !info zlopez is on call from 2024-09-06 to 2024-09-19
2024-09-12 16:17:29 <@Zlopez:matrix.org> Hm, it doesn't seem right
2024-09-12 16:17:54 <@nirik:matrix.scrye.com> yeah, the dates are off. Probibly my fault.
2024-09-12 16:18:00 <@Zlopez:matrix.org> !info ? is on call from 2024-09-20 to 2024-09-27
2024-09-12 16:18:00 <@Zlopez:matrix.org> !info ? is on call from 2024-09-13 to 2024-09-19
2024-09-12 16:18:15 <@Zlopez:matrix.org> So we need somebody to take oncall for next week
2024-09-12 16:18:50 <@nirik:matrix.scrye.com> that looks more right. 😄
2024-09-12 16:19:43 <@nirik:matrix.scrye.com> I can if no one else wants it.
2024-09-12 16:20:10 <@Zlopez:matrix.org> Anyone else wants to watch for pings?
2024-09-12 16:21:38 <@Zlopez:matrix.org> It seems that it's yours @nirik:matrix.scrye.com
2024-09-12 16:21:48 <@nirik:matrix.scrye.com> Hurray! :)
2024-09-12 16:21:59 <@Zlopez:matrix.org> !info @nirik:matrix.scrye.com is on call from 2024-09-13 to 2024-09-19
2024-09-12 16:22:41 <@Zlopez:matrix.org> Anybody for the week after?
2024-09-12 16:23:05 <@Zlopez:matrix.org> If not, we can leave it to next week
2024-09-12 16:23:33 <@lenkaseg:fedora.im> I can!
2024-09-12 16:23:44 <@Zlopez:matrix.org> Nice :-)
2024-09-12 16:23:54 <@Zlopez:matrix.org> !info lenkaseg is on call from 2024-09-20 to 2024-09-27
2024-09-12 16:24:18 <@Zlopez:matrix.org> !info Summary of last week: (from current oncall)
2024-09-12 16:24:39 <@Zlopez:matrix.org> I didn't noticed any ping, probably because of the freeze
2024-09-12 16:24:53 <@nirik:matrix.scrye.com> Thanks to the cinny search I saw there were two oncalls. ;)
2024-09-12 16:25:16 <@nirik:matrix.scrye.com> One asking about how to deal with a package that was created with the wrong name (I told them to file a ticket)
2024-09-12 16:25:32 <@nirik:matrix.scrye.com> the other about planet being down. I didn't see that one until later, but someone did file a ticket.
2024-09-12 16:25:47 <@Zlopez:matrix.org> I didn't saw anything in the cinny inbox :/
2024-09-12 16:26:26 <@nirik:matrix.scrye.com> I did a search for !oncall... but I guess we should add a highlight on that when we are oncall?
2024-09-12 16:27:28 <@Zlopez:matrix.org> Let me check if I have highlight for my FAS name
2024-09-12 16:27:52 <@Zlopez:matrix.org> I didn't missed anything when I was on Element
2024-09-12 16:27:57 <@nirik:matrix.scrye.com> I wonder if the bot reply isn't causing highlighting. We should check that.
2024-09-12 16:28:36 <@Zlopez:matrix.org> In the settings I can see that I have it set
2024-09-12 16:28:44 <@Zlopez:matrix.org> I need to check
2024-09-12 16:28:55 <@nirik:matrix.scrye.com> anyhow, we can do that out of the meeting
2024-09-12 16:30:37 <@Zlopez:matrix.org> I can see that the bot replied with `!oncall is an alias to !infra oncall list please use the !infra oncall command for changing the oncall list`
2024-09-12 16:31:16 <@Zlopez:matrix.org> So it didn't noticed me, because that somebody didn't just wrote !oncall, but !oncall something
2024-09-12 16:31:35 <@nirik:matrix.scrye.com> right. we can play with it and see if it needs adjustment.
2024-09-12 16:31:39 <@Zlopez:matrix.org> But let's continue in the meeting
2024-09-12 16:31:48 <@Zlopez:matrix.org> !info Go over existing out items and fix
2024-09-12 16:31:48 <@Zlopez:matrix.org> !info https://nagios.fedoraproject.org/nagios 
2024-09-12 16:31:48 <@Zlopez:matrix.org> !topic Monitoring discussion [nirik]
2024-09-12 16:32:13 <@nirik:matrix.scrye.com> lets see.
2024-09-12 16:32:30 <@nirik:matrix.scrye.com> Two down hosts (they have memory issues, we are looking at replacing memory in them)
2024-09-12 16:32:55 <@nirik:matrix.scrye.com> David Kirwan got the vmhost-x86-copr01 all back up... but there might be some weird cpu thing still on it.
2024-09-12 16:33:21 <@nirik:matrix.scrye.com> The registry started alerting last night, but James Antill made a pr to fix it.
2024-09-12 16:33:32 <@nirik:matrix.scrye.com> (but will need a freeze break or wait until after freeze)
2024-09-12 16:33:57 <@nirik:matrix.scrye.com> otherwise I think all as normal...
2024-09-12 16:34:03 <@Zlopez:matrix.org> I would go for freeze break
2024-09-12 16:34:49 <@nirik:matrix.scrye.com> yeah, we can, it's a simple change
2024-09-12 16:35:38 <@Zlopez:matrix.org> There wasn't much alerts this week at all
2024-09-12 16:36:19 <@james:fedora.im> Yeh, worst case is that the alert still goes off after the change.
2024-09-12 16:36:20 <@nirik:matrix.scrye.com> There was a flood of alerts yesterday when the openvpn certs on the openshift cluster expired. ;(
2024-09-12 16:36:27 <@nirik:matrix.scrye.com> I fixed that up pretty quick tho
2024-09-12 16:36:57 <@Zlopez:matrix.org> I saw that
2024-09-12 16:36:58 <@nirik:matrix.scrye.com> Added a +1 to the PR for a freeze break. Just need another +1 now
2024-09-12 16:37:18 <@nirik:matrix.scrye.com> https://pagure.io/fedora-infra/ansible/pull-request/2247
2024-09-12 16:37:39 <@Zlopez:matrix.org> Added +1 as well
2024-09-12 16:37:58 <@nirik:matrix.scrye.com> cool. I can push that out later today.
2024-09-12 16:38:07 <@nirik:matrix.scrye.com> thanks for the pr James Antill!
2024-09-12 16:38:54 <@james:fedora.im> n/p ... been looking at a bunch of ansible things, so was right there to do it and make the alerts stop shouting at us :)
2024-09-12 16:40:30 <@Zlopez:matrix.org> We did a RHEL 7 EOL for last few meetings, let's look at other tickets as well
2024-09-12 16:40:38 <@Zlopez:matrix.org> !topic Revisit blocked tickets
2024-09-12 16:40:38 <@Zlopez:matrix.org> !link https://pagure.io/fedora-infrastructure/issues?status=Open&tags=blocked&priority=0&close_status=
2024-09-12 16:40:38 <@Zlopez:matrix.org> !info Check if any blocked ticket is unblocked
2024-09-12 16:40:59 <@Zlopez:matrix.org> !ticket 11427
2024-09-12 16:41:01 <@zodbot:fedora.im> **fedora-infrastructure #11427** (https://pagure.io/fedora-infrastructure/issue/11427):**DMARC validation failed for mail from lists.fp-o**
2024-09-12 16:41:01 <@zodbot:fedora.im> ● **Assignee:** Not Assigned
2024-09-12 16:41:01 <@zodbot:fedora.im> ● **Opened:** a year ago by darknao
2024-09-12 16:41:01 <@zodbot:fedora.im> 
2024-09-12 16:41:01 <@zodbot:fedora.im> ● **Last Updated:** 7 months ago
2024-09-12 16:41:34 <@nirik:matrix.scrye.com> I think we wanted to look into globally enabling this?
2024-09-12 16:42:05 <@Zlopez:matrix.org> So it is something we need to manually enable?
2024-09-12 16:43:16 <@nirik:matrix.scrye.com> I know it can be enabled per list
2024-09-12 16:43:25 <@nirik:matrix.scrye.com> I am not sure if it can be enabled globally/change default
2024-09-12 16:44:15 <@Zlopez:matrix.org> I can look into that
2024-09-12 16:44:21 <@nirik:matrix.scrye.com> That would be great.
2024-09-12 16:45:52 <@Zlopez:matrix.org> When talking about mailman3, I'm still struggling with the index generation, after few weeks of it running I have to start over :/
2024-09-12 16:46:06 <@nirik:matrix.scrye.com> yeah, I saw that. ;( Anoying.
2024-09-12 16:46:18 <@nirik:matrix.scrye.com> would be help any to give that vm more resources?
2024-09-12 16:46:32 <@nirik:matrix.scrye.com> or is it mostly i/o / db bound?
2024-09-12 16:46:32 <@Zlopez:matrix.org> I hope it didn't happen again, not sure if it's something with python-whoosh, I saw there was no update of the package on pypi for few years
2024-09-12 16:47:21 <@Zlopez:matrix.org> It's running on one CPU core, so I don't think we can make it faster
2024-09-12 16:47:25 <@nirik:matrix.scrye.com> We could try another indexer? are there choices?
2024-09-12 16:47:57 <@Zlopez:matrix.org> I looked at the haystack, which is used by mailman and it supports xapian as well, but it's not packaged for epel9
2024-09-12 16:48:22 <@Zlopez:matrix.org> The xapian project looks more healthy from what I saw
2024-09-12 16:49:01 <@Zlopez:matrix.org> But let's see if the current index generation get stuck again and I will probably look at packaging xapian when that happens
2024-09-12 16:49:53 <@nirik:matrix.scrye.com> ok
2024-09-12 16:50:30 <@Zlopez:matrix.org> Here are the supported backends for haystack https://django-haystack.readthedocs.io/en/master/tutorial.html#modify-your-settings-py
2024-09-12 16:50:45 <@nirik:matrix.scrye.com> actually... looks like it is in rhel9
2024-09-12 16:50:59 <@nirik:matrix.scrye.com> xapian-core.x86_64                           1.4.18-5.el9                  rhel9-AppStream
2024-09-12 16:51:54 <@Zlopez:matrix.org> I was looking at the packages.fedoraproject.org
2024-09-12 16:52:15 <@nirik:matrix.scrye.com> I'm not sure if that core is the only part we would need, but it's in rhel...
2024-09-12 16:52:38 <@Zlopez:matrix.org> I tried to set something with whoosh, so let's see first if that helps and finishes the indexing
2024-09-12 16:52:58 <@nirik:matrix.scrye.com> fair enough.
2024-09-12 16:54:55 <@Zlopez:matrix.org> I remember seeing some table with the haystack search engines and what they support, but I can't find it now
2024-09-12 16:55:58 <@nirik:matrix.scrye.com> https://django-haystack.readthedocs.io/en/master/tutorial.html#modify-your-settings-py ?
2024-09-12 16:56:24 <@Zlopez:matrix.org> Something better than this
2024-09-12 16:56:40 <@Zlopez:matrix.org> I see that we are almost at end of our dedicated time
2024-09-12 16:57:15 <@nirik:matrix.scrye.com> yep. ;)
2024-09-12 16:57:51 <@Zlopez:matrix.org> !topic Open Floor
2024-09-12 16:57:58 <@Zlopez:matrix.org> Last 3 minutes for open floor
2024-09-12 16:58:59 <@Zlopez:matrix.org> And here it is https://django-haystack.readthedocs.io/en/master/backend_support.html
2024-09-12 16:59:11 <@patrikp:matrix.org> My body requires sustenance.
2024-09-12 16:59:40 <@Zlopez:matrix.org> And here is the matrix I talked about https://django-haystack.readthedocs.io/en/master/backend_support.html#backend-support-matrix
2024-09-12 17:00:05 <@Zlopez:matrix.org> I remember the package that was missing was the `xapian-haystack`
2024-09-12 17:00:46 <@Zlopez:matrix.org> Or we can go with elasticsearch, but I'm not sure how difficult it will be to set it up
2024-09-12 17:00:57 <@Zlopez:matrix.org> So we are at the end of our time
2024-09-12 17:01:06 <@Zlopez:matrix.org> Thanks everybody for coming today
2024-09-12 17:01:17 <@Zlopez:matrix.org> See you next time
2024-09-12 17:01:18 <@Zlopez:matrix.org> !endmeeting