2024-06-13 16:00:09 <@aggraxis:fedora.im> !startmeeting Infrastructure (2024-06-13)
2024-06-13 16:00:09 <@meetbot:fedora.im> Meeting started at 2024-06-13 16:00:09 UTC
2024-06-13 16:00:10 <@meetbot:fedora.im> The Meeting name is 'Infrastructure (2024-06-13)'
2024-06-13 16:00:16 <@aggraxis:fedora.im> !chair nirik zlopez nb bodanel dtometzki jnsamyak lenkaseg patrikp
2024-06-13 16:00:16 <@aggraxis:fedora.im> !meetingname infrastructure
2024-06-13 16:00:17 <@meetbot:fedora.im> The Meeting Name is now infrastructure
2024-06-13 16:00:33 <@aggraxis:fedora.im> !info Agenda is at: https://board.net/p/fedora-infra
2024-06-13 16:00:39 <@aggraxis:fedora.im> !info About our team: https://docs.fedoraproject.org/en-US/cpe/
2024-06-13 16:00:44 <@aggraxis:fedora.im> !info Fedora Infra documentation: https://docs.fedoraproject.org/en-US/infra
2024-06-13 16:00:48 <@aggraxis:fedora.im> !topic namaste
2024-06-13 16:00:55 <@aggraxis:fedora.im> good morning!
2024-06-13 16:01:23 <@aggraxis:fedora.im> This is my first go at chairing the meeting, so turbulence is guaranteed! :)
2024-06-13 16:01:48 <@aggraxis:fedora.im> !topic New folks introductions
2024-06-13 16:01:53 <@aggraxis:fedora.im> !info This is a place where people who are interested in Fedora Infrastructure can introduce themselves
2024-06-13 16:01:59 <@aggraxis:fedora.im> !info Getting Started Guide: https://docs.fedoraproject.org/en-US/infra/gettingstarted/
2024-06-13 16:02:10 <@aggraxis:fedora.im> Do we have anybody new?
2024-06-13 16:02:52 <@irradiated_lemming:matrix.org> :wave:
2024-06-13 16:03:08 <@aggraxis:fedora.im> Hi! welcome!
2024-06-13 16:04:04 <@irradiated_lemming:matrix.org> Ill probably just be listening in but im a fedora community architect intern and ive been working on some.matrix bot stuff recently
2024-06-13 16:04:17 <@aggraxis:fedora.im> awesome!
2024-06-13 16:05:07 <@aggraxis:fedora.im> Several of the usual suspects are out today. The infra lead is out this week. He usually prods us when necessary. :)
2024-06-13 16:05:17 <@aggraxis:fedora.im> Ok let's keep it rolling.
2024-06-13 16:05:24 <@aggraxis:fedora.im> !topic Next chair
2024-06-13 16:05:34 <@aggraxis:fedora.im> !info magic eight ball says:
2024-06-13 16:05:42 <@aggraxis:fedora.im> !info chair 2024-06-13 Paul Maconi
2024-06-13 16:05:42 <@aggraxis:fedora.im> !info chair 2024-06-20 lenkaseg
2024-06-13 16:05:42 <@aggraxis:fedora.im> !info chair 2024-06-27 nirik
2024-06-13 16:05:42 <@aggraxis:fedora.im> !info chair 2024-07-11 pcreech
2024-06-13 16:06:13 <@aggraxis:fedora.im> I think we're good to go on chairs. The more experienced folks will be driving the next few meetings.
2024-06-13 16:06:26 <@aggraxis:fedora.im> !topic announcements and information
2024-06-13 16:06:35 <@aggraxis:fedora.im> !info CPE Infra&Releng EU-hours team has a Monday through Thursday 30 minute meeting going through tickets at 0800 UTC in https://matrix.to/#/#meeting-3:fedoraproject.org
2024-06-13 16:06:42 <@aggraxis:fedora.im> !info CPE Infra&Releng NA-hours team has a Monday through Thursday 30 minute meeting going through tickets at 1800 UTC in #fedora-meeting-3
2024-06-13 16:06:54 <@aggraxis:fedora.im> !info Fedora infra meeting is cancelled for 2024-07-04 due to US Holidays
2024-06-13 16:06:57 <@leo:fedora.im> hey
2024-06-13 16:06:59 <@aggraxis:fedora.im> leo!
2024-06-13 16:07:02 <@aggraxis:fedora.im> hey there
2024-06-13 16:07:07 <@pcreech:matrix.org> !hello pcreech17
2024-06-13 16:07:08 <@zodbot:fedora.im> Patrick Creech (pcreech17)
2024-06-13 16:07:22 <@aggraxis:fedora.im> :D
2024-06-13 16:08:01 <@aggraxis:fedora.im> ok uhh... next up is...
2024-06-13 16:08:11 <@aggraxis:fedora.im> !topic Oncall
2024-06-13 16:08:11 <@aggraxis:fedora.im> !info https://docs.fedoraproject.org/en-US/cpe/day_to_day_fedora/
2024-06-13 16:08:11 <@aggraxis:fedora.im> !info https://fedoraproject.org/wiki/Infrastructure/Oncall
2024-06-13 16:08:29 <@aggraxis:fedora.im> !info zlopez is on call from 2024-06-14 to 2024-06-20
2024-06-13 16:08:29 <@aggraxis:fedora.im> !info nobody is on call from 2024-06-07 to 2024-06-13
2024-06-13 16:08:29 <@aggraxis:fedora.im> !info ??? is on call from 2024-06-21 to 2024-06-27
2024-06-13 16:09:00 <@aggraxis:fedora.im> !info Summary of last week: (from current oncall)
2024-06-13 16:09:29 <@aggraxis:fedora.im> so, nobody was on call... The repeat thing that I saw come up so far was the package signing needed restarting.
2024-06-13 16:09:31 <@phsmoura:fedora.im> you can mention the person inside ()
2024-06-13 16:09:52 <@phsmoura:fedora.im> oh wait, so noone was oncall last week?
2024-06-13 16:09:58 <@aggraxis:fedora.im> yes
2024-06-13 16:10:10 <@phsmoura:fedora.im> ah sorry
2024-06-13 16:10:20 <@aggraxis:fedora.im> all is well. mostly. mostly well.
2024-06-13 16:10:50 <@irradiated_lemming:matrix.org> I could have sworn that pinged someone like last week to look at my communishift ticket but maybe i messed up the weeks
2024-06-13 16:11:16 <@aggraxis:fedora.im> It could be that you did, but nobody was on call. This is about your work with the bot?
2024-06-13 16:11:48 <@irradiated_lemming:matrix.org> Yeah, it was. I think Justin  used the bot on call command and it came up with someone.
2024-06-13 16:11:56 <@irradiated_lemming:matrix.org> Although it could just not have been updated
2024-06-13 16:12:23 <@leo:fedora.im> i’ll take next oncall if that’s open
2024-06-13 16:12:57 <@aggraxis:fedora.im> yeah it wasn't ever unset for this week.
2024-06-13 16:13:05 <@Zlopez:matrix.org> The oncall was not removed till Tuesday, we forgot about it 
2024-06-13 16:13:08 <@aggraxis:fedora.im> I just eyeballed another oncall ping
2024-06-13 16:13:14 <@leo:fedora.im> ah i see
2024-06-13 16:13:54 <@aggraxis:fedora.im> but either way, the robosignatory was our repeat offender this week.
2024-06-13 16:14:08 <@Zlopez:matrix.org> Hm, I'm currently on DevConf, but I should be able to handle pings 
2024-06-13 16:14:38 <@aggraxis:fedora.im> you're on call starting tomorrow according to the notes in the meeting
2024-06-13 16:14:48 <@Zlopez:matrix.org> leo: Do you want to switch? 
2024-06-13 16:15:11 <@leo:fedora.im> sure!
2024-06-13 16:15:24 <@Zlopez:matrix.org> Ok, I will set you up 
2024-06-13 16:15:50 <@Zlopez:matrix.org> Paul Maconi: Put me for next week 
2024-06-13 16:16:18 <@aggraxis:fedora.im> You're already in?
2024-06-13 16:16:43 <@aggraxis:fedora.im> 6/21-6/27 is the next open slot that we haven't assigned
2024-06-13 16:17:14 <@Zlopez:matrix.org> Put me in that, I set up @leo for this week 
2024-06-13 16:17:21 <@Zlopez:matrix.org> !oncall 
2024-06-13 16:17:22 <@zodbot:fedora.im> The following people are oncall:
2024-06-13 16:17:22 <@zodbot:fedora.im> 
2024-06-13 16:17:22 <@zodbot:fedora.im> If they do not respond, please file a ticket (https://pagure.io/fedora-infrastructure/issues)
2024-06-13 16:17:22 <@zodbot:fedora.im> ● @leo:fedora.im (leo) Current Time for them: 09:17 (America/Los_Angeles)
2024-06-13 16:17:30 <@leo:fedora.im> works for me
2024-06-13 16:17:55 <@aggraxis:fedora.im> !info leo is on call from 2024-06-14 to 2024-06-20
2024-06-13 16:17:55 <@aggraxis:fedora.im> !info zlopez is on call from 2024-06-21 to 2024-06-27
2024-06-13 16:17:57 <@aggraxis:fedora.im> like that?
2024-06-13 16:18:27 <@Zlopez:matrix.org> +1
2024-06-13 16:19:05 <@aggraxis:fedora.im> ok. next up...
2024-06-13 16:19:12 <@aggraxis:fedora.im> !topic Monitoring discussion [nirik]
2024-06-13 16:19:12 <@aggraxis:fedora.im> !info Go over existing out items and fix
2024-06-13 16:19:12 <@aggraxis:fedora.im> !info https://nagios.fedoraproject.org/nagios 
2024-06-13 16:19:21 <@aggraxis:fedora.im> So nirik is out this week.
2024-06-13 16:19:28 <@aggraxis:fedora.im> I had a look at the tactical overview
2024-06-13 16:19:55 <@Zlopez:matrix.org> So the major offender this week was signing 
2024-06-13 16:20:52 <@Zlopez:matrix.org> And the fmn were complaining after python 3.14 rebuild in rawhide 
2024-06-13 16:21:12 <@Zlopez:matrix.org> But it's slowly catching up 
2024-06-13 16:21:58 <@aggraxis:fedora.im> awesome
2024-06-13 16:22:51 <@aggraxis:fedora.im> Nagios reported one host down, with nirik having acked it. some HTTP 301s with IPA. fedbages queue, and the redhat.com mail queue
2024-06-13 16:23:20 <@leo:fedora.im> fyi i think we agreed on adding people oncall to nagios permission list :)
2024-06-13 16:23:30 <@leo:fedora.im> don’t think it’s written down anywhere
2024-06-13 16:24:05 <@Zlopez:matrix.org> The spikes in fedbadges are happening, when it's starts to query datanommer, it will resolve itself after some time 
2024-06-13 16:24:42 <@aggraxis:fedora.im> Yeah, I recognized the alert as one of those that comes and goes.
2024-06-13 16:24:56 <@Zlopez:matrix.org> We should, but I'm not sure how this works exactly
2024-06-13 16:25:10 <@leo:fedora.im> very simple PR
2024-06-13 16:25:20 <@leo:fedora.im> it’s in the nagios cgi config
2024-06-13 16:26:07 <@Zlopez:matrix.org> Could you look at the infra docs and create a PR for the documentation? 
2024-06-13 16:26:22 <@leo:fedora.im> yeah, will do.
2024-06-13 16:27:02 <@zodbot:fedora.im> zlopez gave a cookie to leo. They now have 3 cookies, 1 of which were obtained in the Fedora 40 release cycle
2024-06-13 16:27:07 <@aggraxis:fedora.im> yay!
2024-06-13 16:27:53 <@Zlopez:matrix.org> I need to drive back home now from DevConf, feel free to continue without me 
2024-06-13 16:28:08 <@aggraxis:fedora.im> Are fresh tickets on topic for this meeting, or do we do that in daily standup?
2024-06-13 16:28:21 <@leo:fedora.im> standup
2024-06-13 16:28:24 <@aggraxis:fedora.im> perfect.
2024-06-13 16:28:58 <@aggraxis:fedora.im> ok next thing in the agenda is
2024-06-13 16:29:00 <@aggraxis:fedora.im> !ticket https://pagure.io/fedora-infrastructure/issue/11815
2024-06-13 16:29:00 <@aggraxis:fedora.im> !info Check the progress on tickets related to RHEL7 EOL (end of June)
2024-06-13 16:29:00 <@aggraxis:fedora.im> !topic RHEL7 EOL
2024-06-13 16:29:44 <@aggraxis:fedora.im> We might be missing some key players for this effort, but it looks like we still have some outstanding work
2024-06-13 16:31:10 <@aggraxis:fedora.im> Sorry I'm color blind and tring to understand the changes in the agenda
2024-06-13 16:31:23 <@aggraxis:fedora.im> do we have any other topics or upcoming learning topics?
2024-06-13 16:31:36 <@aggraxis:fedora.im> or any other concerns that we need to go over?
2024-06-13 16:31:48 <@aggraxis:fedora.im> !topic Open Floor
2024-06-13 16:32:27 <@irradiated_lemming:matrix.org> My questions are mostly about bot stuff
2024-06-13 16:32:48 <@irradiated_lemming:matrix.org> Ive been trying To poke through the Ansible scripts, but can only see old stuff.
2024-06-13 16:33:00 <@irradiated_lemming:matrix.org> Is there somewhere I can go to find out how the current matrix bots are hosted in production?
2024-06-13 16:33:13 <@leo:fedora.im> they’re in openshift iirc?
2024-06-13 16:33:21 <@leo:fedora.im> maubot is the name of it
2024-06-13 16:34:14 <@irradiated_lemming:matrix.org> Yeah, I think they are on open shift. I'm just trying to find updated documentation
2024-06-13 16:34:33 <@leo:fedora.im> documentation is often sparse unfortunately 
2024-06-13 16:34:50 <@irradiated_lemming:matrix.org> Ah ok
2024-06-13 16:35:53 <@irradiated_lemming:matrix.org> And i guess second thing thats less infra related, but if anyone knows good dev tools for Getting a public HTTPS URL for testing things that would be awesome
2024-06-13 16:36:27 <@leo:fedora.im> i like ngrok 
2024-06-13 16:36:36 <@irradiated_lemming:matrix.org> But yeah other than that i dont really have anything, just casually observing
2024-06-13 16:36:49 <@irradiated_lemming:matrix.org> That might be the one I was thinking of, but couldn't remember the name of. Thanks.
2024-06-13 16:37:42 <@aggraxis:fedora.im> Right on. Anything else?
2024-06-13 16:39:13 <@irradiated_lemming:matrix.org> I might be interested in where to Submit a merge request for my new bot, but I guess I don't need to know that right now As I'm so largely working on it, but the plan is to have it ready for fedora week of diversity.
2024-06-13 16:39:54 <@irradiated_lemming:matrix.org> I might be interested in where to Submit a merge request for my new bot, but I guess I don't need to know that right now As I'm still largely working on it ang getting it into prod is lower priority, altho the plan is to have it usable somehow for fedora week of diversity.
2024-06-13 16:40:08 <@irradiated_lemming:matrix.org> But it also seems like we're past time, so I don't want to hold things up too much more.
2024-06-13 16:40:17 <@leo:fedora.im> most likely the ansible repo as well
2024-06-13 16:41:01 <@leo:fedora.im> https://docs.fedoraproject.org/en-US/infra/developer_guide/openshift/
2024-06-13 16:41:06 <@leo:fedora.im> most of this is still valid
2024-06-13 16:41:07 <@irradiated_lemming:matrix.org> Ah ok sweet! Thx
2024-06-13 16:41:50 <@aggraxis:fedora.im> leo with the goods! :)
2024-06-13 16:42:13 <@leo:fedora.im> i only know because i went down the ocp rabbit hole myself haha 
2024-06-13 16:42:32 <@aggraxis:fedora.im> oof. that's a real tumble, too.
2024-06-13 16:42:47 <@aggraxis:fedora.im> Ok, well if that's all the big stuff, we can carry on in the infrastructure team channel for the rest
2024-06-13 16:42:54 <@aggraxis:fedora.im> thank you everyone for participating!
2024-06-13 16:42:56 <@aggraxis:fedora.im> !endmeeting