2024-11-18 20:01:02 <@phsmoura:fedora.im> !startmeeting Fedora Infrastructure Ops Daily Standup Meeting
2024-11-18 20:01:03 <@meetbot:fedora.im> Meeting started at 2024-11-18 20:01:02 UTC
2024-11-18 20:01:03 <@meetbot:fedora.im> The Meeting name is 'Fedora Infrastructure Ops Daily Standup Meeting'
2024-11-18 20:01:09 <@phsmoura:fedora.im> !meetingname fedora_infrastructure_ops_daily_standup_meeting
2024-11-18 20:01:09 <@phsmoura:fedora.im> !info reminder: speak up if you want to work on a ticket!
2024-11-18 20:01:09 <@phsmoura:fedora.im> !info agenda is at https://board.net/p/fedora-infra-daily
2024-11-18 20:01:09 <@phsmoura:fedora.im> !info meeting is 30 minutes MAX. At the end of 30, its stops
2024-11-18 20:01:09 <@phsmoura:fedora.im> !chair nirik smooge phsmoura
2024-11-18 20:01:10 <@meetbot:fedora.im> The Meeting Name is now fedora_infrastructure_ops_daily_standup_meeting
2024-11-18 20:01:13 <@phsmoura:fedora.im> hello
2024-11-18 20:01:18 <@smilner:fedora.im> !hi
2024-11-18 20:01:19 <@zodbot:fedora.im> None (smilner)
2024-11-18 20:01:24 <@smilner:fedora.im> Hey phsmoura 
2024-11-18 20:01:36 <@james:fedora.im> !hi
2024-11-18 20:01:38 <@zodbot:fedora.im> James Antill (james)
2024-11-18 20:01:51 <@phsmoura:fedora.im> !info https://pagure.io/fedora-infrastructure/issues?status=Open&priority=1
2024-11-18 20:01:51 <@phsmoura:fedora.im> !topic Tickets needing review
2024-11-18 20:02:15 <@phsmoura:fedora.im> !ticket 12291
2024-11-18 20:02:16 <@zodbot:fedora.im> 
2024-11-18 20:02:16 <@zodbot:fedora.im> ● **Opened:** 3 days ago by adamwill
2024-11-18 20:02:16 <@zodbot:fedora.im> ● **Assignee:** Not Assigned
2024-11-18 20:02:16 <@zodbot:fedora.im> ● **Last Updated:** a day ago
2024-11-18 20:02:16 <@zodbot:fedora.im> **fedora-infrastructure #12291** (https://pagure.io/fedora-infrastructure/issue/12291):**pagure returning 500s due to error in flask_oidc**
2024-11-18 20:02:24 <@nirik:matrix.scrye.com> morning.
2024-11-18 20:02:44 <@nirik:matrix.scrye.com> med med ops and cc abompard?
2024-11-18 20:04:26 <@smilner:fedora.im> Do we know how often it's happening?
2024-11-18 20:05:04 <@nirik:matrix.scrye.com> I've not seen it myself...
2024-11-18 20:05:28 <@nirik:matrix.scrye.com> I am not sure how often it's happening.
2024-11-18 20:05:57 <@james:fedora.im> Yeh, seems different for different users ... and adam suggested there are multiple problems where one has been fixed? Or fixed itself.
2024-11-18 20:06:24 <@nirik:matrix.scrye.com> I think there was a related ticket that was fixed yeah
2024-11-18 20:06:36 <@phsmoura:fedora.im> dont know but Im also having trouble with pagure.. cant merge a PR it pops up an empty green windown when clicking on merge, but I dont think this is related
2024-11-18 20:07:13 <@nirik:matrix.scrye.com> https://pagure.io/fedora-infrastructure/issue/12260
2024-11-18 20:08:49 <@phsmoura:fedora.im> !ticket 12293
2024-11-18 20:08:49 <@zodbot:fedora.im> ● **Last Updated:** an hour ago
2024-11-18 20:08:49 <@zodbot:fedora.im> **fedora-infrastructure #12293** (https://pagure.io/fedora-infrastructure/issue/12293):**Planned Outage - Server update/reboots - 2024-11-20 21:00 UTC**
2024-11-18 20:08:49 <@zodbot:fedora.im> 
2024-11-18 20:08:49 <@zodbot:fedora.im> ● **Opened:** 2 days ago by kevin
2024-11-18 20:08:49 <@zodbot:fedora.im> ● **Assignee:** kevin
2024-11-18 20:08:55 <@smilner:fedora.im> Interesting. Seems like something we'd want to fix quickly if possible 😆. Just curious if we knew the impact. Thanks!
2024-11-18 20:09:00 <@seddik:fedora.im> !hi
2024-11-18 20:09:01 <@zodbot:fedora.im> seddik alaouiismaili (seddik)
2024-11-18 20:09:18 <@nirik:matrix.scrye.com> yeah, this is likely fallout from the auth changes abompard did (or not? just a guess)
2024-11-18 20:09:22 <@phsmoura:fedora.im> med med outage?
2024-11-18 20:09:26 <@nirik:matrix.scrye.com> anyhow, med med ops on this one... yep.
2024-11-18 20:09:44 <@seddik:fedora.im> For me that was an Internal Server Error 
2024-11-18 20:10:13 <@james:fedora.im> Note to everyone ... it's 20:00 UTC now, so 21:00 UTC is one hour from now.
2024-11-18 20:10:43 <@james:fedora.im> yselkowitz is helping you with this, right?
2024-11-18 20:11:06 <@yselkowitz:fedora.im> huh??
2024-11-18 20:11:10 <@phsmoura:fedora.im> !ticket 12295
2024-11-18 20:11:11 <@zodbot:fedora.im> ● **Assignee:** Not Assigned
2024-11-18 20:11:11 <@zodbot:fedora.im> **fedora-infrastructure #12295** (https://pagure.io/fedora-infrastructure/issue/12295):**Failure to log in to fedora discussion account with container.**
2024-11-18 20:11:11 <@zodbot:fedora.im> ● **Opened:** a day ago by gosling203
2024-11-18 20:11:11 <@zodbot:fedora.im> ● **Last Updated:** 6 hours ago
2024-11-18 20:11:11 <@zodbot:fedora.im> 
2024-11-18 20:11:16 <@nirik:matrix.scrye.com> yes, an hour from now, but on wed. ;)
2024-11-18 20:11:53 <@james:fedora.im> The server updates ... did I misread/misremember?
2024-11-18 20:11:57 <@yselkowitz:fedora.im> not me
2024-11-18 20:12:02 <@nirik:matrix.scrye.com> For this one, we don't maintain discussion, but we do maintain the auth to it. So, it's likely in our area.
2024-11-18 20:12:18 <@nirik:matrix.scrye.com> James Antill: he just wanted to know when it was so he could plan the eln mass rebuild.
2024-11-18 20:12:28 <@james:fedora.im> Ahh, okay, my bad.
2024-11-18 20:13:16 <@yselkowitz:fedora.im> I couldn't help anyway but thanks for asking :-D
2024-11-18 20:13:38 <@nirik:matrix.scrye.com> So I think we need more info on this one... shall I add some questions?
2024-11-18 20:14:25 <@james:fedora.im> Yeh, I guess. Could this also be related to the auth changes from abompard?
2024-11-18 20:15:05 <@nirik:matrix.scrye.com> nope. that was pagure.io only I am pretty sure.
2024-11-18 20:15:58 <@nirik:matrix.scrye.com> I added some questions and set it low/low for now... if thats ok
2024-11-18 20:16:46 <@james:fedora.im> LGTM
2024-11-18 20:17:51 <@phsmoura:fedora.im> ok, thanks
2024-11-18 20:17:52 <@phsmoura:fedora.im> !info https://pagure.io/releng/issues?status=Open
2024-11-18 20:18:10 <@phsmoura:fedora.im> !releng 12463
2024-11-18 20:18:12 <@zodbot:fedora.im> ● **Assignee:** Not Assigned
2024-11-18 20:18:12 <@zodbot:fedora.im> 
2024-11-18 20:18:12 <@zodbot:fedora.im> ● **Opened:** 3 days ago by adamwill
2024-11-18 20:18:12 <@zodbot:fedora.im> ● **Last Updated:** 2 days ago
2024-11-18 20:18:12 <@zodbot:fedora.im> **releng #12463** (https://pagure.io/releng/issue/12463):**Further improve full compose speed**
2024-11-18 20:18:45 <@nirik:matrix.scrye.com> low low I guess... \
2024-11-18 20:18:59 <@nirik:matrix.scrye.com> well, or med med or something
2024-11-18 20:19:32 <@james:fedora.im> or high, high ... depends on how fast the end state is ;)
2024-11-18 20:20:30 <@nirik:matrix.scrye.com> I think the low hanging fruit might be picked... but adamw is digging more.
2024-11-18 20:21:24 <@nirik:matrix.scrye.com> I guess med / med makes most sense
2024-11-18 20:22:07 <@james:fedora.im> If any konflux things are going into it then I'd def. go high ... but it probably doesn't matter much.
2024-11-18 20:22:11 <@phsmoura:fedora.im> !releng 12466
2024-11-18 20:22:12 <@zodbot:fedora.im> ● **Assignee:** Not Assigned
2024-11-18 20:22:12 <@zodbot:fedora.im> **releng #12466** (https://pagure.io/releng/issue/12466):**Please update `openh264`to 2.5.0 in F41**
2024-11-18 20:22:12 <@zodbot:fedora.im> 
2024-11-18 20:22:12 <@zodbot:fedora.im> ● **Opened:** 11 hours ago by abitrolly
2024-11-18 20:22:12 <@zodbot:fedora.im> ● **Last Updated:** 4 hours ago
2024-11-18 20:22:47 <@nirik:matrix.scrye.com> low low ops? we need to hear that it's ready to ship... and jednorozec was gonna work with patrikp on the process.
2024-11-18 20:23:19 <@humaton:fedora.im> ack
2024-11-18 20:24:17 <@phsmoura:fedora.im> !topic Planning, Upcoming work and Open floor
2024-11-18 20:24:40 <@phsmoura:fedora.im> anything for open floor?
2024-11-18 20:25:31 <@nirik:matrix.scrye.com> So I have a few things:
2024-11-18 20:25:51 <@nirik:matrix.scrye.com> we have the mass update/reboot cycle this week... stg today, other stuff tomorrow, outage wed
2024-11-18 20:26:12 <@nirik:matrix.scrye.com> I finally finally finally got access to mgmt on ibiblio05 after a remote debugging session on friday.
2024-11-18 20:26:25 <@nirik:matrix.scrye.com> So, I can and will reinstall it. It's a rhel7 box. ;(
2024-11-18 20:26:55 <@nirik:matrix.scrye.com> That leaves us with just 4 rhel7 instances... 2 fedmsg busgateway and 2 github2fedmsg... those should go away when we finish retiring those
2024-11-18 20:27:33 <@nirik:matrix.scrye.com> There are 20 rhel8 boxes left. Many being worked on... and I plan to try and do some more wed during the outage.
2024-11-18 20:27:53 <@humaton:fedora.im> fabian mentioned he is kicking it down the road and we might be able to retire the centos fedmsg dependency
2024-11-18 20:28:09 <@humaton:fedora.im> *retire soon*
2024-11-18 20:28:25 <@nirik:matrix.scrye.com> There's 15 fedora 39 instances... most of them are copr / logdetective
2024-11-18 20:28:26 <@james:fedora.im> So ... talking about the outage ... do you need/want help any of the days? Wed. evening is bad for me, but I can cancel plans if needed.
2024-11-18 20:29:21 <@nirik:matrix.scrye.com> The only f39 ones we need to move are ipsilon. So, we need to test f41 ipsilon in stg and then prod
2024-11-18 20:29:46 <@nirik:matrix.scrye.com> James Antill: would love help anytime... if you could help today/tomorrow even if you're not around wed that would be great.
2024-11-18 20:30:16 <@nirik:matrix.scrye.com> finally, koji builders/hubs. I was hoping to move them from 40->41 on wed...
2024-11-18 20:30:34 <@nirik:matrix.scrye.com> but I just upgraded koji01.stg and... it's not working. Needs debugging to see whats going on.
2024-11-18 20:30:58 <@nirik:matrix.scrye.com> I think thats it. ;)
2024-11-18 20:32:07 <@phsmoura:fedora.im> ok, I dont have much else
2024-11-18 20:32:32 <@james:fedora.im> We are also overtime.
2024-11-18 20:32:37 <@nirik:matrix.scrye.com> oh yeah.
2024-11-18 20:32:50 <@nirik:matrix.scrye.com> thanks everyone. Lots of folks here today... love to see it!
2024-11-18 20:33:45 <@james:fedora.im> Maybe we should tweak the beginning !info about the timelimit ;)
2024-11-18 20:33:45 <@phsmoura:fedora.im> ok, lets go back then, thanks everyone :)
2024-11-18 20:33:52 <@phsmoura:fedora.im> !endmeeting