2025-06-26 19:01:55 <@james:fedora.im> !startmeeting Fedora Infrastructure Ops Daily Standup Meeting

2025-06-26 19:01:56 <@meetbot:fedora.im> Meeting started at 2025-06-26 19:01:55 UTC
2025-06-26 19:01:56 <@meetbot:fedora.im> The Meeting name is 'Fedora Infrastructure Ops Daily Standup Meeting'
2025-06-26 19:02:04 <@nirik:matrix.scrye.com> morning
2025-06-26 19:02:04 <@james:fedora.im> !chair nirik  phsmoura  @james:fedora.im
2025-06-26 19:02:10 <@james:fedora.im> !info invitees Steve 
2025-06-26 19:02:13 <@james:fedora.im> !meetingname fedora_infrastructure_ops_daily_standup_meeting
2025-06-26 19:02:13 <@meetbot:fedora.im> The Meeting Name is now fedora_infrastructure_ops_daily_standup_meeting
2025-06-26 19:02:16 <@james:fedora.im> !info Meeting is 30 minutes MAX. At the end of 30, its stops
2025-06-26 19:02:19 <@james:fedora.im> !info Agenda is at https://board.net/p/fedora-infra-daily
2025-06-26 19:02:22 <@james:fedora.im> !info Reminder: Speak up if you want to work on a ticket!
2025-06-26 19:02:25 <@james:fedora.im> Hey
2025-06-26 19:02:27 <@phsmoura:fedora.im> hello
2025-06-26 19:02:43 <@james:fedora.im> Staging is on 🔥 ;)
2025-06-26 19:02:58 <@james:fedora.im> But we have hoses ;)
2025-06-26 19:03:28 <@james:fedora.im> !topic Tickets needing review
2025-06-26 19:03:31 <@nirik:matrix.scrye.com> ha
2025-06-26 19:03:32 <@james:fedora.im> !info https://pagure.io/releng/issues?status=Open
2025-06-26 19:03:41 <@james:fedora.im> !releng 12793
2025-06-26 19:03:43 <@zodbot:fedora.im> 
2025-06-26 19:03:43 <@zodbot:fedora.im> ● **Opened:** 22 hours ago by jjames
2025-06-26 19:03:43 <@zodbot:fedora.im> ● **Assignee:** Not Assigned
2025-06-26 19:03:43 <@zodbot:fedora.im> ● **Last Updated:** Never
2025-06-26 19:03:43 <@zodbot:fedora.im> **releng #12793** (https://pagure.io/releng/issue/12793):**Stuck update**
2025-06-26 19:05:07 <@james:fedora.im> I guess low / med ... but not sure. Also not sure who can poke koji that is available to do so, right now.
2025-06-26 19:05:09 <@nirik:matrix.scrye.com> looks like none of those are signed, so could be a signing issue, but I'm not sure why...
2025-06-26 19:06:34 <@nirik:matrix.scrye.com> actually I think it's bodhi not doing what it should with the sidetag creation....
2025-06-26 19:06:49 <@nirik:matrix.scrye.com> but I am not sure why
2025-06-26 19:06:58 <@nirik:matrix.scrye.com> so yeah
2025-06-26 19:07:14 <@james:fedora.im> I bumped it to med / med ... due to timing.
2025-06-26 19:08:09 <@james:fedora.im> !topic Planning, Upcoming work and Open floor
2025-06-26 19:08:47 <@nirik:matrix.scrye.com> so my plan is to finish migrating stg db's... then I can focus on builders/signing in rdu3... then I can do initial syncs for the prod stuff for monday.
2025-06-26 19:08:57 <@nirik:matrix.scrye.com> I am out a chunk of tomrrow going to the airport and back
2025-06-26 19:09:10 <@nirik:matrix.scrye.com> Once I get db's done, we can deploy stg openshift apps I think
2025-06-26 19:09:27 <@nirik:matrix.scrye.com> oh, and I am moving the riscv stuff today too
2025-06-26 19:10:48 <@james:fedora.im> Apart from helping out with anything staging related, I'll probably push the koji prod rdu3 today
2025-06-26 19:11:41 <@nirik:matrix.scrye.com> sure, good to have those ready.
2025-06-26 19:11:45 <@james:fedora.im> Not sure if the playbook will finish, but it should get most of the way.
2025-06-26 19:11:54 <@Zlopez:matrix.org> !hi
2025-06-26 19:11:55 <@zodbot:fedora.im> Michal Konecny (zlopez)
2025-06-26 19:12:10 <@phsmoura:fedora.im> is there anything else I can jump in to help while we dont have ocp stg nirik ? 
2025-06-26 19:12:37 <@james:fedora.im> Also started a "staging switcharoo retro" section in the hackmd ... so hopefully we can make different mistakes on Mon/Tue
2025-06-26 19:16:19 <@nirik:matrix.scrye.com> phsmoura: not sure... but we should be set for ocp.stg now I think.. can you try and deploy planet staging and see how it does?
2025-06-26 19:16:35 <@nirik:matrix.scrye.com> James: great, I was going to do that.
2025-06-26 19:17:13 <@nirik:matrix.scrye.com> one I wanted to add: we should cleanup/drop databases we no longer need.
2025-06-26 19:17:21 <@nirik:matrix.scrye.com> the pdc db is... gigantic.
2025-06-26 19:17:33 <@phsmoura:fedora.im> ok, but I cant access ocp stg here.. it says "Application is not available" :/
2025-06-26 19:17:57 <@nirik:matrix.scrye.com> the web console should be up now... hit a shift refresh?
2025-06-26 19:18:33 <@james:fedora.im> I assume we can only do that during the outage ... so do early TZ people need to do it before storage, or just before we upgrade postgresql 15 -> 16?
2025-06-26 19:19:20 <@phsmoura:fedora.im> still getting the same error.. maybe Im trying a wrong link?
2025-06-26 19:19:29 <@nirik:matrix.scrye.com> and I pushed a change so staging openshift playbooks should use the rdu3 stg control host, so it should just be a playbook run -l staging
2025-06-26 19:22:14 <@nirik:matrix.scrye.com> James: the db dropping? no, we can do that anytime, I will do so before the switch
2025-06-26 19:22:26 <@nirik:matrix.scrye.com> https://console-openshift-console.apps.ocp.stg.fedoraproject.org/
2025-06-26 19:22:51 <@james:fedora.im> Ahh didn't know --limit could specify staging ... I was using --limit '*.stg.rdu3.*'
2025-06-26 19:23:05 <@nirik:matrix.scrye.com> yeah, groups or hosts can be matched
2025-06-26 19:23:23 <@james:fedora.im> Ahh didn't know --limit could specify staging ... I was using --limit '\*.stg.rdu3.\*'
2025-06-26 19:23:31 <@nirik:matrix.scrye.com> well, for many things -l staging might still get stg.iad2 stuff...
2025-06-26 19:23:38 <@nirik:matrix.scrye.com> but we should remove that soon
2025-06-26 19:24:31 <@james:fedora.im> Ahh, nice.
2025-06-26 19:27:53 <@nirik:matrix.scrye.com> so, basically just build out stg more and prep for next week hyjinks. ;)
2025-06-26 19:28:43 <@james:fedora.im> Sounds good, see y'all in #noc:fedoraproject.org 
2025-06-26 19:28:50 <@james:fedora.im> !endmeeting