2025-06-16 19:01:34 <@james:fedora.im> !startmeeting Fedora Infrastructure Ops Daily Standup Meeting

2025-06-16 19:03:34 <@meetbot:fedora.im> Meeting started at 2025-06-16 19:01:34 UTC
2025-06-16 19:03:34 <@meetbot:fedora.im> The Meeting name is 'Fedora Infrastructure Ops Daily Standup Meeting'
2025-06-16 19:03:45 <@nirik:matrix.scrye.com> morning
2025-06-16 19:03:48 <@james:fedora.im> Hey
2025-06-16 19:03:51 <@phsmoura:fedora.im> hello
2025-06-16 19:04:09 <@james:fedora.im> !topic Tickets needing review
2025-06-16 19:04:13 <@james:fedora.im> !info https://pagure.io/fedora-infrastructure/issues?status=Open&priority=1
2025-06-16 19:04:20 <@james:fedora.im> !ticket 12601
2025-06-16 19:04:20 <@zodbot:fedora.im> ● **Last Updated:** Never
2025-06-16 19:04:20 <@zodbot:fedora.im> **fedora-infrastructure #12601** (https://pagure.io/fedora-infrastructure/issue/12601):**Decommission provisioning.fp.org**
2025-06-16 19:04:20 <@zodbot:fedora.im> ● **Assignee:** Not Assigned
2025-06-16 19:04:20 <@zodbot:fedora.im> 
2025-06-16 19:04:20 <@zodbot:fedora.im> ● **Opened:** 56 minutes ago by pbrobinson
2025-06-16 19:04:32 <@nirik:matrix.scrye.com> med med ops?
2025-06-16 19:04:42 <@nirik:matrix.scrye.com> should be pretty easy so perhaps med low?
2025-06-16 19:04:54 <@james:fedora.im> Yeh, it looks like we just turn it off and walk away?
2025-06-16 19:05:11 <@james:fedora.im> I'm fine with med though because openshift scares me :)
2025-06-16 19:05:14 <@nirik:matrix.scrye.com> delete it in openshift and remove stuff in ansible, and add a redirect at the end
2025-06-16 19:05:38 <@nirik:matrix.scrye.com> or we could do the lazy way...
2025-06-16 19:05:48 <@nirik:matrix.scrye.com> just ignore it for now, but not migrate it to the new datacenter. ;)
2025-06-16 19:06:13 <@james:fedora.im> Still need to do the ansible bits ;)
2025-06-16 19:06:20 <@nirik:matrix.scrye.com> but better to cleanly remove it
2025-06-16 19:06:56 <@james:fedora.im> No new releng tickets...
2025-06-16 19:06:57 <@james:fedora.im> !topic Planning, Upcoming work and Open floor
2025-06-16 19:07:24 <@james:fedora.im> !info Two weeks until DC move!
2025-06-16 19:07:42 <@nirik:matrix.scrye.com> !info 14 days until datacenter switcharoo week
2025-06-16 19:07:48 <@nirik:matrix.scrye.com> yep.
2025-06-16 19:08:01 <@nirik:matrix.scrye.com> So... I have some stuff you all could help with if you have cycles:
2025-06-16 19:08:37 <@nirik:matrix.scrye.com> phsmoura: would you be willing to install a proxy01.stg.rdu3 and proxy02.stg.rdu3 ? I can help with info needed... but it hopefully shouldn't be too bad.
2025-06-16 19:08:39 <@phsmoura:fedora.im> I finished to reinstall the proxies should we close the issue? also opened a PR adding tmpwatch back to ansible
2025-06-16 19:08:52 <@phsmoura:fedora.im> sure
2025-06-16 19:08:56 <@nirik:matrix.scrye.com> ah, did tmpwatch get back in? cool.
2025-06-16 19:09:13 <@james:fedora.im> Is the fixed version in the official repos?
2025-06-16 19:09:15 <@phsmoura:fedora.im> seems so, their PR got merged
2025-06-16 19:10:07 <@nirik:matrix.scrye.com> James: you interested in setting up rabbitmq clusters in rdu3? :) If we do rhel9 we need to get rabbitmq-server from the centos messaging sig... we could also look at rhel10 for it I guess since it's an anoying one to upgrade.
2025-06-16 19:10:56 <@james:fedora.im> I'm fine to try anything ... was expecting to take wiki ;) ... and maybe some of the easier openshift extras ... I can certainly try rabbitmq though.
2025-06-16 19:11:08 <@nirik:matrix.scrye.com> epel10 right now lacks nagios and zabbix_client and collectd... but otherwise things all see there.
2025-06-16 19:11:58 <@nirik:matrix.scrye.com> so for this week my plan is: get openshift setup the rest of the way and stg openshift (but that needs staging proxies), then get fcos and some projects that don't have database or nfs to move.
2025-06-16 19:12:11 <@nirik:matrix.scrye.com> also want to install builders and power10/arm stuff
2025-06-16 19:12:13 <@phsmoura:fedora.im> ah sorry.. the links is redirecting to an issue now the PR page is 404 :/ mt mistake
2025-06-16 19:12:22 <@james:fedora.im> Can/should we run without any of those? Do we want to poke people, or try to get builds into our infra repo?
2025-06-16 19:12:23 <@phsmoura:fedora.im> ah sorry.. the links is redirecting to an issue now the PR page is 404 :/ my mistake
2025-06-16 19:12:38 <@phsmoura:fedora.im> ah sorry.. the link is redirecting to an issue now the PR page is 404 :/ my mistake
2025-06-16 19:12:43 <@nirik:matrix.scrye.com> anything with databases or nfs we can't easily move early. It will need to be duing switch week.
2025-06-16 19:13:08 <@nirik:matrix.scrye.com> colllectd is just my lack of time. I am not sure on the other two...
2025-06-16 19:13:28 <@james:fedora.im> I wasn't sure if we could install the wiki, but have no data ... and then "just" switch the data during the 30th week.
2025-06-16 19:13:52 <@nirik:matrix.scrye.com> yeah, we can... and probibly should next week...
2025-06-16 19:14:04 <@nirik:matrix.scrye.com> but I suppose we could do that part early.
2025-06-16 19:14:06 <@james:fedora.im> Okay, I'll look at build of collectd and pinging people for the monitoring.
2025-06-16 19:14:48 <@nirik:matrix.scrye.com> I didn't want to get too far into adjusting for rhel10 since we are so low on time, but for rabbitmq and databases it might be worth doing to avoid upgrades later.
2025-06-16 19:14:54 <@james:fedora.im> We have 9ish work days, so I'm fine with whatever order you'd prefer
2025-06-16 19:15:40 <@james:fedora.im> Yeh, I'll look at el10 for it this week ... then if it's not there we can go with plan B of el9 next week.
2025-06-16 19:15:50 <@nirik:matrix.scrye.com> well, we can see how easy it is to just build nagios/zabbix/collecd in epel10-infra for now I guess.
2025-06-16 19:16:00 <@james:fedora.im> !info Thursday is a federal holiday in the US (19th June).
2025-06-16 19:16:05 <@nirik:matrix.scrye.com> but there's also a ticket about adding epel10-infra tags
2025-06-16 19:17:05 <@nirik:matrix.scrye.com> phsmoura: so on those stg proxies, should just be add inventory and host_vars for them... ip's are the same but 10.16 instead of 10.3... and vmhost's should use .rdu3. versions instead of .iad2.
2025-06-16 19:18:24 <@phsmoura:fedora.im> ok, should run ansible after updating that?
2025-06-16 19:18:26 <@james:fedora.im> !releng 12765
2025-06-16 19:18:27 <@zodbot:fedora.im> **releng #12765** (https://pagure.io/releng/issue/12765):**make epel10-infra tags in koji**
2025-06-16 19:18:27 <@zodbot:fedora.im> 
2025-06-16 19:18:27 <@zodbot:fedora.im> ● **Opened:** 2 weeks ago by kevin
2025-06-16 19:18:27 <@zodbot:fedora.im> ● **Last Updated:** 2 weeks ago
2025-06-16 19:18:27 <@zodbot:fedora.im> ● **Assignee:** patrikp
2025-06-16 19:19:05 <@nirik:matrix.scrye.com> well, adding... we do not want to remove the iad2 ones, we want to add new rdu3 ones. ;) but yeah, after adding those you should be able to run ansible to deploy them...
2025-06-16 19:19:25 <@nirik:matrix.scrye.com> same for rabbitmq... and any other rdu3 vm we are deploying.
2025-06-16 19:19:30 <@james:fedora.im> Having never added tags before, that doesn't seem like a real blocker.
2025-06-16 19:19:49 <@nirik:matrix.scrye.com> it shouldn't be hard, just I haven't had time to do it. ;)
2025-06-16 19:20:56 <@nirik:matrix.scrye.com> well, koji has it's own permissions... so koji admins are seperate from any fas group
2025-06-16 19:21:02 <@nirik:matrix.scrye.com> but yeah.
2025-06-16 19:21:05 <@james:fedora.im> ahh, I guess not then ;)
2025-06-16 19:21:32 <@nirik:matrix.scrye.com> I actually have an idea of how to make koji use groups, but it's... down on the todo list
2025-06-16 19:21:47 <@nirik:matrix.scrye.com> anyhow, any other questions?
2025-06-16 19:22:20 <@phsmoura:fedora.im> Im good
2025-06-16 19:22:54 <@james:fedora.im> No real questions ... did notice you were doing openshift install things over the weekend. Do you think we are good for time?
2025-06-16 19:23:41 <@nirik:matrix.scrye.com> hard to say... I hope so? but I am going to try and get lots done this week... better to mostly be ready at the end than scrambling.
2025-06-16 19:25:10 <@james:fedora.im> Anyway, on that cheery note I'll give y'all 5 minutes
2025-06-16 19:25:15 <@james:fedora.im> !endmeeting