2025-05-13 19:00:01 <@james:fedora.im> !startmeeting Fedora Infrastructure Ops Daily Standup Meeting
2025-05-13 19:00:02 <@meetbot:fedora.im> Meeting started at 2025-05-13 19:00:01 UTC
2025-05-13 19:00:02 <@meetbot:fedora.im> The Meeting name is 'Fedora Infrastructure Ops Daily Standup Meeting'
2025-05-13 19:00:14 <@james:fedora.im> !chair nirik @james:fedora.im
2025-05-13 19:00:18 <@james:fedora.im> !info invitees @smilner:fedora.im
2025-05-13 19:00:22 <@james:fedora.im> !meetingname fedora_infrastructure_ops_daily_standup_meeting
2025-05-13 19:00:23 <@meetbot:fedora.im> The Meeting Name is now fedora_infrastructure_ops_daily_standup_meeting
2025-05-13 19:00:26 <@james:fedora.im> !info Meeting is 30 minutes MAX. At the end of 30, its stops
2025-05-13 19:00:29 <@nirik:matrix.scrye.com> morning
2025-05-13 19:00:32 <@james:fedora.im> !info Agenda is at https://board.net/p/fedora-infra-daily
2025-05-13 19:00:35 <@james:fedora.im> !info Reminder: Speak up if you want to work on a ticket!
2025-05-13 19:00:39 <@james:fedora.im> !hi
2025-05-13 19:00:40 <@zodbot:fedora.im> James Antill (james)
2025-05-13 19:01:47 <@james:fedora.im> On the upside, I believe we have no new tickets
2025-05-13 19:01:53 <@nirik:matrix.scrye.com> well, thats something!
2025-05-13 19:02:18 <@james:fedora.im> !topic Planning, Upcoming work and Open floor
2025-05-13 19:02:48 <@nirik:matrix.scrye.com> so, I was working yesterday hard on new hardware (as was Gwmngilfen) but we hit a snag...
2025-05-13 19:03:05 <@nirik:matrix.scrye.com> they are moving some things around to balance power on the new machines, so we are waiting for them to complete that.
2025-05-13 19:03:31 <@nirik:matrix.scrye.com> I have been doing some AI scaper fighting this morning (as one does these days)
2025-05-13 19:03:47 <@nirik:matrix.scrye.com> In the process discovering our bot blocking rule... didn't block any bots. ;(
2025-05-13 19:04:11 <@james:fedora.im> Also weird to me that they say they are bots while ignoring robots.txt
2025-05-13 19:04:51 <@nirik:matrix.scrye.com> yeah, no one seems to care about robots.txt anymore. It was only a 'gentelpersons agreement'
2025-05-13 19:05:35 <@nirik:matrix.scrye.com> So, I need to catch up on emails and tickets I guess... and do some planning for DC move stuff I can do while waiting for hardware.
2025-05-13 19:05:44 <@nirik:matrix.scrye.com> !info f40 is eol today
2025-05-13 19:05:56 <@nirik:matrix.scrye.com> with that we should really move the wiki off it. ;)
2025-05-13 19:06:13 <@james:fedora.im> On that note ... QA said it's fine to reinstall wiki.stg ... so someone (me?) should try that today.
2025-05-13 19:06:34 <@nirik:matrix.scrye.com> sure, sounds good. I can help out and you can do the main lifting?
2025-05-13 19:06:59 <@james:fedora.im> Yeh, just point me at the SOP or docs or whatever ... and I'll see what I can break ;)
2025-05-13 19:07:14 <@nirik:matrix.scrye.com> should be: take down old vm, do db dump, switch playbook and run it to make new vm with new version, login and run the upgrade on the db...
2025-05-13 19:08:02 <@nirik:matrix.scrye.com> https://docs.fedoraproject.org/en-US/infra/sysadmin_guide/wiki/ is... a bit spare
2025-05-13 19:09:18 <@nirik:matrix.scrye.com> not sure I have anything else...
2025-05-13 19:11:13 <@james:fedora.im> Yeh, looked+searched through ... do I have access to take down VMs?
2025-05-13 19:12:44 <@nirik:matrix.scrye.com> probibly not. I can do that part when you are ready tho.
2025-05-13 19:12:54 <@nirik:matrix.scrye.com> I usually like to save it off in case we need to rollback
2025-05-13 19:13:16 <@james:fedora.im> Yeh, that makes a lot of sense ... how much of the above can I do?
2025-05-13 19:13:35 <@james:fedora.im> DB dump requires server login, right?
2025-05-13 19:14:06 <@nirik:matrix.scrye.com> yeah, we should actually already have one from last night I think... but I can check.
2025-05-13 19:14:34 <@james:fedora.im> Have similar questions about reinstall'ing proxy servers ;)
2025-05-13 19:14:40 <@nirik:matrix.scrye.com> just set some nagios downtime for it and I can take the vm down and confirm the db and then leave it to you. ;)
2025-05-13 19:15:27 <@nirik:matrix.scrye.com> for those proxy3* servers... they are all in aws. I can get you the perm to login with infra role there. That should allow you to take them down, make new instance, update dns with new ip and configure.
2025-05-13 19:16:04 <@james:fedora.im> Also don't know how to make a new VM, but can maybe work out from that point how to make it a wiki VM ;)
2025-05-13 19:16:29 <@nirik:matrix.scrye.com> for the wiki it's all done by ansible. ;) It will see there's no vm defined for it and create/install one.
2025-05-13 19:16:39 <@james:fedora.im> Ohh, magic.
2025-05-13 19:16:52 <@nirik:matrix.scrye.com> yeah
2025-05-13 19:19:20 <@nirik:matrix.scrye.com> yeah, it's a nice little task.
2025-05-13 19:21:05 <@james:fedora.im> So ... do a PR to change for `inventory/host_vars/wiki01.stg.iad2.fedoraproject.org` and then wait until you kill the old, and then run the playbook?
2025-05-13 19:21:28 <@james:fedora.im> Do we want to increase MEM/CPU or anything as we are reinstalling anyway?
2025-05-13 19:21:31 <@nirik:matrix.scrye.com> yep. and then fix whatever doom happens. ;)
2025-05-13 19:21:59 <@nirik:matrix.scrye.com> I think it's probibly fine... could look at collectd stats and see if it's heavily loaded or something
2025-05-13 19:23:22 <@james:fedora.im> If nothing stands out, I'll go with it as is.
2025-05-13 19:23:27 <@james:fedora.im> Okay, I guess that's it
2025-05-13 19:23:33 <@james:fedora.im> !endmeeting