#meeting-3:fedoraproject.org log

<@james:fedora.im>

19:00:01

!startmeeting Fedora Infrastructure Ops Daily Standup Meeting

<@meetbot:fedora.im>

19:00:02

Meeting started at 2025-05-13 19:00:01 UTC

<@meetbot:fedora.im>

19:00:02

The Meeting name is 'Fedora Infrastructure Ops Daily Standup Meeting'

<@james:fedora.im>

19:00:14

!chair nirik @james:fedora.im

<@james:fedora.im>

19:00:18

!info invitees @smilner:fedora.im

<@james:fedora.im>

19:00:22

!meetingname fedora_infrastructure_ops_daily_standup_meeting

<@meetbot:fedora.im>

19:00:23

The Meeting Name is now fedora_infrastructure_ops_daily_standup_meeting

<@james:fedora.im>

19:00:26

!info Meeting is 30 minutes MAX. At the end of 30, its stops

<@nirik:matrix.scrye.com>

19:00:29

morning

<@james:fedora.im>

19:00:32

!info Agenda is at https://board.net/p/fedora-infra-daily

<@james:fedora.im>

19:00:35

!info Reminder: Speak up if you want to work on a ticket!

<@james:fedora.im>

19:00:39

!hi

<@zodbot:fedora.im>

19:00:40

James Antill (james)

<@james:fedora.im>

19:01:47

On the upside, I believe we have no new tickets

<@nirik:matrix.scrye.com>

19:01:53

well, thats something!

<@james:fedora.im>

19:02:18

!topic Planning, Upcoming work and Open floor

<@nirik:matrix.scrye.com>

19:02:48

so, I was working yesterday hard on new hardware (as was Gwmngilfen) but we hit a snag...

<@nirik:matrix.scrye.com>

19:03:05

they are moving some things around to balance power on the new machines, so we are waiting for them to complete that.

<@nirik:matrix.scrye.com>

19:03:31

I have been doing some AI scaper fighting this morning (as one does these days)

<@nirik:matrix.scrye.com>

19:03:47

In the process discovering our bot blocking rule... didn't block any bots. ;(

<@james:fedora.im>

19:04:11

Also weird to me that they say they are bots while ignoring robots.txt

<@nirik:matrix.scrye.com>

19:04:51

yeah, no one seems to care about robots.txt anymore. It was only a 'gentelpersons agreement'

<@nirik:matrix.scrye.com>

19:05:35

So, I need to catch up on emails and tickets I guess... and do some planning for DC move stuff I can do while waiting for hardware.

<@nirik:matrix.scrye.com>

19:05:44

!info f40 is eol today

<@nirik:matrix.scrye.com>

19:05:56

with that we should really move the wiki off it. ;)

<@james:fedora.im>

19:06:13

On that note ... QA said it's fine to reinstall wiki.stg ... so someone (me?) should try that today.

<@nirik:matrix.scrye.com>

19:06:34

sure, sounds good. I can help out and you can do the main lifting?

<@james:fedora.im>

19:06:59

Yeh, just point me at the SOP or docs or whatever ... and I'll see what I can break ;)

<@nirik:matrix.scrye.com>

19:07:14

should be: take down old vm, do db dump, switch playbook and run it to make new vm with new version, login and run the upgrade on the db...

<@nirik:matrix.scrye.com>

19:08:02

https://docs.fedoraproject.org/en-US/infra/sysadmin_guide/wiki/ is... a bit spare

<@nirik:matrix.scrye.com>

19:09:18

not sure I have anything else...

<@james:fedora.im>

19:11:13

Yeh, looked+searched through ... do I have access to take down VMs?

<@nirik:matrix.scrye.com>

19:12:44

probibly not. I can do that part when you are ready tho.

<@nirik:matrix.scrye.com>

19:12:54

I usually like to save it off in case we need to rollback

<@james:fedora.im>

19:13:16

Yeh, that makes a lot of sense ... how much of the above can I do?

<@james:fedora.im>

19:13:35

DB dump requires server login, right?

<@nirik:matrix.scrye.com>

19:14:06

yeah, we should actually already have one from last night I think... but I can check.

<@james:fedora.im>

19:14:34

Have similar questions about reinstall'ing proxy servers ;)

<@nirik:matrix.scrye.com>

19:14:40

just set some nagios downtime for it and I can take the vm down and confirm the db and then leave it to you. ;)

<@nirik:matrix.scrye.com>

19:15:27

for those proxy3* servers... they are all in aws. I can get you the perm to login with infra role there. That should allow you to take them down, make new instance, update dns with new ip and configure.

<@james:fedora.im>

19:16:04

Also don't know how to make a new VM, but can maybe work out from that point how to make it a wiki VM ;)

<@nirik:matrix.scrye.com>

19:16:29

for the wiki it's all done by ansible. ;) It will see there's no vm defined for it and create/install one.

<@james:fedora.im>

19:16:39

Ohh, magic.

<@nirik:matrix.scrye.com>

19:16:52

yeah

<@nirik:matrix.scrye.com>

19:19:20

yeah, it's a nice little task.

<@james:fedora.im>

19:21:05

So ... do a PR to change for `inventory/host_vars/wiki01.stg.iad2.fedoraproject.org` and then wait until you kill the old, and then run the playbook?

<@james:fedora.im>

19:21:28

Do we want to increase MEM/CPU or anything as we are reinstalling anyway?

<@nirik:matrix.scrye.com>

19:21:31

yep. and then fix whatever doom happens. ;)

<@nirik:matrix.scrye.com>

19:21:59

I think it's probibly fine... could look at collectd stats and see if it's heavily loaded or something

<@james:fedora.im>

19:23:22

If nothing stands out, I'll go with it as is.

<@james:fedora.im>

19:23:27

Okay, I guess that's it

<@james:fedora.im>

19:23:33

!endmeeting