18:01:21 <phsmoura> #startmeeting Fedora Infrastructure Ops Daily Standup Meeting
18:01:21 <zodbot> Meeting started Tue Aug 15 18:01:21 2023 UTC.
18:01:21 <zodbot> This meeting is logged and archived in a public location.
18:01:21 <zodbot> The chair is phsmoura. Information about MeetBot at https://fedoraproject.org/wiki/Zodbot#Meeting_Functions.
18:01:21 <zodbot> Useful Commands: #action #agreed #halp #info #idea #link #topic.
18:01:21 <zodbot> The meeting name has been set to 'fedora_infrastructure_ops_daily_standup_meeting'
18:01:22 <phsmoura> #chair nirik smooge phsmoura
18:01:22 <zodbot> Current chairs: nirik phsmoura smooge
18:01:22 <phsmoura> #meetingname fedora_infrastructure_ops_daily_standup_meeting
18:01:22 <phsmoura> #info meeting is 30 minutes MAX. At the end of 30, its stops
18:01:22 <zodbot> The meeting name has been set to 'fedora_infrastructure_ops_daily_standup_meeting'
18:01:22 <phsmoura> #info agenda is at https://board.net/p/fedora-infra-daily
18:01:27 <phsmoura> morning
18:01:30 <nirik> good morning
18:01:49 <aheath1992> afternoon
18:02:36 <smooge> ehlo
18:03:25 <phsmoura> #info reminder: speak up if you want to work on a ticket!
18:03:26 <phsmoura> #topic Tickets needing review
18:03:41 <phsmoura> #info https://pagure.io/fedora-infrastructure/issues?status=Open&priority=1
18:03:53 <phsmoura> .ticket 11476
18:03:54 <zodbot> phsmoura: Issue #11476: Please allow us to power-cycle Copr hypervisors - fedora-infrastructure - Pagure.io - https://pagure.io/fedora-infrastructure/issue/11476
18:04:02 <phsmoura> med med ops?
18:04:17 <smooge> that was the one I was going to ask about
18:04:42 <smooge> there were some switch problems at that DC earlier this week. I wasn't sure if the problem they were saying might be affected by that
18:06:25 <smooge> that said.. med med ops
18:07:24 <phsmoura> #info https://pagure.io/releng/issues?status=Open
18:07:28 <nirik> sorry, got sidetracked... back now
18:07:40 <phsmoura> we dont have new releng tickets
18:07:51 <nirik> well, this is not at all going to be easy to do... but I'll ponder on it.
18:09:31 <phsmoura> #topic Planning, Upcoming work and Open floor
18:09:38 <phsmoura> anything for open floor?
18:10:27 <nirik> so, I am updating/rebooting machines today and tomorrow. I am off thursday and friday is a recharge day. Next tuesday is start of beta freeze.
18:10:55 <aheath1992> not from my end, working on getting RPM's approved and talking with nirik and darknao about implementing AWX
18:11:18 <smooge> nirik: are you sure you can't squeeze another thing on that calendar? Like a redo of the entire DNS or monitoring infrastrcture?
18:11:20 <nirik> I'll try and get to that review today... been low on spoons
18:11:36 <nirik> yeah! I'm slacking
18:12:36 <aheath1992> nirik, no rush their are more important things then a nagging fedora-apprentice
18:12:56 <nirik> ha, well, I am sure I will get it...
18:13:09 <darknao> if you need help on updating/rebooting, maybe that's something I can do
18:14:26 <nirik> sure! happy to expand on whats needed there... if you are around tomorrow after 21utc or if you want to do some today.
18:15:25 <darknao> i can do both today and tomorrow, depending of what's needed
18:15:48 <darknao> is that just a dnf update && reboot, or is there something more to it?
18:15:55 <nirik> short summary: there's a hackmd doc to coordinate, and we have a vhost_update_reboot playbook... you pass it a host and it updates the host and all the guests, shuts them down and reboots the host...
18:16:17 <nirik> the playbook also adds nagios downtime and if there's a proxy it takes it out of dns
18:16:40 <darknao> ok so just a playbook to run, seems like something I can do :)
18:16:50 <nirik> unless something goes wrong. ;)
18:17:20 <nirik> but that never happens. ;)
18:17:23 <darknao> but that never happen, right.... :p
18:19:15 <smooge> the main thing to make sure is that certain servers do NOT get rebooted at the same time
18:19:40 <smooge> don't reboot both tang servers. don't reboot both dns servers. don't reboot both bastions
18:20:08 <nirik> right.
18:20:20 <nirik> but that can all be coordinated.
18:20:48 <smooge> and make sure you say you are doing so when you are doing so.. because when someone *COUGH* doesn't.. both will get rebooted
18:21:22 <darknao> they are not all vmhost on that list, right?
18:22:12 <smooge> no they are on different ones.. it just happens sometime that X is rebooting vmhostA and Y is updating and rebooting vmhostB and then Z is wondering why vmhostC isn't coming up
18:23:03 <nirik> There's really only one bad loop left, and I know it... so please coodinate with me when doing them. ;)
18:23:47 <smooge> yeah the lesson is coordinate with nirik
18:23:51 <nirik> (and I might have fixed that one)
18:24:26 <nirik> anyhow, nothing more off hand from me.
18:24:38 <nirik> oh, I won't be at the standup on thursday either. ;)
18:25:20 <phsmoura> nothing new here as well
18:25:38 <phsmoura> seems thats all for today
18:26:21 <phsmoura> thanks everyone :)
18:26:32 <phsmoura> #endmeeting