18:00:02 <nirik> #startmeeting Fedora Infrastructure Ops Daily Standup Meeting
18:00:02 <zodbot> Meeting started Wed Sep 22 18:00:02 2021 UTC.
18:00:03 <zodbot> This meeting is logged and archived in a public location.
18:00:03 <zodbot> The chair is nirik. Information about MeetBot at https://fedoraproject.org/wiki/Zodbot#Meeting_Functions.
18:00:03 <zodbot> Useful Commands: #action #agreed #halp #info #idea #link #topic.
18:00:03 <zodbot> The meeting name has been set to 'fedora_infrastructure_ops_daily_standup_meeting'
18:00:03 <nirik> #chair mboddu nirik pingou mobrien nb
18:00:03 <zodbot> Current chairs: mboddu mobrien nb nirik pingou
18:00:03 <nirik> #meetingname fedora_infrastructure_ops_daily_standup_meeting
18:00:03 <zodbot> The meeting name has been set to 'fedora_infrastructure_ops_daily_standup_meeting'
18:00:03 <nirik> #info meeting is 30 minutes MAX. At the end of 30, its stops
18:00:03 <nirik> #info agenda is at https://board.net/p/fedora-infra-daily
18:00:03 <nirik> #info reminder: speak up if you want to work on a ticket!
18:00:05 <nirik> #topic Tickets needing review
18:00:07 <nirik> #info https://pagure.io/fedora-infrastructure/issues?status=Open&priority=1
18:00:16 <mboddu> .hello mohanboddu
18:00:16 <zodbot> mboddu: mohanboddu 'Mohan Boddu' <mboddu@bhujji.com>
18:00:27 <nirik> hey mboddu
18:00:46 <nirik> .ticket 10229
18:00:47 <zodbot> nirik: Issue #10229: Koji builds failing inconsistently for pam package - fedora-infrastructure - Pagure.io - https://pagure.io/fedora-infrastructure/issue/10229
18:00:54 <nirik> just needs waiting on asignee?
18:01:30 <nirik> .ticket 10232
18:01:31 <zodbot> nirik: Issue #10232: Network connectivity issues - fedora-infrastructure - Pagure.io - https://pagure.io/fedora-infrastructure/issue/10232
18:01:32 <nirik> also
18:01:52 <nirik> .ticket 10233
18:01:54 <zodbot> nirik: Issue #10233: Redeploy openqa-x86-worker04.iad2.fedoraproject.org - fedora-infrastructure - Pagure.io - https://pagure.io/fedora-infrastructure/issue/10233
18:01:55 <nirik> this one too. ;)
18:02:07 <nirik> should mention to the early standup to move status too.
18:02:18 <nirik> but it does give us a chance to look and see if we want to adjust anything
18:02:40 <nirik> .ticket 10235
18:02:41 <zodbot> nirik: Issue #10235: creation of redhat-et group (for copr mainly) - fedora-infrastructure - Pagure.io - https://pagure.io/fedora-infrastructure/issue/10235
18:02:45 <mboddu> ^ Yeah, I like it for this reason, but sometimes I forget to change it as well :D
18:02:48 <nirik> low/low/ops just needs doing
18:03:40 <mboddu> Done
18:04:54 <nirik> .ticket 10236
18:04:55 <zodbot> nirik: Issue #10236: pdc throwing 500 errors - fedora-infrastructure - Pagure.io - https://pagure.io/fedora-infrastructure/issue/10236
18:05:07 <nirik> med med ops. Any ideas on whats causing this one welcome.
18:05:12 <nirik> or med/med/dev perhaps
18:05:19 <nirik> I have no idea whats causing that 500. ;)
18:05:57 <mboddu> I hope its not related memory leaks, I remember PDC was having some issues regarding it
18:06:57 <mboddu> (Also now I think I jinxed it, last week I informed Aoife that it is one of the apps that is not maintained but its one of the stable apps with very less issues)
18:07:01 <nirik> I dont think it is... it seems to happen every 8-10 api requests
18:07:25 <nirik> ah ha. it's your fault! :)
18:08:17 * nirik would be happy once we get rid of pdc one day
18:09:00 <mboddu> Yeah, I wish we could get rid of it
18:09:18 <nirik> anyhow, thats it on new / triage infra tickets.
18:09:22 <nirik> anything on releng?
18:10:13 <mboddu> Nope, no new one's other than from the morning triage
18:10:20 <nirik> cool.
18:10:24 <nirik> #topic Upcoming plans
18:10:35 <mboddu> Yay, we finally got a RC request
18:10:36 <nirik> I'm going to fight down tickets today some I think...
18:10:42 <mboddu> And same here
18:11:20 <nirik> then I have mac notorizing, greewave/waiverdb for stream, and lots of little stuff.
18:11:42 <nirik> #topic Discussion / AOB
18:12:18 <mboddu> greenwave/waiverdb - little stuff?
18:12:27 <nirik> anything anyone would like to discuss or bring up
18:12:38 <mboddu> Nothing from my end
18:12:42 <nirik> they are not little stuff. Thats a seperate item. ;)
18:13:25 <nirik> oh, I need to do a freeze break on my proxy changes... proxy01/10 seem ok today... hopefully that fixed them
18:13:35 <mboddu> Nice
18:13:37 <nirik> hey pmoura
18:13:59 <pmoura> hey
18:14:14 <eddiejennings> So apparently Weechat dropped my connection an hour ago.  :(
18:14:15 <nirik> hey eddiejennings
18:14:16 <pmoura> sorry, just joined
18:14:22 <eddiejennings> And I just realized it
18:14:34 <nirik> no worries. we are in discussion section if you all have anything you would like to discuss?
18:14:49 <eddiejennings> One "quick" thing, yes.
18:15:34 <eddiejennings> For DNS updates.  The SOP does spell out the process of updating the fedoraproject.org template and committing the change, then if I recall running do_dns or whatever the name of the script is
18:15:58 <nirik> yeah, although that requires you to be in sysadmin-dns. :)
18:16:03 <eddiejennings> It then says that a change must be made in Ansible, but looking at the Ansible piece that seems like that's only for actually making changes for named.conf
18:16:11 <nirik> but you can create a patch for someone in that group to push
18:16:14 <eddiejennings> or adding new zones.
18:16:27 <eddiejennings> noted on sysadmin-dns
18:16:27 <nirik> yeah, only named.conf changes need to be done in ansible. yep. exactly right
18:16:42 <eddiejennings> So the question is where do I submit the PR / patch for DNS?
18:17:06 <nirik> you can attach it to the issue or post to the list.
18:17:09 <eddiejennings> Since from what I can see the only way to see the repo is on Batcave where you make a clone
18:17:12 <eddiejennings> Ah, ok
18:17:12 <nirik> the dns repo isn't one thats on pagure.
18:17:19 <nirik> right.
18:18:10 <eddiejennings> One other question.  Do you want me ot make a separate issue for updating DNS and reference the original issue of IPv6, or just add it as a comment to the IPv6 ticket?
18:18:24 <nirik> just a comment is fine.
18:18:32 <mobrien> I'm gonna take on the redeploy of the qa worker in an hour or two. Anything special I should be looking out for there?
18:18:53 <eddiejennings> It will be done.  Probably tomorrow or Friday.  Tonight has had a significant event moved up from Friday.
18:19:37 <nirik> mobrien: note that it's fedora 34 there, not rhel... I think we have a kickstart for those, but not sure. If you don't want to mess with pxe booting you could also just install via grub from the existing install.
18:20:06 <nirik> eddiejennings: no hurry, we have to wait for freeze anyhow to land it. :) but hopefully we unfreeze next week.
18:20:15 * eddiejennings nods.
18:20:44 <mobrien> nirik got it. I may bug you again later if I get stuck
18:21:02 <nirik> please do. :)
18:21:27 <pmoura> I don't have anything to discuss now. I'm writing tests for 10177, then I'm planning to ask for help to mboddu
18:21:31 <nirik> as for the other one about adding another worker there. I was thinking one of those older spares we have around...
18:21:44 <mboddu> pmoura: Sure, happy to help :)
18:21:45 <nirik> pmoura: sounds good. :)
18:22:01 <pmoura> thanks :)
18:22:21 <nirik> mobrien: I was thinking of adding another mini-iniative ticket soon... move all the rhel7 stuff to rhel8.
18:24:28 <nirik> some we can't easily do, but there's lots that just need doing.
18:24:55 <nirik> anyhow, will do that sometime. anything else to discuss?
18:25:01 <mboddu> I think pdc is still on py2?
18:25:16 <eddiejennings> Nothing pertinent to Fedora Infrastructure for me :)
18:25:23 <mobrien> nirik that sounds like a good idea. When is rhel 7 eol?
18:25:35 <nirik> mboddu: yeah, there's going to be some that won't be easy/doable. :)
18:25:52 <nirik> https://paste.centos.org/view/83655245 is the list of all of them
18:26:33 <nirik> many of them will be going away for various reasons.
18:27:34 <nirik> mobrien: also, we should go install all those spare boxes we have that we aren't decomissioning so we can keep track of them better.
18:27:40 <mboddu> And the remaining one's are the troublesome one's :D
18:28:49 <nirik> all the colo-virts can be moved to 8, download can be moved to 8, nameservers, smtp-mm's, people02, sundries, torrent, unbound, virthost*rducc, and vmhost-x86-08/09 can all be moved to 8
18:29:23 <nirik> anyhow.
18:29:27 <nirik> Thanks everyone!
18:29:29 <nirik> #endmeeting