18:00:35 <nirik> #startmeeting Fedora Infrastructure Ops Daily Standup Meeting
18:00:35 <zodbot> Meeting started Mon Jun 22 18:00:35 2020 UTC.
18:00:35 <zodbot> This meeting is logged and archived in a public location.
18:00:35 <zodbot> The chair is nirik. Information about MeetBot at http://wiki.debian.org/MeetBot.
18:00:35 <zodbot> Useful Commands: #action #agreed #halp #info #idea #link #topic.
18:00:35 <zodbot> The meeting name has been set to 'fedora_infrastructure_ops_daily_standup_meeting'
18:00:35 <nirik> #chair cverna mboddu nirik smooge
18:00:35 <nirik> #meetingname fedora_infrastructure_ops_daily_standup_meeting
18:00:35 <nirik> #info meeting is 30 minutes MAX. At the end of 30, its stops
18:00:35 <zodbot> Current chairs: cverna mboddu nirik smooge
18:00:35 <zodbot> The meeting name has been set to 'fedora_infrastructure_ops_daily_standup_meeting'
18:00:44 <mboddu> .hola mohanboddu
18:00:52 <mboddu> We should teach zodbot some spanish :)
18:01:01 <mboddu> .hello mohanboddu
18:01:02 <zodbot> mboddu: mohanboddu 'Mohan Boddu' <mboddu@bhujji.com>
18:01:50 <nirik> ha
18:02:16 <nirik> #meetingname fedora_infrastructure_ops_daily_standup_meeting
18:02:16 <zodbot> The meeting name has been set to 'fedora_infrastructure_ops_daily_standup_meeting'
18:02:22 <nirik> #info meeting is 30 minutes MAX. At the end of 30, its stops
18:02:27 <nirik> #info agenda is at https://board.net/p/fedora-infra-daily
18:02:30 <smooge> hello
18:02:34 <nirik> #topic Tickets needing review
18:02:41 <nirik> #info https://pagure.io/fedora-infrastructure/issues?status=Open&priority=1
18:02:55 <nirik> .ticket 9055
18:02:56 <zodbot> nirik: Issue #9055: docs.fedoraproject.org redirecting to old documentation, not the Antora one - fedora-infrastructure - Pagure.io - https://pagure.io/fedora-infrastructure/issue/9055
18:03:04 <nirik> someone want to run or do tickets today?
18:03:16 <nirik> this one is my fault, I am working on it, and it should be fixed soon.
18:03:36 <smooge> wroking tickets
18:03:56 <fm-admin> pagure.issue.tag.added -- smooge tagged ticket fedora-infrastructure#9055: groomed https://pagure.io/fedora-infrastructure/issue/9055
18:03:57 <fm-admin> pagure.issue.assigned.added -- smooge assigned ticket fedora-infrastructure#9055 to kevin https://pagure.io/fedora-infrastructure/issue/9055
18:03:58 <fm-admin> pagure.issue.edit -- smooge edited the priority fields of ticket fedora-infrastructure#9055 https://pagure.io/fedora-infrastructure/issue/9055
18:04:03 <nirik> so assign it to me I guess and yeah.
18:04:05 * cverna waives
18:04:18 <nirik> .ticket 9506
18:04:23 <zodbot> nirik: An error has occurred and has been logged. Check the logs for more information.
18:04:26 <nirik> .ticket 9506
18:04:30 <zodbot> nirik: An error has occurred and has been logged. Check the logs for more information.
18:04:37 <nirik> humf. pagure down?
18:04:39 <nirik> .ticket 9506
18:04:43 <smooge> .ticket 9056
18:04:43 <zodbot> nirik: An error has occurred and has been logged. Check the logs for more information.
18:04:46 <zodbot> smooge: Issue #9056: PDC/FAS are very unstable - fedora-infrastructure - Pagure.io - https://pagure.io/fedora-infrastructure/issue/9056
18:04:48 <mboddu> .releng 9500
18:04:52 <zodbot> mboddu: Issue #9500: koji build in inconsistent state - releng - Pagure.io - https://pagure.io/releng/issue/9500
18:04:54 <mobrien[m]> s/9506/9056
18:05:02 <mboddu> That is a randome ticket I am checking
18:05:14 <nirik> oh, typo
18:05:30 <nirik> hang on mboddu...
18:05:38 <mboddu> I was just checking
18:05:51 <nirik> so, we kinda need nagios here... we don't know when pdc is hacking up a lung
18:06:08 <smooge> we should just assume it is always doing that
18:06:12 <nirik> I guess we can ask them to list specific tiles? I am not sure why fas would be unstable tho
18:06:26 <smooge> ansible-cron 10m systemctl restart pdc\*
18:06:28 <nirik> so, I guess med/med/waiting on assignee/groomed
18:06:48 <fm-admin> pagure.issue.tag.added -- smooge tagged ticket fedora-infrastructure#9056: groomed, medium-gain, and medium-trouble https://pagure.io/fedora-infrastructure/issue/9056
18:06:49 <fm-admin> pagure.issue.edit -- smooge edited the priority fields of ticket fedora-infrastructure#9056 https://pagure.io/fedora-infrastructure/issue/9056
18:07:30 <nirik> .ticket 9059
18:07:32 <zodbot> nirik: Issue #9059: copr: ppc64le HW machines re-installed in new lab? - fedora-infrastructure - Pagure.io - https://pagure.io/fedora-infrastructure/issue/9059
18:07:52 <nirik> this is high trouble, medium gain, waiting on external, groomed (?
18:08:03 <mboddu> +1
18:08:13 <fm-admin> pagure.issue.tag.added -- smooge tagged ticket fedora-infrastructure#9059: cloud, groomed, and 2 others https://pagure.io/fedora-infrastructure/issue/9059
18:08:14 <fm-admin> pagure.issue.edit -- smooge edited the priority fields of ticket fedora-infrastructure#9059 https://pagure.io/fedora-infrastructure/issue/9059
18:08:24 <nirik> .ticket 9060
18:08:25 <zodbot> nirik: Issue #9060: DNS issue - fedora-infrastructure - Pagure.io - https://pagure.io/fedora-infrastructure/issue/9060
18:09:03 <nirik> I guess we could convert this to: 'retrace.fedoraproject.org is down' and put it the same as the last one?
18:09:32 <fm-admin> pagure.issue.edit -- smooge edited the title fields of ticket fedora-infrastructure#9060 https://pagure.io/fedora-infrastructure/issue/9060
18:09:51 <fm-admin> pagure.issue.tag.added -- smooge tagged ticket fedora-infrastructure#9060: cloud, groomed, and 2 others https://pagure.io/fedora-infrastructure/issue/9060
18:09:52 <fm-admin> pagure.issue.edit -- smooge edited the priority fields of ticket fedora-infrastructure#9060 https://pagure.io/fedora-infrastructure/issue/9060
18:10:21 <nirik> I'd like to bring 9050 to cverna's attention...
18:10:30 <nirik> .ticket 9050
18:10:31 <zodbot> nirik: Issue #9050: https://bodhi.fedoraproject.org/updates/FEDORA-2020-659237bffa stuck because bodhi thinks it's not signed - fedora-infrastructure - Pagure.io - https://pagure.io/fedora-infrastructure/issue/9050
18:10:51 <nirik> for 9049, I can do it after this meeting if folks are around?
18:10:54 <nirik> .ticket 9049
18:10:56 <zodbot> nirik: Issue #9049: Please update ipsilon in prod. - fedora-infrastructure - Pagure.io - https://pagure.io/fedora-infrastructure/issue/9049
18:11:40 <nirik> mboddu: you had some releng ones?
18:11:46 <mboddu> Actually one
18:11:55 <mboddu> .releng 9542
18:11:57 <zodbot> mboddu: Issue #9542: Modules are still being built for Fedora 30 - releng - Pagure.io - https://pagure.io/releng/issue/9542
18:12:08 <nirik> yeah... someone on the list suggested it might be in pdc?
18:12:19 <mboddu> I thought we removed it and I am not seeing platform-f30.yaml in mbs configs
18:12:35 <smooge> well i was going to say i had a solution for that.. but I now have 2 solutions to that problem
18:12:47 <mboddu> smooge: Which one?
18:12:57 <mboddu> For modules building in f30?
18:12:58 <smooge> sorry my snark meter isn't working correctly
18:13:21 <smooge> it was not useful
18:13:42 <nirik> mboddu: yeah, I also don't see it. ;) so... 🤷
18:13:51 <mboddu> nirik: Okay, I will check pdc, but I think it shouldn't affect it
18:14:10 <mboddu> I will ping modularity folks in the ticket
18:14:27 <mboddu> low risk, high gain, groomed?
18:14:31 <nirik> mboddu: note that mbs upstream is now the koji folks...
18:14:34 <mboddu> Assumging its an easy fix
18:14:39 <mboddu> nirik: Yes
18:14:41 <nirik> sure.
18:15:58 <mboddu> .releng 9541
18:16:01 <zodbot> mboddu: Issue #9541: When tags at https://hub.docker.com/_/fedora will be updated to f32|latest - releng - Pagure.io - https://pagure.io/releng/issue/9541
18:16:09 <mboddu> siddharthvipul is looking into it
18:16:16 * nirik nods, sounds good
18:16:19 <siddharthvipul> oh yeah
18:16:25 <mboddu> medium trouble, medium gain, groomed?
18:16:26 <nirik> any other PRs/blockers/tickets to discuss?
18:16:30 <nirik> +1
18:16:49 <mboddu> One unretirement ticket which I dont want to bring up in stand ups, but thats it from me
18:16:58 <siddharthvipul> not groomed yet.. been busy elsewhere.. will work on it tomorrow
18:17:34 <nirik> on the dc move: stuff arrived from phx2 in iad2 friday... they have been racking and connecting things there friday and today and tomorrow they will finish up
18:17:49 <nirik> smooge has been working to bring things back up
18:17:59 <nirik> we added some arm builders saturday...
18:18:25 <mboddu> nirik++ smooge++
18:19:19 <nirik> we will be adding builders/openqa stuff first, then staging hosts... then we will start looking at building staging up.
18:19:34 <nirik> anything else from anyone?
18:19:40 <mobrien[m]> I have a quick one
18:19:47 <mboddu> nirik: I guess this would be first time where stg is almost identical to prod? :P
18:19:51 <mobrien[m]> This PR here https://pagure.io/fedora-infra/ansible/pull-request/147#
18:20:17 <mobrien[m]> I was updating IPs from phx2 to the corresponding iad2 ones and there is one that I couldn't find
18:20:55 <nirik> mboddu: ha. I doubt it. it's kind of a curve... the first 80% is pretty easy... the next 10% is hard, the next 5% is super super hard, etc
18:21:31 <capitanocrunch> accessing quick docs is not possible, it gives 403 Forbidden. https://docs.fedoraproject.org/en-US/quick-docs/
18:22:37 <nirik> we know. it's being worked on.
18:22:47 <mboddu> nirik: Haha, thats still 95% identical (if we can also complete super super hard stuff) which is the best we have ever been :)
18:22:54 <nirik> mobrien[m]: I can't find that one in dns... odd.
18:24:05 <nirik> mobrien[m]: I'd say just remove it.
18:24:40 <mobrien[m]> Ok will do. I'll give the playbook a run then and see does that fix it. Thanks
18:25:21 <nirik> cool. Hope so
18:25:57 <nirik> ok, thanks for coming everyone
18:25:59 <nirik> #endmeeting