18:01:09 #startmeeting Fedora Infrastructure Ops Daily Standup Meeting 18:01:09 Meeting started Fri Jul 31 18:01:09 2020 UTC. 18:01:09 This meeting is logged and archived in a public location. 18:01:09 The chair is nirik. Information about MeetBot at http://wiki.debian.org/MeetBot. 18:01:09 Useful Commands: #action #agreed #halp #info #idea #link #topic. 18:01:09 The meeting name has been set to 'fedora_infrastructure_ops_daily_standup_meeting' 18:01:09 #chair mboddu nirik smooge pingou 18:01:09 Current chairs: mboddu nirik pingou smooge 18:01:09 #meetingname fedora_infrastructure_ops_daily_standup_meeting 18:01:09 #info meeting is 30 minutes MAX. At the end of 30, its stops 18:01:09 The meeting name has been set to 'fedora_infrastructure_ops_daily_standup_meeting' 18:01:10 #info agenda is at https://board.net/p/fedora-infra-daily 18:01:11 #topic Tickets needing review 18:01:12 #info https://pagure.io/fedora-infrastructure/issues?status=Open&priority=1 18:01:17 hello 18:01:19 got it, just takes a while to load. ;) 18:01:25 * mboddu is here 18:01:42 .ticket 9184 18:01:43 nirik: Issue #9184: Flatpak build: Unable to fetch manifest list or v2 schema 2 digest for registry.fedoraproject.org/flatpak-build-base:latest - fedora-infrastructure - Pagure.io - https://pagure.io/fedora-infrastructure/issue/9184 18:01:58 this might be related to 9175... 18:02:21 Could be 18:02:22 proposed: ask them to resubmit and see if it works, close in favor of 9175? 18:02:57 Or maybe not 18:03:05 pagure.issue.edit -- smooge edited the close_status and status fields of ticket fedora-infrastructure#9184 https://pagure.io/fedora-infrastructure/issue/9184 18:03:06 pagure.issue.tag.added -- smooge tagged ticket fedora-infrastructure#9184: groomed, medium-gain, and medium-trouble https://pagure.io/fedora-infrastructure/issue/9184 18:03:07 pagure.issue.edit -- smooge edited the priority fields of ticket fedora-infrastructure#9184 https://pagure.io/fedora-infrastructure/issue/9184 18:03:08 pagure.issue.comment.added -- smooge commented on ticket fedora-infrastructure#9184: "Flatpak build: Unable to fetch manifest list or v2 schema 2 digest for registry.fedoraproject.org/flatpak-build-base:latest" https://pagure.io/fedora-infrastructure/issue/9184#comment-668419 18:03:30 thats all in needs-review on infra side. 18:03:33 #9175 reporter is the only one who got hit with that issue both the times when I was oncall 18:03:40 Maybe its regional 18:03:58 releng has an unretirement request, but thats it 18:04:12 hard to tell too much from just 2 datapoints tho. ;( 18:04:23 i will be finishing some tickets off by monday 18:04:23 Right 18:04:29 smooge++ 18:05:03 mboddu: anything on releng side? 18:05:04 nirik, yesterday all the hosts that I could get into were moved onto proper vlans.. so its just a matter of reinstalls or changing ips.. 18:05:10 nirik: none 18:06:03 smooge: did we test the external ip mapping for proxy01/10 stg? was that setup, or not yet? 18:06:25 I've been slowly rebooting s390x builders... it might be helping them be faster. 18:06:27 I did not test it. I didn't know if the proxy had been deployed 18:08:08 proxy01.stg does exist. 18:08:17 I can try testing later today 18:08:34 I'm also hoping to have stg openshift up today... 18:08:45 and the answer is it doesn't work 18:08:46 and then we can start on noggin deployment 18:08:58 so it will be something I will work with matt on Monday to fix 18:08:59 ah, bummer. ;( 18:09:05 ok 18:09:30 any other blockers or prs or items to discuss? 18:09:38 not for me. 18:09:54 due to the slow s390x builders, mass rebuild has been slow to finish. 18:09:57 When do we expect stg to be fully functional? 18:10:15 (Or whatever it was before dc move) 18:10:36 stg was never fully functional ;) 18:10:40 mboddu: hard to say. we need opneshift, proxies, noggin, then we need to figure out how ssh and sudo work in the grand new noggin world, then we can just start deploying the rest... should be pretty easy from there. 18:11:03 right, we never had 100% coverage... thats really hard to get 18:11:13 nirik: okay, thanks for the update 18:11:24 And thanks for bringing up the s390x slowness 18:11:48 And we need to run more rebuilds after this (failed s390x builds and LTO builds) 18:12:35 yeah. are you or jednorozec able to do that later today/this weekend? or not until monday? would be good to get it done and over with 18:13:12 nirik: jednorozec is planning on running it tomorrow, if he is not around, I will run it tomorrow 18:13:20 Today seems to be a fetch 18:13:36 There are still ~300 builds to finish 18:14:01 ~250 now 18:14:05 yeah, although that might be getting faster after reboots 18:14:10 Maybe its doable today itself, but not sure 18:14:36 either way, thanks to you both. ;) I'll be around and watching things too. 18:14:44 ok, if nothing else will close out in a min 18:15:33 thanks mboddu and smooge 18:15:35 #endmeeting