18:00:12 <smooge> #startmeeting Fedora Infrastructure Ops Daily Standup Meeting
18:00:12 <zodbot> Meeting started Tue Jun 16 18:00:12 2020 UTC.
18:00:12 <zodbot> This meeting is logged and archived in a public location.
18:00:12 <zodbot> The chair is smooge. Information about MeetBot at http://wiki.debian.org/MeetBot.
18:00:12 <zodbot> Useful Commands: #action #agreed #halp #info #idea #link #topic.
18:00:12 <zodbot> The meeting name has been set to 'fedora_infrastructure_ops_daily_standup_meeting'
18:00:13 <smooge> #chair cverna mboddu nirik smooge
18:00:13 <smooge> #meetingname fedora_infrastructure_ops_daily_standup_meeting
18:00:13 <smooge> #info meeting is 30 minutes MAX. At the end of 30, its stops
18:00:13 <zodbot> Current chairs: cverna mboddu nirik smooge
18:00:13 <zodbot> The meeting name has been set to 'fedora_infrastructure_ops_daily_standup_meeting'
18:00:13 <smooge> #info agenda is at https://board.net/p/fedora-infra-daily
18:00:14 <smooge> #topic Tickets needing review
18:00:17 <smooge> #info https://pagure.io/fedora-infrastructure/issues?status=Open&priority=1
18:00:28 <nirik> sure
18:00:37 <smooge> or did we move it and I am int eh wrong channel?
18:00:47 <nirik> no, we didn't... we talked about it, but didn't
18:01:03 <smooge> ok hello everyone. I hope you all are well
18:01:10 <smooge> we start off with an old old ticket
18:01:29 <smooge> .ticket 8871
18:01:30 <zodbot> smooge: Issue #8871: [CI] Rawhide updates stuck in testing - fedora-infrastructure - Pagure.io - https://pagure.io/fedora-infrastructure/issue/8871
18:01:34 <nirik> you want to run the tickets today smooge ? fine by me... I can modify?
18:01:38 * mboddu here
18:01:41 <smooge> sure
18:02:03 <pingou> /
18:02:27 <smooge> I guess wait on assignee? Also when does cverna move to his new manager role and should someone look to take this over?
18:02:55 <nirik> not sure.
18:03:00 <fm-admin> pagure.issue.tag.added -- kevin tagged ticket fedora-infrastructure#8871: bodhi, groomed, and 2 others https://pagure.io/fedora-infrastructure/issue/8871
18:03:01 <fm-admin> pagure.issue.edit -- kevin edited the priority fields of ticket fedora-infrastructure#8871 https://pagure.io/fedora-infrastructure/issue/8871
18:03:01 <pingou> end of the month
18:03:22 <smooge> .ticket 9031
18:03:23 <zodbot> smooge: Issue #9031: review-stats script cronjob timing issue - fedora-infrastructure - Pagure.io - https://pagure.io/fedora-infrastructure/issue/9031
18:03:46 <nirik> ha ha. I see what happened here.
18:03:50 <nirik> openshift-prod-reviewstats       1Gi        RWX            Retain           Bound      messaging-bridges/openshift-prod-reviewstats                                   23h
18:04:00 <nirik> messaging-bridges grabbed the wrong pv
18:04:17 <nirik> I'll sort it out after meeting.
18:04:31 <smooge> groomed openshift waiting-on-nirik
18:04:45 <fm-admin> pagure.issue.tag.added -- kevin tagged ticket fedora-infrastructure#9031: OpenShift, groomed, and 2 others https://pagure.io/fedora-infrastructure/issue/9031
18:04:46 <fm-admin> pagure.issue.edit -- kevin edited the priority fields of ticket fedora-infrastructure#9031 https://pagure.io/fedora-infrastructure/issue/9031
18:04:57 <smooge> .ticket 9035
18:04:58 <zodbot> smooge: Issue #9035: redo maintainer-test instances with large / partition - fedora-infrastructure - Pagure.io - https://pagure.io/fedora-infrastructure/issue/9035
18:05:10 <nirik> mobrien[m]: was working on this. I need to answer his questions
18:05:47 <smooge> low-trouble medium-reward groomed waiting-on-requestor
18:06:39 <nirik> +1
18:06:42 <fm-admin> pagure.issue.tag.added -- kevin tagged ticket fedora-infrastructure#9035: groomed, low-trouble, and medium-gain https://pagure.io/fedora-infrastructure/issue/9035
18:06:43 <fm-admin> pagure.issue.edit -- kevin edited the priority fields of ticket fedora-infrastructure#9035 https://pagure.io/fedora-infrastructure/issue/9035
18:06:44 <fm-admin> pagure.issue.comment.added -- kevin commented on ticket fedora-infrastructure#9035: "redo maintainer-test instances with large / partition" https://pagure.io/fedora-infrastructure/issue/9035#comment-658599
18:07:00 <smooge> .ticket 9036
18:07:01 <zodbot> smooge: Issue #9036: FAS2 is broken on various IAD2 hosts - fedora-infrastructure - Pagure.io - https://pagure.io/fedora-infrastructure/issue/9036
18:07:20 <nirik> so... one thing I noticed. Is this just fedora 32/rhel8?
18:07:24 <smooge> yes
18:07:34 <nirik> I can add that info to the ticket.
18:07:39 <nirik> we just need someone to dig into it.
18:08:10 <nirik> medtrouble/gain/waiting on asignee?
18:08:14 <smooge> yes
18:08:35 <smooge> need to not look up possible solutions while running the meeting :)
18:08:49 <smooge> .ticket 9037
18:08:50 <zodbot> smooge: Issue #9037: Make additional aws proxies in various regions - fedora-infrastructure - Pagure.io - https://pagure.io/fedora-infrastructure/issue/9037
18:08:59 <fm-admin> pagure.issue.tag.added -- kevin tagged ticket fedora-infrastructure#9036: authentication, groomed, and 2 others https://pagure.io/fedora-infrastructure/issue/9036
18:09:00 <fm-admin> pagure.issue.edit -- kevin edited the priority fields of ticket fedora-infrastructure#9036 https://pagure.io/fedora-infrastructure/issue/9036
18:09:01 <fm-admin> pagure.issue.comment.added -- kevin commented on ticket fedora-infrastructure#9036: "FAS2 is broken on various IAD2 hosts" https://pagure.io/fedora-infrastructure/issue/9036#comment-658601
18:09:14 <smooge> this is generally a 'resilience' and looking at how we build proxies in aws versus other places
18:10:13 * nirik has been pondering if we should drop proxies, but it's still just idle thought
18:10:56 <smooge> yeah.. it is probably something to look at
18:11:19 <smooge> low trouble, medium gain, groomed, waiitng on assignee
18:11:31 <nirik> I mean we could drop all proxies, and then just serve things like docs/websites from openshift with cloudfront in front.
18:11:33 <smooge> well getting rid of proxies is something else :)
18:11:35 <nirik> but will ponder on it more
18:11:44 <fm-admin> pagure.issue.tag.added -- kevin tagged ticket fedora-infrastructure#9037: aws, groomed, and 2 others https://pagure.io/fedora-infrastructure/issue/9037
18:11:45 <fm-admin> pagure.issue.edit -- kevin edited the priority fields of ticket fedora-infrastructure#9037 https://pagure.io/fedora-infrastructure/issue/9037
18:12:17 <smooge> nirik, I think mirrormanager would need a rethought but could run in something similar
18:12:27 <smooge> .ticket 9038
18:12:28 <zodbot> smooge: Issue #9038: Mailman is sending unauthorized fedmsgs - fedora-infrastructure - Pagure.io - https://pagure.io/fedora-infrastructure/issue/9038
18:12:38 <smooge> ok I think I fixed this one.. but I am not sure
18:13:01 <smooge> if it is still sending as phx2.fedoraproject.org i don't know where it is coded
18:13:29 <nirik> yeah, I don't see any recent ones.
18:13:38 <nirik> just these: 2020-06-16 18:13:24 [fedmsg.crypto.utils WARNING] No routing policy defined for "org.fedoraproject.prod.github.check_run" but routing_nitpicky is False so the message is being treated as authorized.
18:14:27 <smooge> closed as fixed
18:14:49 <nirik> ok.
18:14:57 <nirik> hum, might have been looking at the wrong one
18:15:01 <smooge> oh
18:15:06 <smooge> well then unclosed as fixed
18:15:14 <nirik> but indeed it looks fixed.
18:15:19 <nirik> there's just other problems. ;)
18:15:23 <nirik> can file new ones on those.
18:15:33 <fm-admin> pagure.issue.edit -- kevin edited the close_status and status fields of ticket fedora-infrastructure#9038 https://pagure.io/fedora-infrastructure/issue/9038
18:15:34 <fm-admin> pagure.issue.comment.added -- kevin commented on ticket fedora-infrastructure#9038: "Mailman is sending unauthorized fedmsgs" https://pagure.io/fedora-infrastructure/issue/9038#comment-658604
18:15:51 <smooge> .ticket 9040
18:15:52 <zodbot> smooge: Issue #9040: Error 503 from osbs.fedoraproject.org - fedora-infrastructure - Pagure.io - https://pagure.io/fedora-infrastructure/issue/9040
18:16:18 <nirik> no idea on this one, lets leave it for cverna.
18:16:32 <nirik> who can also hopefully show us how to check/more about it for when he's away
18:16:43 <smooge> high-trouble (move flatpaks to OBS)
18:17:19 <smooge> does flatpacks block composes?
18:17:23 <nirik> nope.
18:17:44 <smooge> high-trouble, medium-gain, waiting-on-assignee, groomed
18:17:57 <smooge> note we need to be trained on this by cverna
18:18:29 <pingou> yup
18:18:35 <fm-admin> pagure.issue.tag.added -- kevin tagged ticket fedora-infrastructure#9040: OSBS, groomed, and 2 others https://pagure.io/fedora-infrastructure/issue/9040
18:18:36 <mboddu> ack
18:18:36 <fm-admin> pagure.issue.edit -- kevin edited the priority fields of ticket fedora-infrastructure#9040 https://pagure.io/fedora-infrastructure/issue/9040
18:18:37 <fm-admin> pagure.issue.comment.added -- kevin commented on ticket fedora-infrastructure#9040: "Error 503 from osbs.fedoraproject.org" https://pagure.io/fedora-infrastructure/issue/9040#comment-658606
18:19:35 <smooge> .ticket 9041
18:19:36 <zodbot> smooge: Issue #9041: Need: Fedora 32 aarch64 vm for testing - fedora-infrastructure - Pagure.io - https://pagure.io/fedora-infrastructure/issue/9041
18:20:18 <nirik> we can try an aws one. mobrien[m] can or I can later
18:20:19 <smooge> I think you and spot talked about this while I was detailing this in ticket. Another mobrien[m] item?
18:20:26 * nirik nods
18:20:35 <smooge> low-trouble, medium-gain, groomed aws
18:21:20 <smooge> or something else?
18:21:25 <nirik> +1
18:21:28 <nb_> ack
18:21:54 <fm-admin> pagure.issue.tag.added -- kevin tagged ticket fedora-infrastructure#9041: aws, groomed, and 2 others https://pagure.io/fedora-infrastructure/issue/9041
18:21:55 <fm-admin> pagure.issue.edit -- kevin edited the priority fields of ticket fedora-infrastructure#9041 https://pagure.io/fedora-infrastructure/issue/9041
18:21:56 <fm-admin> pagure.issue.comment.added -- kevin commented on ticket fedora-infrastructure#9041: "Need: Fedora 32 aarch64 vm for testing" https://pagure.io/fedora-infrastructure/issue/9041#comment-658608
18:22:40 <smooge> .ticket 9043
18:22:44 <zodbot> smooge: An error has occurred and has been logged. Please contact this bot's administrator for more information.
18:22:54 <nirik> private
18:22:58 <smooge> ah ok that one is private
18:23:10 <smooge> ok well any releng tickets?
18:23:17 <mboddu> No new releng tickets
18:23:32 <mboddu> Oh well, there is
18:23:40 <mboddu> .releng 9532
18:23:41 <zodbot> mboddu: Issue #9532: Updates created in side-tags ejected from push - releng - Pagure.io - https://pagure.io/releng/issue/9532
18:23:47 <smooge> I will note nirik has been working on kojira problem all day also
18:24:04 <mboddu> Yeah
18:24:11 <nirik> mboddu: yeah, bodhi is still not doing something right with side tags.
18:24:17 <mboddu> Seems like its a bodhi issue, sometimes they are not tagging right
18:24:22 <nirik> and just pushing it to testing doesn't work, you need to make sure all the tags are right
18:24:30 <mboddu> Exactly
18:24:53 <mboddu> Who is going to look bodhi issues? cverna or ... ?
18:25:54 <nirik> hopefully cverna for now, but longer term not sure.
18:26:05 <mboddu> Okay, I will ping cverna in the ticket
18:26:23 <mboddu> medium-trouble, high-gain, groomed?
18:29:07 <mboddu> Okay, going with that
18:29:10 <mboddu> And 1 more
18:29:12 <nirik> yeah, sorry
18:29:21 <smooge> +1 mboddu
18:29:43 <mboddu> .releng 9531
18:29:45 <zodbot> mboddu: Issue #9531: manually retire EPEL7-only packages in PDC - releng - Pagure.io - https://pagure.io/releng/issue/9531
18:30:14 <pingou> hm?
18:30:19 <mboddu> carlwgeorge pinged me about them
18:30:31 <mboddu> Not sure why they didn't retire properly, I need to look into them
18:30:46 <mboddu> medium-trouble, medium-gain, groomed?
18:31:43 <mboddu> Okay, thats all I got
18:31:51 <nirik> ack.
18:32:18 <nirik> thanks everyone.
18:32:21 <smooge> ok well in that case.. anything else for today or time to press the button frank?
18:32:28 <smooge> #endmeeting