19:00:15 <smooge> #startmeeting Fedora Infrastructure Ops Daily Standup Meeting
19:00:15 <smooge> #chair cverna mboddu nirik smooge
19:00:15 <zodbot> Meeting started Fri Mar  6 19:00:15 2020 UTC.
19:00:15 <zodbot> This meeting is logged and archived in a public location.
19:00:15 <zodbot> The chair is smooge. Information about MeetBot at http://wiki.debian.org/MeetBot.
19:00:15 <zodbot> Useful Commands: #action #agreed #halp #info #idea #link #topic.
19:00:15 <zodbot> The meeting name has been set to 'fedora_infrastructure_ops_daily_standup_meeting'
19:00:15 <zodbot> Current chairs: cverna mboddu nirik smooge
19:00:15 <smooge> #info meeting is 30 minutes MAX. At the end of 30, its stops
19:00:15 <smooge> #info agenda is at https://board.net/p/fedora-infra-daily
19:00:16 <smooge> #topic Tickets needing review
19:00:17 <smooge> #info https://pagure.io/fedora-infrastructure/issues?status=Open&priority=1
19:00:47 <nirik> morning
19:01:06 <nirik> what is this deviltry! no needs reviews?
19:01:42 <smooge> I took the one which was there
19:02:01 <smooge> I am trying to figure out why retrace-stg.aws.fedoraproject.org can't connect to admin.stg.fedoraproject.org
19:02:01 <nirik> ok, any we wish to discuss?
19:02:23 <nirik> odd, it should be able to...
19:02:49 <smooge> for some reason it times out
19:03:39 <smooge> .ticket 8727
19:03:40 <zodbot> smooge: Issue #8727: retrace-stg.aws cannot reach admin.stg.fedoraproject.org - fedora-infrastructure - Pagure.io - https://pagure.io/fedora-infrastructure/issue/8727
19:04:53 <fm-admin> pagure.issue.comment.added -- fbo commented on ticket fedora-ci/general#88: "Enable CI pipelines for epel8 packages" https://pagure.io/fedora-ci/general/issue/88#comment-631288
19:05:05 * cverna is around
19:05:54 <nirik> cverna: was going to ask... should we schedule a retrospective sometime? replace this on a friday or something sometime?
19:06:14 <nirik> smooge: does tcpdump on proxy01.stg see the packets arrive?
19:06:20 <smooge> it is weird.. I can get to proxy01.fedoraproject.org and stg.fedoraproject.org but going to admin.stg.fedoraproject.org or admin.fedoraproject.org times out
19:06:43 <smooge> so curl -4 https://stg.fedoraproject.org works but curl -4 admin.stg.fedoraproject.org does not
19:07:01 <nirik> smooge: look in /etc/hosts on retrace.stg ;)
19:07:17 <cverna> nirik: yeah I wanted to check with sarah first, I ll catch up with her next week
19:07:21 <smooge> son of a bitcoin
19:07:29 <smooge> thanks
19:07:35 <smooge> I have been trying all kinds of things
19:07:58 <nirik> cverna: sounds good. perhaps after beta is out?
19:08:33 <fm-admin> pagure.issue.comment.added -- smooge commented on ticket fedora-infrastructure#8727: "retrace-stg.aws cannot reach admin.stg.fedoraproject.org" https://pagure.io/fedora-infrastructure/issue/8727#comment-631289
19:08:34 <cverna> yeah sounds good
19:09:31 <nirik> I'm fine doing it early my time to so everyone can be on... I'd love more imput from the other timezone folks
19:10:13 <nirik> .ticket 8648
19:10:15 <zodbot> nirik: Issue #8648: Koji task info pages load very slowly - fedora-infrastructure - Pagure.io - https://pagure.io/fedora-infrastructure/issue/8648
19:10:18 <cverna> +1 we can try to have it around the team call so everyone is around
19:10:33 <nirik> so, no new reports here... should we ask people for more info?
19:10:56 <nirik> including asking them to tell us the time it happened, because... I am not sure what we can do without more detailed info
19:12:12 <cverna> +1
19:12:16 <nirik> as far as I can tell it's responsive, even during backups (although I don't check much then)
19:13:22 <nirik> so more info? I can ask
19:14:09 <cverna> yes let's ask for more info and if we don't get any let's close
19:14:36 <fm-admin> pagure.issue.comment.added -- kevin commented on ticket fedora-infrastructure#8648: "Koji task info pages load very slowly" https://pagure.io/fedora-infrastructure/issue/8648#comment-631293
19:14:43 <nirik> sounds good
19:15:29 <nirik> .ticket 8549
19:15:31 <zodbot> nirik: Issue #8549: Move retrace.fedoraproject.org to letsencrypt - fedora-infrastructure - Pagure.io - https://pagure.io/fedora-infrastructure/issue/8549
19:15:37 <nirik> is this one done? smooge: do you know? ^
19:15:57 <fm-admin> pagure.issue.edit -- smooge edited the close_status and status fields of ticket fedora-infrastructure#8549 https://pagure.io/fedora-infrastructure/issue/8549
19:16:01 <smooge> i believe so
19:16:05 <smooge> I have closed it
19:16:36 <nirik> cool.
19:16:52 <nirik> .releng 9293
19:16:53 <zodbot> nirik: Issue #9293: Fix koji/bodhi in staging - releng - Pagure.io - https://pagure.io/releng/issue/9293
19:17:03 <nirik> we should do this, but when and who? ;)
19:17:39 <cverna> yeah we were suppose to sync with mboddu, so either we can do a quick fix or take a bit more time and have something we can reuse next time
19:17:58 <fm-admin> pagure.issue.edit -- smooge edited the close_status and status fields of ticket fedora-infrastructure#8727 https://pagure.io/fedora-infrastructure/issue/8727
19:17:59 <fm-admin> pagure.issue.comment.added -- smooge commented on ticket fedora-infrastructure#8727: "retrace-stg.aws cannot reach admin.stg.fedoraproject.org" https://pagure.io/fedora-infrastructure/issue/8727#comment-631297
19:18:30 <cverna> one of the more time solution would be to move the branching script to an ansible playbook or have it to do prod and staging at the same time
19:18:46 <nirik> yeah, that would be a lot more work, but helpfull for prod...
19:19:05 <nirik> also tho it would mean prod and stg would diverge... so perhaps we need both...
19:19:30 <cverna> yes
19:19:31 <fm-admin> pagure.issue.comment.added -- smooge commented on ticket fedora-infrastructure#8549: "Move retrace.fedoraproject.org to letsencrypt" https://pagure.io/fedora-infrastructure/issue/8549#comment-631307
19:19:37 <nirik> most of the time just sync prod->stg and tweak things... but also sometimes do the full branching to make sure it works in stg, then do it prod
19:20:22 <nirik> .releng 9246
19:20:23 <zodbot> nirik: Issue #9246: Please block `fedora-cisco-openh264` from pungi composes - releng - Pagure.io - https://pagure.io/releng/issue/9246
19:20:26 <smooge> I have to step away from keyboard ofr a couple of minutes
19:20:33 <nirik> mboddu: ^ I think thats done, can you close it if so...
19:20:35 <cverna> if we had an ansible playbook, would we have it run on local machine or would we have a ansible host ?
19:21:08 <nirik> cverna: I would think it could just be one of the playbooks/manual/ ones and we run it on batcave, but yeah, I guess it could run remote for most of it.
19:22:17 <nirik> thats all I had off hand for today (and I have a meeting in 8min I need to get coffee before)
19:22:23 <nirik> anything else from anyone?
19:22:38 <cverna> I am good
19:23:13 <nirik> thanks smooge / cverna / zodbot :)
19:23:16 <nirik> #endmeeting