19:00:48 <smooge> #startmeeting Fedora Infrastructure Ops Daily Standup Meeting 19:00:48 <zodbot> Meeting started Mon Feb 3 19:00:48 2020 UTC. 19:00:48 <zodbot> This meeting is logged and archived in a public location. 19:00:48 <zodbot> The chair is smooge. Information about MeetBot at http://wiki.debian.org/MeetBot. 19:00:48 <zodbot> Useful Commands: #action #agreed #halp #info #idea #link #topic. 19:00:48 <zodbot> The meeting name has been set to 'fedora_infrastructure_ops_daily_standup_meeting' 19:00:48 <smooge> #chair smooge nirik relrod cverna 19:00:48 <zodbot> Current chairs: cverna nirik relrod smooge 19:00:48 <smooge> #info meeting is 30 minutes MAX. At the end of 30, its stops 19:00:48 <smooge> #info agenda is at https://board.net/p/fedora-infra-daily 19:00:48 <smooge> #topic Tickets needing review 19:01:04 <nirik> so, there's not any in needs review it looks like? 19:01:17 * relrod waves 19:01:17 <nirik> but there's a ton that have come in since our last standup... 19:01:25 <nirik> so I would like to go over those real quick 19:01:34 <smooge> wow 19:01:46 * relrod sits down for the stand up, breaks all the rules 19:01:57 <nirik> .ticket 8525 19:01:58 <zodbot> nirik: Issue #8525: Can't kinit for stg.fedoraproject.org - fedora-infrastructure - Pagure.io - https://pagure.io/fedora-infrastructure/issue/8525 19:02:02 <cverna> o/ 19:02:52 <nirik> no word here... close and ask them to reopen if it still happens? 19:02:58 <relrod> +1 19:03:10 <cverna> I think relrod fixed that for asaleh in brno 19:03:20 <fm-admin> pagure.issue.edit -- smooge edited the close_status and status fields of ticket fedora-infrastructure#8525 https://pagure.io/fedora-infrastructure/issue/8525 19:03:21 <fm-admin> pagure.issue.comment.added -- smooge commented on ticket fedora-infrastructure#8525: "Can't kinit for stg.fedoraproject.org" https://pagure.io/fedora-infrastructure/issue/8525#comment-624163 19:03:30 <relrod> cverna: different issue I think 19:03:36 <cverna> it was a miss match between prod and stg 19:03:50 <nirik> .ticket 8528 19:03:51 <zodbot> nirik: Issue #8528: Missing developer toolset rpms for koji EPEL7 build environment - fedora-infrastructure - Pagure.io - https://pagure.io/fedora-infrastructure/issue/8528 19:04:02 <cverna> relrod: oh ok the error message is the same tho kinit: Client 'zbyszek@STG.FEDORAPROJECT.ORG' not found in Kerberos database while getting initial credentials 19:04:05 <relrod> the issue was "stg fas db was synced over so fas thinks it doesn't have to create an IPA account, but stg IPA had no account" 19:04:06 <nirik> smooge: what was the status on this one? 19:04:22 <relrod> s/stg/prod/ 19:04:26 <cverna> relrod: ok 19:05:26 <nirik> .ticket 8537 19:05:27 <zodbot> nirik: Issue #8537: RFR: deploy coreos-cincinnati to prod cluster - fedora-infrastructure - Pagure.io - https://pagure.io/fedora-infrastructure/issue/8537 19:06:09 <cverna> I think we can close that, they can proceed when they wish ? 19:06:16 <nirik> so this is all fine I think... I guess they want to keep the ticket to track app-owners ack? 19:06:23 <nirik> yeah, unclear... 19:06:41 <cverna> let's ping them to see if they are waiting on something else 19:06:44 <cverna> I can do it 19:06:47 <nirik> ok. 19:07:02 <fm-admin> pagure.issue.comment.added -- smooge commented on ticket fedora-infrastructure#8537: "RFR: deploy coreos-cincinnati to prod cluster" https://pagure.io/fedora-infrastructure/issue/8537#comment-624165 19:07:13 <smooge> oops sorry cverna 19:07:16 <nirik> .ticket 8546 19:07:17 <zodbot> nirik: Issue #8546: [fedora messaging] Not consuming any messages from /public_pubsub - fedora-infrastructure - Pagure.io - https://pagure.io/fedora-infrastructure/issue/8546 19:07:45 <fm-admin> pagure.issue.comment.added -- cverna commented on ticket fedora-infrastructure#8537: "RFR: deploy coreos-cincinnati to prod cluster" https://pagure.io/fedora-infrastructure/issue/8537#comment-624166 19:07:50 <cverna> smooge: no problem :) 19:08:00 <nirik> this looks like it's waiting on meeting between abompard and jpopelka... I guess leave it for now? 19:08:27 <cverna> yes 19:08:37 <cverna> let's wait a little bit more 19:08:47 <nirik> .ticket 8547 19:08:48 <zodbot> nirik: Issue #8547: Rack and install servers for QA - fedora-infrastructure - Pagure.io - https://pagure.io/fedora-infrastructure/issue/8547 19:09:07 <nirik> smooge: can you add exactly what hardware we have here? otherwise just needs working on. 19:09:30 <smooge> will do so 19:09:50 <nirik> smooge: also status on 8528 when you get a chance. 19:10:00 <nirik> .ticket 8549 19:10:01 <zodbot> nirik: Issue #8549: Move retrace.fedoraproject.org to letsencrypt - fedora-infrastructure - Pagure.io - https://pagure.io/fedora-infrastructure/issue/8549 19:10:30 <nirik> retrace does not use proxies. 19:10:39 <nirik> but it could use certgetter still... 19:10:47 <fm-admin> pagure.issue.comment.added -- smooge commented on ticket fedora-infrastructure#8547: "Rack and install servers for QA" https://pagure.io/fedora-infrastructure/issue/8547#comment-624167 19:11:24 <nirik> it needs a rewrite/proxy to certgetter for the challenge. 19:12:20 <nirik> pagure does this: roles/pagure/frontend/templates/0_pagure.conf 19:12:21 <smooge> nirik, I had seen something in keys.fedoraproject.org for cert 19:12:29 <nirik> yeah, keys might also. 19:12:30 <smooge> and that 19:12:42 <smooge> but keys is broke 19:12:53 <nirik> but actually that won't work either. 19:13:11 <nirik> retrace is also not on the vpn, so it can't talk to certgetter01 via that 19:14:07 <nirik> ah, planet does this... 19:14:09 <nirik> RewriteEngine on 19:14:09 <nirik> RewriteRule ^/\.well-known/(.*) "http://fedoraproject.org/\.well-known/$1" [L,R=301,NE] 19:14:12 <nirik> that should work 19:14:24 <nirik> does someone want to do this one? 19:14:32 <nirik> or should I just take it? 19:14:54 <cverna> I think an apprentice submitted a patch 19:15:00 <nirik> or we can add info and the person who supplied the one patch can try and do the rest? 19:15:07 <nirik> yeah, but it's not enough 19:15:12 <cverna> we could add the few pointers there for them to contniue 19:15:17 * nirik nods. 19:15:19 <cverna> continue* 19:15:25 <cverna> +1 19:15:28 <nirik> can someone update the ticket with this info? 19:15:39 <cverna> yup 19:15:58 <nirik> thanks 19:16:02 <nirik> .ticket 8558 19:16:03 <zodbot> nirik: Issue #8558: EL8 libssh2 - fedora-infrastructure - Pagure.io - https://pagure.io/fedora-infrastructure/issue/8558 19:16:05 <smooge> thanks cverna 19:16:47 <nirik> so on this... should we just filter out all the modular packages from being part of rhel8? 19:16:49 <smooge> honestly I thought this was more releng versus infrastructure but it is all one thing 19:17:12 <nirik> yeah, it's a bit tangled here 19:17:53 <smooge> we could do that. I expect that might allow for all kinds of 'neat' things into EPEL 19:18:08 <nirik> I guess it comes down to what epel agrees to not overlap with 19:18:23 <smooge> i have had negative time to spend on looking at anything with EPEL and probably won' 19:18:24 <nirik> I think we said modules can be overlapping so epel could provide different versions? 19:18:27 <smooge> t until after the move 19:18:57 <smooge> yeah someone could make a module with libssh2 in it. However this isn't as much a case of that as much as like ansible 19:19:00 <nirik> basically this ticket comes down to use adjusting our json thing to agree with whatever epel sig decides is policy right? 19:19:05 <fm-admin> pagure.issue.comment.added -- cverna commented on ticket fedora-infrastructure#8549: "Move retrace.fedoraproject.org to letsencrypt" https://pagure.io/fedora-infrastructure/issue/8549#comment-624168 19:19:12 <smooge> where ansible 'is in' RHEL-7 but it is also not in 19:19:39 <smooge> so I was thinking that whatever exception we did for that was needed 19:19:43 <nirik> well, in this case there's no non modular libssh2... 19:19:55 <nirik> libssh2 is all modular right? 19:20:15 <smooge> libssh2 is in a module which was in 8.0 The 8.1 version does not have that in it 19:20:32 <smooge> so virt-devel in 8.0 had libssh2 and 8.1 it does not 19:20:46 <nirik> proposal: ask submittor to take issue to epel-devel list, get consensus, come back and tell us what to adjust in the tool? 19:20:53 <smooge> ok 19:21:06 <cverna> +1 19:21:09 <nirik> yeah, but even in 8.0... couldn't epel have provided a different version since this one was a module? 19:21:21 <nirik> or are we saying anything thats a module can't be also in epel. 19:21:28 <nirik> but I digress... 19:21:47 <fm-admin> pagure.issue.comment.added -- smooge commented on ticket fedora-infrastructure#8558: "EL8 libssh2" https://pagure.io/fedora-infrastructure/issue/8558#comment-624169 19:21:50 <nirik> .ticket 8559 19:21:51 <zodbot> nirik: Issue #8559: Request for mailing list etc. for DeepinDE SIG - fedora-infrastructure - Pagure.io - https://pagure.io/fedora-infrastructure/issue/8559 19:22:31 <nirik> I think this is done. copr reads groups from fas on login, so it should be there already 19:22:55 <nirik> proposal: close. 19:22:56 <cverna> lets close it can be reopen if there is a problem 19:23:12 <nirik> .ticket 8564 19:23:12 <cverna> on it 19:23:13 <zodbot> nirik: Issue #8564: registry.fp.o will soon run out of space - fedora-infrastructure - Pagure.io - https://pagure.io/fedora-infrastructure/issue/8564 19:23:40 <nirik> I can just do this one now. 19:23:43 <fm-admin> pagure.issue.edit -- cverna edited the close_status and status fields of ticket fedora-infrastructure#8559 https://pagure.io/fedora-infrastructure/issue/8559 19:23:44 <fm-admin> pagure.issue.comment.added -- cverna commented on ticket fedora-infrastructure#8559: "Request for mailing list etc. for DeepinDE SIG" https://pagure.io/fedora-infrastructure/issue/8559#comment-624170 19:23:54 <cverna> +1 thanks 19:24:11 <nirik> is it just the one volume? 19:24:20 <cverna> yes 19:24:51 <nirik> ntap-phx2-c01-fedora01::> df -h oci_registry 19:24:51 <nirik> Filesystem total used avail capacity Mounted on 19:24:51 <nirik> /vol/oci_registry/ 285GB 234GB 50GB 82% /oci_registry 19:25:07 <cverna> yes that's the one 19:25:11 <nirik> ntap-phx2-c01-fedora01::> volume modify -volume oci_registry -size 600GB 19:25:21 <nirik> ntap-phx2-c01-fedora01::> df -h oci_registry 19:25:21 <nirik> Filesystem total used avail capacity Mounted on 19:25:21 <nirik> /vol/oci_registry/ 570GB 234GB 335GB 41% /oci_registry 19:25:25 <nirik> done 19:25:31 <cverna> nice and easy :) 19:25:58 <fm-admin> pagure.issue.edit -- kevin edited the close_status and status fields of ticket fedora-infrastructure#8564 https://pagure.io/fedora-infrastructure/issue/8564 19:25:59 <fm-admin> pagure.issue.comment.added -- kevin commented on ticket fedora-infrastructure#8564: "registry.fp.o will soon run out of space" https://pagure.io/fedora-infrastructure/issue/8564#comment-624172 19:26:09 <nirik> .ticket 8565 19:26:10 <zodbot> nirik: Issue #8565: Freshmaker CI stuck - fedora-infrastructure - Pagure.io - https://pagure.io/fedora-infrastructure/issue/8565 19:26:34 <cverna> we need a CI person on that 19:26:37 <nirik> still seems stuck, lets leave open for them to look? 19:26:53 <cverna> +1 19:26:57 <nirik> might be good if this is ongoing to get a few of us fedora shmoes access to unstick things? 19:27:11 <nirik> .ticket 8568 19:27:12 <zodbot> nirik: Issue #8568: New pkgdb group request - fedora-infrastructure - Pagure.io - https://pagure.io/fedora-infrastructure/issue/8568 19:27:37 <nirik> so I think we do have a SOP... let me look. 19:28:20 <cverna> I remember trying to look for it but I might be wrong 19:28:43 <nirik> yeah, I am not seeing it, but I could have sworn pingou wrote one. ;( 19:29:15 <cverna> I ll check with pingou tomorrow and try to get this moving 19:29:25 <smooge> i need to put in tickets for renewing certs for *.fedorahosted.org, *.fedoraproject.org, fedoramagazine.org, fedoracommunity.org 19:29:31 <nirik> ok. yeah, and we should maake a sop if we can't find the old one 19:29:32 <smooge> got pinged on that 19:29:34 <fm-admin> pagure.issue.comment.added -- mattia commented on ticket fedora-infrastructure#5315: "New package review tickets page - RFE for ON_QA" https://pagure.io/fedora-infrastructure/issue/5315#comment-624174 19:30:00 <nirik> .ticket 8579 19:30:01 <zodbot> nirik: Issue #8579: Update regindexer to handle metadata-in-labels - fedora-infrastructure - Pagure.io - https://pagure.io/fedora-infrastructure/issue/8579 19:30:08 <nirik> cverna: you are working this one? 19:30:14 <cverna> I am currently working on this 19:30:31 <nirik> .ticket 8587 19:30:32 <zodbot> nirik: Issue #8587: start.fpo is not updating - fedora-infrastructure - Pagure.io - https://pagure.io/fedora-infrastructure/issue/8587 19:30:41 <nirik> relrod: ^ you have any ideas on this one? 19:30:59 * relrod looks up 19:31:01 <cverna> This looks fixed to me but misc said to wait 19:31:12 <nirik> .ticket 8595 19:31:16 <zodbot> nirik: Issue #8595: Jenkins seems to be out of space - fedora-infrastructure - Pagure.io - https://pagure.io/fedora-infrastructure/issue/8595 19:31:22 <nirik> this needs ci folks again... 19:31:33 <cverna> just fyi we are 1 min past 30min 19:31:33 <nirik> .ticket 8597 19:31:34 <zodbot> nirik: Issue #8597: Add mattia to the github fedora-infra organization and bodhi team - fedora-infrastructure - Pagure.io - https://pagure.io/fedora-infrastructure/issue/8597 19:31:40 <nirik> I can do this one now. 19:31:45 <cverna> thanks :) 19:31:45 * nirik has 2 more. 19:31:54 <cverna> let's go for them 19:32:03 <nirik> .ticket 8600 19:32:04 <zodbot> nirik: Issue #8600: All maintainers should be removed from retired packages eventually. - fedora-infrastructure - Pagure.io - https://pagure.io/fedora-infrastructure/issue/8600 19:32:16 <nirik> this is a discussion ticket. I hate discussion tickets. 19:32:17 <relrod> yeah 8587 looks fixed to me? https://start.fedoraproject.org/ has a thing from today on it 19:33:14 <cverna> nirik: yeah this will probably end up sitting there for years :P 19:33:44 <nirik> I guess we can chime in on 8600, but IMHO discussion should be on devel list or so, until a consensus is found. 19:33:59 <nirik> .ticket 8601 19:34:00 <zodbot> nirik: Issue #8601: Please unblock gnome-desktop - fedora-infrastructure - Pagure.io - https://pagure.io/fedora-infrastructure/issue/8601 19:34:10 <nirik> this is a releng ticket... 19:35:16 <nirik> so, close and ask to refile in releng. 19:35:23 <nirik> and thats the last one 19:35:46 <cverna> I ll do it for 8601 19:36:50 <smooge> so on 8600. I am going to say this needs to go to devel list and FESCO and not infrastructure 19:36:53 <nirik> smooge: file a new ticket on the certs... we might consider letting fedorahosted die... and fedoramagazine.org isn't controlled by us anymore, so we should ask misc about it. 19:37:10 <smooge> we will implement the policy that is decided by that 19:37:38 <smooge> I am also on the 'this is not a place to have a discussion.' 19:37:44 <fm-admin> pagure.issue.comment.added -- cverna commented on ticket fedora-infrastructure#8601: "Please unblock gnome-desktop" https://pagure.io/fedora-infrastructure/issue/8601#comment-624175 19:37:50 <fm-admin> pagure.issue.edit -- cverna edited the close_status and status fields of ticket fedora-infrastructure#8601 https://pagure.io/fedora-infrastructure/issue/8601 19:38:43 <fm-admin> pagure.issue.edit -- kevin edited the close_status and status fields of ticket fedora-infrastructure#8597 https://pagure.io/fedora-infrastructure/issue/8597 19:38:44 <fm-admin> pagure.issue.comment.added -- kevin commented on ticket fedora-infrastructure#8597: "Add mattia to the github fedora-infra organization and bodhi team" https://pagure.io/fedora-infrastructure/issue/8597#comment-624177 19:40:08 <nirik> so, close out? 19:40:12 <nirik> we are 10min over. ;( 19:40:37 <fm-admin> pagure.issue.comment.added -- smooge commented on ticket fedora-infrastructure#8600: "All maintainers should be removed from retired packages eventually." https://pagure.io/fedora-infrastructure/issue/8600#comment-624179 19:40:41 <cverna> yes let's close 19:40:46 <cverna> #endmeeting