19:00:48 #startmeeting Fedora Infrastructure Ops Daily Standup Meeting 19:00:48 Meeting started Mon Feb 3 19:00:48 2020 UTC. 19:00:48 This meeting is logged and archived in a public location. 19:00:48 The chair is smooge. Information about MeetBot at http://wiki.debian.org/MeetBot. 19:00:48 Useful Commands: #action #agreed #halp #info #idea #link #topic. 19:00:48 The meeting name has been set to 'fedora_infrastructure_ops_daily_standup_meeting' 19:00:48 #chair smooge nirik relrod cverna 19:00:48 Current chairs: cverna nirik relrod smooge 19:00:48 #info meeting is 30 minutes MAX. At the end of 30, its stops 19:00:48 #info agenda is at https://board.net/p/fedora-infra-daily 19:00:48 #topic Tickets needing review 19:01:04 so, there's not any in needs review it looks like? 19:01:17 * relrod waves 19:01:17 but there's a ton that have come in since our last standup... 19:01:25 so I would like to go over those real quick 19:01:34 wow 19:01:46 * relrod sits down for the stand up, breaks all the rules 19:01:57 .ticket 8525 19:01:58 nirik: Issue #8525: Can't kinit for stg.fedoraproject.org - fedora-infrastructure - Pagure.io - https://pagure.io/fedora-infrastructure/issue/8525 19:02:02 o/ 19:02:52 no word here... close and ask them to reopen if it still happens? 19:02:58 +1 19:03:10 I think relrod fixed that for asaleh in brno 19:03:20 pagure.issue.edit -- smooge edited the close_status and status fields of ticket fedora-infrastructure#8525 https://pagure.io/fedora-infrastructure/issue/8525 19:03:21 pagure.issue.comment.added -- smooge commented on ticket fedora-infrastructure#8525: "Can't kinit for stg.fedoraproject.org" https://pagure.io/fedora-infrastructure/issue/8525#comment-624163 19:03:30 cverna: different issue I think 19:03:36 it was a miss match between prod and stg 19:03:50 .ticket 8528 19:03:51 nirik: Issue #8528: Missing developer toolset rpms for koji EPEL7 build environment - fedora-infrastructure - Pagure.io - https://pagure.io/fedora-infrastructure/issue/8528 19:04:02 relrod: oh ok the error message is the same tho kinit: Client 'zbyszek@STG.FEDORAPROJECT.ORG' not found in Kerberos database while getting initial credentials 19:04:05 the issue was "stg fas db was synced over so fas thinks it doesn't have to create an IPA account, but stg IPA had no account" 19:04:06 smooge: what was the status on this one? 19:04:22 s/stg/prod/ 19:04:26 relrod: ok 19:05:26 .ticket 8537 19:05:27 nirik: Issue #8537: RFR: deploy coreos-cincinnati to prod cluster - fedora-infrastructure - Pagure.io - https://pagure.io/fedora-infrastructure/issue/8537 19:06:09 I think we can close that, they can proceed when they wish ? 19:06:16 so this is all fine I think... I guess they want to keep the ticket to track app-owners ack? 19:06:23 yeah, unclear... 19:06:41 let's ping them to see if they are waiting on something else 19:06:44 I can do it 19:06:47 ok. 19:07:02 pagure.issue.comment.added -- smooge commented on ticket fedora-infrastructure#8537: "RFR: deploy coreos-cincinnati to prod cluster" https://pagure.io/fedora-infrastructure/issue/8537#comment-624165 19:07:13 oops sorry cverna 19:07:16 .ticket 8546 19:07:17 nirik: Issue #8546: [fedora messaging] Not consuming any messages from /public_pubsub - fedora-infrastructure - Pagure.io - https://pagure.io/fedora-infrastructure/issue/8546 19:07:45 pagure.issue.comment.added -- cverna commented on ticket fedora-infrastructure#8537: "RFR: deploy coreos-cincinnati to prod cluster" https://pagure.io/fedora-infrastructure/issue/8537#comment-624166 19:07:50 smooge: no problem :) 19:08:00 this looks like it's waiting on meeting between abompard and jpopelka... I guess leave it for now? 19:08:27 yes 19:08:37 let's wait a little bit more 19:08:47 .ticket 8547 19:08:48 nirik: Issue #8547: Rack and install servers for QA - fedora-infrastructure - Pagure.io - https://pagure.io/fedora-infrastructure/issue/8547 19:09:07 smooge: can you add exactly what hardware we have here? otherwise just needs working on. 19:09:30 will do so 19:09:50 smooge: also status on 8528 when you get a chance. 19:10:00 .ticket 8549 19:10:01 nirik: Issue #8549: Move retrace.fedoraproject.org to letsencrypt - fedora-infrastructure - Pagure.io - https://pagure.io/fedora-infrastructure/issue/8549 19:10:30 retrace does not use proxies. 19:10:39 but it could use certgetter still... 19:10:47 pagure.issue.comment.added -- smooge commented on ticket fedora-infrastructure#8547: "Rack and install servers for QA" https://pagure.io/fedora-infrastructure/issue/8547#comment-624167 19:11:24 it needs a rewrite/proxy to certgetter for the challenge. 19:12:20 pagure does this: roles/pagure/frontend/templates/0_pagure.conf 19:12:21 nirik, I had seen something in keys.fedoraproject.org for cert 19:12:29 yeah, keys might also. 19:12:30 and that 19:12:42 but keys is broke 19:12:53 but actually that won't work either. 19:13:11 retrace is also not on the vpn, so it can't talk to certgetter01 via that 19:14:07 ah, planet does this... 19:14:09 RewriteEngine on 19:14:09 RewriteRule ^/\.well-known/(.*) "http://fedoraproject.org/\.well-known/$1" [L,R=301,NE] 19:14:12 that should work 19:14:24 does someone want to do this one? 19:14:32 or should I just take it? 19:14:54 I think an apprentice submitted a patch 19:15:00 or we can add info and the person who supplied the one patch can try and do the rest? 19:15:07 yeah, but it's not enough 19:15:12 we could add the few pointers there for them to contniue 19:15:17 * nirik nods. 19:15:19 continue* 19:15:25 +1 19:15:28 can someone update the ticket with this info? 19:15:39 yup 19:15:58 thanks 19:16:02 .ticket 8558 19:16:03 nirik: Issue #8558: EL8 libssh2 - fedora-infrastructure - Pagure.io - https://pagure.io/fedora-infrastructure/issue/8558 19:16:05 thanks cverna 19:16:47 so on this... should we just filter out all the modular packages from being part of rhel8? 19:16:49 honestly I thought this was more releng versus infrastructure but it is all one thing 19:17:12 yeah, it's a bit tangled here 19:17:53 we could do that. I expect that might allow for all kinds of 'neat' things into EPEL 19:18:08 I guess it comes down to what epel agrees to not overlap with 19:18:23 i have had negative time to spend on looking at anything with EPEL and probably won' 19:18:24 I think we said modules can be overlapping so epel could provide different versions? 19:18:27 t until after the move 19:18:57 yeah someone could make a module with libssh2 in it. However this isn't as much a case of that as much as like ansible 19:19:00 basically this ticket comes down to use adjusting our json thing to agree with whatever epel sig decides is policy right? 19:19:05 pagure.issue.comment.added -- cverna commented on ticket fedora-infrastructure#8549: "Move retrace.fedoraproject.org to letsencrypt" https://pagure.io/fedora-infrastructure/issue/8549#comment-624168 19:19:12 where ansible 'is in' RHEL-7 but it is also not in 19:19:39 so I was thinking that whatever exception we did for that was needed 19:19:43 well, in this case there's no non modular libssh2... 19:19:55 libssh2 is all modular right? 19:20:15 libssh2 is in a module which was in 8.0 The 8.1 version does not have that in it 19:20:32 so virt-devel in 8.0 had libssh2 and 8.1 it does not 19:20:46 proposal: ask submittor to take issue to epel-devel list, get consensus, come back and tell us what to adjust in the tool? 19:20:53 ok 19:21:06 +1 19:21:09 yeah, but even in 8.0... couldn't epel have provided a different version since this one was a module? 19:21:21 or are we saying anything thats a module can't be also in epel. 19:21:28 but I digress... 19:21:47 pagure.issue.comment.added -- smooge commented on ticket fedora-infrastructure#8558: "EL8 libssh2" https://pagure.io/fedora-infrastructure/issue/8558#comment-624169 19:21:50 .ticket 8559 19:21:51 nirik: Issue #8559: Request for mailing list etc. for DeepinDE SIG - fedora-infrastructure - Pagure.io - https://pagure.io/fedora-infrastructure/issue/8559 19:22:31 I think this is done. copr reads groups from fas on login, so it should be there already 19:22:55 proposal: close. 19:22:56 lets close it can be reopen if there is a problem 19:23:12 .ticket 8564 19:23:12 on it 19:23:13 nirik: Issue #8564: registry.fp.o will soon run out of space - fedora-infrastructure - Pagure.io - https://pagure.io/fedora-infrastructure/issue/8564 19:23:40 I can just do this one now. 19:23:43 pagure.issue.edit -- cverna edited the close_status and status fields of ticket fedora-infrastructure#8559 https://pagure.io/fedora-infrastructure/issue/8559 19:23:44 pagure.issue.comment.added -- cverna commented on ticket fedora-infrastructure#8559: "Request for mailing list etc. for DeepinDE SIG" https://pagure.io/fedora-infrastructure/issue/8559#comment-624170 19:23:54 +1 thanks 19:24:11 is it just the one volume? 19:24:20 yes 19:24:51 ntap-phx2-c01-fedora01::> df -h oci_registry 19:24:51 Filesystem total used avail capacity Mounted on 19:24:51 /vol/oci_registry/ 285GB 234GB 50GB 82% /oci_registry 19:25:07 yes that's the one 19:25:11 ntap-phx2-c01-fedora01::> volume modify -volume oci_registry -size 600GB 19:25:21 ntap-phx2-c01-fedora01::> df -h oci_registry 19:25:21 Filesystem total used avail capacity Mounted on 19:25:21 /vol/oci_registry/ 570GB 234GB 335GB 41% /oci_registry 19:25:25 done 19:25:31 nice and easy :) 19:25:58 pagure.issue.edit -- kevin edited the close_status and status fields of ticket fedora-infrastructure#8564 https://pagure.io/fedora-infrastructure/issue/8564 19:25:59 pagure.issue.comment.added -- kevin commented on ticket fedora-infrastructure#8564: "registry.fp.o will soon run out of space" https://pagure.io/fedora-infrastructure/issue/8564#comment-624172 19:26:09 .ticket 8565 19:26:10 nirik: Issue #8565: Freshmaker CI stuck - fedora-infrastructure - Pagure.io - https://pagure.io/fedora-infrastructure/issue/8565 19:26:34 we need a CI person on that 19:26:37 still seems stuck, lets leave open for them to look? 19:26:53 +1 19:26:57 might be good if this is ongoing to get a few of us fedora shmoes access to unstick things? 19:27:11 .ticket 8568 19:27:12 nirik: Issue #8568: New pkgdb group request - fedora-infrastructure - Pagure.io - https://pagure.io/fedora-infrastructure/issue/8568 19:27:37 so I think we do have a SOP... let me look. 19:28:20 I remember trying to look for it but I might be wrong 19:28:43 yeah, I am not seeing it, but I could have sworn pingou wrote one. ;( 19:29:15 I ll check with pingou tomorrow and try to get this moving 19:29:25 i need to put in tickets for renewing certs for *.fedorahosted.org, *.fedoraproject.org, fedoramagazine.org, fedoracommunity.org 19:29:31 ok. yeah, and we should maake a sop if we can't find the old one 19:29:32 got pinged on that 19:29:34 pagure.issue.comment.added -- mattia commented on ticket fedora-infrastructure#5315: "New package review tickets page - RFE for ON_QA" https://pagure.io/fedora-infrastructure/issue/5315#comment-624174 19:30:00 .ticket 8579 19:30:01 nirik: Issue #8579: Update regindexer to handle metadata-in-labels - fedora-infrastructure - Pagure.io - https://pagure.io/fedora-infrastructure/issue/8579 19:30:08 cverna: you are working this one? 19:30:14 I am currently working on this 19:30:31 .ticket 8587 19:30:32 nirik: Issue #8587: start.fpo is not updating - fedora-infrastructure - Pagure.io - https://pagure.io/fedora-infrastructure/issue/8587 19:30:41 relrod: ^ you have any ideas on this one? 19:30:59 * relrod looks up 19:31:01 This looks fixed to me but misc said to wait 19:31:12 .ticket 8595 19:31:16 nirik: Issue #8595: Jenkins seems to be out of space - fedora-infrastructure - Pagure.io - https://pagure.io/fedora-infrastructure/issue/8595 19:31:22 this needs ci folks again... 19:31:33 just fyi we are 1 min past 30min 19:31:33 .ticket 8597 19:31:34 nirik: Issue #8597: Add mattia to the github fedora-infra organization and bodhi team - fedora-infrastructure - Pagure.io - https://pagure.io/fedora-infrastructure/issue/8597 19:31:40 I can do this one now. 19:31:45 thanks :) 19:31:45 * nirik has 2 more. 19:31:54 let's go for them 19:32:03 .ticket 8600 19:32:04 nirik: Issue #8600: All maintainers should be removed from retired packages eventually. - fedora-infrastructure - Pagure.io - https://pagure.io/fedora-infrastructure/issue/8600 19:32:16 this is a discussion ticket. I hate discussion tickets. 19:32:17 yeah 8587 looks fixed to me? https://start.fedoraproject.org/ has a thing from today on it 19:33:14 nirik: yeah this will probably end up sitting there for years :P 19:33:44 I guess we can chime in on 8600, but IMHO discussion should be on devel list or so, until a consensus is found. 19:33:59 .ticket 8601 19:34:00 nirik: Issue #8601: Please unblock gnome-desktop - fedora-infrastructure - Pagure.io - https://pagure.io/fedora-infrastructure/issue/8601 19:34:10 this is a releng ticket... 19:35:16 so, close and ask to refile in releng. 19:35:23 and thats the last one 19:35:46 I ll do it for 8601 19:36:50 so on 8600. I am going to say this needs to go to devel list and FESCO and not infrastructure 19:36:53 smooge: file a new ticket on the certs... we might consider letting fedorahosted die... and fedoramagazine.org isn't controlled by us anymore, so we should ask misc about it. 19:37:10 we will implement the policy that is decided by that 19:37:38 I am also on the 'this is not a place to have a discussion.' 19:37:44 pagure.issue.comment.added -- cverna commented on ticket fedora-infrastructure#8601: "Please unblock gnome-desktop" https://pagure.io/fedora-infrastructure/issue/8601#comment-624175 19:37:50 pagure.issue.edit -- cverna edited the close_status and status fields of ticket fedora-infrastructure#8601 https://pagure.io/fedora-infrastructure/issue/8601 19:38:43 pagure.issue.edit -- kevin edited the close_status and status fields of ticket fedora-infrastructure#8597 https://pagure.io/fedora-infrastructure/issue/8597 19:38:44 pagure.issue.comment.added -- kevin commented on ticket fedora-infrastructure#8597: "Add mattia to the github fedora-infra organization and bodhi team" https://pagure.io/fedora-infrastructure/issue/8597#comment-624177 19:40:08 so, close out? 19:40:12 we are 10min over. ;( 19:40:37 pagure.issue.comment.added -- smooge commented on ticket fedora-infrastructure#8600: "All maintainers should be removed from retired packages eventually." https://pagure.io/fedora-infrastructure/issue/8600#comment-624179 19:40:41 yes let's close 19:40:46 #endmeeting