17:00:20 <mboddu> #startmeeting RELENG (2018-05-03)
17:00:20 <zodbot> Meeting started Thu May  3 17:00:20 2018 UTC.
17:00:20 <zodbot> This meeting is logged and archived in a public location.
17:00:20 <zodbot> The chair is mboddu. Information about MeetBot at http://wiki.debian.org/MeetBot.
17:00:20 <zodbot> Useful Commands: #action #agreed #halp #info #idea #link #topic.
17:00:20 <zodbot> The meeting name has been set to 'releng_(2018-05-03)'
17:00:20 <mboddu> #meetingname releng
17:00:20 <mboddu> #chair dgilmore nirik tyll sharkcz masta pbrobinson pingou puiterwijk maxamillion mboddu Kellin dustymabe
17:00:20 <zodbot> The meeting name has been set to 'releng'
17:00:20 <zodbot> Current chairs: Kellin dgilmore dustymabe masta maxamillion mboddu nirik pbrobinson pingou puiterwijk sharkcz tyll
17:00:21 <mboddu> #topic init process
17:00:41 <mboddu> Hello Everyone :)
17:00:45 <nirik> morning
17:00:49 <masta> Howdy
17:00:57 * sharkcz is here
17:01:25 <mboddu> sharkcz: Hey, long time no see, how are you doing?
17:01:46 <sharkcz> mboddu: fine and busy as usual :-)
17:02:19 <mboddu> sharkcz: Good to see you :), but you need to put up with s390x for 1 more month, thats all
17:03:02 <masta> :-)
17:03:08 <mboddu> Since sharkcz is here and probably we might not need to do this after 1 month, lets start with alt arch updates
17:03:17 <mboddu> #topic Alternative Architectures updates
17:03:33 <mboddu> sharkcz: ^ anything you want to add?
17:03:53 <sharkcz> I have a good news :-) there is new lorax build that's supposed to fix ppc64 and ppc64le composes
17:04:31 <sharkcz> otherwise no problems afaict
17:04:50 <sharkcz> or rather no new problem
17:04:51 <nirik> sidetrack: sharkcz: have you seen: https://pagure.io/releng/issue/7481
17:04:53 <mboddu> sharkcz: Awesome, thanks for the update
17:05:21 <sharkcz> nirik: ah, I noticed that, but haven't look yet
17:05:33 <nirik> it's a weird one
17:05:58 <sharkcz> yup
17:07:30 <mboddu> #info There is a new lorax build thats supposed to fix ppc64 and ppc64le composes
17:07:36 <sharkcz> although I was able to run mock builds against rawhide/ppc64le few days ago ...
17:08:00 <mboddu> sharkcz: So, when f26 goes eol, you dont need to look at s390x koji instance and pushing updates, right?
17:08:07 * dustymabe lurks - in another meeting
17:08:13 <sharkcz> mboddu: right
17:08:35 <nirik> hopefully also we could get some of the secondary resources added to our primary... more builders
17:08:43 <sharkcz> and no more dead secondary sigul
17:08:44 <mboddu> nirik: ^ Just FYI, you might need to do some work during that time
17:08:52 <mboddu> sharkcz: haha, true :)
17:09:22 <mboddu> nirik: +1 on moving the secondary resources to primary
17:09:27 <pbrobinson> sharkcz: I don't miss secondary bits at all ;-)
17:09:45 <nirik> I think we can retire... 5 machines when that day comes. ;)
17:09:46 <sharkcz> pbrobinson: I don't believe you ;-)
17:10:28 <pbrobinson> sharkcz: I have more than enough replacement tire fires!
17:10:39 <sharkcz> :-)
17:11:30 <mboddu> Okay, moving on
17:11:38 * nirik is reminded he was meaning to talk to pbrobinson about moonshot/fedora fun.
17:11:46 <nirik> have another! :)
17:12:06 <pbrobinson> nirik: ping me when ever, probably #fedora-arm might be best
17:12:17 <nirik> can do
17:12:42 <mboddu> #topic #7482 bodhi - unable to request this update for stabilization
17:12:48 <mboddu> #link https://pagure.io/releng/issue/7482
17:13:01 <sharkcz> ah, this is mine :-)
17:13:05 <mboddu> So, this is a crazy one
17:13:07 <mboddu> sharkcz: Yes
17:13:25 * mboddu thinking where to start
17:14:02 <mboddu> This is caused by setting post_beta.critpath.num_admin_approvals to 1 as per the docs in https://infrastructure.fedoraproject.org/infra/docs/docs/sysadmin-guide/sops/bodhi.rst
17:14:26 <mboddu> Which we can fix by changing to 0, its not a problem
17:15:01 <mboddu> Now, there is another issue with bodhi that is being looked by bowlofeggs - https://pagure.io/releng/issue/7482#comment-510248
17:15:24 <mboddu> This issue picked up a bug in bodhi
17:15:30 <nirik> yes, this should be 0 as far as I know. we aren't using proventesters.
17:15:53 <nirik> shall I make that change and push it out/
17:15:54 <nirik> ?
17:15:54 <mboddu> So, my question here is, why is it only set for one release in production.ini file in bodhi?
17:16:11 <mboddu> nirik: I can make change and you can push it out
17:16:19 * mboddu dont have permissions to run the playbook
17:16:32 <masta> nirik, mboddu +1 on changing that to 0
17:16:47 <nirik> also the doc needs work. it's out of date.
17:17:09 <nirik> well, if we branch f29 and have that, we want different rules for it vs f28/f27
17:17:10 <mboddu> nirik: That, I dont know where the sources are located
17:17:22 <nirik> pagure.io/infra-docs/ PR's welcome
17:17:29 <mboddu> nirik: I can do that as well
17:17:38 <mboddu> Once I understood the process here
17:17:49 <nirik> this should be what we implement: https://fedoraproject.org/wiki/Updates_Policy
17:18:13 <mboddu> nirik: So, the overwrites is only for branched release?
17:18:35 <mboddu> nirik: The problem is, bodhi has some default values in its configs
17:18:35 <nirik> right. pre_beta (but does that make sense anymore when we enable at beta?) and post_beta
17:18:52 <mboddu> nirik: Yes, which is what I am trying to understand
17:19:09 <nirik> we want the defaults for all stable releases, and only override when there is a branched.
17:19:25 <nirik> at least thats my hope/understanding
17:19:50 <masta> makes sense
17:19:59 <mboddu> nirik: Okay, thats what I am thinking, then should I comment all the lines in the production.ini file or just change that admin approvals to 0?
17:20:15 * nirik looks at whats there now
17:20:38 <mboddu> By all I mean related to the policy
17:20:50 <mboddu> nirik: https://infrastructure.fedoraproject.org/cgit/ansible.git/tree/roles/bodhi2/base/templates/production.ini.j2#n523
17:21:14 <nirik> I would say: change all those f28's to f29 and comment them all.
17:21:28 <nirik> then when we enable bodhi for f29 we can comment in the ones we need
17:21:58 <nirik> oh and change that one back to 0
17:22:44 <mboddu> nirik: Okay, during bodhi enablement to GA of a branched release we will use them
17:23:03 <mboddu> I will check if anything is needed for pre_beta or post_beta based on the policy in wiki
17:23:12 <nirik> sounds good.
17:26:26 <mboddu> nirik: https://infrastructure.fedoraproject.org/cgit/ansible.git/commit/roles/bodhi2/base/templates/production.ini.j2?id=edc34b52ee796fe08caab6f9cc708d575d88710f
17:26:55 <nirik> looks good
17:27:24 <mboddu> #info mboddu updated the config and nirik will run the playbook to fix the issue.
17:28:08 <mboddu> #action mboddu will go through the policy and make necessary changes to config and also will update the docs
17:29:03 <mboddu> thanks nirik
17:30:22 <mboddu> nirik: I still have to go through https://pagure.io/releng/issue/7445, if you have already have, I can talk about it or skip it for next week
17:31:33 <nirik> I looked at it a bit, but again didn't read it in detail.
17:31:45 <nirik> I think the approach is wrong. I think we should try and make the numbers work, not the name
17:32:05 <mboddu> Okay, I will skip it and update the ticket saying that it will be discussed in the next meeting
17:32:41 <mboddu> Okay, I dont have anything more, lets go to open floor
17:32:46 <mboddu> #topic Open Floor
17:32:53 <mboddu> Anybody got anything?
17:34:07 <mboddu> puiterwijk: Got a min? Just wanted to check on couple things
17:34:14 <nirik> Did you see the SRPMS vs sources bug?
17:34:40 <nirik> https://bugzilla.redhat.com/show_bug.cgi?id=1574211
17:35:06 <nirik> I wish we had some kind of test suite on fedora-repos where it checks all the repo urls and confirms they are valid.
17:35:07 <mboddu> nirik: Yes, which is what I am trying to talk to Patrick
17:35:54 <mboddu> nirik: +1 on test suite
17:36:35 <masta> yeah, that would be cool.
17:37:37 <nirik> of course someone would need to write it. ;)
17:38:20 <mboddu> nirik: thats the tricky part :)
17:38:29 <masta> my local mirror of fedora seems to disagree with the issue stated in that bz. weird
17:38:45 <masta> I mirror enchilada
17:39:28 <mboddu> masta: That is odd, can you update the ticket with your findings
17:39:34 * mboddu will try it as well
17:39:38 <puiterwijk> mboddu: maybe after the meeting?
17:39:44 <masta> yeah, I'm taking a closer look now
17:39:53 <mboddu> puiterwijk: Sure, thanks :)
17:47:29 <mboddu> masta: Well, I am hitting the same problem with the mirrors but when I try to download the source, its errored with "Error: Failed to synchronize cache for repo 'fedora-source'"
17:48:37 * mboddu did dnf clean a;;
17:48:38 <masta> mboddu, yeah, I'm looking at my rsync script, and meanwhile trying to remember where to find the master mirror shares in infra.
17:48:39 <mboddu> all
17:49:17 * nirik needs more ☕
17:51:40 <masta> rsync rsync://mirror.math.princeton.edu/pub/fedora/linux/releases/28/Everything/source/tree/Packages/s/  <-- I see packages
17:52:14 <masta> so that is the mirror I go with, but perhaps they don't do --delete in their rsync script.
17:53:58 <masta> at one point I was going to put my IP in the master mirror ACL to test this kind of thing.
17:54:14 * bowlofeggs sends nirik a liter of espresso
17:54:45 <nirik> stat!
17:55:33 <nirik> 🚨
17:55:52 <mboddu> masta: I guess the problem is with updates repo - https://mirror.math.princeton.edu/pub/fedora/linux/updates/28/Everything/
17:56:03 <masta> looks like the reported problem statement is true, the updates are not populating sources
17:56:14 <mboddu> masta: Yes
17:56:18 <masta> but the releases are populated correctly
17:56:22 <mboddu> Yup
17:57:00 <nirik> it's using SRPMS apparently
18:00:40 <masta> I seem to remember in a meeting recently there was some discussion about restructuring the mirror layout
18:02:09 <nirik> There's a request to rename "Everything" to something else...
18:02:31 <nirik> and yeah, there has been talk about rearranging more things... but as far as I know there's no plan for it yet
18:02:48 <masta> okay, good to know.
18:04:49 <masta> anyways, I just looking in pub/fedora to confirm , but that was by now redundant.
18:05:33 <masta> is this a bodhi config? I'm trying to think where best to investigate?
18:05:48 <mboddu> masta: /pub/fedora has source and SRPMS, but SRPMS has the content
18:06:16 <masta> mboddu, that is what I observed, yeah
18:06:18 <nirik> well, could be: pungi, new-updates-sync or mirrormanager depending on what the fix is.
18:07:01 <mboddu> masta: I think its bodhi, because thats the only one which touches that repo(afaik)
18:07:21 <mboddu> Well, updates that repo
18:07:52 <mboddu> Oh, it went over board, we can take this to #fedora-releng
18:07:58 <mboddu> Sorry guys
18:08:15 <mboddu> #endmeeting