17:01:19 #startmeeting F30 Final Go/No-Go meeting 17:01:19 Meeting started Thu Apr 25 17:01:19 2019 UTC. 17:01:19 This meeting is logged and archived in a public location. 17:01:19 The chair is bcotton. Information about MeetBot at http://wiki.debian.org/MeetBot. 17:01:19 Useful Commands: #action #agreed #halp #info #idea #link #topic. 17:01:19 The meeting name has been set to 'f30_final_go/no-go_meeting' 17:01:21 #meetingname F30-Final-Go_No_Go-meeting 17:01:21 The meeting name has been set to 'f30-final-go_no_go-meeting' 17:01:25 #topic Roll Call 17:01:31 morning 17:01:38 .hello2 17:01:39 frantisekz: frantisekz 'František Zatloukal' 17:01:45 .hello zlopez 17:01:46 .hello2 17:01:46 .hello2 17:01:46 mkonecny: zlopez 'Michal Konečný' 17:01:49 coremodule: coremodule 'Geoffrey Marr' 17:01:52 lbrabec: lbrabec 'Lukas Brabec' 17:01:54 Good morning bcotton 17:01:56 .hello mohanboddu 17:01:57 mboddu: mohanboddu 'Mohan Boddu' 17:02:02 hello lailah 17:02:08 fas lailah 17:02:23 .fas lailah 17:02:26 Lailah: lailah 'Sylvia Sánchez' 17:02:28 .hello2 17:02:30 pwhalen: pwhalen 'Paul Whalen' 17:03:03 .hello2 17:03:04 dmoluguw: dmoluguw 'Dinesh Prasanth Moluguwan Krishnamoorthy' 17:03:05 .hello2 17:03:05 .hello adamwill 17:03:07 sgallagh: sgallagh 'Stephen Gallagher' 17:03:10 adamw: adamwill 'Adam Williamson' 17:03:18 greetings 17:03:29 * Lailah waves to all 17:03:43 * satellit listening 17:03:55 * mhroncok lurking 17:04:24 okay, i'll get through the copypasta as folks come on 17:04:32 #topic Purpose of this meeting 17:04:34 #info Purpose of this meeting is to check whether or not F30 is ready for shipment, according to the release criteria. 17:04:35 #info This is determined in a few ways: 17:04:40 #info 1. No remaining blocker bugs 17:04:41 #info 2. Release candidate compose is available 17:04:43 #info 3. Test matrices for Beta are fully completed 17:04:45 so! 17:04:51 #topic Current status — blocker bugs 17:04:52 #link https://qa.fedoraproject.org/blockerbugs/milestone/30/final/buglist 17:05:05 bcotton: "#info 3. Test matrices for Beta are fully completed"? 17:05:18 mboddu: d'oh 17:05:20 #undo 17:05:20 Removing item from minutes: 17:05:23 #undo 17:05:23 Removing item from minutes: 17:05:27 #undo 17:05:27 Removing item from minutes: INFO by bcotton at 17:04:43 : 3. Test matrices for Beta are fully completed 17:05:35 #info 1. No remaining blocker bugs 17:05:37 #info 2. Release candidate compose is available 17:05:38 #info 3. Test matrices for Final are fully completed 17:05:46 bcotton: Just saying, I am not shipping beta again ;) 17:05:56 mboddu: why not? all the work is already done :-D 17:05:59 #topic Current status — blocker bugs 17:06:00 #link https://qa.fedoraproject.org/blockerbugs/milestone/30/final/buglist 17:06:15 #info 3 Proposed Blockers 17:06:17 #info 1 Accepted Blockers 17:06:24 so let's review 17:06:28 * adamw is juggling here 17:06:38 #topic (1702419) toolbox does not work in F30 17:06:40 #link https://bugzilla.redhat.com/show_bug.cgi?id=1702419 17:06:41 #info Proposed Blocker, buildah, ASSIGNED 17:07:19 As noted in the BZ, this issue doesn't affect a blocking desktop. It is worth fixing as an FE if we end up slipping for any other reason 17:07:31 silverblue isn't a blocking deliverable, so that makes it an easy call imo 17:07:33 -1 blocker / +1 FE 17:07:37 yeah, this is straightforward, -1 blocker, +1 FE 17:07:42 -1 blocker, +1 FE 17:07:44 -1 Blocker, +1 FE 17:07:47 -1 B/+1FE yeah 17:07:49 -1B, +1 FE 17:07:53 -1 Blocker, +1 FE 17:07:53 -1B/+1FE 17:08:01 -1 Blocker +1 FE 17:08:23 -1B/+1FE 17:09:08 bcotton: Why Silverblue is not blocking? 17:09:18 -1b +fe 17:09:29 mkonecny: Because the Workstation WG has never listed it as blocking. 17:09:31 mkonecny: because no one ever proposed to make it a blocker, i guess 17:09:43 ok, thanks 17:09:44 it's not really ready to be the primary desktop, i don't think. 17:09:50 whenever desktop team thinks it is, they can propose it. 17:09:52 * nirik nods 17:09:56 bcotton: next comes proposed agreed =) 17:09:59 proposed #agreed 1702419 - RejectedBlocker(Final), AcceptedFreezeException(Final) - Silverblue is not a blocking deliverable, but it would be good to have this fixed 17:10:05 ack 17:10:05 adamw: yep, just have to type :-) 17:10:12 ack 17:10:14 And toolbox is essential on silverblue. But wks? 17:10:14 ack 17:10:16 ack 17:10:17 ack 17:10:22 ack 17:10:41 #agreed 1702419 - RejectedBlocker(Final), AcceptedFreezeException(Final) - Silverblue is not a blocking deliverable, but it would be good to have this fixed 17:10:41 jlanda: I don't use it that much, but it's nice 17:10:41 ack 17:10:50 * jlanda just reached hone from a 10h roadtrip and there is enough quorum to vote, I'll be semi afk 17:10:50 ack 17:11:01 jlanda: take it easy! 17:11:02 #topic (1703152) initial-setup fails with no network - AttributeError: 'NoneType' object has no attribute 'upper' 17:11:04 #link https://bugzilla.redhat.com/show_bug.cgi?id=1703152 17:11:05 #info Proposed Blocker, initial-setup, NEW 17:11:16 so this showed up this morning 17:11:21 pwhalen and I are digging into it right now 17:11:22 so, the question here is how widespread this is... just no network armv7? 17:11:25 we are not yet sure how common it will be 17:11:46 this is an aarch64 board, the pine64_plus. It does not affect the rpi3 17:11:59 Is it a race? 17:12:25 I dont know how common it is, I usually test with network connected. dgilmore found it this morning 17:12:33 Does it ever happen with network connected? 17:12:34 with network, initial-setup starts 17:12:39 It looks like missing brackets 17:12:42 sgallagh, not that I have seen 17:12:52 If not, I'm inclined to deny this as a blocker and just Common Bugs it 17:13:00 sgallagh, me too 17:13:07 +1 commonbugs 17:13:31 sgallagh: I suspect that rpi works only because of wifi, anything without wifi I expect will not work without a network cable plugged in 17:13:33 I think it's a blocker but I'm not sure if it only affects one architecture or if it's widespread 17:13:35 but I dont know if it affects more than arm, like an anaconda install with no network, there was a similar issue in beaker as noted in the bug 17:13:43 for beta, i'd be absolutely on board with rejectedblocker, commonbugs. but for final, i'm only like 75%? 17:13:44 * mboddu has couple of pine64_plus boards sitting at home though 17:13:46 mkonecny: missing brackets? 17:14:06 pwhalen: I can do a quick test in a VM without network. Hang on 17:14:07 it should effect any system with no network plugged in and running initial-setup 17:14:19 dgilmore: i'm not sure that's right. 17:14:28 dgilmore: the code is looking for a mac address, effectively. 17:14:35 it should be able to get one whether or not the device is plugged into a network. 17:14:45 adamw: My mistake, I only noticed the missing attribute upper 17:14:48 also anaconda calls the same thing 17:14:49 so it hits devices without a network interface? 17:15:06 adamw, and the other bug was in anaconda , noted at the bottom 17:15:10 so we need to know whether this might affect anaconda. though the anaconda codepath is less new. 17:15:19 We just know a device thst hits, another one that don't hit mhroncok 17:15:22 there's a lot of unknowns here, basically... 17:15:49 the worst case, i guess, is if networkmanager has started returning None for this in some situation where it previously didn't. 17:15:49 yeah, so perhaps we should delay a bit and explore it and defer go/nogo for a bit to do that? 17:16:04 Yeah 17:16:06 I think that's a good idea 17:16:08 nirik: +1 17:16:16 FWIW, it appears to install fine on x86_64 via anaconda with no network devices installed in a VM 17:16:37 sgallagh: i'd expect that, because there's no network device to have or not have an hwaddr property in that case. :P 17:16:56 The test needs a card, but no cable 17:17:00 the affected case is not 'no network device' but 'network device present but not connected to a network'. but that's not hte whole story for sure 17:17:02 ok, retrying 17:17:07 Or a broken one might work too 17:17:14 since we know at least one other ARM system with device present but not connected to network works 17:17:43 should we continue discussing this or come back to it after reviewing the other blockers? 17:17:51 +1 17:17:52 sgallagh: also, might be an idea to do a KDE install without creating a user so you get initial-setup on first boot... 17:17:58 bcotton: Are there other blockers to discuss? 17:17:59 i'd help, only i'm also trying to test two other things at the same time... 17:18:02 sgallagh: there aer 17:18:11 I'll pull the KDE installer as well, then 17:18:20 bcotton, newly proposed blocker here... sorry! 17:18:20 adamw: Is that possible in KDE? 17:18:35 .bug 1670396 17:18:36 coremodule: 1670396 – KSieve fails to start - https://bugzilla.redhat.com/1670396 17:18:40 Lailah: is what possible in KDE? 17:18:49 coremodule: it's OK, i'm refreshing blockerbugs right now 17:18:56 adamw: Last time I forgot to create a user in KDE it just failed to login. 17:18:57 oh cool 17:18:58 bcotton: reload your blockerbugs tab 17:19:16 Lailah: if you don't create a user during install, then initial-setup should run on first boot. 17:19:25 we're going the wrong way! 17:19:38 #info We'll move on to the other blocker bugs and come back to this one 17:19:43 adamw: Oh. Okay. 17:19:53 bcotton: okay 17:19:55 #topic (1670396) KSieve fails to start 17:19:57 Sorry 17:19:57 #link https://bugzilla.redhat.com/show_bug.cgi?id=1670396 17:19:58 #info Proposed Blocker, pim-sieve-editor, NEW 17:20:24 We banned the wrong guy, poor kparal, handcuffed and all, and the guilt one is coremodule 17:20:28 It's a blocker to me. 17:20:36 jlanda: LOL 17:20:45 Free kparal ! 17:21:20 and of course thats in the default menus? 17:21:26 nirik, yes 17:21:41 * nirik sighs 17:21:45 dang. is that new? I don't see it in my F29 KDE machine 17:21:53 doesn't matter, i guess 17:22:09 well 17:22:18 there is a potential argument to waive this, if we really want to release 17:22:21 nevermind anyway, i found it 17:22:23 only just tested for it this morning, but it's there on the beta... dunno why it didnt get proposed earlier, but... this is what we've got! 17:22:24 I guess it's a blocker... by critera. 17:22:25 adamw: i'm listening 17:22:35 let me find the receipts 17:22:38 adamw, the fact that it was proposed two months ago and no one has found it until now? 17:22:51 nirik: To me is a blocker 17:23:19 coremodule: the fact that it wasn't proposed before the start of the meeting :p 17:23:34 I don't have pim-sieve-editor but maybe that's because I deleted Kontakt long ago. 17:23:42 * mboddu agrees with nirik 17:24:08 well dang it now i can't find it 17:24:11 bcotton: basically that 17:24:32 * nirik wonders if there's enough kde sig cycles these days to keep kde release blocking... I know rex is pretty busy 17:24:40 gah 17:24:43 bcotton, ahhhh! a loophole! you must have worked in law before! 17:24:48 nirik: that's a can of worms we're not opening today :p 17:24:51 adamw: What happened? 17:24:52 I'm really not convinced that a mail filter editor is critical functionality for the desktop 17:24:56 sure, just musing. 17:25:02 i know we agreed some wording at some point regarding considering timeframes when deciding on blocker status 17:25:04 but i can't find it 17:25:16 sgallagh: the basic justification for this criterion is that it's a polish criterion 17:25:28 nirik: fwiw, i think that is a question for us to ask 17:25:28 if we're shipping something in the default menus it ought to work, because people click around on stuff 17:25:30 sgallagh++ 17:25:32 frantisekz: Karma for sgallagh changed to 17 (for the current release cycle): https://badges.fedoraproject.org/tags/cookie/any 17:25:49 "remove the package from the image" is always considered an acceptable solution to violations of this criterion 17:25:58 anyway, so, the point here is: this was apparently discovered in february 17:25:59 yep 17:26:01 it might not have been proposed because of time constraints. People generally dig in for an RC 17:26:02 but was not proposed as a blocker then 17:26:29 Put another way, if this is the sole reason we'd slip, I'd be quite annoyed by it. 17:26:38 if i could find that damn policy, i'm sure it says something about blockers being proposed in a reasonable time frame... 17:26:43 sgallagh: agree 17:26:46 january, even 17:26:52 adamw, was it in a blocker meeting or on the lists? 17:27:01 no, but that's kinda the point 17:27:12 since we knew about this in january, why didn't we propose it as a blocker until just now? 17:27:21 would it be difficult to remove from the image? 17:27:27 no, but it requires a respin 17:27:31 yeah 17:27:38 and that's difficult in itself ☺ 17:27:42 remove, fire rc2 and delay the go/no-go to tomorrow like in bet? Is just a package removal 17:27:44 i mean, not difficult, but time consuming 17:28:00 yah 17:28:07 i think that seems reasonable 17:28:11 Is it a leaf package? 17:28:13 but i have lunch plans tomorrow :-( 17:28:23 ok, so the policy i'm thinking about is "Blocker bug process proposal: waiving late-discovered blockers to next release" 17:28:31 that was a mailing list thread from 2017 17:28:38 proposal: cancel bcotton's calendar for the next 24x7 17:28:49 That's a bit too old, adamw , isn't it? 17:28:53 well 17:29:00 i'm trying to figure out if we actually agreed to put that into production 17:29:01 bowlofeggs: you wouldn't like me when i'm hangry 17:29:06 haha 17:29:12 I would love to see this one waived ... 17:29:20 https://lists.fedoraproject.org/archives/list/test@lists.fedoraproject.org/message/Q46M75GUKRHMI5IMNGBNL6XHLD5GLLTS/ 17:29:34 #link https://lists.fedoraproject.org/archives/list/test@lists.fedoraproject.org/message/Q46M75GUKRHMI5IMNGBNL6XHLD5GLLTS/ 17:29:46 adamw: My read of that thread (just found it too) is that we basically left it a judgement call. 17:30:05 Partial composing would be great for this :( 17:30:09 I'd be ok waving this on the 'not proposed in time nor did anyone care about it for months' 17:30:23 it seems i wrote a second draft of this policy and then...never actually put it into production 17:30:28 i guess i forgot about it. :/ 17:30:34 "we agreed at the F26 Final go/no-go meeting to draft up some formal policy for this so we can make such decisions consistently and not in an ad hoc way that might lead to it becoming a loophole that gets abused" - then adamw proposed a formal policy... I take that to mean the policy is in place 17:30:36 adamw: how did you notice this bug? 17:30:55 nirik: it's in the matrix 17:31:06 lruzicka marked the desktop_menus test for kde as a 'fail' and referenced this bug 17:31:16 but for some reason did not propose it as a blocker. i don't know why and he's not online to ask him 17:31:40 agree with nirik 17:31:42 coremodule: it's not really in place unless it's in the wiki, arguably 17:32:03 adamw: ahhh... ok. and that was today/rc1? 17:32:08 yes 17:32:15 I am inclined to waiving it off, if its the only blocker remaining 17:32:16 i just checked testcase_stats and it was not reported as a fail before today 17:32:19 https://www.happyassassin.net/testcase_stats/30/Desktop/QA_Testcase_desktop_menus_Release_blocking_desktops___lt_b_gt_x86___x86_64_lt__b_gt_.html 17:32:34 hmmmm, it was agreed on to produce some kind of policy, the policy was produced... dang, I can see it both ways. 17:33:00 * nirik is fine waving it even if it's not the last blocker. ;) 17:33:07 so this is awkward, but, i guess i should forewarn that even if we blockerjutsu out all the blockers, i am going to raise the idea that we should not ship rc1 at least yet 17:33:16 i was saving that for later, but... 17:33:18 sure, thats fine. :) 17:33:40 it worries me that it has existed for all of, oh, about 18 hours or something at this point? and it has a new kernel build and stuff in it 17:33:44 * nirik is -1 Blocker (due to long time/no proposal/no one cared about it) and +1 FE 17:33:51 if we don't ship rc1 and do make an rc2, we could drop this package from the image 17:33:52 i am not sure it's responsible to sign it off for release on less than 24 hours worth of testing 17:34:02 then we satisfy the formal conditions 17:34:08 adamw, I would agree. 17:34:14 i dunno what everyone else thinks about that, but i figured i'd mention it in case it affects how much blockerjutsu we are inclined to do 17:34:19 adamw: I totally agree with your point 17:34:24 So... +1FE adamw? 17:34:26 adamw: istr we proposed a rule like that for f29 and people were like "nahhhh, it's fiiiiiine" 17:34:26 adamw: I understand that, but also, I think it's not worth it to delay go/no-go for entire week 17:34:28 Or what? 17:34:59 bcotton: i'm not saying it should be a rule, it's more of a feeling. :P i don't necessarily mind shipping an RC5 that's only existed for 12 hours if it's barely different from an RC4 that got three days of solid testing 17:35:02 I find it very difficult to get the testing done in time for the meeting, and likely missing things along the way. like no network in initial-setup 17:35:03 but that's not the case we're in here 17:35:11 bcotton, that's true, we did come to that conclusion for f29... but we had a little more than 18 hours if i recall correctly... 17:35:13 We have two conditional blockers where we're not sure what to doo 17:35:29 frantisekz: yeah, that's a consideration 17:35:43 I'm still trying to replicate one of them. I'd suggest not making a final decision yet. 17:35:46 i also know sgallagh suggested that we might not want to release *one* week later, for some reason 17:35:48 Do we have other proposed issues? 17:36:00 we have at least two more ;-) 17:36:06 adamw: We'd be releasing on the first day of Red Hat Summit. 17:36:07 how about we do all the proposed and then discuss overall? 17:36:10 Guaranteed to have no press. 17:36:11 1697591, but that's addressed 17:36:14 shall we return to this one as well? 17:36:18 at one point we had agreed to auto slip if we didnt have an RC by Tuesday. 17:36:30 pwhalen: how quaint :P 17:36:47 yeah, i'm +1 for cycling back to this 17:36:53 bowlofeggs: I think kf5-libksieve has a number of other deps... kmail/kdepim-libs 17:36:53 #info We'll come back to this one, too 17:37:13 so removing it is likely to take a swath of other things 17:37:18 #topic (1697591) modesetting driver on some Intel hardware fails to start after kernel 4.20.13 update 17:37:20 #link https://bugzilla.redhat.com/show_bug.cgi?id=1697591 17:37:21 #info Proposed Blocker, xorg-x11-server, ON_QA 17:37:37 nirik: oh that sounds less feasible then 17:38:14 so, we have a fixed kernel in hand for this? or not entirely? 17:38:21 this one has a purported fix. did it make it into the compose? 17:38:28 nirik: fun. we'd have to unpick the app from the menus then. 17:38:33 bcotton: yes. 17:38:38 this is addressed in RC1. 17:38:43 Oh, this one... 17:38:44 adamw: yeah, or fix it from crashing. 17:38:46 we haven't had confirmation that it's fixed yet, but i'm pretty confident it should be. 17:38:49 nirik: pshaw 17:38:58 #info BZ 1697591 has a potential fix in RC1 17:39:08 adamw: Why are you so confident? 17:39:22 lets just ship kernel + nethack... would narrow the test matrix so much! 17:39:34 well i suppose let's put it to a vote just in case 17:39:40 nirik: and it'd be more fun too! 17:39:41 yeah +1 nethack pid 1 17:39:43 * sgallagh adds nethack to the Server Edition 17:39:50 Lailah: because it's the same "fix" (more a workaround) we had in f29 17:39:56 just put back into f30 17:40:18 adamw: fair point 17:40:19 deciding blocker status for this is actually quite hard as we never figured out precisely how much hardware is affected 17:40:20 FWIW, I'm not convinced this is a blocker (if it's not fixed, I don't think I'd slip for an unknown subset of hardware). 17:40:42 but it seems like it's a reasonable amount, and of cards that have always worked before 17:40:53 i'm really on the fence about this one, have been all along 17:41:06 this can has been kicked a few times 17:41:13 yeah 17:41:16 so really it's not gotten too much testing to make sure it's now 'fixed' in rc1 right? 17:41:20 circling back to adamw suggestion of slipping, we should do more testing 17:41:29 nirik: like I said above: no, but i'm pretty confident it must me 17:41:45 must be* 17:42:10 the story here is basically that a kernel workaround (a reversion) was shipped as a downstream patch in f29 and earlier 17:42:24 it got took out of f30 as the kernel team didn't want to carry it forever, on the basis that the bug should get fixed properly in x11 17:42:31 This one is not easy to test, we need specific hw, not all gpus of those series hit this, just some vendor setups 17:42:40 So... is this fixed or not? 17:42:41 that's what the bug report is for: it basically says 'hey x people, this workaround got taken out of the kernel, you need to fix the bug properly now' 17:42:49 in the end that didn't happen and the kernel revert patch got put back in 17:42:56 * nirik is +1 blocker I guess then. 17:43:13 +1 Blocker 17:43:20 i asked tibbs to check the fix (he has an affected system) but he hasn't replied yet 17:44:44 adanw: When did you ask? 17:44:50 it does sound like more testing time is wise here 17:45:02 so i see +1 from nirik and Lailah, and what i take to be -1 (or -0.5?) from sgallagh. anyone else want to commit to a position on this one? 17:45:27 -1 17:45:47 I think if we had this in f29 we need to carry the workaround until it's fixed in the X11 side. Dropping it and breaking things for some subset of people is poor and we should avoid it. 17:45:49 Lailah: yesterday and again about half an hour ago 17:46:02 Yeah, I'm revising my vote to a weak +1 17:46:03 nirik: i think in the end ajax just upstreamed the kernel reversion, in fact, but that's a side note 17:46:13 +0.2 17:46:31 adamw: you should see the face i'm making at you right now 17:46:33 And the integer thing? :D 17:46:35 +1 17:46:35 I don't like it, but regressing is bad. 17:46:41 * mboddu agrees with nirik and +1 blocker 17:46:46 +0.5 :( 17:46:47 If this turns out not to fix the issue, we need to find a way to do it. 17:46:50 bcotton: you just need to find the repo for my highly advanced fuzzy vote counter 17:47:04 +1 17:47:07 +1 17:47:40 adamw: is it written for quantum computing so it can do fuzzy physics too? 17:47:53 adamw: okay, maybe he needs some time to answer. He could be stuck in Alpha Centauri or something, without connection. 17:47:55 proposed #agreed 1697591 - AcceptedBlocker(Final) - This bug prevents a number of common hardware configurations (some generations of Intel graphics) from booting to a functional X server. 17:48:04 ack 17:48:17 ack 17:48:18 ack 17:48:25 ack 17:48:38 sure, ack 17:48:50 ack 17:48:51 #agreed 1697591 - AcceptedBlocker(Final) - This bug prevents a number of common hardware configurations (some generations of Intel graphics) from booting to a functional X server. 17:48:58 ack 17:49:15 one already accepted blocker: 17:49:18 #topic (1693409) gdm/X start fails on 'nomodeset' UEFI boot on multiple bare metal systems: "Cannot run in framebuffer mode. Please specify busIDs for all framebuffer devices" 17:49:20 #link https://bugzilla.redhat.com/show_bug.cgi?id=1693409 17:49:21 #info Accepted Blocker, xorg-x11-drv-vesa, ON_QA 17:49:28 i believe this is in RC1, too? 17:49:46 yes, and fix has been confirmed i believe 17:49:55 Oh, this again. 17:50:04 #info Fix is in RC1 and confirmed 17:50:18 well that's the end of our stalling tactics, back to the ones we passed on 17:50:25 just confirmed 2.4.0-6.fc30 is in rc1, so we're good there 17:50:44 oh, i was figuring we'd come back to them after deciding whether testing was sufficiently complete, or something 17:50:52 okay, we can do that :-) 17:51:11 #topic Current status — release candidate 17:51:13 * nirik has a radical proposal he can offer on the more testing front. 17:51:24 #info RC1 is available 17:51:26 nirik: no testing? :P 17:51:34 * Lailah is all years to nirik proposal 17:51:41 is all ears * 17:51:43 sorry 17:51:50 let's make rawhide beta quality, skip beta next time 17:51:54 nirik: is it that we don't release until RMS says it's good to go? 17:52:13 nirik: go ahead 17:52:21 RADICAL 17:52:28 radical sabbatical 17:52:39 say no go today due to lack of testing coverage. have next go/no-go monday. If go, release thursday. If no go next meeting thursday. 17:53:07 I suspect it will discombobulate everyone tho, since we have always done tuesday releases. 17:53:07 don't we have some rules somewhere about how long slips can be? 17:53:10 nirik: that is radical. let's discuss at the end if we decide to be No/Go 17:53:28 nirik: That is radical and I prefer Tue releases 17:53:41 so, anyway, formal assessment: 17:53:44 it's always tuesday somewhere in the galaxy… 17:53:48 we did, we relunctantly agreed we could release on non tue if we wanted (at least fesco did) 17:53:57 why do we have Tue releases ? is that just historical ? 17:54:05 matrices are mostly complete, we are missing install_to_sas as per ye olde traditions 17:54:17 cverna: Part of it for mirrors to pick up the content over the weekend 17:54:22 adamw: should i #topic Test coverage now? 17:54:30 oh yes, please 17:54:40 mboddu: ah ok :) 17:54:42 cverna: I wonder the same 17:54:47 #topic Current status — test matrices 17:54:49 #link https://fedoraproject.org/wiki/Category:Fedora_30_Test_Results 17:55:04 What's so special about Tuesday? 17:55:15 Taco day. 17:55:19 cverna: tuesday is the best day for press. 17:55:20 TRADITION! 17:55:27 It's unique cause is after monday and before wednesday 17:55:27 did i get a chair? can I #info ? 17:55:29 okay, let's leave tuesday alone for a moment so adamw can wow us with test reports 17:55:32 weekend gives time for mirrors to sync up and stage content 17:55:39 you can info iirc, but i'll chair you anyway 17:55:42 #chair adamw 17:55:42 Current chairs: adamw bcotton 17:55:42 Lailah: Cheaper movie tickets to celebrate :) 17:55:52 #info matrices are near completion 17:55:55 sgallagh: Does Fedora comes with tacos if released on Tuesday? 17:55:59 #info install_to_sas is missing like it always is 17:56:13 #info install_to_fcoe (fiber channel) is missing as our one tester with access to HW to test it hasn't done it yet 17:56:41 (i'm impressed that fcoe is even a thing we have on the matrix) 17:56:46 #info realmd_join_kickstart for Active Directory is missing, but all other combinations have been tested which we usually figure means that will work too 17:56:49 Lailah: fedora only comes with the source code to make your own tacos (GPLv3) 17:56:50 we are starting the 30 cycle we could decide to release all 3X on Thursdays :P 17:57:03 Lailah: oh sorry, i meant gentoo :P 17:57:13 #info xen_paravirt is missing, i am trying to run that ATM 17:57:26 bowlofeggs: now I'm confused... will I get tacos or not? 17:57:31 Yeah, if the FreeIPA kickstart join works and the Cockpit AD join works, there shouldn't be any codepath the AD kickstart can fail on 17:57:52 xen_paravirt and fcoe have not been run throughout the f30 cycle, so those worry me a bit 17:58:35 * nirik meant to install on his macbook, but didn't get around to it. ;( 17:58:42 adamw, I started to run the xen test at the start of the meeting, have hit a roadblock but dont want to say anything just yet... 17:59:35 Okay, guys, sorry, but I have to go. See you in a bit. 17:59:48 coremodule: the roadblock being you can't get a xen kernel booted? 17:59:52 yeah, i think it hasn't been ported to BLS 18:00:16 aye, tis the one 18:00:49 so, it's looking like xen is at least somewhat busted. 18:01:20 xen is a kind of standing pain in the ass 18:01:28 That's us running in a Xen guest or as a Xen host? 18:02:03 'domU' 18:02:11 which i think in Xen-speak means it has to work as a guest, right? 18:02:15 'guest' 18:02:16 yes 18:02:25 Right, our blocker criteria is about running as a guest 18:02:26 so i guess this doesn't technically violate it, but unless me and coremodule can work around the problem we dunno if it works as a guest yet 18:02:41 so anyway, so far as coverage goes...this isn't covered yet 18:02:50 so i would say we are close to sufficient coverage but not there yet 18:02:59 we can probably get everything but FCoE tested by later today 18:03:10 (i guess just xen) 18:03:17 yeah, I'm going to keep messing with it till i can figure something more concrete out 18:03:40 any other questions or comments on test coverage? 18:03:51 coremodule: probably just hacking up a /boot/loader/entries file for it would do the trick 18:03:57 however 18:04:10 #info on formal test matrix coverage, we are nearly complete but missing two things, one of which can be complete by end of day 18:04:46 #info on not-so-formal test coverage, QA is concerned that this RC has only existed for less than a day, and has substantial changes compared to most recently nightlies (including a newer kernel version) 18:05:17 #info we have not yet had sufficient time to fully investigate the proposed initial-setup blocker bug 18:05:29 over 18:05:37 thanks, adamw 18:06:12 To report, I installed KDE, pulled the plug, rebooted and i-s worked fine. 18:06:32 So the problem is not generic to all devices with unplugged network cables 18:06:46 i kinda figured it wasn't, it has to be something weirder 18:06:48 sure is weird though 18:06:59 alright, let's get back into the paused blockers 18:07:02 perhaps it's 'no network device at all' 18:07:08 maybe others have thoughts about test coverage first? 18:07:11 nirik: no, we tried that. 18:07:24 nirik: I tried that first 18:07:30 ok. 18:07:33 nirik: it worked for sgallagh and also the code that crashes definitely should crash when there *is* a device, not when there *isn't* one. 18:07:39 adamw: i asked. no one took the bait :-) 18:07:49 I'd definitely like to see more general testing, especially given all the kernel changes. 18:07:52 (it crashes if there's a device but networkmanager gives us None when we ask it for a 'hardware_address' and/or 'permanent_hardware_address') 18:08:09 bcotton: sorry, i'm in thrashing-around mode here :P 18:08:10 I'd definitely support delaying the decision by one day to make QA more comfortable 18:08:21 adamw: we need to work on your threading :-) 18:08:29 But as of right now, I'm not strongly swayed that we need to respin. 18:08:33 #topic (1703152 revisited) initial-setup fails with no network - AttributeError: 'NoneType' object has no attribute 'upper' 18:08:33 from puiterwijk import cluster_mode 18:08:42 yeah, we could just keep the meeting open... 18:09:14 i think i'd be happy with an extra day to make the call regardless whether we respin, yes 18:09:38 i think if we can figure out a fix for ksieve relatively fast i'd like an rc2 with ksieve and the initial-setup bug fixed, as an option... 18:09:45 Yeah, I agree with it, wait until tomorrow for QA to be more comfortable 18:09:46 but we can decide that part later i guess 18:09:57 yeah, let's decide on this last two blockers first 18:10:27 well, I don't think we have enough info to decide right now, do we? 18:10:44 At least not on initial-setup one 18:11:05 if we choose not to decide, we still have made a choice 18:11:10 the funny thing there is, it's probably easier to just *fix* it than figure out why it's happening 18:11:12 the fix is super easy 18:11:17 For Ksieve, either we can remove the package (which is easier) or fix it 18:11:18 it's just the cost of respinning for it that sucks 18:11:25 mboddu: removing the package may not be practical 18:11:29 that's what we need to figure out next 18:11:30 (if we don't decide now, we're deciding it's a rejectedblocker) 18:11:31 bcotton: Rushing to judgement? 18:11:42 sgallagh: peart-y much 18:11:51 well, we can accept them as FEs then ignore the rule that we don't respin for FEs only :P 18:11:56 so: a) keep meeting open, reconvene tomorrow same time and discuss again, b) no go today due to lack of coverage testing, reconvene tomorrow again at same time 18:11:58 (which we've done once or twice before) 18:13:00 I'd be fine with just deleting the .desktop file for KSieve if everyone else thinks that's actually worth blocking on. 18:13:11 The package can stay (so we don't have to worry about its deps) 18:13:14 hey, a respin is between QA and RelEng. I just want to cross these two off the list 18:13:15 adamw: Ahhh, I like the idea (less work for me) but I dont like it (principles) :( 18:14:07 bcotton: I am happy to respin if we have the fixes in time 18:14:09 well, are we sure other things that depend on KSieve also actually work? 18:14:14 If we're respinning for FEs, I'd like the swid-tags one in 18:15:01 we could call this a blocker just for the purposes of getting a resping 18:15:37 sgallagh: which one was that 18:15:43 bcotton: yeah, process jutsu! 18:15:47 now you're thinking like a monkey 18:15:56 https://bugzilla.redhat.com/show_bug.cgi?id=1703066 18:15:58 I am -1 blocker for the initial-setup issue. I think it can be documented for the affected hardware. Also no one has noticed it prior to this morning. 18:16:03 (it's only proposed, not accepted) 18:16:09 pwhalen: but PROCESS JUTSU 18:16:10 adamw: https://bugzilla.redhat.com/show_bug.cgi?id=1703066 18:16:13 🙊 18:16:19 Right that one 18:16:24 adamw, everything else has been kung fu kicked 18:16:26 that is the current topic in fact :P 18:16:28 ^swid-tags 18:16:32 A topic that is not really for this meeting but I would like to see, is how to get the new boot experience on installs that you upgrade 18:16:39 i am also -1 blocker, +1 FE 18:16:56 * nb agrees with bcotton, -1 blocker +1 FE 18:16:56 nb: there was info on that in the feature page or on the devel list. 18:17:20 that one has enough votes to be accepted, i just marked it as such 18:17:45 i am not yet convinced enough about the exact causes of this to be -1 blocker on it 18:17:56 i'd be a lot happier monkey if it was fixed, given how simple the fix is. at least if i'm right about that 18:18:02 (pwhalen is testing it for me) 18:18:11 * pwhalen goes back to that 18:18:18 testing the proposed fix? 18:18:26 we just don't know where this None return is coming from and whether anaconda could hit it too somehow 18:18:34 bcotton: yeah 18:18:47 shall we skip this one again and hit the other one? 18:18:58 while pwhalen tests 18:19:45 sure 18:19:48 well, let's at least agree that it's FE? 18:19:53 everyone's +1 FE i guess 18:20:02 I guess I am +1 FE for initial-setup 18:20:27 +! FE 18:20:33 +1 FE sure 18:20:34 +1 too 18:20:43 And +1 Blocker for KSieve (so that we can do a respin and include both these fixes including the swid-tags) 18:20:52 +1 FE for initial-setup 18:21:08 +1 fe for initial-setup 18:21:29 proposed #agreed 1703152 - AcceptedFreezeException(Final) - This appears to hit a narrow case, but can't be fixed in an update. We defer a decision on blocker status 18:21:43 ack 18:21:48 ack 18:21:49 ack 18:21:56 ack 18:21:58 ack 18:22:02 ack 18:22:06 #agreed 1703152 - AcceptedFreezeException(Final) - This appears to hit a narrow case, but can't be fixed in an update. We defer a decision on blocker status 18:22:23 #topic (1670396 revisited) KSieve fails to start 18:22:53 mboddu, i know you're +1 18:23:06 bcotton: Yes 18:23:24 it's pretty inarguable (although we should definitely finalize the "must be submitted before the meeting starts" rule) 18:23:27 +1 from me 18:23:42 voting +1 is committing us to a respin, i guess... 18:23:44 * nirik is kinda still -1 due to the time thing, but meh, I guess... 18:23:48 but i want one, so hey, +1 18:24:02 i might argue the time thing harder if i didn't want a respin and we'd ever actually put it in the damn wiki 18:24:07 adamw: Hehe, same reasons here :D 18:24:25 I'm worried that it's not going to be trivial to fix. 18:24:41 adamw: Although do we have a fix for it? 18:24:54 At least for initial-setup, we sorta have a fix 18:24:56 +1 18:26:04 okay, that's +4/-1 18:26:14 proposed #agreed - 1670396 - AcceptedBlocker(Final) - Violates "All applications that can be launched using the standard graphical mechanism of a release-blocking desktop after a default installation of that desktop must start successfully and withstand a basic functionality test." 18:26:44 ack 18:26:51 ack 18:26:53 ack 18:27:32 #agreed - 1670396 - AcceptedBlocker(Final) - Violates "All applications that can be launched using the standard graphical mechanism of a release-blocking desktop after a default installation of that desktop must start successfully and withstand a basic functionality test." 18:28:08 pwhalen: have test results for the initial-setup fix yet? 18:28:18 nirik: if we can't drop the package we can at least patch out the desktop file... 18:28:48 sorry, not quite 18:28:51 I guess, I'm worried that other things that use it are broken too. 18:29:28 pwhalen: is it worth waiting or should we just move on knowing it's already accepted as an FE? 18:29:58 nirik: if they don't use it at run time or in 'basic operation', we're fine. :P 18:30:25 bcotton, you can move on, I'll report to adamw in qa 18:30:29 ok 18:30:32 adamw: well, kdepim and kmail link to it's libraries... but might be when you pull up some seive pref or soemthing? 18:31:04 #topic Go/No-Go decision 18:31:30 so normally i'd just immediately start polling, but it sounds like we want to discuss our options 18:31:41 bcotton, adamw, that worked 18:31:45 nirik: that's what i'm assuming, yes. but i'll actually test kmail myself in a bit. 18:31:47 pwhalen: yay, thanks 18:31:48 pwhalen++ 18:32:04 it sounds like people were generally in favour of 'leave it a day', right? that's good for me 18:32:16 adamw: +1 18:32:27 i'm a little bothered by taking out a default app without giving the KDE team a chance to weigh in 18:32:46 * nirik is too 18:32:48 even though that's the shortest route to being technically in line with release criteria 18:32:49 pwhalen++ 18:32:50 mboddu: Karma for pwhalen changed to 9 (for the current release cycle): https://badges.fedoraproject.org/tags/cookie/any 18:32:55 * nb is a little bothered by blocking on KDE anyway 18:33:17 since that's not one of our default editions 18:33:18 nb well there's that, but that's not a decision we can make here 18:33:25 well, we have a blocker now, so it's no-go right now. 18:33:37 right 18:34:11 rdieter signed out 40 minutes ago 18:34:13 so the question becomes do we reconvene tomorrow or do we kick it to next week in order to engage with the kde team about their blocker 18:34:15 revote on Ksieve? :P 18:34:17 really should've poked him before them. sigh. 18:34:49 mboddu, I like that idea 18:34:55 since it was just proposed 18:36:11 well, our normal process is punt a week. Thats not great this time tho... 18:36:39 yeah, i've heard secondhand that a particular downstream would really like us to not release on the 7th 18:36:43 nirik: Yes, but we dont have the right fix for KSieve 18:37:06 right, we don't know what that is yet for sure... 18:37:52 so, I see our options as: a) try again tomorrow, b) try again monday for thursday release c) punt a week and not care about releasing on the 7th, d) punt 2 weeks! :) 18:38:11 okay, so let's do this. i'm going to 'proposed #agreed' that we're no-go because that's pretty clear. and then we can decide about tomorrow versus next week for the next decision 18:38:18 ack 18:38:22 ack 18:38:24 sure. 18:38:24 ack 18:38:26 ack 18:38:27 ack 18:38:33 ack 18:38:34 proposed #agreed Fedora 30 is NO-GO 18:38:42 look all all of those acks, okay! 18:38:43 ack 18:38:44 anyone else than rdieter could help untangle this? 18:38:50 ack 18:38:52 #agreed Fedora 30 is NO-GO 18:39:20 only 2 more releases until we have a power of 2 fedora version! 18:39:27 there's not been one of those in a while 18:39:35 and we get a prime number next too 18:39:44 bowlofeggs: 1 more branching, if you are on rawhide ;) 18:39:56 BTW, I found: https://pagure.io/fesco/issue/974 "change our release policy such that releases must be on Tuesday, Wednesday, or Thursday, but always pick Tuesday by default unless there's a specific reason not to" 18:40:15 tru 18:40:22 so...assuming we can get a compose to complete on time after whatever we do to fix the KDE bug, do we reconvene friday or next thursday? 18:40:34 kkofler isn't around any more 18:40:36 as much 18:40:51 we just push the .desktop file change to the compose? 18:41:05 Or something bigger? 18:41:37 I think others can test the dependent apps more and find the scope of the problem for sure. 18:42:15 What time would the koji build with the fix for pim-sieve-editor bug would have to finish? 18:42:18 tomorrow seems to early, we don't have a fix right now and the rc took half a day 18:42:29 jlanda: that's what i'm thinking 18:42:35 I do agree, tomorrow seems too soon 18:42:53 I like kevin's proposal 18:42:54 try again monday for thursday release 18:43:01 monday sounds feasible, if we hit a fix tomorrow 18:43:08 We can test and sync on weekend 18:43:20 Yep, Monday seems feasible. 18:43:35 nirik: Then what about mirrors? Are they gonna be happy? 18:43:45 But we need a fix tomorrow 18:43:48 ^ If we meet on Monday for Thu release 18:43:53 * mattdm parachutes in 18:44:07 * nb doesn't see why mirrors would be upset 18:44:08 I'm not sure if this is the right meeting to bring this up. This is NOT a blocker for f30 but f31+. is there a proposed solution for java packages that were affected: https://fedoraproject.org/wiki/SIGs/Stewardship 18:44:36 * bowlofeggs lays down supressing fire for mattdm to ward off non-free software 18:44:37 zbyszek: i am doing the anaconda fix right now 18:44:39 mboddu: if we stage monday, that gives 3-4days... just like if we staged friday 18:44:41 was gonna look at sieve next 18:44:48 dmoluguw: not the right meeting, sorry 18:45:02 bowlofeggs: hehe nice 18:45:10 i'm not opposed to tomorrow tbh 18:45:19 an RC2 with only specific targeted fixes is less scary than RC1 was for me 18:45:31 and i do think we can get something done about both i-s and sieve in the next hour or two 18:45:32 adamw: How targeted are we talking? 18:45:37 mattdm, what are your thoughts? we are discussing having a go/no-go tomorrow or having one monday and then if monday, having thursday release 18:45:48 Just i-s and sieve, or also some FEs? 18:45:55 sgallagh: i-s, sieve, the swid thing i guess 18:46:01 Cool, thanks. 18:46:07 * adamw is writing the i-s patch now 18:46:10 thursday release would be worth doing in this case, I think 18:47:04 I have been, ehm, Suggested To that Red Hat marketing would be fairly unhappy if we release during RH Summit 18:47:11 * nirik nods 18:47:35 but it'd also be nice to have it out the door to give out / talk about _at_ Summit 18:48:17 mboddu: you seemed opposed when this was brought up earlier. is releng okay with a thursday release? 18:48:21 yeah, thats why I was suggesting a thursday release. 18:48:33 but if we cna go tomorrow we could try for tuesday 18:48:45 bcotton: Yeah, I am okay with it, but I think we should try for Tue 18:48:47 i'd like to keep the option open 18:49:03 shall we agree to reconvene tomorrow, and if we're no-go then, we can consider thursday? 18:49:09 okay, so what i'm hearing is that we'll do this again tomorrow and if that doesn't work, we'll try again on monday? 18:49:35 That sounds like our most versatile option 18:49:40 worst case tomorrow will be a quick meeting or could even be just emails? 18:49:44 and monday might be okay for a release _that_ thursday? (The 9th?) 18:50:03 Since there is only one blocker remaining, lets try RC 1.2 with i-s,KSieve,swid-tags fixes tonight, and if we face lot of issues with .desktop file for KSieve fix, then based on the testing, we can revote on KSieve and *probably* release RC 1.1 18:50:38 pingou: yeah, i'll check with folks in the (US Eastern) AM to see. if it's clear that anyone will be no-go, I'll cancel it 18:50:46 mboddu: yeah, that's basically what i'm thinking 18:50:49 let's have rc2 as an option 18:51:16 mattdm: No, we're talking about monday for releasing the 2nd 18:51:37 mboddu: +1 18:51:50 proposed #agreed Next Go/No-Go meeting will be on Friday 2091-04-26 at 1700 UTC in #fedora-meeting-1. bcotton will cancel the meeting if it's clear the decision will be No-Go and we will try again on Monday 29 April 18:51:50 * nirik is on board with that. 18:51:54 ack 18:51:59 nack 18:51:59 ack 18:52:02 2019 18:52:06 :) 18:52:08 ack 18:52:09 it does mean more churn/heroics/meetings 18:52:16 nb, we're slipping big time 18:52:25 btw, does anyone in this meeting have an FCoE setup in their back pocket? 18:52:33 proposed #agreed Next Go/No-Go meeting will be on Friday 2019-04-26 at 1700 UTC in #fedora-meeting-1. bcotton will cancel the meeting if it's clear the decision will be No-Go and we will try again on Monday 29 April 18:52:35 ack 18:52:35 * adamw puts on cape 18:52:36 ack 18:52:42 (same as above but with the right year) 18:52:48 ack 18:52:53 adamw: think of it as your "dodging red hat summit cape" 18:52:53 patch 18:52:58 sgallagh: go ahead 18:53:14 proposed #agreed Next Go/No-Go meeting will be on Friday 2019-04-26 at 1700 UTC in #fedora-meeting-1. bcotton will cancel the meeting if it's clear the decision will be No-Go and we will try again on Monday 29 April with a new release date of Thu May 02 18:53:23 ack 18:53:28 ack 18:53:30 ack 18:53:30 ack 18:53:35 ack 18:53:35 Well, the date formats are inconsistent, but the point is made 18:53:39 ack 18:53:47 ack 18:54:09 nack ISO date standards required 18:54:14 :P 18:54:15 ok fine, ack 18:54:17 adamw is a hero that *does* wear a cape 18:54:18 sorry adamw, i couldn't hear you 18:54:21 .fire adamw for pedantics 18:54:21 adamw fires adamw for pedantics 18:54:22 #agreed Next Go/No-Go meeting will be on Friday 2019-04-26 at 1700 UTC in #fedora-meeting-1. bcotton will cancel the meeting if it's clear the decision will be No-Go and we will try again on Monday 29 April with a new release date of Thu May 02 18:54:36 sgallagh: i mean if you could be fired for being pedantic i wouldn't have lasted two weeks 18:54:47 neither would have sgallagh! 18:54:53 or jcline 18:54:56 #action bcotton to announce decision 18:55:05 Or anyone who just listed a person who would fail that test :-P 18:55:09 .hello2 18:55:10 x3mboy: x3mboy 'Eduard Lucena' 18:55:30 #action adamw to finish implementing "late blocker submission" change to the policy 18:55:42 you can't make me! 18:56:13 adamw: ssshhhhh. nobody is supposed to know i'm powerless 18:56:24 I'm not *always* pedantic 18:56:38 anything else to say before we see each other again in 22 hours (and also in 4 minutes for the release readiness meeting)? 18:57:03 jcline pointed out, pedantically 18:57:18 bcotton: "see you soon"? 18:57:22 sgallagh: haha 18:57:35 zbyszek++ 18:57:36 bcotton: Karma for zbyszek changed to 10 (for the current release cycle): https://badges.fedoraproject.org/tags/cookie/any 18:57:36 I didn't say I wasn't being pedantic there 18:57:38 See ya everyone in 3 min :) 18:57:55 jcline pointed out, pedantically 18:58:08 time for some la croix 18:58:24 use those 3 minutes wisely! 18:58:24 #endmeeting