17:00:30 #startmeeting F29 Beta Go/No-Go meeting 17:00:30 Meeting started Thu Sep 13 17:00:30 2018 UTC. 17:00:30 This meeting is logged and archived in a public location. 17:00:30 The chair is bcotton. Information about MeetBot at http://wiki.debian.org/MeetBot. 17:00:30 Useful Commands: #action #agreed #halp #info #idea #link #topic. 17:00:30 The meeting name has been set to 'f29_beta_go/no-go_meeting' 17:00:32 #meetingname F29-Beta-Go_No_Go-meeting 17:00:32 The meeting name has been set to 'f29-beta-go_no_go-meeting' 17:00:38 #topic Roll Call 17:00:42 .hello psabata 17:00:43 contyk: psabata 'Petr Šabata' 17:00:45 .hello2 17:00:46 frantisekz: frantisekz 'František Zatloukal' 17:01:24 .hello2 17:01:25 bowlofeggs: bowlofeggs 'Randy Barlow' 17:01:34 .hello adamwill 17:01:35 adamw: adamwill 'Adam Williamson' 17:01:38 hello 17:01:48 .hello mohanboddu 17:01:49 mboddu: mohanboddu 'Mohan Boddu' 17:02:43 morning 17:03:01 i see we have at least one person here from FESCo, RelEng, and QA, so let's go ahead and get this party started 17:03:12 #topic Purpose of this meeting 17:03:14 #info Purpose of this meeting is to check whether or not F29 Beta is ready for shipment, according to the release criteria. 17:03:26 #info This is determined in a few ways: 17:03:27 #info 1. No remaining blocker bugs 17:03:35 #info 2. Release candidate compose is available 17:03:36 #info 3. Test matrices for Beta are fully completed 17:04:09 so we still have several proposed and one accepted 17:04:27 #topic Blockers 17:04:34 #link https://qa.fedoraproject.org/blockerbugs/milestone/29/beta/buglist 17:05:04 do we want to do a quick blocker review on these 7? 17:05:18 * contyk nods 17:05:33 bcotton: Yes 17:05:54 okay, here's the first 17:05:56 #link https://bugzilla.redhat.com/show_bug.cgi?id=1592686 17:06:13 shall I do it? 17:06:21 go ahead, adamw 17:06:27 #chair adamw 17:06:27 Current chairs: adamw bcotton 17:06:40 bcotton: for future reference, you can get the magic Official Format at https://qa.fedoraproject.org/blockerbugs/milestone/29/beta/irc 17:06:49 well, change the 29/beta of course :) 17:06:53 fancy. duly noted 17:06:58 go to http://qa.fedoraproject.org/blockerbugs/current then click 'IRC Format' 17:07:09 we have: 17:07:09 #info 7 Proposed Blockers 17:07:09 #info 1 Accepted Blockers 17:07:16 #info starting with proposed... 17:07:21 #topic (1592686) the installer will hang there if inst.vncpassword boot option is added 17:07:21 #link https://bugzilla.redhat.com/show_bug.cgi?id=1592686 17:07:21 #info Proposed Blocker, anaconda, NEW 17:07:41 as noted in bug i'm -1 blocker on this, it's been around quite a while but it's specifically in vncpassword, regular vnc works ok 17:07:46 I think I agree with adamw 17:08:01 -1 17:08:13 -1 Blocker 17:08:13 -1 17:08:16 -1 here too 17:10:24 proposed #agreed 1592686 - RejectedBlocker (Beta) - this only affects passworded VNC, and the criterion doesn't require that to work, just 'VNC'. which does work 17:10:36 ack 17:10:47 +1 to the proposal 17:11:01 +1 17:11:04 .hello2 17:11:05 lruzicka: lruzicka 'Lukáš Růžička' 17:11:20 sorry about being late, was feeding dog 17:11:38 ack 17:12:34 #agreed 1592686 - RejectedBlocker (Beta) - this only affects passworded VNC, and the criterion doesn't require that to work, just 'VNC'. which does work 17:12:44 #topic (1596540) RuntimeError: C++ std::exception: Exec failed: no such table: main.trans_cmdline 17:12:44 #link https://bugzilla.redhat.com/show_bug.cgi?id=1596540 17:12:44 #info Proposed Blocker, dnf, ASSIGNED 17:12:50 so...this one has a bit of a history. 17:13:31 it was originally accepted as a blocker. that was shortly after https://bugzilla.redhat.com/show_bug.cgi?id=1596540#c30 , which suggested dmach (dnf dev) had a clear reproducer and would be able to fix the bug 17:13:38 the bug then just sat there for a few weeks 17:13:59 when we followed up with dnf folks, it turns out they actually *don't* have a clear reproducer and are quite baffled as to how this happened. 17:14:12 see https://bugzilla.redhat.com/show_bug.cgi?id=1596540#c36 17:15:01 Yeah, I can't reproduce and I tried a lot of things 17:15:09 i sent out an email asking for folks who are still having this issue or any other history-related dnf 3 crasher to reply, and didn't get much 17:15:26 * nirik has not seen this hear either 17:15:30 well, according comment 43, I'm worried that an upgrade from f28 could hit this? 17:15:42 I haven't tried reproducing this myself, though I keep hearing about it 17:15:43 It's pretty clear that dnf needs to be much more robust in the face of a bad or corrupt history file 17:15:55 but I'm not sure that that's a blocker 17:15:57 I never hit that issue 17:16:02 contyk: I did a bunch of upgrades in containers 17:16:08 but not on real systems (or vms) 17:16:21 i tried from f28 and from older (f26) 17:16:34 openqa does do upgrades, but probibly not with modules installed or corner cases. 17:17:02 that modules bit is a fair point 17:17:12 mattdm: have you tried upgrading from module-enabled f28? 17:17:12 nirik: We are not testing modules in OpenQA yet 17:18:26 mattdm: well, there's the question of how these files are becoming 'bad' or 'corrupt' in the first place 17:18:35 since it seems apparent that whatever dnf the reporters had before was fine with it. 17:18:41 anyhow. 17:19:00 wasn't there a change in the history format in v3? 17:19:06 yes. lots of them. 17:19:06 adamw, the dnf team changed the structure of the database file. 17:19:11 i know that. 17:19:18 but it's the question of how exactly they're handling the migration 17:19:33 adamw, well, that I dont know 17:19:36 i don't think they've explained that to us, and i don't think any of us has actually looked at it in detail 17:19:37 right. 17:19:45 contyk: I can try 17:20:03 (on my long-existing system, it seems like /var/lib/dnf/history.sqlite is in the new format, and my old files are somehow 'archived' in subdirectories, but that's as far as i've looked into it so far) 17:20:22 mattdm: that would be great; try installing a module and see what it does :) 17:20:35 adamw, I remember know, dmach told me, that the new database has been placed in a new location, so it should not interfere. 17:20:37 I'd be inclined to say -1 blocker for beta, but +1 for final... ie, more robust handling 17:20:51 lruzicka: hrmm. 17:21:14 lruzicka yeah, the history.sqlite is the new location. the history subdir with filename with the date in it is the old 17:21:23 i think my opinion is somehow that i'm -1 on this as a specific blocker but i have a sort of spidey sense reluctance about the whole state of the dnf we have in beta currently... 17:21:48 * nirik nods. 17:22:04 (wheee not getting network in my container for some reason. computers are fun) 17:22:07 * bowlofeggs double nods 17:22:09 adamw: yes, same feeling 17:22:12 I have a bad feeling about this one so can't really say I'm against marking it as a beta blocker; on the other hand there's currently no reproducer, apparently 17:22:38 on the other hand, my confidence that sticking some newer dnf in it would fix all problems without creating any new ones is...not high. :P 17:22:44 on the gripping hand, computers are fun. 17:22:45 for this particular one, i've not seen it happen and i do have some f29 and f30 systems that have been upgraded from older releases 17:22:53 which doesn't say much 17:23:17 so it sounds like we don't have a solid reason to accept it as a blocker. just a collective sense of dread 17:23:21 I've never hit this on rawhide, but then rawhide has a newer dnf now. 17:23:44 a sense of free floating doom. 17:23:56 haha 17:23:58 -1 beta blocker 17:24:41 if there's no reproducer, it seems reasonable even if risky to -1 blocker and get a larger test pool to understand the problem better 17:25:56 alright, -1 beta blocker 17:26:18 unless mattdm makes his container work and tells us it's broken with modules :) 17:26:19 let's go back to having release names 17:26:22 I agree, -1 Blocker 17:26:27 and call this one "A Sense Of Free-Floating Doom" 17:26:36 contyk: well, i got phase one right. 17:27:00 ha 17:27:22 proposed #agreed 1596540 - RejectedBlocker (Beta) - we're all sort of worried about dnf in general and a little about this bug in particular, but as lots of people *didn't* hit it and no-one has found a clear reproducer yet, we don't feel like we can reasonably count it as a blocker at this point 17:27:23 * cmurf feels nostalgic about release names 17:27:33 ack 17:27:36 ack 17:27:40 ack 17:28:01 so, f28 container, installed module repo, installed a random module (stratisd fwiw), running dnf upgrade with releasever=29, in progress... 17:28:01 ack 17:28:28 warning: %triggerpostun(info-6.5-10.fc29.x86_64) scriptlet failed, exit status 1 17:28:30 Non-fatal scriptlet failure in rpm package libgcc 17:28:32 Non-fatal scriptlet failure in rpm package libgcc 17:28:36 unreleated but ugly :) 17:28:43 ack 17:28:50 that all went fine. dnf history works after. 17:28:54 so... ack 17:28:58 #agreed 1596540 - RejectedBlocker (Beta) - we're all sort of worried about dnf in general and a little about this bug in particular, but as lots of people *didn't* hit it and no-one has found a clear reproducer yet, we don't feel like we can reasonably count it as a blocker at this point 17:29:00 mattdm: thanks 17:29:08 mattdm++ 17:29:53 #topic (1625259) RuntimeError: TransactionItem not found for key 17:29:53 #link https://bugzilla.redhat.com/show_bug.cgi?id=1625259 17:29:53 #info Proposed Blocker, dnf, ASSIGNED 17:30:02 -1 beta blocker 17:31:29 -1 17:32:44 -1, it seems not to break the installation and removal ability 17:33:15 seems like we could reuse the text from the previous proposed blocker for this one 17:33:28 the duplicate bug sounds worse than the bug we're discussing 17:33:32 https://bugzilla.redhat.com/show_bug.cgi?id=1627534#c1 17:33:42 note that zbyszek reported that it left duplicate packages in plce 17:33:53 c8 requests an assessment, but one isn't in bug - is an assessment available to estimate the upgrade risk? 17:33:59 so it might not just be a harmless traceback 17:34:01 I think you can fix that with dnf remove --duplicates or somesuch 17:34:24 I mean it's bad but not a blocker from my point of view 17:34:41 if there's a work around that isn't onerous (haha reinstall!) then my inclination is -1 blocker 17:34:42 "The installed system must be able appropriately to install, remove, and update software with the default console tool for the relevant software type (e.g. default console package manager). This includes downloading of packages to be installed/updated." 17:34:49 ^beta 17:34:50 to me, leaving dupes means it fails that criteria 17:35:06 i would argue it's not "appropriate" to leave dupes 17:35:16 bowlofeggs: i have new thoughts about that 17:35:33 bowlofeggs: i now suspect zbyszek *already had* dupes, and that may in fact have triggered the bug 17:35:37 https://bugzilla.redhat.com/show_bug.cgi?id=1627534#c3 17:35:44 ooo 17:35:45 ah, makes sense. 17:35:47 adamw: oh interesting 17:35:54 looking carefully at the transaction log and the 'rpm -qa' output, there are *three* version of libvirt-daemon referenced. not just two. 17:36:09 * nirik is -1 blocker on this, but it adds to sense of peril. 17:36:22 very skilled sleuthing 17:36:28 adamw: oh yeah good call 17:36:31 ok i'm -1 then 17:36:57 I am -1 Blocker 17:36:57 though, how'd those dupes get there - is *that* a dnf bug too :o 17:37:03 off topic i gueass 17:37:24 probably the old 'update crashed' or something along those lines 17:37:26 Fedora 29 - "A Sense Of Free-Floating Doom" 17:37:28 hahah 17:37:38 adamw: oldest trick in the book 17:37:44 hehe 17:38:19 bowlofeggs: Haha :) 17:38:32 (it was adamw's joke ☺) 17:38:36 proposed #agreed 1625259 - RejectedBlocker (Beta) - again this is quite worrying, but with careful analysis of zbyszek's case, we still don't believe this is affecting 'normal', criteria-covered operations, only downgrades and possibly cases where the RPM database has existing duplicate entries 17:38:43 well, nirik's words. 17:38:44 ack 17:38:45 ack 17:38:51 ack 17:38:51 ack 17:39:01 #agreed 1625259 - RejectedBlocker (Beta) - again this is quite worrying, but with careful analysis of zbyszek's case, we still don't believe this is affecting 'normal', criteria-covered operations, only downgrades and possibly cases where the RPM database has existing duplicate entries 17:39:07 oh yeah, nirik++ 17:39:56 okay, you may wish to hide your breakable valuables before this next one 17:39:59 #topic (1628525) F29 KDE Live contains old wallpaper from F28 17:39:59 #link https://bugzilla.redhat.com/show_bug.cgi?id=1628525 17:39:59 #info Proposed Blocker, f29-backgrounds, NEW 17:40:03 SERIOUSLY EVERY GODDAMN TIME 17:40:11 ha ha ha ha ha. only not funny 17:40:23 we should move that wallpaper criteria to final :) 17:40:36 just wait for the obligatory once per release fwraid bug ;-) 17:40:37 * langdon wonders how badly he will get hurt if he types +1 to blocker 17:40:48 oh, i'm +1 blocker 17:40:59 ha 17:41:02 purely because i intend to keep this as painful as possible until someone fixes the fking wallpaper process 17:41:10 +1 17:41:14 perhaps, one day, it will be the f30 wallpapers in f29 17:41:22 * nirik said he would a few years ago... and then did not. 17:41:34 we keep tweaking the criterion to make it, like, as low as possible a bar to get over 17:41:44 it doesn't even have to be the *right* wallpaper any more, just a *different* wallpaper 17:41:57 hehe 17:41:59 yeah, even if this is a beta, it should be distinguishable from the previous version 17:42:02 +1 Blocker 17:42:09 the idea of that was so we could do 'unstable wallpaper' and 'stable wallpaper' so even in the worst case, the betas would just have the 'unstable wallpaper' and that'd be OK 17:42:16 +1 17:42:20 only we didn't even implement *that* 17:42:22 although like frantisekz says, I would worry about this for GA, not for beta 17:42:36 does unstable wallpaper jitter? 17:42:41 * adamw goes and checks there are no outstanding proposals to move the criterion 17:42:56 langdon: it also looks at you funny and is gripping a glass very tightly 17:42:58 much like me 17:43:06 ha 17:43:33 sadly +1, but I will cry if this is the only reason we are blocking. 17:43:41 is this the only blocker? 17:43:52 we have one accepted 17:44:02 +1 blocker 17:44:41 Southern_Gentlem: nah, we have fwraid coming up too 17:44:48 adamw: does the glass ever shatter? 17:44:53 +0 17:44:54 *cracks appear* 17:45:30 at least the fwraid bug is badass, in that it still has us stumped 12 hours later 17:45:34 this isn't funny. i once destroyed a laptop by accidentally squeezing a water glass to death. ;-) 17:45:44 Is this only in KDE? 17:45:51 proposed #agreed 1628525 - AcceptedBlocker (Beta) - this is a clear violation of Basic criterion "The default desktop background must be different from that of the last two stable releases" for the release-blocking KDE live image 17:45:56 mattdm: yeah. 17:45:57 the wallpaper is in the category of cat pics on the internet, srsly wtf? 17:46:03 mattdm: Workstation has the new background 17:46:10 adamw: Cant we just propose this wallpaper thing as FE for beta and blocker for final? 17:46:30 mattdm: because life is awful, backgrounds don't work the same on all desktops and KDE needs to do some special further change that we don't need for the new backgrounds to show up in Workstation 17:46:31 So that by beta if its not done, we can ask people to work on it by final 17:46:38 Proposal: only block on this for Editions; drop from any non-edition blocker artifacts. 17:46:44 (at least for beta) 17:46:46 mboddu: i don't see how we do that without a criteria change 17:46:52 mattdm: whoah, that's a pretty big change right there 17:47:02 mattdm: that's an entirely new concept for the criteria / release process 17:47:10 right now we have the concept of 'release blocking' or not... 17:47:19 and criteria specific to some image or edition... 17:47:26 but no concept of 'this applies only to editions' 17:47:33 i mean, not that we can't do that, but it's not a casual criterion tweak 17:47:46 or stop blocking on kde, but thats also a big change 17:48:00 Eh, ok, I see that. The less invasive way is to say that it only blocks Workstation edition? 17:48:06 mboddu: as the criteria stand this is a pretty non-fudgeable violation 17:48:15 yeah. as much as i hate that this is a blocker, changing our requirements so that it isn't is out of scope for this meeting, imo 17:48:15 mattdm: that would be a bit more in line with what we currently have 17:48:34 adamw: Okay, then we have to deal with it I guess 17:48:36 I mean, in the interest of time, let's go with that then. I think having the entirely-new-concept is probably also good 17:48:40 bcotton: it's something we've done before, but usually only in the style of 'tweak this criterion to cover X' or 'not cover Y' or 'move from beta to final' 17:48:46 well, there's also Xfce on arm that has to have the new desktop (but it should) 17:49:09 the other option is, just push this criterion to Final. i mean, pace my hatred of this perpetually broken process, there's a reasonable argument for that. 17:49:20 haha 17:49:24 of course it only buys us one release and just means that for F30 no-one will notice this until Final and then we'll slip Final, but hey. 17:49:38 you could also just have ~3 rules.. blocks wkstn; blocks server; blocks cloud^watomic^wsilverblue^wsomethingSomething 17:49:39 adamw: right, that seems worse 17:49:40 nirik: yeah, I think xfce is usually okay 17:49:47 Based on the criteria, I am +1 Blocker, but I hate blocking the release based on a wallpaper 17:50:08 it just uses the symlink in the desktop-compat package 17:50:16 it's kde that's weird 17:50:28 think instead of blocking the release because fedora is getting in touch with its artful muse 17:50:29 what if we table this bug and evaluate the rest? if there are other blockers, there's no harm accepting this. if it's the only blocker, then we have to make a decision 17:50:36 We can punt for now, solve the rest of the bugs and if there is nothing to block, we can discuss again 17:50:43 bcotton, exactly 17:50:51 yeah, that's also an option 17:50:51 lruzicka you're a genius :-) 17:50:53 don't we still have the r-pi bug also? 17:50:56 in other words, we argue about fwraid first 17:50:59 nirik: yes 17:50:59 nirik: rc2 should've fixed that 17:51:07 if it even finished building yet 17:51:19 but yeah, it'll come up in 'accepted blockers', since that's what it is 17:51:24 nirik: RC2 should fix the r-pi3 bug 17:51:28 yes, I know 17:51:48 but we don;'t even really have that yet. ;) 17:52:13 I have a different meeting I need to go to. burn fwraid with fire. 17:52:20 so, yeah, that's worth flagging up: we're gonna struggle to be Go in this meeting even if we wind up with no new blockers, given that the thing we'd want to ship doesn't even exist yet. 17:52:30 yep 17:52:45 anyhow, shall we go with the 'run through the other bugs then come back to this' idea? 17:52:50 yes 17:52:52 yes 17:52:58 yep 17:53:07 #info we're going to postpone discussion on this bug and whether to propose a criterion change till after we've been through the others 17:53:19 #topic (1626932) Error getting active session: No data available 17:53:19 #link https://bugzilla.redhat.com/show_bug.cgi?id=1626932 17:53:19 #info Proposed Blocker, gnome-shell, NEW 17:53:21 -1, simple one. 17:53:25 -1 17:53:45 -1 17:53:53 the actual error message is i think just an artifact of shutdown order (vdagent is unhappy for a short time while the session is shutting down), 'it logs out a bit slower than before' is not a blocker issue. 17:54:12 -1 blocker 17:54:20 -1 17:54:34 -1 17:55:17 -1 Blocker 17:55:49 proposed #agreed 1626932 - RejectedBlocker (Beta) - the state of this issue with Beta RC1 as described in comment #7 clearly doesn't violate any criteria 17:55:56 ack 17:55:57 ack 17:56:03 ack 17:56:20 ack 17:56:25 ack 17:56:27 #agreed 1626932 - RejectedBlocker (Beta) - the state of this issue with Beta RC1 as described in comment #7 clearly doesn't violate any criteria 17:56:28 ack 17:56:45 #topic (1628497) gnome-software shows upgrade banner for Fedora 28 instead of Fedora 29 17:56:45 #link https://bugzilla.redhat.com/show_bug.cgi?id=1628497 17:56:45 #info Proposed Blocker, gnome-software, NEW 17:56:49 if I understand this correctly, it's just about gnome-software, not upgrades being broken in general 17:56:52 so -1 17:56:55 yeah 17:57:05 well 17:57:24 note the footbote 17:57:26 footnote 17:57:31 "This criterion applies to the recommended upgrade mechanisms only." 17:57:39 with a link to https://fedoraproject.org/wiki/Upgrading 17:57:54 which specifically recommends the GNOME Software upgrade for Workstation 17:58:02 does it mean that all of them have to be working? 17:58:30 *direct upgrade* 17:58:36 i'd say it means that for each release-blocking edition/image/whatever, the recommended upgrade method for that edition/image/whatever should work. 17:58:43 adamw, maybe we should redefine the criteria, because it is much worse if the upgrade banner points to a wrong version than an old wallpaper 17:58:56 :) 17:58:56 does that mean F27 -> F29, rather than intermediate upgrade which is F27->F28->F29 which is essentially what's on offer? 17:59:07 cmurf: yes. 17:59:24 we had a debate about which one g-s should offer, and the verdict was, direct upgrade. 17:59:28 hum... this would mean we don't get testing of this upgrade method 17:59:40 but we could hopefully fix it in an upgrade. 17:59:43 my memory is fuzzy but i'm pretty sure Workstation WG explicitly wanted direct upgrades, but I'm not sure if it was intended to block beta or final 18:00:00 note if we accept this it'd in all likelihood be an AcceptedPreviousReleaseBlocker 18:00:10 meaning it doesn't block the f29 compose, but rather it must be fixed in f27 by f29 release daty 18:00:16 * frantisekz will be away for ~30 mins 18:00:17 gotcha 18:00:36 what are the chances of that? 18:00:48 getting it fixed? dunno 18:00:52 don't think we know what the problem is, yet 18:00:58 what happens if it's not fixed by that date? 18:01:02 i'd be interested in what happens if you drop f28 from the cached collections json entirely 18:01:11 contyk: ...fire 18:01:20 fines 18:01:22 massive fines 18:01:59 * nirik ponders 18:02:44 contyk: https://www.penny-arcade.com/comic/2009/06/17 18:02:45 * sgallagh had another meeting, but is here now. 18:03:10 clearly we need f27 to f29 upgrades to work for final, and to know that we need to be able to test it. So at some point soon after beta is public, we need an update to fix F27. 18:03:17 hey, we traded a mattdm for an sgallagh 18:03:32 Unsurprisingly, we had 1x1 meetings with the same person :-P 18:03:33 so I guess I am a weak +1 to PreviousReleaseBlocker 18:04:02 it feels kinda pointless but +1 18:04:11 I'm in that same boat, weak +1 previous release blocker 18:04:12 i'd be willing to be -1 if we can figure a workaround 18:04:18 like...removing f28 from the collections json... 18:04:26 hold on a sec, i have an f27 system here, let me poke it a bit. 18:05:13 okilly dokilly 18:05:22 i've *warned* you 18:06:05 adamw, isn't a workaround, if users upgrade to 28 and then to 29 from 27? it is easy, straightforward, they do not have to delete anything ... 18:06:31 heat death 18:06:32 and it will be super safe 18:06:35 lruzicka3: but the agreement was that we should test and support, and GNOME should offer, *direct* upgrades 18:06:51 adamw: +0.5 PreviousReleaseBlocker 18:06:54 that's what the criteria say 18:07:17 and if this is about stable vs. unstable (gnome-software prefers showing stable over unstable), then that would be bad, because we'd test f27-f28-f29 all through development 18:07:25 adamw, so let's block then. I am only saying that fiddling with a json file is not a workaround for everybody 18:07:29 but as soon as f29 went stable, f27 g-s would start offering direct upgrade to f29 instead of intermediate upgrade to f28 18:07:33 I can see the need there. Realistically telling users to upgrade twice is lame, and improves the room for error, are we testing that upgrade path with current packages? 18:07:35 which we wouldn't have tested at all 18:07:37 +1 previous release blocker, given that criteria 18:07:43 lruzicka3: but it's a workaround for beta users. 18:07:59 jforbes: we kinda decided the whole 'which one is safer' thing is a bit 'six of one, half a dozen of the other' 18:08:14 there are different plausible cases where each would work better 18:08:18 so we just had to pick one 18:08:40 adamw, ok, beta users should be able to deal with it, I agree 18:08:51 adamw: right, so if it isn't safer, why make it more difficult? (Not that I am suggesting this block beta) 18:08:55 i'm fine with the criterion as it is, as long as it's going to compel discovering and fixing the problem in f27, rather than holding up f29 for something that f29 can't even fix 18:10:57 cmurf: +1 18:11:25 .hello2 18:11:26 x3mboy: x3mboy 'Eduard Lucena' 18:12:36 what about people that want to upgrade to f28 from f27 ? would that not be available in gnome software ? 18:12:45 For the record, does anyone disagree and feel that we should block F29 on this? 18:12:57 cverna: sure it is... just don't enable prereleases. 18:12:59 If not, we can probably punt this discussion 18:13:09 I think some users like to stay a release behind 18:13:13 i'm just on the fence about whether to even make it a previous release blocker, if we can figure a workaround. for final, sure 18:13:15 nirik: ah ok 18:13:18 sgallagh: we are waiting for adamw to test. 18:13:25 nirik: I think cverna means once F29 is out 18:13:29 ok, i managed to get f29 to show up by editing the json 18:13:34 * nirik plays elevator music 18:13:36 so i'm gonna say -1 beta +1 final previousrelease blocker 18:13:48 cverna: That's not supported from GNOME Software.\ 18:13:51 i think for beta it's ok to say 'use dnf or hack the json to test'. we should fix it for f27 asap though of course 18:13:55 ah, yeah, there's not a way unless you edit the json file I don't think. 18:13:56 You can do it with dnf though 18:14:07 adamw: +1 18:14:18 ok. I can agree with that if there's a workaround. 18:14:20 sgallagh: ok thanks for the answer :) 18:15:27 other votes? 18:15:39 * sgallagh can vote +1 multiple times if you like 18:15:51 -1 18:15:58 +1 from the marketing side. Clarifying that it would be fixed for GA 18:16:05 lruzicka3: What are you voting -1 on? 18:16:28 against this bug to be an F29 beta blocker 18:16:42 OK, maybe we should phrase the proposal more clearly :) 18:17:14 +1 fix F27 ASAP "previous release blocker" 18:17:15 ok, so, the options are: PreviousReleaseBlocker for Beta, or PreviousReleaseBlocker for Final 18:17:22 please vote +1/-1 on both of those 18:17:26 OIC 18:17:44 -1 PRB Beta, +1 PRB Final 18:17:46 adamw: +1 PreviousReleaseBlocker for Final, -1 PreviousReleaseBlocker for Beta 18:17:46 -1 beta blocker, +1 PreviousReleaseBlocker for final 18:17:50 my vote is -1 Beta PRB, +1 Final PRB 18:18:05 -1 beta PRB, +1 final PRB 18:18:05 -1 beta blocker, PRB for final +1 18:18:40 -1 beta, +1 final 18:20:27 -1 beta, +1 final blocker 18:20:31 proposed #agreed 1628497 - RejectedBlocker (Beta), AcceptedPreviousReleaseBlocker (Final) - as there are viable workarounds (use dnf, go through F28 first, hack up the cached JSON...) we believe those are sufficient for Beta, but this counts as a violation of the upgrade criterion for Final and must be fixed in F27 prior to F29 release 18:20:36 ack 18:20:43 ack 18:21:05 ack 18:21:16 ack 18:21:22 #agreed 1628497 - RejectedBlocker (Beta), AcceptedPreviousReleaseBlocker (Final) - as there are viable workarounds (use dnf, go through F28 first, hack up the cached JSON...) we believe those are sufficient for Beta, but this counts as a violation of the upgrade criterion for Final and must be fixed in F27 prior to F29 release 18:21:44 ok, here comes the other fun one 18:21:45 #topic (1628192) Fedora 29 installation cannot see a firmware RAID device. 18:21:45 #link https://bugzilla.redhat.com/show_bug.cgi?id=1628192 18:21:45 #info Proposed Blocker, mdadm, NEW 18:22:10 i've been poking at this for a day and a half and it's still confusing me. but as the criteria stand it clearly violates them 18:22:24 we've tested on two different Intel firmware raid boxes, both fail the exact same way 18:23:13 sadly +1 blocker (but we should look at removing the firmware raid criteria IMHO) 18:23:22 there *is* a workaround, as noted in the bug, though it's not obvious (you'd have to know quite a lot about mdraid or read docs) 18:23:25 I'd propose that we vote to remove this criterion 18:23:46 I agree 18:23:54 It's relatively rare to encounter someone who both has this hardware feature AND is actually using it. 18:24:08 we're having difficult finding people with this feature, and willing to test a pre-beta 18:24:13 well, I don't think this meeting is about changing the criteria 18:24:13 Because most of the people who would actually do a RAID setup are people who know how to do it properly. 18:24:16 +1 to blocker 18:24:32 contyk: We've made decisions like this before 18:24:36 sgallagh: that seems like a loaded definition. 18:24:44 there are reasons to choose firmware raid over kernel raid. 18:24:47 adamw: Well, I wasn't defining it. 18:24:57 what did you mean by 'properly', then? 18:25:12 adamw: either kernel RAID or dedicated hardware controller 18:25:20 * nirik doesn't see any reason to use firmware raid, but could be just me 18:25:30 well arguably firmware raid used to be more common with the dual booters because it's firmware initiated raid, only meaning the firmware sees the array rather than member devices 18:25:31 +1 blocker 18:25:42 and it's the driver on Windows and Linux that does the actual raid 18:26:13 but again hard to test with diminishing numbers with this hardware feature 18:26:29 I'm -1 beta blocker, and +1 moving it to final 18:26:37 I'm also opposed to having a blocking criterion that we generally don't/can't test. 18:26:58 lruzicka3: is there a reason we didn't test this earlier? 18:27:00 * sgallagh feels the same about SAS 18:27:01 i don't oppose changing the criteria, but i do think this is a clear +1 if we don't change the criteria 18:27:02 there's no advantage having this criterion apply for beta, there might be a weak argument having it for final 18:27:12 bowlofeggs: correct 18:27:29 * cmurf feels the same about IDE/PATA 18:27:35 heh 18:27:42 adamw, well, there is not .. I think that we just focused on different things - CoreOS, modularity ... and it somehow slipped 18:27:43 sgallagh: btw, are you assuming we are going to be Go if there are no accepted blockers? 18:27:46 because i'm not sure we are. 18:28:00 nope 18:28:01 lruzicka3: okay. 18:28:03 adamw: No, I just don't think I'd slip for this 18:28:12 sgallagh: okay. 18:28:37 (I consider all blockers by whether I'd hold the release if it was the last one left... this is not passing that bar for me) 18:28:58 * nirik is with bowlofeggs. I'm +1 blocker on the current critera, but wouldn't mind changing that if we want to do that here. 18:29:24 well, let's take a vote on the criteria issue, then. 18:29:24 sgallagh: i'd think that if the criteria didn't say "firmware" 18:29:32 three options: 18:29:36 1) keep criteria as they are 18:29:42 2) move firmware raid requirement to Final 18:29:47 3) remove firmware raid requirement 18:29:47 votes? 18:29:57 i'd +1 #2 18:30:05 I'd prefer 3 but I'd be satisfied with +2 18:30:07 changing criteria at this point feels fairly wrong to me; that should have been done earlier 18:30:11 i'd also +1 #3 18:30:13 adamw: I am more towards #2, but I dont mind #3 as well 18:30:25 +1 3 18:30:28 +1 #3, +.5 #2 18:30:29 i'm +/-0 to all on same basis as contyk 18:30:30 s/+/#/ 18:30:37 i'm with sgallagh, I'm going to +1 #2 and if we don't get more help with testing firmware raid then at that time we can strike the firmware criterion entirely 18:30:38 +1 #1 18:30:48 this criterion isn't a surprise. it's been around a long time. if it was going to be changed it'd be nice if people did it outside of 'last minute in a blocker meeting.' 18:30:56 what would be the more appropriate venue to change the criteria? 18:31:04 I am +2 now and +3 when we will have released F29 18:31:11 bowlofeggs: the 'official' venue is 'the mailing lists', basically - test@, maybe devel@ 18:31:14 The problem is, we never really notice that it's there until something triggers it 18:31:26 we can change the criteria for the next release 18:31:27 the usual process is to send out a draft proposing a change, then consider feedback 18:31:37 it's a loose-consensus type thing 18:31:39 and not just to push something that's broken 18:31:42 adamw: we've loosly pondered this for several releases because it does tend to pop up at the last minute due to lack of test hardware 18:31:48 * nirik is +1 to 3 and a weak +1 to 2. 18:31:49 adamw, we can also remember to make this one the very first thing to test 18:31:54 Proposal: Treat this as a Final Blocker for F29, propose dropping it for F30+ 18:32:01 sgallagh: firmware RAID bugs have come up before, though. multiple times. that would've been a sufficient prompt for you to think about proposing a change for the next cycle. 18:32:26 cmurf: we specifically ensure brno has a system with fwraid specifically for testing this 18:32:38 adamw: I want to propose #4, move raid support to FE rather than blocker 18:32:38 just...no-one actually *did* it for any of the earlier validation composes, this cycle 18:32:47 mboddu: that'd be effectively #3 18:33:07 so, let me count votes 18:33:11 mboddu, if nobody wants to push an update, then FE does not help mucnh 18:33:13 much 18:33:33 lruzicka3: True, but its good to track it even though we dont block on it 18:33:52 we have six votes for Change, one vote for Stay The Same, one abstention 18:34:12 mboddu: neither blocker nor FE processes are for 'tracking', that is a personal bugbear of mine :) 18:34:13 i think it's far less controversial to move the requirement to final, than to abandon the requirement entirely 18:34:17 if you want a tracker bug for tracking, make one. :P 18:34:28 so, i'm gonna propose this: 18:35:46 adamw: Okay :) 18:35:59 proposed #agreed 1628192 - RejectedBlocker (Beta) AcceptedFreezeException (Beta) - this is a fairly clear violation of the criteria as written (though with a workaround), but there is substantial support for either moving the firmware RAID criterion to Final or removing it entirely. On that basis this is rejected as a blocker, and we will propose some options for revising the criteria on the mailing list, on the expectation that at minimum the Beta 18:35:59 requirement for this will no longer exist. 18:36:02 sigh 18:36:24 +1 18:36:34 +1 and ack 18:36:43 proposed #agreed 1628192 - RejectedBlocker (Beta) AcceptedFreezeException (Beta) - this is a fairly clear violation of the criteria as written (though with a workaround), but there is substantial support for either moving the firmware RAID criterion to Final or removing it entirely. On that basis this is rejected as a blocker, and we will send some criteria proposals to the list, expecting at least that the Beta requirement will no longer exist. 18:36:50 I'd like to see this as a beta blocker and move the discussion about this criterion to the list (and I'd like to keep it as is, personally) 18:36:59 but I'm alone in this, so ack, I guess 18:37:02 contyk: noted, but yours is the only clear vote for that 18:37:07 i abstained, everyone else voted For Change 18:37:08 :P 18:37:11 ack 18:37:14 ROFL 18:37:23 ack 18:37:24 contyk: as per tradition, this gives you the Sacred Right To Say I Told You So 18:37:26 use it wisely 18:37:27 ack. 18:37:33 ack 18:37:34 :P 18:37:36 sorry contyk 18:37:59 and contribute to a 'lively' mailing list discussion about changing the critera. ;) 18:38:06 i get the Not-So-Sacred Right To Stand Behind Contyk Looking Vaguely Virtuous But Not Pushing It Too Far 18:38:22 * cmurf knows the truth adamw 18:38:25 For the record, I think we should probably slip one week for reasons of "polish", which gives time for this to also be fixed. I just don't think that if we get to Go/No-Go again in a week and this was the last bug standing that I'd let it stop us. 18:38:32 #agreed 1628192 - RejectedBlocker (Beta) AcceptedFreezeException (Beta) - this is a fairly clear violation of the criteria as written (though with a workaround), but there is substantial support for either moving the firmware RAID criterion to Final or removing it entirely. On that basis this is rejected as a blocker, and we will send some criteria proposals to the list, expecting at least that the Beta requirement will no longer exist. 18:38:37 contyk: You can still fight for it being a final blocker :) 18:39:00 #info now doing the sole accepted blocker before circling back to the KDE backgrounds thing 18:39:09 #topic (1628355) F29 Beta RC1 does not boot on Raspberry Pi 18:39:09 #link https://bugzilla.redhat.com/show_bug.cgi?id=1628355 18:39:09 #info Accepted Blocker, spin-kickstarts, NEW 18:39:25 so supposedly fixed in RC2 which doesn't exist yet? 18:39:32 adamw: Which should be fixed in RC2 18:39:37 so, the status here is: this was a bug in RC1. according to pbrobinson / pwhalen, Beta RC1 32-bit ARM images will not boot on raspberry pis at all 18:39:40 contyk: right 18:39:54 we accepted this as a blocker out-of-band and fired RC2 to fix it 18:39:54 * mboddu wonders if it completed making the arm images 18:39:58 Just to confirm, both Pi2 and Pi3 are blocking, right? 18:40:06 sgallagh: yup. 18:40:17 mboddu: I think not yet, it's doing lives and arm images are right after that 18:40:17 ok 18:40:19 pi3 probably works with 64-bit images, but pi2 doesn't have that option 18:40:28 Beta RC2 is not yet complete 18:40:30 * sgallagh notes that the aarch64 worked fine... yeah 18:40:41 so, as of right now, we don't have this fixed. but it is expected to be fixed when RC2 finishes. 18:40:42 This is worth slipping on. 18:40:51 expected, yeah 18:40:57 but currently isn't 18:41:03 there's not much for this meeting to do at this point, just recording the status. 18:41:23 ETA? 18:41:28 I recommend we slip a week. No "hero testing", please. 18:41:34 #info this bug meant Beta RC1 32-bit ARM images do not boot on Raspberry Pi. Pi2 and Pi3 are supported platforms. Beta RC2 should fix this, but it is still composing at present and so has not been tested at all yet. 18:41:37 sgallagh: that comes in a minute 18:41:42 There's a bunch of other FEs that would be really nice to get in if we slip anyway 18:41:48 #info circling back to KDE backgrounds blocker 18:41:50 * sgallagh nods 18:42:01 #topic (1628525) F29 KDE Live contains old wallpaper from F28 18:42:01 #link https://bugzilla.redhat.com/show_bug.cgi?id=1628525 18:42:01 #info Proposed Blocker, f29-backgrounds, NEW 18:42:06 so, we said we'd hold this for later, and it's later. =) 18:42:20 might as well accept it since it looks like we're a no-go anyway 18:42:28 we didn't accept any other blockers, so this would technically be the only unaddressed blocker if it is accepted. 18:42:36 that's a terrible reason to vote +1, and i agree with it. 18:42:37 +1 blocker, but sad... 18:42:42 This is another one of those things I wouldn't block on if it was the last one at Beta 18:42:52 adamw: No, the Pi2 issue is still unaddressed 18:42:55 sgallagh: No "hero testing", please - I agree 18:43:22 sgallagh: eh, it's 'addressed' in that the fix was committed and the compose is running. 18:43:49 but it's schrodinger's fix until the compose is done and tested 18:43:52 right, but we still need to test it... and retest other things? or assuming we can just pull results from rc1? 18:43:57 bcotton: That ^^ 18:45:07 so we're 15 minutes until the release readiness meeting. adamw, do you want to take a moment and report on the status of the tests, or can we just skip to a final vote on status? 18:45:26 We should finish this blocker proposal first 18:45:38 +1 from me, also has sad 18:45:40 sgallagh: good point 18:45:56 sgallagh: are you a -1 on this? 18:46:12 I'm -1 blocker, +1 FE mostly because as I said, I'd fight tooth and nail about blocking Beta *just* for this 18:46:18 okay. 18:46:33 so we have...bcotton, me, nirik, bowlofeggs +1, sgallagh -1 18:46:34 any other votes? 18:46:40 -1 for Blocker 18:46:40 GA I could see. 18:46:42 +0 18:46:51 oh good, a split decision 18:46:58 haha 18:46:59 +1 Blocker 18:47:01 adamw: I have your back, more or less... 18:47:04 lruzicka3: sgallagh: do you have a criteria change proposal for us? 18:47:05 adamw: in the distance 18:47:13 +4, -2 18:47:14 Based on the criteria, unless we change it 18:47:40 I think, we should change the criteria, when possible. 18:47:47 -1 blocker, +1 FE 18:47:47 i love how we're all anticipating future choices in this meeting while discussing this. i feel like we're doing politics! 18:47:53 +4, -3 18:47:56 adamw: I swear I've proposed to drop this criteria in the past and heard crickets 18:48:03 Also, I dont think we should go for a release next week even if we decide to consider this as a non blocker 18:48:04 sgallagh: i was looking, but didn't see anything 18:48:12 (in the archives) 18:48:34 adamw: I'd move this from being a Beta blocker to a guaranteed +1 FE and a GA Blocker 18:48:48 mboddu, I believe, we need time to test RC2 18:48:59 okay, new idea 18:49:39 i propose we leave this bug's blocker status undetermined, do the test status quickly, then make the go/no-go decision with this bug's status undetermined 18:49:49 I think that sgallagh's idea is good, but I also understand those relying on the criteria. 18:49:49 +1 18:49:53 hum. 18:49:57 lruzicka3: Yes, just dont want to raise the hopes of the people assuming there will be a release next week if there are no blockers 18:50:09 -1 18:50:24 contyk: well i dunno what else to do 18:50:32 as we can't really accept or reject the bug with votes of +4, -3 18:50:33 adamw: give it a week 18:50:38 mboddu: I'd recommend we slip anyway, as I said. I don't think what's left are individually blockers, but taken as a whole... there's a lot of easy polish we can do in a week 18:50:48 so i'm anticipating the general mood that we want to slip for other reasons 18:50:54 meaning we wouldn't *have* to decide on this bug's status right now 18:51:12 adamw: I think we need more time for testing RC2 18:51:16 right. 18:51:18 we're not slipping! we're opting to use the scheduled-in Target #1 instead of Target #0 18:51:20 adamw: At minimum, shall we accept it as +1 FE so they can get it in if we slip? 18:51:22 adamw: not just "do it quickly" and declare go 18:51:22 but technically we make that call after the blocker review. 18:51:27 mattdm++ 18:51:28 nirik: Karma for mattdm changed to 10 (for the current release cycle): https://badges.fedoraproject.org/tags/cookie/any 18:51:29 sgallagh: sure. 18:51:30 is anyone -1 FE> 18:51:31 that's for phoronix :) 18:51:31 ? 18:51:34 good point mattdm 18:51:44 * adamw gets out the cosh and looks for the phoronix spy 18:51:47 mattdm++ 18:51:48 sgallagh: Karma for mattdm changed to 11 (for the current release cycle): https://badges.fedoraproject.org/tags/cookie/any 18:51:59 adamw: it's been me all along, muahahah! 18:52:00 sgallagh: I agree, and we can punt the decision on this to next week and if its the only blocker remaining then I will vote for +1 FE 18:52:06 no, I am +1 FE 18:52:10 +1 FE 18:52:14 i admit I'm conflating two things in my vote: the criterion as it stands means it's a blocker 18:52:17 I think we can all be +1 FE... that should be easy 18:52:31 proposed #agreed 1628525 - AcceptedFreezeException (Beta) - we do not have a clear vote on blocker status for this bug (the vote was +4, -3). but we have consensus that it should at least be a freeze exception. we will proceed with the meeting with its blocker status undecided 18:52:35 +1 18:52:39 ack 18:52:46 adamw: ack 18:53:00 ack 18:53:14 #agreed 1628525 - AcceptedFreezeException (Beta) - we do not have a clear vote on blocker status for this bug (the vote was +4, -3). but we have consensus that it should at least be a freeze exception. we will proceed with the meeting with its blocker status undecided 18:53:15 man, we do weird things at our meetings. ;) 18:53:15 OK 18:53:28 shhhhhh 18:53:29 this is all fine 18:53:34 everything is fine 18:53:35 nirik: hahahah :D 18:53:40 this is fine. 18:53:50 bcotton: ok, that's all the blockers, do you want to take back control? 18:54:04 got it 18:54:19 #topic Current status - tests 18:54:29 adamw: can you give the status of tests in 20 words or less? 18:54:34 fewer* 18:54:41 no 18:54:43 but i'll try! 18:54:47 (this is fine) 18:55:10 adamw: Yes, you can, there are "none" as rc 2 is still running :P 18:55:51 #info validation coverage is actually pretty good for RC1 (which still has the known ARM blocker). I see only a couple of missing tests (hardware RAID, 'basic audio'). There is no validation coverage at all for RC2 yet. Difference between RC1 and RC2 is minimal so we could consider most RC1 testing valid against RC2, but we should really at least smoke-test RC2 and check the ARM images boot on raspbi 18:55:54 adamw: You have 16 words left 18:55:54 er 18:55:58 d'oh, late 18:56:00 #undo 18:56:00 Removing item from minutes: INFO by adamw at 18:55:51 : validation coverage is actually pretty good for RC1 (which still has the known ARM blocker). I see only a couple of missing tests (hardware RAID, 'basic audio'). There is no validation coverage at all for RC2 yet. Difference between RC1 and RC2 is minimal so we could consider most RC1 testing valid against RC2, but we should really at least smoke-test RC2 and check the ARM images boot on raspbi 18:56:04 #info validation coverage is actually pretty good for RC1 (which still has the known ARM blocker). I see only a couple of missing tests (hardware RAID, 'basic audio'). There is no validation coverage at all for RC2 yet. Difference between RC1 and RC2 is minimal so we could consider most RC1 testing valid against RC2, but we should really at least smoke-test RC2 and check the ARM images boot on rasbpi 18:56:42 i would also say that i personally am a little nervous about the 'test status' from a wider PoV 18:57:33 Yeah, I'm also not comfortable with RC2 not having been tested at all 18:57:40 yes we got through most of the RC1 validation, but we haven't really had the bits very long for more freeform testing, and i'm generally worried about the state of DNF especially, would like to check on what the status of dbus is, have a bit more time to bash on GNOME 3.30, stuff like that 18:57:56 adamw, I did basic audio, it worked. I am not sure whether I recorded it or not 18:58:09 our deterministic computers product non-determinstic results :P 18:58:10 lruzicka3: ah, it's not in testcase_stats yet. might just show up on the next hourly refresh 18:58:20 well it sounds like we may end up with an RC3 given the new target and the FEs we have approved 18:58:38 anyway, that's test coverage 18:58:43 okay, great 18:58:56 so let's make it formal then 18:59:06 #topic Go/No-Go decision 18:59:08 I will poll each team. Please reply “go” or “no-go” 18:59:10 FESCo 18:59:14 no-go 18:59:16 no-go 18:59:17 no-go 18:59:22 RelEng 18:59:40 mboddu, you're up :P 18:59:43 * nirik waits for mboddu, but also chimes in again no-go with another hat 18:59:51 works for me 18:59:51 no-go 18:59:54 QA 19:00:05 * sgallagh peers at nirik. Eh, must be his twin brother. 19:00:25 no-go 19:00:36 by QA policy, i believe our vote must be no-go as there has been no testing of RC2 at all 19:00:42 nogo 19:00:46 #agreed Fedora 29 is NO-GO 19:00:47 #info The next F29 Beta Go/No-Go meeting will be Thursday, 2018-09-20 at 1700 UTC 19:00:53 #action bcotton to announce decision 19:00:53 personally i also agree with sgallagh that we should take a week to polish several things 19:01:14 everyone is welcome to stick around in this channel for the release readiness meeting which starts one minute ago 19:01:21 otherwise, i'll see you next week! 19:01:22 =) 19:01:25 * adamw grabs his tardis 19:01:27 wonder how many beta blockers we'll get from rc2 19:01:30 #endmeeting