16:00:03 #startmeeting F27-blocker-review 16:00:03 Meeting started Mon Oct 2 16:00:03 2017 UTC. The chair is kparal. Information about MeetBot at http://wiki.debian.org/MeetBot. 16:00:03 Useful Commands: #action #agreed #halp #info #idea #link #topic. 16:00:03 The meeting name has been set to 'f27-blocker-review' 16:00:03 #meetingname F27-blocker-review 16:00:03 #topic Roll Call 16:00:03 The meeting name has been set to 'f27-blocker-review' 16:00:19 so, who do we have here for a blocker meeting? 16:00:48 kalev: sgallagh: nirik: lbrabec: ping 16:00:50 * lbrabec is here 16:00:56 pwhalen: ping 16:00:56 kparal: Ping with data, please: https://fedoraproject.org/wiki/No_naked_pings 16:01:21 ok, ok, ping "are you available for the meeting"? :) 16:01:32 kparal, sorry on another, will join after 16:01:37 ok, thanks 16:01:45 * kparal also pokes sumantrom[m] 16:01:54 * kparal tries to remember the usual attendees 16:02:33 lbrabec: do you know how to secretarialize? 16:02:38 no 16:03:08 ok, I guess I'll do it 16:03:15 if we have some people in the first place 16:03:25 pschindl will be late, about 30 minutes I think 16:05:03 tflink: we seem to be low on attendance, do you have time to join us? 16:05:14 I am here 16:05:21 great 16:05:23 * mboddu is kinda here 16:05:51 * mboddu is busy with release bits 16:05:52 yeah 16:06:15 ok, let's start, I hope others will join later 16:06:28 bear with me, I don't usually lead 16:06:28 i'm here 16:06:37 present 16:06:39 #chair lbrabec tflink 16:06:39 Current chairs: kparal lbrabec tflink 16:06:50 #topic Introduction 16:06:50 Why are we here? 16:06:51 #info Our purpose in this meeting is to review proposed blocker and nice-to-have bugs and decide whether to accept them, and to monitor the progress of fixing existing accepted blocker and nice-to-have bugs. 16:06:51 #info We'll be following the process outlined at: 16:06:51 #link https://fedoraproject.org/wiki/QA:SOP_Blocker_Bug_Meeting 16:06:52 #info The bugs up for review today are available at: 16:06:54 #link http://qa.fedoraproject.org/blockerbugs/current 16:06:56 #info The criteria for release blocking bugs can be found at: 16:06:58 #link https://fedoraproject.org/wiki/Fedora_27_Alpha_Release_Criteria 16:07:02 #link https://fedoraproject.org/wiki/Fedora_27_Beta_Release_Criteria 16:07:04 #link https://fedoraproject.org/wiki/Fedora_27_Final_Release_Criteria 16:07:13 #info 9 Proposed Blockers 16:07:14 #info 6 Accepted Blockers 16:07:14 #info 0 Accepted 0-day Blockers 16:07:14 #info 0 Accepted Previous Release Blockers 16:07:14 #info 3 Proposed Freeze Exceptions 16:07:16 #info 0 Accepted Freeze Exceptions 16:07:29 let's start with the kernel one since jforbes is here 16:07:37 #topic (1491320) heavy screen flicker with latest kernels in qxl+spice VM 16:07:37 #link https://bugzilla.redhat.com/show_bug.cgi?id=1491320 16:07:37 #info Proposed Blocker, kernel, NEW 16:08:09 so, in a nutshell, our VMs are now horribly broken with workstation by default 16:08:15 screen unbearably flickers 16:08:35 it's a combination of qxl+wayland+new kernel 16:08:49 jforbes: what are the chances of having this fixed in kernel before F27 Final? 16:09:00 So we are in a pretty tough spot with this. Essentially it can't be backed out without reverting a large chunk of DRM. Upstream is pretty clear that wayland gets no benefit from QXL and should not use it 16:09:01 do you have any guess whether it's remotely possible? 16:09:11 kparal: this will likely not be fixed in kernel ever 16:09:49 do you have any idea whether host qxl can be autodetected from inside the vm (and disable wayland, for example)? 16:10:04 I was looking for crobinso but he's not online atm 16:10:06 It should be able to, I know nvidia reverted to X 16:10:33 ok, so this could be one possible fix. not sure how difficult 16:10:49 another is to default to virtio gpu driver in virt-manager and boxes 16:10:57 again, I'm not sure whether it has any drawbacks 16:11:11 why not use the right driver ? 16:11:19 mclasen: what do you mean? 16:11:25 mclasen: and welcome :) 16:11:29 So the drawback there, is guests not using wayland will not have the best possible acceleration 16:11:30 what you just said, use the virtio gpu driver 16:11:47 mclasen: that is the right driver 16:12:03 yes 16:12:21 so we would be decreasing performance for xorg sessions 16:12:22 https://bugzilla.kernel.org/show_bug.cgi?id=196777#c11 16:13:13 .hello2 16:13:14 ignatenkobrain: ignatenkobrain 'Igor Gnatenko' 16:13:31 mclasen: it's a solution. still, it would be good if system could autodetect a problematic setup and fall back to X11. since most people will not read commonbugs 16:13:41 and their old VMs will exhibit the flicker 16:14:07 mclasen: also, do you have any idea if switching to virtio can be done quickly in boxes? 16:14:19 or is that a larger development effort? 16:14:31 kparal: old vms will not exhibit a flicker with virtio-vga, they just won't be as accelerated as they are with qxl 16:15:11 by "old VMs" I mean those VMs created with qxl (the default driver) before we switch the default to virtio 16:15:28 so "old vms" will have qxl, "new vms" will have virtio 16:15:32 if I'm making sense 16:15:40 or maybe misunderstanding something 16:15:44 right, that makes sense 16:15:51 (makes sense; I was thinking the same thing) 16:16:01 so even if we switch the default, many many people will still see this problem 16:16:06 I don't see any controls in boxes for changing the hardware config at all 16:16:06 and won't know how to fix it 16:16:27 jforbes: yes, that's why I asked mclasen. I can't easily test whether it works or not 16:16:54 There is another issue here, outside of what we do with boxes in Fedora, what about people running Fedora guests on other hosts 16:17:07 right, good remark 16:17:15 * mclasen not feeling constructive today, goes away 16:17:34 also, F27 Beta seems to be broken in virtualbox, but I'm not sure if it's related or not - a black screen, reportedly 16:18:01 That would not be related, virtualbox uses it's own drivers 16:18:22 mclasen: mhmm, I'd prefer you to stay... 16:19:40 so, if gnome could detect qxl and fall back to x11, that would solve all issues. changing the default in virt-manager/boxes would make it possible to use wayland even in vm. a combination of both would work the best for fedora and other distros 16:20:03 I'm not trying to find the best solution here, just figure out whether it's doable 16:20:22 because I believe this is a blocker, but if we can't fix it in time, we won't have much choice here 16:20:50 either way, I'd be +1 blocker at the moment. and the relevant devs will tell us if that's not possible to do in this timeframe 16:21:06 wdyt? 16:21:42 sounds reasonable, +1 16:22:32 +1 16:22:48 I will certainly try to push back on upstream for a better solution in kernel, I just don't see it as likely. I cannot comment on whether the other solutions are feasible as I have no idea what that code looks like 16:23:02 +1 16:23:46 +1 16:23:58 proposed #agreed - #1491320 - AcceptedBlocker (Final) - This violates "The release must be able host virtual guest instances of the same release" criterion. Affected parties, please find a solution here. 16:24:35 ack/nack/patch? 16:24:45 ack 16:24:47 ack 16:24:53 Ack 16:25:44 #agreed - #1491320 - AcceptedBlocker (Final) - This violates "The release must be able host virtual guest instances of the same release" criterion. Affected parties, please find a solution here. 16:25:56 #topic (1484916) Can not get destinations from CUPS server 16:25:56 #link https://bugzilla.redhat.com/show_bug.cgi?id=1484916 16:25:56 #info Proposed Blocker, cups, MODIFIED 16:26:48 so, printer dialog is empty in gnome 16:26:58 setting up a fake default printer would be a fine workaround for beta, I feel 16:27:01 but not for Final 16:28:13 * pschindl is here 16:28:17 * sumantrom[m] concurs with kparal 16:28:35 a question is whether this is "default application functionality", but I think we can consider this as one 16:28:44 pschindl: welcome :) 16:29:30 pschindl: Hii 16:30:08 so this is +1 blocker for me 16:30:12 other votes? 16:30:17 +1 16:30:41 +1 16:30:55 we can also say that the control center app is not showing printers as it should 16:30:55 sorry, not very details. agree that a fake printer isn't ideal for final 16:31:04 and then it matches the criterion better 16:31:19 do we have any idea how likely a fix is for final? 16:31:43 it's already submitted 16:31:52 oh 16:31:53 according to that bodhi link 16:32:16 tflink: bugzilla is in modified state, patch was backported from upstream and I tested it with reporter steps - it works with patch 16:32:48 proposed #agreed - #1484916 - AcceptedBlocker (Final) - This violates "All applications that can be launched using the standard graphical mechanism of a release-blocking desktop after a default installation of that desktop must start successfully and withstand a basic functionality test" for control center app and showing printers. 16:33:10 ack 16:33:12 ack 16:33:12 ack 16:33:28 zdohnal: yeah, I'm just slow today, apparently :-/ 16:33:29 ack 16:33:36 ack 16:33:39 #agreed - #1484916 - AcceptedBlocker (Final) - This violates "All applications that can be launched using the standard graphical mechanism of a release-blocking desktop after a default installation of that desktop must start successfully and withstand a basic functionality test" for control center app and showing printers. 16:33:50 #topic (1490832) dnf system-upgrade: dnf.exceptions.MarkingError: no package matched 16:33:50 #link https://bugzilla.redhat.com/show_bug.cgi?id=1490832 16:33:51 #info Proposed Blocker, dnf-plugins-extras, MODIFIED 16:33:57 +1 16:35:02 +1 from me as well 16:35:08 +1 blocker, rather 16:35:09 this happens only if you use --enablerepo during dnf system-upgrade download 16:35:17 a workaround is simple, enable the repo permanently 16:35:22 still, annoying 16:35:28 and unclear from the error 16:36:21 I'm not completely decided here, but probably more of a blocker 16:36:34 enabling repo on cmdline is quite frequent, especially with updates-testing 16:36:41 might be even documented somewhere 16:36:41 +1 blocker 16:36:58 +1 16:37:03 +1 blocker 16:37:34 proposed #agreed - #1490832 - AcceptedBlocker (Final) - This violates "For each one of the release-blocking package sets, it must be possible to successfully complete a direct upgrade from fully updated installations of the last two stable Fedora releases with that package set installed." when --enablrepo is used. 16:37:48 proposed #agreed - #1490832 - AcceptedBlocker (Final) - This violates "For each one of the release-blocking package sets, it must be possible to successfully complete a direct upgrade from fully updated installations of the last two stable Fedora releases with that package set installed." when --enablerepo is used. 16:38:10 ack 16:38:11 ack 16:38:13 ack 16:38:30 #agreed - #1490832 - AcceptedBlocker (Final) - This violates "For each one of the release-blocking package sets, it must be possible to successfully complete a direct upgrade from fully updated installations of the last two stable Fedora releases with that package set installed." when --enablerepo is used. 16:38:43 #topic (1492036) system-upgrade fails to connect to online mirrors during upgrade when caches are missing 16:38:43 #link https://bugzilla.redhat.com/show_bug.cgi?id=1492036 16:38:43 #info Proposed Blocker, dnf-plugins-extras, MODIFIED 16:39:15 this one happens if F26(!!) caches are missing, e.g. when doing dnf clean all before starting upgrade 16:39:33 but I think we also saw it happen in some other cases, maybe if caches were outdated 16:39:43 but I'm not clear on that one and it's harder to reproduce 16:40:16 also, jmracek didn't reproduce it, but I could do it consistently 16:40:22 in a fresh VM 16:40:53 so I'm not so sure here, maybe punt a week before we gather more details (or the fix is verified and goes stable) 16:41:18 wfm 16:42:01 +1 punt 16:42:29 proposed #agreed - #1492036 - Punt (delay decision) - We'll wait until this is confirmed by multiple parties or more ways to trigger this are found. 16:42:46 ack 16:42:58 ack 16:42:59 ack 16:43:17 #agreed - #1492036 - Punt (delay decision) - We'll wait until this is confirmed by multiple parties or more ways to trigger this are found. 16:43:29 #topic (1495635) systemd times out when waiting to unlock disks, falling to dracut shell 16:43:29 #link https://bugzilla.redhat.com/show_bug.cgi?id=1495635 16:43:29 #info Proposed Blocker, dracut, POST 16:43:56 we've had this before and I think it was a blocker, but I didn't check 16:44:17 anyway, we shouldn't release like this I believe 16:44:38 +1, this is annoying 16:44:43 I hated this when it happened before 16:44:44 +1 16:44:46 people complained that upgrade failed, because after they returned they saw a rescue shell 16:45:04 +1 16:45:09 +1 16:45:34 * nb experienced this issue and was confused until i just rebooted and tried again 16:45:35 at least +1 FE 16:45:50 but I'm not -1 blocker, either 16:46:11 * nb thinks blocker 16:46:26 proposed #agreed - #1495635 - AcceptedBlocker (Final) - This violates boot-related criteria when the system is encrypted and is not unlocked quickly enough. 16:46:33 ack 16:46:36 ack 16:46:41 ack 16:46:42 ack 16:47:01 #agreed - #1495635 - AcceptedBlocker (Final) - This violates boot-related criteria when the system is encrypted and is not unlocked quickly enough. 16:47:12 #topic (1494061) gnome-software doesn't show F25->F27 upgrade even though it should 16:47:12 #link https://bugzilla.redhat.com/show_bug.cgi?id=1494061 16:47:12 #info Proposed Blocker, gnome-software, NEW 16:47:28 so, this would be AcceptedPreviousRelease, if accepted 16:47:57 it quite clearly violates the cited criterion, I think 16:48:25 please note that nobody confirmed this, I might've done something wrong. but in that case it can always be lifted 16:48:42 we'll action somebody else from QA to test this independently 16:48:58 eh, I think that's it's arguably not a blocker but that involves splitting some hairs 16:49:15 tflink: please argue :) 16:49:29 the criterion doesn't say that it's must be possible to directly upgrade from n-2 16:49:44 you _can_ upgrade - you just need to go through 26 first 16:49:58 " a direct upgrade " 16:50:20 I was proposing that criterion, I know why I included the *direct* word :) 16:50:36 that was the time when we officially started supporting n+2 upgrades 16:50:46 fair enough. does the cli work? 16:50:48 before that, only n+1 was supported and tested 16:50:51 tflink: yes 16:51:17 * tflink doesn't know why he's arguing this one, doesn't have a problem with blocker 16:51:29 that's fine, clarification 16:51:48 "This criterion applies to the recommended upgrade mechanisms only." 16:51:57 +1 16:52:07 both approaches should work, since both are recommended 16:52:15 +1 16:52:23 +1 16:52:25 +1 16:53:10 proposed #agreed - #1494061 - AcceptedBlocker (Final) - This violates "For each one of the release-blocking package sets, it must be possible to successfully complete a direct upgrade from fully updated installations of the last two stable Fedora releases with that package set installed." for gnome-software on F25. 16:53:15 ack 16:53:18 ack 16:53:18 ack 16:53:23 ack 16:53:34 #agreed - #1494061 - AcceptedBlocker (Final) - This violates "For each one of the release-blocking package sets, it must be possible to successfully complete a direct upgrade from fully updated installations of the last two stable Fedora releases with that package set installed." for gnome-software on F25. 16:53:35 ack 16:53:46 #topic (1479932) gi.overrides.BlockDev.LVMError: Process reported exit code 5: Volume group "VolGroup00" not found 16:53:46 #link https://bugzilla.redhat.com/show_bug.cgi?id=1479932 16:53:47 #info Proposed Blocker, libblockdev, NEW 16:54:23 * tflink is thinking punt and wait for reproduction on this one 16:54:54 yes, proper reproduction steps are needed and at least someone else hitting this too 16:55:20 +1 punk 16:55:23 ah 16:55:26 +1 punt 16:55:49 proposed #agreed - #1479932 - Punt (delay decision) - We'll wait until this has detailed reproduction steps and somebody else manages to successfully reproduce it. 16:55:50 +1 punt 16:55:53 ack 16:55:55 ack 16:55:56 ack 16:55:57 ack 16:55:59 ack 16:56:18 #agreed - #1479932 - Punt (delay decision) - We'll wait until this has detailed reproduction steps and somebody else manages to successfully reproduce it. 16:56:28 #topic (1482692) gi.overrides.BlockDev.LVMError: Failed to call the 'Activate' method on the '/com/redhat/lvmdbus1/Lv/0' object: GDBus.Error:org.freedesktop.DBus.Python.dbus.exceptions.DBusException: ('com.redhat.lvmdbus1.Lv', 'Exit code 5, stderr = Volume group ... 16:56:29 #link https://bugzilla.redhat.com/show_bug.cgi?id=1482692 16:56:29 #info Proposed Blocker, libblockdev, NEW 16:56:58 this is likely the same bug or similar 16:57:07 the same approach here I think 16:57:16 yeah 16:57:18 yep 16:57:27 +1 punr 16:57:29 punt :) 16:57:33 proposed #agreed - #1482692 - Punt (delay decision) - We'll wait until this has detailed reproduction steps and somebody else manages to successfully reproduce it. 16:57:35 ack 16:57:41 also looks like the anaconda bug which is the bane of my existence when re-installing the taskotron-client-hosts 16:57:42 ack 16:57:50 smells kinda like, rather 16:57:57 ack 16:58:09 #agreed - #1482692 - Punt (delay decision) - We'll wait until this has detailed reproduction steps and somebody else manages to successfully reproduce it. 16:58:16 #topic (1475565) initramfs not generated at default location if /boot/ exists 16:58:17 #link https://bugzilla.redhat.com/show_bug.cgi?id=1475565 16:58:17 #info Proposed Blocker, systemd, NEW 16:58:52 so, I did a very poor job proposing this 16:59:02 I was bit in a hurry 16:59:18 I reproduced this easily with clean F27 installation, but not with F26->F27 upgrade 16:59:36 there's /boot/some-hash, and dracut -f creates initramfs in there, instead of updating the existing one 16:59:48 however, new kernels created initramfs just fine for me 17:00:04 which didn't sound the case for person in comment 12 17:00:11 so, my experience differs here 17:00:48 still, this sounds very bad for any tool that regenerates initramfs (or for users who do that manually, etc after updating crypttab) 17:00:58 and I gues some security implications could be there as well 17:01:15 e.g. updating initramfs with plymouth security fix or something 17:01:43 this doesn't directly violate anything, but could be considered a security problem 17:02:07 or, if comment 12 is correct and I was just lucky, this would violate a lot of stuff, breaking boot :) 17:02:11 so, take your pick 17:02:42 jforbes: still around? 17:02:47 another punt? 17:03:22 we could give it more testing, yes 17:04:18 as a heads up, I need to go AFK in about 30 minutes 17:04:19 or ask relevant people outside of this meeting 17:04:27 I'm also +1 punt. But it sounds like a bad bug 17:04:28 or both :) 17:04:57 pschindl: in my mind, it depends on the details that got kparal to not see it vs. comment 12 17:05:14 either way, worth more testing/digging 17:05:44 +1 punt 17:06:00 +1 punt for more testing and/or digging, to be more formal 17:06:09 proposed #agreed - #1475565 - Punt (delay decision) - We need to perform more testing to estimate the user impact better. 17:06:55 ack 17:07:06 ack 17:07:38 ack 17:07:41 #agreed - #1475565 - Punt (delay decision) - We need to perform more testing to estimate the user impact better. 17:07:55 ok, those are proposed blocker 17:07:58 blockers 17:08:23 #info Proposed FEs 17:08:52 I'll skip 1479932 and 1482692 since we already discussed them as blockers and punted 17:09:02 a single one remains 17:09:04 #topic (1497458) implantisomd5sum fails to implant on 32 bit x86 17:09:04 #link https://bugzilla.redhat.com/show_bug.cgi?id=1497458 17:09:05 #info Proposed Freeze Exceptions, isomd5sum, NEW 17:09:39 releasing i686 images without working md5sums sounds like a bad idea, so I'm +1 FE here 17:09:46 This has been pointed out to the i686 SIG 17:10:23 +1 FE 17:10:28 +1 fe 17:10:37 +1 FE 17:10:41 kparal: +1 FE but as jforbes said, we need to take it to i686 SIG and have a fix for it asap 17:11:00 +1 fe 17:11:07 proposed #agreed - #1497458 - AcceptedFreezeException (Final) - We prefer to release i686 images with working checksums, as long as the fix is not invasive and doesn't break anything else. 17:11:19 ack 17:11:20 * mboddu dont want people to think we are dropping i686 support 17:11:23 ack 17:11:25 ack 17:11:28 ack 17:11:43 #agreed - #1497458 - AcceptedFreezeException (Final) - We prefer to release i686 images with working checksums, as long as the fix is not invasive and doesn't break anything else. 17:12:11 jforbes: do you have a minute to go back and discuss 1475565 ? 17:12:26 ack 17:12:36 Sure 17:12:50 #topic (1475565) initramfs not generated at default location if /boot/ exists 17:12:50 #link https://bugzilla.redhat.com/show_bug.cgi?id=1475565 17:12:50 #info Proposed Blocker, systemd, NEW 17:13:14 jforbes: what do you think about security implications of not updating initramfs when dracut -f is called? 17:13:26 or any other implications you can think of? 17:14:13 I want to hear your thoughts in case new kernel installs generate initramfs fine, but tools trying to update it don't work 17:14:28 Possible missing drivers and such are the biggest issue 17:15:09 I mean it isn't really a workable long term solution, there are many reasons to need to update the initramfs 17:15:59 aren't all drivers already present when it's generated with the new kernel installed? how would failing to update initramfs miss some drivers? 17:16:33 also, what are your thoughts on this being a blocker (considering this case as described)? 17:16:54 Third part modules could be an issue, drivers not part of the kernel proper than dkms builds 17:17:10 oh, I see. nvidia trying to build its module and such? 17:17:13 virtualbox, etc? 17:17:19 I would be +1 to blocker 17:17:45 We also see a lot of failures for whatever reason fixed by rebuilding initramfs 17:18:25 ok, thanks for details. we'll revisit this bug on our next meeting, hopefully with more testing done 17:18:34 thanks 17:18:56 that's it for proposed blockers and FEs 17:19:07 I think it doesn't make much sense to go through accepted as this point 17:19:12 so 17:19:14 #topic Open floor 17:19:23 anybody has a topic to raise? 17:20:10 nothing from me 17:21:06 * kparal will keep this open for a few more minutes 17:25:43 ok, thanks everyone for attending 17:25:48 #endmeeting