17:00:12 #startmeeting F31 Beta Go/No-Go meeting 17:00:13 Meeting started Thu Sep 12 17:00:12 2019 UTC. 17:00:13 This meeting is logged and archived in a public location. 17:00:13 The chair is bcotton. Information about MeetBot at http://wiki.debian.org/MeetBot. 17:00:13 Useful Commands: #action #agreed #halp #info #idea #link #topic. 17:00:13 The meeting name has been set to 'f31_beta_go/no-go_meeting' 17:00:14 #meetingname F31-Beta-Go_No_Go-meeting 17:00:14 The meeting name has been set to 'f31-beta-go_no_go-meeting' 17:00:21 #topic Roll Call 17:00:29 .hello adamwill 17:00:30 adamw: adamwill 'Adam Williamson' 17:00:33 .hello pwhalen 17:00:34 pwhalen: pwhalen 'Paul Whalen' 17:00:40 .hello2 coremodule 17:00:41 coremodule: coremodule 'Geoffrey Marr' 17:00:59 .hello2 17:01:00 lruzicka: lruzicka 'Lukáš Růžička' 17:01:31 .hello2 17:01:32 alciregi: alciregi 'Alessio Ciregia' 17:01:32 morning 17:01:33 i see the QA team is arriving in force to make me sad :-) 17:01:47 .hello2 17:01:48 pbokoc: pbokoc 'None' 17:02:03 .hello2 17:02:04 dump: Sorry, but you don't exist 17:02:31 hi 17:02:58 .hello2 17:02:59 lbrabec: lbrabec 'Lukas Brabec' 17:03:27 okay, while folks are filing in (there are some seats up front still), i'll go ahead and do the boilerplate 17:03:38 #topic Purpose of this meeting 17:03:40 #info Purpose of this meeting is to check whether or not F31 Beta is ready for shipment, according to the release criteria. 17:03:41 #info This is determined in a few ways: 17:03:45 #info 1. No remaining blocker bugs 17:03:47 #info 2. Release candidate compose is available 17:03:48 #info 3. Test matrices for Beta are fully completed 17:04:36 let's get to item #1 17:04:43 #topic Current status — blocker bugs 17:04:52 #link https://qa.fedoraproject.org/blockerbugs/milestone/31/beta/buglist 17:05:03 #info 2 Proposed Blockers 17:05:04 #info 3 Accepted Blockers 17:05:27 so, two of the accepted blockers are the same bug 17:05:27 i'll go through the accepted blockers first, since if we don't get that list down to zero, the proposed blockers can wait 17:05:50 #topic (1744266) Fedora 31 still using Fedora 30 backgrounds AND (1749086) Needs updating for Fedora 31 background etc. 17:05:56 #link https://bugzilla.redhat.com/show_bug.cgi?id=1744266 17:06:00 #link https://bugzilla.redhat.com/show_bug.cgi?id=1749086 17:06:13 backgrounds. why is is always backgrounds. ;) 17:06:17 adamw: did i see on the mailing list that these are fixed enough to meet the criteria? 17:06:18 so, i think we can say this no longer technically blocks beta 17:06:31 the KDE background in beta-1.1 is wrong (it's an upstream background), but it is not the same as the f29 or f30 background 17:06:36 * satellit_ listening 17:06:44 that's technically correct, which is the best kind of correct 17:06:48 :D 17:07:00 so it satisfies the beta criteria. i'd propose we move it to Final blocker (per "The proposed final Fedora artwork must be included and used as the background on release-blocking desktops" criterion) 17:07:10 objections? 17:07:12 +1 17:07:12 next time, we can put a big red letter over the last background saying TECHNICALLY CORRECT 17:07:15 +1 17:07:18 mhroncok++ 17:07:19 xfce is also 'wrong', but also not the same as F30 17:07:31 pwhalen: man. why is this so painful :/ 17:07:35 huh, nothing should have changed there. ;( Is there a bug on it? 17:07:49 i can't figure out why kde is wrong either 17:07:53 #info KDE and XFCE backgrounds are 'wrong', but not the same as F29 or F30, so they do not violate the criteria 17:07:53 backgrounds are just cursed 17:08:04 nirik, dont think so. The right background is shown at login, but replaced once I log in 17:08:06 pwhalen: can you file a bug for xfce and mark it as blocking Final? 17:08:12 that's same for KDE 17:08:13 nobody pays attention to them until it is too late 17:08:16 adamw, will do 17:08:23 login and lock screens get the right one, desktop doesn't 17:08:26 lruzicka: oh, *I* do 17:08:28 :P 17:09:01 #agreed BZs 1744266 and 1749086 satisfy the beta criteria and are moved to Final blocker per the "The proposed final Fedora artwork must be included and used as the background on release-blocking desktops" criterion 17:09:08 * nirik thinks he sees the Xfce issue. Dropped patch. ;( 17:09:10 ack 17:09:13 ack 17:09:24 hum, or not. anyhow, we can fix it. 17:09:25 ack 17:09:32 #info bcotton has started a conversation with design about changing the background deadline to avoid this 17:09:38 #link https://pagure.io/design/issue/657 17:10:12 anything else on backgrounds? 17:10:18 oh 17:10:32 can we also grant 'wrong background' bugs Beta FE, in case we slip and want to fix them? 17:10:40 +1 17:10:43 +1 17:10:47 +1 17:10:50 * nirik now has found the problem, a sed invocation. 17:10:51 i'm +1 FE in general for any desktop having the wrong background, including specifically 1749086 17:11:11 +1 17:11:34 yes, I do not suppose that adding a background could break something important, we could be adding an automated FE to backgrounds 17:12:13 +1 on FE for those (if it's just that change) 17:12:20 * mboddu is here 17:12:20 lruzicka: for a QA person, you sound overly optimistic 17:13:01 #agreed BZ 1744266 and 1749086 AcceptedFreezeException (Beta) 17:13:22 look at me skipping 'proposed #agreed' like a madman :-) 17:13:48 mhroncok, well ... maybe you know more risks than I do, but adding a bunch of pngs should be safe ? 17:13:58 bcotton: not 1744266...oh never mind. 17:14:06 i already closed that one. 17:14:20 lruzicka: breathing on things the wrong way can break everything sometimes. :P 17:14:58 adamw, better to clean one's teeth then :D 17:15:07 1744266 receives FE posthumous ly 17:15:21 #topic (1751438) Workstation x86_64 live image is over size target 17:15:22 May be we change the criteria to FE for beta and Blocker for Final on new backgrounds 17:15:23 #link https://bugzilla.redhat.com/show_bug.cgi?id=1751438 17:15:24 #info Accepted Blocker, LiveCD, NEW 17:15:32 mboddu: that's already what they are. 17:15:49 mboddu: the criteria can't dictate FEs. that's not what criteria are for. 17:15:51 anyhoo 17:15:52 so, yeah, this 17:15:55 is this where i remind everyone that we have a new policy for late-filed blockers? :-) 17:15:59 Oh, nvm then :) 17:16:01 we should've known about this in June, but, uh, whoops. 17:16:12 i mean, technically we knew about it, the script has been filing the results in the wiki religiously 17:16:17 we just sort of forgot to notice and file a bug 17:16:34 (in case anyone wondered, i've looked at making the robot file bugs but it's sort of awful) 17:17:02 i'm generally not a fan of rewriting our criteria on the fly (despite past evidence), but this one strikes me as a "do we actually care?", at least for beta 17:17:03 so, can we just adjust the size and move on? or is there some need for the size asked for? 17:17:13 so, yeah, we could try applying our new 'late-filed blocker' policy here (though it conflicts interestingly with the 'automatic blocker' policy in this case) 17:17:33 the other fudge we have available is just to declare a new size target for workstation. 17:17:41 the current size is still larger than a CD and smaller than a DVD, so i'm not sure a slight overage actually matters unless someone can explain why 17:17:42 but i kinda hate if we're perpetually doing that 17:18:01 well, I think the idea was that it would fit on a 2gb usb... 17:18:01 the ostensible justification for 2 power-of-ten GBs is USB sticks, i think. 17:18:01 you guys dont all install using cds? 17:18:06 what world have I been living in? 17:18:07 sheesh 17:18:13 I guess these size restrictions are for making bootable dvd's which is not a thing afaik, so we can change the criteria 17:18:14 kalev: ahoy 17:18:19 but 2gb usb's are... really small these days 17:18:41 * adamw wishes he had the log of the last time we argued the toss about this handy 17:19:00 the other thing we can do is...just block on this 17:19:09 I wonder, why we cannot keep the compose below 2gb when we know about this criteria? 17:19:10 because, you know, some of those FEs look like things i'd kinda like fixed 17:19:16 and we also have the GNOME 3.34.0 megaupdate lying around 17:19:17 JUST SAYIN 17:19:38 yeah, but people will get it in updates... 🤷 17:19:39 lruzicka: we probably could fix this. just because no bug was filed, no-one looked at it 17:19:45 i would note here that optical boot is release blocking for workstation, so maybe "can be burned to a single DVD" is better than a set size 17:19:45 won't be in the live image, though. 17:19:56 right 17:19:58 bcotton: i mean, for that you just declare the size limit as the size of a DVD 17:20:15 bcotton: that's what all the '4.7 GB' limit images are 17:20:43 yeah. we probably shouldn't rewrite workstation's rules for them unannounced 17:20:46 I guess I'd prefer to not block on this, but it would be good to have some workstation WG people weigh in. 17:20:59 so i'd say we either keep blocking on this or invoke the late blocker policy 17:21:13 nirik: yeah, i just pinged #fedora-desktop 17:21:16 late blocker vs auto blocking. FIGHT! 17:21:21 DING DING DING 17:21:31 bcotton, but it is not a late blocker this time ... it is a long time known problem that nobody thought was severe enough to report it 17:21:52 but yeah tbh i'd quite like a beta with 1749433 fixed and 1731415 fixed and 1750120 fixed 17:22:04 lruzicka: sure, but that's why we wrote the policy. it was inspired by a similar issue in the last cycle 17:22:07 lruzicka: no, that's not accurate 17:22:12 I kinda like adamw proposal to block it for the reasons he mentioned and also, we tested it for less than a day, I would like more days of testing 17:22:20 lruzicka: it meets the policy definition perfectly 17:22:41 "Last minute blocker bugs - bugs proposed as blockers 5 days or fewer before the scheduled Go_No_Go_Meeting for a milestone release (Beta or Final) can be considered under this policy" 17:22:41 mboddu, adamw I tend to agree. 17:22:47 ok, this was proposed and accepted at the same time, but eh. 17:22:57 adamw, so I maybe do not understand what a late blocker is ... I thought it is something found in the last hours before go/nogo 17:23:01 mboddu: yeah, late arrival of the candidate is also a consideration 17:23:11 lruzicka: it's that thing i just quoted. 17:23:29 proposed #agreed This bug remains a blocker, but we will ask the Workstation WG to revisit their size limit to see if it still makes sense 17:23:29 this was proposed (and immediately accepted) as a blocker yesterday, by me. 17:23:47 patch 17:23:56 adamw: waiting 17:24:05 * nirik is unhappy blocking on it, but will bow to everyone else 17:24:35 another unhappy person will be frantisekz :) 17:24:48 proposed #agreed 1751438 - this is a blocker per the criteria, but we have the option of changing the target size (in consultation with workstation WG) or invoking the last-minute blocker policy. we will revisit these choices later in the meeting 17:25:08 let's get through matrix coverage and so on too 17:25:10 ack 17:25:12 ack 17:25:13 ack 17:25:14 ack 17:25:16 ack 17:25:19 and it gives time for workstation wg to show up 17:25:23 ack 17:25:37 ack 17:25:42 #agreed 1751438 - this is a blocker per the criteria, but we have the option of changing the target size (in consultation with workstation WG) or invoking the last-minute blocker policy. we will revisit these choices later in the meeting 17:25:56 now this forces us to look at the proposed blockers, you sneaky man 17:26:06 you're welcome 17:26:12 #topic (1750575) dnfdragora complains that dnf is locked by another process after updates 17:26:14 #link https://bugzilla.redhat.com/show_bug.cgi?id=1750575 17:26:15 let's sneak into it 17:26:15 #info Proposed Blocker, dnfdaemon, NEW 17:26:27 -1 blocker. it's functional, just with a dumb error message. i can live with that in a beta 17:26:46 yeah, on current description -1 for me 17:26:48 -1 blocker, +1 beta FE, +1 final blocker 17:26:57 assuming there are no later consequences of the error? 17:27:01 it does affect most of the desktops 17:27:13 -1blocker, +1FE 17:27:14 adamw, none I saw, packages can be installed and removed 17:27:15 +1 FE 17:27:18 does the problem go away after some time, pwhalen ? 17:27:21 * satellit_ it does unlock eventually for me 17:27:22 cool 17:27:25 -1 blocker, +1FE 17:27:30 when dnf frees the lock? 17:27:50 lruzicka, not that I've seen 17:28:05 affects all arches as well so will need to be documented 17:28:51 proposed #agreed 1750575 RejectedBlocker (Beta) AcceptedFreeException (Beta) - Updates are installed so it is functional, but the error message needs to be fixed 17:28:55 throw a CommonBugs at it then 17:28:57 pwhalen, and the updates are applied via dnfdragora or dnf itself? 17:29:28 ack 17:29:29 ack 17:29:34 lruzicka, dnfdragoria 17:29:37 ack 17:29:38 ack 17:29:40 ack 17:29:47 ack 17:29:50 er 17:29:51 patch 17:29:54 AcceptedFreezeException 17:29:57 not FreeException :P 17:29:59 * lruzicka thinks it might be a race condition 17:30:03 ah yes 17:30:14 #info there's no such thing as a free exception 17:30:27 bcotton, free as in beer? 17:30:29 join us and free the exceptions 17:30:40 #agreed 1750575 - RejectedBlocker (Beta) AcceptedFreezeException (Beta) - Updates are installed so it is functional, but the error message needs to be fixed 17:31:14 and lastly.... 17:31:17 #topic (1747408) Cannot upgrade to Fedora 31: package exa-0.9.0-2.module_f31+5365+04413d87.x86_64 requires libgit2.so.28()(64bit), but none of the providers can be installed 17:31:19 #link https://bugzilla.redhat.com/show_bug.cgi?id=1747408 17:31:20 #info Proposed Blocker, libgit2, NEW 17:31:51 so, this is the libgit2 default module stream issue 17:32:17 * mhroncok is seriously afraid that if this isn't a blocker, nobody will fix this 17:32:27 soas live foes 17:32:39 * satellit_ sorry 17:32:48 I thought it was fixed for upgrades 17:32:49 .hello2 17:32:50 frantisekz: frantisekz 'František Zatloukal' 17:32:54 it's not, obviously 17:33:05 but the rule here is: we only block on upgrades of the default release-blocking package sets 17:33:07 nope 17:33:10 it might be. 17:33:16 distro-sync != system-upgrade 17:33:29 well...system-upgrade does distro-sync, i think 17:33:36 but yeah, that's a point worth considering 17:33:46 + extra magic to workaround broken modularity design 17:34:04 (so it might as well does extra magic to workaround this) 17:34:05 I thought they fixed it in system--upgrade, but not anything else, but I could be mistaken 17:34:20 we can ask in the bug 17:34:37 but regardless...by the criteria, i think this is -1, because i don't see any indication this affects any package in the default blocking sets 17:34:39 tflink: sorry I was away, I saw your ping re: centos CI openshift version upgrade.. right now we can't provide you a date. Soon we will have a ticket where we can update our progress. Once we have that handy, I will be sure to pass on the link :) 17:34:41 I think that we are going to hit more such bugs when people start installing more modules 17:34:41 and the openQA upgrade tests are passing 17:34:45 cverna: thank you for the ping 17:34:59 lruzicka: it seems likely! 17:35:08 siddharthvipul, wrong channel? 17:35:18 lruzicka: left over from a previous meeting 17:35:21 lruzicka: well, except people aren't supposed to have default modules do this moving forward (for now at least) 17:35:35 lruzicka: sorry to speak out in between, was away during the last meeting 17:35:35 siddharthvipul: we should take that to another channel, not during another meeting 17:35:57 "things will probably be bad in the future" is not a release criterion 17:36:04 the problem is that if modules have default streams and get installed before non.modular content, there must be a clear policy on howto upgrade those streams 17:36:15 "lot's of confused users who are unable to upgrade" is not a criterion ether 17:36:17 but i agree with mhroncok that we do need to apply some kind of pressure on this (maybe the Prioritized Bugs process?) 17:36:46 consider that now we get confused contributors unbale to upgrade to pre-beta 17:36:59 yeah, i'm worried about this issue in general 17:37:02 this will be a "shit in the fan" situation if we release with this 17:37:04 but not sure blocking beta for it is the answer exactly 17:37:16 mhroncok: did you test what actually happens with system-upgrade yet? 17:37:19 * mhroncok proposed it for final blocker actually 17:37:25 yeah, I don't think so... final perhaps 17:37:27 adamw: downloading some F30 to do it 17:37:30 as we speak 17:37:37 pwalter proposed for beta 17:37:40 This is a serious bug that I want to solve before Beta, but not a blocker as per criterion 17:37:42 sorry I didn't note that in the bug before now. ;( 17:37:52 I want to see solved* 17:38:05 I tried to upgrade with some modular content using system-upgrade ... that was fine, but I have not tested libgit2 or exa 17:39:05 so, i'm -1 beta blocker, not sure about FE it would depend what the fix looks like. 17:39:24 I will be -1 beta blocker, but +1 final blocker definitely 17:39:31 yeah... -1 beta blocker, I think I am ok with a FE, we can always decide it's too invasive... 17:39:46 blocker doesn't change the fact that there will be nobody fixing this 17:39:55 soory 17:40:00 a FE doesn't change... 17:40:13 the other question is "is this something we could fix in a week"? i kinda feel like the Rules™ compel us to be -1 on blocker, but i'd be more inclined to throw away the rule book if it were readily fixable 17:40:33 mhroncok, but how do you want to make sure someone is going to fix it, when they say that it is a matter of "design" ? 17:40:39 well, it might be whatever they did in system-update to fix it could also be used in distro-sync... but I am just speculating. 17:40:49 lruzicka: you block on it 17:41:15 mhroncok, "blocker doesn't change the fact that there will be nobody fixing this" .... maybe I did not get it? 17:41:35 lruzicka: I've made a mistake, corrected after. "a FE doesnẗ..." 17:41:50 mhroncok, oh... now I see, sorry. 17:41:58 np, my mistake 17:42:26 so i count +1, -4 for beta blocker 17:43:13 So ... I believe we should stop considering modularity a "technology preview" and we should start requiring quality 17:43:20 If the fix is as simple as nirik say's, then based on the other reasons why I would like to see a delay in the release, I can +1B this bug. 17:43:43 I have no idea, I was just hoping. ;) Thats probibly the best case 17:43:46 lruzicka: too late for that sadly 17:43:57 nirik: Sure :) 17:44:00 lruzicka: i mean, we are holding it to the same release criteria as everything else 17:44:13 the reason this isn't a blocker has nothing to do with modularity, it's simply because it happens not to affect any packages in the default set 17:44:29 if something in a default blocking install happened to depend on libgit2...this *would* be a blocker 17:44:35 * Pharaoh_Atem waves 17:44:51 adamw, I am not sure about it ... we cannot block on malformed modules (we do not block on packages), we cannot block on upgrade processes because with clean system, you can upgrade 17:44:51 nirik: But we can get a response from dnf by then, and if they say it takes a gazillion days to fix it, then we will not block on it 17:45:10 gnome-builder is not default? 17:45:22 mboddu: what about dnf right now? 17:45:26 adamw, until now, modularity was just a part of the system, but I believe it must have its own criteria 17:45:35 mhroncok: nope. see https://openqa.fedoraproject.org/tests/449358/file/upgrade_run-dnf.log 17:45:36 Pharaoh_Atem: https://bugzilla.redhat.com/show_bug.cgi?id=1747408 17:45:44 kate is not default? 17:45:47 that's the log of a workstation f30 -> f31 upgrade test. you can see all packages it upgrades there, and that it doesn't remove any 17:45:58 hmm, let me see the kde upgrade test log 17:46:08 wtf 17:46:08 why would it remove anything? 17:46:15 why are the libgit modules still a thing? 17:46:18 https://openqa.fedoraproject.org/tests/449362/file/upgrade_run-dnf.log <-- no mention of kate 17:46:19 I thought ignatenkobrain removed them? 17:46:47 nirik: the test re-tries with --allowerasing if it fails without it (though in fact it doesn't need to do that in either case at present) 17:47:07 and for the record, GNOME upgrades do the equivalent of --allowerasing *by default and without notification* (which I'm quite unhappy with) 17:47:26 that is, graphical upgrades with gnome-software. 17:47:30 Pharaoh_Atem, what I have seen in some previous composes it was there and it had a default stream which means that anything that pulls libgit2 pull modular libgit first 17:48:04 lruzicka: ignatenkobrain demodularized the libgit2 package, I'm pretty sure he has asked for all the libgit2 modules to be removed from the distribution 17:48:18 You should call dnf module reset libgit2 17:48:34 okay, we don't need to litigate this whole bug here 17:48:37 only decide whether it's a blocker 17:48:43 I wonder, mboddu, how does it take to remove or change the module defaults, when there is a change in fedora-module-defaults? 17:48:50 ignatenkobrain: yeah, that would work around it too... but people would have to know to do it. 17:48:55 how long does it take 17:49:01 mhroncok: looking at comps, kate is in the kde-software-development group, but that's not in the kde environment group. 17:49:05 mboddu: are you still +1 blocker or was that conditional on nirik's hope being reality 17:49:35 If we do -1B now, we definitely need to document it. I can do it, if needs be. 17:49:39 In any kind of cool nice timeline, you would expect distro-sync to also sync default streams... 17:50:08 nirik, but the design is, when you are on a particular stream, it is not changed into a new one. 17:50:30 lruzicka: i'd like to know if it affects system-upgrade, though. if it doesn't, it's much less of a problem. 17:50:32 nirik, so if the default stream changes you run into some weird behaviour 17:50:34 yes, but when you upgrade major versions it needs to let you 17:50:45 bcotton: Conditional blocker 17:50:48 otherwise defaults could never change 17:50:48 again, we're not deciding how modules work here 17:50:56 adamw, with some modules it does not, but I have not tested libgit 17:51:00 Let's put it in release notes 17:51:01 mboddu: i'll call that +0.5 then :-) 17:51:07 adamw, I guess I could try tomorrow 17:51:15 mhroncok said he was trying now. 17:51:15 for beta it could be a common bug... 17:51:23 bcotton: Okay :) 17:51:30 adamw, so lets wait until mhroncok tells us 17:51:51 I cannot try, becasue installing exa on F30 now gives the proper noncrippled libgit package 17:51:57 okay, so i have +1.5 (mhroncok, mboddu), -4 (bcotton adamw nirik lruzicka). does anyone else want to express an opinion? 17:52:04 that's only for commonbugs purposes, for me. i'm -1 either way. this is clearly not a blocker per the criteria. 17:52:08 -1 B 17:52:19 BTW I don't think we should block beta on this 17:52:21 frantisekz, I thought so 17:52:25 oh 17:52:28 well heck 17:52:28 I've propsoed it as final blocker 17:52:43 so, yeah I agree ... final blocker definitely 17:52:47 okay, so we're near unanimous for beta blocker then 17:52:48 for beta, common bugs 17:53:08 ignatenkobrain: any way how to get my systsem to that beoken state so i can test system-upgrade? 17:53:16 well, or a fix would be great... but... 17:53:35 mhroncok, enable modular libgit before you install exa? 17:53:47 proposed #agreed 1747408 - RejectedBlocker (Beta) - No packages in the default sets require libgit, so this is not a blocker 17:54:02 lruzicka: To answer your question on change default streams, yes, a change in fedora-module-defaults and the rules around that are listed in https://docs.fedoraproject.org/en-US/modularity/making-modules/managing-defaults/ 17:54:04 ack 17:54:05 (i'm intentionally ignoring final for now, we can leave that to the next blocker review meeting) 17:54:09 so no final blocker? 17:54:11 (i guess one thing we don't test is xfce. hrm. should probably test that.) 17:54:17 we don't need to review final blocker status here. 17:54:22 ack 17:54:29 mboddu, thanks ... but how long does it take to see the change in the compose? 17:54:47 lruzicka: Next run of the compose after the PR gets merged 17:55:02 mboddu, ok ... thanks. 17:55:02 ack 17:55:05 ack 17:55:09 ack 17:55:17 #agreed 1747408 - RejectedBlocker (Beta) - No packages in the default sets require libgit, so this is not a blocker 17:56:19 okay, do we want to revisit the workstation bug now that frantisekz is here? 17:56:36 (me wondering which bug you mean.... :) ) 17:56:50 you're about to fine out! 17:56:52 find, too 17:56:56 :O 17:57:01 we're talking about the size bit in #fedora-workstation 17:57:04 what are the options? 17:57:06 #topic (1751438 revisited) Workstation x86_64 live image is over size target 17:57:21 we don't know off hand why it's bigger, is there a way to figure this out easily? 17:57:26 why are there two channels sigh 17:57:39 so our options are to adjust the target size, to keep it as a blocker, or to invoke the late blocker policy and ignore it 17:57:40 there's only one that i know of 17:57:58 cmurf: not *that* easily, since the images have been garbage collected. you can look at the compose changelog for the compose they started being too big 17:58:18 honestly, for Beta, I'd rather not block on this, especially since we found out so late 17:58:24 https://lists.fedoraproject.org/archives/list/test@lists.fedoraproject.org/message/65Q4CM4EX5MXYYDD36TBCHGJACGA5BDT/ 17:58:28 uh 17:58:32 can we not revisit this yet? 17:58:35 frantisekz: if we didn't have the blocker notice, I don't think we'd have found out until final 17:58:45 we still didn't do matrix completion 17:58:51 my gut instinct is this shouldn't be a beta blocker, I can see why we wouldn't want it to be bigger than 4GiB sticks 17:59:07 that'd limit testing - but I don't see how being unable to image 2GiB sticks is limiting... 17:59:23 I'm still of the mindset that given how little we're over, we should try to keep below the 2GB limit 17:59:39 Pharaoh_Atem:the problem is it means blocking beta and slipping 17:59:40 it's useful especially for having persistence on 4GB usb sticks 17:59:45 I do not like this bending the criteria ... I think if somebody wanted that size, they knew why 17:59:46 * nirik waits for matrix with adamw 18:00:01 adamw: are you expecting anything to change in the interim? 18:00:15 I'm pretty sure the reason we keep the 2GB limit is to support running the live environment on a USB stick with persistence 18:00:17 for Beta, it's not that big deal, having it oversized imo 18:00:32 adamw: i brought us back since we have Workstation represented now, but i'm happy to unrevist if there's a reason 18:00:34 for Final, we can discuss that, but slipping for a week just because of this... 18:00:38 lruzicka: honestly, the sizes only get set when we poke people about them. 18:01:12 adamw, it seems so ... which means we must start poking them sooner next time 18:01:14 i wish i had the notes handy but my best recollection is when workstation got bigger than a CD we just said 'meh' and bumped it to 1GB then when it got bigger than 1GB we said 'meh' and bumped it to 2GB 18:01:39 adamw: we also used to ship LibreOffice on the CD/DVD 18:01:41 so.. meh? 18:01:45 adamw, we can do it, but we need to bump first and then dismiss the criteria 18:01:57 I think when we switched to 1GB, we also dropped LibreOffice 18:02:04 Pharaoh_Atem: with persistence I think livecd-tools uses ext4 by default? oh no for UEFI it has to be FAT... 18:02:06 shit 18:02:12 cmurf: yep 18:02:12 and FAT has a 2GiB file size limit doesn't it? 18:02:15 bingo 18:02:22 ok so here's the thing 18:02:22 I think few people bother with persistence these days... 18:02:34 nirik, you would be surprised 18:02:39 nirik: I get enough patches and bug reports that I don't think that's true 18:02:52 hell, the bulk of the PRs for livecd-tools are related to that functionality 18:02:53 the ext4 file system baked into the squashfs image? that's what sets the size, regardless of the size of the persistence backing file 18:03:05 such as it's designed now - which i'm trying to get us away from with the overlayfs work 18:03:14 but we don't use livecd-tools. ;) 18:03:20 and there's maybe 500MiB of float right now 18:03:24 nirik: livecd-iso-to-disk is part of livecd-tools 18:03:30 and it's compatible with lmc-produced media 18:03:34 i still have an older gent that sends me a usb for the newest fedora release on a usb with persistance 18:03:36 s/float/free space 18:03:37 cmurf: yep, I've seen some of your tickets and work, thanks for that 18:03:38 right... but we don't point people at that much... 18:03:48 anyhow 18:03:49 so the image is like 47MiB over size right? 18:03:54 adamw: yep 18:04:40 hmm ok 18:04:48 i wish there were a way to have different size limits for beta and final - 18:04:50 i'm looking for stuff that got a lot bigger in 0625.n.0 but didn't really find anything yet./ 18:04:55 cmurf: there'd be no point for that 18:05:15 the blocker criteria is there for us to be able to figure out what to do 18:05:21 not necessarily to say we mandate the slippage 18:06:11 adamw: if I had to guess, I think the 4% rise is because of the payload change 18:06:21 I don't see a significant package set change anywhere 18:06:25 bcm283x-firmware got 11MiB bigger 18:06:27 so I think we rose because we compress less 18:06:35 Pharaoh_Atem: ah. when did that happen? 18:06:45 we switched from xz to zstd for F31 ;) 18:06:48 yes 18:06:51 but i mean specifically what date 18:06:55 lives don't have RPMs on them 18:06:57 but thats just the rpms... we unpack them when making the image? 18:07:02 right 18:07:03 so zstd compression for rpms doesn't matter 18:07:10 welp, there goes my theory :P 18:07:14 sigh 18:07:17 it was a good one. ;) 18:07:17 and the squashfs image is still xz 18:07:30 adamw: but it was completed just before Flock 18:07:36 just to answer your question 18:07:45 the mass rebuild converted everything to zstd 18:08:13 we don't have a debug kernel do we? hum, no I guess not. 18:08:27 RPM xz to zstd could affect server DVD because it has RPMs as its payload 18:08:33 that does occasionally accidentally slip in there, but it didn't this time, I think 18:08:52 someone check the initramfs...quick 18:08:54 no, it's not debug kernel in F31 18:09:07 anyhow, I would prefer changing the size bigger so it's not a blocker... but I guess thats up to WS... 18:09:14 okay, so in the interests of time, let's decide if we care about the overage. +1 if we continue to treat this as a blocker, -1 if we invoke the late blocker policy and move on 18:09:18 ah 18:09:18 Date: Mon Jun 24 20:34:44 2019 +0000 18:09:18 Merge #527 `Workstation: include podman` 18:09:22 welp there we go 18:09:27 i'm gonna say that looks like a gun wot is smoking 18:09:41 I was actually about to ask about go-based software too ;) 18:09:42 changing the limit is something that workstation should do with more deliberation 18:09:55 -1, fwiw 18:09:59 -1 18:09:59 becuase we upgraded the go compiler and that increased the size of some binaries :/ 18:10:02 ok, fair. so, -1 (invoke late blocker) 18:10:15 -1 18:10:16 +1 blocker, get criteria sorted first 18:10:28 there's nothing wrong with the criteria, fight me :P 18:10:30 +/-0 18:10:39 I agree with adamw 18:10:41 -1 18:10:41 i don't really mind waiving this as a late blocker, but i also secretly want to slip, so. :P 18:10:44 now it says that it is blocking 18:10:58 and there's nothing wrong with that! 18:11:00 glad we agree ;) 18:11:00 if we do not want it to be blocking, we must change size first 18:11:18 the late blocker policy covers exactly this situation, though. 18:11:21 therefore I am +1, because this not a bug that jumped at us from nowhere 18:11:22 yep 18:11:24 we only found it super late, and it's not a super critical bug. 18:11:37 lruzicka: it jumped at the release process from nowhere. 18:11:39 * mboddu agrees with adamw with the slip :P 18:11:46 okay, so i count +1, 0x2, -5 18:11:51 that's *specifically* why the policy says "proposed as a blocker", not "discovered" or "reported" or anything like that. 18:11:59 adamw, yes, but was it not a bit our fault? 18:12:01 i'm -1 also, fwiw 18:12:04 sure it was. does that matter? 18:12:07 the policy isn't about fault 18:12:16 it's about achieving a good release process 18:12:25 everything is *someone's* fault, that's rarely the important point :P 18:13:01 so, if I know about a bug and I do not propose it until the gonogo meeting, we will release. Thats dangerous. 18:13:13 proposed #agreed 1751438 - We will invoke the late blocker policy and not block the beta release for this. Workstation WG will revisit the size limit to see if it is still appropriate 18:13:14 I am -1 Blocker, but I also secretly want to slip :D 18:13:15 lruzicka: we've always relied a bit on the honor system here 18:13:21 well, no, we will discuss and vote on it. ;) 18:13:37 lruzicka: we're not obligated to ignore late blockers, but we have the ability to use our best judgment 18:13:43 lruzicka: no, the policy is not that simple. 18:14:18 ack to the proposal 18:14:28 secretly want to slip 18:14:30 why? 18:14:35 ack, because you have outvoted me 18:14:36 bcotton: ack 18:14:41 and yes, in general fedora processes expect people to act in good faith, there are lots of things in our processes that can easily be subverted by someone who wants to be malicious. i mean, if you want to hide a bug, you can just *not propose it at all*, right? 18:14:48 plus it's not a secret anymore, might as well say why 18:14:49 cmurf: to fix the juicy FEs 18:14:55 we went over this earlier 18:14:55 and I cherish democracy and the power of free vote 18:14:57 haha 18:15:19 lruzicka: i believe in the "one man, one vote" system. so long as i'm the man. 18:15:31 #agreed 1751438 - We will invoke the late blocker policy and not block the beta release for this. Workstation WG will revisit the size limit to see if it is still appropriate 18:15:31 well, you've always been the man to me ;) 18:15:39 okay, so that's it for our blockers 18:15:59 * nirik has a thing to bring up if we have time/energy 18:16:06 #topic Current status ­release candidate compose is available 18:16:07 fire away, nirik 18:16:13 nirik: May be after test matrices 18:16:35 mboddu: we have compose, yes? 18:16:38 sure. 18:16:38 yes, there is a release candidate 18:16:44 just the one, but it's all candidate...y 18:16:52 #info RC is available 18:16:53 Haha :D 18:17:00 USS Ship It 18:17:01 anything else, or should we let adamw get to his matrices finally 18:17:14 nirik: ack on your thing, btw 18:17:20 basically: I tried to install rc1 on our ancient RHOSP5 and... it doesn't finish booting. It gets to userspace, but fails to get to a login/etc. 18:17:38 so, we might want to check more modern clouds and make sure they work... or aws or the like 18:17:49 that's gonna come up in matrix coverage in fact 18:17:55 great, let's do that then 18:18:00 nirik: testcloud, the newest cloud of all, works just fine... :) 18:18:08 #topic Current status — test matrices 18:18:13 #link https://fedoraproject.org/wiki/Category:Fedora_31_Test_Results 18:18:17 adamw: the floor is yours 18:18:32 muahahahahahahahaha 18:18:33 *ahem* 18:18:45 * Pharaoh_Atem is ready with a sword if adamw becomes evil 18:18:49 becomes? 18:18:50 so, matrix coverage is mostly good, but there are two notable exceptions: 18:18:52 frantisekz: great! 18:18:52 oy 18:18:56 .fire bcotton for cheek 18:18:56 adamw fires bcotton for cheek 18:19:06 #info matrix coverage is mostly good with two exceptions: 18:19:25 #chair adamw 18:19:25 Current chairs: adamw bcotton 18:19:32 #info matrix coverage is mostly good with two exceptions: 18:19:37 i'm pretty sure you can #info without chair, but just in case 18:19:41 #info two of three Active Directory tests for Server have not been done 18:20:00 #info Cloud tests have not been run in any actual cloud (only with local testcloud) 18:20:31 adamw, I can run those cloud tests right now... 18:20:35 on a real cloud... 18:20:46 coremodule++ 18:20:47 nirik: Karma for coremodule changed to 2 (for the current release cycle): https://badges.fedoraproject.org/tags/cookie/any 18:21:07 #info also worth noting RC has only been around for ~22 hours 18:21:08 coremodule++ 18:21:08 mboddu: Karma for coremodule changed to 3 (for the current release cycle): https://badges.fedoraproject.org/tags/cookie/any 18:21:11 [[0;32m OK [0m] Started [0;1;39mLogin Service[0m. 18:21:12 [[0;1;31mFAILED[0m] Failed to start [0;1;39mLoad/Save Random Seed[0m. 18:21:12 See 'systemctl status systemd-random-seed.service' for details. 18:21:12 Starting [0;1;39mCleanup of Temporary Directories[0m... 18:21:12 [[0;32m OK [0m] Started [0;1;39mCleanup of Temporary Directories[0m. 18:21:13 seems coremodule is the cloud guy from now on 18:21:14 coremodule: please do! 18:21:16 oops. sorry... 18:21:21 running... standby 18:21:24 volunteering, a rookie mistake 18:21:28 well, carry on, but standby for me 18:22:06 Pvt. /me runs tests 18:22:09 " #info also worth noting RC has only been around for ~22 hours" is one of the reason for me secretly wishing for a slip :D 18:22:27 so, alciregi ran one AD join test at least 18:22:52 mboddu: careful what you wish for... 18:22:58 i seem to recall a very smart and handsome FPgM suggesting we should have a minimium time between RC and Go/No-go and being told "nahhhhh, it's fiiiiiine" 18:23:01 we could, reasonably, hold that the combination of that test and the other two tests passing for FreeIPA gives us fairly high certainty that the same two tests would pass for AD 18:23:13 bcotton: doesn't ring a bell! 18:23:36 (in fact i think we might have a rule like that somewhere but just be cheerfully ignoring it) 18:24:02 bcotton, we once said if there was no RC by Tuesday, auto-slip. 18:24:16 frantisekz: I know what I am getting into, as I have to run the compose :D (but adamw has to test it again) 18:24:20 bcotton, I would support the minimum-time-in-between thingie 18:24:26 pwhalen: yeah, that's what i remember, but i don't remember where it is. 18:24:46 (BTW I've finally beaten the F30 system to get to the broken state with libgit and distrosync, system-upgrade does the same) 18:24:50 nor I, I think tribal knowledge 18:25:08 while there may be no such thing as a free exception, there is such thing as a FreeIPA. i wouldn't object if you made the argument that it's good enough, adamw 18:25:33 bcotton, free beer again :D 18:25:36 adamw: Yeah, I remember there was a rule about RelEng should get a request by EOD of Tue before go/no-go which gives couple of days of testing for QA 18:25:38 * nirik needs to wander to another meeting in 5m... but can try and keep paying attention here 18:25:44 mhroncok: how much 'beating up' is necessary? 18:26:08 I'll document my steps 18:26:44 while we wait for the weather report from coremodule, are there any other questions or comments about test coverage? 18:26:47 adamw: but basically I needed to dnf module enable libgit2:0.27, dnf install libgit2, dnf install exa bat 18:26:59 the weather man is always wrong... 18:27:04 mhroncok: okay. but some existing systems will have got into this position by just installing exa or bat or whatever? 18:27:26 adamw: yes, this has been "fixed" for people who dnf install exa or bat now 18:27:39 it's the users who did that before 18:27:50 okay. 18:28:51 mhroncok, how do you install modular libgit2 ... it cannot be installed since it does not have any profile ? 18:29:25 lruzicka: dnf module enable libgit2:0.27 && dnf install libgit2 18:29:30 lruzicka: He is enabling a stream "dnf module enable libgit2:0.27" 18:29:31 mhroncok, I was told that that module is for dependency purposes only - the content cant be installed per se, but gets pulled by other modules. 18:29:50 yeah, yo don't really need a profile in many cases to use RPMs provided by a module 18:29:52 yes. but in order to reproduce the problem some existing installs have, you have to do that. 18:30:25 mboddu, enable ... you can do it, but it will not install anything ... which also is a weird behaviour I do not like about modules. 18:31:09 so far 4/5 tests have passed on ec2, running the last service test now... 18:31:32 🎉 18:32:08 libgit2:0.27 should be default in f30. 18:32:18 ok ... 18:32:23 * Pharaoh_Atem has to go now 18:32:27 lruzicka: Right, but thats another fight 18:32:32 hopefully I shouldn't be needed anymore in here 18:32:39 * Pharaoh_Atem puts away his sword and walks out 18:33:04 lruzicka: it can get even better - you can have module:stream enabled, having nothing installed from it & still have it block your upgrades :) 18:33:12 lruzicka: have seen that case today 18:33:41 mkolman: Okay, that is new to me, never seen that before but I can see why its doing that 18:34:15 mkolman, I believe you 18:34:36 nirik, check this and show me what profile does libgit install when they are empty? https://dpaste.de/9svh/raw 18:35:01 nirik, that from my F30 ?) 18:35:06 if you don't do anything you get 0.27 as it's default... 18:35:08 IIRC it was the jmc module depending on the eclipse module, that has not yet been rebuilt for F31 correctly - as far as we could tell nothing was installed from the jmc module 18:35:35 nirik, but doing "dnf module install libgit2:0.27" will not install it, just enable 18:36:34 anyway, since all the rust modules will be retired from f31, this will bite in a completelly different way 18:37:08 ah, I see what you're saying. Yeah... but 'dnf install libgit2' will install it. 18:37:13 * mhroncok wonders whether we can even obsolete modular packages / modules from fedora-obsolete-packages 18:37:16 coremodule: almost there? 18:37:26 bcotton, 1 min or less 18:37:32 * bcotton waits anxiously 18:37:48 45 18:37:49 44 18:37:50 43 18:37:51 42 18:37:56 0 18:38:00 :P 18:38:06 * bcotton waits for coremodule to get kicked for spamming 18:38:18 lol 18:38:24 then I guess YOULL NEVER KNOW!!! 18:38:34 mhroncok: we need a module called fedora-obsolete-modules, obvs 18:38:43 yeah we're good 18:38:47 okay 18:38:49 they all pass 18:38:55 adamw: can one module obsolete others? 18:39:05 mhroncok: i have absolutely no idea! 18:39:13 #info cloud tests pass on ec2 18:39:18 we need to add special obsoleting packages into the default streams 18:39:19 anything else before we get to the decision? 18:39:29 so if everyone's so keen to ship this hunk of junk, i think we can reasonably say that matrix coverage is sufficient inferring that the two missing AD tests should be fine based on the other AD test and the FreeIPA tests 18:39:41 if anyone disagrees, please speak up 18:40:02 what about the sas drives and fakeraid? 18:40:27 ... 18:40:37 bear spray 18:41:02 has the sas drive test ever failed? 18:41:07 not really sure why it would 18:41:15 nirik: i thought we had fakeraid? 18:41:25 fw raid was done by me today 18:41:30 yeah, we have fakeraid 18:41:31 but I don't have hw for hw raid 18:41:31 I was just joking about the ones we often don't have. ;) 18:41:38 sas was run on 20190722.n.1, which is recent enough for me! 18:41:40 okay, so it sounds like nobody disagrees 18:41:45 #topic Go/No-Go decision 18:41:46 I will poll each team. Please reply “go” or “no-go” 18:41:50 FESCo? 18:42:02 ship this ship. go. 18:42:08 go 18:42:08 #info FESCo is go 18:42:12 Releng? 18:42:57 mboddu, nirik: the releng perspective, if you please 18:43:00 Go... 18:43:00 go (or can wait for mboddu ) 18:43:08 #info Releng is go 18:43:11 QA? 18:43:20 grudgingly go :P 18:43:21 go 18:43:25 I pass 18:43:30 yo 18:43:38 i mean go 18:43:42 #info QA is go 18:43:44 yolo 18:43:45 #info QA is go based on lack of outstanding blockers and sufficient matrix coverage 18:44:05 mhroncok: brb, renaming this the Go/YOLO meeting 18:44:12 #agreed Fedora 31 Beta is GO 18:44:13 #info Fedora 31 Beta will release on 2019-09-17 18:44:35 well gee, look at us 18:44:36 bcotton: Dont we check infra as well? 18:44:55 infra is ready whenever we have bits. :) 18:45:13 * mkolman recommends "this is fine meeting" 18:45:18 #action bcotton to announce decision 18:45:24 #topic Open floor 18:45:31 beta: this is fine! 18:45:37 nirik: did you still have a thing, or was the thing you brought up earlier the thing? 18:45:56 yeah, the cloud thing was it. I just wanted to make sure more reasonable clouds were tested 18:46:09 anyone else? 18:46:17 as a side note I tested on a macbook and everything was fine. 18:46:48 thanks for the meeting bcotton !!! 18:46:57 nothing really 18:47:01 thanks everyone! 18:47:10 Not related, but anyone has testing Fedora on MS Surface pro 6? 18:47:17 Thanks bcotton 18:47:22 don't forget to tune in for the release readiness meeting in this room in 13 minutes 18:47:25 mboddu, what is it, a tablet? 18:47:26 mboddu: if you buyme one, i'll test it 18:47:46 bcotton: exciting action adventure thrill! 18:48:06 #endmeeting