17:00:23 #startmeeting F35 Beta Go/No-Go meeting 17:00:23 Meeting started Thu Sep 23 17:00:23 2021 UTC. 17:00:23 This meeting is logged and archived in a public location. 17:00:23 The chair is bcotton. Information about MeetBot at https://fedoraproject.org/wiki/Zodbot#Meeting_Functions. 17:00:23 Useful Commands: #action #agreed #halp #info #idea #link #topic. 17:00:23 The meeting name has been set to 'f35_beta_go/no-go_meeting' 17:00:28 #meetingname F35-Beta-Go_No_Go-meeting 17:00:28 The meeting name has been set to 'f35-beta-go_no_go-meeting' 17:00:36 #topic Roll Call 17:00:51 morning everyone. 17:01:10 afternoon nirik 17:01:16 oh come on, bridge :-( 17:01:24 .hello geraldosimiao 17:01:25 geraldosimiao: geraldosimiao 'Geraldo S. Simião Kutz' 17:01:34 .hello jbwillia 17:01:35 Southern_Gentlem: jbwillia 'Ben Williams' 17:01:37 .hello mohanboddu 17:01:38 mboddu: mohanboddu 'Mohan Boddu' 17:01:45 .hello2 17:01:45 .hello zlopez 17:01:47 frantisekz: frantisekz 'František Zatloukal' 17:01:50 zlopez: zlopez 'Michal Konecny' 17:02:16 #chair bcotton_ 17:02:16 Current chairs: bcotton bcotton_ 17:02:23 bcotton, not as much lag on chat.fp 17:02:24 .hello pwhalen 17:02:25 pwhalen: pwhalen 'Paul Whalen' 17:02:49 computers were a mistake 17:02:54 ahoyhoy 17:02:57 .hello adamwill 17:02:58 adamw: adamwill 'Adam Williamson' 17:03:17 The bot is on vacation? Lol 17:03:36 #info Messages from IRC are apparently not reaching Matrix dot org 17:03:41 .hello sgallagh 17:03:42 StephenGallagher: sgallagh 'Stephen Gallagher' 17:04:01 i'll fax you the decision tuesday week 17:04:06 oddly they are fine for me... wonder if there's a matrix federation issue. 17:04:09 asynchronous lag 17:04:22 adamw: I can’t receive faxes where I live 17:04:47 StephenGallagher: Then pigeon it is ;) 17:04:48 bcotton, i am seeing maybe 1-2 secs between irc and chat.fp 17:04:49 okay, let's get started before StephenGallagher starts making jokes 17:05:01 Too late 17:05:02 #topic Purpose of this meeting 17:05:07 #info Purpose of this meeting is to check whether or not F35 Beta is ready for shipment, according to the release criteria. 17:05:08 #info This is determined in a few ways: 17:05:10 #info 1. No remaining blocker bugs 17:05:12 #info 2. Release candidate compose is available 17:05:13 #info 3. Test matrices for Beta are fully completed 17:05:16 .hello lruzicka 17:05:17 lruzicka2: lruzicka 'Lukáš Růžička' 17:05:21 #topic Current status - blockers 17:05:22 #link https://qa.fedoraproject.org/blockerbugs/milestone/35/beta/buglist 17:05:28 .hello geraldosimiao 17:05:29 geraldosimiao: geraldosimiao 'Geraldo S. Simião Kutz' 17:05:44 okay, so we have some proposed and some accepted blockers to look at 17:05:48 let's start with our accepted blockers 17:05:59 #topic (2005289) blivet.errors.DeviceFormatError: Failed to delete the device:format has not been created 17:06:00 #link https://bugzilla.redhat.com/show_bug.cgi?id=2005289 17:06:01 #link https://pagure.io/fedora-qa/blocker-review/issue/473 17:06:03 #info Accepted Blocker, blivet-gui, VERIFIED 17:06:06 oh god everybody run 17:06:16 this one is VERIFIED, anyone care to object? 17:06:26 #agreed release is no-go due to excessive sgallagh humor level 17:06:41 adamw: you forgot the scare quotes around humor 17:06:46 … that’s fair 17:06:57 adamw: also, you forgot to spell it Canadianly 17:07:05 ok, eh 17:07:19 adamw: ack 17:07:25 okay, i'm not hearing any objections (to the bug, not the StephenGallagher) 17:07:27 #topic (2005625) gnome-keyring does not work correctly in gnome-initial-setup session (causes delay on user creation, incorrect login keyring password, failure to connect to wifi network...) 17:07:29 #link https://bugzilla.redhat.com/show_bug.cgi?id=2005625 17:07:30 #link https://pagure.io/fedora-qa/blocker-review/issue/463 17:07:32 #info Accepted Blocker, gnome-keyring, MODIFIED 17:07:50 it seems to be fixed? at least the delay part 17:08:29 anyone want to disagree? 17:08:31 this is verified fixed in rc2 17:08:42 just need to update it 17:08:44 Yes 17:08:58 nope, do not disagree 17:09:04 geraldosimiao: yes you want to disagree, or yes it is fixed 17:09:34 i could add fedora account, I could connect to a wifi and the delay seems to be gone 17:10:21 #info This is verified to be fixed in rc2 17:10:32 #topic (1989726) [abrt] gnome-shell: cogl_texture_get_gl_texture(): gnome-shell killed by SIGSEGV 17:10:34 #link https://bugzilla.redhat.com/show_bug.cgi?id=1989726 17:10:35 #link https://pagure.io/fedora-qa/blocker-review/issue/399 17:10:37 #info Accepted Blocker, mesa, NEW 17:10:39 so. this one is not fixed 17:11:05 but it's also not likely to be fixed in a reasonably-fast timeframe 17:12:11 considering g41 just released things should be a little rough around the edge 17:12:49 beta i say wave, final would be a different story 17:12:53 proposed #agreed BZ 1989726 is waived under the "Difficult to fix blocker bugs" exception 17:13:07 ack 17:13:14 ack 17:13:16 Southern_Gentlem: fwiw, this appears to be more of a mesa issue than a gnome issue 17:13:39 ack 17:13:57 ack 17:13:57 so. move on? 17:14:08 #agreed BZ 1989726 is waived under the "Difficult to fix blocker bugs" exception 17:14:26 Is the aarch64 SIG okay with this decision? 17:14:42 poor jetson users :) 17:14:43 * StephenGallagher looks at pwhalen 17:14:48 bcotton_: Better than waived, mark it as pushed to Final 17:14:53 StephenGallagher: pwhalen acked it 17:14:57 #topic (2006028) Non-root user cannot join a domain through Cockpit 17:14:58 #link https://bugzilla.redhat.com/show_bug.cgi?id=2006028 17:14:59 ok, good 17:15:00 #link https://pagure.io/fedora-qa/blocker-review/issue/465 17:15:02 #info Proposed Blocker, cockpit, POST 17:15:04 er, i missed the last ten minutessomehow 17:15:22 mboddu: waiving automatically means 'pushed to next milestone' 17:15:28 adamw: the bridge is a little rickety today 17:15:53 #info Ticket vote: BetaBlocker (+0,0,-2) (-bcotton, -sgallagh) 17:15:54 adamw: Right, I forgot about that 17:15:54 #info Ticket vote: FinalBlocker (+3,0,-0) (+bcotton, +adamwill, +sgallagh) 17:15:56 #info Ticket vote: BetaFreezeException (+3,0,-0) (+bcotton, +adamwill, +sgallagh) 17:16:15 "geraldosimiao: yes you want to..." <- Yes fixed. The bridge here is too slow. I'll only watch. 🙂 17:16:47 yeah, -1 betablocker 17:17:07 so the general consensus here is that there's a workaround and that's good enough for now. this your opportunity to say otherwise 17:17:26 -1 BetaBlocker, +1 FinalBlocker 17:17:27 fine, here i am on irc 17:17:40 welcome to the present, adamw_ 17:17:45 I would not hold beta for this, so -1 BB 17:17:48 -1 betablocker 17:17:53 -1 bb, +1FB 17:18:27 i think the 'refresh the page' workaround is OK for beta, so -1 beta / +1 final. 17:18:39 -1 bb, +1FB 17:19:00 I was -1 BetaBlocker, +1 FinalBlocker in the ticket 17:19:16 proposed #agreed 2006028 - RejectedBlocker(Beta) - A suitable workaround is available and fixes can arrive in a post-releease update. (We'll leave FinalBlocker status for the Usual Process™) 17:19:19 In the event of a respin, I'd be in favor of FE 17:19:29 ack 17:19:31 ack 17:19:31 ack 17:19:34 ack 17:19:38 ack 17:19:42 ack 17:20:02 ack 17:20:04 ack 17:20:07 yes i am on both sides 17:20:10 #agreed 2006028 - RejectedBlocker(Beta) - A suitable workaround is available and fixes can arrive in a post-releease update. (We'll leave FinalBlocker status for the Usual Process™) 17:20:22 #topic (1999321) DNS often stops resolving properly after FreeIPA server upgrade to Fedora 35 or 36 17:20:24 #link https://bugzilla.redhat.com/show_bug.cgi?id=1999321 17:20:25 #link https://pagure.io/fedora-qa/blocker-review/issue/419 17:20:27 #info Proposed Blocker, freeipa, NEW 17:20:28 #info Ticket vote: BetaBlocker (+0,1,-1) (kparal, -bcotton) 17:20:53 * nirik waits for bugzilla 17:21:29 This is the one that held me busy for a couple of days and I still did not see anything on my local machine. 17:21:34 last time i looked, we couldn't reproduce this outside of openQA so there may be an acutal bug somewhere but who can really say? 17:21:43 so, i think it's reasonable to -1 this at least for Beta 17:21:49 So, basically the assumption right now is that there's something specifically about the openQA setup that causes this 17:21:55 it seems to be hard to reproduce outside of fedora infra 17:22:03 StephenGallagher: more so the environment it's running in 17:22:04 agreed, we could warn in Common bugs 17:22:05 With no confirmation in any other environment, I'm -1 BetaBloacker 17:22:15 adamw_: Right, I misspoke. 17:22:43 yeah, -1 BB here... but very odd. 17:22:45 there is also a workaround - disable dnssec - though i don't actually know how to do that for an existing deployment; i'll check that with ab for commonbugs purposes 17:23:13 the unreachable root servers there are all ipv6... there's no ipv6 in that dc. ;) 17:23:24 nirik: it's not the unreachable ipv6 ones that are the problem 17:23:37 nirik: it's the dnssec chain issues with the ipv4 addresses further down 17:23:47 proposed #agreed 1999321 - RejectedBlocker(Beta) - This has not been reproduced outside of the openQA environment, so it doesn't seem reasonable to block the Beta release for 17:24:14 ack 17:24:20 ack 17:24:23 ack 17:24:27 ack 17:24:32 ack 17:24:34 ack 17:24:40 #agreed 1999321 - RejectedBlocker(Beta) - This has not been reproduced outside of the openQA environment, so it doesn't seem reasonable to block the Beta release for 17:24:47 huh, weird. 17:25:01 #topic Current status - blockers 17:25:13 #info All accepted blockers are verified or waived 17:25:17 yay! 17:25:31 #topic Current status - test matrices 17:25:32 #link https://fedoraproject.org/wiki/Category:Fedora_35_Test_Results 17:25:53 Okay, QA friends, how are our tests? 17:26:00 i have just been massaging them 17:26:02 so they're great! 17:26:27 uh, but seriously folks. a couple of small things. we don't have cloud tests in a real cloud on x86_64 (we do on aarch64 though, thanks pwhalen for that) 17:26:29 adamw_: Relaxed, if nothing else :) 17:27:28 we don't have USB UEFI checked off for one of the aarch64 installer images, which is required... 17:28:01 though it passed in openQA and the disk images boot, so hard to think it'd be busted. 17:28:10 I guess this is new, not done USB testing in a while. 17:28:12 Rc 1.2 is looking good so far 17:28:25 pwhalen: i don't think it's changed? let me check the previous release matrices 17:29:01 it was the same for f34...jlinton checked it for final 17:29:01 https://fedoraproject.org/wiki/Test_Results:Fedora_34_RC_1.2_Installation?rd=Test_Results:Current_Installation_Test#Default_boot_and_install_.28aarch64.29 17:29:16 welp, i guess i can go find a jumper and see if i can avoid frying this jetson...:D 17:29:39 I dont think its going to work there adamw_ 17:30:20 "Hardware not molten. Test passes" 17:30:22 I think the OpenQA results should suffice. I'll make note to do this too for final. Too much in such little time 17:31:51 jetson will only work from a disk image? 17:32:43 okay, so aside from that, the only holes are a few cases where we have things tested for one arch but not another, i think they're all cases we don't need to worry about 17:32:51 no reason it'd work on one but not on the other (artwork stuff for e.g.) 17:33:24 We can throw them under "This is Beta" bus :) 17:34:20 This. Is. Beta! 17:34:40 adamw_: right, I'll try to cover this shortly, unlikely before the decision 17:34:54 pwhalen: hey, sometimes it's x86_64 that isn't covered :D 17:35:33 anything else on the test matrices? 17:36:18 that's it, i'd say coverage is acceptable 17:36:30 #info Tetst coverage is acceptable 17:36:34 #undo 17:36:34 Removing item from minutes: INFO by bcotton_ at 17:36:30 : Tetst coverage is acceptable 17:36:40 #info Test coverage is acceptable 17:36:52 typos are for the announcement emails, not the meeting logs 17:36:53 Nah, leave the other one. The irony is delicious. 17:37:07 #topic Current status - RC 17:38:01 do i recall correctly that RC2 reached the vaunted FINISHED status? 17:38:10 Yup 17:38:18 it did. 17:38:23 IoT - https://fedoraproject.org/wiki/Test_Results:Fedora-IoT_35_RC_20210922.0_General 17:38:39 #info RC2 is the current candidate. All artifacts built successfully 17:39:37 anything else to add on the RC? 17:40:06 not a sausage 17:40:08 it built, it tested 17:40:11 #topic Go/No-Go decision 17:40:13 I will poll each team. Please reply “go” or “no-go” 17:40:16 FESCo? 17:40:18 GO 17:40:32 #info FESCo is GO 17:40:36 Releng? 17:41:26 the suspense is killing me 17:41:28 I'll also say GO with my FESCo hat on :-) 17:41:38 Go 17:41:39 🏎️go go go 17:41:41 #info Releng is GO 17:41:43 QA? 17:41:44 GO 17:41:48 per QA rules, we're go 17:41:49 #info QA is GO 17:41:59 #agreed Fedora Linux 35 Beta is GO 17:42:00 #info Fedora Linux 35 Beta will release on 2021-09-28 17:42:07 Yay 17:42:12 #action bcotton to announce decision 17:42:19 #topic Open floor 17:42:19 cg 17:42:21 Anything else we need to discuss before closing? 17:42:21 how much time do we have for final? 17:42:40 freeze is on 5th? 17:42:46 lruzicka2: early final target is 2021-10-19 https://fedorapeople.org/groups/schedule/f-35/f-35-key-tasks.html 17:42:49 planned release 19th 17:42:59 frantisekz: correct. freeze starts on the 5th 17:43:08 check the packager dashboard lruzicka! :D 17:43:18 pfft who uses that thing :P 17:43:19 we do not have much time then 17:43:34 bcotton_: Wont the freeze gets pushed to 12? 17:43:34 lruzicka2, which might be to our advantage 17:43:35 let's better not start anything big :D 17:43:49 just polish what we have :D 17:43:55 it's already baking in u-t though... :D 17:43:55 bcotton_: I thought the policy is to have 2 weeks in between beta release and final freeze 17:43:56 exactly 17:44:02 * nirik has to run, but thanks everyone for your hard work. 17:44:09 thanks, \o nirik 17:44:16 thanks nirik 17:44:25 thanks 17:44:31 mboddu: not necessarily. f32 had immediate freeze, iirc 17:44:44 mboddy 19-5 == two weeks 17:44:55 which is true 17:45:25 Jan would be 28-5 17:45:37 bcotton_: Right, but I thought it was a special case, anyway if adamw_ is okay with, I am fine with it 17:46:18 i'm busy looking at air conditioner reviews over here 17:46:47 uhh, freeze on 5th gives us...12 days? yeah, it's a bit tight i guess 17:46:59 we've got a whole gnome version to land 17:47:00 adamw_, get a sinclair 17:47:02 dunno what else people have lined up 17:47:28 7days but that gives time to fix stuff we didnt have in beta 17:47:55 the freeze-to-early-release window hasn't changed in...at least since i started as fpgm, iirc 17:48:02 instead of introducing a bunch of unknows 17:48:23 ns 17:48:29 bcotton_: well, the thing is when we slip beta without changing the final dates that window gets tighter 17:48:32 the start of final freeze is keyed to the final release target, not the beta release 17:48:47 we used to slip the whole schedule when beta slipped, iirc 17:48:55 anyhoo 17:49:35 anything else before i start sending emails? 17:50:17 i guess not, just adamw_ should get a sinclair :d 17:50:54 #action adamw_ to get a sinclair 17:50:58 no, just i think mboddu has a reasonable concern, and we will reserve the right to say i told you so :P 17:51:04 :) 17:51:19 I am getting a feeling that F35 final will be postponed as well, it will come down to Gnome 41 is important and we cannot ship F35 final with it 17:51:32 s/with/without/ 17:51:33 happy to discuss the concern post-meeting in a venue of your choosing :-) 17:51:55 #endmeeting