16:30:20 #startmeeting fedora_coreos_meeting 16:30:20 Meeting started Wed May 20 16:30:20 2020 UTC. 16:30:20 This meeting is logged and archived in a public location. 16:30:20 The chair is dustymabe. Information about MeetBot at http://wiki.debian.org/MeetBot. 16:30:20 Useful Commands: #action #agreed #halp #info #idea #link #topic. 16:30:20 The meeting name has been set to 'fedora_coreos_meeting' 16:30:24 .hello2 16:30:24 #topic roll call 16:30:25 jlebon: jlebon 'None' 16:30:29 .hello2 16:30:30 dustymabe: dustymabe 'Dusty Mabe' 16:30:33 .hello2 16:30:34 slowrie: slowrie 'Stephen Lowrie' 16:30:34 .hello2 16:30:39 davdunc: davdunc 'David Duncan' 16:30:52 o/ 16:30:55 .hello2 16:30:56 cyberpear: cyberpear 'James Cassell' 16:31:03 .hello2 16:31:03 x3mboy: x3mboy 'Eduard Lucena' 16:31:27 .hello2 16:31:28 lucab: lucab 'Luca Bruno' 16:31:32 .hello sohank2602 16:31:33 skunkerk: sohank2602 'Sohan Kunkerkar' 16:31:38 .hello2 16:31:39 bgilbert: bgilbert 'Benjamin Gilbert' 16:31:52 .hello miabbott 16:31:53 miabbott: miabbott 'Micah Abbott' 16:32:02 .hello abai 16:32:03 abai: abai 'Zonggen Bai' 16:32:09 wow, lots here today! 16:32:37 .hello2 16:32:37 darkmuggle: darkmuggle 'None' 16:33:07 #chair slowrie davdunc cyberpear x3mboy lucab skunkerk bgilbert miabbott abai cyberpear darkmuggle 16:33:07 Current chairs: abai bgilbert cyberpear darkmuggle davdunc dustymabe lucab miabbott skunkerk slowrie x3mboy 16:33:12 what a turnout :) 16:33:51 #topic Action items from last meeting 16:34:09 * lorbus to try out OKD on our `next` stream so we can work out any 16:34:10 .hello2 16:34:11 walters: walters 'Colin Walters' 16:34:11 kinks before switching `stable` to f32 16:34:13 * dustymabe to create a ticket where we discuss appropriate update 16:34:15 barrier approach for major upgrades 16:34:17 * dustymabe to get new podman release into testing release so we can fix 16:34:19 stable in next weeks releases 16:34:21 #chair walters 16:34:21 Current chairs: abai bgilbert cyberpear darkmuggle davdunc dustymabe lucab miabbott skunkerk slowrie walters x3mboy 16:35:27 #info dustymabe created a intermediate testing release with podman fix (31.20200505.2.1). That fix just landed in stable yesterday (31.20200505.3.0) 16:36:00 #info dustymabe created a ticket to further the barrier discussion #480 16:36:20 lorbus isn't around this week so we'll re-action that for now 16:36:30 #action lorbus to try out OKD on our `next` stream so we can work out any kinks before switching `stable` to f32 16:37:03 #topic meeting agenda 16:37:46 we have a lot of tickets to get through today so i'll mostly just iterate through those 16:38:20 if anyone has a big topic to bring up feel free to do so and I'll add it to the agenda (i.e. not something small like open floor) 16:38:44 otherwise I'll start on meeting tickets in a moment 16:39:32 #topic F32 rebase tracker for changes discussion 16:39:39 #link https://github.com/coreos/fedora-coreos-tracker/issues/372 16:39:55 we're using this ticket as an excuse to talk about Fedora 32 progress 16:40:14 the last update we have on the schedule is in https://github.com/coreos/fedora-coreos-tracker/issues/372#issuecomment-631586457 16:40:52 #info we decided to delay the F32 transition into `testing` until the next release cycle because of an issue where clients could get stuck in a "trying upgrade" loop https://github.com/coreos/fedora-coreos-tracker/issues/481 16:41:53 so we'll shift and target the f32 transition for the next testing release (around 06/02/2020) which should propagate to stable after that (06/16/2020) 16:42:39 any questions or concerns related to that OR any other f32 related things someone would like to bring up? 16:43:55 * dustymabe moves to next meeting ticket shortly 16:44:18 #topic Fedora 32 samba-client-libs now pulls in Unicode data 16:44:23 #link https://github.com/coreos/fedora-coreos-tracker/issues/452 16:45:15 we have discussed this out of band in the past I believe, (I think with luca and jlebon) 16:45:31 TL;DR we've got a new dep that's large that's coming in 16:45:55 I think Luca was surprised we didn't already have the unicode data in FCOS (i.e., that something else didn't already need it) 16:46:30 lucab: is that accurate ^^ 16:46:38 indeed 16:46:59 i thought ICU was for rather esoteric unicode stuff 16:47:00 I wonder if it could be downgraded to a Recommends, but I'm not /that/ familiar w/ samba 16:47:08 yes 16:47:27 e.g. glib has always carried a basic implementation, and so does golang 16:47:49 up until this point we haven't worked to avoid this in f32 so are we OK with it staying (as we transition our other streams to f32) 16:47:59 in the assumption that something else is going to need it in the future so we might as well 16:49:13 even for Fedora Minimization objective, it'd be good to get to the bottom of the requirement 16:49:14 hmm, probably worth doing a quick poking around at least to see how essential it is in that package 16:49:33 any volunteers to do poking :) ? 16:49:53 cyberpear: how plugged in are you with the minimization objective ? 16:49:53 if it's not actually needed, lets drop the dep; if it can be Recommends, let's make it so, and add a comment to the .spec file about why, for the next person who comes along 16:50:13 I only follow it; there are no regular meetings, just conversations on fedora-devel 16:50:19 and chatting on #fedora-devel 16:50:45 cyberpear: any chance you'd be willing to do some light investigation here and report back next week? 16:50:45 I send patches to .specs occasionally for reasons for Recommends, or changing deps around to make things smaller 16:51:02 sure, I'll take a quick look, but again, I'm not familiar w/ samba 16:51:27 cyberpear: thanks so much.. Yeah I'm not sure if we have any samba experts in the meeting here with us 16:51:33 if you're here.. show yourself!! :) 16:51:58 I have to ask AB to tell me anything about that work. 16:52:33 #action cyberpear to take a look to see if we can change the libicu dep in samba-client-libs to a recommends (#452) 16:52:41 cyberpear++ 16:53:02 #topic update barrier approach to major upgrades 16:53:07 #link https://github.com/coreos/fedora-coreos-tracker/issues/480 16:53:31 this is a carryover from last meeting where we were discussing what our update barrier approach to major Fedora bumps should be 16:54:00 One pertinent point that was brough up is https://github.com/coreos/fedora-coreos-tracker/issues/480#issuecomment-630913393 16:54:45 which IIUC means we need update barriers for FedoraMajor-2 to FedoraMajor 16:55:08 assuming we don't already have barriers in place which satisfy this 16:55:23 e.g. for testing, the barrier we have ensures nodes already have f32 keys 16:55:43 yeah, I'd vote for no barrier unless technically needed 16:55:44 for stable, we don't have a barrier, but i checked that the earliest stable release already has f32 16:55:55 has f32 keys* 16:56:39 couldn't we retrofit those barriers? 16:57:00 e.g. when F33 comes out, add a barrier from F31 to F32 16:57:05 clarification to my last statement in the ticket: https://github.com/coreos/fedora-coreos-tracker/issues/480#issuecomment-631599416 16:57:10 that way they won't affect most users, but we avoid breaking stragglers 16:57:36 bgilbert: yep 16:57:44 i guess so. though barriers already don't affect most users, since everyone in theory should be following along 16:57:58 jlebon: :-) 16:58:14 with CL, people _often_ launched stale images and then immediately updated 16:58:29 AWS CloudFormation is one culprit 16:58:33 retrofit seems reasonable, but maybe F32 comes out, then we add barrier F30->F31 16:58:52 wait, that's what u said 16:58:54 cyberpear: I think that is what @bgilbert is suggesting 16:58:55 (sorry) 16:58:56 yep 16:59:20 stale images in private clouds are another 17:00:14 bgilbert: yeah for sure people will do that. though feels like if you're doing that, you're probably ok with multiple reboots already :) 17:00:32 ok so the current proposal (to work around the key signature issue) is to retrofit barriers for old releases ? 17:01:02 WFM 17:01:05 jlebon: sure, +1 to multiple reboots for very old images. just trying to avoid it for reasonably recent ones 17:01:09 dustymabe: +1 17:01:14 it sounds like a reasonable middle ground 17:02:20 at what time do we retrofit? when doing the N+1 bump? 17:02:54 ok so the two proposals are 1) make a barrier such that all Fedora major N-1 flows through the latest N-1 -> N 2) make that same barrier but only after N+1 has been released (i.e., retrofit) 17:03:07 maybe only need a -3 to -2 barrier.. i.e., F33 comes out, make a F30 -> F31 barrier? 17:03:18 * cyberpear (does the very first F30 release have 17:03:37 I still like 1) better but I'm OK with 2) - obviously we can revisit this in the future when f33 happens 17:03:39 (does the very first F31 release have F33 keys?) 17:03:59 cyberpear: no I don't think - i guess we could test that now to see if f32 has f34 keys 17:04:10 I don't think they make them until rawhide starts being f34 17:04:53 I'm okay adding the N-1 -> N barrier at the N+1 point. if the image is six months stale, the extra reboot seems fine 17:05:14 anyone want to advocate for 1) ? If not I'll open a #proposed for the 2) proposal 17:05:58 bgilbert: +1 17:06:35 that seems like an easy SOP to wrap our head around and not mess up :) 17:07:02 +1 for retroactive barriers 17:07:05 i think +1 to 2) for me, though with bgilbert's suggestion 17:07:44 #proposed in the interest of signing keys we'll retrofit a barrier for N-1 -> N at the N+1 point. i.e., 6 months after N came out. 17:07:53 +1 17:08:01 +1 17:08:01 how was 2) different thant what bgilbert said? 17:08:04 +1 17:08:22 dustymabe: I was just trying to figure that out. 17:08:41 i think they are the same - but i miss things sometimes :) 17:08:57 I think they're the same, and distinct from cyberpear's suggestion of -3 to -2 17:09:00 * davdunc has the same problem. I miss things. 17:09:08 bgilbert: +1 17:09:15 dustymabe: yeah sorry, i think i misread it as putting the barrier on f31 shortly after f32 comes out 17:10:26 I'll probably try to elaborate on this a little more (with an exmaple) when I populate the ticket 17:10:38 #agreed in the interest of signing keys we'll retrofit a barrier for N-1 -> N at the N+1 point. i.e., 6 months after N came out. 17:10:54 (though again, note that we don't actually have to add a barrier on f30 for the f32 release specifically) 17:11:06 jlebon: right, because there was no f30 17:11:13 so we don't need to do any barriers for now 17:11:41 well, testing did run f30, but we have a barrier which does what we need already 17:11:55 +1 17:12:12 jlebon: i'll lean on you to make a followup comment about that with some details :) 17:12:20 in the ticket after I put this info into it 17:12:24 ack, will do! :) 17:12:48 * dustymabe skipping the NIC naming card til next week based on comments in the ticket 17:12:56 #topic 2020-05-20: gather status update for Fedora Council 17:13:03 #link https://github.com/coreos/fedora-coreos-tracker/issues/486 17:13:19 it's that time again.. what beautiful work have we been doing ? 17:13:25 here is the one from last time 17:13:42 link : https://github.com/coreos/fedora-coreos-tracker/issues/450 17:14:38 - the FCOS landing page now offers more rich information about each version of FCOS in our streams: https://getfedora.org/en/coreos?stream=stable 17:15:10 do we count rpm-ostree/zincati/afterbun stuff too in there? 17:15:11 did the offline work land in this cycle ? 17:15:18 yup, osmet landed 17:15:24 lucab: I think so 17:15:30 (ignition/coreos-installer/etc ...) 17:15:31 jlebon: want to give me a blurb on that ? 17:16:11 basically high level things that happened - probably want to keep it under 10 bullet points 17:16:23 - users can now install FCOS from the live ISO fully offline 17:16:50 did the vultr stuff land this cycle ? 17:16:53 - Ignition config spec 3.1.0 is now available in the testing stream 17:16:53 (osmet applies to PXE too of course, but it's a different shade of "offline" in that context :) ) 17:17:17 (FCCT support not stabilized yet; coming soon) 17:17:28 - enabled cloud-recommended time sync configuration for AWS, GCP, Azure 17:17:57 - FCCT gained support for embedding local files and directory trees in the config 17:18:00 - we now offer the option to configure static networking in the interactive live installer via NM tools (nmcli/nmtui) and have that configuration propagate into an installed sysem 17:18:17 dustymabe: yes 17:18:57 dustymabe: mention something about the GCP work you've been doing? 17:19:20 miabbott: yeah - most of it has been behind the scenes work (in our last update we mentioned we're now uploading to GCP) 17:19:27 so not as much user facing 17:19:33 👍 17:19:40 i did think about it :) 17:19:59 i can mention that we have a docs page for it (thanks lucab) 17:20:06 - docs page for GCP 17:20:33 - next stream supports re-enabling sshd password auth 17:20:59 lucab: the zincati work for update windows - should we put in the next update probably ? 17:21:28 - docs pages for Azure and DigitalOcean 17:21:38 dustymabe: it's currently only on master. Same for afterburn stuff. I'll add some points once released. 17:21:48 +1 17:22:01 thanks all for helping identify the great work that's been going on! 17:22:38 if there is any we missed here feel free to add a note to the ticket https://github.com/coreos/fedora-coreos-tracker/issues/486 17:22:43 #topic open floor 17:23:47 crickets 👀 17:23:49 re. signing-keys, do we need to bump anything in coreos-installer at this point? 17:24:01 good question 17:24:07 ooh, let me check 17:24:08 * cyberpear has an idea 17:24:28 yes! 17:24:28 so right now we've been signing with the f31 key still (we have a ticket to switch robosig) 17:24:29 good catch 17:24:43 that should go in the SOP doc if we have one 17:25:00 +1 we need an SOP 17:25:01 https://github.com/coreos/fedora-coreos-config#moving-to-a-new-major-version-of-fedora 17:25:10 oh nice :) 17:25:14 :) 17:25:45 bgilbert: we hard code some keys right ? 17:26:12 dustymabe: we do 17:26:16 i think i argued at some point to just use fedora-gpgp-keys instead of embedding 17:26:24 jlebon: that works on a fedora system 17:26:31 #action bgilbert to PR c-i and f-c-c SOP for new signing key 17:26:35 if you're running on ubuntu, not so much 17:26:51 yeah, I'm still in favor of hardcoding. explicit > implicit 17:26:55 but... we don't support running as a fat binary, do we? 17:27:12 jlebon: ? 17:27:12 jlebon: i'm not sure.. i was thinking of fcct 17:27:20 `cargo install` is supported 17:27:47 as always "support" deserves a `*` 17:27:52 i.e., support* :) 17:28:00 bgilbert: ok, i think this came up a few times and it wasn't clear to me what our stance was 17:28:03 `cargo install` is support*ed 17:28:14 😜 17:28:23 #idea fedora-coreos-rojig.src.rpm, imports the fedora-coreos-config in Sources, then runs cosa in an rpmbuild, to result in a small rojig binary RPM, built in Koji -- then only the other artifacts than the OSTREE need be built in the external-to-compose pipeline 17:28:27 because we do link to stuff and call out to other stuff. but anyway, no need to linger :) 17:28:31 ^ but maybe for next meeting 17:29:22 cyberpear: that seems like a fun thought exercise 17:29:31 definitely quite a ways from where we are now 17:29:43 cyberpear: that's an funky but interesting idea 17:29:58 * cyberpear loves RPMs 17:30:04 * cyberpear loves SRPMS 17:30:12 meeting time is..... up.. any final thoughts before closing? 17:30:51 cyberpear: koji has this "runroot" thing which is how Fedora Atomic Host was built, and coreos-assembler was created and works the way it does in large part in result to how awful that was 17:31:32 a related point is, we are basically re-inventing initscripts as generators in -config, and I'm scared 17:31:32 I'm saying, run coreos-assembler in the RPM build, just have koji/rpmbuild run it for you 17:31:51 (Fedora Silverblue and IoT are still built that way and I'm trying to fix that) 17:32:04 mock uses container tech too - so it doesn't stack well IIUC 17:32:05 yeah, I've been wanting to get some/many of those moved out of fedora-coreos-config into better homes, but... 17:32:09 * cyberpear has very little bandwidth 17:32:28 * dustymabe needs to run soon 17:32:45 * cyberpear has nothing more 17:32:48 let's close, we can move other things back to our channel 17:32:51 #endmeeting