16:29:16 #startmeeting fedora_coreos_meeting 16:29:16 Meeting started Wed Jan 8 16:29:16 2020 UTC. 16:29:16 This meeting is logged and archived in a public location. 16:29:16 The chair is dustymabe. Information about MeetBot at http://wiki.debian.org/MeetBot. 16:29:16 Useful Commands: #action #agreed #halp #info #idea #link #topic. 16:29:16 The meeting name has been set to 'fedora_coreos_meeting' 16:29:20 #topic roll call 16:29:23 .hello2 16:29:24 dustymabe: dustymabe 'Dusty Mabe' 16:29:29 .hello2 16:29:30 slowrie: slowrie 'Stephen Lowrie' 16:30:09 * dustymabe waves at slowrie :) 16:30:18 .hello2 16:30:19 bgilbert: bgilbert 'Benjamin Gilbert' 16:30:21 hey dusty, hope you had a good holiday break 16:31:56 slowrie: I did, got a lot of small things done that I've been meaning to do for a while 16:32:09 #chair slowrie bgilbert 16:32:09 Current chairs: bgilbert dustymabe slowrie 16:32:18 .hello2 16:32:19 .chair bgilbert 16:32:19 ajeddeloh: ajeddeloh 'Andrew Jeddeloh' 16:32:23 bgilbert is seated in a chair with a nice view of a placid lake, unsuspecting that another chair is about to be slammed into them. 16:32:33 #chair ajeddeloh 16:32:33 Current chairs: ajeddeloh bgilbert dustymabe slowrie 16:32:52 .hello lucab 16:32:53 kaeso[m]: lucab 'Luca Bruno' 16:32:54 .hello2 16:32:56 jlebon: jlebon 'None' 16:33:02 .hello mnguyen 16:33:03 mnguyen_: mnguyen 'Michael Nguyen' 16:33:06 #chair jlebon kaeso[m] mnguyen_ 16:33:06 Current chairs: ajeddeloh bgilbert dustymabe jlebon kaeso[m] mnguyen_ slowrie 16:33:09 .hello2 jdoss 16:33:10 jdoss: jdoss 'Joe Doss' 16:33:14 \o/ jdoss 16:33:15 * jdoss waves 16:33:17 .hello jdoss 16:33:21 dustymabe: jdoss 'Joe Doss' 16:33:29 * bgilbert blinks 16:33:38 woah 16:33:43 call the press, bgilbert is here 16:33:56 nooooooo, not the press 16:34:06 #chair jdoss 16:34:06 Current chairs: ajeddeloh bgilbert dustymabe jdoss jlebon kaeso[m] mnguyen_ slowrie 16:34:08 A bgilbert wink is as good as a nudge to a blind bat. 16:34:13 call the NY housing authority instead :P 16:34:25 You'll get an answer sometime in the next 8 months 16:34:27 is ksinny around? /me misses ksinny 16:34:50 honorary chair 16:34:51 she's in another meeting right now 16:34:56 +1 16:35:07 #topic Action items from last meeting 16:35:27 * miabbott to help us get the azure image upload/boot tested 16:35:29 * jlebon to create a separate issue to track the updates needed to the 16:35:31 websites for the stable stream 16:35:46 .hello miabbott 16:35:47 miabbott: miabbott 'Micah Abbott' 16:35:53 well howdy! 16:35:57 #chair miabbott 16:35:57 Current chairs: ajeddeloh bgilbert dustymabe jdoss jlebon kaeso[m] miabbott mnguyen_ slowrie 16:36:11 sorry, never got to the Azure test before the holiday :( 16:36:17 .hello2 16:36:18 lorbus: lorbus 'Christian Glombek' 16:36:26 #chair lorbus 16:36:26 Current chairs: ajeddeloh bgilbert dustymabe jdoss jlebon kaeso[m] lorbus miabbott mnguyen_ slowrie 16:36:42 miabbott: no worries 16:36:50 #action miabbott to help us get the azure image upload/boot tested 16:36:56 jlebon: did you create that ticket? 16:36:58 #info jlebon filed https://github.com/coreos/fedora-coreos-tracker/issues/332 for website updates for stable 16:37:03 perfect! 16:37:35 i'll check in with alan and see how that is going 16:38:15 #topic Create stable stream 16:38:20 #link https://github.com/coreos/fedora-coreos-tracker/issues/331 16:38:44 this topic is mostly left over from last meeting, but I figured it would be good to get a status update from various work items that are in flight 16:39:50 jlebon: kaeso[m]: anything to mention here that's specifically related to the ticket? 16:39:58 i have an update, tangential to the ticket 16:40:34 there is a cincinnati ticket in there, it's on my radar for this sprint but it doesn't block the first release (it will need to be done to auto-update to the second one though) 16:40:36 so, we have a stable build. aiming to do a stable "release" this week to sanity check everything before we're actually ready to release what we want 16:40:54 kaeso[m]: jlebon: +1 16:41:39 regarding the few other things we'd like to do: I've been working on carrying bgilbert's good work on the installer to completion 16:42:01 we got the systemd service merged (https://github.com/coreos/coreos-installer/pull/119) 16:42:04 dustymabe: +1, thanks for picking that up! 16:42:27 and I've done some work to add a coreos-installer-systemd rpm subpackage to the rpm in fedora 16:42:43 i'm working through the release process for coreos-installer today (so we'll have a new release to package) 16:42:50 dustymabe: we need rereview for the main package, no? 16:43:10 bgilbert: rfairley got it into Fedora as 'rust-coreos-installer' 16:43:17 rfairley++ 16:43:17 bgilbert: Karma for rfairley changed to 2 (for the current release cycle): https://badges.fedoraproject.org/tags/cookie/any 16:43:20 so it went through as a new review and got approved 16:43:39 The PR to update the (new) rpm is at https://src.fedoraproject.org/rpms/rust-coreos-installer/pull-request/1 16:43:52 is it in F31 too already? 16:44:01 although I need to push up some local changes to that PR 16:44:22 kaeso[m]: no, it's only been built for rawhide, but I don't know of any blockers for it being built for f31 16:44:34 ack 16:44:35 of course, there may be some issues that I don't know about 16:44:37 :) 16:45:10 any other updates for things related to stable before we move to the next ticket? 16:46:03 #topic Add Azure to release and stream metadata 16:46:09 https://github.com/coreos/fedora-coreos-tracker/issues/325 16:46:43 so there are a few different artifacts (not just azure) that we are building in the pipeline, but we aren't plumbing all the way through the release process 16:47:05 anybody around that is able to tweak a few places to get that content included?> 16:47:19 i can take a look 16:48:15 ok, if anyone else is interested i'm sure jlebon would be a good mentor as well :) please reach out 16:48:37 next topic? 16:49:19 #topic FCoS versions are not semvers, unable to leverage them inside of more structured systems 16:49:27 #link https://github.com/coreos/fedora-coreos-tracker/issues/338 16:49:34 * dustymabe re-reads the issue 16:50:09 the TL;DR (as i remember it) is that OKD wants to be able to report FCOS versions through their tooling, but it is setup for semver format 16:50:25 it being OKD tooling 16:51:17 is that the case for RHCOS versions already? Can we align them? 16:51:20 my view on this is: with the current state of the art, it's impossible for releases of a Linux distro to adhere to semver compat guarantees, unless every new release bumps the major. 16:51:44 RHCOS is moving to semver format, but without any semver guarantees 16:51:53 I think the requirement was to be pseudo-semver 16:52:00 for FCOS that is. 16:52:04 bgilbert: correct. 16:52:15 if we aren't going to actually use semver, why support being parsed by a semver parser? FCOS versions aren't intended to be parsed at all; they're for debugging/reporting purposes only. they're strings. 16:52:54 the changelog use case has some reason to parse, sure, but we shouldn't restructure our versioning only for that case. 16:53:20 kaeso[m]: i'm curious about the interaction with users that were confused. were they angry at compat breaks that somehow weren't publicized enough? 16:53:29 I believe this is so the version plays well with the rest of OpenShift tooling and the CVO. IIRC the only change need was to replace a dot with a dash or something. 16:53:52 the .dev case given in the ticket is kind of a red herring 16:54:16 the relevant part is official releases, which are A.B.C.D 16:54:26 bgilbert: right 16:54:27 bgilbert: well, they're strings to everyone else, they're parsable to us :) 16:54:34 jlebon: sure 16:54:35 not sure if Clayton documented the exact reqs anywhere. I can follow that up with him if needed. 16:54:52 (nvmd it is in the ticket) 16:55:14 official releases used to be A.B.C but we recently implemented our versioning scheme that we wanted which is now A.B.C.D 16:55:15 jlebon: docker had a huge storm at the time of 1.1x.y releases, they eventually switched away to calendars to try to avoid confusion 16:55:35 how do we suggest users perform version ordering for FCOS? would we expose the release index to them? 16:56:03 the release-index is source of ordering Cincinnati uses, yes 16:56:07 jlebon: what are the cases where they'd need to? Cincinnati will upgrade them, and otherwise, ? 16:56:14 *the source 16:56:23 Shouldn't they just be using stream metadata if they need to know which to launch and the rest is handled automatically 16:57:02 not necessarily for software on the node itself, but higher level client infra 16:57:19 I think we are having X-Y problem discussion 16:58:07 i'm just evaluating whether "they're strings" should indeed be our stance 16:58:28 jlebon: yeah, it's a bit more nuanced than that 16:58:35 we defined versions s.t. version-sort will work 16:58:43 and I think breaking that would be too confusing 16:58:56 my point was more that nothing should be taking _action_ based on versions 16:59:13 why is semver specifically being discussed? if it is for ordering, the release-index has that. If it is for compatibility decision, FCOS does not follow that. 16:59:32 bgilbert: is something taking action based on them? seems like OKD wants to display "what changed" info 16:59:48 have you considered QA needs here? it is generally useful to QA if things have some kind of sanely parseable versioning scheme 17:00:19 it helps to know what this thing that just came out is, how it relates to other things, identify when a thing broke or changed... 17:00:24 What is QA?? 17:00:28 * jdoss hides from adamw 17:00:32 .fire jdoss 17:00:32 adamw fires jdoss 17:00:35 ahhhhh 17:00:38 .hire jdoss 17:00:38 adamw hires jdoss 17:00:41 woah 17:00:45 whew 17:00:52 #chair adamw 17:00:52 Current chairs: adamw ajeddeloh bgilbert dustymabe jdoss jlebon kaeso[m] lorbus miabbott mnguyen_ slowrie 17:01:40 we don't need it to actually follow semver rules or anything, but something where we can at least know vaguely what the version string indicates and parse 'X is newer than Y' is important 17:01:44 kaeso[m]: I think semver is being discussed because apparently everything in kube uses the semver format for versioning and they're asking if we can do the same so that display tools will show our OS version differences more easliy 17:01:57 adamw: yep, you'll definitely have that 17:02:03 adamw: version-sort will work. the version numbers actually encode a lot of information about what's going on with the release 17:02:06 we're not going full git hash on you 17:02:09 =) 17:02:09 :) 17:02:12 cool, thanks 17:02:24 git hash versioning is the future 17:02:40 slowrie: or the past. hard to tell 17:03:05 ok, so let's see where we are 17:03:09 I'm not even sure that version-sort always work in all cases, we already started a F31 build and then reverted to F30 17:03:29 that's the king of things that adamw loves :) 17:03:33 kaeso[m]: but we didn't release the F31 build 17:03:33 s/king/kind 17:03:37 * adamw warms up the firin' script again 17:03:42 lol 17:03:42 kaeso[m]: but we didn't intend anyone to downgrade 31 -> 30, and I can't imagine we would 17:04:20 let me make a few statements and see if people agree with them 17:04:32 1. OKD is not asking us to comply with semver 17:04:44 right, not officially. That's why sticking to release-index order works better (it doesn't contain aborted builds) 17:04:50 2. OKD is asking to see if we can make our versioning fit in the semver format 17:05:12 for context, the original phrasing was: "Is there a strong reason to have the current version format? Would there be significant opposition to changing to be reported in semver?" 17:05:24 IMO the answers are yes and yes 17:05:42 "significant" is hard to define of course 17:05:48 bgilbert: do you agree with 1. 2. ? 17:06:06 roughly, yeah 17:06:16 anyone disagree with 1. 2. ? 17:06:20 FWIW: my opinion would be that if it's as simple as not having a 4th '.' and instead using a '-' I don't really think it matters as long as we clearly state it's not semver 17:06:36 slowrie: i'm getting there 17:07:03 so the big question is, considering our current versioning, what do we lose if we move to semver? could we adapt it so that we don't lose any fidelity? 17:07:26 I don't agree with that 17:08:00 Truly moving to semver would require completely re-designing the versioning. Just following the basic convention to allow it to be parseable but unusable would be a different scenario 17:08:11 the status quo is the default. I'd like to see a strong argument why we should switch to a format that we've already agreed isn't a semantic fit for us. 17:08:31 (it doesn't matter if it looks like semver and we clearly state it's not semver: folks are already semver parsing it, so it will be semver) 17:08:39 kaeso[m]: +1 17:09:36 who on earth expects semver guarantees from an OS, though 17:09:54 users :) 17:10:07 Exactly why I asked what is QA! 17:10:18 (kidding I love guarantees) 17:10:30 especially because part of our version is a datestamp 17:10:45 it's not really an incrementing version 17:11:13 I just don't think anyone would be confused about expecting semver from an OS just because the version is in semver format 17:11:29 I always find a datestamp version more useful than semver for OS images. 17:11:50 the last paragraph of https://github.com/coreos/fedora-coreos-tracker/issues/338#issue-540477085 also implies that the reporter already has a workaround 17:13:05 stepping back a bit, it seems like okd shouldn't be forcing it's components into its versioning scheme 17:14:09 ajeddeloh: probably 17:14:46 we've reserved the right to change the versioning scheme when bumping the major, so we have an opportunity to revisit every 6 months 17:15:01 fcos doesn't seem like the right place to fix the issue 17:15:04 I'd propose that we keep the status quo for now, and if it creates really serious problems, we can come back to this 17:16:08 I think keeping the status quo is fine, but I do keep getting stuck on the "people will expect semver guarantees if it's in semver format" 17:16:16 I just disagree with that last part 17:16:41 and who cares if they expect semver, it's a community project and we'll point them at documentation 17:16:44 right, i tend to agree with dustymabe 17:17:17 people tend to do things. :-) I agree that that part may not be a major issue, but I don't think it's the core of the argument either 17:17:56 i totally get the idealistic view of not having a semver format because it's not semver, though at a practical level, given that we do want our versions to be somewhat parseable, ISTM the ability to be leveraged by parsers outweighs possibly confusing a small set of people who somehow expected semver from an OS 17:18:29 bgilbert: which part is the core of the argument? 1. openshift shouldn't enforce requirements here or 2. we'd lose fidelity by using semver 17:18:45 jlebon: the versions aren't unparseable or anything. they just have more than three fields. 17:19:24 dustymabe: fair. But again I've already seen an iteration of this mess, so I don't see the point of voluntarily introducing the confusion. 17:19:26 bgilbert: right, but there's lots of code already out there that knows how to parse semver and compare them 17:21:07 kaeso[m]: +1 - past experience is always useful 17:21:19 kaeso[m]: for an OS though, or a component software? 17:21:32 dustymabe: IMO the core of the argument is that we should use a system that works well for FCOS, rather than cramming our worldview into three fields to satisfy a parser whose worldview intentionally involves guarantees we can't meet 17:22:16 jlebon: the latter 17:22:18 bgilbert: wait wait 17:22:27 who said we had to use just 3 fields? 17:22:48 dustymabe: with a side of "OKD may sometimes have to deal with external components that don't use semver" 17:22:52 dustymabe: ...semver does? 17:23:12 but what about the - 17:23:16 x.y.z-foo 17:23:46 Why is it such a problem for okd to have non-semver components 17:24:02 not all software is semver 17:24:03 ajeddeloh: maybe it's not, we haven't really gone there 17:24:30 whatever we decide, we shouldn't do it just for the benefit of OKD 17:24:40 if it comes at a perceived cost to FCOS 17:24:42 I'd be surprised if fcos is the only non-semver thing that okd encounters 17:24:56 jlebon: i agree, I wouldn't be having this conversation if we had already put out our first stable release 17:25:31 dustymabe: ugh, yeah, we could do that. it violates semver semantics ("pre-release version") but we've already agreed we'd be doing that. 17:25:46 bgilbert: right 17:25:57 bgilbert: check out this diff: https://github.com/coreos/fedora-coreos-releng-automation/pull/67/files 17:25:58 i don't think anyone was thinking we'd drop a filed 17:26:01 field* 17:26:12 blah 17:26:40 so everything becomes a "prerelease" 17:27:04 bgilbert: if you are a person who makes assumptions, yes 17:27:06 :) 17:27:26 but if we don't make semver guarantees, then it means whatever we say it means 17:27:27 bgilbert: hmm, it's also used for metadata, no? 17:27:41 jlebon: that's + 17:27:49 oh, well + works for me too 17:28:00 yup sure :) 17:28:10 I agree that that makes the change survivable. I still don't think we should do it. 17:28:51 the world is not actually semver and we should push back against the assumption that non-semver-parsable strings are malformed. 17:29:41 #proposed currently our versioning scheme is just a string with encoded bits of information in it. we'd prefer not to change it at this time but we can revisit this on the next major release of Fedora 17:30:10 Coming from the OKD side of things, I am +1 for this change, as I think we wouldnt loose any info encoded in the version, but have the benefit of being able to parse it using any semver parser, instead of needing another implementation for getting that within OKD. 17:30:50 does anyone have takes on the current proposal? 17:30:58 I'm +1 ofc 17:31:01 +1 17:31:16 -1 17:31:17 OR should we make clear two options and have a more formal vote in the GH ticket? 17:31:18 +1 17:31:20 it's unclear why OKD wants to parse it in the first instance 17:31:26 lorbus: that said, the OS is a bit more special than other OKD components :) 17:31:48 kaeso[m]: because OKD wants to report information about the OS? 17:32:37 can we ask for more info about the constraints? 17:32:41 lorbus: does OKD need to be using a semver parser at all? 17:32:51 jlebon: yes, of course 17:32:55 lorbus: generic version parsers have existed for a long time 17:33:10 RPM does it, to name one 17:33:32 jlebon: would you like to ask for more constraints in the ticket? 17:33:40 bgilbert: are there any questions for openshift that you'd like to ask? 17:34:30 just the big one: why is this necessary? are there reasons that a generic version parser wouldn't be adequate? 17:34:50 jlebon: maybe you can try to incorporate that in your ask 17:35:05 for now obviously if we don't change anything then the status quo stays. 17:35:08 jlebon: true :) and I could definitely live with it if it doesn't change. It's just if our only reason for not doing it is that we don't want to give the impression of the version following semver (with it only being formatted like it, i.e. pseudo-semver), I dont see that as a very strong argument. 17:35:48 lorbus: yeah I think we already arrived at that point 17:36:17 #action jlebon to ask more about the contstraints in #338 17:36:34 we'll need to circle on this very soon so keep in mind we have a short timeline 17:37:01 i think it'd be super helpful if we had a case where an OS that followed semver caused confusion 17:37:15 #info we're leaning towards not changing our currently implemented versioning scheme but will ask for more info in the ticket 17:37:19 #topic open floor 17:37:25 jdoss: you have the floor! 17:37:28 Sorry if these are kinda long and sorry Dusty it turned into three questions. I can make tickets to track them or follow existing tickets. 17:37:38 kk 17:37:40 1) Has there been any end users using FCOS at home on a home servers for personal testing? If not, I am going to work on setting it up on my server at home and I was planning on writing up a blog post on that process/journey. Is FCOS in a state for this kind of usage? Looking at the coreos-installer it seems like it is ready. 17:37:56 2) Do we have any kind of plans for a FCOS project blog like we did with Project Atomic? It would be nice to try to rally FCOS end users with better documentation/website/blog on building cool stuff with FCOS. 17:38:15 3) At work we are pushing forward on using OKD 4.x this quarter and we want to use FCOS on AWS and GCP for our nodes. Have other FCOS users done this successfully and if not, I can dedicate some of work resources to figure out what the end user process for using FCOS and OKD is if you folks feel FCOS with OKD is in a stable state where we can be successful here. 17:38:19 The same kind of blog post offer to socialize the usage of FCOS would apply for this epic quest. 17:38:25 sorry in advance! 17:39:09 1) there are users using it at home on home servers for personal testing (I have a canary). It should be in a good state for that kind of usage. The installer is in a bit of a re-work, though. So if you are installing from ISO you'll need to wait a week 17:39:21 +1 17:39:54 2) projectatomic was an umbrella project with a blog that we could contribute to. we don't have that for FCOS right now and I'm not sure if we should try to do that or just fold posts into Fedora magazine 17:40:26 we could create a separate blog site, but would take some effort and people wanting to write content 17:40:58 I just feel it would be awesome to have a focus point for socializing the usage of FCOS. It feels like we are missing that. 17:41:02 3) that would be great to talk to lorbus about. there are people using the OKD alpha on FCOS 17:41:34 I am not sure what that would look like but I am willing to help write content but I can't do it alone. 17:41:39 jdoss: I agree, but we lost our community manager, so we don't have anyone organizing that stuff and us engineers are kinda overloaded :) 17:41:58 +1 bother lorbus about OKD and FCOS got it. 17:42:12 yes! The OKD 4 beta is coming soon, hopefully before DevConf.cz in 2 weeks 17:42:17 I think it's a great idea to have a site like that, but not much in my tank for it right now 17:42:30 jdoss: any chance you'll be at devconf.cz? 17:42:36 Fair enough. Maybe something later in 2020. 17:42:44 all: any other topics for open floor? sorry about the meeting running long 17:42:46 the beta will support all platforms that are supported in OCP right now, including AWS and GCP. 17:42:58 for GCP, you still have to upload the FCOS image yourself manually 17:43:03 lorbus: that is awesome news! Heck yes. 17:43:23 * dustymabe will close out the meeting in ~30seconds 17:43:34 dustymabe: no devconf.cz this year. I burned my conf budget on Kubecon. 17:44:21 +1 17:44:24 #endmeeting