14:00:46 #startmeeting modularity_wg 14:00:46 Meeting started Tue Jul 25 14:00:46 2017 UTC. The chair is nils. Information about MeetBot at http://wiki.debian.org/MeetBot. 14:00:46 Useful Commands: #action #agreed #halp #info #idea #link #topic. 14:00:46 The meeting name has been set to 'modularity_wg' 14:00:46 #meetingtopic Meeting of the Modularity Working Group (once every two weeks) 14:00:46 #chair dgilmore langdon tflink 14:00:46 Current chairs: dgilmore langdon nils tflink 14:00:59 #topic Roll Call 14:01:01 .hello langdon 14:01:02 langdon: langdon 'Langdon White' 14:01:03 .hello nphilipp 14:01:05 nils: nphilipp 'Nils Philippsen' 14:01:18 .hello2 14:01:18 .hello ignatenkobrain 14:01:19 jkurik_mtg: Sorry, but you don't exist 14:01:22 ignatenkobrain: ignatenkobrain 'Igor Gnatenko' 14:01:28 o/ 14:01:29 jkurik: :D 14:01:30 .hello2 14:01:32 .hello psabata 14:01:35 jkurik: jkurik 'Jan Kurik' 14:01:37 contyk: psabata 'Petr Šabata' 14:01:43 .hello tflink 14:01:50 tflink: tflink 'Tim Flink' 14:02:06 .hello2 you too jkurik 14:02:07 langdon: langdon 'Langdon White' 14:02:16 * tflink has another meeting scheduled right now and is going to be semi-lurking, is going to get it rescheduled going forward 14:02:24 hi langdon and everybody here 14:02:48 .hello sgallagh 14:02:49 sgallagh: sgallagh 'Stephen Gallagher' 14:03:16 #topic Agenda 14:03:30 Does anybody have anything for the agenda? The board is empty. 14:03:41 \o/ boltron! 14:03:58 #info Boltron is out! 14:04:08 nils: There's a Server SIG meeting later today where we're going to have a post-mortem on Boltron and a strategize where to go in F27 and F28 14:04:36 then let's get at it... 14:04:41 #topic Boltron is out! 14:05:00 langdon, I guess that's yours :) 14:05:11 oops.. wasn't look 14:05:12 ing 14:05:21 you brought it up :P 14:05:31 yeah.. need more coffee 14:05:34 the server wg meetings are so late 14:05:35 #link https://fedoramagazine.org/announcing-boltron/ 14:05:38 ha 14:05:46 👍 14:06:05 so.. we shipped it... it has some issues.. but it mostly works.. and we forgot some pretty important things for the qcow 14:06:24 but.. we did prove that the whole thing builds in the infrastructure and we can get the whole thing shipped 14:06:29 with only a bit of pain 14:06:37 mmcgrath made it work yesterday; I assume he used the non-modular cloud-init 14:06:48 contyk, nice 14:07:13 .hello asamalik 14:07:14 asamalik: asamalik 'Adam Samalik' 14:07:14 qcow is missing cloud-init, sudo, and network-manager so.. that's fun 14:07:45 but.. we should have daily builds RSN, which will show off these kinds of issues a lot faster 14:07:57 i guess that is all i have on this.. unless people have qs 14:08:30 do we have a specific plan for dnf in f27? 14:08:54 ohh.. sorry.. and i am working on a note to devel-announce 14:08:59 will it include everything we want or will it be just a limited functionality? 14:09:10 because dnf in boltron is... well 14:09:13 contyk, the hope is everything.. but we need to confirm with dnf 14:09:24 contyk, doesn't sound as if you mean that it is well :) 14:09:37 ;) 14:10:27 sgallagh, do you want to #info the later meeting? 14:10:46 nils: I was actually thinking it should be a #topic 14:10:56 So we can decide what we want to propose 14:11:00 sgallagh, aah, sorry, my bad 14:11:17 contyk: I would suggest to check with dmach as he is maintaining the roadmap for DNF 14:12:02 I guess we're through with this one 14:12:09 jkurik: I was hoping langdon would know :) 14:12:20 I can add one more note 14:12:33 langdon said we would be having new builds soon 14:13:03 mbs is going to be configured to create s390x tags this week and we should have modulemds for platform and host soon too 14:13:05 .hello ttomecek 14:13:06 ttomecek: ttomecek 'Tomas Tomecek' 14:13:16 I would like to start building these modules this week 14:13:17 contyk, ohh right.. 14:13:33 and the new builds would be "boltron-rawhide" or something 14:13:44 based on an f27 core 14:13:46 if you insist on that name :) 14:14:10 but yet, we're operating on (frozen) rawhide atm 14:14:27 i just made it up.. 14:14:39 i would like to just call it f27 .. but.. you know 14:14:42 To be clear "frozen rawhide" == "a snapshot of rawhide"? 14:14:58 yes, a snapshot of rawhide plus cherry picked updates 14:15:43 well.. not really a snapshot, right? just only updates when the h&p is rebuilt 14:15:50 nope 14:15:53 it's a snapshot 14:15:58 why not follow rawhide? 14:16:08 because we wouldn't be able to build anything 14:16:26 it changes too much; following branches is fine for some use cases, not really for ours 14:16:32 langdon: The rate of churn is ridiculous 14:16:42 langdon, any package FTFBS would kill the module build 14:16:46 for instance 14:17:16 just like during f26 development, we will be rebasing the snapshot every now and then 14:17:39 but we would like to stabilize it first 14:17:48 we should probbably be re-snapshotting pretty regularly though.. 14:18:27 it's easier once you have a stable base 14:18:32 sure 14:18:45 regular as in "every Monday" rebases don't help anything 14:18:54 quite the opposite 14:19:28 What we actually need is a stable base and then scripts that try to rebase each package individually on a constant basis and yell loudly when it stops building 14:19:33 contyk, sure.. but at some point soon, it should probably start.. maybe once there is some continuous testing in place 14:19:40 sgallagh, +1 14:19:41 sgallagh, yeah 14:19:42 (With some handwavy logic for handling things that have to update together) 14:19:54 yes, CI is the answer 14:19:57 something we still lack 14:20:59 langdon: what you were thinking originally, that we just reference rawhide, will apply to atomic host 14:21:11 langdon: but that's yet to be discussed with atomic wg 14:21:47 anyway, that's all I wanted to add :) 14:21:54 well.. actually, i thought you had some CI going already.. but, yeah.. i guess i was thinking it would at least be rebasing on rawhide "every week" (or sometihng) 14:22:09 but.. im not married to it.. and i see your point 14:22:22 but i would really like the CI to be in place to make this less of a concern 14:22:26 langdon: we have a few tests but most of the package level tests rot in upstreamfirst pagure 14:22:37 right 14:22:39 langdon: the tests we have for base-runtime are... well, for base-runtime 14:22:44 ha 14:22:46 it will need to be adapted 14:22:56 and it only tests a small subset of the functionality 14:23:10 langdon, if we had "scratch-builds" for modules, rebuilding against brand new would be more feasible I guess 14:23:16 freshmaker isn't available either 14:23:44 it doesn't need to be a scratch build 14:23:59 we use PDC flags to decide whether the module build is fine or could be ignored 14:24:12 yeah.. whihc makes a lot more sense to me than scratch builds 14:24:18 yeah 14:24:20 contyk, btw, any updates on the 'container-runtime in platform module'? I got asked by docker maintainers about container-runtime module. 14:24:22 tell me the difference :P 14:24:33 would like to see cleanup in koji for pdc-says-this-build-stinks though.. which i don't think is in the works 14:24:42 ttomecek: you suggested we should include ocid only, right? 14:25:00 ttomecek: docker could live in a standalone module 14:25:04 nils, no difference to a human.. except that the human doesn't have to decide 14:25:09 contyk, no, runc, ocid doesn't exist, it's cri-o, and it's meant for kubernetes *only* 14:25:11 ttomecek: that's part of a big module plan we need to put together :) 14:25:24 ttomecek: ah, ok, runc 14:25:29 ttomecek, really? cri-o isn't for "my laptop"? 14:25:43 * langdon must have missed that 14:25:50 langdon, I think the main difference could be that you can do scratch-builds "from local source" i.e. doesn't have to be in dist-git 14:25:50 ttomecek: would appreciate some input in fedora-modularity/hp on this matter, thank you 14:26:00 contyk, I agree with that (having docker in a separate module, I kind-of asked docker maintainers if they wanna start working on it, but since we don't have guidelines in-place yet and only modularity wg can build modules...) 14:26:07 nils, ahh .. "mbs-build local" :) 14:26:13 langdon, no 14:26:25 langdon, "fedpkg local" vs. "fedpkg build --scratch" 14:26:35 scratch builds are in official infra 14:26:45 ttomecek, contyk sorry.. not sure i follow.. separate from what? container-runtime module? or h&p? 14:26:46 nils: that's not really doable and you know why 14:27:02 nils: also for CI real builds are better 14:27:15 nils: you can GC them if they're bad or actually ship them if they are fine 14:27:25 nils: you cannot do that with scratch builds; you need to build it again 14:27:30 like do you guys envision a docker-module and a runc-module? or a container-runtime that has different install profiles? and/or in h&p? or on h&p? 14:27:42 langdon, sorry, can't find any reference to support my argument 14:27:45 langdon, ttomecek: docker separate from container runtime in platform 14:27:49 contyk, yeah, there's no way to "download a module" when there aren't any artifacts yet 14:28:15 ttomecek, ha 14:28:33 But I guess we've strayed from the topic pretty far already, so let's get on with sgallagh's? 14:28:35 langdon: the idea was that we would use runc to run our standard module containers; this would be used by dnf somehow, perhaps, and would be in platform to allow direct installation of container modules 14:28:50 And table container-related discussion for afterwards` 14:28:51 ? 14:29:01 langdon: and then there would be the full docker, in a module because it's developed at a much faster pace 14:29:09 contyk: somehow ;) 14:29:12 langdon: runc is supposed to be stable 14:29:21 * ttomecek is sorry for distraction 14:29:22 ahh ok.. i see.. but, per nils, maybe we should "re-#topic"? 14:29:31 * langdon holds breath on runc 14:29:35 I feel that we will need "atomic" to be somewhere for DNF supporting containers 14:29:36 +1 14:29:40 but I would rather avoid this 14:29:43 contyk, I'm writing a todo for myself to start the discussion 14:30:02 ok, let's continue this after sgallagh's topic 14:30:07 #topic Server SIG meeting later today 14:30:10 #chair sgallagh 14:30:10 Current chairs: dgilmore langdon nils sgallagh tflink 14:30:53 * sgallagh looks up 14:31:08 First, to reiterate: great job on Boltron, folks! 14:31:30 +1 14:32:03 It has been suggested to me that we should seriously consider (starting with F27) replacing the existing Server Edition artifacts with those produced (and using) modularity features. 14:32:23 So, using that as a straw-man: let's try to figure out what we would need to do to get there. 14:32:53 #info Straw-man proposal: Fedora 27 Server Edition is modular-only -- How do we get there? 14:33:09 yeah.. im starting a doc to try to collect everything i know about.. /me doesn't actually have a link yet 14:33:27 and contyk & i were talking about a list of the modules we expect 14:33:31 langdon: "From the Big Bang to Modular Server" 14:33:37 right! 14:33:39 Heh 14:33:43 should be a one-pager! 14:33:55 contyk: "Intelligent Design of Fedora Server" 14:34:00 :) 14:34:21 later we can add around the first word 14:34:36 Joking aside, I think the major hurdle we would have to get over with the Server SIG in general will be feature parity. 14:34:50 sgallagh, to be fair, what we did seems rather evolutionary to me 14:34:52 There are a few aspects of Fedora Server that we will *really* not want to regress. 14:35:13 Some of these will be easy, others... complicated. 14:35:27 yeah.. i think we need that punch list.. and/or we can address that with prioritization 14:35:30 (Shall I start with the easy stuff or just drop the Big One now?) 14:35:56 sgallagh: would you consider not having all of the Fedora packages available being an issue? 14:35:57 sgallagh, big one! 14:36:17 contyk: Sorry, can you rephrase that? "Fedora packages" starts to get overloaded. 14:36:33 sgallagh: those ~20k source packages we have in Fedora today 14:36:46 sgallagh: nowadays you can install anything you want on your server installation 14:37:00 contyk, WDYM, nowadays? 14:37:15 nils: in a non-modular release 14:37:19 contyk: We discussed that in a previous Server meeting. We're okay with *not* having access to everything. 14:37:27 sgallagh: ok, thanks 14:37:38 We're fine with shipping a core set of stuff and adding to it with new modules as we go 14:37:51 Our user-base is currently small enough that we're willing to take the risk 14:37:55 contyk, I don't see that changing, do you? If "anything you want" != "in any artifact you want" at least. 14:38:15 nils: it will change; you will only have access to modularized content 14:38:25 The Big One of course is FreeIPA, which is currently Fedora Server Edition's flagship component. 14:38:39 contyk, yeah, but all content will be modularized... eventually ;) 14:38:53 nils: is that an action for nils? 14:38:55 nils: Right, and as I said the Server SIG discussed this 14:39:10 And we're okay with shipping without everything being modularized first. 14:39:23 contyk, heh, I'm sure the powers that be want to send me out "in the jungle for months on end" :P 14:39:27 We are fine as long as we don't regress any of the features we've advertised previously. 14:39:41 Which mostly boils down to "FreeIPA", "PostgreSQL" and "Cockpit" 14:39:52 Oh, and support for being managed by Ansible 14:40:32 that's getting more complicated 14:40:34 sgallagh, do you foresee freeipa as module-rpms or as containers? 14:40:48 because ansible's DNF cant manage modules 14:41:06 langdon: That's a great question... 14:41:16 and at this point I don't think there will be way of managing modules from DNF API in f27 (probably only CLI support) 14:41:21 * nils is not sure if he likes the sound of "ansible's DNF"... 14:41:47 nils: obviously I meant DNF plugin for ansible ;) 14:41:50 (We will also have to discuss whether we want to support an upgrade path or agree that fresh install is the only way to go from F26->F27 Server) 14:42:10 ignatenkobrain, well.. priorities change.. we can add it to the list and see what can be committed too 14:42:31 sgallagh, i know mattdm is really pushing for upgrade.. 14:42:33 langdon: On paper, I think the container strategy is better for FreeIPA... but I know enough about the internals to be concerned that it probably wouldn't happen in time for F27. 14:42:46 * ignatenkobrain is just saying what is on DNF's team radar nowadays and raising some concerns ;) 14:42:55 sgallagh, gotcha i thought it had "been done" already 14:42:57 not sure how the upgrade would work 14:42:58 langdon: That's all well and good, but I think we may want to accept this one-time cost for Fedora at least. 14:43:17 langdon: Well, if we wanted it fully containerized, there needs to be a concerted effort to do so 14:43:21 contyk, sgallagh re:upgrade agreed.. but we should at least think about it 14:43:45 sgallagh, yeah.. i was just saying, i thought that had been done.. but i am apparently mistaken 14:44:11 langdon: A FreeIPA container exists as a PoC... but it's a monster container with the whole shabang in a single instance. 14:44:16 It's basically a VM 14:44:24 And it's out of date, last I heard 14:45:03 Realistically, it needs to be divided up into individual services, which means breaking some assumptions in the code about pieces co-existing on the same machine. 14:45:23 s/machine/filesystem/ 14:45:30 got it 14:45:31 contyk, the mapping of "no modules" to whatever modules are available by then that have the same content will be tricky, yes 14:46:43 nils: Well, we could always have an "upgrade" profile on every module that automatically enabled *nothing*. Then on upgrade just turn on all modules :-D 14:46:55 sgallagh, hue 14:47:01 sgallagh, or it could just rm -rf / 14:47:04 hue? 14:47:19 sgallagh, "heh" with an accent :D 14:47:24 haha 14:48:02 Honestly, while upgrades would be *nice*, I think it might be worthwhile to look at that for F28 rather than F27 14:48:05 ok.. devel-announce email away 14:48:16 (So we support them for the F26->F28 jump) 14:48:28 https://imgflip.com/i/1t1or0 14:48:36 * langdon lied.. source address the wrong one :( 14:49:40 sgallagh, I think we should offer some kind of upgrade path eventually, not necessarily for f27 14:50:09 langdon: Let me get back to your FreeIPA question: where were you going with the rpms-vs-containers question? 14:50:09 * langdon going to print that pic and hang it on the wall 14:50:26 sgallagh, so we're done for SIG tonight? 14:50:34 nils: Not yet. 14:50:37 just that if it is a container.. it is easier to build/deliver than as rpms 14:50:44 assuming that the containers were done 14:50:46 I'd like to leave this meeting with a clear idea of what we're proposing 14:50:54 langdon: but harder to upgrade 14:50:58 * nils is desperately looking where to wedge in the #topic boundary 14:51:21 langdon: so you wouldn't want to build the freeipa container from modules? 14:51:22 langdon: Do we have examples of container-based modules yet? 14:51:33 Or module-based containers? 14:51:34 nils, i think sgallagh wants a list of what the m-wg should propose to the s-wg at the meeting today/tonight 14:51:42 langdon, ah 14:51:43 langdon: Exactly 14:51:50 sgallagh, yes.. a bunch 14:51:59 ok 14:52:01 module-based containers that is 14:52:06 ohh.. sorry.. unclear 14:52:10 that workflow isn't automated, unfortunately 14:52:13 I don't think we do it the other way around :) 14:52:32 nils, right.. not yet.. and it will require negotiation yet 14:52:48 nils: I guess my question is, could I do "dnf module-install postgresql" and have that pull down a container and run it? 14:52:58 you build rpms in a module and then create (manually) a Dockerfile in the docker/ namespace that installs your content on top of a modular base image 14:53:00 (And *should* that be possible?) 14:53:01 devel-announce is always moderated, right? 14:53:18 sgallagh: it should but it isn't 14:53:20 langdon: yes 14:53:29 sgallagh, i want that .. but dnf and atomic haven't agreed to it yet :) 14:53:30 contyk: Well, I'm not certain about that. 14:53:49 I wonder if we actually want to do that or if we should be using openshift/minishift in such cases 14:54:01 sorry, not minishift. Ignore that part. 14:54:17 sgallagh, i think it depends on the container(s).. freeipa? probably.. bind? probably not 14:54:36 langdon: Probably not... what? 14:54:54 I asked an either/or question, so I'm unclear which side you're answering :) 14:54:55 sgallagh, two examples.. one that might want openshift and one that probably wouldn't 14:56:00 I'm not sure that there's a story to be told for any container that isn't manageable by OpenShift/Kubernetes 14:56:01 sgallagh, does that make more sense? 14:56:13 sgallagh, ohh.. was that what you meant? 14:56:29 i thought you meant "a app that required openshift when it was installed" 14:56:47 Well, those might or might not be tightly-coupled statements :) 14:57:13 ha 14:57:46 langdon: Honestly, I kind of foresee a world where every system is an OpenShift node right from install-time. 14:57:51 sgallagh, do you want to take a stab at the "list of things for server wg"? we are running out of time 14:57:58 sgallagh, me too 14:58:08 Some machines might be a self-contained cluster, others part of a mesh. 14:58:12 i think modularity is the first steps on that path 14:58:41 langdon: Well, if that's our long-term vision, then we should make sure to ask the right questions along the way. 14:58:57 i.e. "Does this plan advance our goal?" 14:59:41 well.. my long term vision is more "service based functionality" with less reliance on "host of that service" .. every computer as an openshift node is one path for that.. or at least part of a path 15:00:00 langdon: For today, shall we settle for "Propose that F27 ship only the modular compose *concurrent with the Workstation release*"? 15:00:21 And see what the SIG comes back with as requirements for reaching such a goal? 15:00:23 i don't understand your part in *s 15:00:37 like at the same time as wkstn? in case it slips? 15:00:38 langdon: Unlike Boltron, it would have to ship on release day 15:00:43 right 15:00:44 yes 15:00:58 Though I'm really concerned by the time available to F27 15:01:00 but it is the same release day as the normal compose :) 15:01:12 as contyk says.. why? we still have *5* weeks! 15:01:18 langdon: Yes, I was trying to be more explicit 15:01:36 langdon: We still don't even have a mass-rebuild ;_; 15:01:39 sgallagh, yeah.. i thought your phrasing was fine 15:02:00 Anyway, let's go with fact-finding for today's meeting 15:02:06 * langdon notes once modularity is all the way implemented we will be doing them every day..or not at all.. depending on perspective 15:02:26 them = mass rebuilds 15:02:36 #info Modularity WG will propose that Server Edition ships only modular-composed artifacts in Fedora 27 on the same schedule as other official releases 15:02:58 OK, nils /#topic 15:02:59 sgallagh, just a note.. we had the change approved already 15:03:13 Which Change? 15:03:21 like this is already the stated plan.. as of the server meeting a few weeks ago 15:03:29 * langdon digs 15:03:51 https://fedoraproject.org/wiki/Changes/Modular_Server < i think 15:03:56 there are 3 with similar names 15:04:09 yeah.. thats it 15:05:59 OK, given that we're overtime, do you guys talk about the dnf<->container thing from earlier now? Or table it for next time? 15:06:27 ok 15:07:17 nils, maybe in #f-m? 15:07:36 langdon, sure, we can discuss anything in #fedora-modularity :) 15:07:41 ha 15:07:51 but.. let's end meeting? sgallagh ? 15:07:58 I'm done 15:08:01 In that case, thanks everybody! 15:08:04 #endmeeting