20:00:43 #startmeeting Server Working Group Weekly Meeting (2017-07-25) 20:00:43 Meeting started Tue Jul 25 20:00:43 2017 UTC. The chair is sgallagh. Information about MeetBot at http://wiki.debian.org/MeetBot. 20:00:43 Useful Commands: #action #agreed #halp #info #idea #link #topic. 20:00:43 The meeting name has been set to 'server_working_group_weekly_meeting_(2017-07-25)' 20:00:43 #chair nirik sgallagh mhayden dperpeet smooge jds2001 vvaldez adamw mjwolf 20:00:43 Current chairs: adamw dperpeet jds2001 mhayden mjwolf nirik sgallagh smooge vvaldez 20:00:43 #topic roll call 20:00:52 .hello jstanley 20:00:53 jds2001: jstanley 'Jon Stanley' 20:00:54 .hello sgallagh 20:00:56 sgallagh: sgallagh 'Stephen Gallagher' 20:00:56 .hello adamwill 20:00:58 .hello mhayden 20:00:59 adamw: adamwill 'Adam Williamson' 20:01:01 .hello dperpeet 20:01:02 mhayden: mhayden 'Major Hayden' 20:01:03 i'm sorta here, but have to go to the dentist in 10 mins. 20:01:05 dperpeet: dperpeet 'None' 20:01:07 .hello langdon 20:01:08 langdon: langdon 'Langdon White' 20:01:12 * langdon hopes he is in the right place 20:01:18 still reading topic 20:01:31 adamw: Server SIG meetings probably are more tolerable on nitrous oxide! 20:01:38 langdon: you are :) 20:01:45 woot! go me! 20:02:10 OK, looks like we've got enough people to start 20:02:14 here 20:02:14 #topic Agenda 20:02:18 Why are we here today? 20:02:38 to inhale nitrous oxide? 20:02:55 So, F26 is out the door and F27 is dangerously close. 20:03:00 I also have a 2 min Cockpit topic - how to get started with a plugin 20:03:02 smooge, i have had enough of that.. root canal couple weeks ago :/ 20:03:04 we're here to talk about boltron! :) 20:03:05 smooge: Did you bring enough to share with the class? 20:03:19 langdon: i wish my dentist gave me that. 20:03:28 she just gives me some injections of stuff. 20:03:38 dperpeet: Roger that. 20:03:42 jds2001, ha.. i am not sure any of them do.. it was really just novacaine :( 20:03:57 #info Agenda Item: Cockpit - How to get started with a plugin 20:04:11 #info Agenda Item: Boltron and conquering the universe 20:04:43 Anything else? 20:05:00 OK, dperpeet promises that it will be a short topic, so lets start with his. 20:05:07 #topic Cockpit - How to get started with a plugin 20:05:11 so, with Cockpit it's logical that many plugins don't want to and shouldn't have to be in the cockpit main repo 20:05:12 dperpeet: Take it away 20:05:14 thanks 20:05:27 so I've been working a bit on a demo for this 20:05:29 https://github.com/cockpit-project/subscription-manager 20:05:48 and today's pull request should go in soon https://github.com/cockpit-project/subscription-manager/pull/5 20:05:58 with that you can pull in whatever js you wish 20:06:05 "make rpm" or "make srpm" 20:06:15 make install for developer build 20:06:18 all the niceties 20:06:23 or even webpack --watch 20:06:28 and just refresh the browser with cockpit 20:06:37 should work with cockpit in fedora out of the box 20:06:54 there's even vagrant 20:06:56 dperpeet: So the intention is that subsystems would ship a cockpit module inside their own projects rather than submitting them to Cockpit upstream? 20:07:00 yup 20:07:02 exactly 20:07:08 and not worry about building cockpit 20:07:28 #info Cockpit plugins for everyone! 20:07:28 I'm also adding some testing 20:07:30 dperpeet, nice! 20:07:42 and I did this without the autotools "magic" :) 20:07:54 #info Cockpit can now handle out-of-tree plugins without needing to build Cockpit itself 20:08:07 well, technically that's not new 20:08:10 #info Subsystems are encouraged to distribute and maintain their own Cockpit plugins 20:08:18 but a simple repo to clone is a lot nicer :) 20:08:39 I'll have more next meeting, probably 20:08:45 dperpeet++ 20:08:45 sgallagh: Karma for dperpeet changed to 1 (for the f26 release cycle): https://badges.fedoraproject.org/tags/cookie/any 20:08:46 feel free to poke holes into what I did there 20:08:57 thanks :) 20:09:13 Questions for dperpeet? 20:09:22 nice work! :) 20:09:29 dperpeet, will there be an "independent" repo i woul dclone? 20:09:38 like a "starter"? 20:09:45 * langdon may have missed that 20:09:47 langdon, that's what this repo is meant to me 20:09:48 to be 20:10:12 we're working on putting the "convenience" react components into their on npm repo 20:10:17 *their own 20:10:19 ahh ok.. gotcha 20:10:22 * jds2001 guesses s-m is the simplest useful plugin one can have? 20:10:41 well, this was started out with the intent of moving subscriptions out of the cockpit tree 20:10:53 but now I've shared the link already and don't want to rename it 20:11:03 I may start a fresh one and call it starter kit 20:11:05 hehe :) 20:11:07 but this is what you'll get 20:11:12 dperpeet +1 20:11:12 dperpeet: A starter kit would be ideal 20:11:17 thanks for reminding me :) 20:11:25 you can treat the content as said starter kit 20:11:29 or the beginnings thereof 20:11:38 it doesn't require the cockpit source tree at all 20:11:47 jds2001: I'd think the simplest example would be something like "Set SELinux to enforcing, permissive or MakeDanWalshCry" 20:11:58 haha 20:11:58 sgallagh++ 20:11:58 dperpeet: Karma for sgallagh changed to 3 (for the f26 release cycle): https://badges.fedoraproject.org/tags/cookie/any 20:12:01 I'll do that 20:12:04 sgallagh++ 20:12:04 mhayden: Karma for sgallagh changed to 4 (for the f26 release cycle): https://badges.fedoraproject.org/tags/cookie/any 20:12:10 MakeMajorCry :D 20:12:30 sgallagh: wait, permissive and MakeDanWalshCry are the same, aren't they? 20:12:33 it's actually a good example for many reasons 20:12:36 i deal with openstack frequently, so i know how to cry 20:12:37 :) 20:13:12 Actually, I'd love to see a Cockpit plugin with a setting for "switch to permissive for N minutes" :) 20:13:25 So it would fix your system if you forgot to set it back :-D 20:13:30 sgallagh, I thought about that, but I think I should reply in a breakout meeting 20:13:31 :) 20:13:34 OK 20:13:35 sgallagh, +1 ... i do that too 20:13:57 I'll also add simple CI 20:14:03 with semaphore or some such 20:14:12 so expect that to be part of the starter kit 20:14:21 (not the full vm stuff cockpit has) 20:14:25 #info dperpeet will work on a simple example, possibly using SELinux enforcing/permissive as the demonstration. 20:15:36 OK, anything else on this topic? 20:15:41 not from me, thank you 20:15:54 * sgallagh notes that this will be great for modularity as well 20:16:07 If we can ship the cockpit plugins with the associated module, that will make life easier. 20:16:15 for everyone :) 20:16:17 yes 20:16:40 we don't promote the "Cockpit" brand within Cockpit for a reason 20:16:48 #topic Boltron and conquering the universe 20:17:18 right 20:17:59 langdon: Do you want to start here, or should I? 20:18:33 sgallagh, oh.. i thought you would.. thought you were typing a lot :/ 20:18:40 No problem. 20:18:42 i can if you like.. but i think you know the goal you wanted to achieve better than i do 20:19:02 So, in previous meetings, we've expressed some general goals for F27. 20:19:18 I'd like to try to dive in and figure out what *exactly* we need to do to reach those goals. 20:19:47 The biggest (and most difficult) one to achieve will be our plan to deliver a complete Fedora Server Edition built from modules. 20:19:52 * langdon tried to start an etherpad for this but none seem to actually be up anymore 20:20:08 Boltron provided us a framework and much of the necessary build/compose tooling. 20:20:09 sorry to run, folks, have to go to the dentist 20:20:22 So the next big piece we'll need to discuss is the content. 20:21:02 In particular, we may need to make some hard decisions regarding what pieces of the current Server Edition we want to maintain as release-blocking. 20:21:19 what content do we need to be considered "complete"? 20:21:27 jds2001: That would be the big question, yes. 20:21:47 The "easy" answer is "modules must provide all packages currently on the DVD" 20:22:12 * jds2001 thinks that is probably not realistic :( 20:22:14 (modulo any packages dropped or replaced in the normal order of things) 20:23:28 jds2001: Well, carrying all of the packages isn't terribly hard. 20:23:37 But dividing them up into meaningful modules may be 20:23:56 Particularly if we want to take advantage of any of the advanced features that modules give us, such as profiles. 20:24:07 langdon: Do you want to go into detail on profiles? 20:24:18 i heard you highlight cockpit, postgres, and freeipa 20:24:33 those are "must haves" .. 20:24:38 * sgallagh nods 20:26:12 but there are a bunch of things that no one ever thinks of that we forgot for boltron.. e.g. cloud-init, sudo, network-manager, less, vi, nano .. 20:26:12 i think it will help because we plan to start having daily composes (perhaps this week) 20:26:12 of "f27-boltron-server" or whatever 20:26:12 * langdon notes we didn't get real "base runtimes" until ~3 weeks ago 20:26:13 so.. sgallagh what's next? what do we want to decide here? 20:26:14 also, i have been playing with https://pagure.io/modularity/test-for-module-layout/blob/master/f/graphing.dot as a way to document the content.. 20:26:27 Sorry, my client briefly disconnected. 20:26:30 I'm back 20:27:02 OK 20:27:15 So those aren't really "forgotten" from the Server Edition 20:27:30 We actually have a document and release criteria requiring some of those to work 20:27:40 woah.. it certainly did 20:27:44 But you're right, those are "cost of doing business" 20:27:57 * langdon reads, sorry 20:28:15 Whereas Cockpit, PostgreSQL and FreeIPA are the highlights we show off 20:28:29 right 20:28:36 because they're both exciting and polished 20:28:53 and.. that was adamw's proposal was to modify the release crit to be "module aware" .. and i liked that idea 20:29:11 langdon: Sorry, could you recount that? 20:29:25 * langdon thinks 20:29:43 ok for questions? 20:29:52 fine with me 20:30:03 why was less and sudo modules? 20:30:27 smooge, yeah.. not .. systemtools {less, nano, other stuff} 20:30:30 sorry 20:30:46 ok I was worried we were going to bolt bolts 20:30:50 so.. adam's idea was adapt https://fedoraproject.org/wiki/Fedora_26_Final_Release_Criteria for f27 to be "modules" 20:31:05 smooge, modules == rpms is dumb ;) 20:31:09 langdon: What does that mean, though? 20:31:15 ohh 20:31:48 well.. i was thinking that we would follow the same proof points .. adapting commands and tests to use the modular version of them.. 20:32:00 * langdon isn't sure the doc really needs changing all that much 20:32:48 Right, the doc is user-facing 20:33:04 i guess i assumed there were automatic tests that accounted for these.. and they would, at the very least, need adapting 20:33:07 "These things must work" rather than "These things must work in this way" 20:33:16 Yes, the automated tests are a different story 20:33:44 and changing things like "A bug in a Critical Path package that: " -> "A bug in a Critical Path module or package that: " or some such 20:34:04 shouldn't the "module stories" go hand in hand with tests? 20:34:08 langdon: I think that may be getting into the weeds 20:34:28 if stuff belongs together, it makes sense to have stories 20:34:31 and those can be tested 20:34:55 Particularly when we haven't answered (in my mind) some of the big questions 20:35:02 if they can't, then that's a good indicator to question whether the bits and pieces belong together :) 20:35:14 Like: can we discontinue the non-modular release in F27 (or: what do we need to achieve before we can?) 20:35:21 dperpeet, yeah... the module-test-framework (which now has a different name) is hoping to use behave for more of our tests 20:36:05 sgallagh, ahh.. so perhaps a smaller version of the release-crit that decides if modular-server is "good enough" for replacement of traditional-server? 20:36:27 * sgallagh nods 20:36:56 i think that approach.. preferably with behave tests would be awesome.. 20:36:57 Or else a decision that we don't *replace* until we hit 100% of the release criteria 20:37:29 that i can't decide.. but obviously, i am biased towards a good enough version ;) 20:39:03 its not like we're taking away anything 20:39:16 jds2001: Well, that's actually not true. 20:39:19 if folks really want the old thing, there's the netinstall. 20:39:28 Ah, that's what you meant 20:39:30 True. 20:39:53 Likely that's where we will have to send upgrades from F26 as well; keep them on the traditional lines for now. 20:40:11 But there's a valid question to be made about new installs: 20:40:11 we also don't have to decide today or even soon.. it isn't like we are deleting the traditional build infra.. i would assume we would "build both" and, in my opinion, just ship modular-server 20:40:11 assuming there isn't a whole lot of "extra" effort in making the traditional distro go 20:40:11 sgallagh, almost definitely 20:40:31 Is it okay for our install media to have less functionality in F27 than in F26? 20:40:39 i actually think jds2001's comment is what mattdm suggested as well (might even be in the change ;) ) 20:40:48 And if so, which functionality can be sacrificed? 20:42:07 that's the hard question :) 20:42:20 I'm good at asking those... bad at answering them 20:42:42 I have considerable concern about our ability to modularize FreeIPA in the F27 time-frame 20:42:49 But it's a significant piece of our story. 20:43:15 If we can't have a major spin with less functionality.. how hard would it be able to do a 'spin/remix' which allowed us to play with things 20:43:34 sgallagh, really? do you think it is that hard? i mean there is a decent metapackage, right? can't we just depchase it down? 20:43:37 smooge: We just did that? 20:44:00 langdon: The problem isn't figuring out what it needs. 20:44:14 The problem is breaking it up the right way, because it consumes and provides a LOT of stuff. 20:44:30 I think in any case there should be a transitional period with both 20:44:34 Kerberos KDC, Kerberos client libraries, 389DS, BIND DNS... 20:44:41 sgallagh, well.. a good answer or even ok answer can be for f27... we can fix it over time 20:44:44 since the Fedora releases aren't *that* rare 20:45:16 stupid question: can a package belong to multiple modules? 20:45:19 langdon: If you want to commit the modularity WG to providing the modules, I'm good with that. 20:45:25 i.e. freeipa and dns-server for BIND? 20:45:28 we can set minimal criteria to deprecate the traditional stuff, but keep it for one release 20:45:34 lol 20:45:54 jds2001: It's not good if it is. We're still working out how to deal with relocation for conflicting dependencies. 20:46:57 boo. the "easy" solution would be to lump everything into freeipa 20:47:09 i also would like dnf to be smarter about non-conflicting but the same deps.. so bind can be in both as lng as they are in the same version .. until we get better conflicting deps solutions 20:47:15 jds2001: Yes, but IIRC we already have some of those pieces separately 20:47:17 but that isn't that great for folks that want the pieces separately 20:47:49 langdon: Remind me where the list of Boltron modules is? 20:48:43 https://docs.pagure.org/modularity/prototype/boltron/content.html 20:48:58 sorry.. super slow today 20:49:33 jds2001, that's the dream.. but i don't think we will be there for f27 or f28.. 20:50:35 OK, so here's a proposal: F27 is good as long as the FreeIPA module exists. We are okay if it is much larger than it "should" be for this pass. 20:50:54 Meaning we won't make any exceptional effort to separate out Dogtag, 389, etc. 20:51:12 sgallagh, yeah.. i just need to get the freeipa folks to agree.. but i think they have already been experimenting 20:51:35 langdon: Are you willing to commit to having *something* out of the Modularity WG for FreeIPA by F27 beta? 20:51:45 * sgallagh notes that this is *five weeks away* by the current schedule 20:51:54 sgallagh, probably? but i can't during this meeting.. 20:52:21 #action langdon to get confirmation that FreeIPA will have a module for F27 20:52:27 you need to promise the world NOW! :D 20:52:34 lol 20:52:54 ill just do it.. cause you know.. i have plenty of time.. and deeply understand freeipa /s 20:53:17 lol 20:53:48 langdon: FYI, I'm available as a resource... I just can't commit to being the sole person responsible for that. 20:53:57 s/can't/won't/ 20:54:28 sgallagh, ohh totally.. and like i said.. i think we want the rest of the team responsible involved.. and, i have discussed it with them a bit before.. we just need to get to a commitment 20:54:38 ok 20:55:03 OK, I'm going to make a proposal for our goals for F27: 20:56:01 Proposal: Fedora 27 will ship only the modular version of Server Edition as long as it contains modules that include FreeIPA (for both master and replica), PostgreSQL, Cockpit, Network Manager and storaged. 20:56:05 * nirik arrives late... 20:56:28 "contains, at least, modules" ?? 20:56:32 s/storaged/udisks2/ 20:56:43 langdon: I thought that was implicit 20:56:57 they keep renaming them so much the names should be interchangeable now. ;) 20:56:58 if it contains more, great! 20:57:00 and/or a new release-crit will be developed that details the content expected? 20:57:15 blivet! 20:57:20 is Cockpit its own module? 20:57:32 no wait, I read that wrong (I hope) 20:57:47 dperpeet: I specified "modules that include" so we don't have to define that here :) 20:57:47 dperpeet, i would imagine, yes.. with plugins landing in their own modules 20:57:51 "modules that include..." is generic enough for me :) 20:57:54 dperpeet: why wouldnt it be its own moduke? 20:58:10 But likely the infrastructure bits for Cockpit would be their own module 20:58:17 could be 20:58:33 modules don't have to be large :) 20:58:45 * jds2001 is +1 to sgallagh's proposal 20:58:58 +1 20:59:03 * nirik can be +1 to that too. 20:59:19 dperpeet: Well, the module wouldn't necessarily *just* be the cockpit packages. It might also be any deps that Cockpit needs that aren't a good fit elsewhere. 20:59:36 I'm +1 to my proposal, for the record 20:59:46 sgallagh, could be... I think that's a separate discussion though :) 20:59:48 dperpeet, i am actually starting to see cockpit as so integral that it might just be part of platform.. much like a container-runtime.. 21:00:06 langdon: I could be on board with that as well 21:00:24 It's a mandatory part of the Server Edition install today. 21:00:27 *especially* if the plugins are separate and in their "host" modules 21:01:28 * sgallagh nods 21:01:39 does being in platform mean its on other editions as well? 21:01:45 smooge: Any thoughts? 21:01:53 jds2001: Long-term, yes. 21:01:58 for instance workstation where it might not fit? 21:02:03 jds2001: Short-term, Server is the guinea pig 21:02:03 jds2001, not at this point.. but, ultimately yes.. and "available" not "installed by default" 21:02:18 ok, makes sense. 21:02:20 I am +0 for this 21:02:36 jds2001: For a lot of what Cockpit does, I'd actually rather see Workstation just pull up a browser window rather than have every DE reimplement it :-/ 21:03:04 smooge: What are your reservations? 21:03:07 yeah :/ 21:03:14 I think the core parts of cockpit could be present everywhere 21:03:19 very small footprint 21:03:31 dperpeet: Yeah, I don't think there would be much (any) problem with that. 21:03:37 we've also discussed getting rid of glib-networking dep for example 21:03:47 make it even smaller 21:04:00 My reservation is that I haven't actually run the modules or seen how a sysadmin updates them or how infrastructure will keep up with them 21:04:17 but I am not -1 on it. I just don't feel I have done enough to be +1 21:04:20 * sgallagh nods 21:04:42 langdon: Do I recall that you have a video recording answering some of those questions? 21:04:50 Probably worth linking here. 21:04:56 * langdon thinks 21:05:11 end-user? yes.. not the "how infra keeps up" though 21:05:20 * langdon digs again 21:05:30 I will need to take some time and run through the commands and see what it actually means by "we only will ship modules" and how that looks on the ftp server 21:05:45 "the ftp server"? 21:05:51 http/rsync 21:05:56 I am old 21:06:44 and I have been staring at the partition today which is still called fedora_ftp on the Red Hat 21:06:46 i highly recommend trying the walkthrough: http://bit.ly/mod-walkthrough 21:07:27 will do so this evening after I finish moving furniture 21:07:36 but the video of it is: /me still digging 21:07:59 https://www.youtube.com/watch?v=uSySSfN40yE 21:08:34 although, technically, that video is from the pre-release... but it should be 99% the same 21:08:43 #link https://www.youtube.com/watch?v=uSySSfN40yE 21:09:39 Alright, we are over time. 21:09:55 Let's all take some time to play around with Boltron until next week and revisit this then? 21:10:04 sgallagh, can you link the walkthrouhg too/ 21:10:05 ? 21:10:09 Oh, right 21:10:13 thanks.. 21:10:17 #link http://bit.ly/mod-walkthrough 21:10:17 sounds good to me..... 21:10:41 #info Please have a look at the modularity walkthrough. We will revisit this topic next week. 21:11:17 thanks all 21:11:30 Thank you for coming! 21:11:36 #endmeeting