17:05:39 #startmeeting Cloud WG (2014-09-05) 17:05:39 Meeting started Fri Sep 5 17:05:39 2014 UTC. The chair is number80. Information about MeetBot at http://wiki.debian.org/MeetBot. 17:05:39 Useful Commands: #action #agreed #halp #info #idea #link #topic. 17:06:01 #char jzb mattdm agrimm oddshocks geppetto 17:06:09 hi! 17:06:09 * jsmith joins (a bit late) 17:06:14 .hellomynameis jzb 17:06:15 jzb: jzb 'Joe Brockmeier' 17:06:19 .hellomynameis james 17:06:20 number80: jeez, messing up already. tsk tsk ;) 17:06:20 geppetto: james 'James Antill' 17:06:22 .hellomyname is roshi 17:06:24 .hellomynameis hguemar 17:06:25 number80: hguemar 'Haïkel Guémar' 17:06:29 .hellomynameis dustymabe 17:06:30 dustymabe: dustymabe 'Dusty Mabe' 17:06:36 .hellomynameis imcleod 17:06:37 imcleod: imcleod 'Ian McLeod' 17:06:39 .hellomynameis oddshocks 17:06:43 oddshocks: oddshocks 'David Gay' 17:06:45 .hellomynameis roshi 17:06:46 roshi: roshi 'Mike Ruckman' 17:06:52 there, did it right this time 17:07:03 roshi: :) 17:07:10 #chair imcleod roshi jsmith 17:07:10 Current chairs: imcleod jsmith number80 roshi 17:07:24 .hellomynameis jsmith 17:07:25 jsmith: jsmith 'Jared Smith' 17:07:27 #chair jzb mattdm agrimm oddshocks geppetto 17:07:27 Current chairs: agrimm geppetto imcleod jsmith jzb mattdm number80 oddshocks roshi 17:07:36 everyone is around ? 17:07:40 ok 17:07:42 number80: jzb: Here is the link from last meeting: https://lists.fedoraproject.org/pipermail/cloud/2014-September/004194.html 17:07:52 * adamw around if needed (but still clueless) 17:07:58 thanks 17:08:09 adamw: you're welcome to join us :) 17:08:21 #topic Coordinate F21 / fedora next website 17:08:23 me is kinda here 17:08:29 https://fedorahosted.org/cloud/ticket/36 17:08:38 jzb: since you're the lead here ? 17:08:41 website in staging: 17:08:43 http://stg.fedoraproject.org/en/get-prerelease#cloud 17:09:00 ticket the websites people are using: 17:09:02 https://fedorahosted.org/fedora-websites/ticket/267 17:09:27 number80: sorry - point of order 17:09:35 last week we agreed we'd start with AIs from the prior meeting 17:09:48 mattdm: big issue 17:09:50 jzb: my apologies 17:09:56 atomic is 64 bit only 17:10:00 number80: no harm 17:10:05 website has both 32 and 64 bit 17:10:11 true 17:10:13 good catch 17:10:29 long story short, I'll get them the info this weekend/Monday 17:10:39 we discussed it yesterday in the readiness meeting. 17:11:05 #info staging website: http://stg.fedoraproject.org/en/get-prerelease#cloud 17:11:18 or... 17:11:18 #info related ticket https://fedorahosted.org/fedora-websites/ticket/267 17:11:23 mattdm: did you already provide the info? 17:11:28 #topic Atomic Image 17:11:35 https://fedorahosted.org/cloud/ticket/64 17:11:50 jzb I gave them some basic info but not really everything 17:11:50 (just making sure to have useful minutes) 17:12:28 anyway sorry. on with the topic? 17:13:03 we're discussing the atomic image right ? 17:13:30 yes but I was replying to something previous still. but i'll hold the rest of that. 17:14:45 what *is* the state of Atomic? 17:15:18 mattdm, it's progressing slowly in walters' absence 17:15:52 probably more movement next week. I have a working vagrant image & cloud image... we just don't have the full workflow string together 17:16:07 agrimm: links for those? 17:16:20 or are they somewhere we can bang on? 17:16:37 mattdm: meetings have been pretty null as far as atomic goes, due to only a couple people being able to show up. mostly they've been cancelled unfortunately 17:17:01 jzb, I will get them to some place you can bang on on Monday. 17:17:14 maybe sooner 17:17:14 #info agrimm has a working vagrant & cloud image (still figuring out the full workflow) 17:17:42 agrimm can that image be produced via the spin kickstarts in koji? 17:18:11 mattdm: took the words out of my mouth.... 17:19:53 mattdm, I actually don't know. The hold-up was originally related to the atomic mirror situation. 17:20:14 I have been using imagefactory to ensure that the transition from what we have now to koji later is as smooth as possible 17:20:24 but I don't know when we can actually make the switch 17:20:46 maybe dgilmore has some hints about it ? 17:20:51 agrimm: OK. If you are already driving it through Factory it should be relatively painless to migrate to koji at some point. I can help. 17:21:42 * dgilmore notes this sounds like f22 type thinsg 17:21:43 agrimm: dgilmore already has nightly build attempts for Atomic using the kickstart file in the spin-kickstarts repo. 17:21:44 things 17:22:07 I need to glue up making a nightly atomic tree 17:23:08 dgilmore once that's happening, putting agrimm's work into the spin kickstart should be okay for F21, not delayed to F22, right? 17:23:17 Or are you saying all of this is missing the F21 deadlines? 17:24:09 mattdm: adding vagrant images is too late 17:24:28 we should have been looking at that months ago 17:24:45 dgilmore agreed on vagrant, yes. 17:25:08 I'm just worried about the just normal atomic cloud images 17:25:22 atomic i have no idea what agrimm is doing, but anything more than the docker host tree ive been working on is too late for f21 17:25:22 And I think imcleod and agrimm were talking about both 17:27:09 both of what? 17:27:34 roshi both atomic cloud image and atomic vagrant image 17:27:40 vagrant and the docker host? (which is atomic, right?) 17:27:41 dgilmore, I've actually been building the cloud image with the exact same kickstart from spin-kickstarts, so there's no work for you to consume there 17:27:49 The vagrant kickstart is two lines different in the main kickstart, and ten lines of postinstall shell. 17:27:59 dgilmore: So we can't introduce other trees within a release? 17:28:14 geppetto: no 17:28:17 can we tweak the composition of the tree? (i hope?) 17:28:30 mattdm: tweak how? 17:28:46 I guess add packages? 17:29:01 I mean, we'd kind of have to … if they come in via. deps. 17:29:29 or remove 17:29:37 dgilmore change the json file if need be 17:29:38 IIRC we may have a request coming to remove geard 17:29:57 jzb: related to kubernetes ? 17:29:58 jzb: we pull the git repo every time we compose 17:30:15 geard is gone from fedora and it wont be installable anymore 17:31:02 number80: the state of geard is best described as "in flux" 17:31:13 dgilmore: solves that then 17:31:27 ack 17:33:34 agrimm -- so, you're saying that what you're using is the same as in spin-kickstarts already, right? any additional tweaks needed? 17:34:10 if not, and I'm understanding correctly, this means that the test compose atomic images should be good to actually test, right? 17:34:22 mattdm, nope, doesn't look like it. 17:34:44 wait was that the good kind of "nope" or the bad one? :) 17:34:48 I got a tc6 atomic tree installed today 17:34:59 speaking of testing, has anyone given any thought to how to test/validate the atomic images? 17:35:32 * mattdm hopes we can pull in some of the wider atomic community to help with that 17:35:36 mattdm, that's "nope, no additional tweaks needed." :) 17:35:42 agrimm: \o/ 17:35:48 dgilmore: is that grabbable? 17:36:03 jzb: from koji yes 17:36:05 awesome :) 17:36:08 roshi, there's going to be about 75% overlap with regular cloud images 17:36:21 http://koji.fedoraproject.org/koji/taskinfo?taskID=7531371 17:36:37 the cloud install tree is a mess and naeeds major work 17:36:44 fair enough, that's still 25% more testing at least though :) 17:37:31 #info Fedora Atomic TC6 image (should be, you know... testable!) http://koji.fedoraproject.org/koji/taskinfo?taskID=7531374 17:37:34 roshi, which is basically 1) test docker, and 2) test ostree updates and rollbacks 17:37:44 woot! 17:37:53 agrimm: so we can do 1/2 with this 17:38:04 dgilmore "major work" to make it not ugly or major work to make it function? 17:38:05 we'd need a new compose / tree to do update/rollback 17:38:10 * agrimm should have let dgilmore speak first on this topic, it seems 17:38:20 mattdm: major work to make it function 17:38:27 dgilmore: That tree is defined by this file in spin-kickstarts, correct? -> https://git.fedorahosted.org/cgit/spin-kickstarts.git/tree/fedora-install-cloud.ks 17:38:34 imcleod: yes 17:38:44 dgilmore: can you briefly elaborate on the "mess"? 17:38:47 many packages the cloud install needs are not there 17:38:52 OK. That's a mess. 17:38:59 and tehre is no environments in the tree at all 17:39:19 there should be a cloud-product-environment and the cloud images should use that 17:39:30 so there is a bunch of comps changes needed 17:39:39 and likely some kickstart changes needed 17:40:51 OK. I made a very tentative proposed comps change quite a while ago but then kind of lost the thread. I can try to pick that up but will need a few pointers to details on the environments setup. I can take this as an action if I can get a few moments of your time offline after the meeting. 17:40:52 dgilmore is there a ticket for this? 17:41:03 imcleod++ 17:41:14 * mattdm is as happy with that as with a ticket :) 17:41:20 mattdm: no idea, its the same issue basically as the server product had 17:41:30 but we are much further behind 17:42:30 dgilmore: Is it fair to summarize this as "generate comps, spin kickstart and environments changes as needed to get the required cloud packages into the Cloud spin?" 17:42:45 mattdm: there is at least one bug in bugzilla 17:43:00 the packages missing probably doesnt have one yet 17:43:16 but it will need one filed so we can block alpha on getting it fixed 17:43:25 imcleod: yes 17:43:40 imcleod: the environments bit is in comps 17:44:32 dgilmore: OK. I'll see if I can figure it out. 17:45:16 imcleod: looking at what the server guys have done this week should help 17:45:23 #action imcleod to generate comps, spin kickstart and environments changes as needed to get the required cloud packages into the Cloud spin 17:45:28 ^^^^ :) 17:45:36 any groups needed for the cloud-product-environment need to be in the install kickstart 17:46:26 for cloud currently, that's @core and a few random packages 17:47:05 as I understand it, the idea here is to put those random packages into a cloud-product group instead 17:47:12 mattdm: those random packages need to go in a comps group 17:48:18 okay sounds like the problem is at least well understood 17:48:23 do we have anything else like that? 17:49:12 just needs done :) 17:49:36 okay, and we've got imcleod tagged for it. :) 17:49:46 any other things we know need done? 17:49:46 imcleod: when you have thinsg together I am happy to review and make sure they get applied 17:49:51 I can do some testing also 17:50:01 imcleod: I will owe you beers 17:50:12 straigten out the install tree, make the kickstarts match 17:50:14 dgilmore: Cheers. I cannot commit to spin-kickstarts so you'll be getting patches from me :-). 17:50:23 setup automated nightly atomic tree composition 17:50:52 dgilmore: I suspect this is, as mentioned above, adding a comps group for the cloud-enabling packages, adding that group to the tree and then including it in the cloud kickstart. Am I missing anything obvious? 17:50:55 mattdm: its getting there 17:51:27 imcleod: thats about it, we should add an environment to comps so people can select it 17:51:53 dgilmore: K. 17:51:54 and we should think up ways to document and make it easy for people to make custom images 17:52:10 #help documentation for making custom images would be nice 17:53:11 okay number80 next on the agenda? :) 17:54:23 let's esee 17:55:28 #topic next steps on test plan 17:55:36 https://fedorahosted.org/cloud/ticket/61 17:55:42 roshi: ? 17:56:03 well, I put up drafts of the test plan and test overview a while back 17:56:19 https://fedoraproject.org/wiki/User:Roshi/QA/Cloud_Docs 17:56:30 #help everyone look at roshi's test plan! 17:56:35 never got much feedback on them 17:56:41 so I presume they're good 17:57:03 I think we've got a decent list of things to test for the base cloud image (AMI) 17:57:15 but nothing for the docker container image or the atomic image 17:57:40 roshi yeah have read through them several times and I think they are good 17:57:48 #help add test cases for Atomic Host image 17:57:53 number80++! 17:58:03 roshi: aren't Atomic == docker host same thing? 17:58:12 docker host == atomic aiui 17:58:23 (as for the docker image, it's now under the umbrella of the Base WG) 17:58:31 oh, gotcha. Misread. 17:58:37 but we're also talking docker container images (for running inside a container) and talks of the vagrant image too 17:58:45 none of which are blocker as far as I know 17:58:56 but should still be testing if we're going to say "We made this." 17:59:15 number80: docker image being the docker container image or the atomic image? 17:59:19 somewhere in beta timeframe we should probably try a test day w/the base folks 17:59:27 running the docker image in Atomic image 17:59:30 good idea jzb 17:59:34 roshi: container one 17:59:50 jzb: yeah would be great to have an atomic/docker test day 17:59:51 * roshi doesn't remember who the QA contact is in base 18:00:03 roshi looks like the docker image (the one that runs inside the container, not the host) is outside of cloud wg now, so we should pass that on 18:00:21 roshi: just remember that Atomic => container hosting platform, docker image => the one used by containers 18:00:26 #help we hould plan a test day with the base wg for running the docker base image in atomic 18:00:34 nothing to pass on because I haven't written anything for testing it :) 18:00:40 roshi yay! 18:00:43 :) 18:00:53 and the vagrant image is f22 material so nothing to worry about now 18:00:59 jzb: do you know if there's a test day for Atomic image ? 18:01:03 mattdm: dgilmore and a few others of us talked about terminology earlier for the "docker image" 18:01:03 yeah number80 - just took a while to suss out due to either misunderstanding on my part or equivocation about the image names 18:01:06 number80: not yet 18:01:09 there isn't now, a test day 18:01:24 it would be good to have one 18:01:25 #action jzb plan test days for Atomic image, base docker image 18:01:29 mattdm: would probably be less confusing if we started saying "docker container image" 18:01:43 jzb: thanks :) 18:01:46 well, we could just say "docker image" 18:01:56 and "atomic" 18:02:04 the biggest issue I talked to mattdm about was documented in the "Ideas on what to test" page on my wiki space 18:02:06 jzb: seems like enough people are getting confused 18:02:23 I did my best to document things we should test since there wasn't really a list to begin with 18:02:27 jzb: it makes sense to me and you but most people assume 'docker image' can be run as a VM 18:02:37 hmm 18:02:38 do they? 18:02:50 To add another wrinkle of confusion, we also want to distinguish that this is a docker _base_ image (in docker's terminology). 18:02:50 I'm writing a blog post explaining the different images we're making - once I have it fully grokked :) 18:02:51 seems like it keeps coming up in chats 18:02:53 * dgilmore needs to go seek out food 18:02:54 dustymabe: I'm perpetually confused so maybe I just hadn't noticed when others were ;-) 18:03:08 maybe we could discuss this on the list and have a lexicon on the wiki ? 18:03:12 could perhaps be good on the magazine as well 18:03:28 number80: good call. dustymabe can you start a thread on the cloud list? 18:03:33 I'll also put it on the wiki - since I feel like there's some confusion for sure 18:03:34 ISTR someone is working on a clarification piece. 18:03:41 mattdm: regarding the terminology ? 18:03:45 dustymabe yeah. 18:03:50 mattdm: sure 18:04:14 #action dustymabe start a discussion on terminology (docker/atomic) on the cloud m-l 18:04:15 that way we all know how to properly refer to the bikeshed. :) 18:04:34 bicyclic housing unit :p 18:04:34 well, next topic ? 18:04:39 lol 18:04:44 roshi: +1 18:05:11 any comments on the test plan and what to test we can talk in fedora-cloud after the meeting 18:05:23 mattdm: should I include the base WG on that email since they are responsible for the docker container image? 18:05:23 if that works 18:05:32 +1 dustymabe 18:05:45 +1 18:05:57 * dustymabe takes the hint :) 18:06:03 ok 18:06:14 #topic Automatic Smoketests on Image Build 18:06:22 https://fedorahosted.org/cloud/ticket/38 18:06:33 agrimm, roshi ? 18:06:52 we talked a bit about this earlier this week 18:07:12 hmm, we talked about two tasks last friday, and I think I put my whole update in one of them... 18:07:17 * agrimm looks for the other 18:07:38 also i know oddshocks's fedimg service _does_ do a basic boot/ssh test, but I don't know the details 18:07:46 for basic smoke tests I was thinking fabric based ssh tests 18:08:15 and I think I can get those to run in taskotron, but would need to talk to tflink about it more down the line 18:08:18 works for me 18:08:29 https://fedoraproject.org/wiki/User:Roshi/QA/Cloud_Docs/what_to_test 18:09:28 I think most of those things listed there can be turned into automated tests via fabric 18:09:36 mattdm: yeah, right now I just have it configured to run /bin/true and check the exit code, but fedimg will run an entire shell script and check the exit code 18:09:47 it's just I haven't put anything in that script besides the basic /bin/true by default 18:09:53 I also made some test cases for doing manually 18:10:14 at the bottom of the link I just gave 18:12:22 oddshocks do we have somewhere easy (or an easy command to run) so mere mortals can see the state of those tests? 18:13:03 * dustymabe wonders if the FPL is a mere mortal? 18:13:13 mattdm: sure, there's an image.test fedmsg topic :) 18:13:21 dustymabe: no, but there can be only one. 18:13:21 mattdm: nothing to see at the momennt though, still smoketesting in staging 18:13:31 mattdm: but yeah you can see if tests have started, completed, or failed 18:13:32 dustymabe: he needs to eat and sleep at least ;) 18:13:38 :) 18:13:48 number80: I've never seen him sleep. 18:14:00 mattdm: and of course there's more I can add in the future 18:14:05 lol 18:14:05 I think this discussion would be good to have with the qa-devel group 18:14:22 get oddshocks and tflink, kparal all on the same sheet of music 18:14:40 since we would want the results with the rest of the results throughout fedora and on resultsdb 18:14:57 sounds good 18:15:20 * roshi isn't sure when the next qa-devel meeting is 18:15:56 for the time being though, we can do manual tests and automagic tests as we have them and report in the wiki that the images are valid once we have images 18:16:20 roshi: is it the same as the QA meeting ? 18:16:35 * oddshocks nods 18:16:35 nope, it's the devel team for taskotron 18:16:43 ok 18:16:56 * oddshocks apologizes for being semi-unresponsive, on a call 18:17:05 I don't see the automagic testing as being a huge deal right now - since we can do these tests manually now 18:17:09 we just need to document them 18:17:14 roshi: it doesn't appear on fedocal, please request that they add it :) 18:17:25 for atomic and the docker bace image tests especially 18:17:32 might not be one scheduled 18:17:42 #info for the time being we can do manual tests and automagic tests as we have them, and report in the wiki as usual 18:17:43 but I'll check in with them 18:18:09 I'll be making sure the wiki pages have the tests added to the results page 18:18:19 talk to adamw and the qa folks about placement and whatnot 18:19:25 roshi thanks! 18:19:36 roshi: I'm going to be doing a docs binge this week and there will be a lot more info on how fedimg tests, at least 18:19:47 good 18:19:57 sweet 18:20:04 we can link up on that sometime too 18:21:30 next topic ? 18:22:07 yep 18:22:09 #topic start communication/collaboration on cloud image updates 18:22:16 https://fedorahosted.org/cloud/ticket/51 18:22:24 roshi: again ^^ 18:22:51 this is a lot of stuff for not even being a proper cloudy person :P 18:23:06 sure :) 18:23:15 this was the other thing agrimm and I talked about 18:23:39 roshi I think you're an *honorary* proper cloudy person by now :) 18:23:44 haha 18:23:51 #info agrimm has some good info in the ticket 18:23:52 something like that for sure :) 18:24:28 I think some discussion should probably happen about where the testing actually *happens* - but that process listed in the ticket is good afaict 18:25:13 suggestions on the list of times a update should be created would be good 18:25:20 those were what we could come up with 18:26:36 #help more suggestions for cases where an update should be created would be helpful 18:27:08 as for the where to run the tests in that process, I think the conversation with qa-devel will be important 18:27:25 since that's where all the other testing is going to be moving towards, aiui 18:28:38 +1 18:29:35 do we have any other action to take on this one at this point? 18:29:59 * roshi doesn't have anything he doesn't think 18:30:09 more discussion within the ticket should be good 18:30:09 ok, last point :) 18:30:52 #help more discussion in the ticket please 18:31:32 #topic Process for determining when and why Docker trusted images need to be rebuilt 18:31:37 https://fedorahosted.org/cloud/ticket/59 18:31:52 this process might be almost covered by the last, right? 18:32:03 almost yeah 18:32:07 yup 18:32:08 I've sent a draft to the list for discussion 18:32:15 and ... crickets 18:32:26 well, sorta - I got a bunch of questions from one person directly 18:32:37 asked if it was OK to send ot list, but didn't get a reply 18:32:49 but it'd be good to get some feedback from the rest of the WG 18:32:57 * oddshocks nods 18:33:07 link to that email? 18:33:08 jzb: I think from what I read you had said once a month? 18:33:08 jzb: it should be ok 18:33:26 dustymabe: short version: montly or if a security update triggers it 18:33:26 * roshi didn't respond because up until this week I didn't really grok docker at all 18:33:55 jzb yep. sounds good to me 18:34:25 OK 18:34:43 lemme go back through and see if any of the other qs need to go to the list and I'll close this out. 18:34:46 EOF 18:34:59 do we skip the open floor ? 18:35:18 or do you have any other topics ? 18:35:20 number80: any items from last week that got lost? 18:35:37 https://lists.fedoraproject.org/pipermail/cloud/2014-September/004194.html 18:35:43 dustymabe: there is #65 => https://fedorahosted.org/cloud/ticket/65 18:35:51 * roshi has nothing since we alreday talked about the bicyclic housing unit that is naming images in a less confusing way 18:36:05 but since we're not in charge anymore of the docker image, it may be ok to skip it 18:36:36 I suggest that we close it ? 18:36:57 so the concrete list of the images we want to produce (product and others) is: Base (AMI, etc), Atomic, Docker (handled by Base), right? 18:37:03 +1 number80 18:37:12 cool 18:37:30 roshi: more or less, yes 18:37:39 number80 I think close for now. this is about a second thing -- images produced _at Docker_ via stuff in fedora-dockerfiles. (eg not releng or "official fedora" deliverables) 18:37:50 what's the answer that doesn't require the "more or less" modifier? 18:37:59 #action number80 close ticket #65 18:38:03 :) 18:38:08 roshi: we have few variants of base ;) 18:38:15 probably not for F21 18:38:23 ok, for F21 then 18:38:34 I just haven't seen The List for F21 (tm) 18:38:39 yeah let's just worry about f21 for now :) 18:38:48 ok 18:38:53 #topic openfloor 18:39:04 last call before we end this meeting 18:39:18 Just a reminder that there's a weekly Atomic meeting in #atomic on Tuesdays 18:40:00 so those three are The List for F21? 18:40:03 oddshocks: the atomic/infra meeting ? 18:40:03 20:00 UTC. that's all I got 18:40:34 number80: infra meeting is Thursdays. but a few infra people do go to the #atomic meeting 18:40:38 number80: https://apps.fedoraproject.org/calendar/cloud/ 18:40:40 #info Weekly Atomic meeting in #atomic on tuesdays 20:00 UTC 18:40:44 https://apps.fedoraproject.org/calendar//meeting/738/ 18:41:27 ok 18:41:32 good 18:41:47 anything else ? 18:41:57 Nope 18:42:04 thanks number80! 18:42:16 thank you guys for attending and see you next week ! :) 18:42:18 yeah, thanks :) 18:42:21 indeed, thanks number80 ! 18:42:25 thanks number80 :) 18:42:25 #endmeeting