21:00:06 #startmeeting Cloud SIG 21:00:07 Meeting started Thu Aug 26 21:00:06 2010 UTC. The chair is rbergeron. Information about MeetBot at http://wiki.debian.org/MeetBot. 21:00:07 Useful Commands: #action #agreed #halp #info #idea #link #topic. 21:00:11 heya 21:00:31 hey jforbes, how goes it :) 21:00:34 #topic Roll call 21:00:35 #topic roll call 21:00:48 #chair gholms|work jforbes 21:00:48 Current chairs: gholms|work jforbes rbergeron 21:00:50 It goes, hopefully generating the last F13 image set 21:01:03 anyone else about? 21:01:16 * gholms|work tries to stay awake 21:01:25 * rbergeron grins 21:01:49 * jsmith is here 21:01:59 (but I'll probably have to leave early) 21:02:03 * rbergeron waves to jsmith 21:02:09 rbergeron: Long time, no chat 21:02:09 #topic Agenda 21:02:16 #link https://fedoraproject.org/wiki/Cloud_SIG#Upcoming_meeting_agenda 21:02:29 More or less standard fare, though I've added some "let's think about the future" if we get that far into the meeting :) 21:02:34 #topic EC2 status 21:02:37 here 21:02:40 gholms|work: I know that feeling, going on 3 hours sleep, my oldest turned 7 today so he woke up early 21:02:47 jforbes: take it away, sir :) 21:03:03 EC2 status... Building what I hope to be the last F13 images right now after getting more feedback 21:03:23 feedback from.... amazon? 21:03:33 specifically Amazon wanted to see root login locked out 21:03:40 ah 21:03:40 an ec2-user as default user 21:03:47 can we document those little things somewhere? maybe on the wiki? 21:04:00 and an entry in /root/.ssh/authorized_keys with a forced command saying how to log into the instance 21:04:01 or in your notes list for when we figure out how to make this consistently repeatable :) 21:04:26 Indeed (which is also why I typed them here, so there is a record of them somewhere 21:04:33 #info jforbes is building what he hopes is the last F13 image right now, cleaning up some items after getting feedback from the folks at amazon 21:04:43 #info amazon wanted root login locked out 21:05:12 #info and an entry in root/.ssh/authorized_keys with a forced command saying how to log into the instance 21:05:23 okay. 21:05:29 So after this..... ? 21:05:39 #info Amazon requested ec2-user as the default user and a sudo nopassword entry for that user 21:06:07 After this, we make images public and call for broad testing 21:06:10 sorry, have stuff going on at work 21:06:22 Can we just call the user 'fedora' so we match both our live CD and Ubuntu's precedence? 21:06:24 are we talking about Ben yet? heh 21:06:24 brianlamere: no worries, just making sure you knew :) 21:06:45 brianlamere: not yet :) 21:07:12 jforbes or anyone else: do we know exactly what we want to test - is there a list we can point users to of things they shoudl specifically check? 21:07:14 what the user is called is irrelevant; bucket names are what is important, otherwise you're literally just a number 21:07:16 While the public is testing we can work with amazon to get the official bit set and work out the S3 mirror bit that Nathan had in mind 21:07:35 brianlamere: just a number? where did they ever get that idea from :) 21:08:03 jforbes: was Ben someone you were already working with? does the official account already have S3 comp'd? 21:08:20 What are we using for EC2-specific init scripts? 21:08:21 brianlamere: not when amazon makes you a clicky :) 21:08:48 yeah - that's what Ben was saying he could easily do if we just tell him the AMI number to do it with 21:08:53 gholms|work: rc.local bits still, but amazon would like those broken out... That requires a new package, and will be an F14 target 21:08:55 since he's in the group that manages it 21:09:10 jforbes: Have you looked at http://packages.ubuntu.com/karmic/ec2-init ? 21:09:20 gholms|work: I have 21:09:32 Can we make use of something like that? 21:09:44 look at some of the ec2-init stuff, they query a meta url (169.something.169.something) and get info about it 21:09:53 gholms|work: possibly 21:10:11 brianlamere: Yeah, those are the URIs that their infrastructure gives VMs to configure themselves with. 21:10:26 it's pretty basic - I use it to get the private IP address when something starts, so an instance can tell all it's friends where it can be found 21:10:39 and ubuntu uses cloud-user instead of ec2-user. no reason to go against their wish their though, makes docs easier for new users 21:10:40 err...its. sorry. 21:11:25 ec2-user makes sense if their docs say that. 21:12:38 jforbes, all the things from amazon look like stuff from the initial kickstart? correct? 21:13:02 oh sorry didn't scroll down (again) 21:13:02 smooge: yeah, with a bit of post 21:13:19 * rbergeron sends smooge a new scroller for the day 21:13:53 Soooo - can i drag us back to testing for a moment? 21:14:11 * rbergeron notes that we could announce a testing day for EC2 - if we have all the stuff in place 21:14:21 ie: people available online to help out, a standard list of things to test, etc. 21:14:35 and all the bits for access that people would need in place. 21:14:48 here's ubuntu's ec2 init stuff: https://help.ubuntu.com/community/CloudInit 21:15:13 the Amazon guy suggested it as something we should look at and use/fork/learnfrom 21:15:37 jforbes: btw, EC2 has been picked for a Feature Profile to be done in the next few weeks, and I'm on the hook for writing it :) 21:16:03 * gholms|work is willing to package cloud-init if we want to do that 21:16:12 rbergeron: Yeah, I was also asked to see if we had anyone in RDU who is part of this SIG... anyone? 21:16:13 rbergeron: Good luck 21:16:41 ohhh, for the video stuff - I have no idea. gregdek was, I don't know about now - I suspect nobody 21:17:13 ok, so something to keep in mind: there should be a minor difference for ec2 instances over instances in the wild, outside of ec2; ec2 instances should have a package installed that covers there being different repos than normal 21:17:18 rbergeron: Yeah, they thought I was in Boston, but I am very far away from that 21:17:21 smooge: do we have any infrastrucutre folks in RDU? 21:17:36 yeah - I was like... ummm, he's on hte better half of the country, yo 21:17:40 :) 21:17:41 brianlamere: why? 21:17:42 brianlamere: Why's that? 21:17:45 is there already a package for the minor extras that get put on an ec2 instance? 21:18:09 fore Fedora? 21:18:13 brianlamere: no, there needs to be one created, scroll up :) 21:18:17 rbergeron, for Fedora or RH in general? 21:18:22 On Fedora? Not yet. 21:18:33 why: because then the AWS repos that can only be reached inside amazon can actually be added as the primary repo targets 21:18:46 brianlamere: Why not use mirrormanager? 21:18:47 brianlamere: umm, mirror manager takes care of that 21:18:48 smooge: someone that might be able to talk a bit to Cloud stuff with Fedora on video 21:18:59 Mirrormanager can prioritize repos by IP blocks. 21:19:09 well I will be out there in late September for RHEL training 21:19:15 ah...ok, I apologize, I didn't realize this 21:19:18 (Speaking of that, do we have a list of EC2's IPs?) 21:19:23 hrmmmmmm 21:19:24 gholms|work: not yet 21:19:35 jforbes: i'll talk to stickster about the timing on the video stuff 21:19:48 Ben said there are ACLs for easily making buckets only accessible within a region 21:19:56 rbergeron: I appreciate it, had it been 2 weeks ago, I was in boston :) 21:19:57 rbergeron: Or me -- doesn't have to block on stickster 21:20:11 jforbes: But the video team wasn't there :-( 21:20:22 jsmith: ah - i didn't know he had you in the loop for the video stuff 21:20:29 problem is, none of the tools out there reference those ACLs (boto doesn't, for instance). he seemed to be suggesting they could set that up for us, though. 21:20:30 jsmith: can you see what the timeline for that is? 21:20:39 rbergeron: It technically falls on my to-do list -- he's just helping me learn the ropes 21:20:48 brianlamere: Does the web UI have that? 21:20:55 I know it was probably colby hoke doing the video, esp if they were thinking RDU - but smooge is going to be there in late september and might be able to do it 21:21:03 we don't have anyone else in RDU, really 21:21:19 I don't know about boston - but jforbes just said they wer asking about RDU - id ont' even think any of us are in boston, even 21:21:40 jsmith: yeah, the good news is, this is a real community effort, the bad news is, that means no one is close to RDU or BOS 21:21:49 jforbes: That's OK -- we'll improvise 21:22:04 rbergeron: Yeah, stickster said they would be in Boston in a couple of weeks or something, but when I said I wasn't there he asked about RDU folks 21:22:04 RDU? 21:22:06 jforbes: Worse comes to worse, we fly somebody to RDU 21:22:09 send colby up to OLF :) 21:22:16 rbergeron: That may work as well 21:22:23 gholms|work: RDU = Raleigh, NC 21:22:24 not that I could talk about it 21:22:25 Oh, there. 21:22:29 jsmith, when did you need it? 21:22:32 dhuff is one of th ose places, but he has been kind of out of the loops lately 21:22:32 gholms|work: (silly airport codes) 21:22:39 * rbergeron nods 21:22:49 smooge: End of September at the latest 21:22:52 yeah, huff is in RDU - he might be able to wing it though - he was certainly involved for a while 21:23:03 Maybe we can get huff and smooge 21:23:08 well I will be there 26th to the 1st 21:23:13 of sept? 21:23:15 They could probably make something work 21:23:31 jsmith: can you check it out? :) 21:23:41 * rbergeron hopes the rdu video crew of awesome will be around then 21:23:43 rbergeron: It's on my to-do list :-) 21:23:44 of sept. I can bring my brightest hawaiian shirt or the one with blue/red cross hatches.. 21:23:56 smooge: can you layer them? 21:24:20 anyway: EC2 - any more thoughts here folks? 21:24:27 On the image-building front: new euca2ools is on its way to updates-testing. Please try building images and managing instances with it so we can find out if it works for it. 21:24:36 s/it\./that./ 21:25:07 They managed to make it compatible with deps that are already in stable Fedora, so it's on its way out the door. 21:25:13 gholms: awesome. 21:25:30 gholms|work: that makes me happy :) 21:25:50 I also managed to get in touch with boto's author, who seemed interested in helping with packaging. 21:25:53 rsc, brianlamere: ^ 21:26:10 gholms|work: is he on the mailing list? 21:26:12 gholms|work: Is that the same one that's in your personal repo? 21:26:23 jsmith: euca2ools-1.3-1, yeah. 21:26:39 gholms|work: Cool... already have it, but haven't played w/ it yet 21:26:53 gholms: cool - well, he trumps me by far in usefulness ;) though I'd still like to help out with that 21:27:00 gholms|work: the main question still remains: How compatible is 1.9 vs 2.0 beta? 21:27:20 I did catch up with rsc finally, he's going to send me his rpms to test with. 21:27:37 rsc: Good question. I don't require 2.0 any more for my package, so I can't really tell for sure. 21:27:48 oh, you're here - yeah, just send me the rpms you have and I can start testing the backwards compat starting...tomorrowish 21:29:28 anything else on ec2? :) 21:29:36 * rbergeron is just here with the cattle prod, don't mind me :) 21:29:52 * gholms|work raises hand 21:30:02 * rbergeron laughs... go ahead 21:30:03 :) 21:30:18 I'm also contemplating building euca2ools for el5, but I need a packager for m2crypto. Any takers? 21:30:29 do we want to get moving on actually having repos put up on S3, then? and then work with getting mirrormanager up on ec2 heads once we get that worked out? 21:30:38 oh god.. I am trying to remember why that name calls headaches 21:30:39 #info euca2ools 1.3 on its way to updates-testing; please test 21:31:25 gholms|work: I can try and hunt one down if we have no takers. 21:31:43 brianlamere: That sounds like a good idea. It would be nice to have a process nailed down for getting stuff from the master mirror to S3 buckets. 21:32:20 rbergeron: I just need someone to do it for el5 since el6 and Fedora have new enough Python to support euca2ools on their own. 21:32:54 #action rbergeron to try and hunt down a packager for m2crypto for el5 21:33:10 gholms: yes, I told Matt I'd work with him to get MirrorMaster to understand S3 as a backend 21:33:31 currently, MirrorMaster only understands a flat filesystem 21:34:01 point is, there's some dev work that needs to take place to facilitate it 21:34:09 There's a bit of controversy about what that package would be called, but it's basically the same thing as the existing epel-5 package, just built for python 2.6 21:34:49 gholms|work: noted 21:35:10 ok - m2crypto: I sortof use it, in that I use paramiko sometimes (well, I use fabric.api, which uses paramiko; I rarely use paramiko directly). It's really really indirectly that i use m2crypto, in other words 21:36:13 (specifically it may be called m2crypto26 or python-m2crypto26) 21:36:47 #info There's a bit of controversy about what that package would be called, but it's basically the same thing as the existing epel-5 package, just built for python 2.6; specifically it may be called m2crypto26 or python-m2crypto26 21:37:29 Do we want to attempt to package cloud-init now, or do we need to do dev work on it first? 21:38:02 * rbergeron doesn't know - jforbes? ^^ 21:39:21 gholms|work: want to ask on the list? 21:39:37 gholms|work: It probably needs some looking at, anyone want to start the packaging and I will be glad to review 21:39:38 * gholms|work shrugs 21:39:52 I'll see what I can do as far as packaging it goes. 21:40:07 * rbergeron grins 21:40:28 #action gholms|work to look at packaging cloud-init, jforbes can look at / review 21:40:39 I see what appears to be upstart-specific stuff, so we need to make sure that it works with systemd. 21:41:01 alllrighty - anything else here? 21:41:34 [You hear the sound of distant drums] 21:41:44 * rbergeron grins 21:41:52 #topic openstack packaging 21:41:56 silassewell, still about? 21:42:05 yup 21:42:49 For the swift stuff I'm still waiting on the reviewer 21:42:57 okay - I'll get after ian. 21:43:03 just the questions you had, or anything else? 21:43:14 https://bugzilla.redhat.com/show_bug.cgi?id=617632 21:43:27 If they're still an issue, otherwise just waiting for a formal review 21:44:06 #action rbergeron to follow up with ianweller on swift package review 21:44:12 #info openstack-swift waiting on package review 21:44:16 Gah, too slow! 21:44:20 i know he's just started school, so he's a little hectic atm i'd guess. :) 21:44:41 If anyone else wants to steal the review I'm sure he wouldn't mind that much. :P 21:44:55 no, i'm sure he'd be kosher with that 21:45:04 But reviewing packages it so extremely fun :p 21:45:06 though we'd have to find a taker :) 21:45:15 Ask on the list. 21:45:28 * rbergeron will do just that 21:45:38 hey look, a highlight 21:45:43 :D 21:45:43 #action rbergeron to look on list for another reviewer if ianweller is swamped :) 21:45:47 ears burning? :) 21:45:54 yeah school has blown me up, but this weekend should be... freeish 21:46:08 free enough to finish up that review. i think it's mostly all been taken care of. 21:46:22 ianweller: thanks :) 21:46:38 #action ianweller to finish up review this weekend, time permitting :) 21:47:12 alrighty. 21:47:18 silassewell: thanks for all your work on this :) 21:47:42 #topic Cloud in F15 and beyond...... 21:48:08 Sooo - I realize that we're still in F14 - but I'd like for people to start thinking about the "beyond getting on EC2" thing for F15. 21:48:32 If there are things we want to do, have, and what that will take between now and then - because really, we don't have all of F15, just the time we have to get things into feature list and so forth. 21:48:39 Does anyone have any thoughts / ideas / preferences? 21:48:42 How about we make refinements based on what we learn with F14? 21:48:49 * rbergeron notes she would really like to see deltacloud get packaged. 21:48:54 * rbergeron nods - excellent. 21:49:06 #info Refinements based on what we've learned with F14. 21:49:12 * rbergeron wonders if the idea tag works? 21:49:13 Nu-uh 21:49:16 #undo 21:49:16 Removing item from minutes: 21:49:17 #idea Refine our processes based on our F14 experiences 21:49:21 i think it does 21:49:23 * rbergeron grins 21:49:32 #idea Get deltacloud packaged. 21:49:58 #idea Document image building, publishing SOPs 21:50:20 * rbergeron notes that sdake is getting sheepdog packaged as well 21:50:44 nifty, saw a presentation on sheepdog at the kvm forum 21:50:52 What do you think of it? 21:51:00 I guess the question is, do we want to solely focus on just having images on amazon and elsewhere - or do we want to work on also having toolsets for people who are doing cloud-related development, etc? 21:51:17 ie - adding in nosql databases, etc 21:51:21 still a lot of work to be done, but the idea is good 21:51:46 #link http://www.osrg.net/sheepdog/_static/kvmforum2010.pdf 21:51:55 #link http://www.osrg.net/sheepdog/ 21:52:20 rbergeron: I think both are acceptable goals, but focus has to be on getting Fedora images into EC2 first 21:52:20 ah thanks 21:52:26 jforbes: indeed. 21:52:33 smooge: ? 21:52:51 rbergeron: I think people who want to do that can take one of our VMs, customize it, then build their own images out of those. 21:52:55 link to sheep dog 21:53:00 I was about to ask 21:53:14 sheepdog has some pre-work I think to getting packaged - man pages, init scripts were missing until like 2 days ago 21:53:34 and other stuff too... not sure what all exactly 21:53:51 anyhoo 21:54:10 I just wanted to feel out what people were thinking as we look towards the next round of fun. 21:54:43 Anyone else have any thoughts atm? 21:54:47 I think we should nail down the basics really well, first. 21:55:45 * rbergeron nods 21:55:57 okee dokee. 21:56:00 #topic Open Floor 21:56:10 Hey, we have time for open floor this time! :P 21:56:17 I know! 21:57:34 anyone? :) 21:58:04 [A cat slowly rolls a watermelon up onto shore] 21:58:07 * rbergeron will close out the meeting in a minute or so if nobody pipes up 21:58:54 Thanks for participating everyone :) 21:58:56 alllrighty then. 21:58:59 * rbergeron nods. Indeed! 21:59:06 #endmeeting