18:59:59 #startmeeting Infrastructure (2013-06-06) 18:59:59 Meeting started Thu Jun 6 18:59:59 2013 UTC. The chair is nirik. Information about MeetBot at http://wiki.debian.org/MeetBot. 18:59:59 Useful Commands: #action #agreed #halp #info #idea #link #topic. 18:59:59 #meetingname infrastructure 18:59:59 The meeting name has been set to 'infrastructure' 19:00:00 #topic welcome y'all 19:00:00 #chair smooge skvidal CodeBlock ricky nirik abadger1999 lmacken dgilmore mdomsch threebean 19:00:00 Current chairs: CodeBlock abadger1999 dgilmore lmacken mdomsch nirik ricky skvidal smooge threebean 19:00:17 * abadger1999 here 19:00:19 * lmacken 19:00:22 * skvidal is here 19:00:25 ack 19:00:31 * framew0rk here 19:00:32 is here 19:00:50 * pvod here 19:01:03 * pingou here 19:01:07 here 19:01:27 morning everyone. ;) 19:01:38 #topic New folks introductions and Apprentice tasks 19:01:44 * mdomsch 19:01:49 * puiterwijk here 19:01:56 any new folks like to introduce themselves? or apprentices witch questions ? 19:02:14 me 19:02:24 * threebean is here a little late 19:02:48 welcome mtsil. Can you provide a short bio/background and if you are interested in sysadmin or application devel type things? ;) 19:02:53 * bitlord here (watching) 19:03:44 hi folks, my name is Matheus Silva, I am just another RHCSA guy wanting learn more about the project and sysadmin 19:04:25 excellent. Welcome. see me in #fedora-admin after the meeting and I can see about getting you started. 19:04:38 quick question re: apprentice group 19:04:40 ok, thanks nirik 19:04:46 framew0rk: fire away. ;) 19:05:05 how do i get a public key to ssh in? i am just now getting around to using my membership :) 19:05:25 framew0rk: hang on, there's a guide on our wiki... 19:05:39 framew0rk, http://fedoraproject.org/wiki/Cryptography#Creating_SSH_Keys 19:05:51 yeah, that one. ;) bitlord is faster than I. 19:06:12 thanks guys :) 19:06:22 #topic Applications status / discussion 19:06:29 any applications news this week? 19:06:34 I have one bit... 19:06:44 #info geoip service moved to production. 19:06:54 thanks for mdomsch for working on that geoip stuff. ;) 19:07:09 happy to. Thanks for cleaning up the mess I left it in. 19:07:17 Badges/Tahrir work is progressing 19:07:29 #info Fedora content dropped from S3 mirrors 19:07:34 * pingou worked more on fedocal and provided a couple of patches to packages and datagrepper 19:07:38 #info EPEL remains 19:08:16 we didn't have enough users of Fedora in EC2 to justify continually pushing Fedora content into each of the S3 regions 19:08:29 * nirik nods. 19:08:49 So final freeze is not starting next week, but the week after. Do we have anything we want to get in before final freeze? 19:08:53 all the regions or just a couple? 19:09:06 smooge: all regions 19:09:13 ok np 19:09:14 As usual I'd like to get things so we drop all the hotfixes we are carrying, but not sure how practical that is. 19:10:10 On getting stuff ready before the freeze, having the badges machines ready would be nice -- nirik has already been asking about details for that in #fedora-apps. 19:10:31 yeah, I am hoping to have those before too long. 19:10:40 * threebean nods 19:10:52 we will need to work through some workflow with ansible and staging, as I would like to make them in ansible instead of puppet if possible 19:10:52 not as much of a rush as I'd thought. Sorry for that false alarm. ;) 19:11:02 +1 19:11:10 nirik: post-meeting let's talk staging 19:11:19 https://fedorahosted.org/fedora-infrastructure/report/15 19:11:22 to see what needs to happen for that happiness 19:11:29 (that is the list of current hotfixes) 19:11:30 nirik, skvidal: thanks both. 19:11:31 skvidal: sounds good. 19:12:31 anything else on the application side of things? 19:13:31 #topic Sysadmin status / discussion 19:13:44 #info lots of ansible work in progress, check the git repo for details 19:13:44 lots of ansible ports this week 19:13:45 lots and lots 19:13:47 :) 19:14:03 tested fireball mode 19:14:10 skvidal is on fire! 19:14:10 other minor things 19:14:21 mostly just playing with the mirrorlist stuff 19:14:28 which has allowed porting a ton of stuff over 19:14:31 skvidal: how far are we from the hook to do playbook runs? we should try and get that before long so more folks can work on converting things. 19:14:50 nirik: I agree 19:15:01 #info revamped our sign-vault machines this week (not a very visible change, but needed) 19:15:02 we're going to get a lot of bogon runs when we touch stuff in tasks, of course 19:15:06 yeah. 19:15:21 and I was kinda delaying on purpose 19:15:27 b/c I wanted to talk to some people at ansiblefest next week 19:15:44 to see if there are other more graceful solutions that I just haven't read about 19:15:57 is that silly? 19:16:04 not at all. completely fair. 19:16:17 do you know if any of the ansiblefest stuff will be online? 19:16:38 I dont think so 19:16:42 maybe I'll sneak in a camera 19:16:50 #info our koji data sync has completed it's first 2 passes to netapp... 3rd in progress. 19:17:55 #info we have an outage scheduled for monday for mass rebooting. 19:18:15 wear your google glasses 19:18:51 hah 19:19:07 indeed. 19:19:29 #info still need to write up/implement new backup plan. 19:19:48 any other sysadmin items? 19:20:36 #topic Private Cloud status update / discussion 19:20:43 not much to report here again I don't think... 19:20:53 people are using the cloud and it's working along ok for now. 19:21:02 on the minus side 19:21:17 we've had it explained that all of our assumptions are wrong 19:21:22 and we have to rebuild it eventually 19:21:54 yeah, I still want to rebuild 01/03 nodes with the next version and done more like "they" want us to. 19:22:04 but thats a good thing for when we are in freeze. ;) 19:22:25 oh dear 19:22:30 nirik: +1 19:22:31 that sounds like an entire session of flock 19:22:42 smooge: let's put it this way 19:22:56 smooge: there are a lot of...... perspectives that the openstack devels have 19:23:00 cloud putting the F in Flock 19:23:02 that are not the most obvious choices 19:23:09 at least from my perspective 19:23:16 i don't doubt. 19:23:42 yeah. 19:24:01 like 'quotas should work' 19:24:05 I think over time they are adding things that everyday sysadmins would want to do, but there's still a lot of weird assumptions, IMHO 19:24:09 or 'failing commands should tell you something about it' 19:24:19 or 'you should be able to change your password' 19:24:20 like that they failed, at all 19:24:54 or 'setting quotas in one place should, theoretically, impact the rest of the places using that quota' 19:25:03 anyhow, we will continue to push for our uses and hopefully make things better. ;) 19:25:06 it is only counted a failure if the command crashed. otherwise the command did execute to the best of its ability and left without a coredump 19:25:06 indeed 19:25:22 #topic Upcoming Tasks/Items 19:25:28 https://apps.fedoraproject.org/calendar/list/infrastructure/ 19:25:36 * skvidal looks 19:25:37 I finally did fill this in more. :) 19:25:51 it's nice 19:25:53 lovely 19:25:58 anything anyone would like to note or plan for? 19:26:00 hmm 19:26:06 how come our reboot-a-thon isn't on there? 19:26:20 I should add it, also to the outage one. ;) 19:26:31 * skvidal checks if he has the outage one on his list 19:28:18 added to both 19:28:26 https://apps.fedoraproject.org/calendar/list/infrastructure-outages/ 19:28:30 is the outage one 19:29:00 we may schedule a outage to move koji storage before final freeze, not sure yet... 19:29:37 #topic Flock 19:29:49 voting for flock talks is open... everyone should go vote. ;) 19:30:17 https://admin.fedoraproject.org/voting/about/flock-2013 19:30:58 Do we want to do any more planning for flock? I'm sure we will gather and discuss various things, but is there specific things we want to try and do/plan? 19:31:15 it's still a ways out, but something to think about. 19:32:00 * abadger1999 thinks he'll have too little infra time to do much :-( -- have python sig and fesco stuff to work on 19:32:36 yeah, it's always easy to get pulled in several directions. 19:32:50 #topic Open Floor 19:33:03 But if some of that doesn't happen -- there's a lot of discussions to be had around auth in the next year. 19:33:04 Anyone have anything for open floor? general comments, questions, observations? 19:33:26 abadger1999: yeah, I'd like to talk oauth for sure... try and hash out how best to use it. 19:33:36 rebuild devel and staging of flock onto the Clooooud should be a flock thing 19:35:16 all cloud all the time. ;) 19:35:34 ok, if nothing else will close out the meeting in a minute or two 19:35:37 though to be fair 19:35:49 I would like to see all of our dev instances diaf 19:35:53 and move to the cloud space 19:36:14 only b/c it feels like they'd be better off there 19:36:22 If I get some time next week before freeze, I may finish up MM 1.4. No promises, but I can wish... 19:36:27 yeah, dev seems like a great fit for cloud... 19:37:05 mdomsch wishes cann come true 19:37:06 mdomsch: that would be great. 19:37:35 mdomsch: so - not sure if it matters to you - but with the mirrorlist boxes split out 19:37:52 mdomsch: testing out a box should involve less 'where is all this crap' than it does now 19:37:58 or 'is this other app molesting mm' 19:39:03 ok, thanks for coming everyone. Do continue in #fedora-admin, #fedora-apps and #fedora-noc. 19:39:03 #endmeeting