19:00:38 <smooge> #startmeeting Infrastructure
19:00:38 <zodbot> Meeting started Thu Dec 20 19:00:38 2012 UTC.  The chair is smooge. Information about MeetBot at http://wiki.debian.org/MeetBot.
19:00:38 <zodbot> Useful Commands: #action #agreed #halp #info #idea #link #topic.
19:00:51 <smooge> #ops relrod skvidal smooge mdomsch
19:00:59 <smooge> geez I can't remember crap
19:01:09 <skvidal> #roll?
19:01:14 <skvidal> .roll
19:01:24 <relrod> smooge: #chairs, then #topic whatever
19:01:24 <smooge> #topic Roll Call
19:01:26 * skvidal is here :)
19:01:32 * lmacken 
19:01:34 * relrod here
19:01:37 <smooge> #chairs relrod skvidal smooge mdosmch
19:01:42 * pingou 
19:01:43 * threebean here
19:01:57 <relrod> maybe just #chair, meh.
19:02:07 * herlo is here
19:02:29 <herlo> smooge: yeah, relrod is correct
19:02:32 * abadger1999 here
19:02:33 * marcdeop sorry is late
19:03:40 <smooge> no problem
19:03:43 <smooge> I am runniung slow
19:03:57 <smooge> #topic New folks introductions and Apprentice tasks.
19:04:06 <smooge> If any new folks want to give a quick one line bio or any apprentices
19:04:06 <smooge> would like to ask general questions, they can do so in this part of the
19:04:06 <smooge> meeting. Don't be shy!
19:05:23 <smooge> anyone?
19:05:27 <smooge> Buelher?
19:05:47 <smooge> ok... this will be faster than I expected :)
19:05:49 <smooge> #topic Applications status / discussion
19:05:51 <skvidal> 2 days before a massive holiday weekend
19:06:01 <skvidal> I suspect a lot of people are checked out
19:06:01 <smooge> bah holidays?
19:06:04 <pingou> I've been working on this last week-end http://ambre.pingoured.fr/fedora-stats2/index.html
19:06:08 <Southern_Gentlem> end of the world
19:06:18 <marcdeop> that's tomorrow, isn't it?
19:06:21 <pingou> with the idea of it replacing http://fedoraproject.org/wiki/Statistics
19:06:21 <smooge> aren't there workshops and prisons that people should be at?
19:06:24 <lmacken> pingou: nice!
19:06:29 <lmacken> pingou: where is the code?
19:06:30 <smooge> hi pingou cool
19:06:37 <pingou> lmacken: atm github
19:06:46 <pingou> it's just flat file database + a cron job
19:06:55 <pingou> since the page are only updated weekly
19:07:01 <lmacken> I'd love to finally pull some of the remaining widgets out of https://admin.fedoraproject.org/community/statistics
19:07:21 <pingou> I thought we could couple it to Paul's script that provides the stats to directly update the data file
19:07:46 <pingou> lmacken: I've to bother abadger1999 to get some user/group info :)
19:08:00 <abadger1999> pingou: can do.
19:08:02 <smooge> pingou, really cool
19:08:09 <lmacken> I wrote some code this week to find all of the bugs that bodhi was never able to close due to bz issues after the last upgrade.
19:08:17 <lmacken> It closed over 800 ON_QA bugs today, left bugs in the other states alone.
19:08:18 <pingou> lmacken: the week-edit is already there, just it's weekly
19:08:27 <pingou> smooge: thanks
19:08:44 <smooge> pingou, could I ask for a favour on the release data put in a line for each release versus every 2?
19:08:59 <smooge> I know this one from past experience on giving out graphs like that
19:09:25 <smooge> lmacken, how go things on your front?
19:09:27 <pingou> smooge: I've the idea to have a area graph in the main page to display the yum data accross all releases
19:09:45 <pingou> lmacken: btw, from my mailbox pov, it worked great :)
19:09:51 <lmacken> pingou: great :)
19:10:03 <lmacken> smooge: good, just trying to catch up on old tickets & bugs
19:10:09 <smooge> pingou, ok make it 3 dimensional to show how long a release has been etc etcf :)
19:10:13 <smooge> lmacken, cool.
19:10:24 <smooge> abadger1999, any app news?
19:10:24 <pingou> smooge: might be more tricky, I'll have to see
19:11:02 <smooge> pingou, hey wait til I ask for the 4 dimensional graph using transparency to map the 4th dimension... I loved trying to do that one.
19:11:11 <abadger1999> smooge: nope.  Freeze is a nice time to catch up on stuff but nothing to deploy :-)
19:11:32 <pingou> smooge: you write the js and I'll deploy it, deal ? :D
19:11:42 <smooge> okie dokie
19:11:56 <smooge> threebean, how goes the items?
19:12:02 <skvidal> smooge: the tardis doesn't like it when you attempt to map the time vortex
19:12:07 <skvidal> smooge: oh wait. sorry
19:12:28 <threebean> same as abadger1999 here.. I've been working on some upstream patches that we'll use eventually for the bugz.fp.o switchover.
19:12:44 <smooge> skvidal, if it means she will come visit me again.. I will map time and any relative dimensions in space I can.
19:12:53 <skvidal> heh
19:13:07 <smooge> threebean, cool.
19:13:25 <abadger1999> threebean: oh -- I'm going to deploy the new pkgdb to stg (with your fedmsg hooks).  Hopefully today.
19:13:31 <abadger1999> threebean: if you have time.
19:13:49 <smooge> mdomsch, you around.. there was a MM problem last night.. anything we need to watch over break?
19:13:53 <threebean> abadger1999: yeah, definitely :)
19:14:22 <abadger1999> excellent :-)
19:14:33 * abadger1999 uploads rpms to the testing repo while thining about it
19:14:54 <smooge> always thinks of abadger1999 petting a cat and speaking as a bond villian when he says that. [ok 4 cups of Peet's coffee is my limit ]
19:15:05 <smooge> ok any other app news?
19:15:23 <abadger1999> hehe.
19:15:35 <smooge> #topic Sysadmin status / discussion
19:15:46 <smooge> skvidal, you are up to nbat
19:15:49 <skvidal> okay
19:16:14 <skvidal> I've been messing with the nova client and seeing if openstack's metadata holders for instances lets us hold all the info we need for transients
19:16:26 <skvidal> it seems to - will require some new ansible modules to make that behave
19:16:41 <skvidal> also just found out about pynag today
19:16:55 <skvidal> which is a python-interface/cli tool for handling/rewriting/querying nagios
19:17:05 <skvidal> which might solve a bunch of problems for us like
19:17:19 <smooge> cool
19:17:19 <skvidal> "how and where do I disable this host/service/etc so it stops annoying me"
19:17:28 <smooge> hammer
19:17:29 <threebean> nice!
19:17:34 <skvidal> i'm still trying to deal with what we need to do that
19:17:44 <skvidal> it looks like we can specify a service group
19:17:50 <skvidal> get the list of short host names from there
19:17:51 <pingou> sounds great
19:17:56 <skvidal> and match those up to actual hostnames
19:17:59 <skvidal> (addresses)
19:18:11 <skvidal> so we can disable notifications on those hostnames
19:18:27 <skvidal> I'm still trying to figure out what that will actually look like
19:18:33 <skvidal> the other bit is this
19:18:42 <skvidal> it allows for programmatically re-outputting the nagios configs
19:18:55 <skvidal> and that, imo, seems like a massive win - b/c it could mean no more possible errors in nagios configs
19:19:09 <smooge> yay.. not that I know anything about that this week
19:19:15 <mdomsch> smooge: - yes - watch my commits for stupid typos (endswidth != endswith)
19:19:25 <skvidal> if anyone else wants to have a look - pynag is on github and already built in epel/fedora
19:19:35 <smooge> mdomsch, its ok.. I keep typing your name mdosmch
19:19:47 <skvidal> also - pingou and I got the jenkins instances in the euca cloudlet working (more or less)
19:19:50 <smooge> skvidal, cool. whats the url?
19:20:05 <skvidal> smooge: lmgtfy.com
19:20:05 <abadger1999> nice!
19:20:22 <smooge> HAHAHA
19:20:29 <skvidal> pingou: are we just waiting on patrick's openid changes?
19:20:30 <pingou> it's basically set-up, we just need to fix the authentication via OpenID
19:20:37 <skvidal> right
19:20:37 <pingou> skvidal: yes
19:20:44 <pingou> but the builders are already at work
19:20:58 <pingou> as we use the same builders for our master and for jenkins.tg.o for the moment
19:20:59 <skvidal> the nice bit here is that our jenkins instance can be torn down/brought back up w/o much in the way of thought
19:21:18 <skvidal> the playbook does EVERYTHING - from creating the instances to ensuring stuff is running
19:21:43 <skvidal> I like this model, btw
19:21:58 <skvidal> of having a playbook which is soup-to-nuts complete for a service
19:22:31 <skvidal> if we can isolate more of our services like this - it seems like a benefit in terms of being able to replicate/duplicate/scale-out our services
19:22:57 <skvidal> I'd love more feedback on where else we should think about this
19:23:21 <smooge> which brings me to what I am doing this week
19:23:38 <smooge> learning ansible playbooks so I can start writing more of our puppet over to it.
19:24:16 <smooge> basically making my own infrastructure and playbooking it outside using the ones we publically write. then adding various things so I can learn how to break things and fix them
19:24:41 <skvidal> smooge: cool
19:24:58 <smooge> [after that it  has been finishing budgets (we have one for 2013), tracking down "lost" hardware (I love you to IBM), and starting on our UCS hardware deployments.]
19:25:20 <smooge> and getting my password paper written for Fudcon.
19:26:28 <smooge> and drinking too much coffee (Damn You Peets for being so good).
19:26:38 <smooge> relrod, what are you up to?
19:27:16 <relrod> I have been dealing with some IRL stuff this week (involving taking my mom to several dr appointments), and also doing my compliance training.
19:27:23 <relrod> and various stuff as it comes up in -noc
19:27:29 <relrod> nothing special to report this week :(
19:28:04 <smooge> ok.. any other system administrators who want to output status?
19:28:21 <relrod> I'll be working on the FAS php lib thing I was working on a while back, soon. I would like to have a gallery3 module with that soon so we can proceed with that project
19:29:04 <smooge> cool. relrod you may want to check with mizmo as she had soem sort of gallery like program she was looking at recently (I think)
19:29:34 <smooge> skvidal, did you have anything else cloud related or should I skip that topic?
19:29:40 <relrod> smooge: ok, specifically I'm referring to https://fedorahosted.org/fedora-infrastructure/ticket/3533
19:30:01 <skvidal> nirik and I have been discussing the plans for the cloudlets
19:30:18 <smooge> relrod, ah ok
19:30:19 <skvidal> specifically what else we need to declare things production and if we want to continue having 2 cloudlets running different sw
19:30:23 <smooge> #topic Private Cloud status update / discussion
19:30:34 <skvidal> we've been measuring up features/capabilities vs what we need
19:31:04 <skvidal> that's still ongoing and I don't want to speak out about it until things are sure
19:31:52 <smooge> ok no problem
19:32:00 <smooge> #topic Freeze reminder / holidays
19:32:35 <skvidal> here's the reminder. A lot of us are visiting family and on vacation
19:32:38 <skvidal> SO LEAVE EVERYTHING ALONE
19:32:39 <smooge> Ok we are in a freeze for the final release of F18. We are also in a HARD freeze starting Saturday 00:00:00 UTC. That means everything
19:33:40 <skvidal> yes
19:34:08 * mdomsch unplugs the yubikey after last night's fiasco
19:34:14 <mdomsch> btw, yubikey FTW!
19:34:31 <abadger1999> :-)
19:34:52 <mdomsch> doing that with just Google Authenticator would have been painful
19:34:54 <relrod> fwiw I should be around over the holidays (not planning on going anywhere). I won't touch anything, but if anything breaks I should be around to look into it.
19:35:00 <abadger1999> I'll probably be vacationing until after New Years (maybe back on the 3rd or so).
19:35:49 <relrod> Or maybe I'll convert all the python I can to ruby just to spite skvidal. ;)
19:35:50 * relrod kids
19:35:52 <smooge> Changes during the next week are going to need two +1 from sysadmin-main. If you need it, you can page one of us and we will get to reviewing it when we can.. but please really need it.
19:35:53 <abadger1999> May be around close to Christmas
19:36:01 <abadger1999> relrod: just deploy to staging first ;-)
19:36:12 <skvidal> mdomsch: why would it have been painful with GA?
19:36:45 <mdomsch> skvidal: starting sudo run-puppet on each machine so as to get them back up faster
19:37:00 <skvidal> ?
19:37:35 <skvidal> mdomsch: for the future - from lockbox: sudo -i ansible hostname;hostname;hostname;hostname -a "/usr/local/bin/run-puppet nowait"
19:37:49 <mdomsch> sweet
19:38:00 <mdomsch> I was missing that
19:38:11 <smooge> skvidal, I think we need to have a training class on this to help catch up main on the beauty of ansible.. I believe fudcon sounds good?
19:38:11 <mdomsch> at 2:30am EST
19:38:25 <skvidal> I'm planning on a talk for fudcon
19:38:28 <skvidal> mdomsch: sorry
19:38:28 <mdomsch> luckily jds2001 was awake
19:38:45 <mdomsch> skvidal: not your problem to be sorry about - only myself to blame
19:38:45 <skvidal> mdomsch: you could have also run the samething with func
19:39:03 <skvidal> mdomsch: I'm normally up around 2-3am
19:39:13 <skvidal> txting me is the best route to getting my attention
19:39:20 <skvidal> and I think you have my number
19:39:24 <mdomsch> indeed
19:39:52 <mdomsch> lessons at fudcon would be most appreciated
19:40:11 <skvidal> I have some docs already - in the ansible repo - but I'll work on more as time allows
19:40:21 <smooge> #topic Fudcon
19:40:28 <pingou> \ó/
19:40:29 <smooge> which I think leads to this topic?
19:42:31 <smooge> anyone else with Fudcon ideas and such?
19:42:34 <Southern_Gentlem> Have you ever want to get your Amateur Radio License or Upgrade here is your chance at Fudcon Lawrence.For the Second NA Fudcon we are pleased to offer  a ARRL Test Session on Saturday Jan 19th 10am -2PM in Learned Hall University of Kansas
19:42:55 <smooge> cool
19:43:40 <smooge> I barely remember by Charlie Foxtrot from my Tango Sierra.. but sounds like a cool thing to do.
19:44:03 <smooge> thanks Southern_Gentlem
19:44:09 <smooge> ok last set
19:44:12 <smooge> #topic Upcoming Tasks/Items
19:44:12 <smooge> #info 2012-12-11 to 2013-01-08 F18 Final Freeze
19:44:12 <smooge> #info 2012-12-20 colorado RH holiday lunch
19:44:12 <smooge> #info 2012-12-24 to 2013-01-01 Red Hat Shutdown for holidays.
19:44:12 <smooge> #info 2012-01-05 PHX2 outage.
19:44:12 <smooge> #info 2013-01-08 F18 release.
19:44:14 <smooge> #info 2013-01-18 to 2013-01-20 FUDCON Lawrence
19:44:16 <smooge> #info 2013-01-29 f19 feature submission deadline.
19:44:20 <smooge> Anything else?
19:44:40 <smooge> #topic Open Floor
19:44:45 <smooge> OK time to wind this down then
19:44:47 <pingou> on the FUDCon bits
19:44:54 <pingou> I putsome ideas on the wiki page
19:44:54 <smooge> pingou, ok cool
19:44:57 <michealPW> 8th of january for F18?
19:45:13 <pingou> if there is interest, I don't mind to make a session on one of them
19:45:13 <smooge> supposedly.. until they tell me otherwise
19:47:04 <smooge> pingou, ok.. lets focus on that next meeting when vareious people have sobered up etc :)
19:47:12 <pingou> sure thing
19:47:17 <smooge> any other open floor?
19:47:21 <pingou> when is the next meeting ?
19:47:28 <pingou> next week or next year ?
19:47:33 <smooge> pingou, I think it will be a cool idea.
19:47:41 <smooge> NEXT MEETING IS JANUARY 3rd
19:47:47 * pingou won't be here
19:48:00 <smooge> after that will be JANUARY 10
19:48:06 <smooge> ok how about 2 meetings?
19:48:20 <pingou> I'll be there :)
19:48:23 <smooge> and mailing lists (infrastructure)
19:51:38 <smooge> Ok I need to type in the right meeting.. closing in 1 minute.
19:53:16 <smooge> #endmeeting