19:00:02 <nirik> #startmeeting Infrastructure (2013-01-10)
19:00:02 <zodbot> Meeting started Thu Jan 10 19:00:02 2013 UTC.  The chair is nirik. Information about MeetBot at http://wiki.debian.org/MeetBot.
19:00:02 <zodbot> Useful Commands: #action #agreed #halp #info #idea #link #topic.
19:00:02 <nirik> #meetingname infrastructure
19:00:02 <zodbot> The meeting name has been set to 'infrastructure'
19:00:02 <nirik> #topic welcome all of y'all
19:00:02 <nirik> #chair smooge skvidal CodeBlock ricky nirik abadger1999 lmacken dgilmore mdomsch threebean
19:00:02 <zodbot> Current chairs: CodeBlock abadger1999 dgilmore lmacken mdomsch nirik ricky skvidal smooge threebean
19:00:06 * skvidal is here
19:00:13 * Adran waves
19:00:18 * pingou 
19:00:25 <smooge> here
19:00:46 <relrod> here
19:00:46 * lmacken 
19:00:57 <nirik> welcome everyone.
19:01:08 <nirik> #topic New folks introductions and Apprentice tasks.
19:01:16 <nirik> any new folks? or apprentices with questions?
19:01:34 <Adran> I had a question. Just a second.
19:01:40 * abadger1999 here
19:01:47 <nirik> Adran: sure, fire away. ;)
19:01:51 * Adran fires
19:01:51 * threebean is here :)
19:01:55 * maayke is here
19:02:54 <nirik> good sized crowd today. ;)
19:03:04 <Adran> I've been following the new tickets that have been posted for the last week. I can follow most of them, but I wasn't sure how this one worked. https://fedorahosted.org/fedora-infrastructure/ticket/3618. Do they get services on their own host or is it just added to the existing servers?  If you guys could possibly elaborate not his one a bit, much appreciated.
19:03:24 * nirik looks
19:03:39 <nirik> ah yeah, thats a request for a fedorahosted.org project setup
19:03:52 <nirik> we set those up on hosted01 or hosted02... and they show up at fedorahosted.org :)
19:04:12 <nirik> http://infrastructure.fedoraproject.org/infra/docs/fedorahosted.txt has the process. ;)
19:04:20 <Adran> nirik: Awesome, was just going to ask about that. Thanks!
19:04:52 <nirik> no problem. Thats done by the sysadmin-hosted group, (although I and relrod have just been doing most of them recently)
19:05:09 <nirik> ok, any other questions or new introductions?
19:05:33 <smooge> not me
19:05:35 <mahrud> just in time! I have a quick question
19:05:44 <nirik> mahrud: cool. go for it.
19:05:48 <mahrud> is anybody interested to work with me on the selinux issue?
19:05:55 <mahrud> .ticket 230
19:05:59 <zodbot> mahrud: #230 (SELinux Deployment) – Fedora Infrastructure - https://fedorahosted.org/fedora-infrastructure/ticket/230
19:06:36 <nirik> mahrud: I can try and assist further... although if some other sysadmin-main person would want to help with it, that would be just fine with me. ;)
19:07:14 <mahrud> nirik: thanks but you're also busy with other (and potentially more urgent) stuff.
19:07:26 <smooge> I would like to work on that
19:07:26 <nirik> sure, but it would be nice to get those cleaned up for sure. ;)
19:07:39 <nirik> cool. ;) Sounds good to me smooge.
19:07:43 <mahrud> great!
19:07:55 <nirik> #info smooge to work with mahrud on fixing selinux denials.
19:08:09 <smooge> mahrud, after the meeting we can go over what you need etc help with and where I can pick up any heavy objects
19:08:13 <nirik> any other questions? shall we move on?
19:08:26 <mahrud> smooge: alright
19:08:40 <nirik> #topic Freeze reminder / release tickets
19:08:56 <nirik> so, we are still in deep freeze. The good news is, we have a light at the end of the tunnel now. ;)
19:09:04 <nirik> release will be next tuesday.
19:09:12 <threebean> \o/
19:09:16 <nirik> we have our usual release tickets...
19:09:40 <nirik> .ticket 3612
19:09:44 <zodbot> nirik: #3612 (Fedora18 Final - check mirror sizes) – Fedora Infrastructure - https://fedorahosted.org/fedora-infrastructure/ticket/3612
19:09:47 <nirik> .ticket 3613
19:09:49 <zodbot> nirik: #3613 (Fedora18 Final - check permissions on staged content) – Fedora Infrastructure - https://fedorahosted.org/fedora-infrastructure/ticket/3613
19:09:50 <nirik> .ticket 3614
19:09:52 <nirik> .ticket 3615
19:09:54 <zodbot> nirik: #3614 (Fedora18 Final - release day ticket.) – Fedora Infrastructure - https://fedorahosted.org/fedora-infrastructure/ticket/3614
19:09:57 <zodbot> nirik: #3615 (Fedora18 Final - misc tasks) – Fedora Infrastructure - https://fedorahosted.org/fedora-infrastructure/ticket/3615
19:10:12 <nirik> smooge: did you want to take the first two again?
19:10:20 <smooge> okie dokie
19:10:27 <smooge> will do those after I talk with mahrud
19:10:39 <nirik> ok, we need content staged first. probibly tomorrow.
19:11:01 <nirik> anything else anyone can think of for release that we don't already have in our SOP?
19:11:36 <nirik> ok. One additional thing...
19:12:08 <nirik> freeze is up next wed after release. However, fudcon is coming up right after there... so we might try and be a bit conservative of stuff we push out before everyone is traveling. ;)
19:12:19 <nirik> #topic Applications status / discussion
19:12:30 <nirik> any application devel/maint news this week or upcoming?
19:12:36 * pingou hasn't much
19:12:54 <nirik> I'm still stalled trying to update askbot. ;(
19:13:01 <skvidal> copr testing is coming along nicely so far
19:13:08 <skvidal> we're fixing bugs and pingou is adding features :)
19:13:27 <skvidal> and most important packages are actually being built :)
19:13:27 <nirik> python-longerusernames author never has responded to my emails. :( Not sure where to go from here. I guess I could ask askbot to not use that module or make it optional or something.
19:13:31 <pingou> only 1 ;)
19:13:49 <nirik> skvidal: I hope to throw xfce against it, but keep getting sidetracked. ;)
19:13:57 <skvidal> nirik: EXCUSES!
19:14:15 <relrod> I sort-of started back up on the php-fas thing I was working on. I'm going to start messing around with making the gallery module for it soon and packaging both things up and whatnot.
19:14:16 <threebean> lots of stuff in stg that needs moving to prod post freeze.  I'm still working on that upstream dogpile patch, too.
19:14:46 <nirik> threebean: how much better does this make packages? enough to replace bugz? or not quite yet?
19:15:24 <abadger1999> packagedb and (soon as I get it fixed on rawhide) python-fedora are ready for update.  Shall I update while we're at fudcon?
19:15:31 <threebean> nirik: definitely enough to replace bugs, imho.  But we should have more people look at it.
19:15:37 <threebean> https://apps.stg.fedoraproject.org/packages/dracut/bugs/  <-- for example.
19:15:47 <nirik> sure, might be good to ping those folks who complained
19:15:55 * threebean nods
19:16:03 <nirik> abadger1999: sure, just not while we are all traveling. ;)
19:16:14 <abadger1999> nirik: Sounds good.
19:16:23 <pingou> once the cache is generated it's nice
19:16:27 <abadger1999> threebean: The All bugs link is still exceedingly slow
19:16:47 <pingou> abadger1999: the first time only
19:16:55 <abadger1999> threebean: :-(  And All bugs is not quite right too... "Viewing 1-62 of 63 bugs"
19:17:05 <nirik> it's fast now. ;)
19:17:11 <skvidal> abadger1999: couldn't put all 63 on one page!
19:17:19 <pingou> abadger1999: try another time, I had it to
19:17:19 <threebean> abadger1999: noted.  thanks :)
19:17:21 <skvidal> abadger1999: 62 is okay - but 63 is ludicrous!
19:17:42 <nirik> heh.
19:17:46 <nirik> ok, any other apps news?
19:17:53 <abadger1999> 64 would be plaid :-)
19:17:58 <nirik> #topic Sysadmin status / discussion
19:17:59 * marcdeop is sorry to be late
19:18:06 <nirik> marcdeop: no worries. welcome.
19:18:17 <nirik> ok, not too much sysadminy to report, but a few things.
19:18:33 <abadger1999> threebean: oh, one other enhancement -- can The All Bugs link have a URL?  Like "https://apps.stg.fedoraproject.org/packages/kernel/bugs/All"
19:18:39 <nirik> #info we have our new virthost14, virthost-comm02 and sign-vault03/04 machines installed and online.
19:18:46 <abadger1999> threebean: and.. kernel broke the bug page too.
19:18:47 <nirik> abadger1999: it does already. ;)
19:19:32 <nirik> #info there will be some outages later in jan/feb for storage. Need to determine exactly when.
19:19:36 <abadger1999> nirik: ah.. Just not discoverable?  /me tried "All" and "all"
19:19:45 <nirik> abadger1999: /all should be it.
19:19:57 <threebean> abadger1999: yup, the url should work with "all" -- it did work last time I checked.
19:20:02 <abadger1999> Oops, lost the "bugs" when I tried "all"
19:20:17 <nirik> #info our download-i2 machines are somewhere, might be online soon we hope
19:20:47 <nirik> after fudcon, I'd like to do a few sysadminy things:
19:20:53 <nirik> mass update/reboot cycle
19:21:08 <nirik> rebuild builders. less of them, but more ram
19:21:27 <nirik> perhaps koji hub update if it's ready
19:21:38 <skvidal> nirik: if we're not rebuilding anything else
19:21:48 <skvidal> I can probably rebuild builders following the thaw
19:22:06 <nirik> that would be delightful. I was thinking 6g ram... might let createrepo be happy.
19:22:17 <skvidal> okay - and whatever the divider is for procs?
19:22:18 <nirik> also, we might consider new mock...
19:22:22 <nirik> yeah
19:22:29 <skvidal> nirik: I think we'll get new mock by default, won't we?
19:22:41 <nirik> well, unless we are afraid of it. ;)
19:22:41 <skvidal> simply by reinstall
19:22:46 <nirik> yep
19:22:50 <skvidal> the new mock is in use for coprs now
19:23:11 <nirik> anyhow, those are the short term plans I think I had. We will have more after fudcon I am sure.
19:23:26 <nirik> #topic Private Cloud status update / discussion
19:23:51 <nirik> any cloudy items? I'd like to try and finish moving them to production after fudcon, hopefully we can work out anything left to do that at fudcon
19:24:05 <skvidal> nirik: I'm still trying to figure out why cinder
19:24:10 <skvidal> and the cli are not getting along
19:24:19 <nirik> yeah. not sure.
19:24:21 <skvidal> at this point I'm less convinced it is a config error
19:24:26 <skvidal> and starting to think it might just be broken
19:24:36 <nirik> just a plain old folsom (blues) bug?
19:24:50 <skvidal> nirik: yes
19:25:04 <nirik> ok.
19:25:11 <nirik> we can figure something out.
19:25:21 <nirik> #topic Fudcon
19:25:25 <pingou> \ó/
19:25:27 <nirik> ok, fudcon is coming up. ;)
19:25:52 <nirik> one thought is that perhaps we could do a session with a bunch of folks demoing various cool infra things we have or are working on.
19:26:08 <smooge> that would be good
19:26:27 <nirik> would anyone be willing to lead such a session? I'm already signed up to do 2, so not sure if me doing it would be good. ;)
19:26:43 <nirik> how many things do we have and who would be willing to demo them?
19:27:10 <skvidal> what's a demo look like, too?
19:27:31 <skvidal> 'hey look, here's this server that's running silently'
19:27:35 <nirik> yeah, some things are hard to show visually.
19:27:35 <skvidal> 'look, I'll do it again'
19:27:40 <skvidal> 'there'
19:27:40 <pingou> fedocal, packages, tagger, hyperkitty, easyfix (?), status (?), jenkins (?)
19:27:43 <skvidal> 'there it goes'
19:28:04 <pingou> fedmsg/busmon ?
19:28:05 <smooge> skvidal, I think ansible workship
19:28:07 <threebean> apps.fp.o, busmon
19:28:15 <skvidal> smooge: I have that in the list now
19:28:27 <skvidal> smooge: I may just steal the slides from another ansibler
19:28:28 <threebean> easyfix, status, and jenkins <- definitely.
19:28:28 <smooge> would be a good demo. I cant tell if I meant workshop or worship
19:28:30 <skvidal> b/c his are better
19:28:49 <nirik> How about: apps demo first, then each person next comes up and clicks on their app to demo it from the apps interface? :)
19:28:51 <skvidal> smooge: potayto potahto
19:29:10 <threebean> nirik: cool :)
19:29:17 <pingou> nirik: apps demo as in apps.fp.o demo ?
19:29:20 * pingou like it
19:29:21 <nirik> yeah
19:30:01 <pingou> threebean: jenkins might be tough to demo atm
19:30:07 <threebean> what about 2fa?  can someone demo and talk about that?
19:30:29 <nirik> threebean: sure, I could.
19:30:33 <skvidal> threebean: we could play the google 2fa video
19:30:37 <skvidal> and say 'there, that, but for us'
19:30:44 <skvidal> 'and w/yubikeys too'
19:30:44 <nirik> :)
19:30:55 <threebean> skvidal: sounds great :P
19:31:09 <skvidal> threebean: but the dude doing the 2fa video for google has weird hair
19:31:31 <smooge> I will get a wig and pantomime it?
19:31:34 <nirik> so, we need: someone to pitch/lead this, and come up with a specific list of people/things they are demoing...
19:31:35 <threebean> "and we don't have weird hair.  That, too."
19:31:40 <skvidal> not that it is bad - I just want hair...
19:31:49 <relrod> ha
19:31:53 * nirik could try and make his hair into a mohawk, I hear those are the rage these days. ;)
19:31:57 <smooge> nirik, I can maestro.
19:32:08 <skvidal> nirik: might be best to see who actually shows up
19:32:09 <smooge> if someone else doesn't
19:32:21 <nirik> smooge: cool.
19:32:27 <skvidal> nirik: despite the weather reports I suspect snomg! will hit all of the US
19:32:37 <skvidal> since it is fudcon afterall
19:32:42 <nirik> skvidal: yeah, true, but might be nice to know how much time each thing can get, etc.
19:32:45 <skvidal> it wouldn't be fudcon w/o being stranded in an airport
19:32:52 <nirik> smooge: you want to sign it up on the wiki for us?
19:33:29 <nirik> we can coordinate more on the list out of the meeting.
19:33:34 <pingou> skvidal: you're just being optimistic
19:33:43 <abadger1999> smooge: I can pitch it too if you want.
19:33:49 * abadger1999 doesn't care
19:33:54 <skvidal> pingou: statistically accurate ;)
19:34:01 <nirik> any other fudcon ideas or items?
19:34:01 <pingou> smooge: abadger1999 I can help too
19:34:08 <abadger1999> excellent
19:34:22 <pingou> I had the idea of doing something similar but more what's for the future type
19:34:29 <smooge> oke dokie
19:34:36 <pingou> so less demos and more discussion on where we want to go
19:34:45 * abadger1999 woulod like that personally
19:34:49 <smooge> I was thinking this was more a workshop than a fud
19:34:55 <nirik> pingou: perhaps we could do that also toward the end?
19:35:16 <smooge> I think that some of our stuff is going to have to happen whether or not it gets up voted by other attendees
19:35:18 <nirik> well, demoing what we have now seems like a fine tech talk session to me... it's more presenting
19:35:39 <nirik> talking about stuff we want to do, etc is more workshop/interactive.
19:35:43 <nirik> but it could go either way
19:35:45 <pingou> nirik: fine for me of course
19:35:50 <abadger1999> I always have these ideas for great discussion items that seem to fit more with the spirit of hte hackfest but we never get enough 'round 'tuits to get to them...
19:36:02 <pingou> nirik: +1, one is demo, the other more interactive
19:36:24 <nirik> I'd really like to try and get everyone together saturday morning at the start of hackfests for a higher level discussion/planning session...
19:36:34 <pingou> abadger1999: I think I have two, I can bring them if you like ;-)
19:36:48 <nirik> ie, so we can tell folks what we want to work on/when, and get everyone intersted to be able to try and do so
19:36:53 <abadger1999> pingou: Cool ;-)
19:37:11 <nirik> but no idea if that will work out. ;)
19:37:25 <abadger1999> nirik: wfm.  Do you know when the fesco meeting is planned?
19:37:45 <nirik> not sure.
19:38:39 <abadger1999> thats the only other known thing I have this fudcon. (oh... nad future of features if that's a separate fesco + everyone discussion) :-(
19:38:41 <nirik> so are we going to have remote audio/video this time? I wonder if we could try just for grins doing hangouts of our talks...
19:38:45 <threebean> pretty excited for that discussion, fwiw.
19:38:56 <nirik> abadger1999: yeah, thats friday sometime, I think both of them are.
19:39:24 <abadger1999> nirik: Cool.  If that all gets done Friday (Hah!) then we'll have the rest of the time free for infrastructure :-)
19:39:37 <skvidal> nirik: would it be worth updating the fi service map I drew a while back?
19:39:41 <nirik> yeah, and/or pulling in 12 directions. ;)
19:39:41 <skvidal> nirik: to show where things are?
19:39:56 <nirik> skvidal: yeah, I think that could be useful to several discussions...
19:40:17 <skvidal> nirik: okay  -I'll see about cleaning it up and making it current
19:40:49 <nirik> sadly, I fear it's not changed too much for the better.
19:40:57 <skvidal> nirik: I think it has some
19:40:59 <skvidal> 1. fas
19:41:00 <abadger1999> oh -- smooge you wanted to do an epel discussion too...
19:41:01 <skvidal> 2. 2fa
19:41:08 <abadger1999> that probably will involve a few of us as well.
19:41:19 <skvidal> 3. movement away from more things tightly bound to each other
19:41:20 <nirik> abadger1999 / smooge: I signed up to run that already. ;)
19:41:27 <abadger1999> okay cool.
19:41:28 <skvidal> 4. decoupling the publictest systems
19:41:35 <skvidal> 5. replication of hosted*
19:41:36 <nirik> skvidal: true.
19:41:40 <skvidal> nirik: I think we've made progress
19:41:44 <nirik> so some progress.
19:41:45 <skvidal> nirik: but I think we have a lot more to go
19:41:47 <smooge> abadger1999, like I said that would not be a presentation more of a workshop. It has to get done whether or not it gets upvoted :)
19:41:49 <nirik> yep. always.
19:42:11 <nirik> smooge: right. if it gets no timeslot/interest on friday, we can do it as a hackfest sat/sun.
19:42:24 <abadger1999> smooge: <nod> -- I'm just trying to figure out what our hackfest time is going to look like :-/
19:43:19 <nirik> yeah.
19:43:34 <nirik> like I said, I hope we can decide some of it sat morning. whatever didn't get solved friday. ;)
19:43:44 * skvidal would like to remind all of the folks who have some level of root access to bring  hand sanitizer and facemasks
19:43:49 <skvidal> we cannot all be sick at the same time
19:44:07 <smooge> ooh I wonder where I can get facemasks
19:44:14 <skvidal> smooge: almost every drug store
19:44:19 <nirik> are you bringing large hamster ball/bubbles for us all to roll around in? ;)
19:44:26 <skvidal> nirik: if only I could
19:44:30 <smooge> skvidal, I was thinking more germwarfare level mask
19:44:35 <skvidal> smooge: :)
19:45:09 <nirik> #topic Upcoming Tasks/Items
19:45:15 <nirik> #info 2012-12-11 to 2013-01-15 F18 Final Freeze
19:45:15 <nirik> #info 2013-01-15 F18 release.
19:45:15 <nirik> #info 2013-01-18 to 2013-01-20 FUDCON Lawrence
19:45:15 <nirik> #info 2013-01-29 f19 feature submission deadline.
19:45:27 <nirik> anything anyone wants to schedule or note?
19:45:43 <smooge> http://www.amazon.com/Military-Surplus-Czech-M10M-Mask/dp/B00447KBK4/ref=sr_1_4?ie=UTF8&qid=1357847093&sr=8-4&keywords=gas+mask I am not sure I could get it on the plane even checked :)
19:45:56 <nirik> I'm sure we will have a bunch of things to add after fudcon. ;)
19:46:22 <nirik> oh, I did a blog on what I wanted to get done at fudcon, others might consider likewise... drum up more excitement. ;)
19:46:26 <abadger1999> threebean: packagedb update first day of hackfest work for you?
19:46:34 <nirik> smooge: nice!
19:47:28 <abadger1999> nirik: I'll do a packagedb update in prod on the 19th if it works for threebean.
19:47:31 <threebean> abadger1999: stg to prod?  definitely :)
19:47:32 <nirik> and blog posts / etc while at fudcon are nice too. ;)
19:47:46 <nirik> abadger1999: works for me.
19:48:05 <abadger1999> nirik: assuming I get python-fedora onto stg today, you can put a stg => prod update of that on the 19th as well.
19:48:18 <nirik> ok
19:49:01 <nirik> #topic Open Floor
19:49:24 <nirik> anyone have any items for open floor? questions, comments, anti-bacterial soap brands?
19:49:25 <smooge> ok status of hardware
19:49:45 <smooge> 1) sign-vault boxes have initial instlal. Need testing and rebuild  + ansible stuff
19:50:05 <smooge> 2) virthost14 is built so we can add more stuff to it.
19:50:26 <nirik> yeah, related to that, I would like to discuss at fudcon policy for our 'high security' boxes.
19:50:26 <smooge> 3) virthost-comm02 for arm koji and stuff is built.
19:50:50 <skvidal> nirik: +1
19:50:59 <nirik> thanks for building all those smooge. :)
19:51:22 <smooge> 4) arm boxes are waiting for parts from China to be shipped to UK, rebuilt, shipped to BOston, rebuilt and then shipped to PHX2.
19:51:37 <smooge> they will get there after Fudcon
19:52:00 <smooge> 5) need to order memory for various systems.. will do later today/tomorrow.
19:52:18 <nirik> I'm going to talk to arm folks at fudcon also about us using some of the SOC's for infra... or looking at getting another one for us. I think it would be great to run some things on arm if we can help testing it in a real env.
19:52:30 <smooge> nirik, no problem. the UCS boxes are so much faster and nicer than the IBM's.. even if I have to use flash to configure them
19:52:44 <abadger1999> nirik: SOC?
19:52:50 <nirik> yeah, I think I agree... the big test will be dealing with their service. ;)
19:53:04 <nirik> abadger1999: system on a chip.
19:53:10 <abadger1999> Cool.
19:53:17 <nirik> basically the servers are a bunch of SOC's...
19:53:38 <nirik> 24 (or was it 32) per 2u
19:53:52 <nirik> each with their own cpus/mem/disk
19:53:54 <relrod> huh, neat
19:54:08 <nirik> well, disk might be shared, not sure.
19:54:19 <nirik> anyhow, there should also be one at fudcon for us to look at in person. :)
19:54:24 <smooge> cpus mem.. I am not sure if they have disks
19:55:06 <nirik> of course us using them for infra things means we would be using Fedora... so something to keep in mind update and such wise.
19:55:17 <nirik> anyhow, anything else? or shall we call it a meeting?
19:56:12 <nirik> ok, will close out in a minute if nothing else. ;)
19:56:55 <nirik> thanks for coming everyone!
19:56:56 <smooge> not me
19:57:12 <nirik> Oh wait.
19:57:17 <nirik> One final thing...
19:57:27 <smooge> Oh dear he is pulling a steve jobs
19:57:28 <nirik> many of us are traveling next thursday to fudcon.
19:57:35 <nirik> So, I am going to say no meeting next week. ;)
19:57:37 <smooge> Here comes the Fedora Phone
19:57:44 <nirik> but if someone else wants to run one, feel free I guess.
19:58:05 <threebean> cool :)
19:58:22 <nirik> #endmeeting