18:59:25 <smooge> #startmeeting infrastructure
18:59:25 <zodbot> Meeting started Thu Mar 31 18:59:25 2011 UTC.  The chair is smooge. Information about MeetBot at http://wiki.debian.org/MeetBot.
18:59:25 <zodbot> Useful Commands: #action #agreed #halp #info #idea #link #topic.
18:59:31 <smooge> #meetingname infrastructure
18:59:31 <zodbot> The meeting name has been set to 'infrastructure'
18:59:45 <goozbach> beat me to the punch
19:00:03 <hvivani> hi, hvivani is here
19:00:04 <smooge> #chairs goozbach
19:00:13 <smooge> #chair goozbach smooge
19:00:13 <zodbot> Current chairs: goozbach smooge
19:00:16 * skvidal is here - but seth has been in lala land all day
19:00:38 * waltJ lurks
19:00:40 <smooge> skvidal, we switched places. I am in grumpy swearing cuss day
19:00:47 <skvidal> smooge: yay
19:00:52 <cyberbyte> hi, cyberbyte is here
19:00:58 <goozbach> #topic rollcal
19:01:13 * skvidal is here
19:01:24 <smooge> here
19:01:25 * abadger1999 here
19:02:09 <abadger1999> Hey cyberbyte.  welcome.
19:02:59 <cyberbyte> Hi everybody, quick intro again - I joined the infrastructure group a week or so ago and it was suggested to show up on the IRC channels, so here I am. I must admit I’m new to IRC so apologies in advance for any protocol mistakes.
19:02:59 <cyberbyte> I’m a keen Linux administrator professionally and aspire to take my knowledge to the next level, since I work with Enterprise Red Hat 5 and currently using Fedora 14 at home - I think my loyalty will lie here. I do wish to stick around and hopefully contribute something useful in time, but I am new to the Fedora community, I guess we all have to start somewhere.
19:03:00 <cyberbyte> So hello all, my real name is Richard.
19:03:03 <cyberbyte> 
19:03:11 <goozbach> #topic new folks introductions
19:03:23 <goozbach> welcome cyberbyte
19:03:34 <skvidal> cyberbyte: how long have you been an alcoholic?
19:03:35 <skvidal> oh
19:03:35 <skvidal> wait
19:03:37 <skvidal> wrong meeting
19:03:38 <skvidal> sorry
19:04:01 <cyberbyte> nice, although I do have a beer right now
19:04:14 <goozbach> you can bring that here!?
19:04:16 <goozbach> :)
19:04:18 <goozbach> JK
19:04:29 <goozbach> cyberbyte: what would you be most interested in working on?
19:05:10 <cyberbyte> To be honest, I'm not sure yet...
19:05:34 <goozbach> that's just fine
19:05:47 <goozbach> have a read through the getting started guide and hang out in -admin
19:05:57 <goozbach> and you'll be sure to find something
19:06:13 <goozbach> again welcome
19:06:19 <goozbach> #topic beta freeze
19:06:32 <goozbach> or is there anyone else to introduce?
19:07:12 <smooge> ok for beta freeze we will start on Tuesday
19:07:20 <goozbach> beta freeze starts on the 5th
19:07:34 <smooge> I will have a bunch of tickets I will open this afternoon for various parts of the freeze
19:07:34 <goozbach> same drill as every time
19:07:40 <goozbach> right?
19:07:53 <goozbach> couple of +1s on anything which needs to change?
19:08:01 <skvidal> yes
19:08:04 <abadger1999> Right.
19:08:09 <smooge> this freeze is less slushy than last time and 2 +1s needed
19:09:03 * CodeBlock here, completely forgot about meeting day :)
19:09:18 <goozbach> cyberbyte: and any other newer folks
19:09:31 <smooge> the freeze may end the 20th or the next week if we slip
19:09:43 <goozbach> any change that needs to happen has to be seconded (twice) by someone else on the mailing list or IRC
19:09:48 <smooge> this looks like a release with a lot of grease added so I am expecting a slip
19:10:07 <smooge> and any IRC +1 need to be logged by email this time.
19:10:21 <goozbach> ahh yes forgot abt that caveat
19:10:26 <smooge> for people who don't pay attention to IRC because we sleep
19:10:59 <abadger1999> Clarification -- +1s come from sysadmin-main?
19:11:25 <goozbach> is there a SOP for freezes?
19:12:04 <CodeBlock> http://fedoraproject.org/wiki/Release_Infrastructure_SOP#Change_Freeze
19:12:10 <CodeBlock> abadger1999: correct
19:12:48 <goozbach> #info Hard Beta freeze means two +1 approvals needs to come from sysadmin-main or releng http://fedoraproject.org/wiki/Release_Infrastructure_SOP#Change_Freeze
19:12:48 <abadger1999> k sysadmin-main or rel-eng
19:12:59 <goozbach> very good
19:13:12 <goozbach> #topic meeting tickets
19:13:46 <goozbach> anyone have a high-priorty ticket which needs to be discussed
19:14:00 * CodeBlock will give an update on..whichever tha nagios 3 one was
19:14:01 <goozbach> if not I'll pick from my limited knowlege
19:14:01 <smooge> ok I can't remember the ticket for this
19:14:09 <CodeBlock> s/tha/the/
19:14:12 <goozbach> .ticket 2275
19:14:13 <smooge> but pkgs01 is having issues
19:14:14 <zodbot> goozbach: #2275 (Upgrade Nagios) - Fedora Infrastructure - Trac - https://fedorahosted.org/fedora-infrastructure/ticket/2275
19:14:17 <goozbach> CodeBlock: let her rip
19:14:20 <smooge> oh wait sorry
19:14:25 <goozbach> smooge: we'll do that next
19:15:02 <CodeBlock> alright, we tried to do that upgrade, and nagios was set up (and working with the puppet module I created!) but we ran into an issue with zodbot, and supybot-fedora having differences on noc01 than are in the package
19:15:06 <CodeBlock> (local differences)
19:15:22 <CodeBlock> That has been fixed, and post-freeze (probably at the end of my semester) we will try that whole upgrade thing again.
19:15:26 <goozbach> #topic tickets -- nagios (2275)
19:15:39 <goozbach> CodeBlock: so the upgrade was rolled back?
19:15:47 <CodeBlock> goozbach: correct
19:16:11 <CodeBlock> we were close :)
19:16:14 <CodeBlock> just not close enough :)
19:16:41 <goozbach> #info nagios upgrade was rolled back and issues have been addressed, CodeBlock will re-do after freeze is lifted.
19:16:48 <goozbach> that sum it up pretty well?
19:17:04 <CodeBlock> worksforme, no specific date yet
19:17:08 <goozbach> gotcha
19:17:10 <CodeBlock> like I said probably post-semester for me
19:17:15 <goozbach> coolio
19:17:17 <goozbach> anything else?
19:17:26 <CodeBlock> because people don't like doing things on friday's which...current schedule is one of my only free days
19:17:43 <CodeBlock> goozbach: that's it for me
19:18:06 <goozbach> NEXT! -- smooge I don't see a ticket for pkgs01 issues unless it's 2647
19:18:11 <goozbach> .ticket 2647
19:18:12 <zodbot> goozbach: #2647 (pkgs01 remounts /srv/cache/lookaside read-only, preventing uploads.) - Fedora Infrastructure - Trac - https://fedorahosted.org/fedora-infrastructure/ticket/2647
19:18:54 <goozbach> #topic PKGS01 issues (unknown ticket)
19:19:55 <smooge> thats it
19:20:13 <smooge> ok pkgs01 is having issues with the equalogics which is causing problems.
19:20:25 <smooge> like git going apeshit and OOM'ing the box
19:20:30 <goozbach> #topic PKGS01 issues (2647)
19:20:41 <smooge> or uploads puking
19:21:04 <smooge> we aren't sure what the cause is or what the fix will be.
19:21:33 <smooge> so at the moment its basically flail fail
19:21:42 <goozbach> who's running point?
19:21:50 <goozbach> you I assume
19:21:53 <smooge> Dennis has been as its his box
19:22:02 <smooge> no I am working on other items.
19:22:07 <goozbach> ok
19:22:13 <smooge> Kevin is the second person but he isn't here so I am filling in
19:22:17 <goozbach> gotcha
19:23:06 <smooge> at this point keep yours open and if people have iscsi/equallogics ideas send them to them
19:23:40 <goozbach> #info Dennis and Kevin are working on the issue which appears to be with the equalogics and pkgs01, keep your eyes/ears open for iscsi/equalogics help for them
19:23:45 <goozbach> that sum it up well?
19:24:12 <smooge> yes
19:24:23 <smooge> I ahve one other topic when ready
19:24:29 <goozbach> k
19:24:35 <goozbach> meeting ticket?
19:24:38 <goozbach> fire away!
19:24:43 <smooge> new infrastructure leader
19:24:48 <goozbach> ok
19:24:55 <smooge> someone needs to put a ticket for that
19:24:55 <goozbach> #topic new infrastructure leader
19:25:20 <smooge> Ok starting next week Kevin Fenzi (nirik) will be in Red Hat training to become the new infra leader
19:25:39 <smooge> he should be able to start being the big boss in two weeks.
19:26:02 <smooge> I will be retiring to a nice island villa like all temporary despots
19:26:17 <goozbach> #info Congrats to Kevin Fenzi (nirik) which starts training next week to become new infra leader
19:26:36 <goozbach> very cool
19:26:55 <skvidal> goozbach: congrats? Or condolences?
19:26:57 <skvidal> it's a fine line :)
19:27:05 * skvidal is just being silly
19:27:16 <goozbach> skvidal: Congrats because he hasn't actually taken the reins yet
19:27:22 <goozbach> condolences when he actually does
19:27:22 <skvidal> :)
19:27:24 <goozbach> :)
19:27:35 <skvidal> I think good luck covers both cases :)
19:28:22 * goozbach wonders if he's going to have to relinquish his temporary duty as meeting wrangler (not that he's done a stellar job of it)
19:28:22 <smooge> ok that si all I have.
19:28:26 <goozbach> very good
19:28:30 <smooge> probably not
19:28:32 <goozbach> #topic open floor
19:28:45 <goozbach> the way I see it
19:29:01 <goozbach> if I can help remind people of the meetings, and keep them on-topic and on-schedule
19:29:08 <goozbach> it's one less thing the infra-lead has to do
19:29:24 <goozbach> and it's basicly the only thing I can do with my current schedule/workload
19:29:43 <goozbach> does anyone have anything for open floor
19:29:45 <goozbach> ?
19:29:58 <abadger1999> smooge: Re: the pkg01 problems -- if a problem is noticed, do we jsut restore service (like remounting the lookaside cache drive rw) or do we need to preserve some sort of info for debugging?
19:30:01 <goozbach> we'll keep it open for 5 min then close the meeting if not
19:30:23 <smooge> abadger1999, I would say restore service for the time being.
19:30:26 <abadger1999> k
19:30:30 <smooge> From what I can tell there is nothing to debug
19:30:41 <smooge> "Hey look we pooped packets! "
19:30:42 <cyberbyte> Can I track these tickets?
19:30:59 <smooge> Not sure what that means.
19:31:15 <goozbach> cyberbyte: yeah, feel free to follow along with these tickets
19:31:53 <cyberbyte> ok
19:32:50 <goozbach> that's a good way to learn the ropes as well
19:33:45 <smooge> My current tasks are getting insight working, getting systems that are racked working and getting QA moved sometime next month
19:33:51 <cyberbyte> i figured, i'm a support guy at the end of the day, so will follow and try and help out if I can
19:35:00 <goozbach> anything further?
19:35:10 <goozbach> buhler
19:35:13 <goozbach> ?
19:35:16 <goozbach> cool
19:35:21 <goozbach> #endmeeting