17:59:59 <nirik> #startmeeting Infrastructure (2012-05-31)
17:59:59 <zodbot> Meeting started Thu May 31 17:59:59 2012 UTC.  The chair is nirik. Information about MeetBot at http://wiki.debian.org/MeetBot.
17:59:59 <zodbot> Useful Commands: #action #agreed #halp #info #idea #link #topic.
18:00:00 <nirik> #meetingname infrastructure
18:00:00 <nirik> #topic Robot Roll Call
18:00:00 <nirik> #chair smooge skvidal CodeBlock ricky nirik abadger1999 lmacken dgilmore mdomsch threebean
18:00:00 <zodbot> The meeting name has been set to 'infrastructure'
18:00:00 <zodbot> Current chairs: CodeBlock abadger1999 dgilmore lmacken mdomsch nirik ricky skvidal smooge threebean
18:00:18 * mdomsch lurks
18:00:32 * threebean is here
18:00:33 <dgilmore> gday
18:00:34 * abadger1999 here
18:01:02 * skvidal is here but is not very responsive atm
18:01:10 <cuppsy> Here.
18:02:04 <nirik> ok, lets go ahead and dive on in then...
18:02:07 <nirik> #topic New folks introductions and Apprentice tasks.
18:02:07 <nirik> If any new folks want to give a quick one line bio or any apprentices
18:02:07 <nirik> would like to ask general questions, they can do so here.
18:02:10 <nirik> anyone?
18:02:17 <ssmoogen> here
18:02:24 <ssmoogen> but not new
18:02:37 <nirik> :)
18:02:53 <nirik> ok, moving along then...
18:02:58 <nirik> #topic two factor auth status
18:03:15 <nirik> I suspect no new news on this this week... it's been very busy with the release and other issues.
18:03:34 * jds2001 sorta here
18:03:57 <skvidal> none
18:03:58 <skvidal> next
18:04:06 <nirik> #topic Applications status / discussion
18:04:26 <nirik> abadger1999 / pingou / threebean / relrod / anyone else working on applications.
18:04:26 * mdomsch got s3-mirror-us-west-1 functional yesterday
18:04:28 <nirik> any news?
18:04:39 <nirik> mdomsch: oh yeah. cool. So both are synced up now?
18:04:51 <mdomsch> and have started syncing s3-mirror-us-west-2 (oregon) last night
18:05:14 <mdomsch> nirik: yes
18:05:21 <nirik> how many regions are there? lots?
18:05:41 <mdomsch> bapp02 pushes to both in parallel, will push to west-2 in parallel too once it's synced
18:05:55 <nirik> how many do we want to end up supporting?
18:06:05 <nirik> I guess if they are mostly in sync it's not very costly to do
18:06:07 <mdomsch> https://fedoraproject.org/wiki/Cloud_images
18:06:25 <mdomsch> 7 regions total right now we have EC2 images in
18:06:38 * marcdeop present!
18:06:46 <mdomsch> The mirror is ~300GB, one for each region
18:06:47 <skvidal> mdomsch: wait - when did we start west-2 syncing?
18:06:47 <nirik> cool.
18:06:49 <mdomsch> once I get there
18:07:11 <mdomsch> skvidal: last night, but, it's doing S3->S3 copying, not touching our infra except to issue the HTTP command to start the copy
18:07:22 <skvidal> mdomsch: hmmm.....
18:07:22 <skvidal> ok
18:08:06 <threebean> I'm ready to start trying to deploy tagger+fedmsg to stg and I have some pieces ready, but I think I'm going to need a sponsor to update the FI repo.
18:08:29 <nirik> threebean: I can help with that...
18:08:42 <nirik> it's been crazy... but hopefully things will calm down now.
18:08:46 <threebean> nirik: ok.  it seemed pretty busy this morning.  :)
18:09:19 <nirik> yeah, sadly.
18:10:02 <nirik> ok, any other application news?
18:10:46 <nirik> oh, one more thing to mention that was mentioned on the mailing list:
18:11:00 <nirik> we are considering looking at switching gitweb-caching to cgit.
18:11:15 <nirik> thats sort of in the 'how difficult will this be' stage.
18:11:54 <nirik> so, more feedback welcome on list.
18:12:00 <nirik> #topic Upcoming Tasks/Items
18:12:10 <nirik> #info 2012-06-01 - nag fi-apprentices.
18:12:10 <nirik> #info 2011-06-03 - gitweb-cache removal day.
18:12:10 <nirik> #info 2012-06-04 - class B reboots?
18:12:10 <nirik> #info 2012-06-05 - class A reboots?
18:12:10 <nirik> #info 2012-06-08 OOW: osuosl01.fedoraproject.org
18:12:10 <nirik> #info 2012-06-17 OOW: sign-vault02.phx2.fedoraproject.org
18:12:12 <nirik> #info 2012-06-21 to 2012-07-04 Kevin is off on trains and boats.
18:12:14 <nirik> #info 2012-06-26 Fedora 15 end of life.
18:12:20 <nirik> oh, thats old.
18:12:24 * nirik sighs.
18:12:36 <jds2001> nirik: i think we looked at cgit before moving to gitweb-caching
18:12:38 <nirik> I wanted to move reboots out a week
18:12:38 <skvidal> 2012-06-28 - seth at jury duty
18:12:41 <nirik> 2012-06-13 - class B reboots?
18:12:41 <nirik> 2012-06-14 - class A reboots?
18:13:09 <nirik> skvidal: added.
18:13:12 <nirik> jds2001: yeah?
18:13:13 <abadger1999> Moving to fas-db today ?
18:13:19 <nirik> any other things we want to schedule or note?
18:13:20 <abadger1999> if things have settled down :-)
18:13:32 <skvidal> abadger1999: I'm fine with doing that, I think - if you're up
18:13:36 <jds2001> nirik: and the gitweb caching performs *so* much better than the non-caching one. I don't know if you recall but we routinely had load averages of 300+ on hosted.
18:13:39 <abadger1999> skvidal: Let's do it.
18:13:58 <nirik> jds2001: cgit does do caching... git.gnome.org uses it.
18:14:15 <nirik> abadger1999 / skvidal: what time? can you guys make an outage ticket and announce it?
18:14:16 <jds2001> nirik: i think the main issue was link breakage.
18:14:17 <abadger1999> skvidal: How about 4:00 or 5:00PM Eastern time?
18:14:19 <nirik> or would you like me to?
18:14:25 <skvidal> abadger1999: 2hours
18:14:26 <nirik> jds2001: yeah, thats the biggie. ;(
18:14:28 <skvidal> nirik: yes, please
18:14:30 <jds2001> but if we're cool with that....
18:14:33 <abadger1999> skvidal: That works for me.
18:14:37 <abadger1999> 2 hours it is
18:14:45 * abadger1999 writes up outage ticket and announcement
18:14:51 <nirik> abadger1999: thanks.
18:15:26 <nirik> #info There will be a short fedora account system outage later today at 20UTC... to move database servers.
18:16:09 <nirik> anything else upcoming?
18:16:55 <ssmoogen> hosted lists to hosted-lists01
18:17:08 <nirik> ssmoogen: oh yeah, when would be good to schedule that?
18:17:10 <ssmoogen> next week I am hoping if we get this all working well
18:17:11 <nirik> next week?
18:17:35 <ssmoogen> if I am spending all night long up with pager like eeryone else then it will wait til that is over
18:18:01 <nirik> ok, we can pick a day monday or something. we should really try and announce in advance if possible.
18:18:23 <nirik> #topic Open Floor
18:18:29 <nirik> Anyone have anything for open floor?
18:18:43 <ssmoogen> June 6th 20:00 UTC.
18:18:57 <nirik> ssmoogen: for lists move? sure.
18:19:17 <ssmoogen> yes. that shoudl give us room to do things
18:19:22 <ssmoogen> early in the week
18:19:39 <nirik> ssmoogen: you want to file an outage ticket and announce, or would you like me to?
18:19:52 <ssmoogen> will do so in a short while
18:20:23 <nirik> cool.
18:20:40 <nirik> #info 2012-06-06 20UTC for lists.fedorahosted.org move
18:21:12 <nirik> ok, anything else from anyone?
18:22:07 * nirik listens to the crickets.
18:22:10 <threebean> :)
18:22:13 <nirik> will close out the meeting in a minute or so
18:22:26 * marcdeop wishes could do more
18:22:49 <nirik> marcdeop: I have pending that ticket you worked on... ;) Just need to stop having outages and stuff so I can commit it. ;)
18:23:15 <marcdeop> no problem nirik, it's not an urgent thing. I understand the priority chane ;)
18:23:21 <nirik> yeah...
18:23:28 <nirik> hopefully we will get back to nice and quiet soon.
18:23:37 <nirik> ok, thanks for coming everyone!
18:23:39 * skvidal isn't going to hld his breath
18:23:44 <nirik> #endmeeting