18:02:19 #startmeeting Infrastructure (2014-05-15) 18:02:19 Meeting started Thu May 15 18:02:19 2014 UTC. The chair is nirik. Information about MeetBot at http://wiki.debian.org/MeetBot. 18:02:19 Useful Commands: #action #agreed #halp #info #idea #link #topic. 18:02:19 #meetingname infrastructure 18:02:19 The meeting name has been set to 'infrastructure' 18:02:20 #topic welcome my friends 18:02:20 #chair smooge relrod nirik abadger1999 lmacken dgilmore mdomsch threebean pingou puiterwijk 18:02:20 Current chairs: abadger1999 dgilmore lmacken mdomsch nirik pingou puiterwijk relrod smooge threebean 18:02:24 * threebean 18:02:30 * lmacken 18:02:32 * pingou 18:02:36 * relrod 18:02:39 Greetings 18:02:42 hi 18:02:55 * tflink 18:03:02 hey y'all..... 18:03:03 * bwood09 is here 18:03:11 * nirik waves to everyone 18:03:14 * mpduty1 is present 18:03:28 #topic New folks introductions and Apprentice tasks 18:03:35 any new folks want to introduce themselves? 18:03:43 or apprentices with comments, questions or ideas? ;) 18:03:49 I'll say hi 18:04:00 MIchael Haynes here. Software developer from southern Alabama (US) looking to apply my dev skills to whatever I can while learning some new things that are hopefully related to networking and security. See my mailing list note for more info. 18:04:29 welcome mhaynes. :) Are you more interested in sysadmin or application development, or both? 18:04:51 Sysadmin.. been writing code for years as a daily job and want to expand my horizons 18:05:07 Also, I'd like to note: There was no May apprentice update email. I was gone on vacation and forgot about it... so we are just going to skip may and there will be one for june. ;) 18:05:24 mhaynes: great. See me in #fedora-admin after the meeting and I can add you to our apprentice program. 18:05:37 Thanks nirik 18:05:45 one of the new apprentices here...... with an idea for a new project that I've discussed (briefly) with nirik. 18:05:54 In last week's meeting, someone brought up the idea of a pictoral landscape of FP.... so after some thought (and trying to figure out what I can do here), I decided that I'd bite. I'm already doing something similar for my paying job (but for some Lotus Domino servers). 18:06:00 Nagios has a map page, but FP has too many servers for a clear picture of FP's landscape. I looked at a couple of the docs in http://infrastructure.fedoraproject.org/infra/docs as a place to get started from. 18:06:32 ootbro: it seems like a fine plan to me. ;) A nice overview and map type thing would be nice... 18:07:31 I haven't settled on final product form. I was thinking of .png, but realized a .pdf might be better -- I can add links to it. 18:08:07 yeah... it would be nice also to have it easy to modify as things change. 18:08:23 (not that they do all that often) 18:08:39 but no IT system is static, so change is expected 18:08:49 yep. very true. 18:09:06 #info no may fi-apprentice status update email, look for one in june. 18:09:26 * webpigeon late 18:09:26 #info ootbro to work on map/landscape/overview of infra architecture. 18:09:42 anything else for apprentices or new folks ? 18:09:46 I'll post the idea to the mailing list, too, for feedback 18:09:51 (done) 18:10:17 ootbro: great. Do ask when you run into questions on things... happy to help you out. 18:10:32 #topic Applications status / discussion 18:10:33 nirik: many thanks for the offer. 18:10:42 #info pkgdb2 is now in production. Hurray! 18:11:01 yay! 18:11:11 \ó/ 18:11:32 nice team effort to get it deployed :) 18:11:43 a bit of interaction issues we didn't expect... ;( but we overcame them 18:12:20 yeah, it was a long day ;) 18:12:25 there's only a few things left on app servers. I am really looking forward to moving the last bits off there and nuking them. ;) 18:13:11 there is still few outstanding issues, but we're slowly getting there :) 18:13:12 any other application news from the last week or upcoming? 18:13:33 pingou: one I noticed (need to file a ticket on) is that the email doesn't contain all the info for changes. 18:13:43 * pingou building pkgdb-cli 2.2 18:13:59 ie, email has: 18:14:01 user: kevin set acl: approveacls of package: incron from: Awaiting Review to: Approved on branch: master 18:14:07 nirik: someone also asked why we still send email, the original idea being to rely on FMN 18:14:15 but doesn't say _who_ I approved acls for 18:14:25 nirik: I'll fix this, thanks 18:14:37 well, I'd still like the scm-commits cc 18:14:41 it's nice as a record. 18:14:45 but I guess we have datanommer 18:14:58 threebean: could we create a fake account on FMN? 18:15:00 so perhaps we could drop it. 18:15:12 pingou: if you can create a fake account in fas, then yes. 18:15:22 nirik: would that be a solution? 18:15:39 +1 fake fas account for scm-commits 18:15:39 we could... just mark it 'bot' so it doesn't allow resetting, etc 18:15:41 I guess one admin of the list would have to do i :) 18:15:47 it* 18:16:15 right now that list allows *@fedoraproject.org I think, so we would need to moderate password emails or just make it direct in the db 18:16:57 anyhow, we don't need to decide this now, we can figure it out. 18:17:25 relrod: have you had a chance to work on the process git requests/epel7 scripts? where are we with those? 18:17:30 * Daredel is late 18:17:41 * nirik waves to Daredel 18:17:45 nirik: I have a patch started for those, it still needs work 18:18:01 https://gist.github.com/CodeBlock/b6f9020a3f129a29f5c8 is what I have so far. 18:18:32 ok. would be good to get those soon... the spice^Wnew packages must flow. 18:19:06 I have some questions for pingou regarding it - will ping after meeting 18:19:08 #info a few pkgdb2 issues outstanding, working on them 18:19:13 cool. thanks. 18:19:20 anything else application wise? 18:19:31 #topic Sysadmin status / discussion 18:19:42 lets see... on the sysadmin side... 18:19:54 #info reinstalled all our old blade servers as koji buildhw builders. 18:20:10 (one of them is hosed, but I put in a ticket to have someone on site pull it out and try and reset it) 18:20:31 relrod: me or limburgher 18:21:07 I updated all stg hosts and rebooted them monday, but there's another kernel update out soon I suspect, so holding off on updating production... 18:21:11 but we might do it next week. 18:21:16 pingou: you ;) 18:21:42 #info reinstalled fas02 as x86_64 with more memory 18:21:53 (hopefully this fixes some fasClient run timeouts we have been seeing lately) 18:22:11 nirik: nice :) 18:22:27 smooge and I will be heading out to our main datacenter next month or month after (not fully scheduled yet) 18:23:05 #topic nagios/alerts recap 18:23:17 I have a ugly url... 18:23:20 does this work for folks: 18:23:23 https://admin.fedoraproject.org/nagios/cgi-bin//summary.cgi?report=1&displaytype=3&timeperiod=last7days&smon=5&sday=1&syear=2014&shour=0&smin=0&ssec=0&emon=5&eday=15&eyear=2014&ehour=24&emin=0&esec=0&hostgroup=all&servicegroup=all&host=all&alerttypes=3&statetypes=2&hoststates=3&servicestates=56&limit=50 18:23:30 http://is.gd/1i0Eqe 18:23:44 those are the top 50 alert producers in the last week. 18:23:53 Plans are to rebuild the cloud.. arm the illudium Q-36 explosive space modulator.. and figure out quantum mechanics 18:23:55 most of them can be explained. 18:24:14 retrace should get fixed by new machines we have on order. 18:24:32 the telia01 ones are just network issues. ;( 18:24:48 the "check fedmsg consumers" ones keep hitting socket timeout. not sure why, but I increased the timeout today to see if it makes a difference. 18:24:59 the tummy01 ones at the bottom are a tummy01 network outage that was pretty short 18:25:19 the fas02 ones hopefully are solved by my repaving it. 18:25:34 the pkgdb ones are related to the pkgdb2 roll out 18:26:05 so, hopefully next week we look a good deal better. ;) 18:26:50 #topic Upcoming Tasks/Items 18:26:52 https://apps.fedoraproject.org/calendar/list/infrastructure/ 18:27:00 anyone have upcoming items they would like to note or schedule? 18:27:10 #info our bodhi2/taskotron fad is coming up! 18:27:15 \ó/ 18:27:16 :) 18:27:24 anything we need to discuss on it? or are we pretty set ? 18:27:48 if we have flight arival times I can see about trying to pick up folks at the airport? 18:28:23 I can do some pickups on sunday, but I won't have a car on monday 18:28:27 yeah, the flight arrival times on the wiki should be correct 18:29:04 as far as logistics, I think we're good. Hopefully everyone will have a dev environment setup ahead of time :) 18:29:20 In other news, the fedorahosted guidelines I sent out a week or two ago are almost finished with the revisions; should I pass it around another time? If not, what should I do next? 18:29:42 gather statistics :) 18:29:50 ok, I can look at the times and see when I might be able to pick up folks. I think tflink also said he could pick up some people. 18:30:23 bwood09: yeah, some stats might be good... and/or you could run it by the list again for a final lookover. 18:30:43 Define stats. What specifically should I collect? 18:31:01 I'll do the stats and final look simultaneously. 18:31:45 bwood09: how many projects are concerned by the rules you're proposing 18:31:48 bwood09: well, how many projects would be affected, etc? 18:31:59 yeah, I'm willing and able to do airport pickups 18:32:11 bwood09: how many projects have not updated their trac index page, do not use their git, their mailing list... 18:32:14 Got it. Should I start taking a look at implementation as well? 18:32:33 Making a plan, etc 18:33:03 sure. ;) 18:33:31 #topic Open Floor 18:33:56 anyone have items for open floor? questions, comments, ideas, favorate soft drink? 18:34:38 Raspberry Coca Cola is REALLY goof 18:34:41 Good* 18:34:52 * nirik hasn't even seen that before. 18:35:00 yeah. that's news :P 18:35:06 Ii 18:35:08 Oo 18:35:16 From those freestyle machines in Firehouse and Checkers/Rally's? 18:35:42 apprentice here, still trying to familiarize with all the things... 18:35:56 bwood09: will keep an eye out, but I haven't ever seen it here. ;( 18:36:21 Daredel: I'm in the same boat, which is why I decided to go with the FP landscape :) 18:37:25 yeah, there's a lot to take in. ;) 18:38:10 Yeah, I have a lot to read myself. So much I don't know about things at the moment. 18:38:20 not english native speaker, so not sure what do u refer with "FP landscape" 18:38:52 Fedora Project 18:38:56 Daredel: ootbro is going to work on a diagram/map/overview of fedora infrastructure setup 18:38:56 Daredel: no problem.... "FP landscape" is the FedoraProject.org architectrual picture 18:39:12 ohhh 18:39:15 nice 18:39:45 well i'm lookig for things to work on. so i can try to help 18:39:46 I'm still trying to learn the landscape and I figure this will help all the newbies get up to speed 18:40:56 i have looked at the easyfix but don't feel like prepared enough to solve one 18:41:05 Well, I just got a phone call from Nintendo 18:41:13 I'm an official Wii U developer now 18:41:15 DareDel: look for my e-mail on the mailing list -- it'll have my e-mail address for direct contact 18:41:16 So that's fun 18:41:20 bwood09: alright. ;) 18:41:22 Awesome bwood 18:41:26 bwood09: congrats :D 18:41:49 ok, if nothing else will close out in a minute... and we can all continue over in #fedora-admin, #fedora-noc and #fedora-apps. 18:42:38 Thanks for coming everyone! 18:42:41 #endmeeting