20:00:35 #startmeeting Infrastructure 20:00:35 Meeting started Thu Nov 19 20:00:35 2009 UTC. The chair is mmcgrath. Information about MeetBot at http://wiki.debian.org/MeetBot. 20:00:35 Useful Commands: #action #agreed #halp #info #idea #link #topic. 20:00:37 #topic Who's here? 20:00:39 * ricky 20:00:40 yo 20:00:43 yo 20:00:45 helo 20:01:02 is the NFR conf call supposed to be streamed and recorded? 20:01:30 jcollie: no idea, is that mechanism all working? 20:01:47 * nirik is hanging around in the back. 20:01:49 mmcgrath: should be 20:01:59 * a-k is around 20:02:03 Ok, lets get started. 20:02:11 #topic F12 20:02:14 .tiny https://fedorahosted.org/fedora-infrastructure/report/9 20:02:14 mmcgrath: http://tinyurl.com/5onzad 20:02:19 lets go through what hasn't been closed yet 20:02:20 .1787 20:02:25 that's me, I'll close it now 20:02:36 .ticket 1787 20:02:37 mmcgrath: #1787 (Change Freeze) - Fedora Infrastructure - Trac - https://fedorahosted.org/fedora-infrastructure/ticket/1787 20:02:38 .ticket 1788 20:02:40 mmcgrath: #1788 (Websites) - Fedora Infrastructure - Trac - https://fedorahosted.org/fedora-infrastructure/ticket/1788 20:02:41 * ricky closes all of the websites ones 20:02:44 k 20:02:50 Oops, they already were :-) 20:02:52 * sijis is here.. 20:02:54 .ticket 1790 20:02:55 mmcgrath: #1790 (Verify RELENG permissions) - Fedora Infrastructure - Trac - https://fedorahosted.org/fedora-infrastructure/ticket/1790 20:03:00 * josemm is here 20:03:10 smooge mentioned he might be a little late to the meeting today but that one's him and I'm sure it's fine. 20:03:14 .ticket 1796 20:03:15 mmcgrath: #1796 (Disable wiki caching) - Fedora Infrastructure - Trac - https://fedorahosted.org/fedora-infrastructure/ticket/1796 20:03:25 I'll do it now 20:03:28 .ticket 1794 20:03:29 mmcgrath: #1794 (Lessons Learned) - Fedora Infrastructure - Trac - https://fedorahosted.org/fedora-infrastructure/ticket/1794 20:03:33 And the last one, lessons learned. 20:03:37 what did we learn this release? 20:03:40 what did and didn't go well? 20:03:43 egooms is here just a little slow 20:03:53 * abadger1999 shows up 20:04:04 sixxs is not allowing uploads. i checked yesterday 20:04:11 I think the number of mirrors we had at release time was quite good, sat at 85% for a long time 20:04:19 sijis: yeah I saw your note on that on release day, what's the deal? 20:04:21 so i couldn't add the torrents for ipv6 folks 20:04:31 the bitflip still caught some mirrors by surprise 20:04:35 yeah, i dunno, i posted a message on the forum and i haven't heard back. 20:04:36 even though I had told them about it beforehand 20:04:48 someone wanted a reminder that they should run report_mirror after manually bitflipping 20:05:09 before the bitflip, we had ~160 mirrors checked in and ready with ISOs 20:05:17 smooge: just checking if 1790 is done 20:05:21 having rsync of everything available was a huge win, IMO 20:05:56 right after the bitflip, we had ~17 ready, up to almost 100 within a few hours, and by today, we're at about 140 20:06:04 mmcgrath, closing right now 20:06:06 mdomsch: 'caught some mirrors by surprise' was it a pretty big problem or just general murmurings? 20:06:15 mmcgrath, general 20:06:32 which is an improvement off the old days :) 20:06:32 our emails aren't necessarily high priority 20:06:32 yeah 20:06:42 nirik: were you hanging out in #fedora on release day? How'd the mirrors hold out? 20:06:52 were people having problems getting to isos? 20:07:02 sijis: they have never allowed uploads 20:07:04 EvilBob: how about you? 20:07:07 also, we didn't have mirrors.*.kernel.org for several hours on release day due to their DNS breakage 20:07:12 * mmcgrath should have been in there but forgot. 20:07:12 sijis: they allow you to recommend a torrent 20:07:15 mmcgrath: things were good. 20:07:21 dgilmore: that's what i meant. :| 20:07:22 opening up the mirrors/torrents early really helped. 20:07:30 mmcgrath: not that I noticed 20:07:40 posting a link to the torrent 20:07:48 EvilBob: nirik: k, thanks 20:08:01 sijis: it's possible next release we'll have our own ipv6 torrent so that step might not be so important :) 20:08:11 yeah, my torrent seeded got pounded right after the announcement 20:08:19 One thing I wanted to note was the night before the release and the various problems nirik and I had with the torrent system. 20:08:32 but it was hard to say for sure if it was really a problem or just torrent behaving as it should. 20:08:34 s/seeded/seeder/ 20:08:42 nirik: how'd your seeders hold up on actual release day? 20:08:44 jcollie: mine did too 20:08:58 http://fpaste.org/tGQj/ shows in text the pre-bitflip (first 3) to post-bitflip hourly count of mirrors w/ ISOs, as MM knew it 20:09:12 my torrents couldn't talk to the tracker at all when I got up. I wasn't seeding. ;( 20:09:21 I switched over to transmission and everything came up ok. 20:09:23 i'm just glad i put a rate limit on 20:09:39 mdomsch: interesting 20:09:47 i enabled DHT on my seeder, hopefully that helped 20:09:55 nirik: so perhaps rtorrent is teh suck? :( 20:10:09 yeah, on epel at least. ;( it works fine in fedora, so not sure whats going on there. ;( 20:10:14 I guess I should file a bug on it. 20:10:26 20:10:33 i was using rtorrent on F12, i think it's much newer so hopefully fewer bugs 20:10:57 In general though, things went like clock work. 20:11:00 oh, there was one odd thing 20:11:03 stickster: you there? 20:11:16 What happened with the announcement? Did someone approve it or are you on some auto-approver list? 20:11:36 * mdomsch seeded at max for a while, has dropped off quite a bit by now 20:12:12 * mmcgrath assumes mr stickster is a bit busy at the moment. 20:12:21 mdomsch: yeah same here, I actually closed most of my seeders. 20:12:30 Does anyone have anything else related to the release they'd like to discuss? 20:12:42 mmcgrath: Right, it auto-approved for some reaso 20:12:45 *reason 20:12:53 Maybe because I'm on the list of owners/moderators? 20:13:04 stickster: I'm officially under the opinion that relying on moderation is not a good thing :) 20:13:06 In any case, I put both my emails on the "auto-hold" list now 20:13:24 So nothing I post should go straight through any more, as a check measure 20:13:35 Thankfully I had checked all the links, and didn't post it until almost right at the appointed time. 20:13:36 Ok, if no one has anything else we'll move on to the next topic 20:13:54 #topic Fedora 13 - Jesse's Girl. 20:13:57 * ricky notes that we should all keep a good eye on the webmaster@ queue 20:14:12 So what do we want to see in F13 for infrastructure? 20:14:28 I have a couple of big wants 20:14:30 ah man we need to name the release that 20:14:33 1) a global search engine 20:14:41 2) a proper CDN. 20:14:41 +1 20:15:03 and probably a few other things I'm forgetting at the moment. 20:15:09 what do others want to be working on for this release? 20:15:12 Packagedb-0.5 w/ tags for yum and critpath markings for bodhi, releng. 20:15:18 oh, 3) finalize alt.fp.o, secondary.fp.o, etc. 20:15:41 4) death to the term cloud 20:15:42 is there any F/OSS CDN software? i've never gone looking 20:15:44 MM push mechanism, maybe using qpid 20:15:45 but that's a bit out of scope :) 20:15:56 * lmacken rolls in late 20:16:07 jcollie: I've been talking on various mailing lists, it seems almost everyone rolls their own 20:16:11 and they do it with geiop 20:16:14 amqp server that's receiving notifications from cvs and maybe a notification server working off of those messages to replace the cvs syncmail script. 20:16:15 Geo DNS sounds cool :-) 20:16:33 mdomsch: BTW, remember that "have central servers redirect to us1.fedoraproject.org, de1.fedoraproject.org, etc idea? 20:16:48 Someone mentioned on another list that it does horrible things to search engines and page rank. 20:16:50 mmcgrath, yes... 20:17:06 looks like everyone in almost every case is using geoip so I see no reason we shouldn't continue down that road. 20:17:22 geoip and not geodns 20:17:29 err sorry, geodns 20:17:38 ok 20:17:46 I guess I kind of group those into the same technology but they're really not are they? 20:17:55 pretty much everyone I know has tried something else at one point and then just went with geoip after some flameout 20:17:56 similar, but at different levels 20:18:01 abadger1999: self service cvs requests? :) 20:18:06 hmm does BIND do geodns now? iirc the powerdns stuff looked icky to me 20:18:16 jcollie, yes, warthog9 wrote a patch for it 20:18:16 jcollie: it doesn't yet 20:18:20 wikipedia uses pdns for what it's worth 20:18:20 not natively anyway 20:18:21 nirik: Yeah, But not for 0.5.0; maybe 0.5.1. 20:18:29 And it has a backend that takes bind-like zonefiles too 20:18:30 everyone else uses pdns 20:18:52 centos uses pdns 20:18:56 nirik: I'm sorry, about the btw, it's pretty simple so I keep tossing it at new people but they keep tossing it back. It must have the kiss of death or something. 20:19:10 does powerdns do dnssec too? i'd rather not go backwards on that front 20:19:11 smooge: oh, that's good to know. Do you know who's primarly in charge of it? z00dax or Evolution? 20:19:15 abadger1999: no worries. Would be nice tho. 20:19:19 jcollie: my understanding is yes. 20:19:32 jcollie: but we'll have to verify that. 20:19:44 I think it was Johnny at one point, but it may have moved to Evolution. 20:19:58 * mmcgrath will ping those guys and find out. 20:19:59 I didn't ask to be blessed to the level of knowing. 20:20:14 Anyone have any other infrastructure technologies they'd like to see? 20:20:18 #help 20:20:29 #idea global search engine 20:20:38 #idea proper CDN probably with geodns and pdns 20:20:45 #idea finalization of the new primary mirror 20:20:49 #idea message bus 20:21:03 #idea MM messaging of some kind 20:21:06 #idea cloud replacement 20:21:13 :) 20:21:19 am I forgetting anything? 20:21:29 #idea pkgdb w/ tags and critpath 20:21:29 lmacken: do you guys have any major milestones to have done for this release wrt fcommunity? 20:21:38 #idea insight (probably very soon here) 20:21:54 Zikula for docs would be awesome :-) 20:21:58 do we wanna go down the road of replacing CVS with ??? for packages? or leave that to rel-eng to figure out 20:21:59 #idea notification server (amqp => email) 20:21:59 mmcgrath: ideally AMQP integration... hooks into our services and live widgets to expose them 20:22:08 20:22:18 #idea fedoracommunity AMQP integration with widgets 20:22:41 jcollie: actually I believe there's goign to be a talk of that at fudcon 20:22:42 ftalk front end in fedoracommunity? 20:22:52 jcollie: I saw a 'talk' branch in git that ian was hacking on 20:22:53 I'm new here but if You are still using cvs its quite easy to swith to svn from it 20:22:56 but I'm not sure if it'll make it for F13, maybe F14 20:23:12 pitr: we've discussed that in the past, what you gain by doing that is questionable. 20:23:26 people are generally looking to improve workflow, not just the technology on the back end. 20:23:32 pitr: Yeah... but the only people who want to move are people who want dvcs so we'll either stick w/ cvs or go dvcs. 20:23:52 rewrite of all infrastructure in go? 20:24:04 hg and git are the leading candidates, but it's kind of a religious question at this point 20:24:14 is go the new javascript? 20:24:16 :-) 20:24:39 smooge: go ftw! 20:24:44 the few samples of go code i have seen so far are about as pretty as perl code 20:25:02 abadger1999, only after its been made into a plugin 20:25:30 Ok, does anyone have anything else on this topic? If not we'll move on to the next topic 20:25:44 abadger1999, I thinks it going to be just someone will have to be a villain and say its X. so sorry 20:25:50 mmcgrath: id like to try work on updating koji auth/ and notifications during F-13 life cycle 20:26:05 PKI would be nice too :-) 20:26:06 #idea updating koji auth and notifications 20:26:17 #idea pki (ricky says he'll do this and it'll be done by january) 20:26:19 :-P 20:26:20 * ricky runs 20:26:36 #idea further streamling and full integration of secondary arches 20:26:36 Ok, next topic then 20:26:44 #topic Search Engine 20:26:46 a-k: hit me! 20:26:54 #link http://fedoraproject.org/wiki/Infrastructure/Search 20:26:58 <|pitr|> heh - I lost connection - it seams that ath9k dev's still have things to do ;) 20:27:04 mmcgrath: i have a bunch of dogtag packages to review on the pki side of things 20:27:10 huzaifas and I were thinking we'd have candidates to try out on a PT server in January 20:27:25 Nothing has blown us away yet, but we should have worked through most of the candidates by then 20:27:36 If I can make Apache Solr work, it sounds really nice from the docs 20:27:47 We'll have a better handle on specific PT requirements by January 20:28:01 I think that's about it. 20:28:09 dgilmore: yeah I forgot about that. 20:28:27 a-k: thanks for the update. 20:28:30 pki? 20:28:43 sorry.. will talk off chan 20:28:47 smooge: yeah our pki right now is very... ehh manual 20:28:59 and not fun to manage :) 20:29:10 Ok, and I think that's really all I had for the meeting 20:29:13 #topic Open Floor 20:29:19 anyone have anything they'd like to discuss? 20:29:25 any new members want to make themselves known? 20:29:30 our first real f-talk meeting is under way... 20:29:31 smooge: public key infrastructure 20:29:39 jcollie: its going ok 20:29:41 <|pitr|> I'm new 20:30:10 |pitr|: Welcome. What would you like to do? 20:30:12 :-) 20:30:14 hi |pitr| welcome to Sysadmins Anonymous 20:30:18 <|pitr|> I've sent email 3 days ago on fedora-infrastructure 20:30:50 Welcome! 20:31:00 <|pitr|> I'm not quite sure yet 20:31:23 <|pitr|> I wor as a some kind sysadmin at r&d department of my company 20:31:40 <|pitr|> I'm good at troubleshooting 20:32:03 |pitr|: have you seen - https://fedorahosted.org/fedora-infrastructure/report/1 20:32:09 it has a good list of things we're currently working on. 20:32:22 <|pitr|> right now I'm reading what I can find and trying to follow the discusion 20:32:37 <|pitr|> no 20:33:16 |pitr|: well welcome, also do hang out in #fedora-admin, that's the business end of the group :) 20:33:47 <|pitr|> thx 20:33:53 Ok, if no one has anything else to discuss we'll close the meeting in 30s. 20:34:49 alrighty! 20:34:51 #endmeeting