20:00:56 #startmeeting 20:01:08 #topic Infrastructure -- Who's here? 20:01:08 * mchua here 20:01:27 * mmcgrath is here 20:01:28 * sijis is here 20:01:28 here 20:01:29 * tmz watches 20:01:31 * jpwdsm is here 20:01:47 * ricky 20:02:04 * abadger1999 here 20:02:24 Ok, lets jump right in to it then 20:02:32 #topic Infrastructure -- Alpha Release 20:02:39 The alpha release is next week 20:02:52 Lets go over these tickets and make sure things are all good 20:03:01 https://fedorahosted.org/fedora-infrastructure/report/9 20:03:03 .ticket 1608 20:03:18 I talked with Jesse yesterday and it seems we're good on space. 20:03:23 I'll re-verify today though. 20:03:29 .ticket 1607 20:03:32 ricky: you on this one? 20:03:49 I can help out with that ricky. 20:03:54 Yup, tmz has been working on branching and getting F12 keys up 20:04:10 ricky: tmz: will one of you accept that ticket so it goes to assigned? 20:04:18 And I'll be getting some new contributors on making get-prerelease and checking URLs so that other people know what to do during the release 20:04:27 * SmootherFrOgZ is around 20:04:30 I'll accept it and CC web-members 20:04:35 k 20:04:45 ricky: tmz: that'll all be ready in time for the alpha? 20:04:48 ricky: i'm available to help too. 20:04:51 Yup 20:05:35 k 20:05:37 sijis: Thanks - I'll get a list of tasks documented on the wiki soon 20:05:42 .ticket 1609 20:05:47 This is just the release day tracker ticket. 20:05:53 .ticket 1610 20:06:05 SmootherFrOgZ: you've done this in the past, want to do it again? 20:06:38 if not I'll grab it. 20:06:41 Oxf13: you around? 20:07:14 I'll go ahead and accept this 20:07:14 mmcgrath: sure 20:07:16 jwb: you around? 20:07:26 oh good 20:07:31 SmootherFrOgZ: would you mind accepting that ticket? 20:07:37 no problem 20:07:45 follow up with releng and see if the bits are already staged, they might be. 20:08:02 next 20:08:09 .ticket 1611 20:08:22 mdomsch: ? 20:08:42 mmcgrath, I probably need to do those 20:08:50 I haven't looked at what redirects are in place yet 20:08:53 * mdomsch takes it 20:08:58 k 20:09:02 mdomsch: you da man, thanks 20:09:06 .ticket 1612 20:09:22 The change freeze is in affect. I did mess up and start it later then normal but that's ok because we slipped. 20:09:26 and last 20:09:29 .ticket 1613 20:09:36 that's not something we have to do until after the release. 20:09:50 Ok, so does anyone have any outstanding concerns about the release from an Infrastructure point of view? 20:10:17 allrighty. 20:10:26 So the next thing on the list is to talk about Smooge's recent trip 20:10:33 #topic Infrastructure -- The Smooginator 20:10:35 smooge: you around? 20:10:39 * mmcgrath notes he might be faxing right now 20:11:09 I am 20:11:13 faxing right now 20:11:21 smooge: should we come back to you? :) 20:11:58 we'll get back to the smooge :) 20:12:22 #topic Infrastructure -- Alt/network issues 20:12:30 so it seems we're having some network issues downloading from PHX. 20:12:44 sorry give me 5 minutes.. I am using up all my upload speed 20:12:50 I've contacted the network team in charge of all of that, they did some similar tests and have at least been able to reproduce the 1MB/s download speed. 20:12:54 ah crap did I mess soemthing up? 20:12:59 which is an order of magnitude slower then what we see elsewhere. 20:13:14 Nothing real interesting there. 20:13:24 smooge: Highly doubtful. 20:13:34 it's reproducable to all of our hosts in PHX. 20:13:42 and we're seeing other oddities related to port speeds. 20:13:55 for example iptraf shows 1M transfers on port 80 but 70M transfers on port 8080 20:14:06 sounds like QoS misconfiguration but I've been told it's not being used. 20:14:09 ok.. I was noticing that getting stuff off of puppet1 last night was about 4mb/s 20:14:13 in the colo 20:14:22 smooge: 4Mbps or MBps? 20:14:34 hmmm whatever scp says 20:14:40 20:14:41 I think its MBps 20:14:43 * mmcgrath will look. 20:14:50 either eay, it's not the speeds I think we should be seeing. 20:14:57 That's really all there is on that. 20:15:01 #topic Infrastructure -- Zikula 20:15:05 rsync died completely with a stall so I switched to scp 20:15:06 mchua: around?> 20:15:13 smooge: yeah I've seen that too. 20:15:16 smooge: I've seen stalled scps to puppet1 too 20:15:30 mchua: yes. 20:15:34 ergh, mmcgrath yes. 20:15:48 mchua: want to talk about the zikula install you're wanting us to get up and going? 20:15:59 .ticket 1615 20:16:03 That'd be it. 20:16:21 that's for https://fedoraproject.org/wiki/Fedora_Insight 20:16:25 mchua: who it's for, what you're wanting to do with it, etc 20:16:46 it's a Marketing project, the user audience is going to be folks who aren't yet Fedora contributors. 20:17:04 so the various marketing materials we usually pump out for each release - dev interviews, feature profiles, etc. 20:17:27 will all be there for journalists, users, etc. to go to, and for Ambassadors to grab from, and for the NDN to pump things to newspapers from. 20:17:53 we've got an ambitious schedule, we want to have this up for beta so that Ambassadors can use it when they start turning the big PR wheel. 20:18:01 * mchua posts schedule to wiki 20:18:46 currently we have an instance up on pt6 20:18:59 http://publictest6.fedoraproject.org/zikula/ 20:19:05 mchua: and is http://fedoraproject.org/insight/ a good location for you or would you prefer insight.fedoraproject.org/zikula/ ? 20:19:09 schedule is here: https://fedoraproject.org/wiki/Fedora_Insight#Schedule 20:19:21 mmcgrath: fp.o/insight, with a redirect to that from insight.fp.o, would be great. 20:19:33 coolz, we can certainly do that. 20:19:36 (no "zikula" needed in URL.) 20:19:58 mmcgrath: any other info you were looking for? 20:20:11 mchua: not at the moment. 20:20:24 mchua: you have anything else? 20:20:36 mmcgrath: huge thank you to you and tmz and ricky for all the patience + advice + help so far. 20:20:36 that's it. 20:21:19 well, don't thank us yet. We're not done :) 20:21:24 Ok. 20:21:32 smooge: you done faxing? 20:21:40 yes 20:21:48 #topic Infrastructure -- The Smooginator 20:21:55 smooge: tell us a bit about your trip, what you did, etc. 20:22:00 I have come back 20:22:32 Ok I arrived on site on Monday and worked Jonathan Pickard on getting some hardware moved out of racks and new stuff put in 20:22:49 Hardware wise, xen4 is gone from the rack. 20:23:07 backup1 went from a 2950 to an IBM x3650 20:23:20 and the tape storage is now an LTO-4 with a full box of tapes on it. 20:23:45 I went through and labeled backup1 and sign-vault1 and looked at the various wiring and other problems. 20:24:03 Did our total backup capacity go up then (as in can we afford to keep more at a time for example?) 20:24:14 I also toured the new racks at PHX2 which was like being in geek heaven 20:24:22 ricky: it would have doubled. 20:24:23 Our total should have more than doubled 20:24:50 Nice - will we be editing the retention periods in bacula, or are there other plans for that space? 20:24:57 the LTO-4 are 800 GB tapes and we have 22 tapes when we had 20 good tapes before 20:25:12 I think we will be keeping the bacula the same at the moment. 20:25:36 the current retention was too much for the old tapes from the amount of purging we did 20:25:37 ricky: that space is already long taken up I think :) 20:25:41 by /mnt/koji. 20:25:53 Hehe 20:25:53 /mnt/koij == teh suck 20:26:03 it will need 2 weeks to gauge how we look next 20:26:06 smooge: anyway, thanks for going out and doing that. 20:26:24 the wiring at PHX1 is abysmal and we are way over power in one rack 20:26:45 smooge: yeah, the thing that sucks about the power is we were kind of forced into that. 20:26:50 I was hoping to put in some extra 1 U PDU's for some boxes but didnt have time in the end 20:26:51 you saw the other rack where we only have one pdu? 20:26:56 yes. 20:27:02 hopefully moving to PHX2 will help correct all of this. 20:27:13 I think what we should look at doing is sending all our new hardware to PHX2 and work out a storage plan for there. 20:27:37 Then we will work out how we will do a transfer of old hardware. 20:27:43 there's already a plan to move stuff over but I've never been given a timeline yet. 20:27:49 nor how long we'll have to do it. 20:27:53 Finally I saw our pile of delapidated hardware.. it was uhm impressive 20:27:55 I think most of our stuff can go over in small segments. 20:28:09 but some stuff, like the buildsys, might have to go over in one swoop. 20:28:27 I would like to have the guys RHIT are using to wire things at PHX2 for our stuff. 20:28:27 Do we have enough space reserved in PHX2 already? Cool 20:28:31 it was so pretty 20:28:33 though the blade center is EOLed as of next year so we might just be able to purchase a new thing. 20:28:35 it made me cry 20:28:39 smooge: you nkow RHIT wired PHX1 too right? :) 20:28:46 different RHIT people 20:28:51 heheheh yeah 20:28:55 jonathan does good work there. 20:29:21 Well, I'll schedule a meeting and see what timeline we're looking at now. 20:29:27 Hopefully sooner then later. 20:29:28 The wiring and power at the other places is very clear on how much we are oging to put in a cage at a time. 20:29:32 i also hear the PHX2 network stuff is far superior 20:29:46 20:29:47 we wont be putting as much in which will allow us to deal with power maximums better 20:29:55 smooge: have anything else? 20:30:15 I will be writing up a report and passing it by people by tomorrow 20:30:29 coolz. 20:30:46 Ok, with that I'll open the floor 20:30:51 #topic Infrastructure -- Open Floor 20:30:56 anyone have anything they'd like to discuss? 20:31:16 Welcome to jpwdsm - he's working on FAS OpenID - some of you may have seen the hosting request 20:31:20 I'd like to introduce myself 20:31:26 jpwdsm: please do 20:31:30 jpwdsm: Welcome! 20:31:38 I'm Jason Walsh, new member of sysadmin sponsored by ricky 20:31:59 hopefully I'll be helping out with infrastructure's web apps, and as ricky said working on FAS + OpenID 20:32:07 that's exiting 20:32:20 it'll be nice to get the OpenID stuff finalized 20:32:47 He's working in a pylons app for now, which we can either move into FAS later, or run separately if FAS doesn't get TG2 or Pylons-ified by then :-) 20:33:20 TG1 did lead to some special pain with OpenID though which is why I didn't think it was worth it to put much more effort into that bit 20:33:37 ah 20:33:57 (Particularly dealing with getting non-TG-modified request parameters and the poor framework for sessions which we might have hacked around somewhat) 20:34:41 Anyway, thanks jpwdsm for taking this up - it's been on the back burner for a looong while :-) 20:35:03 jpwdsm: excellent 20:35:09 Ok, anyone have anything else they'd like to discuss? 20:35:21 mmcgrath: Relicensing or not. 20:35:29 abadger1999: take it 20:35:52 mmcgrath: So while you were gone, I think we ironed out all the wrinkles except stagin/publictest. 20:36:12 ricky and I have two different ideas of how we could implement staging/publictest to comply. 20:36:12 is the problem still doing development on public facing hosts? 20:36:16 yep. 20:36:29 if the problem is config files, could we make everything a config file? 20:36:45 Sorry I was busy looking at a house 20:36:46 back now 20:37:11 heh :-) config files aren't a problem but making everything a config file would mean why do we license at all :-) 20:37:24 Oxf13: no worries, just wanted to know if the alpha bits are staged or still in progress. 20:37:33 staged on the mirror, about to be opened to other mirrors 20:37:36 abadger1999: so what are the two ideas? 20:37:40 So myidea is to close off access to staging and publictest to everyone except sysadmin and select others that we allow in. 20:37:40 er on the master mirror 20:37:43 Oxf13: excellent 20:37:44 I'm still staging things to the torrent system 20:38:18 staging can be done via mod_pgsql on the proxys, publictest could be handled by mod_auth_pam on the publictest machine itself. 20:39:00 ricky's idea is to make those people who have AGPL apps responsible for keeping the source requirement met at all times. 20:39:04 and what's our gain to switch? 20:39:15 just code sharing? 20:39:29 mmcgrath: essentially. No one can take the code private. 20:39:41 mmcgrath: It's the reason I like the GPL extended to web services. 20:40:24 Right now, any of our web services could be taken private since the code wouldn't be distributed, just the service. 20:40:26 well, I have no more opinion on this subject now then I did a month ago so. 20:40:31 20:40:37 abadger1999: if you have something in mind you'd like to do, lets just do it. 20:40:43 or wait, what was ricky's opinion on it? 20:40:50 or did you two agree on the test/staging implementation? 20:40:58 I would like to see a mixture of the two approaches 20:41:36 I just don't like testers/users on publictest/staging have to deal with auth 100% for the sake of AGPL compliance 20:41:47 **having 20:41:55 If a person HAS to have open access in staging, they (the service owner) are on the hook for complying with the letter and spirit of the AGPL. If they don't want to, we will provide a nice password protected area for them 20:42:17 Especially when we have staging pulling from an outdated FAS db and publictest using mod_auth_pam which is downright restrictive for non-sysadmin-test testers 20:42:36 I think it's time for a decision. But I would like you to leave it for you to decide. I like the AGPL, but there's definitely costs associated with it. If you don't think the benefit is worthwhile, we shouldn't switch. 20:43:23 smooge, ricky: The one part of that is that we're contemplating switching all the web services we've written over to it. 20:43:49 * XulWork has an AGPL package 20:43:54 So we'd be inconveniencing fas, pkgdb, elections, bodhi, etc development by making it something that the individuals have to manage. 20:44:08 Err.. I guess that was more for ricky than for smooge :-) 20:44:49 Given that our applications are already open source and hosted publicly (fedorahosted) 20:44:53 Are most of our apps in risk of other people running them and not sharing the improvements? 20:44:57 smooge: i'd rather set it up so that if you are AGPL, you must be in an account protected area. if you're using another license that's fine. 20:44:59 I think that we would need to revisit a lot of different areas of roll out on what environment gets what access etc. It happens for any project as it grows :) 20:45:11 mdomsch: but it makes things such more a pain in the ass 20:45:19 hell, I did work on smolt just last night that is now out of compliance. 20:45:20 mmcgrath, right, AGPL does make it a PITA 20:45:26 I'm not sure how much the AGPL brings for highly Fedora-specific apps like FAS and pkgdb and bodhi 20:45:29 what if the pt web services/apps are populated from an scm only? the source would be available. and any chagnes to pt has to be through a scm. 20:45:29 so the question is, what's the huge benefit? 20:45:48 mdomsch: just that we get to let legal tell us what to do and live with the consequences and like it 20:45:51 someone could take FAS, pkgdb, bodhi code, run it themselves 20:45:54 ricky: Well, fas is being used outside fedora. 20:45:57 and not contribute back to the mainline projects 20:46:17 abadger1999: and you're in favor of the AGPL? 20:46:32 compared to the GPL for our web apps? 20:46:33 so, the benefit is "forcing others to give us the changes they make to our code" 20:46:37 ricky: And packagedb hasbeen considered -- but the present architecture is pretty fedora0centric. I think by winter release we'll have some features that people will either want to run it themselves, or copy the features, though. 20:46:50 mdomsch: I think so. 20:47:01 I imagine FAS would be slightly less attractive to rpmfusion if we put the AGPL on them too - they have patches that are highly specific to them :-) 20:47:08 mmcgrath: I'm in favor of it on the basis of the benefits. But I'm not as able to judge the costs as you. 20:47:28 Although I doubt they'd stop using it over stuff like this. 20:47:31 ricky: what about you, whats your opinion. Lean more towards AGPL or GPL? 20:47:40 mdomsch, I don't see it as they are forced to give it back. Its on us to ask them for their changes. If we don't know that Bobs plumbing is using AGPL-FAS their changes will not be put in our tree 20:47:50 I'm leaning more towards GPL because I don't see us as being at risk of what the AGPL is protecting us from 20:47:59 For something like moksha it's more in the air for me. 20:48:04 SmootherFrOgZ: What do you think of that? Would AGPL compliance make fas less attractive to you? 20:48:27 (As long as not everybody else has to deal with extra publictest/staging restrictions due to it) 20:48:29 smooge: whats your opinion. Do you like the GPL or AGPL for our apps better? 20:48:42 our web apps. 20:49:57 my opinion is that I like the IDEA behind the AGPL. I am not sure how the details of it being implemented will affect us 20:49:58 elections is not very tied to fedora. 20:50:03 :-) 20:50:13 well, private patches must not upstreamed IIRC - even with AGPL. 20:50:29 but IANAL, spot is the legal guy ;) 20:50:29 abadger1999: as i'm working with upstream, not really 20:50:37 my opinion is tied to the fact that all of the questions and issues we keep bringing up are the same that I remember from 1992 and people licensing or not with GPL 20:50:43 speaking of elections, the Sugar Labs guys will be trying to deploy FAS and our elections app soon. 20:50:52 not sure if they contacted any of you guys yet 20:50:55 Coool. 20:51:08 * ricky likes getting extra incentive to make FAS better. 20:51:09 rsc, any patches need to be made avilable under the agpl 20:51:15 even when testing 20:51:15 lmacken: haven't heard from him, hopefully he's interested in converting it to TG though :) 20:51:26 oh, elections isn't TG? /me thought it was 20:51:29 will elections ever support something other than the bane of my existence method? 20:51:31 * ricky has started vaguely dreaming about a TG2/Pylons version... 20:51:33 lmacken: It is 20:51:36 lmacken: I thought it wasn't 20:51:39 ricky: is it? 20:51:42 ok my bad then :) 20:51:48 lmacken: hopefully he's interested in converting it to TG2 :) 20:51:50 LinuxCode: uh, the FSFE has not identical thinking about when I got a lawyer correctly. 20:51:53 heh :) 20:52:09 rsc, well redhat legal is quite adamont 20:52:18 LinuxCode: who cares about the US? ;) 20:52:20 abadger1999: ok, well. Based on what I'm hearing from everyone there's not an overwhelming urge here. Lots of meh's and question marks. I say for now we toe the line. 20:52:29 rsc: heh -- it might depend on definitions of "testing" and "private". 20:52:31 abadger1999: if something changes later, we can always change later. 20:53:09 mmcgrath: Sure. Sounds good -- I'd like for us to license under GPLv2+ then, just like the proposal for our regular scripts. 20:53:09 LinuxCode: the interesting point comes up, if upstream explicitly refuses your patch :) 20:53:10 rsc, red hat does 20:53:15 lots of the questions have been answered really, there's a few implementation details left. But I just don't see the pro's as outweigning the cons. 20:53:16 mmcgrath, abadger1999 in the end, I would like us to deploy moksha, deal with the kinks, relicense next, deal with the kinks etc 20:53:18 abadger1999: that sounds good to me. 20:53:26 rsc, that is besides the point 20:53:28 LinuxCode: which causes less discomfort to RPM Fusion... 20:53:31 Cool. 20:53:34 smooge: yeah, moksha's already deployed. 20:53:36 you must make patches available 20:53:48 mmcgrath: The tangent that comes up is how do we want to deal with moksha/community? 20:53:50 mmcgrath, I know.. we are in deal with he kinks stage. 20:53:54 we're all far better educated on this whole process, abadger1999, spot, lmacken thanks for that. 20:53:59 mmcgrath: partially... the messaging components of moksha aren't out yet, since we don't have an AMQP broker 20:54:03 On staging/publictest, I'd like developers to handle their own patch posting 20:54:17 (partially, regarding moksha's deployment) 20:54:20 lmacken: hell even I've got plans for that broker, lets get it out :) 20:54:22 mmcgrath: production is fine. But we can't deal with it in staging and publictest without some sort of policy or change to the environment. 20:54:26 So on publictest, perhaps set the footer link to a directory publictestx.fedoraproject.org/mokshapatches with patches 20:54:30 mmcgrath: yeah, I'm down. 20:54:41 abadger1999: well, we can write an AGPL sop for when we're dealing with AGPL code. 20:54:59 On staging, they can do the ticket thing if those changes are going to make it into master soon, or commit those changes in git while they work (remind me if that's valid again? :-)) 20:55:00 abadger1999: which may just be a strict "rpm release only" model? 20:55:23 mmcgrath: yeah -- it might be -- that limits the use case for publictest significantly, though. 20:55:34 abadger1999: or, alternatively, just not have it publically accessable during tests. 20:55:47 via your password protected setup. 20:55:49 mmcgrath: Right. 20:55:49 I think mod_auth_pam limits it even more - I think the public part of publictest is very valuable 20:56:06 Ah, they could do that if they can live with limited public testing too :-) 20:56:16 well, it doesn't mean we can't use agpl stuff in pt, it just means that if we do, it has to match upstream by the time we allow others to use it. 20:56:42 hell, we could even script some sort of rpm -qV thing that puts a lock on the app if it's not matching 20:56:47 Yep. Okay, so I guess an AGPL SOP with discussion is the next thing I'll write up. 20:56:54 abadger1999: yeah 20:57:05 In the meantime, I'll update the tickets for people to update code to GPLv2+. 20:57:06 abadger1999: yep, thx 20:57:20 abadger1999: thanks 20:57:24 Excellent. 20:58:12 Ok, we're nearing the end of the meeting. 20:58:17 anyone have anything else they'd like to discuss? 20:58:46 not me 20:58:55 Ok, well thanks for coming by everyone! 20:59:00 we'll close in 30 20:59:03 * mmcgrath forgot that part :) 20:59:30 15(ish) 20:59:33 * mmcgrath isn't really counting 20:59:44 [22:59:00] < mmcgrath> we'll close in 30 20:59:45 #endmeeting