20:59:50 #startmeeting EPEL SIG (2010-02-12) 20:59:50 Meeting started Fri Feb 12 20:59:50 2010 UTC. The chair is smooge. Information about MeetBot at http://wiki.debian.org/MeetBot. 20:59:52 Useful Commands: #action #agreed #halp #info #idea #link #topic. 20:59:59 #topic roll call 21:00:11 Hello guys I will be running the meeting today 21:00:15 I'm here for epel meeting 21:00:25 stahnma is unavailable and nirik might also be 21:00:31 hello derks 21:00:32 I'm around... 21:00:38 thank you for arriving 21:00:39 I'm here... 21:00:57 hi tremble 21:01:06 ok today's meeting should be pretty quick 21:01:13 the agenda should be: 21:01:25 - Status update on action items 21:01:25 - smooge: Blocking packages already in RHEL 21:01:25 - Fuse for 5.4 status 21:01:25 - RHEL 5.5 21:01:25 - Dead packages.. need for no frozen rawhide? 21:01:26 - Open Floor 21:01:40 anything I have missed or need to add? 21:02:02 #topic status of itmes 21:02:43 I have downloaded the latest packages and such and am going through what items should be blocked 21:03:04 I should have a list of packages that need to be dropped/added/changed for 5.5 this weekend. 21:03:10 of course 5.5 will be along soon too. ;) 21:03:19 oh, you are checking 5.5 beta? 21:03:38 yes 21:03:59 cool. 21:04:10 they rarely add or subtract packages after the beta 21:04:17 so its a good place to check from 21:05:16 the package list for blocking I am going to look at core stuff 21:05:29 and items that have been added in. 21:05:47 the blockage will be for i386 and x86_64. ppcXX is a bit funky 21:05:59 yeah. ;( 21:06:22 I would be happy to drop it like an itanium bomb. but not my call :) 21:07:03 ok anyone want to talk about FUSE and 5.x 21:07:29 I think things are going well there... we have a number of fuse packages no 21:07:30 now. 21:07:45 #topic FUSE is go for throttle up 21:08:08 so FUSE packages have been added and that looks good. 21:08:26 cool 21:08:38 #topic RHEL-5.5 anyone playing with it? 21:08:58 * nirik hasn't. The changes didn't look all that major... 21:09:07 ok so this week RHEL-5.5 was released for testing. 21:09:16 * tremble hasn't had chance yet. 21:09:35 I have started downloading the ISO but will probably be ready by Monday due to super fast net speeds at home 21:10:12 skvidal downloaded the channel and it looked like there were a couple hundred packages updated.. but not much new 21:10:22 more than couple hundred 21:10:26 900 pkgs for x86_64 21:10:29 and 517 for i686 21:10:38 or thereabouts 21:10:56 skvidal, I am an astro-physicist .. I am within an order of magnitude :) 21:11:03 :) 21:11:06 excellent, sorry 21:11:07 carry on 21:11:08 :) 21:11:38 so within our 10^2(+/-1) package changes there will probably be some additions. 21:12:10 I am going to get that list dealt with this weekend and see what got dropped to 21:12:23 the ppc of course is probably going to be our weird one again. 21:13:06 what I would like to do is organize a 'test' day on an off meeting friday. 21:13:23 basically install 5.5 and then install epel stuff to see what cracks up or not 21:13:31 does that sound workable 21:13:51 possibly... nothing should break... ABI should stay the same... 21:13:57 correct 21:14:06 but well 21:14:25 my main worry will be with the FUSE stuff.. and conflicts 21:15:00 that kind of testing 21:15:08 yeah... 21:15:22 that sounds more than feasible 21:15:49 ok cool 21:16:17 well then.. I have a special speaker for the class now. 21:16:29 all the way from winter wonderland of Virginia. 21:16:34 Well, maybe not so much special as "special K" 21:16:37 #topic RH EPEL relations 21:16:42 Hi gang 21:16:58 welcome 21:16:59 hi stickster 21:17:05 'lo 21:17:07 So I know that a few weeks ago there was some concern about RHN channel content wrt. EPEL. 21:17:26 The concern being, are Red Hat maintainers working with EPEL like they should? 21:17:45 And what's going to happen come RHEL-6? 21:18:46 So several months back, Spot and I worked with some internal folks to make sure that both our new-package and RHEL update processes include checklist items regarding EPEL 21:19:13 cool 21:19:15 so that engineers inside Red Hat understand they need to be working with EPEL as an upstream 21:19:27 that's great 21:19:52 The unanimous response I got from the folks I talked to was, "Yup, we're doing that now, and will keep doing so" 21:20:18 cool. 21:20:21 I think there was some discussion, too, about whether the EPEL community needed to be concerned about content beyond the RHEL Advanced Platform (AP) package content 21:20:29 yes 21:20:50 So I have an answer to that as well, which is "No." 21:20:55 :-) 21:21:03 great. :) 21:21:05 In other words, the policy that you guys have centered on, IIRC, is the right one. 21:21:13 Finally, regarding RHEL 6 21:21:22 RHEL 6 channel content is not set at this point 21:21:45 But at such time as that happens, Red Hat is committed to continuing to work with EPEL as an upstream 21:22:01 I have heard it has ponies 21:22:04 working with EPEL contributors to manage any changes or transitions that might be involved 21:23:02 Cool. If they have questions, the epel-devel list is the best communications channel... 21:23:09 nirik: Precisely 21:24:33 That's all I have unless there are quesetions 21:24:35 *questions, even 21:24:36 21:24:55 question) how can we work with RH better 21:25:31 as in how can we make this a 'relationship' where we are helping each other grow the commons. 21:26:17 smooge: I asked about where there was any perceived friction here, and mostly I got "huh?" as a response. In other words, the internal maintainers and other folks look at EPEL as an upstream which is their preferred choice to grow/cultivate packaging of software 21:27:24 I think the issue is that we want to make it more of a conversation. Its not as much friction as "oh look they put X in the next release." 21:28:27 I am glad the Red Hat engineers are using the work of the EPEL engineers but I want to make sure that we have a partnership (we like this but could you make it more flavorful here?) versus just a customer relationship (you want fries with that?) 21:28:29 smooge, agreed... seems we are reacting to RHEL changes (pulling in packages, etc) rather than proactively communicating changes 21:28:30 smooge: Right. Always at odds with that is the pressure for Red Hat to be just broadcasting its future product strategies. But I think there's middle ground where for example we could encourage engineers to be co-maintainers 21:28:34 does that make sense? 21:29:49 smooge: derks: As I said earlier, everyone I talked with is committed to *not* doing that in the future. We've got process in place to discourage it now, too, which helps. 21:30:12 yeah.. I don't expect us to know that "next release we will be putting in XYZ-4.3, and taking out A#FD-2.0" before beta testers would.. but a co-maintainership so that "oh we found this helpful at a customer site, but had to change this to make it really work for them." would be nice 21:30:14 * stickster corrects earlier statement -- encourage *more* engineers 21:30:33 smooge: Exactly 21:31:08 And that's what Spot and I conveyed to the team managers internally -- that EPEL can deliver that value in the same way that Fedora does 21:31:15 thanks. 21:31:20 To which the unanimous answer was "Yeah! Right on!" 21:31:42 well if they need to ask for things.. let them know its ok for them to join :) 21:32:06 I think at times we tend to turn up old cruft that creates the perception that people are not communicating -- when it's really just dust bunnies 21:32:41 by which I don't mean to minimize issues -- we should continue to open up any communication blockages we find 21:33:06 yes understood 21:33:11 But what we *shouldn't* need to worry about is that there's anyone unwilling to help! 21:33:27 ok cool. 21:33:31 * stickster yields 21:33:41 to the gentleman from NM :-D 21:33:48 i would have thought that more redhat engineers would already be contributers to epel... is that not the case? 21:34:02 as in RHEL packagers... also packaging for epel 21:34:21 derks: I believe we do. I will certainly continue to stump for even more wherever I can. 21:34:54 right on 21:35:16 ok any other questions at the moment? 21:35:37 Thanks for letting me horn into the meeting guys :-) 21:35:38 stickster, could you hang on a minute in case someone scrolls up and asks in a couple 21:35:47 I'm lurking, no problem 21:35:50 ok cool 21:36:06 Ok I think I can switch topics to my next one 21:36:35 #topic Dead Packages OR No Frozen EPEL (or how to drive dgilmore to distraction) 21:37:06 so our long running problem with web applications is reaching the fore as I am trying to make mediawiki a usable package 21:37:14 and well it don't upgrade too well 21:37:41 and then we have moin, nagios, and a host of other web applications which are making problems 21:38:27 smooge: mediawiki is sorta a known quantity if you will. 21:38:35 there are a couple of ideas on how to deal with this 21:38:52 jds2001, how so? 21:38:56 there are going to be DB changes at every update, and your installation wont work without them, and they're impossible to automate. 21:39:57 yes. its the same with moin and most other opensource db oriented packages I have seen 21:40:18 however, if you just wanna backport security stuff, you could try that. 21:40:25 and stay with one version of the schema. 21:40:31 but that's *hard* 21:40:43 That's an understatement 21:41:28 s/hard/impossible unless prime developer/ 21:41:37 "Yeah we know that was a bug, we ended up reengineering that whole chunk" 21:42:20 well in the long run we can run for a couple of different strategies: 21:42:42 1) break the customer all the time. [oops you shouldn't make yum update a nightly cron job.] 21:43:08 1) As a sysadmin - please don't do that to me 21:43:17 2) try a packaging schema that puts more work on us but keeps compatible parts together until they EOL 21:43:23 1) this breaks our promise to end users, should be rejected. ;) 21:44:22 problem with 2 is that if you have mediawiki and mediawiki2 and mediawiki3... people who are doing new installs will install the oldest one. Also, keeping the old ones around could leave them vulnerable to security issues. 21:44:24 2) has the problem that you need to know not to install mediawiki you need to isntall mediawiki19 and 18 and 16 are security hazards 21:45:15 so, if we aren't maintaining the original anymore... couldn't it be removed? 21:45:31 Except we say we won't 21:45:37 so if you try to install 'mediawiki'... fail, yum search would show the alternatives 21:46:13 And then you break KS build scripts and annoy us Sysadmins. 21:46:13 err.... i guess you would still need it there for a mediawiki original user to restore a system 21:46:41 It's a shame there 21:46:56 's no clen way to "alais" an RPM for yum 21:47:05 alias even 21:47:10 3) break the customer at regular intervals. Have a 'rawhide/slipstream' channel where stuff gets built. Have a regular update timed with upstream sub-releases to move things into a stable channel. Have updates meet old criteria only hit the updates 21:48:09 4) backport fixes to people who pay us to get a stable of developers. 21:48:12 3) sounds doable, but still not ideal. 21:48:52 but the issue with it is that most people wont upgrade to say RHEL5.5 on the day it comes out 21:49:00 3) feels vile, and kinda breaks the principals. 21:49:05 whereas we'd be rebasing EPEL on 5.5 on that day. 21:49:37 jds2001, actually we would time it with that but it doesnt mean we would release on the same day 21:49:59 well, why does slipstream need to merge over to stable? can't it stay seperate? 21:50:15 I was thinking it would be when the beta comes out you build your stable against that into "testing" and when 5.5 final came out you would build and release say 2 weeks later with that 21:50:31 nirik, I was thinking slipstream would be the cherry picker 21:50:42 but I stole the name from you so what did you think 21:51:10 there should be no need to rebuild against minor releases... upstream promises ABI compatibility (although I know they have broken it a few times) 21:51:11 in any case, all the ideas above break some 'principles/promises' people feel the EPEL sig should deliver on 21:52:04 yeah, or there is: 5) just don't ship incompatible updates at all as we are doing now... you need to go to another repo to get an updated version. ;( 21:52:09 nirik, the idea would be that at the minor editions you could move from say mediawiki-1.5 to mediawiki-1.7 21:52:19 Splitting them, like eg unison. UnisonAB, UnisonCD... might be the best option 21:53:10 it basically is about creating the infrastructure and pain of having a 'Z' channel for epel 21:54:05 tremble: thats option 2 above. 21:55:35 tremble, the issue is probably the most doable of the 5 21:56:10 the pain there is making them so they can parallel install. 21:56:28 why would you? 21:56:29 and getting them reviewed, etc. 21:56:43 I just want to get them all listed for people to mull over and then working on a document for Dummies like me to follow to do parallel installs 21:56:45 i would expect mediawiki15 and mediawiki17 to have file conflicts. 21:57:02 Same here 21:57:20 well, in the case of say rdiff-backup you wouldn't. 21:57:24 the issue would be when you need mediawiki15 to dump stuff for mediawiki17 to update 21:57:31 you want both versions because they can talk to other versions. 21:57:50 also, packages are supposed to "avoid conflicts whenever possible" :) 21:58:09 sure, but we could make an exception here. 21:58:34 rdiff-backup is a special case. 21:59:18 where someone needs to figure out what to do :) 21:59:43 I guess I would like to see if the FPC would be ok with us doing this... conflicts suck. ;( 21:59:46 To be fair, paralell installs may well be the better option, and with web apps it's less of a nightmare than many options. 21:59:48 but in general, I think conflicts are OK in this particular problem space. 21:59:54 jds2001, I will be honest to say I don't know how many of these packages are going to eb "special" cases 22:00:19 RT fits into that category too. 22:00:31 for moin I know its a special case as you need the old toy to get the new one to work 22:00:59 The error you get from yum/pk when you try and install a conflicting package is not good. 22:00:59 to what end? Can't you just install a new version and run the db migration script? 22:01:40 Actually RT comes with POST install update scripts. 22:01:58 right, that's sane. 22:04:10 perhaps we could compile a list of these items so we know what option might be best? 22:04:25 ok 22:04:28 nagios 3, rdiff-backup 1.2, mediawiki, ... ? 22:04:32 moin 22:05:00 actually I am trying to think of a webapp+db that doesn't have a problem 22:05:35 wordpress/wordpress-mu sorta... but they are a mess. 22:06:33 so, all options kinda suck. ;) 22:07:29 now speaking about how to handle this using option 2 22:07:51 * derks sees why RHEL doesn't package web apps 22:08:18 I would like to work with FESCO on seeing if we can make this a general 'policy' if they so wish. I remember when we talked about this in 2008? that people wanted us to look at it first as we were a smaller sample than all of Fedora 22:08:40 oh and for nonwebapps 22:08:43 I would think FPC would be the better place to start the dialog... 22:08:50 snort and clamav 22:09:00 nirik, sorry I forgot about FPC 22:09:08 so i have an idea 22:09:12 I couldn't remember which one went away a while back 22:09:15 ..... regarding #2 22:09:50 mv mediawiki -> mediawiki1 (or whatever)... it obsoletes mediawiki... then sometime after introduce the new mediawiki 22:10:15 or introduce mediawiki2, and have mediawiki just be a metapackage that requires mediawiki2 22:10:40 while mediawiki1 just stays stagnent (cause it obsoleted all the old mediawiki users) 22:11:02 Trouble with it being a metapackage is that when you update it, it'll try to update the dependancy. 22:11:16 and you can't confirm that people caught the earlier update 22:11:25 the other problem with this is "some time" is impossible to judge. ;( 22:11:44 smooge, no you can't. but how can you really account for that if people aren't updating after say... a month? 22:11:46 And would probably want to be a major EL version increment 22:12:02 sorry I'm late :( 22:12:14 * derks looks at watch 22:12:28 you're fired 22:12:34 oh noes! 22:12:37 >.> 22:12:53 oh wait.. I can't fire a volunteer. Ok you are getting a pay cut 22:13:07 LOL 22:13:08 anyway. we are still discussing the same thing we have been doing for a while 22:13:11 50% of your EPEL salery ? 22:13:24 tremble: meh, 50% of 0 is still 0 22:13:35 * tremble winks 22:14:26 No Frozen EPEL ... lets do that 22:14:28 this is the one area i actually like satellite server over just yum repos.... you can query satellite for boxes running XYZ package 22:14:48 derks: ooo, that's cool 22:15:03 derks: we don't have satellite in production yet, still have a lackie working on it 22:15:04 yeah.. something I am not sure people would allow us to update their systems for them :) 22:15:10 then we just upgrade those boxes manually... of course those boxes are our customers, and not random people on the internetz 22:15:16 smooge: pffft 22:15:32 I wonder if we might want to work with the RPM/YUM developers and see if they can think of a way to implement metapackages where the meta package doesn't get installed 22:16:00 tremble, so what was the problem with dependencies you were saying? 22:16:30 say if mediawiki is a metapackage that requires: mediawiki2 22:16:40 Run yum update 22:16:53 It'll update the metapackage to the latest version 22:17:04 Which then requires mediwiki3 22:17:10 tremble: that's call a group 22:17:24 oh 22:17:25 tremble: and if you don't install the metapackage then how would you know to update it later? 22:17:27 * nirik doesn't see how metapackage or groups help. 22:17:27 yep 22:17:39 I guess for the 'default new people installing X' 22:17:54 You wouldn't, the real package would have been installed and that would get updated 22:18:02 skvidal, it wouldn't need to be updated (the metapackage) 22:18:16 derks: if you want to add a new pkg to the metapkg of course it would 22:18:27 otherwise how would the users get the new pkg? 22:18:40 its only purpose would be to link you to the latet version of X package 22:18:49 more like an alias 22:18:53 yum install mediwiki3 (obseletes mediawiki2) 22:19:03 'yum install mediawiki' is interpretted as 'yum install mediawiki2' 22:19:23 * maxamillion is now confused 22:19:25 umm 22:19:26 skvidal, I think what he is looking at it is the evil step-dad of groups from back in the day. package base requires glibc, blah blah blah so you install base and get a base system 22:19:30 you know how provides work, right? 22:19:33 tremble.... you can't obsolete mediawiki2 via the package though 22:19:43 yum install foo 22:19:46 if there is no pkg named foo 22:19:49 then yum looks at provides 22:19:52 to see what provides foo 22:19:55 and installs that 22:20:02 what id multiple things provide foo? 22:20:13 it uses compare_providers to see which one is 'best' 22:20:35 you know, i didn't think about that if.... the package doesn't exist 22:21:45 skvidal, here is what I am trying to 'solve'. Currently updating mediawiki in enterprise sucks. So I want to replace mediawiki with mediawiki15 which would provide mediawiki and I want mediawiki19 to provide mediawiki too. 22:22:04 I want people who have the old mediawiki to stay on mediawiki15 and the ones who want mediawiki19 to get that. 22:22:11 I don't know how to do it withiout pain 22:22:16 does that make sense 22:22:58 umm 22:22:58 yah 22:23:00 good luck 22:23:01 from what skvidal is saying, if mediawiki15 obsoletes mediawiki.... and then we remove mediawiki from the repos.... if a user does 'yum install mediawiki' they will get the latest based on compare providers 22:23:19 even if you don't remove it 22:23:24 yum won't install an obsoleted pkg 22:24:11 yeah that is what I thought. 22:25:44 heck I am not sure what I would have to do with it package wise (eg do I make a new package called mediawiki15 and go through approval process or do I do some cvs magic to subbranch it from mediawiki 22:25:45 it's silly to do so 22:25:52 the next update run will remove the obsoleted pkg 22:26:08 smooge: what is it you want users to be able to do? 22:26:16 yum install mediawiki and have it what? 22:26:21 magically work? 22:26:25 ok we have issues that most web applications do not upgrade sanely without manual work 22:26:59 actually I want it so that if they had the old mediawiki installed they aren't fucked when they do yum update 22:27:09 but get pushed onto a line that works for them 22:27:38 while new users get the latest mediawiki19 22:27:41 if they want to have updates and all that they can manually do it but we aren't screwing them over at 4 am when yum-updatesd runs 22:28:00 well personally I don't care if new users have to install mediawiki19 to get the latest 22:28:10 smooge, neither do i 22:28:25 it would be nice that yum install mediawiki worked but hey I can't have ponies with horns 22:28:35 smooge: then here's what you do 22:28:42 whatever pkg you want to be the definitive mediawiki 22:28:48 you make it provide: mediawiki 22:28:50 the other ones don't 22:29:07 so if 19 is the right one - then it Provides: mediawiki 22:29:16 so: yum install mediawiki 22:29:16 works 22:29:25 if you update to mediawiki 22 as the new 'real' mediawiki 22:29:26 so, it mediawiki15 obsoletes mediawiki... isn't that an implied provide? 22:29:35 derks: then don't have the obsoletes 22:29:46 and no and obsoletes is NOT an implied provide 22:29:56 ok 22:29:58 ok so in our current fucked up state of having mediawiki as a package... put in the obsoletes for a while then remove it later? 22:30:08 yes 22:30:14 ok cool. 22:30:19 i like this 22:30:19 I can live with that 22:30:25 but here's the catch 22:30:50 Hopefully EL6 will be along soon enough that you make the switch with EL6 22:31:13 so in this case what happens with the old mediawiki packages? they just stick around? 22:31:18 (removing the obsolete) 22:31:29 nirik: yes 22:31:57 unmaintained, unloved, possibly insecure? 22:32:02 skvidal, wouldn't compare_providers pick the package named mediawiki over one that provides it 22:32:28 i remember having these issues with the IUS project and going through similar loops as this 22:32:35 nirik, as far as I can tell thats going to happen.. we can mark them EOL inside or such.. but we either break people, don't ship the stuff, or don't update 22:33:22 yeah, there is no good answer. 22:33:24 or try to fix things and say "you got this from us. please update to something newer, but if you really need to keep this old one.. here is the code for you to fix." 22:34:09 nirik, as far as I can tell we are doing our best. our customers are getting what they paid for, and we can put out stuff that works as best it can 22:34:37 and I am not saying paid as in no money.. if they want to help and maintain say mediawiki15 then they can join in 22:34:52 derks: so you're asking me how to unscrew a screwed situation? 22:35:04 derks: you ask about REMOVING the mediawiki pkg from the repos 22:35:24 skvidal, right... that is where i was confused. you just said to leave it 22:36:40 in which case, base on the way i understand compare_providers, the package named mediawiki would win out over mediawiki19 that provides it. i just wanted to clarify... I would image it would be better to remove the original mediawiki package 22:36:58 ... from the repo 22:38:07 or start some other scheme 22:38:26 irc conversations tend to lead to misparsing at times :) 22:38:42 I think we need to write up a guideline and mail it to the list. 22:38:53 then try it out with mediawiki and then go from there 22:39:00 does that sound good? 22:39:18 * tremble nods at smooge 22:39:24 i think that would be best 22:39:28 any others? 22:39:38 thank you very much for your advice skvidal 22:40:04 np 22:40:08 agreed, thank you 22:40:36 smooge: I would say write it up and ask packaging list for feedback... 22:40:51 see if they think of problems or come up with a more clever way to do things. 22:41:09 ok. I will do so and have it ready for next weke 22:41:15 which list? 22:41:46 packaging@lists.fedoraproject.org I think it is. 22:42:16 ok thanks 22:42:37 alright I think we have filled our hour with a lot of stuff and our borrowed 42 mnutes with even more 22:42:49 does anyone have any open items? 22:42:56 #topic Open Floor 22:43:21 * nirik has nothing. 22:43:32 ok then I will close in 60 seconds 22:44:18 thank you all for coming. see you in two weeks 22:44:21 #stopmeeting 22:44:49 #endmeeting