16:00:00 #startmeeting Fedora QA Meeting 16:00:00 Meeting started Mon Jan 3 16:00:00 2011 UTC. The chair is jlaska. Information about MeetBot at http://wiki.debian.org/MeetBot. 16:00:00 Useful Commands: #action #agreed #halp #info #idea #link #topic. 16:00:06 #meetingname fedora-qa 16:00:06 The meeting name has been set to 'fedora-qa' 16:00:18 #topic Gathering in the lobby 16:00:52 * kparal welcome 16:01:04 Happy 2011 fedora-qa! Who is ready to join me hosting the first awesome meeting of 2011? 16:01:49 * jskladan_home is lurking from the shadows, but will be departing soon :-/ 16:01:59 howdy jskladan and kparal 16:02:13 mkrizek is out this week, so hopefully he's hitting the books hard 16:02:31 and wwoods is now fully transitioned over to anaconda-devel 16:03:34 well, I'm still lurking here 16:03:39 * rbergeron peeks in 16:03:51 but unofficially! 16:03:54 Anyone else lurking? Viking-Ice, robatino, adamw etc... 16:04:00 rbergeron: hi there :) 16:04:06 jlaska: howdy sir! 16:04:31 I think adamw has holiday, if he's in Canada 16:04:32 * Viking-Ice drops in Happy New year ;) 16:06:15 oh goodness, my gnome-shell session just froze .... one moment while I recover folks 16:06:18 apologies for delay 16:06:56 okay ... we'll run this from the console then ... 16:07:39 #topic Previous meeting follow-up 16:07:58 The only item I had on the list was tracking the bodhi patch that fcame sent out for review 16:08:24 kparal: thanks, I didn't realize today was a holiday in Canada 16:10:21 I haven't seen any updates in the ticket. I have it listed as infrastructure ticket#701, but I think I must have typo'd that from a previous meeting 16:10:38 Will likely need to catch up with fcami and lmacken for an update here 16:11:03 So ... into the agenda ... 16:11:29 Nothing earth shattering planned for today ... just a recap on current activities so we don't completely forget what we were working on 16:11:35 #topic Fedora 15 Test Days 16:11:55 The schedule looks pretty good so far 16:12:27 The open items I have are that AdamW was waiting to hear back from mezcalero on the timing of a systemd test day 16:12:46 Aside from that ... there are still a handfull of open slots remaining (7 slots) 16:13:15 we don't have to have each of these filled of course, and as AdamW notes, while they are typically held on Thursdays ... folks are certainly welcome to choose a more applicable day of the week 16:13:50 jlaska: does the QA team normally have these test days individually added / detailed on the Fedora schedule? 16:14:00 If they suddenly will get filed we might need to drop some of those Gnome-Shell event I think I saw AdamW marked three testdays dedicated to Gnome-shell.. 16:14:19 rbergeron: no, we've debated adding them to the official schedule, but given the dynamic nature of the test day slots ... we've held off on doing that 16:14:42 Viking-Ice: that'll be a good problem to have! Too many people interested in hosting events :) 16:14:52 hehe ;) 16:15:15 I understand that the 3 gnome-shell events lines up with what was requested on @desktop list and based on feedback from some of the upstream GNOME QA folks 16:15:26 rbergeron: does that answer your q? 16:15:53 jlaska: indeed. 16:15:58 * jlaska trying to figure out how to cut'n'paste links from `links` 16:16:24 #info If anyone has topic suggestions, or would like to host an event, please reach out on test@lists.fedoraproject.org 16:16:39 Has not experience tough us not being hosting *DE test days until after alpha just before beta + I think we would need to host the systemd test day before Gnome-shell one 16:16:52 #link http://fedoraproject.org/wiki/QA/Fedora_15_test_days 16:17:18 perhaps all the graphics card related once as well ( Intel Radeon Nouveaou ) 16:17:46 Viking-Ice: definitely! I know that idea came up with regards to priorizing the xorg-x11-drv* stuff before the shell events 16:18:06 yeah I think systemd should be there as well 16:18:10 okay 16:18:36 #info Viking-Ice suggested that systemd and xorg-x11-drv-* test days should be scheduled *before* gnome-shell events 16:18:59 anything else on the test day topic? 16:20:08 Alright ... 16:20:16 #topic Fedora TCMS use case review 16:20:24 Just a quick heads up on some of the work Hurry has been doing ... 16:20:27 #link http://fedorahosted.org/fedora-qa/ticket/152 16:20:39 She has drafted 2 new pages ... 16:21:03 #link https://fedoraproject.org/wiki/Rhe/tcms_use_cases - to list all of our current test management use cases 16:21:30 #link https://fedoraproject.org/wiki/Rhe/tcms_Comparison - Comparison of the features of the different use cases 16:21:49 I find that second document very readible ... but I like tables and colors :) 16:22:13 As always, I'm sure any ideas or suggestions to help Hurry move forward on this subject would be appreciated 16:23:11 I prefer the tables and colors as well 16:23:21 I believe the first goal is to identify and document all current uses of the wiki for test management (cases, plans and results) 16:23:43 hiya 16:23:53 sorry, lunch overran... 16:24:06 from there, and I'm not sure of the order, to identify which features are present in nitrate, and to prioritize the missing features so they are on the nitrate development roadmap 16:24:11 adamw: hi there! 16:24:24 Viking-Ice: okay 16:24:40 adamw: no worries, we actually thought you were on holiday today 16:24:57 * jlaska suspects this is all part of the adamw beach beverage plan 16:25:04 good timing though ... 16:25:10 wasn't sure if we were supposed to be on holiday or not 16:25:19 #topic CritPath Test Case development 16:25:32 #link http://fedorahosted.org/fedora-qa/ticket/154 16:25:53 adamw: I'm still coming up to speed on your latest here, but it looks like you have some new drafts/mock-ups? 16:26:05 well, just what i did right before xmas 16:26:25 they're not new, exactly, i just picked a set of existing test cases and converted them to the new naming scheme as an exampke 16:26:52 I'm cut'n'paste deficient at the moment ... got any handy links? 16:27:10 you can drill down from https://fedoraproject.org/wiki/Category:Test_Cases to see how it works 16:27:27 to https://fedoraproject.org/wiki/Category:Package_xorg-x11-drv-ati_test_cases and https://fedoraproject.org/wiki/Category:Critical_path_test_cases 16:27:49 nice! 16:28:08 I still have a few unread updates from you on the subject, I'll try to respond and clarify and comments shortly 16:28:17 any other updates or next steps you want to share? 16:29:43 well, i was kinda hoping for some feedback over xmas break, but haven't seen any 16:30:05 if we assume no news is good news then next step is simply continuing to convert existing test cases, and getting people started writing new ones 16:30:09 #help Feedback on ticket#152 and ticket#154 needed 16:30:13 then talking to the tool devs 16:30:44 #info Need more feedback from testers/developers 16:30:56 sounds great, thanks adamw 16:31:15 #topic AutoQA Updates 16:31:35 ah 16:31:38 kparal: what's the latest? Do we have a holiday easter egg implanted in autoqa now? :) 16:32:02 I don't really have anything prepared for today. I must admit I haven't been working on autoqa over christmas :) 16:32:31 neither have I 16:32:34 * jskladan_home blushes 16:32:35 but today I pushed to master mkrizek's support for staging server 16:32:37 good for you guys! 16:32:45 so at least mkrizek deserves kudos 16:32:52 heh ... already mkrizek :) 16:33:35 kparal: in general, how are things looking for the next %{version} of autoqa? 16:33:41 or is it too soon to tell? 16:34:21 well, I am not sure how it looks about depcheck 16:34:34 I am sure we can adjust the koji watcher in time 16:35:21 I believe the next release should occur this month 16:35:55 cool! I'm not sure on the status of depcheck either, I started a thread with wwoods on that topic, so hopefully we'll know more soon. 16:36:44 clumens and I finished up some work on his private branch, which includes a new installer test called 'compose-tree' that does a pungi test whenever a new anaconda is built in koji 16:37:13 I also have a preliminary git-post-receive hook (along with companion .wsgi app) to allow us to trigger tests based on 'git push's 16:37:50 sounds great 16:38:04 what's the wsgi app for? 16:38:22 the wsgi app is how the git-watcher triggers tests on the autoqa server 16:38:38 ok 16:38:43 I'll have to document this in more detail of course, I took a stab at a long README in the hook directory for this 16:38:48 but I'm sure it'll need more docs 16:40:05 oh, I should also mention that Hongqing Yang joined the group in Beijing. He's tasked with coming up to speed on our installation testing and looking for areas to automate 16:40:20 alright ... open-discussion time ... 16:40:26 #topic Open discussion - 16:40:52 quick topic for rbergeron ... are there any open items related to QA and the F15 schedule? 16:41:00 jlaska: does that mean that Honqging will cooperate with clumens or will it be a separate task? 16:41:45 kparal: unsure at this time ... they may end up converging, but the initial scope is somewhat different 16:42:20 Another question for everyone ... 16:42:48 #info Are there any suggestions/ideas on how we can make our weekly meetings more effective? 16:43:26 Merge Bug Zappers meetings with this one 16:43:34 Change the format, change the frequency, rotate meeting chair, More open to topic submissions etc... 16:43:40 Viking-Ice: that's an idea ... hmmm 16:43:45 it depends what 'more effective' means... shorter? :) 16:44:07 kparal: to me, more effective means it served a purpose, and we all found it a valuable use of our time 16:44:14 do we think it's currently ineffective? 16:44:14 and shorter would be nice! 16:44:16 posting the topics with a bit more advance then hour before meeting ;) 16:44:34 adamw: I don't think it's ineffective, but I think it could be more effective 16:44:46 Viking-Ice: that's always something I struggle with ... indeed, I could do a better job of that 16:44:55 do 'em on friday 16:45:01 put them on a wiki page people can edit 16:45:02 the meetings, or the agenda? 16:45:06 agenda 16:45:08 hmm, likey 16:45:14 that might facilitate more topic suggestions 16:45:19 that's how we do/did it for bugzappers, it works fine when people actually have things to contribute 16:45:28 in fact it was just a rolling list 16:45:36 * jlaska would like to stop carrying all the topics 16:45:40 whoever does the meeting announcement grabs everything off the list and puts it in 16:46:23 well, that's a quick fix I can implement for the next meeting ... thanks! 16:47:05 following that idea ... if there are no topic submissions, is it acceptable to not have a meeting? 16:47:47 fine by me. 16:47:47 is it *bad* if we go 2/3/4 weeks without a meeting? I would think that means we have a problem somewhere, no? 16:47:50 I think the bug zappers meeting should be merged with this one 16:47:59 but we have some recurring topics at present which would cause that to be very unlikely. 16:48:03 #topic Improve QA meetings 16:48:14 #info idea - Merge BugZappers and QA meetings 16:48:33 #info idea - Post and solicit meeting topics on Friday, conditionally host meetings on Monday 16:48:54 I have just a slight idea how BugZappers meeting look like. but keeping it separate looks more reasonable to me 16:49:03 why ? 16:49:23 Viking-Ice: sounds like we should also raise this for discussion on the next BugZapper meeting? 16:49:45 Viking-Ice: because going over proposed bugs is outside of my usual tasks 16:50:02 yeah it was them that split of the process from QA in the first place so they might not like it so much 16:50:27 Viking-Ice: I wouldn't completely kill the idea, but seems worth more info/exploration 16:50:40 kparal: that's not what happens in bugzappers meetings 16:51:15 adamw: ah, ok. so first I should attend one, before speaking, sorry :) 16:51:21 having one meeting for the whole QA community is what I'm after it will alow reporters to be a bit more aware of what's happening on that side 16:51:35 kparal: you can see logs at http://meetbot.fedoraproject.org/teams/bugzappers/ if you like 16:51:51 I personally never attend any "BugZappers" meeting 16:51:53 we haven't actually had many bugzappers meetings at all lately so it's somewhat academic 16:52:41 Well, by being more transparent with collecting meeting topics for this meeting, we can certainly encourage more BugZapper participation 16:53:07 if the meetings consistently go over 1 hour in length, I would probably have to shoot myself 16:53:20 That'd be my personal goal :) 16:53:42 from my stand point we all work as one group or we split of QE in their corners bugzapper in theirs and reporters in their corners 16:53:49 after reading the logs, it doesn't seem so bad. taking back my statement :) 16:54:09 Viking-Ice: let's start the discussion with the bugzappers ... see what they think 16:54:37 I don't think it's as black and white as you articulate (QA vs BugZappers) ... but I'm open to combining the meetings 16:55:48 for this week, I'll adjust the meeting topic process. 16:55:57 can we go back to test days, since I missed that bit of the meeting? 16:56:06 sure ... you got 4 minutes :) 16:56:15 #topic Fedora 15 Test Days 16:56:30 adamw: any updates/topics/cautionary_tales to add? 16:56:31 just to say the ordering of the test days i've put in so far isn't just me throwing stuff at a wall 16:56:47 the gnome test day schedule is based on me talking to the desktop team, that's the schedule they want 16:56:56 * jlaska nods 16:57:26 we don't need to do the systemd test day before the gnome3 test days unless we're particularly scared that zillions of people will be unable to boot f15, which by all current experience isn't the caes 16:57:34 I propose xorg-x11-drv test and systemd before first gnome-shell test 16:57:44 we can't do that, practically speaking 16:57:48 why 16:57:54 wouldn't be enough time for everything 16:58:02 ? 16:58:05 systemd and xorg devs don't want their test days really early 16:58:28 especially for xorg, it'd mean we were testing code with little relevance to what we were actually going to ship 16:59:10 Viking-Ice: it sounds like current schedule was developed in conjunction with desktop@lists.fedoraproject.org ... /me searches for desktop@ link 16:59:11 yeah well we have had problems in the past with the X not being in good enough shape before *DE tests when hosting DE before the X tests 16:59:17 the only particular benefit of doing them before gnome3 test days is if we're really worried systemd or x drivers are going to cause lots of people to be unable to get into gnome3, yes? at present that doesn't look like it'd be the case 16:59:45 jlaska: most of the discussion was on irc, but i can provide a log if anyone wants (i'd have to check with mclasen first as it was in /query) 16:59:54 Viking-Ice: I don't have a lot of data on the retrospective pages about people being unable to test desktop environments due to a large number of xorg-x11-drv issues 17:00:34 F8 and F9 X changes and radeon 17:01:00 That's when we introduced modesetting for the first time, right? 17:01:05 yeah 17:01:10 we could move X up to late february, but i'd have to check with the X devs 17:01:19 okay 17:01:41 I don't think we're in the same boat with regards to disruptive core xorg-x11-drv-* changes like we were when modesetting landed 17:01:50 systemd really doesn't worry me, we've had people using it for quite a long time now and it really hasn't presented any problems 17:02:11 the systemd test day will be 'polishing advanced use cases' not 'omg does this thing work', i think 17:02:14 adamw: not on fresh install I dont think it's the same with upgrades. . . 17:02:34 Viking-Ice: that's fine. we don't get many people doing upgrades for test days. 17:02:41 alright, we've exceeded the one hour limit ... let's start to wrap-up 17:02:56 so summary ... 17:03:11 * reach out to xorg devs to see if there is any wiggle room for the Xorg Test Week? 17:03:33 * Add upgrades to the list of use cases to explore during systemd test day? 17:03:37 17:04:23 adamw: Viking-Ice: that sound right? 17:04:25 sure 17:04:30 yup 17:04:40 eggsellent 17:04:48 okay folks ... let's close out unless there are any other topics 17:04:54 #topic Open Discussion - 17:05:00 * jlaska sets the fuse for 1 minute 17:05:45 15 seconds... 17:06:01 Thanks for your time everyone! 17:06:14 I'll follow-up with minutes to the list 17:06:16 #endmeeting