15:00:16 #startmeeting Cockpit public meeting 2014-09-01 15:00:16 Meeting started Mon Sep 1 15:00:16 2014 UTC. The chair is puiterwijk. Information about MeetBot at http://wiki.debian.org/MeetBot. 15:00:16 Useful Commands: #action #agreed #halp #info #idea #link #topic. 15:00:18 #chair puiterwijk andreasn mvollmer stefw sgallagh 15:00:18 Current chairs: andreasn mvollmer puiterwijk sgallagh stefw 15:00:20 #topic Welcome 15:00:37 okay, so just a short roll call who is arround here for the meeting? 15:00:46 * mvollmer is 15:01:10 me 15:01:23 * stefw is here 15:01:24 #info Today is Labor day in the US, so nobody from the US will be here probably 15:01:38 #topic Fedora 21 status 15:01:58 okay, so a quick update on Fedora 21: we got the port change release in F21 Alpha, should be in TC5+ 15:02:13 this was release 0.21 for those taking count 15:02:20 great 15:02:34 #info Port change to 9090 in release 0.21, which is in Fedora 21 Alpha 15:02:58 so we should write the test day test cases for 0.21, right? 15:03:05 mvollmer: yes. 15:03:11 ok 15:03:17 #info Cockpit 0.21 will be in the test composes used for test days 15:03:28 have we had any further decisions on what the test cases should cover? 15:03:50 I think we decided somewhere between hand-holding and abstract, but not exact, no 15:04:03 only root login, no focus on dialog input validation 15:04:27 #info Cockpit test day on 2014-09-16 15:04:46 puiterwijk, should we review last weeks action items? 15:05:09 mvollmer: sure. let me get the meeting minutes 15:05:36 mvollmer will merge Pull Request #870, changing our port to 9090 15:05:46 done 15:05:56 puiterwijk will make a new release and submit to Fedora today 15:06:01 done 15:06:46 puiterwijk to review and merge open PRs => was not done, mainly because of next one 15:06:53 andreasn working through post-review, to report to puiterwijk once ETA is available to plan exact release time 15:06:55 andreasn: ? 15:07:06 mvollmer to rename F21 Sprint to F21 Alpha 15:07:09 done 15:07:21 and closed already, moved all open isues to Fedora 21 Beta 15:07:38 that also covers the next one then I guess: mvollmer andreasn puiterwijk to review open issues filed under F21 Sprint and F21 milestone to see which are needed before Alpha 15:07:58 well, for Alpha was already too late anyway. we should check which issues are blockers for F21 Beta 15:08:00 done my share 15:08:32 when does the alpha freeze lift? 15:08:34 okay, so do we have any blockers so far? 15:08:41 stefw: when alpha is releases 15:08:43 released* 15:08:58 so are we going to continue with our releases in the mean time? 15:09:03 https://github.com/cockpit-project/cockpit/issues/1099 15:09:03 and just not put them in fedora? 15:09:28 stefw: well, I would say that's okay, though it might hinder with getting stuff through the blocker process if we get releases with fixes for other things than approved blockers 15:09:44 i imagine we'd have to patch those in anyway 15:10:01 but yeah, it's a tradeoff 15:10:10 fedora isn't our only target (more on that later) 15:10:16 that's also an option. yeah, I'd say to go ahead with releases, and if we can't get something through the blocker process we'll just patch it 15:10:26 k 15:10:44 #info Normal releases to continue, and if something gets stuck for blocker process, patch that instead of new release 15:10:59 note that we can always send zero-day updates for non-critical things 15:11:11 (so after all the freezes etc have been lifted) 15:11:47 we should agree how we treat Cockpit in Fedora 21. Stable? Rolling beta? 15:12:02 mvollmer: I'd say stable, given that it's the server product.. 15:12:17 well, relatively stable. aka, do not add new features, but fix bugs 15:12:24 what does stable mean? 15:12:30 our internals and API certainly aren't stable 15:12:39 for example, the cockpit in f22 won't work with the cockpit in f21 15:12:47 although hopefully the one in f22 will work with all others after that. 15:12:58 stefw: right, but we shouldn't make any major UI changes or add new major features after F21 is releases I think 15:13:02 (within the F21 release) 15:13:03 stable == we don't surprise users too much and we try very hard not to release bugs. 15:13:10 so we branch? 15:13:17 stefw: I'd say yes 15:13:19 or we just let it rot 15:13:24 without any fixes? 15:13:28 I say branch and do bugfixes 15:13:57 i am afraid we don't have enough dev power for a branch 15:14:01 yeah 15:14:11 hmm, that's true. 15:14:19 i would put my dev power behind fixes that actual users discover and patches from others 15:14:38 but I don't think we should make major UI changes or the like after GA 15:15:06 yeah, i'm torn on that 15:15:20 maybe we should leave the one in f21 locked to the GA release 15:15:22 but in updates-testing 15:15:27 track the latest release 15:15:30 or something like that 15:15:30 hi! sorry for being later! 15:15:35 late 15:15:46 stefw, yes, sounds good. 15:15:47 stefw: yeah, that's certainly possible. sojust not push it to stable? 15:15:54 yeah 15:15:56 just like F20 now 15:16:08 because then people can use the 'stable but broken' or 'unstable but also broken ' :P 15:16:19 hah, right :) 15:16:20 no seriously ... they can choose which bugs affect them 15:16:21 hehe, right. 15:16:24 and help with development, testing, etc... 15:16:49 yeah, if you are happy with the corner of cockpit that works for you, you might not want to update. 15:16:51 #info Freezing Cockpit after F21 GA for updates, but still push new versions to updates-testing 15:17:00 i would be in favor of no branch ... and nothing but security updates in F21 stable 15:17:11 stefw: that works for me 15:17:19 yes, sounds like a good compromise. 15:18:06 mvollmer: so for the blocker bug: that needs to be filed in bugzilla, and marked as a blocker candidate for Beta 15:18:24 (or possible even Alpha if you're daring and want to defend that) 15:18:39 so if you want to, I can do that, or you can, either works for me 15:18:55 but above only applies after Fedora 21 is actually released, right? 15:19:02 we can keep updating f21 until then 15:19:04 yup, after F21 GA 15:19:09 minus freezes of course 15:19:15 yeah 15:19:46 note that between freezes there's still a stricter commit policy which we should take into account 15:20:10 but there's nothing actually preventing us from updates 15:21:33 mvollmer: so do you think you can fix the blocker between freezes, or would it take longer than that? 15:21:43 #info Beta freeze starts 2014-09-30 15:22:01 #info Translation freeze starts 2014-09-30 15:22:16 puiterwijk, I have patch, which needs testing of course. 15:22:30 mvollmer: okay, great. so then I guess we don't need a freeze exception for that 15:22:41 puiterwijk, would be nice to get it into alpha. 15:23:00 mvollmer: that would be possible, though that needs a freeze exception 15:23:07 but I can't say whether it is justified to delay the schedule for it. 15:23:36 well, since it breaks one of our main features, we can at least request it, and then leave it up to QA/rel-eng? 15:23:37 so, hmm, can we tell people to update Cockpit as part of the test day preparations? 15:23:47 or is that totally pointless? 15:23:57 theoretically, we could. but that's really bad(R) 15:23:58 mvollmer, sure we can 15:24:02 puiterwijk, yes, makes sense. 15:24:03 why is it bad? 15:24:12 obviously we should include fixes for bugs *everyone* is going to hit 15:24:15 in the test day images 15:24:18 otherwise the test day is useless 15:24:21 puiterwijk, yes, makes sense (letting re-leng decide). 15:24:21 stefw: because you want to test Cockpit with the rest of the system etc 15:24:23 just noise 15:24:45 but sure, if you want to make people update, we certainly can 15:24:52 or we just inlcude it in the image 15:24:54 when we build it 15:25:00 or both 15:25:07 i see. 15:25:22 yes, since it is 'only' alpha testing, we can be a bit loose there. 15:25:27 I think the best way would be to try to get it as freeze exception so it goes into the alpha fixes 15:25:45 and if we can't do that, then we can always ask people to update during the test day 15:26:28 yeah 15:26:37 mvollmer: do you want me to file the bugzilla ticket, or will you file it and request freeze exception? 15:28:30 puiterwijk, please file it. 15:28:35 okay 15:28:51 #action puiterwijk to file RHBZ for #1099 and request freeze exception 15:29:06 anything else F21 related? 15:29:11 testsuite 15:29:21 and dropping f20 support, possibly. 15:29:30 mvollmer: ah, I have that next in the agenda 15:29:34 ok, cool. 15:29:42 #topic Dropping f20 for f21 (multi-os testing) 15:29:53 ok, status: 15:30:18 integration tests almost pass, one or two days of tinkering, then we should be good. 15:30:40 biggest regression is extended DOS partitions, which seem to be broken in F21 right now. 15:30:57 #info Integration tests almost pass 15:31:02 but we can disable those in our tests. 15:31:06 #info Regression with extended DOS partitions 15:31:10 so, no blockers, as far as I can see. 15:31:24 okay, so we could just say we abandon F20 now and just move all development to F21? 15:31:40 supporting both f20 and f21 can be done, I guess, but dropping f20 makes things easier. 15:31:59 right, but there's not that many differences that affect us, and we've never been in stable for f20 15:32:07 main issue there is SELinux: for f21 we can just delete all SELinux bits from our packaging. 15:32:30 well as things change we need to have selinux updated 15:32:38 for example, with the gssapi work there will be a change 15:32:42 to read the keytab 15:32:51 but more to the point on f20 ... 15:33:02 puiterwijk, i'm assuming we still don't have ostree based testing going on right? 15:33:16 we *need* to be able to test against more than one base OS 15:33:43 if it's not f20 + f21, then it should probably be atomic + f21 at this point 15:33:51 stefw: not automatically, and the VERIFY-script fixes are not complete yet, no. As published I have the script that can create the ostrees 15:34:34 stefw, I agree. 15:34:39 I also haven't heard from RHIT regarding the move of ci.cockpit-project.org to the RH network, will ping again 15:34:39 puiterwijk, yeah, i think you sent that to me a few weeks ago right? 15:34:47 but i haven't had time to work on it, since i've been away 15:34:53 stefw: yes, that's that 15:35:17 also, I was wondering: would it be an idea to do main development on rawhide? 15:35:19 I guess we can have OS specific packaging in the test suite. 15:35:26 (just thinking out loud) 15:35:37 cockpit.spec.fedora-20, cockpit.spec.fedora-21, etc. 15:35:38 in the future there's no 'main development' OS per se. 15:35:45 certain features will work on certain OS's 15:36:01 puiterwijk, makes sense to me. 15:36:05 andreasn has been working on getting the atomic features ready for us to implement 15:36:17 mvollmer: that's a possibility, but we'd be better of with just %if-ing in the spec file as the gross will be the same 15:36:20 but we won't be able to test or do development on (all of) them in fedora rawhide 15:36:31 rawhide for Fedora, not as "main". 15:37:11 stefw: right, so I can easily modify my script to push the ostree images to files.cockpit-project.org so we can just setup an ostree VM and use that 15:37:34 and I can also make it follow master with the ostree (and with some modifications also other branches) 15:37:46 most of that code is already in my script, just needs an rsync and some tagging 15:38:34 but for development for atomic stuff, we just need documentation, as it complicates development a little bit 15:39:02 there's nothing preventing you from creating an ostree yourself with your development branch and testing that, just needs to be documented 15:40:21 do my remarks make sense, or am I just rambling? 15:40:49 makes enough sense to me. 15:40:54 well to actually do atomic specific development we also need the modular stuff done 15:41:05 nothing == not enough time 15:41:07 which ties into the navigation work, unless we figure out a good way to split it out 15:41:26 i mean, there doesn't seem to be enough time to do evrything that makes sense. 15:41:38 right. I removed the navigation work from the agenda for today on andreasn's request, given it's waiting on external review 15:41:56 basically from julim and leslie 15:42:53 │ | done │ 15:43:01 sorry for that 15:43:34 okay, so do we want to plan anything for that, or work arround the navigation stuff, or do we just wait for the review? 15:44:06 stefw, so what about dropping f20 at the same time as supporting f21? 15:44:13 yeah, lets just do it 15:44:15 stefw, would that make you cringe? 15:44:32 no, i was hoping we could use it as the use case for multi-os testing 15:44:38 but that never materialized 15:44:41 yeah, let's see. 15:44:42 so lets not hold things up 15:45:09 okay, so we're dropping f20? 15:45:14 i have to do some cross-checks with f20 anyway, so maybe I am making the problem bigger as it actually is. 15:45:41 puiterwijk, I would say: probably. 15:45:59 #info F20 support maybe to be dropped when we start supporting F21 15:46:58 okay, next? 15:46:59 the DOS extended partition stuff is interesting... looks like the kernel randomly forgets about them. 15:47:13 mvollmer: hum. so that's a kernel issue? 15:47:21 looks like it. 15:47:32 sure it's not udisks? 15:47:37 pretty sure. 15:47:41 wow 15:47:55 you can reproduce it with parted and blkid. 15:48:19 At one point, opening /dev/sda1 (say) return ENODEV. 15:48:36 hum. I guess that should be filed upstream. 15:49:03 I have filed it for Fedora. 15:49:11 mvollmer: ah, great 15:49:12 needs more investigation 15:50:07 #action mvollmer to investigate DOS partitions bug in F21 15:50:25 mvollmer: anything else for F21 so far? 15:51:09 no, except that everything works much better already than I had hoped. 15:51:16 heh, that's always good 15:51:21 #info F21 works better than hoped 15:51:25 puiterwijk, yeah, one thing: 15:51:32 mvollmer: yeah? 15:51:48 the mirrors seem to be unreliable, and signatures, too. 15:51:55 mvollmer: you mean the Fedora mirrors? 15:52:01 yes. 15:52:04 yeah, I've been working on that for the last few days. 15:52:09 that's a FEdora Infra issue 15:52:11 oho! :-) 15:52:36 and it's in one of the most annoying parts of our stack, so it's a puzzle, but I'm working on that :) 15:52:38 ok, just checking what I am seeing. 15:52:59 yup, thanks again for reporting. if you see it happen again, please let me know 15:53:27 #info Fedora Infra has issues with mirror metalink, so sometimes updates might give lots of errors. Working on fixing that 15:53:57 (just for your interresent: the issue is that the metalink that we generate is outdated on sone mirror servers.. :-/ ) 15:53:58 ok, so I continue with the testsuite on F21, ok? 15:54:06 yup 15:54:18 #topic systemd + polkit 15:54:21 stefw: ^ 15:54:26 ahh, yes. 15:54:37 so systemd merged patches that enable polkit support for the systemd1.Manager interfaces and friends. 15:54:45 \o/ 15:54:47 however, lennart did this with interactive = no prompts 15:54:59 /o\ 15:55:07 so it doesn't work with any of the default polkit that they (now) distribute 15:55:24 there's a discussion on dbus mailing list about adding a flag to dbus to indicate whether a method should be interactively authenticated or not. 15:55:37 if that's approved, spec updated, libdbus and glib would need to be updated 15:55:43 as well as services like systemd 15:55:52 so it's a pretty big deal 15:55:55 in theory backportable 15:56:11 it's not cockpit specific, right? 15:56:15 no 15:56:29 it's so that systemd can properly use polkit? 15:56:32 but we may end up having to write our own brain-dead stupid daemon that listens on same interfaces, just does polkit verify, and passes the call along to systemd 15:56:37 systemd can use polkit 15:56:40 and for things like hostnamed 15:56:47 they have a allow_interaction boolean argument in each method 15:56:53 which is then passed along to polkit 15:57:08 but for the Manager interface (the main one managing units etc...) there's no such arguments 15:57:19 and instead of defaulting to allow_interaction = yes, it defaults to no 15:57:32 see http://www.freedesktop.org/wiki/Software/systemd/hostnamed/ 15:57:36 i see. 15:57:47 vs these methods: 15:57:47 http://www.freedesktop.org/wiki/Software/systemd/dbus/ 15:57:52 hum... is that default an error? as that sounds pretty strange and breaking to me? 15:58:21 not really, some callers of dbus methods don't want to have to block on a prompt 15:58:25 i would expect that there is no such flag, and whether interaction is allowed or not is handled by the polkit-agent. 15:58:52 yeah, except the agent and caller don't know much about each other 15:58:54 stefw, right 15:58:56 in our case they're more closely related 15:59:07 dbus interactive authentication flag discussion: http://lists.freedesktop.org/archives/dbus/2014-August/016294.html 15:59:26 related: http://lists.freedesktop.org/archives/systemd-devel/2014-September/022804.html 15:59:59 i guess in addition to making this happen upstream 16:00:21 we should file some bugs in the red hat bugzilla, so we can track backporting patches, implementing work arounds, and making those sorts of decisions 16:00:33 likely systemd, libdbus, glib would be affected 16:01:18 #info major changes happening to systemd/polkit, need to backport patches for systemd, libdbus, glib 16:01:58 maybe 16:02:04 #undo 16:02:04 Removing item from minutes: INFO by puiterwijk at 16:01:18 : major changes happening to systemd/polkit, need to backport patches for systemd, libdbus, glib 16:02:11 #info major changes happening to systemd/polkit, maybe need to backport patches for systemd, libdbus, glib 16:02:45 so the alternative (and probably method of last resolt for us) is to proxy all systemd calls through a service running as root 16:02:51 that does polkit verification with allow_interactoin = true 16:02:57 it wouldn't need to be *that* tedious 16:03:09 can it be generated from some XML file? 16:03:10 could just have a mapping of which methods belong to which polkit actions 16:03:13 stefw: right. though currently we only support root anyway, right? so this is for if we want to support wheel-users as well? 16:03:27 we only support root, because this stuff is broken 16:03:37 also, anyone can log in 16:03:40 they just find stuff broken 16:03:44 right. 16:03:45 so this is stuff we need to fix 16:04:03 the current 'only-root' situation is only for f21 because we haven't fixed all these issues yet 16:04:17 yeah, I know. so this was just a summary 16:04:19 also, i wonder if we should have a warning when you log in as non-root, in the interim 16:05:08 like at the login page? 16:05:39 or on the initial dashboard? 16:05:42 not sure 16:05:50 or on the top bar? 16:06:29 well, we probably want to make sure it gets seen? 16:06:46 it would be easiest as a little box on the dashboard that you can dismiss 16:06:56 like we have for docker right now 16:07:04 sure 16:07:45 I'll open an issue about it 16:07:47 #info Look into adding a warning message on dashboard if logged in as non-root 16:08:03 #action andreasn to open issue on warning for non-root 16:08:09 Is everything broken when login with non-root? I think is part of the features 16:08:48 just certain features and actions 16:09:10 https://github.com/cockpit-project/cockpit/issues/1101 <- done 16:09:23 yeah, which we need to capture carefully 16:09:45 stefw: maybe it'd be useful to have a short list of broken things on that ticket? 16:10:10 yup 16:10:13 I think it's a good idea 16:10:35 can you do that, stefw? 16:11:00 so go through all of cockpit as non-root and look at what breaks? 16:11:12 also, what about non-wheel users? 16:11:24 I think that's a different category of issues 16:11:41 and non-wheel is, I think, not a core feature, as we're a management system.. 16:12:26 although if someone disagrees, we could decide otherwise 16:12:45 wheel essentially ends up being root equivalent 16:12:54 so ... i think we'll need to eventually support non-wheel 16:13:06 the roles stuff was an interesting first step in that direction 16:13:13 yeah, but for that we need to have a way to check which permissions the current user does have 16:13:16 althuogh probably would be reimplemented using polkit as we discussed earlier 16:13:49 i gotta go soon ... i guess irc meetings take much longer ... 16:14:09 stefw: well, our other meetings used to take about 2 hours, remember? :) 16:14:14 really? 16:14:17 yes 16:14:25 I left the office arround 7PM quite often 16:14:41 interesting. well i i'll try and stay 16:14:46 anyway, we only have one other big point on the agenda 16:15:15 #action stefw to put a list of stuff that doesnt work as non-root in ticket #1101 16:15:23 #topic Atomic features 16:15:30 all right, I guess that's me 16:15:36 yup 16:15:56 andreasn: could you put the links in here prepended with #link? 16:15:57 so, I've filled the pages stefw started 16:16:12 Atomic Updates from Cockpit 16:16:16 #link https://github.com/cockpit-project/cockpit/wiki/Atomic:-OSTree-Update 16:16:24 like that? 16:16:27 yup 16:16:49 so, today, the only way to update your atomic host is from the cli 16:17:00 we should have something in Cockpit for that 16:17:30 there are 2 personas/user stories connected to that and two workflows 16:17:44 if there is any persona or workflow missing, please let me know 16:18:19 the second one is Atomic: Docker Storage 16:18:24 #link https://github.com/cockpit-project/cockpit/wiki/Atomic:-Docker-Storage 16:18:28 #topic Two user stories for update stuff, let andreasn know if it's missing anything 16:18:32 #undo 16:18:32 Removing item from minutes: 16:18:41 #info Two user stories for update stuff, let andreasn know if it's missing anything 16:19:01 right now you have 8.5 GB for your docker files in Atomic and, yeah, that's pretty much it 16:19:30 if you run out of that space, then, well 16:20:01 that feature page has 3 user stories/personas and 3 scenarios 16:20:21 same with that if anything is missing from that that we need to cover 16:20:36 #info Three user stories for docker storage management 16:20:49 the thind one is Atomic: Resource Controls 16:20:53 #link https://github.com/cockpit-project/cockpit/wiki/Atomic:-Resource-Controls 16:23:45 that's for management of CPU, memory and disk space resources, right? 16:23:53 sorry, client died 16:24:06 and I'm seeing two user stories? 16:24:16 yes, we have some management of cpu and memory today, but none for network and storage 16:24:26 so it's kind of interconnected with the storage one I guess 16:24:48 #info Two user stories for docker resource management, but missing stories for network and storage resources 16:24:49 yep 16:25:25 so once these are reviewed for sanity and completeness the next step would be design 16:25:35 so please review! :) 16:25:47 #info please review the user stories and provide feedback to Andreas 16:25:59 #topic vm-create on files.cockpit-project.org 16:26:14 I've also gotten in touch with julim, leslie and walters about it 16:26:18 #undo 16:26:18 Removing item from minutes: 16:26:43 andreasn: right. Good feedback from them so far? 16:27:01 sent it just today, so no feedback from anyone yet 16:27:07 ah, right 16:27:15 neither from anyone on cockpit-devel 16:27:40 #info Please post review comments on the user stories to the cockpit-devel mailing list 16:28:27 and that was pretty much it from me 16:28:32 okay :) 16:28:38 #topic vm-create on files.cockpit-project.org 16:28:42 mvollmer: 16:28:49 yep. 16:29:00 lookinf forward to the docker fix so I can run more containers on my server :) 16:29:01 so you want to run that as a cron? 16:29:06 so, it would be nice to create the test machine images on that server. 16:29:19 puiterwijk, I want to run it at all. 16:29:31 mvollmer: fine with me. just make sure you're not running it every minute :) 16:29:43 looks like qemu doesnt't understand the "-net bridge" options. 16:30:07 puiterwijk, do you have experience there? do you run the tests on RHEL6? 16:30:38 i spent about 10 seconds with this, so I might be totally wrong about everything. 16:30:45 mvollmer: I have bridging net working on RHEL6, so I can check how I have that done. I think it needs some manual fiddling 16:31:02 puiterwijk, that would be cool. 16:31:09 #action puiterwijk to check into bridging net for RHEL6 to run vm-create on files.cockpit-project.org 16:31:15 thanks 16:31:24 mvollmer: so after that works, how about we just set it as a cron for every day at midnight? 16:31:46 yes, that makes sense. 16:31:58 of course we should also publish any failures, etc. 16:32:12 right, we can just make it pipe the output to a daily log file 16:32:42 ok, gotta run soon, still in the office... 16:32:49 okay. we have just one last thing 16:32:52 #topic Open floor 16:33:01 * mvollmer starts dancing 16:33:03 andreasn, mvollmer, stefw: any last remarks? 16:33:15 nothing from me 16:33:32 test cases for test day worry me a bit. 16:33:53 i am not sure how the end result should look like. 16:34:01 I'll check other test day pages. 16:34:06 mvollmer: right. so how about we just have someone write something up in the wiki and then review it next week? 16:34:26 we still have a little over two weeks, if I recall correctly 16:34:44 #action mvollmer to check other test days and write some test cases 16:34:55 jawohl! :-) 16:35:01 :-) 16:35:06 anything else? 16:35:21 I'm going to end the meeting in 30 seconds if nothing else 16:35:22 i have that other action item anyway: mvollmer to update the test day page to include warning 16:35:22 about error checking in dialogs 16:35:28 ah, right 16:35:42 but that's linked with the test case stuff, right? 16:35:58 #info Make sure to put "last weeks action points" on next weeks agenda 16:36:10 woohoo, VERIFICATION PASSED on Fedora 21. 16:36:17 mvollmer++ 16:36:26 images are on files.cockpit-project.org. 16:36:40 awesome :) 16:36:43 credits go to fedora. 16:36:58 heh 16:37:00 ok, see you tomorrow! 16:37:02 oh, and I had one last question 16:37:06 sure 16:37:16 so we have multi-os testing on the schedule now right? 16:37:25 when do we start supporting Windows? 16:37:26 * puiterwijk ducks 16:37:31 heh. 16:37:46 okay, on that note, before people start killing me, thanks to everyone for coming! 16:37:53 thanks! 16:38:07 thanks, bye! 16:38:09 #endmeeting