15:00:08 #startmeeting ansible core 15:00:08 Meeting started Thu Oct 12 15:00:08 2017 UTC. The chair is thaumos. Information about MeetBot at http://wiki.debian.org/MeetBot. 15:00:08 Useful Commands: #action #agreed #halp #info #idea #link #topic. 15:00:08 The meeting name has been set to 'ansible_core' 15:02:51 blorp 15:03:00 \o 15:03:18 #chair alikins shertel 15:03:18 Current chairs: alikins shertel thaumos 15:04:57 * gundalow waves 15:05:21 * Qalthos o/ 15:05:22 Around for a bit before heading to run London Meetup 15:06:15 #chair gundalow Qalthos 15:06:15 Current chairs: Qalthos alikins gundalow shertel thaumos 15:06:28 are you in London already? 15:07:12 #topic Open Floor 15:07:23 thaumos: yarp 15:07:36 fun 15:08:33 so how's everyone doing today? 15:08:34 * gundalow has a topic 15:08:43 \o/ 15:09:19 * mikedlr waves happily 15:09:25 #chair mikedlr 15:09:25 Current chairs: Qalthos alikins gundalow mikedlr shertel thaumos 15:09:58 Greetings 15:10:03 #chair abadger1999 15:10:03 Current chairs: Qalthos abadger1999 alikins gundalow mikedlr shertel thaumos 15:10:07 * mkrizek lurks 15:10:17 #chair mkrizek 15:10:17 Current chairs: Qalthos abadger1999 alikins gundalow mikedlr mkrizek shertel thaumos 15:10:27 gundalow: what's your topic? 15:11:14 o/ 15:11:44 #topic Ansible hosted jinja2 tool 15:11:46 #chair sdoran 15:11:46 Current chairs: Qalthos abadger1999 alikins gundalow mikedlr mkrizek sdoran shertel thaumos 15:11:55 someone pointed me at http://jinja2test.tk/ 15:12:25 which should really be linked from pocoo 15:12:35 pocoo? 15:12:35 #chair bcoca 15:12:35 Current chairs: Qalthos abadger1999 alikins bcoca gundalow mikedlr mkrizek sdoran shertel thaumos 15:12:56 http://jinja.pocoo.org 15:13:07 ^ domain that hosts jinja docs 15:13:16 bcoca: pointed out that rather than linking to that, we COULD host our own which would know about our lookups, filters and tests 15:14:23 Before I create an issue, wondered what people thought 15:14:58 fyi, that requires 'installing ansible' on the webserver and creating an app that will use it to templatize the input 15:15:16 We don't have a large infrastructure team and it wouldn't know about our builtin variables without some coding. 15:15:18 mmm ... awx feature? 15:15:21 #info in self-hosted soloution we'd need to include all dependencies, such as `netaddr` 15:15:35 but it could be useful to users. 15:15:37 I was thinking the same about awx/tower 15:15:58 there has been a similar ask of playbook validation there as well 15:16:01 Unofficially telling people about it might be better than officially. 15:16:16 even if we pay for the hosting 15:16:29 agreed, but it is very limited usefulness since it wont include our 'expansions' to jinja2 15:16:45 thaumos: playable? 15:17:04 https://www.ansible-playable.com/ 15:17:31 no not that 15:17:39 OSAS (ping misc) could host the website 15:17:43 you mean ansible-lint? 15:17:48 yeah like that 15:18:09 not sure I would trust user input to jinja on something I host 15:18:10 i think these are all nice 'awx plugins' 15:18:20 tiny hosted apps that are 'slappable' on top of awx 15:18:27 alikins: aye, would need to be very isolated 15:18:51 alikins: jinja2 already 'sandboxes' stuff, we should just also validate the input 15:19:18 the 'do.ext' is the dangerous one and that is 'off by default' 15:21:31 It's not a bad idea @gundalow. how about this. create a proposal and I will ask leadership their thoughts. sound like a plan? 15:21:56 thaumos: sure, proposal, rather than issue. WIll do 15:22:30 yeah that way depending on which route it takes it'll be easier to "manage" 15:22:44 #action gundalow to create a proposal for this (Hosted, AWX) Is this also like hosted ansible-lint type tool 15:22:47 ack 15:22:50 Thanks 15:22:54 #topic Open Floor 15:24:02 is sethp here? 15:24:19 \o 15:24:30 hi there 15:24:32 #chair sethp 15:24:32 Current chairs: Qalthos abadger1999 alikins bcoca gundalow mikedlr mkrizek sdoran sethp shertel thaumos 15:24:49 #topic treat wait_for as unready discussion 15:24:58 #link https://github.com/ansible/ansible/pull/28839 15:26:19 change in previous behaviour w/o a toggle? 15:27:26 My understanding is that it’s more of a bug fix; from macOS hosts we often saw plays failing because we trying to shut down an already closed socket 15:27:55 It seems to me that a failure closing a thing that’s already closed indicates “wait longer”, not “abort" 15:28:41 * bcoca was reading up on ENOTCONN meaning 15:29:10 I’m not too sure what causes it, I suspect it has something to do with systemd having bound the socket but being unable or unwilling to start the daemon that would recieve connections, casuing something like a successful handshake followed very quickly by a RST 15:29:15 k, makes more sense, its a noop to shutdown a connection that doesnt exist anymore 15:29:37 yeah, and so macOS cleans up its side before ansible has a chance to issue the close 15:29:43 (is my suspicion) 15:30:21 not all tcp stacks are the same ... lots of grey areas in RFCs ... not always follow RFCs 15:30:37 so many reasons that could happen, probalby timeout related 15:30:41 lgtm 15:30:53 https://tools.ietf.org/html/rfc1149 15:30:56 just did not remember what ENOTCONN meant 15:31:03 it's the pigeons fault in this case 15:31:17 seems like any otherwise unhandled exceptions in port connect could be considered 'not ready' 15:31:20 thaumos: ^ that RFC has already been revised x2 by subsequent ones 15:31:26 yep it has 15:31:54 alikins: depends ... sooo much stuff can happen on socket shutdown ... 15:32:55 @bcoca, are you willing to merge this pr? 15:33:28 reading the convos first, see if anyone had any issues 15:33:55 i remember dag getting involved, which is why i had not looked at this, he knows wait_for well 15:34:57 yeah, he suggested the new wait_for_connection module, which does indeed avoid this problem by relying on a higher-level semantic than establishing a connection to assert readiness, and sweeping any failure (including edge cases in rfcs) under that rug 15:35:35 which is definitely a good idea, but it doesn’t help us in the narrow but critical case of waiting for a brand new host that doesn’t yet have python installed 15:35:37 yeah, reading up, convo seems totally unrelated to your change 15:36:01 to solve that, we need to wait for ssh and then use `raw` 15:36:06 i might go further and add a list of error statuses which we can ignore 15:36:36 but this looks fine to me, i'll merge, need to check with release managers on backport status 15:37:45 #action bcoca to follow up with release managers for backport on merged pr 15:37:47 wont make 2.4.1, but probalby 2.4.2 .. unsure about 2.3 15:38:04 #topic open floor 15:38:17 unit test documentation 15:38:40 sounds good, thank you for your time! 15:38:42 this has been reviewed twice: https://github.com/ansible/ansible/pull/31373 15:39:10 2.4.2 yeah. 15:39:29 have fixed; now welcome some more reviews, but propose merging it ASAP so it goes in _before_ changes to the unit test directory and is visible to those doing it (pilou) 15:39:52 abadger1999: put it into project for 2.4.2 15:41:14 dharmabumstead: mikedlr says https://github.com/ansible/ansible/pull/31373 is ready for a new review (changed some broad swaths in response to previous reviews) 15:41:15 so nothing much more to say. 15:41:25 mikedlr: should something be added about cloud testing with placebo? ryansb is at a conference, but I think the plan was to try to do more of that rather than using mocks. 15:42:07 shertel: I started thinking about it; would be nice to have but it's simply an extra section in the module unit test. 15:42:37 both strategies are legitimate for different things - mocks test against what the API docs say it should do - placebo tests against what some version of an API actually did 15:42:38 Yeah, can be added later. 15:43:00 Good point 15:43:54 I guess I will make sure that placebo is at least mentioned. 15:44:22 * gundalow -> away 15:44:57 mikedlr: #31456 reorganize common code for unit tests :) 15:45:13 mattclay: ^ 15:46:02 Pilou: I was reading through that 'cos mattclay linked it. When it's done the unit test documents will be a good place to add info about it.. which is partly why I want to merge soon. 15:46:29 so for the docs to get merged, would we say that we need dharmabumstead, mattclay and ryansb to give one more glance at them? 15:47:38 yes; at least to close their current reviews which I think I have now answered wherever it's possible 15:49:35 heh, we're all not good at closing current reviews. 15:50:34 I'll take a look after the meeting. 15:50:53 well, if they just say "it's fine" on IRC I'll personally be happy; not sure about the Official Guardians of Community Process (R) 15:50:54 thanks mattclay 15:51:28 #action mattclay to review the doc pr later today. 15:51:43 #action thaumos to ping dharmabumstead on pr as well 15:53:01 #topic open floor 15:53:14 anything else quick to discuss? 15:53:15 FYI: 2.4.1rc1 is out. Please test ;-) 2.4.1 final next week unless blocker bugs are found, in which case rc2 next week. 15:53:19 ^^ 15:53:31 #info 2.4.1rc1 is out to test folks! 15:53:45 Already have a few non-blocker bugs queued up for 2.4.2 as well. 15:54:19 * bcoca keeps piling on 15:54:38 rds deprecation - think we should do first announcement of that in 2.5 and is on track, but not so much test feedback on new RDS modules. https://github.com/ansible/ansible/pull/30746 15:55:16 some of the AWS working group have promised to test rds_instance which should replace rds. 15:55:23 * shertel is still testing it 15:56:24 looking good though 15:59:21 Alright, anything else from anyone? 15:59:34 If not, I'll close in 60 seconds 16:01:27 #endmeeting