17:14:50 <mattclay> #startmeeting Ansible Testing Working Group
17:14:50 <zodbot> Meeting started Thu May 23 17:14:50 2019 UTC.
17:14:50 <zodbot> This meeting is logged and archived in a public location.
17:14:50 <zodbot> The chair is mattclay. Information about MeetBot at http://wiki.debian.org/MeetBot.
17:14:50 <zodbot> Useful Commands: #action #agreed #halp #info #idea #link #topic.
17:14:50 <zodbot> The meeting name has been set to 'ansible_testing_working_group'
17:14:53 <Pilou> o/
17:15:24 <mattclay> #info Agenda: https://github.com/ansible/community/issues/248
17:15:31 <mattclay> #chair pilou pabelanger
17:15:31 <zodbot> Current chairs: mattclay pabelanger pilou
17:15:37 <mattclay> pabelanger: Do you have any Zuul updates for us today?
17:15:42 <alongcha_> o/
17:17:10 <mattclay> Does anyone else have something they'd like to discuss?
17:17:37 <Pilou> #56534 adds a new sanity test (require 'type' in metadata). Should test/sanity /validate-modules/ignore.txt be updated or is_new_module used ?
17:18:24 <Pilou> there were differing opinions :)
17:19:49 <mattclay> How many modules fail the new test?
17:20:10 * Pilou execute the test
17:21:02 <pabelanger> sorry, I am in a meeting currently
17:24:59 <Pilou> E336: 10189, E337: 4309 (python test/sanity/validate-modules/validate-modules  --arg-spec --exclude='.*\.ps1' lib/ansible/modules/ |grep -E '(E336|E337)')
17:27:48 <mattclay> That's error counts. Can you give module counts instead?
17:29:28 <Pilou> E336: 1859, E337: 1105
17:33:46 <mattclay> That's a lot of modules to eventually fix, but this wouldn't be the first time we had a long ignore list. We already have 800+ in the ignore list. I don't see adding 3K more as a problem -- just make sure it's sorted.
17:35:15 <Pilou> ok
17:36:33 <mattclay> We really want to avoid using `_is_new_module` for anything that could be added to the ignore list instead.
17:38:45 <Pilou> Unrelated: i will try to update #56392 (consul_session integration tests) today.
17:43:56 <mattclay> Pilou: Thanks.
17:44:07 <mattclay> Is there anything else to discuss?
17:45:26 <pabelanger> I won't have time this week, sorry.
17:45:32 <mattclay> pabelanger: No problem.
17:49:40 <mattclay> #endmeeting