17:14:50 <mattclay> #startmeeting Ansible Testing Working Group 17:14:50 <zodbot> Meeting started Thu May 23 17:14:50 2019 UTC. 17:14:50 <zodbot> This meeting is logged and archived in a public location. 17:14:50 <zodbot> The chair is mattclay. Information about MeetBot at http://wiki.debian.org/MeetBot. 17:14:50 <zodbot> Useful Commands: #action #agreed #halp #info #idea #link #topic. 17:14:50 <zodbot> The meeting name has been set to 'ansible_testing_working_group' 17:14:53 <Pilou> o/ 17:15:24 <mattclay> #info Agenda: https://github.com/ansible/community/issues/248 17:15:31 <mattclay> #chair pilou pabelanger 17:15:31 <zodbot> Current chairs: mattclay pabelanger pilou 17:15:37 <mattclay> pabelanger: Do you have any Zuul updates for us today? 17:15:42 <alongcha_> o/ 17:17:10 <mattclay> Does anyone else have something they'd like to discuss? 17:17:37 <Pilou> #56534 adds a new sanity test (require 'type' in metadata). Should test/sanity /validate-modules/ignore.txt be updated or is_new_module used ? 17:18:24 <Pilou> there were differing opinions :) 17:19:49 <mattclay> How many modules fail the new test? 17:20:10 * Pilou execute the test 17:21:02 <pabelanger> sorry, I am in a meeting currently 17:24:59 <Pilou> E336: 10189, E337: 4309 (python test/sanity/validate-modules/validate-modules --arg-spec --exclude='.*\.ps1' lib/ansible/modules/ |grep -E '(E336|E337)') 17:27:48 <mattclay> That's error counts. Can you give module counts instead? 17:29:28 <Pilou> E336: 1859, E337: 1105 17:33:46 <mattclay> That's a lot of modules to eventually fix, but this wouldn't be the first time we had a long ignore list. We already have 800+ in the ignore list. I don't see adding 3K more as a problem -- just make sure it's sorted. 17:35:15 <Pilou> ok 17:36:33 <mattclay> We really want to avoid using `_is_new_module` for anything that could be added to the ignore list instead. 17:38:45 <Pilou> Unrelated: i will try to update #56392 (consul_session integration tests) today. 17:43:56 <mattclay> Pilou: Thanks. 17:44:07 <mattclay> Is there anything else to discuss? 17:45:26 <pabelanger> I won't have time this week, sorry. 17:45:32 <mattclay> pabelanger: No problem. 17:49:40 <mattclay> #endmeeting