14:59:54 <adamw> #startmeeting Fedora QA Meeting
14:59:54 <zodbot> Meeting started Mon Jun 15 14:59:54 2020 UTC.
14:59:54 <zodbot> This meeting is logged and archived in a public location.
14:59:54 <zodbot> The chair is adamw. Information about MeetBot at http://wiki.debian.org/MeetBot.
14:59:54 <zodbot> Useful Commands: #action #agreed #halp #info #idea #link #topic.
14:59:54 <zodbot> The meeting name has been set to 'fedora_qa_meeting'
15:00:02 <adamw> #meetingname fedora-qa
15:00:02 <zodbot> The meeting name has been set to 'fedora-qa'
15:00:08 <adamw> #topic Roll call
15:00:17 <adamw> morning folks! how's everyone doing?
15:00:24 <adamw> now give me five minutes to feed the cats
15:00:25 * kparal is here
15:00:31 <coremodule> good morning adamw
15:00:36 <tflink> morning
15:00:43 <bcotton> .hello2
15:00:53 <zodbot> bcotton: bcotton 'Ben Cotton' <bcotton@redhat.com>
15:02:34 <Southern_Gentlem> .hello jbwillia
15:02:35 <zodbot> Southern_Gentlem: jbwillia 'Ben Williams' <vaioof@gmail.com>
15:05:11 <lruzicka> .hello
15:05:11 <zodbot> lruzicka: (hello <an alias, 1 argument>) -- Alias for "hellomynameis $1".
15:05:18 <lruzicka> .hello2
15:05:24 <zodbot> lruzicka: lruzicka 'Lukáš Růžička' <lruzicka@redhat.com>
15:07:08 <adamw> alllrighty
15:07:16 * cmurf waves
15:07:33 <adamw> #topic Previous meeting follow-up
15:07:48 <adamw> #info there were no action items at last meeting
15:07:51 <adamw> any other stuff left over?
15:08:31 * kparal shrugs
15:10:41 * sumantro is around
15:11:32 <cmurf> 1 hour past beer O'clock in Brno
15:12:01 <adamw> okay
15:12:08 <adamw> #topic Fedora 33 status
15:12:20 <bcotton> cmurf: that implies a time when it's not beer o'clock in brno
15:12:39 <adamw> so, we didn't have a compose for a week due to the datacenter move (coming up!)
15:12:48 <adamw> but aside from that i'm not aware of anything on fire in f33, still
15:13:05 <adamw> i'm sure this unnatural and disturbing state will end soon
15:13:18 <cmurf> wait until the features start landing :D
15:13:41 <cmurf> is there going to be a mass or partial rebuild? gcc 10.1?
15:14:29 <bcotton> there will be a mass rebuild, hopefully on time even
15:15:05 <bcotton> i have been assured that our builder capacity will be back to normal in time for the mass rebuild to start
15:15:36 <cmurf> cool
15:16:23 <nirik> rawhide is broken. ;)
15:16:29 <adamw> nirik: excellent!
15:16:39 <kparal> finally some good news
15:16:51 <adamw> nirik: normal brokenness?
15:17:00 <nirik> lorax is trying to write to /proc/something and failing.
15:17:11 <nirik> I am not sure if thats new mock in the new datanceter or what
15:17:24 <adamw> okay, so i'll try and help with that after this
15:17:42 <adamw> #info composes have not started working again since data center move, nirik is working on it
15:18:09 <adamw> #info up till DC move Rawhide was mostly working well with some minor bugs, but don't worry, we have many features still to land and the mass rebuild coming up so we're sure it'll be properly broken soon
15:19:05 <adamw> anything else on f33?
15:19:54 <kparal> we have a new test case live, if that counts
15:20:08 <kparal> https://fedoraproject.org/wiki/QA:Testcase_desktop_user_switching
15:20:12 <kparal> https://pagure.io/fedora-qa/issue/630
15:22:15 <adamw> exciting!
15:22:23 <adamw> we also have a bunch of new IoT test cases
15:22:27 <adamw> so ha ha we win
15:22:54 <adamw> oh, yeah, I'm not sure it's been covered at a meeting, so:
15:23:17 <adamw> #info IoT validation events are (or were, before the DC move) up and running and seem to be working fine. still unknown whether IoT will be release-blocking for 33 yet.
15:24:30 <Southern_Gentlem> for f33 what is the end date to submit a new spin
15:24:45 <adamw> bcotton: ?
15:25:09 <bcotton> Southern_Gentlem: let's call it the self-contained change deadline
15:25:24 <bcotton> Southern_Gentlem: so July 21
15:25:54 <Southern_Gentlem> and it must go through the spin-masters by that point correct?
15:26:10 <bcotton> that doesn't really...exist.... any more, afaict
15:26:31 <Southern_Gentlem> so whom needs to approve it
15:26:36 <bcotton> for the Comp Neuro lab, we treated it as a self-contained change
15:26:47 <bcotton> so it went to the community for a week and then to FESCo for approval
15:27:05 <nirik> it's a change
15:27:17 <bcotton> somewhere in my stack of "docs to improve and policies to clarify", i have a card for the spins process
15:27:18 <nirik> like any other... there's no more spins process... thats gone
15:27:47 <adamw> nobody breathe on the pile
15:27:50 <adamw> okey dokey
15:27:53 <bcotton> Southern_Gentlem: see https://docs.fedoraproject.org/en-US/program_management/changes_policy/ for guidance (and please let me know if anything is unclear)
15:28:15 <Southern_Gentlem> fyi the i3 sig has a working ks
15:28:58 <bcotton> awesome :-D
15:29:05 <Southern_Gentlem> and the respin-sig is assisting  (there will be a i3-lxde and i3-xfce released this afternoon)
15:29:22 <Southern_Gentlem> for F32
15:30:07 <adamw> ok, moving on...
15:30:09 <adamw> #topic Data center move updates
15:30:50 <adamw> so, in case anyone just woke from hibernation and was unaware, we are in the middle of moving more or less the entire Fedora infrastructure from one data center (phx2) to another (iad2)
15:30:55 <adamw> and by "we" i mean "nirik" :P
15:31:41 <nirik> and smooge! :) and others
15:32:20 <adamw> this process has been ongoing for a while but started really kicking into high gear last week as critical stuff like koji and bodhi got moved. in general any infra-related weirdnesses you see (sites being down that should be up, odd behaviours in sites and tools like fedpkg) are probably related. you can drop by #fedora-noc to get a general idea of what's currently on fire in this process
15:32:56 <adamw> if you see a really obvious problem like 'koji is down' you probably don't need to file a ticket, if you see a more subtle issue that someone might not have noticed yet, i guess file an infra ticket and/or drop by #fedora-noc and mention it
15:33:31 <nirik> everything is logically moved from phx2 now. Next is moving all the turned off stuff in old DC -> new DC, reinstalling it and adding it back in to add capacity.
15:33:37 <adamw> staging instances of various things will be down or not working as part of this, as we have less hardware up in the new DC than we had in the old DC for now.
15:33:57 <adamw> to swing around to QA stuff: openQA staging is one of those things. it's down for now until we have more hardware available
15:34:27 <adamw> this means we unfortunately don't have aarch64 or ppc64le tests happening right now. i'll try to get them back ASAP (either by getting staging deployed, or bringing them up on prod)
15:34:50 <adamw> #info openQA staging is down as part of the DC move, so are aarch64 and ppc64le testing. adam will try to get them back ASAP
15:35:04 <adamw> #info resultsdb and openQA prod are migrated to the new DC and seem to be working well, please report any issues you see
15:35:19 <adamw> #info the rest of Taskotron is retired for ever, may it rest in peace
15:35:38 <adamw> #info blockerbugs prod is migrated and seems to be working also
15:35:52 <adamw> not sure where we're at with testdays app, i think we're still using our own deployment?
15:36:16 <kparal> I believe so
15:37:38 <adamw> welp, whatever it is, it's working :D
15:37:46 <adamw> #info testdays webapp is currently up too
15:38:02 <adamw> so overall we're in decent shape there.
15:38:08 <adamw> any other notes/questions on this?
15:39:17 <kparal> nothing here
15:40:36 <lruzicka> ack
15:40:44 <adamw> #info DC migration continues, please report any problems you see to infra
15:40:51 <adamw> #topic Test Day / community event status
15:41:02 <adamw> #chair sumantro
15:41:02 <zodbot> Current chairs: adamw sumantro
15:41:05 <adamw> sumantro, take it away!
15:41:11 <adamw> (then bring it back again)
15:41:28 <sumantro> adamw https://fedoraproject.org/wiki/Test_Day:Fedora_32_CoreOS_2020-06-08 has the results of the test day
15:42:12 <sumantro> the FCOS test day was succesful and we are awaiting feedback from coreos team on https://github.com/coreos/fedora-coreos-tracker/issues/491
15:42:39 <adamw> awesome
15:42:44 <sumantro> the test kernel test week is from 22-19 http://testdays.fedorainfracloud.org/events/85
15:43:07 <sumantro> and ZRAM test day is in progress and we are waiting to write test cases
15:43:41 <kparal> for cmurf to write them, I think :)
15:43:56 <sumantro> the test day page is being tracked  https://pagure.io/fedora-qa/issue/632
15:44:48 <sumantro> cmurf, proposed to have btrfs test day which stems from btrfs as default WS WG proposal
15:45:35 <adamw> how about onboarding?
15:45:35 <sumantro> There was an onboarding call also, and about 20 ppl participated
15:45:39 <adamw> ah, there we go :D
15:45:43 <adamw> awesome
15:45:58 <sumantro> the recording will be shared on fedora's youtube and the test list by tonight
15:46:00 <cmurf> yeah working on the zram tests and also some upstream features are still being fleshed out; and btrfs stuff is an R&D project still, no proposal yet
15:46:21 <cmurf> i think the main question WRT swap on zram is the issue of upgrades
15:46:22 <sumantro> adamw, I would like to thank coremodule for helping aq lot!
15:46:46 <coremodule> of course
15:46:47 <cmurf> i'm confident in it, but this means nothing. it's probably a good idea to not do it for upgrades
15:47:07 <coremodule> sumantro ran the call, I just shared some cloud/AWS/coreos specific tasks
15:47:46 <adamw> #info CoreOS Test Day happened successfully on 2020-06-08: https://fedoraproject.org/wiki/Test_Day:Fedora_32_CoreOS_2020-06-08
15:48:00 <adamw> #info onboarding event also wrapped up successfully with ~20 participants
15:48:33 <adamw> #info kernel test week is coming from 2020-06-22 to 2020-06-29: https://fedoraproject.org/wiki/Test_Day:2020-06-22_Kernel_5.7_Test_Week
15:48:49 <adamw> #info sumantro and cmurf are working on swap-on-zram test day
15:49:05 <adamw> thanks sumantro!
15:49:26 <adamw> #topic Open floor
15:49:29 <adamw> any other business, folks?
15:49:59 <kparal> nothing here
15:50:26 <tflink> nothing here, either
15:50:43 <lruzicka> i do not have anyting
15:54:27 <adamw> welp then
15:54:51 <adamw> it's beer o' clock somewhere
15:54:53 <adamw> (probably brno)
15:55:01 <adamw> thanks for coming, folks!
15:55:12 <kparal> thanks adamw
15:56:30 <adamw> #endmeeting