2025-07-31 15:00:10 <@davdunc:fedora.im> !startmeeting fedora_cloud_meeting 2025-07-31 15:00:11 <@meetbot:fedora.im> Meeting started at 2025-07-31 15:00:10 UTC 2025-07-31 15:00:12 <@meetbot:fedora.im> The Meeting name is 'fedora_cloud_meeting' 2025-07-31 15:00:21 <@davdunc:fedora.im> !topic roll call 2025-07-31 15:01:58 <@davdunc:fedora.im> !topic actions from last meeting 2025-07-31 15:02:13 <@davdunc:fedora.im> !topic action items from last meeting 2025-07-31 15:03:30 <@conan_kudo:matrix.org> !hi 2025-07-31 15:03:33 <@zodbot:fedora.im> Neal Gompa (ngompa) - he / him / his 2025-07-31 15:04:29 <@davdunc:fedora.im> Hey Neal! 2025-07-31 15:05:01 <@davdunc:fedora.im> So I am not going to fret over the action items because we have had a full two cycles. 2025-07-31 15:05:32 <@jcline:fedora.im> !hi 2025-07-31 15:05:34 <@zodbot:fedora.im> Jeremy Cline (jcline) - he / him / his 2025-07-31 15:05:48 <@davdunc:fedora.im> hey Jeremy Cline ! 2025-07-31 15:06:29 <@davdunc:fedora.im> sorry I have been absent. we had a big reorg over the past couple of weeks and I lost some colleagues. It's been complicated to resorb that workload. 2025-07-31 15:06:49 <@davdunc:fedora.im> (before that I was in MX in the woods) 2025-07-31 15:07:10 <@davdunc:fedora.im> but I'm back now. 2025-07-31 15:07:32 <@davdunc:fedora.im> !topic Rawhide EC2 images failing to build because ec2-instance-connect was retired 2025-07-31 15:07:45 <@davdunc:fedora.im> #link https://pagure.io/cloud-sig/issue/443 2025-07-31 15:07:59 <@davdunc:fedora.im> !link https://pagure.io/cloud-sig/issue/443 2025-07-31 15:08:10 <@davdunc:fedora.im> :D old habits die hard. 2025-07-31 15:08:22 <@davdunc:fedora.im> I am planning to pick this package up. 2025-07-31 15:08:32 <@conan_kudo:matrix.org> you mean you already did 2025-07-31 15:08:43 <@conan_kudo:matrix.org> !link https://src.fedoraproject.org/rpms/ec2-instance-connect 2025-07-31 15:08:53 <@davdunc:fedora.im> haha. okay. thanks. 2025-07-31 15:09:11 <@conan_kudo:matrix.org> I revived it and transferred it to you 2025-07-31 15:09:21 <@davdunc:fedora.im> aha. thanks. 2025-07-31 15:09:48 <@davdunc:fedora.im> I did a business case forit internally to identify the impact and I think I have support for it. 2025-07-31 15:10:02 <@conan_kudo:matrix.org> excellent 2025-07-31 15:10:59 <@davdunc:fedora.im> Thank you Neal for your help and support. 2025-07-31 15:12:00 <@adamwill:fedora.im> i think it being unretired might mean it's fixed already, let me check 2025-07-31 15:12:35 <@adamwill:fedora.im> yeah, today's compose had the package in it and has EC2 images, so you can go ahead and close it 2025-07-31 15:12:49 <@adamwill:fedora.im> Or I will 2025-07-31 15:12:52 <@davdunc:fedora.im> @adamw yea. I think that neal did it. Thanks for reporting it. 2025-07-31 15:13:01 <@davdunc:fedora.im> I have it now. 2025-07-31 15:14:20 <@davdunc:fedora.im> !topic #442 Please push new Fedora 42 images to Hashicorp vagrant registry 2025-07-31 15:14:42 <@davdunc:fedora.im> I missed on this one as a result of the tumult. I'll get to this Friday. 2025-07-31 15:15:47 <@davdunc:fedora.im> !link https://pagure.io/cloud-sig/issue/442 2025-07-31 15:16:09 <@davdunc:fedora.im> !action davdunc to complete the vagrant image upload links by Friday Aug 1. 2025-07-31 15:17:22 <@davdunc:fedora.im> !topic #441 cloud images are missing `saved_entry` in grubenv 2025-07-31 15:17:32 <@davdunc:fedora.im> !link https://pagure.io/cloud-sig/issue/441 2025-07-31 15:18:01 <@davdunc:fedora.im> Neal Gompa (Fedora) do you know where we stand on this investigation? 2025-07-31 15:18:50 <@davdunc:fedora.im> I'll take that as a "busy right now" 2025-07-31 15:18:51 <@nhanlon:beeper.com> !hi 2025-07-31 15:18:52 <@zodbot:fedora.im> Neil Hanlon (neil) - he / him / his 2025-07-31 15:19:00 <@davdunc:fedora.im> hey Neil! 2025-07-31 15:19:06 <@nhanlon:beeper.com> heya Dave 2025-07-31 15:19:08 <@nhanlon:beeper.com> howzit 2025-07-31 15:19:12 <@davdunc:fedora.im> thanks for dropping in! 2025-07-31 15:19:20 <@davdunc:fedora.im> it's grubby right now! :) 2025-07-31 15:19:38 <@nhanlon:beeper.com> 🙂 I've got my travel router plugged into my actual router providing internet right now 2025-07-31 15:19:50 <@nhanlon:beeper.com> because someone cut the fiber trunk thru town 2025-07-31 15:20:09 <@davdunc:fedora.im> whoa! 2025-07-31 15:20:11 <@nhanlon:beeper.com> who even needs path diversity, anyway 2025-07-31 15:20:14 <@nhanlon:beeper.com> who even needs path diversity, anyways 2025-07-31 15:20:31 <@davdunc:fedora.im> haha. 2025-07-31 15:20:35 <@nhanlon:beeper.com> i'm just struggling to understand how they cut a fiber bundle using a hydrovac, but.. idk. i'm not a real engineer 😛 2025-07-31 15:20:38 <@nhanlon:beeper.com> back to cloud things 😛 2025-07-31 15:21:34 <@davdunc:fedora.im> So Martin stated that there is some randomness to the kernel that boots first in the cloud images? Is that what I am to understand from his last statement? 2025-07-31 15:22:19 <@davdunc:fedora.im> Neal seemed to think that we were on the right path to fix the issue, but I don't see agreement from the reporter. 2025-07-31 15:22:59 <@nhanlon:beeper.com> /me looks 2025-07-31 15:23:02 <@davdunc:fedora.im> Jeremy Cline are you familiar with "the randomness"? 2025-07-31 15:24:31 <@jcline:fedora.im> No, I've not looked into this 2025-07-31 15:24:42 <@conan_kudo:matrix.org> I'm not sure what is still creating this problem 2025-07-31 15:25:51 <@davdunc:fedora.im> I can understand that. 2025-07-31 15:27:17 <@davdunc:fedora.im> I'll engage Martin in the ticket to see if he has an idea of what or why this is occurring and we have the reproducer here with his one command it looks like. 2025-07-31 15:27:39 <@davdunc:fedora.im> !action davdunc to update the ticket and followup with Martin on possible areas to explore. 2025-07-31 15:28:18 <@conan_kudo:matrix.org> oh now I understand what's happening 2025-07-31 15:28:32 <@conan_kudo:matrix.org> `grub2-editenv` is for some reason not in the cloud images 2025-07-31 15:28:32 <@davdunc:fedora.im> oh awesome. 2025-07-31 15:28:58 <@davdunc:fedora.im> hmm. okay. so we need to add it. it's helpful to have it. 2025-07-31 15:28:58 <@conan_kudo:matrix.org> [ DEBUG ]: 17:22:08 | /image/config.sh: line 46: [[Cloud-Base-AmazonEC2,CloudCore,BootCore: command not found 2025-07-31 15:28:58 <@conan_kudo:matrix.org> ``` 2025-07-31 15:28:58 <@conan_kudo:matrix.org> ``` 2025-07-31 15:29:07 <@conan_kudo:matrix.org> command not found on the line running that command 2025-07-31 15:29:36 <@davdunc:fedora.im> cool. That's easy enough to remedy. 2025-07-31 15:30:17 <@jcline:fedora.im> Hm, should that script be set to fail if a command fails? 2025-07-31 15:31:03 <@conan_kudo:matrix.org> yeah 2025-07-31 15:31:10 <@conan_kudo:matrix.org> but I thought I had already done that 2025-07-31 15:32:02 <@conan_kudo:matrix.org> `set -euxo pipefail` is supposed to make that fail 2025-07-31 15:32:15 <@davdunc:fedora.im> in a big way. 2025-07-31 15:32:21 <@jcline:fedora.im> Weird 2025-07-31 15:32:49 <@jcline:fedora.im> My bash skills are... not good, so I have no idea 2025-07-31 15:34:26 <@davdunc:fedora.im> yea. that's basically identifying that if any issues occur, get out. 2025-07-31 15:36:18 <@davdunc:fedora.im> okay. So we have a path to completion. That's awesome. 2025-07-31 15:37:32 <@conan_kudo:matrix.org> I'm confused though 2025-07-31 15:37:42 <@conan_kudo:matrix.org> it should be present since the grub efi packages require grub2-tools-minimal 2025-07-31 15:39:15 <@davdunc:fedora.im> yea. I'm seeing this a a glass half full moment Neal Gompa (Fedora) in that the issue is somewhat identified and we have a trajectory and a describable problem fix even if there is a new obstacle in the way of making that one work. :D 2025-07-31 15:40:29 <@davdunc:fedora.im> !topic QA changes in scope. 2025-07-31 15:42:09 <@davdunc:fedora.im> do we need to be working on building more of our own support? adamw is there something that we need to do for you as a SIG or as members of the QE 2025-07-31 15:42:29 <@adamwill:fedora.im> the main thing would be to implement automated real-cloud testing 2025-07-31 15:42:35 <@adamwill:fedora.im> because right now i always wind up doing that manually 2025-07-31 15:43:10 <@adamwill:fedora.im> if we had that i think all testing would be automated 2025-07-31 15:43:24 <@jcline:fedora.im> So I've talked to a couple folks internally, and we were already planning to run some set of LISA tests against the Azure images. Supposedly LISA also does AWS, but not GCP. 2025-07-31 15:43:42 <@adamwill:fedora.im> that's all i ever test on manually, so hey. but of course testing on more would be great. 2025-07-31 15:44:05 <@adamwill:fedora.im> it would also need to be hooked up to the wiki reportotron 2025-07-31 15:44:11 <@adamwill:fedora.im> i can help with that bit if you can get tests actually running 2025-07-31 15:44:18 <@davdunc:fedora.im> Jeremy Cline we can talk to @ajorgensen at GCP and get his assessment on what tools we need to use there or how they might be able to help us update the LISA tests. 2025-07-31 15:44:19 <@jcline:fedora.im> My initial plan is to add another consumer that either lives with the image uploader or in its own place (doesn't really matter for this discussion) that runs the test suite on every new image and publishes the results via AMQP 2025-07-31 15:44:36 <@davdunc:fedora.im> I personally like the public test suite from Azure. 2025-07-31 15:44:53 <@jcline:fedora.im> We could also tag the images that pass all the tests and promote them automatically 2025-07-31 15:45:13 <@davdunc:fedora.im> I like that. 2025-07-31 15:46:30 <@davdunc:fedora.im> There are a lot of validations that only need one pass on one provider. 2025-07-31 15:46:54 <@jcline:fedora.im> One of my teammates has already written a little fedora-messaging consumer that runs the LISA tests on the Azure images, we just need to get that reviewed and running in Fedora infra and then we can build it out to cover AWS and GCP 2025-07-31 15:47:40 <@davdunc:fedora.im> I am happy to help with that! 2025-07-31 15:47:51 <@davdunc:fedora.im> (for as much help as I can be) 2025-07-31 15:48:21 <@davdunc:fedora.im> I don't want to slow you down too much, but I also don't want you to be the SPOF. 2025-07-31 15:49:05 <@davdunc:fedora.im> okay. I think we have a path forward here. 2025-07-31 15:49:42 <@davdunc:fedora.im> I just don't want to drop in quality beause Adam has enough responsiblity. 2025-07-31 15:49:44 <@jcline:fedora.im> My plan is mostly to help my teammate handle a lot of it, and mostly handle the deployment and maintenance 2025-07-31 15:49:56 <@davdunc:fedora.im> okay. awesome. 2025-07-31 15:50:39 <@jcline:fedora.im> We'd probably run the tier 1 test suite for each image (https://mslisa.readthedocs.io/en/main/run_test/microsoft_tests.html#test-tier) and then maybe higher tier test suites less frequently 2025-07-31 15:51:50 <@jcline:fedora.im> And if there's anything that's not covered by the tier 1 tests that are in the manual tests we've been running we can add that. My understanding is the LISA folks are happy to take PRs. 2025-07-31 15:52:04 <@davdunc:fedora.im> yea -- just for beta and rc or where there is a specific test related to a feature change or addition. 2025-07-31 15:53:46 <@davdunc:fedora.im> okay. 2025-07-31 15:54:16 <@davdunc:fedora.im> So what I am seeing here is that we think that LISA is the right tool to adopt for testing. adamw any objections? 2025-07-31 15:54:33 <@davdunc:fedora.im> (sorry to keep pinging you.) 2025-07-31 15:54:57 <@davdunc:fedora.im> he can raise them any time, I suppose. 2025-07-31 15:55:17 <@davdunc:fedora.im> !link https://mslisa.readthedocs.io/en/main/quick_start.html 2025-07-31 15:55:52 <@davdunc:fedora.im> !info Cloud SIG is officially adopting the LISA testing tools for platform validations. 2025-07-31 15:56:00 <@jcline:fedora.im> My plan for the higher tiers was maybe once a month or something, depending on how much it ends of costing. Some of the tests are for VMs with several hundred cores or 2TB of RAM, for example. 2025-07-31 15:56:14 <@davdunc:fedora.im> ah gotcha. 2025-07-31 15:56:48 <@davdunc:fedora.im> yea. I just ran into an issue (not with Fedora) on an extra large instance type with a gazillion vcpus. 2025-07-31 15:57:38 <@davdunc:fedora.im> but they are really immediate and not typically an issue unless there is a major change in a subsystem for the kernel or deprecation in the glibc. 2025-07-31 15:58:06 <@davdunc:fedora.im> !topic open floor 2025-07-31 15:58:28 <@davdunc:fedora.im> Anyone have something that they want to cover in the next "one minute". :D 2025-07-31 15:58:44 <@davdunc:fedora.im> once . . . 2025-07-31 15:58:49 <@davdunc:fedora.im> twice . . . 2025-07-31 15:58:56 <@davdunc:fedora.im> !endmeeting