15:58:21 #startmeeting fedora_cloud_meeting 15:58:21 Meeting started Tue Aug 18 15:58:21 2020 UTC. 15:58:21 This meeting is logged and archived in a public location. 15:58:21 The chair is dustymabe. Information about MeetBot at http://wiki.debian.org/MeetBot. 15:58:21 Useful Commands: #action #agreed #halp #info #idea #link #topic. 15:58:21 The meeting name has been set to 'fedora_cloud_meeting' 15:58:26 #topic roll call 15:58:30 .hello2 15:58:31 dustymabe: dustymabe 'Dusty Mabe' 15:58:53 .hello2 15:58:54 .hello2 15:58:54 jdoss: jdoss 'Joe Doss' 15:58:57 cyberpear: cyberpear 'James Cassell' 15:59:47 \o/ 15:59:49 welcome all 16:00:52 waiting for a few more to join if possible 16:01:38 ok we'll get started 16:01:53 #chair cyberpear jdoss 16:01:53 Current chairs: cyberpear dustymabe jdoss 16:01:59 #topic Action items from last meeting 16:02:10 #chair michaelgugino 16:02:10 Current chairs: cyberpear dustymabe jdoss michaelgugino 16:02:29 * King_InuYasha to engage mhayden to see if the cloud base images might 16:02:31 be a good candidate for Image Builder 16:02:47 looks like Neal isn't around today 16:02:50 .hello2 16:02:51 michaelgugino: michaelgugino 'Michael Gugino' 16:03:10 .hello ngompa 16:03:13 King_InuYasha: ngompa 'Neal Gompa' 16:03:15 #chair King_InuYasha 16:03:15 Current chairs: King_InuYasha cyberpear dustymabe jdoss michaelgugino 16:03:18 hey folks 16:03:27 * King_InuYasha to engage mhayden to see if the cloud base images might 16:03:27 Hey Neal 16:03:29 be a good candidate for Image Builder 16:04:27 I hadn't emailed mhayden yet, but I did have a conversation during Nest that made me think that the solution might not be so simple 16:05:09 ok any more you want to add or should we move on? 16:05:17 nah, I'm good 16:05:21 #action King_InuYasha to engage mhayden to see if the cloud base images might be a good candidate for Image Builder 16:05:22 I'll email Major after this meeting 16:05:44 this is probably going to prompt discussions of how to wire this up to Koji 16:06:00 because right now, we have no way to use osbuild in our compose pipeline 16:06:48 +1 16:06:52 let me find a meeting ticket 16:07:47 #topic publish a cloud image for GCP 16:07:51 #link https://pagure.io/cloud-sig/issue/310 16:08:18 #info The engineer from google has posted up a proposed kickstart for creating and image for GCP 16:08:40 i need to look into it and see if we can get that into our build system for f33 16:09:21 last I tried cloud-init was broken on GCP, but I know dustymabe mentioned major had some steps to replace cloud-init with google's stuff. 16:09:22 tie in with FCOS images? or is it purely a kickstart issue? 16:09:34 That was like a year ago at this point, so IDK. 16:09:42 cyberpear: this is for fedora cloud base 16:09:55 can we make sure GCP images are UEFI? 16:10:07 That Issue has a uefi script in it 16:10:52 King_InuYasha: yeah I think that should be the default - just make it UEFI 16:11:06 we'd have a specific image for GCP I think 16:11:15 and not just make it part of a single cloud base image 16:11:16 I think we already have to anyway 16:11:36 we might want to reuse that pipeline for making an Azure image if the osbuild stuff doesn't work out 16:11:43 and a Generic Cloud UEFI image 16:12:54 yeah, though if we include the GCP tooling inside the image at some point 16:13:00 we'll probably want individual images 16:13:55 anything else to discuss this ticket? 16:15:12 #topic regular releases: uploading to clouds 16:15:16 #link https://pagure.io/cloud-sig/issue/301 16:15:24 michaelgugino: I think has an update here 16:15:32 Yeah 16:16:27 I've put together a basic POC dockerfile for listening to the fedora-messaging bits: https://github.com/michaelgugino/fed-image-watcher 16:17:14 I haven't incorporated the bits to look up the image urls, but it's pretty straight forward looking at fedimg's stuff. 16:17:21 #info POC for listening to fedora-messaging for doing cloud image uploads: https://github.com/michaelgugino/fed-image-watcher 16:17:52 I went down the dockerfile rabbit hole trying to figure out which is the most convenient base image to use. I settled on the s2i python image, that makes it trivial to install python things, but I'm open to suggesting. 16:17:58 #url https://github.com/michaelgugino/fed-image-watcher 16:18:21 michaelgugino: i typically just use Fedora as a base and add whatever I need on top of that 16:18:35 likewise 16:18:58 also note that pingou and his team has the "toddlers" framework for being able to listen and kick off things in infra 16:19:06 it might be worth talking to them about plugging into that framework 16:19:14 yep. this is basically the same model 16:20:01 thanks michaelgugino for working on this. i suppose you're just looking for feedback now? 16:20:42 One notable change in arch from fedimg, we can discuss the merits of here. Previously fedimg would fetch multiple items from the messaging queue, and then use another thread to upload them with an internal queue. I propose we don't do this. We want to only fetch one item from the queue, and upload one at a time. That way if the process fails, the queue items get nacked, and can get assigned to a different container. 16:22:17 so do it serially? 16:22:20 seems fine to me 16:22:55 Yeah, serially, but, in reality, we can spin up more than one container if we want to do more than one at once, just configure them both on the same queue. That would also give us some HA in case one goes down for some reason. 16:23:24 The builds aren't all that frequent compared to some other topics on the exchange, so serially will mostly be just as fast. 16:23:25 sounds like a good optimization to do later if we have problems 16:24:12 I think we should consume the fedora-messaging library as a binary using the CLI params vs using it python lib and building our own executable. This is what's being done here: https://github.com/michaelgugino/fed-image-watcher/commit/a6ae76fff891a1920b2afdd2b49ed7e660576d22#diff-04c6e90faac2675aa89e2176d2eec7d8R12 16:24:33 Those are the highlights, really. 16:24:38 serially in parallel :) 16:25:31 Running the fedora-messaging binary with the callback file as in my example repo, that gets you all the ack/nack stuff out of the box. Not much code to maintain, which is always good. 16:26:08 +1 16:26:26 michaelgugino: that's what my examples that I linked you to do right? use the fedora-messaging binary with the callback file 16:27:04 Yeah, I can't remember who showed me what at this point, but yes, probably :) 16:28:02 :) 16:28:10 any more items to discuss here? 16:28:24 Did we decide on what to actually upload things with? I think fedimg kicks off some kind of job or something so it's not actually pulling/uploading images directly. 16:28:39 I think King_InuYasha was looking at some tool the SuSe uses? 16:28:47 yeah 16:29:02 https://github.com/SUSE-Enceladus/mash 16:29:21 I hadn't packaged it up for Fedora yet, but it seems like it'd do everything we need 16:29:41 anybody want to volunteer to wire that up? 16:30:32 it would go well with using https://github.com/SUSE-Enceladus/img-proof for testing cloud images 16:32:01 already added support for Fedora into the tool: https://github.com/SUSE-Enceladus/img-proof/commit/b8a35010cd159c8c21b173594b145604aaac52ed 16:33:27 ok. we can move on probably. 16:33:34 I can maybe look at getting the image uploading bits to work with mash, I have access to the big 3 clouds. 16:33:44 that'd be awesome 16:34:07 thanks michaelgugino 16:34:23 King_InuYasha: can you work with michaelgugino to make sure he knows how to use mash ? 16:34:36 sure 16:34:42 King_InuYasha++ for cross distro work! 16:35:20 #action King_InuYasha and michaelgugino to work together to see if mash is a viable avenue for uploading disk images to the clouds 16:35:54 sounds good to me. 16:36:01 #topic open floor 16:36:08 anybody have anything for open floor? 16:36:12 jdoss: maybe? 16:36:39 I closed the initial change request for the cloud updates 16:36:50 because the can got kicked from F29ish to F33 16:37:13 jdoss: got ya 16:37:17 and I am pretty sure bcotton was going to lart me 16:37:29 Other than that, I don't have anything else. 16:38:54 cool 16:38:57 anyone else? 16:40:23 I had some old fixes for the ks files, might rebase and send... 16:41:07 https://github.com/jamescassell/fedora-kickstarts/commits/cloud-cleanup 16:41:46 nothing else from me 16:42:13 I got to drop. Talk to you all soon. 16:44:11 nothing else for me 16:44:22 #endmeeting