16:00:14 <jednorozec> #startmeeting RELENG (2023-08-22)
16:00:14 <zodbot> Meeting started Tue Aug 22 16:00:14 2023 UTC.
16:00:14 <zodbot> This meeting is logged and archived in a public location.
16:00:14 <zodbot> The chair is jednorozec. Information about MeetBot at https://fedoraproject.org/wiki/Zodbot#Meeting_Functions.
16:00:14 <zodbot> Useful Commands: #action #agreed #halp #info #idea #link #topic.
16:00:14 <zodbot> The meeting name has been set to 'releng_(2023-08-22)'
16:00:15 <jednorozec> #meetingname releng
16:00:15 <zodbot> The meeting name has been set to 'releng'
16:00:15 <jednorozec> #chair nirik sharkcz pbrobinson phsmoura dustymabe jednorozec
16:00:15 <jednorozec> #topic init process
16:00:15 <zodbot> Current chairs: dustymabe jednorozec nirik pbrobinson phsmoura sharkcz
16:00:33 * bittin is here
16:00:59 <nirik> morning
16:01:12 * pcreech waves
16:01:57 <jednorozec> hello and welcome
16:02:14 <jednorozec> I dont have much for today, just few quick things
16:02:27 <jednorozec> #topic Fedora 39 is frozen
16:02:52 <jednorozec> updates-testing is active
16:03:09 <jednorozec> or it should be
16:03:17 <jednorozec> I didnt check actually
16:03:56 <jednorozec> oh it works bunch of updates is in testing https://bodhi.fedoraproject.org/releases/F39
16:04:35 <bittin> neat, do i want to update my Fedora 38 i3 install on my laptop or will i regret it? :P
16:05:37 * jednorozec is running branched on desktop so far so good
16:06:58 <nirik> up to you. ;)
16:07:04 <bittin> heh fair enough
16:08:10 <jednorozec> ok I think that is for the branched
16:08:20 <jednorozec> .releng 11621
16:08:21 <zodbot> jednorozec: Issue #11621: Packages not being retired from f39 / branched - releng - Pagure.io - https://pagure.io/releng/issue/11621
16:08:27 <jednorozec> SO this is weird
16:08:47 <jednorozec> it seems like the block_retired.py has a bug in it
16:08:57 <nirik> :(
16:09:12 <jednorozec> I am not sure where it is but will dig a bit more
16:09:46 <jednorozec> I will keep this ticket opened and use those 2 packages as a testing ground so we know it works
16:10:10 <nirik> Oh shoot, I was gonna do another f37/f38 stable push... ran out of time last night.
16:10:15 <jednorozec> I have gathered few jsons today and will throw it at the script
16:10:37 <jednorozec> nirik, oh did we break something?
16:11:08 * jednorozec want the official title of release breaker
16:11:18 <jednorozec> maybe we can get a badge :)
16:11:34 <nirik> well, we need linux-firmware update in f37 to make ostree composes not fail, and there's some budgie desktop fixes in both we wanted to go out asap...
16:11:41 <nirik> naw... nothing too breaky
16:11:59 <jednorozec> I have session on bodhibacked
16:12:02 <jednorozec> can do the push
16:12:25 <nirik> just did. sorry.
16:12:56 <jednorozec> I have just one more
16:13:00 <jednorozec> .releng 11527
16:13:01 <zodbot> jednorozec: Issue #11527: Fix tokens for ftbfs_weekly_reminder. script - releng - Pagure.io - https://pagure.io/releng/issue/11527
16:13:08 <jednorozec> I think we are good on prod
16:13:16 <jednorozec> not sure if/what to do with stg
16:14:05 <nirik> stg should be using the staging bugzilla...
16:14:10 <nirik> we should be able to get a token from it.
16:14:26 <jednorozec> and its stored in ansible?
16:14:35 <nirik> should be
16:14:42 <jednorozec> hmm I missed it
16:14:51 <jednorozec> because did the update for prod there
16:15:09 <nirik> might be we never set it there? but we should have
16:16:17 <jednorozec> nope its not there
16:16:25 <jednorozec> there is only one entry for ftbfs
16:18:27 <nirik> I'd need to dig around, but I can...
16:18:45 <jednorozec> I can look how it is deployed
16:18:48 <jednorozec> and check
16:19:02 <jednorozec> was just confused that there is only ftbfs no stg mentioned there
16:19:23 <jednorozec> there is also no releng credentials for stg
16:20:54 <nirik> I think the login/etc is the same (because they sync prod to stg sometimes or used to)
16:21:07 <nirik> it might be we never setup stg seperately
16:21:46 <jednorozec> for some we did
16:21:49 <jednorozec> anyhow
16:22:01 <jednorozec> .releng 10724
16:22:02 <zodbot> jednorozec: Issue #10724: Package rubygem-ruby_parser is retired in dist git, but PDC still see it as active - releng - Pagure.io - https://pagure.io/releng/issue/10724
16:22:05 <jednorozec> I think we can close this
16:23:18 <nirik> ok
16:24:30 <jednorozec> and that is it from me
16:25:15 <nirik> I had a few things to just note...
16:25:43 * bittin does not really have anything is tired after dayjob and fighting with simcards and cellphones, forgot my phone at the bus 2 weeks ago so got my little sisters old and had to fight with Comviq/Tele2 to get a working simcard with old number on it
16:26:03 <bittin> as the old one got stolen
16:26:11 <jednorozec> :(
16:26:27 <nirik> The buildvm-ppc64le's were unstable after last weeks updates. They would stop checking in to koji after a while. I tried various things and finally downgrading the hosts to 6.3.x kernels seemed to do the trick. We will need to track down whats happening someday. At least we should be ok for freeze, as long as we don't reboot them.
16:26:40 <nirik> bittin: sorry to hear it. ;(
16:27:48 <nirik> Also, we hit max space on koji again last thursday. ;( I cleaned up some snapshots and got storage folks to enable compression, but thats not gonna save us completely. I am going to look into getting the moving of builds to archives working again during beta freeze.
16:28:06 <bittin> jednorozec: nirik: well got my sisters old one and a new sim card from my phone provider, but was some hassle for 1,5-2weeks oh well not really related to Fedora releases
16:28:32 <jednorozec> nirik, how is the moving to archives done? or was?
16:28:39 <nirik> yeah, so much of our lives is on phones these days. ;(
16:28:56 <bittin> idd
16:29:08 * jednorozec proudly does not use phone for nothing just 2factorauthapp
16:29:19 <nirik> it's a koji-tools script. But... the last time I tried to run it it... caused doom. It deleted active things that broke builds and was a big mess.
16:29:40 <jednorozec> oh
16:29:44 <jednorozec> *fun*
16:29:47 <nirik> so I am going to try some dry runs on it and see if I can see what it would do, and then after freeze we can carefully try and run it again
16:30:18 <nirik> 7.1TB of our packages is... kernel. ;)
16:31:04 <jednorozec> nice collection
16:31:15 <nirik> compression is currently saving us 734GB
16:31:23 <nirik> so thats slowly increasing over time
16:32:18 <nirik> anyhow, just wanted to note it...
16:32:21 <jednorozec> yeah, I had to turn compression on my zfs pool
16:32:44 * jednorozec needs new sniping rust
16:32:51 <nirik> /vol/fedora_koji/         95TB       92TB     2776GB      97%  /fedora_koji
16:33:02 <jednorozec> uuh
16:33:44 <nirik> so many packages. ;)
16:33:59 <nirik> (and snapshots take a lot)
16:35:48 <nirik> anyhow, i don't think I have anything else... at least that I can think of
16:36:24 <jednorozec> lets close early today
16:36:37 <bittin> alright, thanks for today
16:37:17 <jednorozec> #endmeeting