2024-02-06 17:01:58 <@jnsamyak:matrix.org> !startmeeting RELENG (2024-02-06)
2024-02-06 17:02:00 <@meetbot:fedora.im> Meeting started at 2024-02-06 17:01:58 UTC
2024-02-06 17:02:00 <@meetbot:fedora.im> The Meeting name is 'RELENG (2024-02-06)'
2024-02-06 17:02:10 <@jnsamyak:matrix.org> !meetingname releng
2024-02-06 17:02:16 <@jnsamyak:matrix.org> !chair nirik sharkcz pbrobinson phsmoura dustymabe jednorozec jnsamyak patrikp
2024-02-06 17:02:21 <@jnsamyak:matrix.org> !info Meeting is 60 minutes MAX. At the end of 60, it stop
2024-02-06 17:02:23 <@nirik:matrix.scrye.com> morning
2024-02-06 17:02:28 <@jnsamyak:matrix.org> !info agenda is at https://hackmd.io/vm6biLBcTYKtkQUH5kQkmw
2024-02-06 17:02:34 <@jnsamyak:matrix.org> !topic init process
2024-02-06 17:02:36 <@patrikp:matrix.org> Hello to all.
2024-02-06 17:02:50 <@jnsamyak:matrix.org> So i came up with this agenda which is basically releng meeting template
2024-02-06 17:03:20 <@nirik:matrix.scrye.com> cool. ;)
2024-02-06 17:03:32 <@jnsamyak:matrix.org> so in case folks others want to run they can and changes are welcome
2024-02-06 17:05:06 <@jnsamyak:matrix.org> So last week we finally finished mass rebuild, and the branching is suppose to happen in Feb 20!
2024-02-06 17:05:18 <@jnsamyak:matrix.org> regarding release process^
2024-02-06 17:06:11 <@nirik:matrix.scrye.com> yeah. Time flys
2024-02-06 17:06:30 <@jnsamyak:matrix.org> :o hope the branching is not crazy as rebuild
2024-02-06 17:07:41 <@nirik:matrix.scrye.com> yeah, me too, but sadly, branching is where we hit the most problems it seems like.
2024-02-06 17:07:48 <@jnsamyak:matrix.org> nirik: do you have something to bring up specifically for the init process? Otherwise we can discuss onto the tickets item  
2024-02-06 17:08:01 <@jnsamyak:matrix.org> yeah that's why I'm worried but as always we will get thru
2024-02-06 17:08:34 <@nirik:matrix.scrye.com> I plan after the mass updates/reboots tomorrow to start resigning everything with f41 key (so we are ready for branching). I think there's a schedule milestone for that...
2024-02-06 17:10:14 <@jnsamyak:matrix.org> okay I have one thing to ask, is there a process where we have to ask for key access to do &tuff? I remember vaguely but last time i found out people are added or given access in order to process some tasks
2024-02-06 17:11:14 <@nirik:matrix.scrye.com> you can just ask me, or I guess an infra ticket if you need access to do something...
2024-02-06 17:12:25 <@jnsamyak:matrix.org> Okay just wanted to know if there is a formal process to follow because i remeber we need to add the keys to ansible repo robosignotry files etc
2024-02-06 17:12:49 <@jnsamyak:matrix.org> that's all, we can move on to next topic if nothing else!
2024-02-06 17:14:41 <@nirik:matrix.scrye.com> ah, you mean signing keys?
2024-02-06 17:14:48 <@jnsamyak:matrix.org> yes :P
2024-02-06 17:15:08 <@nirik:matrix.scrye.com> I can get you setup there if you aren't already, but yeah...
2024-02-06 17:16:05 <@jnsamyak:matrix.org> yes pls, if there is anything to do on my side let me know and sounds good to me!
2024-02-06 17:16:11 <@jnsamyak:matrix.org> okay moving on
2024-02-06 17:16:12 <@jnsamyak:matrix.org> !topic Tickets needing attention
2024-02-06 17:16:44 <@jnsamyak:matrix.org> !info this is the time where you can bring releng tickets to discuss if there are blockers etc
2024-02-06 17:19:10 <@nirik:matrix.scrye.com> lets see...
2024-02-06 17:19:19 <@jnsamyak:matrix.org> I can start - I have one from my assigned ticket
2024-02-06 17:19:25 <@jnsamyak:matrix.org> !releng 11782
2024-02-06 17:19:26 <@zodbot:fedora.im> **releng #11782** (https://pagure.io/releng/issue/11782):**Update bootloader components assignee to "Bootloader Engineering Team"for Improved collaboration**

● **Opened:** 3 months ago by raravind
● **Last Updated:** 3 months ago
● **Assignee:** jnsamyak
2024-02-06 17:20:17 <@jnsamyak:matrix.org> So here the request was to create a dedicated fas account, but fas account should be directed to a mailing list - bootloader-eng-team@redhat.com
2024-02-06 17:20:21 <@nirik:matrix.scrye.com> um, ok...
2024-02-06 17:20:33 <@nirik:matrix.scrye.com> yeah, it really should be a group I think
2024-02-06 17:20:54 <@jnsamyak:matrix.org> I guess so as well but then they pointed out to an example which is this
2024-02-06 17:21:01 <@jnsamyak:matrix.org> https://src.fedoraproject.org/rpms/anaconda
2024-02-06 17:21:07 <@nirik:matrix.scrye.com> https://docs.fedoraproject.org/en-US/infra/howtos/groups_in_fedora/
2024-02-06 17:21:27 <@jnsamyak:matrix.org> (anaconda-maint) <<<< is the mailing list assigned 
2024-02-06 17:21:43 <@nirik:matrix.scrye.com> yeah... this I think it's a holdover from the old fas days...
2024-02-06 17:22:12 <@jnsamyak:matrix.org> also this needs to be in sysadmin-main correct inorder to create an user or group to get accerss IPA?
2024-02-06 17:23:16 <@nirik:matrix.scrye.com> ah... I see... ok.
2024-02-06 17:24:56 <@nirik:matrix.scrye.com> well, anyone could create the initial account, but then needs someone to add it to packager and change the address on it to the list, then login once to src.fedoraproject.org with it so it knows it's in packager and exists and finally give those packages to it.
2024-02-06 17:25:09 <@nirik:matrix.scrye.com> so, it's complicated sadly.
2024-02-06 17:26:04 <@nirik:matrix.scrye.com> so, perhaps we could both do it? if you can make the account initially with some email, I can add it to packager and change the address and you can then loign to src and reassign the packages?
2024-02-06 17:27:12 <@jnsamyak:matrix.org> ok i'll follow up with you on that
2024-02-06 17:27:23 <@jnsamyak:matrix.org> thanks that's all from my list of tickets
2024-02-06 17:27:39 <@nirik:matrix.scrye.com> ok, I have a few I think...
2024-02-06 17:27:47 <@jnsamyak:matrix.org> shooooot :D
2024-02-06 17:27:57 <@nirik:matrix.scrye.com> Well, there's a pile of unretires waiting. ;(
2024-02-06 17:28:05 <@nirik:matrix.scrye.com> I have had 0 time to look at them even
2024-02-06 17:28:59 <@jnsamyak:matrix.org> nirik: yeah so i am disabled in that matter, can we soooner rather than later set me up with pdc token and database so i can learn processing them?
2024-02-06 17:29:22 <@jnsamyak:matrix.org> I have 1:1 with jednorozec tomorrow i can ask him for his secret script :3
2024-02-06 17:29:25 <@nirik:matrix.scrye.com> Yep. Happy to do so... just let me know when
2024-02-06 17:29:58 <@jnsamyak:matrix.org> also Anton Medvedev was/is working on automating this but i guess that needs some changes and testing; lies in staging atm 
2024-02-06 17:30:13 <@nirik:matrix.scrye.com> There is a SOP I think. Just check that the package has been retired less than 8 weeks or has a re-review, then run the pdc script, give the package on src and unblock in koji.
2024-02-06 17:30:35 <@nirik:matrix.scrye.com> yeah, I think the automation was getting close, will be nice when thats there.
2024-02-06 17:30:55 <@jnsamyak:matrix.org> here's the sop: https://docs.fedoraproject.org/en-US/infra/releng_misc_guide/sop_unretire/#_unretiring_a_package_branch
2024-02-06 17:31:13 <@nirik:matrix.scrye.com> I think you should have perms for the unblocking and reassigning, just missing the pdc token? or ?
2024-02-06 17:31:55 <@jnsamyak:matrix.org> nirik: I hopefully will be awake for sometime after the meeting so i can start looking into it
2024-02-06 17:32:10 <@jnsamyak:matrix.org> yep i guess just the pdc token
2024-02-06 17:32:52 <@jnsamyak:matrix.org> but i can take one less impact ticket as my guinea pig
2024-02-06 17:33:04 <@jnsamyak:matrix.org> and figure out from there
2024-02-06 17:33:21 <@nirik:matrix.scrye.com> So, for the pdc token, I think it explains there how to get it?
2024-02-06 17:33:31 <@nirik:matrix.scrye.com> once you have one, I can give it perms in the db.
2024-02-06 17:33:45 <@jnsamyak:matrix.org> done will try it out 
2024-02-06 17:33:54 <@jnsamyak:matrix.org> https://pagure.io/releng/issues?status=Open&search_pattern=unretire&close_status= 12 tickets almost 
2024-02-06 17:34:02 <@nirik:matrix.scrye.com> or any sysadmin-mainer can via: https://docs.fedoraproject.org/en-US/infra/sysadmin_guide/pdc/#_adding_superusers
2024-02-06 17:34:39 <@nirik:matrix.scrye.com> yeah, they are piling up. ;) Also... if someone files one and needs to do a re-review... IMHO we should close those... ask them to refile or reopen when the review is done.
2024-02-06 17:35:15 <@nirik:matrix.scrye.com> !releng 11932
2024-02-06 17:35:16 <@zodbot:fedora.im> **releng #11932** (https://pagure.io/releng/issue/11932):**dozens of f39 builds mis-tagged, getting ejected from f39-stable bodhi pushes**

● **Opened:** a day ago by decathorpe
● **Last Updated:** an hour ago
● **Assignee:** Not Assigned
2024-02-06 17:35:31 <@jnsamyak:matrix.org> +1; I need to check on sop once when they need to have a review or when it's fine 
2024-02-06 17:35:36 <@nirik:matrix.scrye.com> I tried to fix this last night, but it didn't take. ;) Will try and figure it out today.
2024-02-06 17:36:14 <@nirik:matrix.scrye.com> Thats all off hand for tickets I think from me... there's some f40 changes we should look at sometime
2024-02-06 17:37:35 <@jnsamyak:matrix.org> okay I'll move on to the next topic we can discuss there
2024-02-06 17:37:45 <@jnsamyak:matrix.org> !topic Discussion / All other Business / Blockers

2024-02-06 17:38:37 <@jnsamyak:matrix.org> changes in the releng tracker are here: https://pagure.io/releng/issues?status=Open&tags=changes&tags=f40&close_status=
2024-02-06 17:40:35 <@jnsamyak:matrix.org> also nirik i remember you wanted to talk about "builders and new koji" we can take this now as well
2024-02-06 17:41:16 <@nirik:matrix.scrye.com> ok. The f40 mass rebuild tracker ticket can likely be closed?
2024-02-06 17:41:27 <@jnsamyak:matrix.org> +1
2024-02-06 17:43:08 <@nirik:matrix.scrye.com> So, there's a new upstream version of koji (1.34). I am trying to get it rolled out in staging and keep hitting things. I was hoping to update production tomorrow in the mass update, but now I am not sure thats a good idea. ;) Also the builders are still on f38. we kept them on f38 because createrepo_c breaks epel7... but I have made a old createrepo_c package that overrides the f39 one... so I think it should be ok to move them to f39 tomorrow in the mass updates... or perhaps do some today and make sure they are ok first....
2024-02-06 17:44:24 <@jnsamyak:matrix.org> i guess now will be a good time to do it since we are finished with re building stuff? 
2024-02-06 17:45:40 <@amedvede:fedora.im> Hello guys, I wanted to discuss one thing, correct me if I'm mistaking. Today I was testing the automation that was discussed here and noticed that staging server doesn't send messages, I don't see any of them in toddler logs for stg and in Datagrepper there is also no messages when I'm trying to check staging topic e.g.: https://apps.fedoraproject.org/datagrepper/v2/search?topic=io.pagure.stg.pagure.issue.new but if you'll change stg to prod it will show messages correctly
2024-02-06 17:47:02 <@nirik:matrix.scrye.com> could be something broken on pagure-stg... or... should you be looking in apps.stg.fedoraproject.org/datagrepper?
2024-02-06 17:49:15 <@nirik:matrix.scrye.com> I restarted things there, can you try a new test?
2024-02-06 17:49:59 <@amedvede:fedora.im> I tried to look in apps.stg.fedoraproject.org/datagrepper but it not working as well. for example here the latest messages were 17 hours ago https://apps.stg.fedoraproject.org/datagrepper/v2/search?rows_per_page=1
2024-02-06 17:50:04 <@amedvede:fedora.im> sure i will try it now
2024-02-06 17:51:28 <@nirik:matrix.scrye.com> huh... yeah, looking. perhaps my reboots messed up something there.
2024-02-06 17:53:41 <@amedvede:fedora.im> ticket was created but still no messages recieved( Anyway i already planned to finish work for today and go to read book, so we will fix it tomorrow
2024-02-06 17:55:01 <@nirik:matrix.scrye.com> yeah, it's hosed. ;) Looking more...
2024-02-06 17:55:11 <@nirik:matrix.scrye.com> hopefully I can get it working and you can look tomorrow
2024-02-06 17:56:11 <@nirik:matrix.scrye.com> it seems like datanommer isn't inserting into the db, but it's running... so weird.
2024-02-06 17:57:38 <@nirik:matrix.scrye.com> anyhow, I can look more after meeting. ;)
2024-02-06 17:57:51 <@amedvede:fedora.im> That would be great! see you tomorrow, take care ;)
2024-02-06 17:58:44 <@nirik:matrix.scrye.com> have a good one/book. ;)
2024-02-06 18:00:18 <@jnsamyak:matrix.org> folks we are almost at time
2024-02-06 18:00:28 <@jnsamyak:matrix.org> !info Thank you all for coming.
2024-02-06 18:00:44 <@jnsamyak:matrix.org> !endmeeting