<@nirik:matrix.scrye.com>
16:00:04
!startmeeting Infrastructure (2024-08-15)
<@meetbot:fedora.im>
16:00:09
Meeting started at 2024-08-15 16:00:04 UTC
<@meetbot:fedora.im>
16:00:09
The Meeting name is 'Infrastructure (2024-08-15)'
<@nirik:matrix.scrye.com>
16:00:13
!meetingname infrastructure
<@nirik:matrix.scrye.com>
16:00:13
!topic ahoy
<@nirik:matrix.scrye.com>
16:00:13
!info Fedora Infra documentation: https://docs.fedoraproject.org/en-US/infra
<@nirik:matrix.scrye.com>
16:00:13
!info About our team: https://docs.fedoraproject.org/en-US/cpe/
<@nirik:matrix.scrye.com>
16:00:13
!info Agenda is at: https://board.net/p/fedora-infra
<@nirik:matrix.scrye.com>
16:00:13
!chair nirik zlopez nb bodanel dtometzki jnsamyak lenkaseg patrikp
<@meetbot:fedora.im>
16:00:13
The Meeting Name is now infrastructure
<@smilner:fedora.im>
16:00:16
!hi
<@zodbot:fedora.im>
16:00:16
None (smilner)
<@nphilipp:fedora.im>
16:00:21
!hi
<@zodbot:fedora.im>
16:00:22
Nils Philippsen (nphilipp) - he / him / his
<@nirik:matrix.scrye.com>
16:00:40
morning everyone!
<@jnsamyak:matrix.org>
16:00:44
!hi
<@zodbot:fedora.im>
16:00:46
Samyak Jain (jnsamyak) - he / him / his
<@nirik:matrix.scrye.com>
16:01:22
lets wait a min or two for folks to wander in...
<@james:fedora.im>
16:01:24
!hi
<@zodbot:fedora.im>
16:01:24
James Antill (james)
<@eabucay:fedora.im>
16:01:33
!hi
<@zodbot:fedora.im>
16:01:34
Edward Fitz Abucay (eabucay)
<@nirik:matrix.scrye.com>
16:01:45
πΆ <elevator music> π΅
<@nirik:matrix.scrye.com>
16:02:22
ok, first floor:
<@nirik:matrix.scrye.com>
16:02:23
!info Getting Started Guide: https://docs.fedoraproject.org/en-US/infra/gettingstarted/
<@nirik:matrix.scrye.com>
16:02:23
!info This is a place where people who are interested in Fedora Infrastructure can introduce themselves
<@nirik:matrix.scrye.com>
16:02:23
!topic New folks introductions
<@nirik:matrix.scrye.com>
16:02:33
Any new folks like to introduce themselves?
<@eabucay:fedora.im>
16:02:48
yes
<@eabucay:fedora.im>
16:03:08
Iβm quite excited about this opportunity to join the infra team to further solidify my skills and contribute to the community.
<@eabucay:fedora.im>
16:03:08
<@eabucay:fedora.im>
16:03:08
My name is Edward. Iβm a DevOps engineer and backend developer based in SG (sometimes in PH). I have been a software engineer for as long as I can remember since graduating from university. As Iβm doing consultancy now, I find that I have a lot of spare time.
<@eabucay:fedora.im>
16:03:08
<@eabucay:fedora.im>
16:03:08
I have experience working with various programming languages (e.g., Golang, Rust, TypeScript, Python) and have done SRE tasks like setting up CI/CD pipelines, infra design, scaling web apps, and optimizing and finding root causes of service problems.
<@eabucay:fedora.im>
16:03:08
<@eabucay:fedora.im>
16:03:08
<@eabucay:fedora.im>
16:03:08
You can reach out to me on Matrix at @eabucay:fedora.im.
<@eabucay:fedora.im>
16:03:08
<@eabucay:fedora.im>
16:03:08
Rn, I've been reading/familiarizing the infra docs and setting up my own dev environment.
<@eabucay:fedora.im>
16:03:08
Hi team!
<@nirik:matrix.scrye.com>
16:03:38
Hey Edward Fitz Abucay! welcome!
<@nphilipp:fedora.im>
16:03:52
Welcome Edward!
<@nirik:matrix.scrye.com>
16:03:59
do feel free to ask questions/chime in on anything and happy have you...
<@smilner:fedora.im>
16:04:11
Good to have you here Edward Fitz Abucay! π
<@nirik:matrix.scrye.com>
16:04:15
are you more interested in app develpment? or operations? or both?
<@eabucay:fedora.im>
16:05:31
Aurelien asked me the same thing. I think I'll try to feel first what's good but leaning on app development
<@nirik:matrix.scrye.com>
16:05:48
Sure, sounds good. There's lots going on in both places...
<@nirik:matrix.scrye.com>
16:05:54
welcome again.
<@nirik:matrix.scrye.com>
16:05:57
Any other new folks?
<@nirik:matrix.scrye.com>
16:06:29
ok, none heard, doors closing and heading up to floor 2:
<@nirik:matrix.scrye.com>
16:06:31
!info chair 2024-08-29 - ?
<@nirik:matrix.scrye.com>
16:06:31
!topic Next chair
<@nirik:matrix.scrye.com>
16:06:31
!info chair 2024-08-22 - ?
<@nirik:matrix.scrye.com>
16:06:31
!info magic eight ball says:
<@nirik:matrix.scrye.com>
16:06:47
Anyone interested in running the meeting the 22nd or 29th?
<@nirik:matrix.scrye.com>
16:08:45
π¦s?
<@nirik:matrix.scrye.com>
16:09:27
I mean, I guess I can next week again, but it's a good chance for someone else to get involved. ;)
<@james:fedora.im>
16:09:31
I could try one of those days if there's nobody else ... but I don't really want to run two meetings at once :-o
<@nirik:matrix.scrye.com>
16:09:55
yeah, you are in FPC at the same time, right?
<@james:fedora.im>
16:10:19
yeh
<@nirik:matrix.scrye.com>
16:10:54
ok. I'll just put myself for now, but if anyone else wants it, please let me know. ;)
<@nirik:matrix.scrye.com>
16:11:16
!info Remaining issues with new mailman3 deployment are being investigated
<@nirik:matrix.scrye.com>
16:11:16
!info Flock 2024 was last week
<@nirik:matrix.scrye.com>
16:11:16
!topic announcements and information
<@nirik:matrix.scrye.com>
16:11:16
!info CPE Infra&Releng EU-hours team has a Monday through Thursday 30 minute meeting going through tickets at 0800 UTC in https://matrix.to/#/#meeting-3:fedoraproject.org
<@nirik:matrix.scrye.com>
16:11:16
!info CPE Infra&Releng NA-hours team has a Monday through Thursday 30 minute meeting going through tickets at 1800 UTC in #fedora-meeting-3
<@nirik:matrix.scrye.com>
16:11:16
!info Fedora 41 branching is done
<@nirik:matrix.scrye.com>
16:11:28
any other announcements or info anyone would like to note?
<@nphilipp:fedora.im>
16:12:01
Not sure about announcementβ¦
<@nphilipp:fedora.im>
16:12:17
Or if itβs necessary or to what extent π
<@nphilipp:fedora.im>
16:12:53
Iβm about to switch the staging builders from the rpmautospec Koji to the mock plugin
<@nirik:matrix.scrye.com>
16:13:29
cool. Yeah, usually just a heads up on matrix in case someone else is depending on that working to test other things (rarely)
<@nphilipp:fedora.im>
16:13:53
If that works out, I want to flip the switch in prod, too. Any wider announcement necessary?
<@nirik:matrix.scrye.com>
16:14:04
There's some other koji changes actually that I need to try and get in next week...
<@nirik:matrix.scrye.com>
16:14:16
we could do them at the same time.
<@nphilipp:fedora.im>
16:14:42
Hmm if possible I would want to get that in earlier to fix https://pagure.io/fedora-infrastructure/issue/12126
<@nirik:matrix.scrye.com>
16:14:54
Basically some kiwi adjustments we need before beta.
<@nirik:matrix.scrye.com>
16:15:38
ah yeah. well, if all it takes is just a install of plugin, some config change and restarting kojid I think we can do that without too much notice.
<@nphilipp:fedora.im>
16:17:35
Run parts of the playbook which removes the koji plugin, installs the mock plugin (explicitly) and applies config changes, then restart kojid
<@nirik:matrix.scrye.com>
16:17:54
( https://pagure.io/koji/pull-request/4157 and https://pagure.io/koji/pull-request/4156 are the kiwi koji patches)
<@nirik:matrix.scrye.com>
16:18:32
sure, I'd say just announce on matrix and make sure it looks ok in staging first. :)
<@nirik:matrix.scrye.com>
16:18:41
I can do my patches next week
<@nphilipp:fedora.im>
16:18:54
Of course π
<@nirik:matrix.scrye.com>
16:19:28
ok, moving along then... floor 3:
<@nirik:matrix.scrye.com>
16:19:33
!info https://docs.fedoraproject.org/en-US/cpe/day_to_day_fedora/
<@nirik:matrix.scrye.com>
16:19:33
!info https://fedoraproject.org/wiki/Infrastructure/Oncall
<@nirik:matrix.scrye.com>
16:19:33
!topic Oncall
<@nirik:matrix.scrye.com>
16:19:33
!info ? is on call from 2024-08-22 to 2024-08-29
<@nirik:matrix.scrye.com>
16:19:33
!info ? is on call from 2024-08-15 to 2024-08-21
<@nirik:matrix.scrye.com>
16:19:48
I can take the next oncall... anyone want the 22nd to 29th?
<@nirik:matrix.scrye.com>
16:20:25
if not, we can figure it next week
<@nirik:matrix.scrye.com>
16:20:43
!info no summary from last week, we were at flock and no one was oncall. ;)
<@nirik:matrix.scrye.com>
16:20:54
!topic Monitoring discussion [nirik]
<@nirik:matrix.scrye.com>
16:20:54
!info Go over existing out items and fix
<@nirik:matrix.scrye.com>
16:20:54
!info https://nagios.fedoraproject.org/nagios
<@nirik:matrix.scrye.com>
16:21:15
nothing much new here.
<@nirik:matrix.scrye.com>
16:21:46
a few down machines we need onsite folks for, planet messages (that phsmoura is going to work on)
<@nirik:matrix.scrye.com>
16:22:14
oh, and bugzilla messages not coming through. :( No errors on our side tho, so I think it might be something with the internal bus...
<@nirik:matrix.scrye.com>
16:22:26
Zlopez was going to look more into that.
<@phsmoura:fedora.im>
16:23:07
yep.. adding new files and changing somethings in ansible repo to add fedora messaging to it
<@nirik:matrix.scrye.com>
16:24:03
ok, doors closing, moving to floor 5!
<@nirik:matrix.scrye.com>
16:24:17
Lets check in on our fun rhel7 retirements...
<@nirik:matrix.scrye.com>
16:24:19
!ticket https://pagure.io/fedora-infrastructure/issue/11815
<@nirik:matrix.scrye.com>
16:24:19
!info Check the progress on tickets related to RHEL7 EOL (end of June)
<@nirik:matrix.scrye.com>
16:24:19
!topic RHEL7 EOL
<@nirik:matrix.scrye.com>
16:24:29
Just a small number of things left.
<@nirik:matrix.scrye.com>
16:24:54
!info need to get bugzilla component sync working without pdc ( jednorozec has a pr for this)
<@nirik:matrix.scrye.com>
16:25:10
I guess we could close the PDC ticket now? or wait for that?
<@nirik:matrix.scrye.com>
16:25:44
Then, there is just github2fedmsg... I am not sure the status there. I know Akashdeep Dhar was re-writing it...
<@nirik:matrix.scrye.com>
16:25:52
then we can retire fedmsg entirely
<@nirik:matrix.scrye.com>
16:25:55
then we are done
<@nirik:matrix.scrye.com>
16:27:27
What do folks think on the pdc ticket? pdc is gone, but that bugzilla sync thing is related because it has to adjust for pdc being gone...
<@nirik:matrix.scrye.com>
16:27:45
I guess there's another ticket on it not working yet, so we could just close the pdc one and track in that one
<@nphilipp:fedora.im>
16:28:04
+1
<@nirik:matrix.scrye.com>
16:28:11
!ticket 12127
<@zodbot:fedora.im>
16:28:12
β **Opened:** 2 days ago by michich
<@zodbot:fedora.im>
16:28:12
**fedora-infrastructure #12127** (https://pagure.io/fedora-infrastructure/issue/12127):**missing Bugzilla component for a new package**
<@zodbot:fedora.im>
16:28:12
β **Assignee:** Not Assigned
<@zodbot:fedora.im>
16:28:12
β **Last Updated:** a day ago
<@zodbot:fedora.im>
16:28:12
<@nirik:matrix.scrye.com>
16:28:55
!ticket 11820
<@zodbot:fedora.im>
16:28:56
β **Opened:** 5 months ago by zlopez
<@zodbot:fedora.im>
16:28:56
β **Assignee:** humaton
<@zodbot:fedora.im>
16:28:56
**fedora-infrastructure #11820** (https://pagure.io/fedora-infrastructure/issue/11820):**rhel7 - PDC**
<@zodbot:fedora.im>
16:28:56
<@zodbot:fedora.im>
16:28:56
β **Last Updated:** 19 hours ago
<@nirik:matrix.scrye.com>
16:30:27
ok, so I will close the pdc one then.
<@nirik:matrix.scrye.com>
16:30:49
if anyone could help out with https://pagure.io/fedora-infra/toddlers/pull-request/238 that would be great.
<@nirik:matrix.scrye.com>
16:32:23
I think thats it for rhel7 staus. :)
<@amedvede:fedora.im>
16:32:25
I saw the comment on this ticket, i will take a look
<@nirik:matrix.scrye.com>
16:32:35
thanks Anton Medvedev!
<@nirik:matrix.scrye.com>
16:33:28
What would folks like to do now? 1) just end early and get 30min back, 2) look at old tickets, 3) talk about something else (provide topic).
<@nirik:matrix.scrye.com>
16:33:50
I guess I could have split those and people could vote with emojis
<@nirik:matrix.scrye.com>
16:33:56
end early
<@nirik:matrix.scrye.com>
16:33:59
look at old tickets
<@nirik:matrix.scrye.com>
16:34:04
other topic
<@nirik:matrix.scrye.com>
16:36:35
sorry, someone at the door here.
<@nirik:matrix.scrye.com>
16:36:42
ok, lets do old tickets!
<@nirik:matrix.scrye.com>
16:36:56
!topic Revisit blocked tickets
<@nirik:matrix.scrye.com>
16:36:56
!link https://pagure.io/fedora-infrastructure/issues?status=Open&tags=blocked&priority=0&close_status=
<@nirik:matrix.scrye.com>
16:36:56
!info Check if any blocked ticket is unblocked
<@nirik:matrix.scrye.com>
16:37:36
everything there is still pretty blocked...
<@nirik:matrix.scrye.com>
16:37:48
!link https://pagure.io/fedora-infrastructure/issues?status=Open&order_key=last_updated&order=asc
<@nirik:matrix.scrye.com>
16:37:48
!topic Fedora Infra backlog refinement
<@nirik:matrix.scrye.com>
16:37:48
!info Refine oldest tickets on Fedora Infra tracker
<@nirik:matrix.scrye.com>
16:38:20
!ticket 7361
<@zodbot:fedora.im>
16:38:21
β **Opened:** 5 years ago by pbrobinson
<@zodbot:fedora.im>
16:38:21
<@zodbot:fedora.im>
16:38:21
**fedora-infrastructure #7361** (https://pagure.io/fedora-infrastructure/issue/7361):**Signing infrastructure for aarch64**
<@zodbot:fedora.im>
16:38:21
β **Last Updated:** a year ago
<@zodbot:fedora.im>
16:38:21
β **Assignee:** Not Assigned
<@nirik:matrix.scrye.com>
16:38:33
so, this is ancient and... there's some movement on it.
<@smilner:fedora.im>
16:38:54
Is this something we truly need given it's been ongoing for 5 years?
<@nirik:matrix.scrye.com>
16:38:57
we now have sigul that can do this signing, but we need to integrate it into the build process/setup
<@nirik:matrix.scrye.com>
16:39:09
yep. It's just been really hard.
<@nirik:matrix.scrye.com>
16:39:49
I talked with some folks at flock and we need to figure out a plan for this last bit... I am supposed to send out an email/update ticket with it.
<@nirik:matrix.scrye.com>
16:40:11
I guess ticket might be better
<@smilner:fedora.im>
16:40:15
Makes sense ποΈ
<@nirik:matrix.scrye.com>
16:40:40
I guess this was on the blocked list too... but hopefully we can fix it someday
<@nirik:matrix.scrye.com>
16:40:55
!ticket 10241
<@zodbot:fedora.im>
16:40:56
β **Last Updated:** 8 months ago
<@zodbot:fedora.im>
16:40:56
**fedora-infrastructure #10241** (https://pagure.io/fedora-infrastructure/issue/10241):**Port apps to OIDC**
<@zodbot:fedora.im>
16:40:56
<@zodbot:fedora.im>
16:40:56
β **Opened:** 2 years ago by zlopez
<@zodbot:fedora.im>
16:40:56
β **Assignee:** Not Assigned
<@nirik:matrix.scrye.com>
16:41:17
this is stalled on ipsilon, but we want to move to keycloak anyhow... so it's blocked on that.
<@nirik:matrix.scrye.com>
16:41:33
I think AurΓ©lien B was going to setup a staging keycloak, but hasn't had time yet.
<@nirik:matrix.scrye.com>
16:41:39
so a bit of progress on that at least
<@smilner:fedora.im>
16:41:43
Do we tend to reuse tickets when they go stale like this or do we like to close them in favor of a new one with new info?
<@james:fedora.im>
16:42:01
For 7361 ... are we signing manually ... and is centos also signing aarch64 manually?
<@nirik:matrix.scrye.com>
16:42:34
Steve: we tend to just keep things open... but we could look at a new workflow if it works better.
<@smilner:fedora.im>
16:42:59
I'm fine with whatever works. Just curious :-)
<@nirik:matrix.scrye.com>
16:43:05
James Antill: nope, we are not signing aarch64 kernels/etc at all. I am not sure what centos is doing, but their signing infra is completely different too.
<@james:fedora.im>
16:43:36
Ahh, fair enough ... for some reason I thought with the move to stream signing was pretty close to Fedora.
<@nirik:matrix.scrye.com>
16:43:51
it's not something you can do manually easily... you need to sign the vmlinuz/etc at build time before the rpm is written. ;(
<@nphilipp:fedora.im>
16:44:48
As someone who has absolutely no idea: the signature needs to be in the RPM, as a file?
<@nirik:matrix.scrye.com>
16:45:01
!ticket 10458
<@zodbot:fedora.im>
16:45:02
β **Opened:** 2 years ago by mattdm
<@zodbot:fedora.im>
16:45:02
β **Assignee:** Not Assigned
<@zodbot:fedora.im>
16:45:02
**fedora-infrastructure #10458** (https://pagure.io/fedora-infrastructure/issue/10458):**Help me move my discourse bots to production?**
<@zodbot:fedora.im>
16:45:02
<@zodbot:fedora.im>
16:45:02
β **Last Updated:** 8 months ago
<@smilner:fedora.im>
16:45:54
Looks like it's waiting on Matthew's availability
<@nirik:matrix.scrye.com>
16:46:00
nils: yeah, this is for secure boot, so the thing that runs when booting has to be signed with the valid cert
<@nirik:matrix.scrye.com>
16:46:31
yeah, and it has been for a while. ;( Perhaps someone would be willing to more actively take this on and get info from him?
<@nirik:matrix.scrye.com>
16:46:41
or we could keep waiting?
<@smilner:fedora.im>
16:48:05
I'd suggest asking for volunteers and if there aren't any maybe it's time to close it and let it be recreated in the future IF it's still helpful work.
<@james:fedora.im>
16:48:05
It's been 5 years, what's one more ?;)
<@nphilipp:fedora.im>
16:48:45
nirik: Apropos, not having any bkernel-*.stg makes not getting things wrong hard π
<@nirik:matrix.scrye.com>
16:48:53
ok. I have peroidic meetings with him, can bring it up there too.
<@nirik:matrix.scrye.com>
16:49:49
nils: oh yeah, but we could now I guess... as the reason we didn't was that bkernel01/02 are hardware with smartcards in them, but under the new setup we will be using sigul, so no smart card needed... so it should be possible to setup a test env in staging I think...
<@nphilipp:fedora.im>
16:50:50
nirik: heh, as it is I guess I just have to check after applying the changes π
<@nirik:matrix.scrye.com>
16:51:26
!ticket 10372
<@zodbot:fedora.im>
16:51:26
β **Opened:** 2 years ago by ryanlerch
<@zodbot:fedora.im>
16:51:26
**fedora-infrastructure #10372** (https://pagure.io/fedora-infrastructure/issue/10372):**[proposal] Move Pagure (pagure.io and src.fp.o) to use OIDC for web login**
<@zodbot:fedora.im>
16:51:26
<@zodbot:fedora.im>
16:51:26
β **Last Updated:** 8 months ago
<@zodbot:fedora.im>
16:51:26
β **Assignee:** Not Assigned
<@nirik:matrix.scrye.com>
16:51:44
this was related to the ipsilon/keycloak thing...
<@nirik:matrix.scrye.com>
16:52:02
no, wait... this was due to the pagure rhel8 being too old?
<@smilner:fedora.im>
16:52:37
Is it worth doing given the work to move to a new gitforge?
<@nirik:matrix.scrye.com>
16:52:41
ah yeah, rhel8 too old.
<@nirik:matrix.scrye.com>
16:52:54
I suspect not.
<@nirik:matrix.scrye.com>
16:53:42
Tied up in this is that keycloak doesn't support openid (which pagure uses now). So, we can't move to keycloak until pagure is moved / no longer there.
<@nirik:matrix.scrye.com>
16:54:03
However! I talked to ab at flock and he was willing to ask keycloak maintainers if they could somehow support openid for us.
<@nirik:matrix.scrye.com>
16:54:31
so many moving parts. ;)
<@nirik:matrix.scrye.com>
16:54:48
So, perhaps we just decide to close this one?
<@nirik:matrix.scrye.com>
16:55:12
If a rhel9 pagure becomes available we could revisit...
<@nirik:matrix.scrye.com>
16:55:57
Lets move to the roof! Open floor. ;)
<@nirik:matrix.scrye.com>
16:56:00
!topic Open Floor
<@amedvede:fedora.im>
16:58:03
Recently saw how the guy used fish instead of bash with plugin that allows to run bash scripts, is there any benefit of using fish and do someone use it?
<@amedvede:fedora.im>
16:58:36
just curious to try it myself
<@nirik:matrix.scrye.com>
16:58:37
I played around with fish a long time ago... it's pretty different, but some folks really like it.
<@nirik:matrix.scrye.com>
16:58:48
(but things might have changed since then)
<@james:fedora.im>
16:59:00
I used it for a bit, years ago. It's v. different from bash or zsh, etc.
<@nirik:matrix.scrye.com>
16:59:43
I do know it sometimes breaks things if it's your default shell... since so much stuff assumes bash/zsh/sh for scripts
<@nirik:matrix.scrye.com>
17:01:15
ok, we are out of time now... thanks so much for coming everyone!
<@nirik:matrix.scrye.com>
17:01:28
!endmeeting