<@nirik:matrix.scrye.com>
16:00:32
!startmeeting Infrastructure (2023-12-07)
<@meetbot:fedora.im>
16:00:35
Meeting started at 2023-12-07 16:00:32 UTC
<@meetbot:fedora.im>
16:00:35
The Meeting name is 'Infrastructure (2023-12-07)'
<@leo:fedora.im>
16:00:39
!hi
<@zodbot:fedora.im>
16:00:40
Leo Puvilland (leo) - he / him / his
<@nirik:matrix.scrye.com>
16:00:42
!meetingname infrastructure
<@nirik:matrix.scrye.com>
16:00:47
!chair nirik zlopez nb bodanel dtometzki jnsamyak lenkaseg patrikp
<@nirik:matrix.scrye.com>
16:00:52
!info Agenda is at: https://board.net/p/fedora-infra
<@nirik:matrix.scrye.com>
16:00:59
About our team: https://docs.fedoraproject.org/en-US/cpe/
<@nirik:matrix.scrye.com>
16:01:03
Fedora Infra documentation: https://docs.fedoraproject.org/en-US/infra
<@nirik:matrix.scrye.com>
16:01:11
!topic aloha
<@aheath1992:matrix.org>
16:01:27
!hi
<@zodbot:fedora.im>
16:01:29
Andrew Heath (aheath1992)
<@seddik:fedora.im>
16:01:34
!hi
<@zodbot:fedora.im>
16:01:35
seddik alaouiismaili (seddik)
<@Zlopez:matrix.org>
16:01:42
!hello
<@zodbot:fedora.im>
16:01:44
Michal Konecny (zlopez)
<@humaton:fedora.im>
16:02:49
!hello
<@zodbot:fedora.im>
16:02:50
Tomáš Hrčka (humaton) - he / him / his
<@nirik:matrix.scrye.com>
16:03:13
My network here isn't the greatest... but hopefully will hold up. ;)
<@nirik:matrix.scrye.com>
16:03:20
!topic New folks introductions
<@nirik:matrix.scrye.com>
16:03:26
!info This is a place where people who are interested in Fedora Infrastructure can introduce themselves
<@nirik:matrix.scrye.com>
16:03:29
Getting Started Guide: https://fedoraproject.org/wiki/Infrastructure/GettingStarted
<@nirik:matrix.scrye.com>
16:03:32
any new folks today?
<@leo:fedora.im>
16:04:37
doesn’t look like it
<@nirik:matrix.scrye.com>
16:04:39
Looks like not... so lets drive on.
<@nirik:matrix.scrye.com>
16:04:53
!topic Next chair
<@nirik:matrix.scrye.com>
16:04:57
!info magic eight ball says:
<@nirik:matrix.scrye.com>
16:05:07
!info chair 2023-12-14 jednorozec
<@nirik:matrix.scrye.com>
16:05:20
then the next 3 are canceled for holidays.
<@nirik:matrix.scrye.com>
16:05:33
do we want to try and get someone for jan 11th?
<@leo:fedora.im>
16:06:00
i would but i’d have to run it from my phone so maybe not ;(
<@nirik:matrix.scrye.com>
16:06:19
we could just wait for next weeks meeting to decide too if folks want...
<@leo:fedora.im>
16:06:27
+1
<@nirik:matrix.scrye.com>
16:07:31
ok.
<@nirik:matrix.scrye.com>
16:07:38
!topic announcements and information
<@nirik:matrix.scrye.com>
16:07:48
!info CPE Infra&Releng EU-hours team has a Monday through Thursday 30 minute meeting going through tickets at 0830 UTC in https://matrix.to/#/#meeting-3:fedoraproject.org
<@nirik:matrix.scrye.com>
16:07:52
!info CPE Infra&Releng NA-hours team has a Monday through Thursday 30 minute meeting going through tickets at 1800 UTC in #fedora-meeting-3
<@nirik:matrix.scrye.com>
16:08:00
any other announcements?
<@nirik:matrix.scrye.com>
16:08:21
!info nirik is out for the holidays starting next week. Will still look in and answer emails and outages likely.
<@Zlopez:matrix.org>
16:08:43
!info Red Hat Shutdown happening during Christmas - plenty of folks will not be around
<@leo:fedora.im>
16:09:17
lots of people contribute in the holidays
<@nirik:matrix.scrye.com>
16:09:25
I am planning on sending an email/discussion post tomorrow reminding people to not do anything that causes outages during the holidays. ;)
<@nirik:matrix.scrye.com>
16:09:38
(as I always do)
<@leo:fedora.im>
16:09:58
people still break stuff anyway ;)
<@nirik:matrix.scrye.com>
16:10:00
You might think that, but contributions are usually much lower during the holidays. ;)
<@leo:fedora.im>
16:10:14
oh really well makes sense
<@Zlopez:matrix.org>
16:10:16
Leo: Lots of people are also taking time off from PC
<@leo:fedora.im>
16:10:22
true true
<@leo:fedora.im>
16:10:40
i remember reading something a while back that said that that’s all
<@nirik:matrix.scrye.com>
16:11:10
there's a contributor graph mattdm has that shows it pretty dramatically.
<@nirik:matrix.scrye.com>
16:11:37
https://mattdm.org/fedora/fedora-contributor-trends/
<@leo:fedora.im>
16:12:06
oh cool
<@nirik:matrix.scrye.com>
16:12:20
Those deep dips? holidays.
<@nirik:matrix.scrye.com>
16:12:27
anyhow, any other announcements?
<@nirik:matrix.scrye.com>
16:12:50
!topic Oncall
<@nirik:matrix.scrye.com>
16:12:55
!info https://fedoraproject.org/wiki/Infrastructure/Oncall
<@nirik:matrix.scrye.com>
16:13:01
https://docs.fedoraproject.org/en-US/cpe/day_to_day_fedora/
<@nirik:matrix.scrye.com>
16:13:12
!info Leo is on call from 2023-12-01 to 2023-12-07
<@nirik:matrix.scrye.com>
16:13:16
!info jednorozec is on call from 2023-12-08 to 2023-12-14
<@nirik:matrix.scrye.com>
16:13:20
!info <name> is on call from 2023-12-15 to 2023-12-21
<@nirik:matrix.scrye.com>
16:13:31
I suggest we do what we have done in previous years...
<@nirik:matrix.scrye.com>
16:13:41
no one is really oncall, we just ask people to file tickets.
<@leo:fedora.im>
16:13:50
+1
<@nirik:matrix.scrye.com>
16:14:22
and resume oncall on jan 8th...
<@pcreech:matrix.org>
16:14:53
.hello pcreech17
<@pcreech:matrix.org>
16:14:58
(better late than never... :D )
<@nirik:matrix.scrye.com>
16:15:04
any objections?
<@leo:fedora.im>
16:15:05
i think it’s !hello now
<@nirik:matrix.scrye.com>
16:15:07
hey pcreech
<@leo:fedora.im>
16:15:12
hey!
<@Zlopez:matrix.org>
16:16:03
nirik: +1
<@pcreech:matrix.org>
16:16:09
+1
<@nirik:matrix.scrye.com>
16:16:21
!info Summary of last week: (from current oncall )
<@nirik:matrix.scrye.com>
16:16:31
any oncall pings Leo?
<@leo:fedora.im>
16:16:37
pretty calm week some bodhi and koschei issues and rdu-cc having issues
<@leo:fedora.im>
16:17:09
mostly bodhi choking on something but couldn’t troubleshoot much other than seeing that the pod was restarting a lot from log01
<@nirik:matrix.scrye.com>
16:17:55
yeah, I looked at that some, but it's an odd one.
<@nirik:matrix.scrye.com>
16:18:44
thanks Leo.
<@leo:fedora.im>
16:19:05
of course :)
<@leo:fedora.im>
16:19:23
looking forward to days where i’ll be able to troubleshoot more… one day
<@humaton:fedora.im>
16:19:31
is the take command the same?
<@humaton:fedora.im>
16:19:52
!oncalltakeeu
<@nirik:matrix.scrye.com>
16:19:55
nope, it's currently only controled by bot admins. I switched it.
<@nirik:matrix.scrye.com>
16:20:05
should be set
<@humaton:fedora.im>
16:20:05
thanks
<@nirik:matrix.scrye.com>
16:20:17
!oncall
<@zodbot:fedora.im>
16:20:18
The following people are oncall:
● @humaton:fedora.im (humaton) Current Time for them: 17:20 (Europe/Prague)
If they do not respond, please file a ticket (https://pagure.io/fedora-infrastructure/issues)
<@nirik:matrix.scrye.com>
16:20:29
hum... perhaps thats not right? or is it?
<@nirik:matrix.scrye.com>
16:20:43
I am not sure if it takes fas or matrix name?
<@humaton:fedora.im>
16:20:53
my matrix is my fas
<@humaton:fedora.im>
16:21:00
It works
<@nirik:matrix.scrye.com>
16:21:13
ok, cool.
<@nirik:matrix.scrye.com>
16:21:22
!topic Monitoring discussion [nirik]
<@nirik:matrix.scrye.com>
16:21:32
!info https://nagios.fedoraproject.org/nagios
<@nirik:matrix.scrye.com>
16:21:59
oops. looks like one the power9 boxes is taking a nap. ;(
<@nirik:matrix.scrye.com>
16:22:02
will fix that.
<@nirik:matrix.scrye.com>
16:22:21
otherwise I think we are in normal shape.
<@leo:fedora.im>
16:23:34
nice nice
<@nirik:matrix.scrye.com>
16:24:11
So, are we wanting to do backlog refinement, a learning topic or just end early today?
<@Zlopez:matrix.org>
16:24:52
Do we have learning topic for today?
<@nirik:matrix.scrye.com>
16:26:07
nothing set...
<@leo:fedora.im>
16:26:32
i did a quick look and not much backlog
<@leo:fedora.im>
16:27:00
koschei is down apparently
<@Zlopez:matrix.org>
16:27:52
I'm for backlog refinement
<@nirik:matrix.scrye.com>
16:27:55
yeah, it's been having issues. I think it's hitting it's quotas and getting oom killed. at least thats happened in the past.
<@leo:fedora.im>
16:28:08
maybe we should up them?
<@leo:fedora.im>
16:28:28
+1 on backlog
<@nirik:matrix.scrye.com>
16:29:02
it's back up. it's only sporadically down...
<@nirik:matrix.scrye.com>
16:29:57
my net is being slow... Zlopez you want to run refinement from there?
<@leo:fedora.im>
16:30:15
maybe we should up the quotas
<@Zlopez:matrix.org>
16:30:34
nirik: I ca, let me find the agenda
<@Zlopez:matrix.org>
16:30:57
!topic Revisit blocked tickets
<@Zlopez:matrix.org>
16:31:02
!info Check if any blocked ticket is unblocked
<@Zlopez:matrix.org>
16:31:06
!link https://pagure.io/fedora-infrastructure/issues?status=Open&tags=blocked&priority=0&close_status=
<@nirik:matrix.scrye.com>
16:31:06
Leo: yeah, if thats the issue, I am just speculating, haven't looked yet.
<@leo:fedora.im>
16:31:27
will investigate
<@Zlopez:matrix.org>
16:31:59
I don't think anything blocked is now unblocked
<@nirik:matrix.scrye.com>
16:32:03
t's failing liveness checks. I am suspecting something might be going on with the db server, but not sure what. it looks fine.
<@nirik:matrix.scrye.com>
16:32:10
agreed, all still blocked.
<@leo:fedora.im>
16:32:22
hm okay
<@leo:fedora.im>
16:32:42
will take a look
<@nirik:matrix.scrye.com>
16:33:17
ha. I see a problem. it needs f37 deleted.
<@Zlopez:matrix.org>
16:34:35
!topic Fedora Infra backlog refinement
<@leo:fedora.im>
16:34:38
oh yeah
<@Zlopez:matrix.org>
16:34:39
!info Refine oldest tickets on Fedora Infra tracker
<@Zlopez:matrix.org>
16:34:44
!link https://pagure.io/fedora-infrastructure/issues?status=Open&order_key=last_updated&order=asc
<@Zlopez:matrix.org>
16:35:11
!link https://pagure.io/fedora-infrastructure/issue/10458
<@Zlopez:matrix.org>
16:35:26
This is still waiting for mattdm
<@Zlopez:matrix.org>
16:36:13
!link https://pagure.io/fedora-infrastructure/issue/11452
<@leo:fedora.im>
16:36:41
seems like we can go ahead with this one no?
<@nirik:matrix.scrye.com>
16:36:51
we need to document stuff and then yeah, this can move ahead
<@Zlopez:matrix.org>
16:37:01
Yes
<@Zlopez:matrix.org>
16:39:18
!link https://pagure.io/fedora-infrastructure/issue/10383
<@Zlopez:matrix.org>
16:39:37
Hm, I should probably use ticket command
<@Zlopez:matrix.org>
16:39:43
!ticket 10383
<@zodbot:fedora.im>
16:39:46
fedora-infrastructure #10383 (https://pagure.io/fedora-infrastructure/issue/10383): Upgrade Venus to Pluto
<@Zlopez:matrix.org>
16:40:47
phsmoura worked on this, but I'm not sure where it is
<@nirik:matrix.scrye.com>
16:40:48
phsmoura has been working on this...
<@nirik:matrix.scrye.com>
16:41:00
its really close for stg.
<@nirik:matrix.scrye.com>
16:41:15
there's a PR, but he was going to adjust it to handle kerberos the way we like for openshift.
<@leo:fedora.im>
16:41:23
don't we have this?
<@leo:fedora.im>
16:41:24
https://docs.fedoraproject.org/en-US/infra/ocp4/sop_communishift_onboard_tenant/
<@nirik:matrix.scrye.com>
16:41:25
I'm not sure if he has been able to do that yet.
<@leo:fedora.im>
16:42:03
for communishift
<@nirik:matrix.scrye.com>
16:42:59
yeah, we need to add some more process to it... not from the technical side, but legal and such.
<@leo:fedora.im>
16:43:16
ah, okay.
<@Zlopez:matrix.org>
16:43:22
It needs legal stuff as nirik said
<@leo:fedora.im>
16:43:43
was not aware it was so legally complicated
<@nirik:matrix.scrye.com>
16:44:23
¯\_(ツ)_/¯ the world we live in...
<@Zlopez:matrix.org>
16:45:00
It's complicated
<@Zlopez:matrix.org>
16:45:16
!ticket 11297
<@smooge:fedora.im>
16:45:49
would say 'very complicated' but probably time to move on?
<@leo:fedora.im>
16:46:11
indeed
<@Zlopez:matrix.org>
16:46:26
Zodbot is ignoring me :-D
<@zodbot:fedora.im>
16:46:54
fedora-infrastructure #11297 (https://pagure.io/fedora-infrastructure/issue/11297): Reconfigure pagure.io to only allow new projects from 'contributors' or via request
<@leo:fedora.im>
16:47:13
this depends on parure implementing this right
<@leo:fedora.im>
16:47:22
pagure
<@Zlopez:matrix.org>
16:47:40
This is still waiting for the new release of Pagure that will work on RHEL 9, this is currently in progress
<@leo:fedora.im>
16:47:53
right
<@Zlopez:matrix.org>
16:48:11
It's already merged in Pagure, but no version to deploy
<@nirik:matrix.scrye.com>
16:48:13
should we mark it blocked?
<@leo:fedora.im>
16:48:37
+1 for that
<@Zlopez:matrix.org>
16:48:37
It's already marked
<@Zlopez:matrix.org>
16:49:29
!ticket 10372
<@zodbot:fedora.im>
16:49:30
fedora-infrastructure #10372 (https://pagure.io/fedora-infrastructure/issue/10372): [proposal] Move Pagure (pagure.io and src.fp.o) to use OIDC for web login
<@leo:fedora.im>
16:49:36
also blocked?
<@Zlopez:matrix.org>
16:49:47
This is the ticket that is waiting for RHEL 9 Pagure
<@nirik:matrix.scrye.com>
16:49:54
yep
<@Zlopez:matrix.org>
16:50:13
Marked as blocked
<@Zlopez:matrix.org>
16:50:49
!ticket 11013
<@zodbot:fedora.im>
16:50:51
fedora-infrastructure #11013 (https://pagure.io/fedora-infrastructure/issue/11013): Redeploy openQA workers with consistent storage configuration
<@Zlopez:matrix.org>
16:50:55
Last one before open floor
<@nirik:matrix.scrye.com>
16:51:05
just haven't gotten to it...
<@nirik:matrix.scrye.com>
16:51:10
I guess next year. ;)
<@Zlopez:matrix.org>
16:51:23
Or the year after :-D
<@leo:fedora.im>
16:51:30
or the year after that :)
<@leo:fedora.im>
16:51:36
one day
<@Zlopez:matrix.org>
16:52:31
Ok, I think we can move to Open Floor
<@Zlopez:matrix.org>
16:52:46
I will give the meeting back to nirik
<@nirik:matrix.scrye.com>
16:52:59
!topic open floor
<@nirik:matrix.scrye.com>
16:53:08
any items for open floor?
<@leo:fedora.im>
16:53:11
only thing from me is the same TLS stuff for flatpak
<@leo:fedora.im>
16:53:36
maybe we could modify the letsencrypt roles to allow a copying of files to arbitrary hosts but that would add dependency :(
<@nirik:matrix.scrye.com>
16:54:11
yeah.
<@nirik:matrix.scrye.com>
16:54:23
I suppose at that point we could just do self signed.
<@leo:fedora.im>
16:54:24
what if we called the letsencrypt role and skipped the proxies?
<@leo:fedora.im>
16:54:32
ah... yeah.
<@leo:fedora.im>
16:54:53
would have to make openqa trust them though...
<@nirik:matrix.scrye.com>
16:58:02
I don't think we will solve this in the next 3 min. ;)
<@leo:fedora.im>
16:58:11
of course, yeah
<@leo:fedora.im>
16:58:21
let's move on
<@Zlopez:matrix.org>
16:58:33
You can try :-)
<@leo:fedora.im>
16:59:38
i'll just look on my side about directly calling letsencrypt role from the playbook
<@nirik:matrix.scrye.com>
16:59:52
I think a self signed cert for this is probibly best...
<@leo:fedora.im>
16:59:58
ah, okay
<@nirik:matrix.scrye.com>
17:00:20
but of course openqa will have to trust the ca
<@leo:fedora.im>
17:00:25
yeah. gonna have to ask adam
<@leo:fedora.im>
17:00:39
will update pr accordingly
<@nirik:matrix.scrye.com>
17:01:06
thanks everyone!
<@nirik:matrix.scrye.com>
17:01:09
!endmeeting