2023-12-07 16:00:32 <@nirik:matrix.scrye.com> !startmeeting Infrastructure (2023-12-07) 2023-12-07 16:00:35 <@meetbot:fedora.im> Meeting started at 2023-12-07 16:00:32 UTC 2023-12-07 16:00:35 <@meetbot:fedora.im> The Meeting name is 'Infrastructure (2023-12-07)' 2023-12-07 16:00:39 <@leo:fedora.im> !hi 2023-12-07 16:00:40 <@zodbot:fedora.im> Leo Puvilland (leo) - he / him / his 2023-12-07 16:00:42 <@nirik:matrix.scrye.com> !meetingname infrastructure 2023-12-07 16:00:47 <@nirik:matrix.scrye.com> !chair nirik zlopez nb bodanel dtometzki jnsamyak lenkaseg patrikp 2023-12-07 16:00:52 <@nirik:matrix.scrye.com> !info Agenda is at: https://board.net/p/fedora-infra 2023-12-07 16:00:59 <@nirik:matrix.scrye.com> About our team: https://docs.fedoraproject.org/en-US/cpe/ 2023-12-07 16:01:03 <@nirik:matrix.scrye.com> Fedora Infra documentation: https://docs.fedoraproject.org/en-US/infra 2023-12-07 16:01:11 <@nirik:matrix.scrye.com> !topic aloha 2023-12-07 16:01:27 <@aheath1992:matrix.org> !hi 2023-12-07 16:01:29 <@zodbot:fedora.im> Andrew Heath (aheath1992) 2023-12-07 16:01:34 <@seddik:fedora.im> !hi 2023-12-07 16:01:35 <@zodbot:fedora.im> seddik alaouiismaili (seddik) 2023-12-07 16:01:42 <@Zlopez:matrix.org> !hello 2023-12-07 16:01:44 <@zodbot:fedora.im> Michal Konecny (zlopez) 2023-12-07 16:02:49 <@humaton:fedora.im> !hello 2023-12-07 16:02:50 <@zodbot:fedora.im> Tomáš Hrčka (humaton) - he / him / his 2023-12-07 16:03:13 <@nirik:matrix.scrye.com> My network here isn't the greatest... but hopefully will hold up. ;) 2023-12-07 16:03:20 <@nirik:matrix.scrye.com> !topic New folks introductions 2023-12-07 16:03:26 <@nirik:matrix.scrye.com> !info This is a place where people who are interested in Fedora Infrastructure can introduce themselves 2023-12-07 16:03:29 <@nirik:matrix.scrye.com> Getting Started Guide: https://fedoraproject.org/wiki/Infrastructure/GettingStarted 2023-12-07 16:03:32 <@nirik:matrix.scrye.com> any new folks today? 2023-12-07 16:04:37 <@leo:fedora.im> doesn’t look like it 2023-12-07 16:04:39 <@nirik:matrix.scrye.com> Looks like not... so lets drive on. 2023-12-07 16:04:53 <@nirik:matrix.scrye.com> !topic Next chair 2023-12-07 16:04:57 <@nirik:matrix.scrye.com> !info magic eight ball says: 2023-12-07 16:05:07 <@nirik:matrix.scrye.com> !info chair 2023-12-14 jednorozec 2023-12-07 16:05:20 <@nirik:matrix.scrye.com> then the next 3 are canceled for holidays. 2023-12-07 16:05:33 <@nirik:matrix.scrye.com> do we want to try and get someone for jan 11th? 2023-12-07 16:06:00 <@leo:fedora.im> i would but i’d have to run it from my phone so maybe not ;( 2023-12-07 16:06:19 <@nirik:matrix.scrye.com> we could just wait for next weeks meeting to decide too if folks want... 2023-12-07 16:06:27 <@leo:fedora.im> +1 2023-12-07 16:07:31 <@nirik:matrix.scrye.com> ok. 2023-12-07 16:07:38 <@nirik:matrix.scrye.com> !topic announcements and information 2023-12-07 16:07:48 <@nirik:matrix.scrye.com> !info CPE Infra&Releng EU-hours team has a Monday through Thursday 30 minute meeting going through tickets at 0830 UTC in https://matrix.to/#/#meeting-3:fedoraproject.org 2023-12-07 16:07:52 <@nirik:matrix.scrye.com> !info CPE Infra&Releng NA-hours team has a Monday through Thursday 30 minute meeting going through tickets at 1800 UTC in #fedora-meeting-3 2023-12-07 16:08:00 <@nirik:matrix.scrye.com> any other announcements? 2023-12-07 16:08:21 <@nirik:matrix.scrye.com> !info nirik is out for the holidays starting next week. Will still look in and answer emails and outages likely. 2023-12-07 16:08:43 <@Zlopez:matrix.org> !info Red Hat Shutdown happening during Christmas - plenty of folks will not be around 2023-12-07 16:09:17 <@leo:fedora.im> lots of people contribute in the holidays 2023-12-07 16:09:25 <@nirik:matrix.scrye.com> I am planning on sending an email/discussion post tomorrow reminding people to not do anything that causes outages during the holidays. ;) 2023-12-07 16:09:38 <@nirik:matrix.scrye.com> (as I always do) 2023-12-07 16:09:58 <@leo:fedora.im> people still break stuff anyway ;) 2023-12-07 16:10:00 <@nirik:matrix.scrye.com> You might think that, but contributions are usually much lower during the holidays. ;) 2023-12-07 16:10:14 <@leo:fedora.im> oh really well makes sense 2023-12-07 16:10:16 <@Zlopez:matrix.org> Leo: Lots of people are also taking time off from PC 2023-12-07 16:10:22 <@leo:fedora.im> true true 2023-12-07 16:10:40 <@leo:fedora.im> i remember reading something a while back that said that that’s all 2023-12-07 16:11:10 <@nirik:matrix.scrye.com> there's a contributor graph mattdm has that shows it pretty dramatically. 2023-12-07 16:11:37 <@nirik:matrix.scrye.com> https://mattdm.org/fedora/fedora-contributor-trends/ 2023-12-07 16:12:06 <@leo:fedora.im> oh cool 2023-12-07 16:12:20 <@nirik:matrix.scrye.com> Those deep dips? holidays. 2023-12-07 16:12:27 <@nirik:matrix.scrye.com> anyhow, any other announcements? 2023-12-07 16:12:50 <@nirik:matrix.scrye.com> !topic Oncall 2023-12-07 16:12:55 <@nirik:matrix.scrye.com> !info https://fedoraproject.org/wiki/Infrastructure/Oncall 2023-12-07 16:13:01 <@nirik:matrix.scrye.com> https://docs.fedoraproject.org/en-US/cpe/day_to_day_fedora/ 2023-12-07 16:13:12 <@nirik:matrix.scrye.com> !info Leo is on call from 2023-12-01 to 2023-12-07 2023-12-07 16:13:16 <@nirik:matrix.scrye.com> !info jednorozec is on call from 2023-12-08 to 2023-12-14 2023-12-07 16:13:20 <@nirik:matrix.scrye.com> !info is on call from 2023-12-15 to 2023-12-21 2023-12-07 16:13:31 <@nirik:matrix.scrye.com> I suggest we do what we have done in previous years... 2023-12-07 16:13:41 <@nirik:matrix.scrye.com> no one is really oncall, we just ask people to file tickets. 2023-12-07 16:13:50 <@leo:fedora.im> +1 2023-12-07 16:14:22 <@nirik:matrix.scrye.com> and resume oncall on jan 8th... 2023-12-07 16:14:53 <@pcreech:matrix.org> .hello pcreech17 2023-12-07 16:14:58 <@pcreech:matrix.org> (better late than never... :D ) 2023-12-07 16:15:04 <@nirik:matrix.scrye.com> any objections? 2023-12-07 16:15:05 <@leo:fedora.im> i think it’s !hello now 2023-12-07 16:15:07 <@nirik:matrix.scrye.com> hey pcreech 2023-12-07 16:15:12 <@leo:fedora.im> hey! 2023-12-07 16:16:03 <@Zlopez:matrix.org> nirik: +1 2023-12-07 16:16:09 <@pcreech:matrix.org> +1 2023-12-07 16:16:21 <@nirik:matrix.scrye.com> !info Summary of last week: (from current oncall ) 2023-12-07 16:16:31 <@nirik:matrix.scrye.com> any oncall pings Leo? 2023-12-07 16:16:37 <@leo:fedora.im> pretty calm week some bodhi and koschei issues and rdu-cc having issues 2023-12-07 16:17:09 <@leo:fedora.im> mostly bodhi choking on something but couldn’t troubleshoot much other than seeing that the pod was restarting a lot from log01 2023-12-07 16:17:55 <@nirik:matrix.scrye.com> yeah, I looked at that some, but it's an odd one. 2023-12-07 16:18:44 <@nirik:matrix.scrye.com> thanks Leo. 2023-12-07 16:19:05 <@leo:fedora.im> of course :) 2023-12-07 16:19:23 <@leo:fedora.im> looking forward to days where i’ll be able to troubleshoot more… one day 2023-12-07 16:19:31 <@humaton:fedora.im> is the take command the same? 2023-12-07 16:19:52 <@humaton:fedora.im> !oncalltakeeu 2023-12-07 16:19:55 <@nirik:matrix.scrye.com> nope, it's currently only controled by bot admins. I switched it. 2023-12-07 16:20:05 <@nirik:matrix.scrye.com> should be set 2023-12-07 16:20:05 <@humaton:fedora.im> thanks 2023-12-07 16:20:17 <@nirik:matrix.scrye.com> !oncall 2023-12-07 16:20:18 <@zodbot:fedora.im> The following people are oncall: ● @humaton:fedora.im (humaton) Current Time for them: 17:20 (Europe/Prague) If they do not respond, please file a ticket (https://pagure.io/fedora-infrastructure/issues) 2023-12-07 16:20:29 <@nirik:matrix.scrye.com> hum... perhaps thats not right? or is it? 2023-12-07 16:20:43 <@nirik:matrix.scrye.com> I am not sure if it takes fas or matrix name? 2023-12-07 16:20:53 <@humaton:fedora.im> my matrix is my fas 2023-12-07 16:21:00 <@humaton:fedora.im> It works 2023-12-07 16:21:13 <@nirik:matrix.scrye.com> ok, cool. 2023-12-07 16:21:22 <@nirik:matrix.scrye.com> !topic Monitoring discussion [nirik] 2023-12-07 16:21:32 <@nirik:matrix.scrye.com> !info https://nagios.fedoraproject.org/nagios 2023-12-07 16:21:59 <@nirik:matrix.scrye.com> oops. looks like one the power9 boxes is taking a nap. ;( 2023-12-07 16:22:02 <@nirik:matrix.scrye.com> will fix that. 2023-12-07 16:22:21 <@nirik:matrix.scrye.com> otherwise I think we are in normal shape. 2023-12-07 16:23:34 <@leo:fedora.im> nice nice 2023-12-07 16:24:11 <@nirik:matrix.scrye.com> So, are we wanting to do backlog refinement, a learning topic or just end early today? 2023-12-07 16:24:52 <@Zlopez:matrix.org> Do we have learning topic for today? 2023-12-07 16:26:07 <@nirik:matrix.scrye.com> nothing set... 2023-12-07 16:26:32 <@leo:fedora.im> i did a quick look and not much backlog 2023-12-07 16:27:00 <@leo:fedora.im> koschei is down apparently 2023-12-07 16:27:52 <@Zlopez:matrix.org> I'm for backlog refinement 2023-12-07 16:27:55 <@nirik:matrix.scrye.com> yeah, it's been having issues. I think it's hitting it's quotas and getting oom killed. at least thats happened in the past. 2023-12-07 16:28:08 <@leo:fedora.im> maybe we should up them? 2023-12-07 16:28:28 <@leo:fedora.im> +1 on backlog 2023-12-07 16:29:02 <@nirik:matrix.scrye.com> it's back up. it's only sporadically down... 2023-12-07 16:29:57 <@nirik:matrix.scrye.com> my net is being slow... Zlopez you want to run refinement from there? 2023-12-07 16:30:15 <@leo:fedora.im> maybe we should up the quotas 2023-12-07 16:30:34 <@Zlopez:matrix.org> nirik: I ca, let me find the agenda 2023-12-07 16:30:57 <@Zlopez:matrix.org> !topic Revisit blocked tickets 2023-12-07 16:31:02 <@Zlopez:matrix.org> !info Check if any blocked ticket is unblocked 2023-12-07 16:31:06 <@Zlopez:matrix.org> !link https://pagure.io/fedora-infrastructure/issues?status=Open&tags=blocked&priority=0&close_status= 2023-12-07 16:31:06 <@nirik:matrix.scrye.com> Leo: yeah, if thats the issue, I am just speculating, haven't looked yet. 2023-12-07 16:31:27 <@leo:fedora.im> will investigate 2023-12-07 16:31:59 <@Zlopez:matrix.org> I don't think anything blocked is now unblocked 2023-12-07 16:32:03 <@nirik:matrix.scrye.com> t's failing liveness checks. I am suspecting something might be going on with the db server, but not sure what. it looks fine. 2023-12-07 16:32:10 <@nirik:matrix.scrye.com> agreed, all still blocked. 2023-12-07 16:32:22 <@leo:fedora.im> hm okay 2023-12-07 16:32:42 <@leo:fedora.im> will take a look 2023-12-07 16:33:17 <@nirik:matrix.scrye.com> ha. I see a problem. it needs f37 deleted. 2023-12-07 16:34:35 <@Zlopez:matrix.org> !topic Fedora Infra backlog refinement 2023-12-07 16:34:38 <@leo:fedora.im> oh yeah 2023-12-07 16:34:39 <@Zlopez:matrix.org> !info Refine oldest tickets on Fedora Infra tracker 2023-12-07 16:34:44 <@Zlopez:matrix.org> !link https://pagure.io/fedora-infrastructure/issues?status=Open&order_key=last_updated&order=asc 2023-12-07 16:35:11 <@Zlopez:matrix.org> !link https://pagure.io/fedora-infrastructure/issue/10458 2023-12-07 16:35:26 <@Zlopez:matrix.org> This is still waiting for mattdm 2023-12-07 16:36:13 <@Zlopez:matrix.org> !link https://pagure.io/fedora-infrastructure/issue/11452 2023-12-07 16:36:41 <@leo:fedora.im> seems like we can go ahead with this one no? 2023-12-07 16:36:51 <@nirik:matrix.scrye.com> we need to document stuff and then yeah, this can move ahead 2023-12-07 16:37:01 <@Zlopez:matrix.org> Yes 2023-12-07 16:39:18 <@Zlopez:matrix.org> !link https://pagure.io/fedora-infrastructure/issue/10383 2023-12-07 16:39:37 <@Zlopez:matrix.org> Hm, I should probably use ticket command 2023-12-07 16:39:43 <@Zlopez:matrix.org> !ticket 10383 2023-12-07 16:39:46 <@zodbot:fedora.im> fedora-infrastructure #10383 (https://pagure.io/fedora-infrastructure/issue/10383): Upgrade Venus to Pluto 2023-12-07 16:40:47 <@Zlopez:matrix.org> phsmoura worked on this, but I'm not sure where it is 2023-12-07 16:40:48 <@nirik:matrix.scrye.com> phsmoura has been working on this... 2023-12-07 16:41:00 <@nirik:matrix.scrye.com> its really close for stg. 2023-12-07 16:41:15 <@nirik:matrix.scrye.com> there's a PR, but he was going to adjust it to handle kerberos the way we like for openshift. 2023-12-07 16:41:23 <@leo:fedora.im> don't we have this? 2023-12-07 16:41:24 <@leo:fedora.im> https://docs.fedoraproject.org/en-US/infra/ocp4/sop_communishift_onboard_tenant/ 2023-12-07 16:41:25 <@nirik:matrix.scrye.com> I'm not sure if he has been able to do that yet. 2023-12-07 16:42:03 <@leo:fedora.im> for communishift 2023-12-07 16:42:59 <@nirik:matrix.scrye.com> yeah, we need to add some more process to it... not from the technical side, but legal and such. 2023-12-07 16:43:16 <@leo:fedora.im> ah, okay. 2023-12-07 16:43:22 <@Zlopez:matrix.org> It needs legal stuff as nirik said 2023-12-07 16:43:43 <@leo:fedora.im> was not aware it was so legally complicated 2023-12-07 16:44:23 <@nirik:matrix.scrye.com> ¯\_(ツ)_/¯ the world we live in... 2023-12-07 16:45:00 <@Zlopez:matrix.org> It's complicated 2023-12-07 16:45:16 <@Zlopez:matrix.org> !ticket 11297 2023-12-07 16:45:49 <@smooge:fedora.im> would say 'very complicated' but probably time to move on? 2023-12-07 16:46:11 <@leo:fedora.im> indeed 2023-12-07 16:46:26 <@Zlopez:matrix.org> Zodbot is ignoring me :-D 2023-12-07 16:46:54 <@zodbot:fedora.im> fedora-infrastructure #11297 (https://pagure.io/fedora-infrastructure/issue/11297): Reconfigure pagure.io to only allow new projects from 'contributors' or via request 2023-12-07 16:47:13 <@leo:fedora.im> this depends on parure implementing this right 2023-12-07 16:47:22 <@leo:fedora.im> pagure 2023-12-07 16:47:40 <@Zlopez:matrix.org> This is still waiting for the new release of Pagure that will work on RHEL 9, this is currently in progress 2023-12-07 16:47:53 <@leo:fedora.im> right 2023-12-07 16:48:11 <@Zlopez:matrix.org> It's already merged in Pagure, but no version to deploy 2023-12-07 16:48:13 <@nirik:matrix.scrye.com> should we mark it blocked? 2023-12-07 16:48:37 <@leo:fedora.im> +1 for that 2023-12-07 16:48:37 <@Zlopez:matrix.org> It's already marked 2023-12-07 16:49:29 <@Zlopez:matrix.org> !ticket 10372 2023-12-07 16:49:30 <@zodbot:fedora.im> fedora-infrastructure #10372 (https://pagure.io/fedora-infrastructure/issue/10372): [proposal] Move Pagure (pagure.io and src.fp.o) to use OIDC for web login 2023-12-07 16:49:36 <@leo:fedora.im> also blocked? 2023-12-07 16:49:47 <@Zlopez:matrix.org> This is the ticket that is waiting for RHEL 9 Pagure 2023-12-07 16:49:54 <@nirik:matrix.scrye.com> yep 2023-12-07 16:50:13 <@Zlopez:matrix.org> Marked as blocked 2023-12-07 16:50:49 <@Zlopez:matrix.org> !ticket 11013 2023-12-07 16:50:51 <@zodbot:fedora.im> fedora-infrastructure #11013 (https://pagure.io/fedora-infrastructure/issue/11013): Redeploy openQA workers with consistent storage configuration 2023-12-07 16:50:55 <@Zlopez:matrix.org> Last one before open floor 2023-12-07 16:51:05 <@nirik:matrix.scrye.com> just haven't gotten to it... 2023-12-07 16:51:10 <@nirik:matrix.scrye.com> I guess next year. ;) 2023-12-07 16:51:23 <@Zlopez:matrix.org> Or the year after :-D 2023-12-07 16:51:30 <@leo:fedora.im> or the year after that :) 2023-12-07 16:51:36 <@leo:fedora.im> one day 2023-12-07 16:52:31 <@Zlopez:matrix.org> Ok, I think we can move to Open Floor 2023-12-07 16:52:46 <@Zlopez:matrix.org> I will give the meeting back to nirik 2023-12-07 16:52:59 <@nirik:matrix.scrye.com> !topic open floor 2023-12-07 16:53:08 <@nirik:matrix.scrye.com> any items for open floor? 2023-12-07 16:53:11 <@leo:fedora.im> only thing from me is the same TLS stuff for flatpak 2023-12-07 16:53:36 <@leo:fedora.im> maybe we could modify the letsencrypt roles to allow a copying of files to arbitrary hosts but that would add dependency :( 2023-12-07 16:54:11 <@nirik:matrix.scrye.com> yeah. 2023-12-07 16:54:23 <@nirik:matrix.scrye.com> I suppose at that point we could just do self signed. 2023-12-07 16:54:24 <@leo:fedora.im> what if we called the letsencrypt role and skipped the proxies? 2023-12-07 16:54:32 <@leo:fedora.im> ah... yeah. 2023-12-07 16:54:53 <@leo:fedora.im> would have to make openqa trust them though... 2023-12-07 16:58:02 <@nirik:matrix.scrye.com> I don't think we will solve this in the next 3 min. ;) 2023-12-07 16:58:11 <@leo:fedora.im> of course, yeah 2023-12-07 16:58:21 <@leo:fedora.im> let's move on 2023-12-07 16:58:33 <@Zlopez:matrix.org> You can try :-) 2023-12-07 16:59:38 <@leo:fedora.im> i'll just look on my side about directly calling letsencrypt role from the playbook 2023-12-07 16:59:52 <@nirik:matrix.scrye.com> I think a self signed cert for this is probibly best... 2023-12-07 16:59:58 <@leo:fedora.im> ah, okay 2023-12-07 17:00:20 <@nirik:matrix.scrye.com> but of course openqa will have to trust the ca 2023-12-07 17:00:25 <@leo:fedora.im> yeah. gonna have to ask adam 2023-12-07 17:00:39 <@leo:fedora.im> will update pr accordingly 2023-12-07 17:01:06 <@nirik:matrix.scrye.com> thanks everyone! 2023-12-07 17:01:09 <@nirik:matrix.scrye.com> !endmeeting