<@lenkaseg:fedora.im>
16:01:37
!startmeeting Infrastructure (2024-01-11)
<@meetbot:fedora.im>
16:01:37
Meeting started at 2024-01-11 16:01:37 UTC
<@meetbot:fedora.im>
16:01:37
The Meeting name is 'Infrastructure (2024-01-11)'
<@lenkaseg:fedora.im>
16:01:48
correct channel?
<@leo:fedora.im>
16:02:00
yep ;)
<@lenkaseg:fedora.im>
16:02:00
!meetingname infrastructure
<@lenkaseg:fedora.im>
16:02:06
!chair nirik zlopez nb bodanel dtometzki jnsamyak lenkaseg patrikp
<@pcreech:matrix.org>
16:02:06
Yup :D
<@lenkaseg:fedora.im>
16:02:11
!info Agenda is at: https://board.net/p/fedora-infra
<@lenkaseg:fedora.im>
16:02:17
About our team: https://docs.fedoraproject.org/en-US/cpe/
<@leo:fedora.im>
16:02:20
!hi
<@zodbot:fedora.im>
16:02:22
Leo Puvilland (leo) - he / him / his
<@lenkaseg:fedora.im>
16:02:22
Fedora Infra documentation: https://docs.fedoraproject.org/en-US/infra
<@phsmoura:fedora.im>
16:02:25
!hi
<@zodbot:fedora.im>
16:02:26
Pedro Moura (phsmoura) - he / him / his
<@lenkaseg:fedora.im>
16:02:28
!topic namaste
<@patrikp:matrix.org>
16:02:28
Good evening.
<@nirik:matrix.scrye.com>
16:02:32
!hi
<@zodbot:fedora.im>
16:02:34
Kevin Fenzi (kevin) - he / him / his
<@lenkaseg:fedora.im>
16:02:34
hello everybody!
<@nirik:matrix.scrye.com>
16:02:36
morning everyone
<@pcreech:matrix.org>
16:02:47
!hello pcreech17
<@pcreech:matrix.org>
16:02:48
mornin!
<@zodbot:fedora.im>
16:02:50
Patrick Creech (pcreech17)
<@leo:fedora.im>
16:03:01
morning everyone!
<@Zlopez:matrix.org>
16:03:14
!hello zlopez
<@zodbot:fedora.im>
16:03:15
Michal Konecny (zlopez)
<@lenkaseg:fedora.im>
16:03:23
!topic New folks introductions
<@lenkaseg:fedora.im>
16:03:29
Any new folks here?
<@lenkaseg:fedora.im>
16:03:58
!info This is a place where people who are interested in Fedora Infrastructure can introduce themselves
<@lenkaseg:fedora.im>
16:04:05
Getting Started Guide: https://fedoraproject.org/wiki/Infrastructure/GettingStarted
<@lenkaseg:fedora.im>
16:04:43
nobody new this time...
<@nirik:matrix.scrye.com>
16:04:52
we should change that to https://docs.fedoraproject.org/en-US/infra/gettingstarted/ (and redirect the wiki page)
<@lenkaseg:fedora.im>
16:05:14
changed
<@lenkaseg:fedora.im>
16:05:31
!topic Next chair
<@lenkaseg:fedora.im>
16:05:46
somebody interested in info chair 2024-01-18?
<@lenkaseg:fedora.im>
16:06:08
or 2024-01-25
<@nirik:matrix.scrye.com>
16:06:57
I'm happy to take either if no one else wants them.... but happy to let other folks have the fun too. ;)
<@Zlopez:matrix.org>
16:07:02
I can take one of those
<@pcreech:matrix.org>
16:07:12
I can take either, or both if no one volunteers........
<@pcreech:matrix.org>
16:07:23
which one you want Zlopez?
<@lenkaseg:fedora.im>
16:07:41
I can take one too :) so that would be 4 volunteers for 4 following weeks, great!
<@Zlopez:matrix.org>
16:08:09
Preferably the next week
<@pcreech:matrix.org>
16:08:37
cool, i'll take 25th
<@lenkaseg:fedora.im>
16:08:48
18th nirik, 25th pcreech, 1st zlopez, 8th lenkaseg
<@lenkaseg:fedora.im>
16:08:59
!info chair 2024-01-25 pcreech
<@lenkaseg:fedora.im>
16:09:12
!info chair 2024-01-18 zlopez
<@lenkaseg:fedora.im>
16:09:33
I prefer the 1st of February
<@lenkaseg:fedora.im>
16:09:48
!info chair 2024-02-01 lenkaseg
<@lenkaseg:fedora.im>
16:10:01
Thanks for volunteering everybody!
<@nirik:matrix.scrye.com>
16:10:11
Sounds good to me. ;)
<@lenkaseg:fedora.im>
16:10:36
!topic announcements and information
<@lenkaseg:fedora.im>
16:11:07
!info CPE Infra&Releng EU-hours team has a Monday through Thursday 30 minute meeting going through tickets at 0830 UTC in https://matrix.to/#/#meeting-3:fedoraproject.org
<@lenkaseg:fedora.im>
16:11:14
!info CPE Infra&Releng NA-hours team has a Monday through Thursday 30 minute meeting going through tickets at 1800 UTC in #fedora-meeting-3
<@lenkaseg:fedora.im>
16:11:24
do we have more announcements?
<@Zlopez:matrix.org>
16:12:26
!info Summary of 2023 for Fedora Infrastructure is coming soon
<@nirik:matrix.scrye.com>
16:12:27
!info nirik posted a rhel7 round up to discussion: https://discussion.fedoraproject.org/t/rhel7-status-in-fedora-infra-early-2024-edition/101411
<@Zlopez:matrix.org>
16:13:29
!info ARC Dist-git investigation was finished, discussion is open here: https://discussion.fedoraproject.org/t/dist-git-decoupling-investigation/93644
<@lenkaseg:fedora.im>
16:14:31
Thanks for the info!
<@lenkaseg:fedora.im>
16:15:04
Let's move on...
<@lenkaseg:fedora.im>
16:15:06
!topic Oncall
<@lenkaseg:fedora.im>
16:15:14
!info https://fedoraproject.org/wiki/Infrastructure/Oncall
<@lenkaseg:fedora.im>
16:15:26
https://docs.fedoraproject.org/en-US/cpe/day_to_day_fedora/
<@lenkaseg:fedora.im>
16:15:53
## !oncall add <fas_name>
<@lenkaseg:fedora.im>
16:16:08
lol, the two hashes made it a headline
<@nirik:matrix.scrye.com>
16:16:20
ha.
<@lenkaseg:fedora.im>
16:16:32
!info jednorozec is on call from 2023-12-08 to 2023-12-14
<@lenkaseg:fedora.im>
16:16:44
ah that is old
<@lenkaseg:fedora.im>
16:17:05
mmm... there was nobody on oncall duty?
<@nirik:matrix.scrye.com>
16:17:10
Anyhow, again, I am happy to take oncall for times no one else wants. ;)
<@leo:fedora.im>
16:17:12
not for a couple weeks
<@leo:fedora.im>
16:17:17
i’ll take it too if nobody wants
<@nirik:matrix.scrye.com>
16:17:18
right, we didn't have anyone over holidays.
<@nirik:matrix.scrye.com>
16:17:37
(but I was watching for tickets/outages)
<@lenkaseg:fedora.im>
16:17:39
sold to nirik! Thanks for volunteering!
<@Zlopez:matrix.org>
16:17:40
lenkaseg: I removed the space so it shouldn't be a headline in future :-)
<@lenkaseg:fedora.im>
16:17:59
!info ? is on call from 2024-01-11 to 2024-01-18 nirik
<@pcreech:matrix.org>
16:18:47
I'll jump on the '1-18 to 1-25'
<@leo:fedora.im>
16:19:08
i’ll take the next one if it’s available or whatever
<@leo:fedora.im>
16:19:13
i’ll take the next one if it’s available or whatever it is
<@lenkaseg:fedora.im>
16:19:29
ok, sorry Leo, I sold it to nirik before reading your message
<@leo:fedora.im>
16:19:38
no problem ;)
<@lenkaseg:fedora.im>
16:19:53
!info nirik is on call from 2024-01-11 to 2024-01-18
<@lenkaseg:fedora.im>
16:20:24
!info pcreech is on call from 2024-01-18 to 2024-01-25
<@lenkaseg:fedora.im>
16:20:48
!info leo is on call from 2024-01-25 to 2024-02-01
<@lenkaseg:fedora.im>
16:20:56
Is that ok with everyone?
<@lenkaseg:fedora.im>
16:21:43
!info Summary of last week: (from current oncall )
<@lenkaseg:fedora.im>
16:21:56
nirik, were there some calls or outages?
<@nirik:matrix.scrye.com>
16:23:20
various small things, but overall pretty quiet. The koji database server gave me a lot of headaches in mid-december, but adding 1 index made it really a lot happier. ;)
<@lenkaseg:fedora.im>
16:24:25
Thank! Let's move on to
<@lenkaseg:fedora.im>
16:24:27
!topic Monitoring discussion [nirik]
<@lenkaseg:fedora.im>
16:24:33
Over to nirik again :)
<@lenkaseg:fedora.im>
16:24:46
Thanks! Let's move on to
<@lenkaseg:fedora.im>
16:25:44
!info https://nagios.fedoraproject.org/nagios
<@lenkaseg:fedora.im>
16:25:51
Go over existing out items and fix
<@nirik:matrix.scrye.com>
16:26:07
So, thanks to some work from Leo and ryanlerch we do have nagios alerts on matrix now. ;)
<@nirik:matrix.scrye.com>
16:26:24
There's a few things we have gotten a fair pile of alerts on:
<@nirik:matrix.scrye.com>
16:26:59
db01 is low on space... I can grow the disk, but that will need an outage. I am thinking week after next (after the mass rebuild is over).
<@nirik:matrix.scrye.com>
16:27:29
FMN keeps alerting. I think we should just change the alert values to be really high, since we are only going to do something if it's not processing at all for a long time.
<@Zlopez:matrix.org>
16:27:58
The low on space errors are really common, maybe having a guide how to fix that in docs would be nice
<@nirik:matrix.scrye.com>
16:28:33
well, fixing it means growning the disk... which we do have a sop for. ;) But things like db servers need an outage time for it.
<@nirik:matrix.scrye.com>
16:29:06
and actually on db01, I might also just move it to rhel9 at that time too... we will see.
<@Zlopez:matrix.org>
16:29:16
I'll need to look for it then, so I can do that by myself when I see it
<@nirik:matrix.scrye.com>
16:29:54
https://docs.fedoraproject.org/en-US/infra/sysadmin_guide/guestdisk/
<@nirik:matrix.scrye.com>
16:30:12
anyhow, I think those are the common alerts lately...
<@nirik:matrix.scrye.com>
16:30:54
oh wait, there's one more weird one...
<@nirik:matrix.scrye.com>
16:31:50
bvmhost-p09-03 (one of our power9 buildvmhosts) has a alert on 'total processes'. I am not sure why it's different than the others... so it needs limit increased or diffing it's process list to see whats different there.
<@nirik:matrix.scrye.com>
16:32:41
Thats alert the nagios news. ;)
<@nirik:matrix.scrye.com>
16:32:47
thats all the nagios news rather
<@lenkaseg:fedora.im>
16:33:30
Ok, let's move to next topic ...
<@lenkaseg:fedora.im>
16:33:40
we don't seem to have a learning topic today
<@lenkaseg:fedora.im>
16:33:45
nor anything planned
<@lenkaseg:fedora.im>
16:33:58
some ideas about learning topics?
<@nirik:matrix.scrye.com>
16:34:00
I'm happy to do learning topics if folks tell me what they are interested in.
<@lenkaseg:fedora.im>
16:34:45
there are some brainstormed topics as well
<@lenkaseg:fedora.im>
16:34:54
ok, time to ..
<@lenkaseg:fedora.im>
16:35:00
!topic Fedora Infra backlog refinement
<@lenkaseg:fedora.im>
16:35:22
!info Refine oldest tickets on Fedora Infra tracker
<@Zlopez:matrix.org>
16:35:27
It was last year we checked that out :-D
<@lenkaseg:fedora.im>
16:35:50
!link https://pagure.io/fedora-infrastructure/issues?status=Open&order_key=last_updated&order=asc
<@lenkaseg:fedora.im>
16:36:13
!ticket7361
<@lenkaseg:fedora.im>
16:36:18
!ticket 7361
<@zodbot:fedora.im>
16:36:19
**fedora-infrastructure #7361** (https://pagure.io/fedora-infrastructure/issue/7361):**Signing infrastructure for aarch64**
● **Opened:** 5 years ago by pbrobinson
● **Last Updated:** 7 months ago
● **Assignee:** Not Assigned
<@lenkaseg:fedora.im>
16:37:16
no change?
<@Zlopez:matrix.org>
16:37:32
I'm not sure if we have the hardware for that yet
<@lenkaseg:fedora.im>
16:38:16
the backlog refinement includes the blocked tickets as well?
<@Zlopez:matrix.org>
16:38:49
Yes, it does
<@lenkaseg:fedora.im>
16:38:54
!ticket 11297
<@zodbot:fedora.im>
16:38:55
**fedora-infrastructure #11297** (https://pagure.io/fedora-infrastructure/issue/11297):**Reconfigure pagure.io to only allow new projects from 'contributors' or via request**
● **Opened:** 8 months ago by kevin
● **Last Updated:** 5 months ago
● **Assignee:** ryanlerch
<@lenkaseg:fedora.im>
16:39:30
depends on https://pagure.io/fedora-infrastructure/issue/10372
<@Zlopez:matrix.org>
16:39:59
And that is blocked by waiting for new Pagure version, which is currently being packaged for EPEL9
<@lenkaseg:fedora.im>
16:40:23
ok, another one ...
<@lenkaseg:fedora.im>
16:40:28
!ticket 8291
<@zodbot:fedora.im>
16:40:28
**fedora-infrastructure #8291** (https://pagure.io/fedora-infrastructure/issue/8291):**Fedora messaging - Translation platform topics review**
● **Opened:** 4 years ago by jibecfed
● **Last Updated:** 5 months ago
● **Assignee:** Not Assigned
<@Zlopez:matrix.org>
16:41:00
This is still blocked
<@lenkaseg:fedora.im>
16:41:13
ah, there will be a new release of Pagure then?
<@Zlopez:matrix.org>
16:41:30
It's being worked on for some time
<@lenkaseg:fedora.im>
16:42:25
Good! That would be a big release I guess, a lot of commits and last release 2 years ago...
<@lenkaseg:fedora.im>
16:42:53
!ticket 11324
<@zodbot:fedora.im>
16:42:54
**fedora-infrastructure #11324 ** (https://pagure.io/fedora-infrastructure/issue/11324):**[Badges] [DB] Dump snapshot of existing Badges database in line with updated schema**
● **Opened:** 8 months ago by jflory7
● **Last Updated:** 5 months ago
● **Assignee:** Not Assigned
<@Zlopez:matrix.org>
16:44:13
I'm not sure if this should still be open as the related issue https://pagure.io/fedora-infrastructure/issue/11323 already closed
<@lenkaseg:fedora.im>
16:44:50
Yaeh, looks like it's done
<@Zlopez:matrix.org>
16:46:32
But I'm not aware of the Badges progress, so it's possible that this is still waiting for the schema update
<@nirik:matrix.scrye.com>
16:46:53
Yeah, I think this should be done, but also not clear on badges.
<@nirik:matrix.scrye.com>
16:47:23
I mean we have the db dumped... but new schema should be part of a new app/deployment, no?
<@nirik:matrix.scrye.com>
16:47:36
but perhaps thats also covered under this ticket
<@Zlopez:matrix.org>
16:48:17
We did everything that as Fedora Infra we can do about it, provided the dump
<@lenkaseg:fedora.im>
16:49:42
we can bring it up on tomorrow's standup and ask t0xic0der or jflory7 if the ticket can be closed
<@Zlopez:matrix.org>
16:50:23
I think the earliest standup is on Monday
<@lenkaseg:fedora.im>
16:50:42
oh no, it's Thursday! the time flies...
<@lenkaseg:fedora.im>
16:50:55
!ticket 11042
<@zodbot:fedora.im>
16:50:55
**fedora-infrastructure #11042** (https://pagure.io/fedora-infrastructure/issue/11042):**MBS 3.8.0 Release**
● **Opened:** a year ago by breilly
● **Last Updated:** 5 months ago
● **Assignee:** dherrera
<@Zlopez:matrix.org>
16:51:06
But yes, the t0xic0der should know
<@nirik:matrix.scrye.com>
16:51:19
I have this on my list... getting closer to the top. ;)
<@nirik:matrix.scrye.com>
16:51:33
we have a rpm thanks to Diego Herrera
<@Zlopez:matrix.org>
16:52:04
Should I put it to our team TODO list?
<@Zlopez:matrix.org>
16:53:03
Oh it's already assigned :-)
<@nirik:matrix.scrye.com>
16:53:47
well, it needs deploymet now... I'm happy to help someone...
<@nirik:matrix.scrye.com>
16:54:04
I think diego was just doing the rpm side, but we could ask him if he wants to try and deploy too?
<@Zlopez:matrix.org>
16:56:12
We can ask him or assign it to somebody else
<@Zlopez:matrix.org>
16:56:44
I should start looking at the tickets that are assigned for too long
<@nirik:matrix.scrye.com>
16:57:19
yeah, thats a good idea. In some cases the person might not be around or abile/willing/interested anymore.
<@Zlopez:matrix.org>
16:58:17
It should be more visible with unified backlog
<@lenkaseg:fedora.im>
16:58:22
What is usually considered as time passed since since somebody touched an issue if that person is still working on it?
<@lenkaseg:fedora.im>
16:58:48
oh, maybe let's move to open floor for the next 2 mins
<@lenkaseg:fedora.im>
16:58:50
!topic Open Floor
<@nirik:matrix.scrye.com>
16:58:57
hard to say, some things would be blocked or low pri...
<@Zlopez:matrix.org>
16:59:20
The blocked things should be marked with blocked label
<@lenkaseg:fedora.im>
16:59:42
What is usually considered as too much time passed since somebody touched an issue if that person is still working on it?
<@nirik:matrix.scrye.com>
16:59:45
sure
<@Zlopez:matrix.org>
16:59:57
Let
<@Zlopez:matrix.org>
17:00:22
Let's see I will start poking people :-D
<@lenkaseg:fedora.im>
17:00:32
Ok, let's and the meeting
<@lenkaseg:fedora.im>
17:00:33
!endmeeting