#meeting-3:fedoraproject.org log

<@phsmoura:fedora.im>

20:01:02

!startmeeting Fedora Infrastructure Ops Daily Standup Meeting

<@meetbot:fedora.im>

20:01:03

Meeting started at 2024-11-18 20:01:02 UTC

<@meetbot:fedora.im>

20:01:03

The Meeting name is 'Fedora Infrastructure Ops Daily Standup Meeting'

<@phsmoura:fedora.im>

20:01:09

!meetingname fedora_infrastructure_ops_daily_standup_meeting

<@phsmoura:fedora.im>

20:01:09

!info reminder: speak up if you want to work on a ticket!

<@phsmoura:fedora.im>

20:01:09

!info agenda is at https://board.net/p/fedora-infra-daily

<@phsmoura:fedora.im>

20:01:09

!info meeting is 30 minutes MAX. At the end of 30, its stops

<@phsmoura:fedora.im>

20:01:09

!chair nirik smooge phsmoura

<@meetbot:fedora.im>

20:01:10

The Meeting Name is now fedora_infrastructure_ops_daily_standup_meeting

<@phsmoura:fedora.im>

20:01:13

hello

<@smilner:fedora.im>

20:01:18

!hi

<@zodbot:fedora.im>

20:01:19

None (smilner)

<@smilner:fedora.im>

20:01:24

Hey phsmoura

<@james:fedora.im>

20:01:36

!hi

<@zodbot:fedora.im>

20:01:38

James Antill (james)

<@phsmoura:fedora.im>

20:01:51

!info https://pagure.io/fedora-infrastructure/issues?status=Open&priority=1

<@phsmoura:fedora.im>

20:01:51

!topic Tickets needing review

<@phsmoura:fedora.im>

20:02:15

!ticket 12291

<@zodbot:fedora.im>

20:02:16

<@zodbot:fedora.im>

20:02:16

● **Opened:** 3 days ago by adamwill

<@zodbot:fedora.im>

20:02:16

● **Assignee:** Not Assigned

<@zodbot:fedora.im>

20:02:16

● **Last Updated:** a day ago

<@zodbot:fedora.im>

20:02:16

**fedora-infrastructure #12291** (https://pagure.io/fedora-infrastructure/issue/12291):**pagure returning 500s due to error in flask_oidc**

<@nirik:matrix.scrye.com>

20:02:24

morning.

<@nirik:matrix.scrye.com>

20:02:44

med med ops and cc abompard?

<@smilner:fedora.im>

20:04:26

Do we know how often it's happening?

<@nirik:matrix.scrye.com>

20:05:04

I've not seen it myself...

<@nirik:matrix.scrye.com>

20:05:28

I am not sure how often it's happening.

<@james:fedora.im>

20:05:57

Yeh, seems different for different users ... and adam suggested there are multiple problems where one has been fixed? Or fixed itself.

<@nirik:matrix.scrye.com>

20:06:24

I think there was a related ticket that was fixed yeah

<@phsmoura:fedora.im>

20:06:36

dont know but Im also having trouble with pagure.. cant merge a PR it pops up an empty green windown when clicking on merge, but I dont think this is related

<@nirik:matrix.scrye.com>

20:07:13

https://pagure.io/fedora-infrastructure/issue/12260

<@phsmoura:fedora.im>

20:08:49

!ticket 12293

<@zodbot:fedora.im>

20:08:49

● **Last Updated:** an hour ago

<@zodbot:fedora.im>

20:08:49

**fedora-infrastructure #12293** (https://pagure.io/fedora-infrastructure/issue/12293):**Planned Outage - Server update/reboots - 2024-11-20 21:00 UTC**

<@zodbot:fedora.im>

20:08:49

<@zodbot:fedora.im>

20:08:49

● **Opened:** 2 days ago by kevin

<@zodbot:fedora.im>

20:08:49

● **Assignee:** kevin

<@smilner:fedora.im>

20:08:55

Interesting. Seems like something we'd want to fix quickly if possible 😆. Just curious if we knew the impact. Thanks!

<@seddik:fedora.im>

20:09:00

!hi

<@zodbot:fedora.im>

20:09:01

seddik alaouiismaili (seddik)

<@nirik:matrix.scrye.com>

20:09:18

yeah, this is likely fallout from the auth changes abompard did (or not? just a guess)

<@phsmoura:fedora.im>

20:09:22

med med outage?

<@nirik:matrix.scrye.com>

20:09:26

anyhow, med med ops on this one... yep.

<@seddik:fedora.im>

20:09:44

For me that was an Internal Server Error

<@james:fedora.im>

20:10:13

Note to everyone ... it's 20:00 UTC now, so 21:00 UTC is one hour from now.

<@james:fedora.im>

20:10:43

yselkowitz is helping you with this, right?

<@yselkowitz:fedora.im>

20:11:06

huh??

<@phsmoura:fedora.im>

20:11:10

!ticket 12295

<@zodbot:fedora.im>

20:11:11

● **Assignee:** Not Assigned

<@zodbot:fedora.im>

20:11:11

**fedora-infrastructure #12295** (https://pagure.io/fedora-infrastructure/issue/12295):**Failure to log in to fedora discussion account with container.**

<@zodbot:fedora.im>

20:11:11

● **Opened:** a day ago by gosling203

<@zodbot:fedora.im>

20:11:11

● **Last Updated:** 6 hours ago

<@zodbot:fedora.im>

20:11:11

<@nirik:matrix.scrye.com>

20:11:16

yes, an hour from now, but on wed. ;)

<@james:fedora.im>

20:11:53

The server updates ... did I misread/misremember?

<@yselkowitz:fedora.im>

20:11:57

not me

<@nirik:matrix.scrye.com>

20:12:02

For this one, we don't maintain discussion, but we do maintain the auth to it. So, it's likely in our area.

<@nirik:matrix.scrye.com>

20:12:18

James Antill: he just wanted to know when it was so he could plan the eln mass rebuild.

<@james:fedora.im>

20:12:28

Ahh, okay, my bad.

<@yselkowitz:fedora.im>

20:13:16

I couldn't help anyway but thanks for asking :-D

<@nirik:matrix.scrye.com>

20:13:38

So I think we need more info on this one... shall I add some questions?

<@james:fedora.im>

20:14:25

Yeh, I guess. Could this also be related to the auth changes from abompard?

<@nirik:matrix.scrye.com>

20:15:05

nope. that was pagure.io only I am pretty sure.

<@nirik:matrix.scrye.com>

20:15:58

I added some questions and set it low/low for now... if thats ok

<@james:fedora.im>

20:16:46

LGTM

<@phsmoura:fedora.im>

20:17:51

ok, thanks

<@phsmoura:fedora.im>

20:17:52

!info https://pagure.io/releng/issues?status=Open

<@phsmoura:fedora.im>

20:18:10

!releng 12463

<@zodbot:fedora.im>

20:18:12

● **Assignee:** Not Assigned

<@zodbot:fedora.im>

20:18:12

<@zodbot:fedora.im>

20:18:12

● **Opened:** 3 days ago by adamwill

<@zodbot:fedora.im>

20:18:12

● **Last Updated:** 2 days ago

<@zodbot:fedora.im>

20:18:12

**releng #12463** (https://pagure.io/releng/issue/12463):**Further improve full compose speed**

<@nirik:matrix.scrye.com>

20:18:45

low low I guess... \

<@nirik:matrix.scrye.com>

20:18:59

well, or med med or something

<@james:fedora.im>

20:19:32

or high, high ... depends on how fast the end state is ;)

<@nirik:matrix.scrye.com>

20:20:30

I think the low hanging fruit might be picked... but adamw is digging more.

<@nirik:matrix.scrye.com>

20:21:24

I guess med / med makes most sense

<@james:fedora.im>

20:22:07

If any konflux things are going into it then I'd def. go high ... but it probably doesn't matter much.

<@phsmoura:fedora.im>

20:22:11

!releng 12466

<@zodbot:fedora.im>

20:22:12

● **Assignee:** Not Assigned

<@zodbot:fedora.im>

20:22:12

**releng #12466** (https://pagure.io/releng/issue/12466):**Please update `openh264`to 2.5.0 in F41**

<@zodbot:fedora.im>

20:22:12

<@zodbot:fedora.im>

20:22:12

● **Opened:** 11 hours ago by abitrolly

<@zodbot:fedora.im>

20:22:12

● **Last Updated:** 4 hours ago

<@nirik:matrix.scrye.com>

20:22:47

low low ops? we need to hear that it's ready to ship... and jednorozec was gonna work with patrikp on the process.

<@humaton:fedora.im>

20:23:19

ack

<@phsmoura:fedora.im>

20:24:17

!topic Planning, Upcoming work and Open floor

<@phsmoura:fedora.im>

20:24:40

anything for open floor?

<@nirik:matrix.scrye.com>

20:25:31

So I have a few things:

<@nirik:matrix.scrye.com>

20:25:51

we have the mass update/reboot cycle this week... stg today, other stuff tomorrow, outage wed

<@nirik:matrix.scrye.com>

20:26:12

I finally finally finally got access to mgmt on ibiblio05 after a remote debugging session on friday.

<@nirik:matrix.scrye.com>

20:26:25

So, I can and will reinstall it. It's a rhel7 box. ;(

<@nirik:matrix.scrye.com>

20:26:55

That leaves us with just 4 rhel7 instances... 2 fedmsg busgateway and 2 github2fedmsg... those should go away when we finish retiring those

<@nirik:matrix.scrye.com>

20:27:33

There are 20 rhel8 boxes left. Many being worked on... and I plan to try and do some more wed during the outage.

<@humaton:fedora.im>

20:27:53

fabian mentioned he is kicking it down the road and we might be able to retire the centos fedmsg dependency

<@humaton:fedora.im>

20:28:09

*retire soon*

<@nirik:matrix.scrye.com>

20:28:25

There's 15 fedora 39 instances... most of them are copr / logdetective

<@james:fedora.im>

20:28:26

So ... talking about the outage ... do you need/want help any of the days? Wed. evening is bad for me, but I can cancel plans if needed.

<@nirik:matrix.scrye.com>

20:29:21

The only f39 ones we need to move are ipsilon. So, we need to test f41 ipsilon in stg and then prod

<@nirik:matrix.scrye.com>

20:29:46

James Antill: would love help anytime... if you could help today/tomorrow even if you're not around wed that would be great.

<@nirik:matrix.scrye.com>

20:30:16

finally, koji builders/hubs. I was hoping to move them from 40->41 on wed...

<@nirik:matrix.scrye.com>

20:30:34

but I just upgraded koji01.stg and... it's not working. Needs debugging to see whats going on.

<@nirik:matrix.scrye.com>

20:30:58

I think thats it. ;)

<@phsmoura:fedora.im>

20:32:07

ok, I dont have much else

<@james:fedora.im>

20:32:32

We are also overtime.

<@nirik:matrix.scrye.com>

20:32:37

oh yeah.

<@nirik:matrix.scrye.com>

20:32:50

thanks everyone. Lots of folks here today... love to see it!

<@james:fedora.im>

20:33:45

Maybe we should tweak the beginning !info about the timelimit ;)

<@phsmoura:fedora.im>

20:33:45

ok, lets go back then, thanks everyone :)

<@phsmoura:fedora.im>

20:33:52

!endmeeting