2024-02-05 19:03:17 <@phsmoura:fedora.im> !startmeeting Fedora Infrastructure Ops Daily Standup Meeting
2024-02-05 19:03:18 <@meetbot:fedora.im> Meeting started at 2024-02-05 19:03:17 UTC
2024-02-05 19:03:18 <@meetbot:fedora.im> The Meeting name is 'Fedora Infrastructure Ops Daily Standup Meeting'
2024-02-05 19:03:23 <@leo:fedora.im> !hi
2024-02-05 19:03:23 <@zodbot:fedora.im> Leo Puvilland (leo) - he / him / his
2024-02-05 19:03:26 <@phsmoura:fedora.im> !chair nirik smooge phsmoura
2024-02-05 19:03:35 <@nirik:matrix.scrye.com> oh right, was distracted again. ;)
2024-02-05 19:03:35 <@phsmoura:fedora.im> !meetingname fedora_infrastructure_ops_daily_standup_meeting
2024-02-05 19:03:37 <@nirik:matrix.scrye.com> !hi
2024-02-05 19:03:38 <@zodbot:fedora.im> Kevin Fenzi (kevin) - he / him / his
2024-02-05 19:03:43 <@phsmoura:fedora.im> hello
2024-02-05 19:03:52 <@phsmoura:fedora.im> !info meeting is 30 minutes MAX. At the end of 30, its stops
!info agenda is at https://board.net/p/fedora-infra-daily
!info reminder: speak up if you want to work on a ticket!
2024-02-05 19:03:59 <@phsmoura:fedora.im> !topic Tickets needing review
2024-02-05 19:04:07 <@phsmoura:fedora.im> !info https://pagure.io/fedora-infrastructure/issues?status=Open&priority=1
2024-02-05 19:04:28 <@phsmoura:fedora.im> !ticket 11754
2024-02-05 19:04:28 <@zodbot:fedora.im> **fedora-infrastructure #11754** (https://pagure.io/fedora-infrastructure/issue/11754):**Planned Outage - server updates - 2024-02-07 22:00 UTC**

● **Opened:** 2 hours ago by kevin
● **Last Updated:** 27 minutes ago
● **Assignee:** kevin
2024-02-05 19:04:47 <@nirik:matrix.scrye.com> If someone(s) could review this and make sure I didn't make any typos/date errors that would be great...
2024-02-05 19:04:50 <@nirik:matrix.scrye.com> then I can send it.
2024-02-05 19:04:57 <@nirik:matrix.scrye.com> med med outage
2024-02-05 19:05:09 <@aheath1992:matrix.org> !hi
2024-02-05 19:05:12 <@zodbot:fedora.im> Andrew Heath (aheath1992)
2024-02-05 19:05:39 <@smooge:fedora.im> There will be an outage starting at 2024-0207 22:00UTC,
2024-02-05 19:05:45 <@smooge:fedora.im> missed a -
2024-02-05 19:06:48 <@smooge:fedora.im> also "Most services will be affected for a short time, but end user facing services (mirrorlists, websites) should not be affected." if the DB servers are down, won't that affect websites
2024-02-05 19:06:54 <@smooge:fedora.im> aka wiki
2024-02-05 19:07:10 <@nirik:matrix.scrye.com> no on websites, they do not use any database .
2024-02-05 19:07:18 <@nirik:matrix.scrye.com> wiki yes.
2024-02-05 19:07:33 <@smooge:fedora.im> ok that was all I could see. better than my usual one
2024-02-05 19:07:44 <@smooge:fedora.im> all in the same century and times
2024-02-05 19:08:14 <@nirik:matrix.scrye.com> fixed missing -... thanks!
2024-02-05 19:08:38 <@phsmoura:fedora.im> !ticket 11755
2024-02-05 19:08:38 <@zodbot:fedora.im> **fedora-infrastructure #11755** (https://pagure.io/fedora-infrastructure/issue/11755):**vmhost-x86-copr02 hardware issues**

● **Opened:** an hour ago by kevin
● **Last Updated:** Never
● **Assignee:** kevin
2024-02-05 19:09:27 <@nirik:matrix.scrye.com> med med ops... I will try and get dell to respond again later today.
2024-02-05 19:10:04 <@phsmoura:fedora.im> ok, moving to releng
2024-02-05 19:10:05 <@phsmoura:fedora.im> !info https://pagure.io/releng/issues?status=Open
2024-02-05 19:10:29 <@phsmoura:fedora.im> !11929
2024-02-05 19:10:43 <@phsmoura:fedora.im> !releng 11929
2024-02-05 19:10:43 <@zodbot:fedora.im> **releng #11929** (https://pagure.io/releng/issue/11929):**No space left on s390x builder**

● **Opened:** 2 days ago by qulogic
● **Last Updated:** 2 days ago
● **Assignee:** Not Assigned
2024-02-05 19:11:09 <@nirik:matrix.scrye.com> We can close this I guess. I need to file a bug on dnf5 for not cleaning up it's caches... or it might be koji / dnf5...
2024-02-05 19:12:00 <@smooge:fedora.im> I wonder if it is a separate setting to clean up dnf cache with 5
2024-02-05 19:12:10 <@phsmoura:fedora.im> Do you want to close it nirik ?
2024-02-05 19:13:10 <@nirik:matrix.scrye.com> I can...
2024-02-05 19:14:29 <@phsmoura:fedora.im> !releng 11930
2024-02-05 19:14:30 <@zodbot:fedora.im> **releng #11930** (https://pagure.io/releng/issue/11930):**f40 repo broken**

● **Opened:** a day ago by raveit65
● **Last Updated:** a day ago
● **Assignee:** Not Assigned
2024-02-05 19:15:40 <@phsmoura:fedora.im> is it upstream?
2024-02-05 19:16:32 <@nirik:matrix.scrye.com> yes, close it upstream is my vote
2024-02-05 19:17:48 <@phsmoura:fedora.im> closing.. waiting pagure to respond
2024-02-05 19:18:03 <@phsmoura:fedora.im> !releng 11932
2024-02-05 19:18:04 <@zodbot:fedora.im> **releng #11932** (https://pagure.io/releng/issue/11932):**dozens of f39 builds mis-tagged, getting ejected from f39-stable bodhi pushes**

● **Opened:** 7 hours ago by decathorpe
● **Last Updated:** an hour ago
● **Assignee:** Not Assigned
2024-02-05 19:18:59 <@nirik:matrix.scrye.com> med med ops... we need to sort out tagging on them.
2024-02-05 19:20:55 <@phsmoura:fedora.im> !releng 11933
2024-02-05 19:20:56 <@zodbot:fedora.im> **releng #11933** (https://pagure.io/releng/issue/11933):**python-hiredis accidentally had tar ball added to git on new import package**

● **Opened:** 2 hours ago by pwouters
● **Last Updated:** Never
● **Assignee:** Not Assigned
2024-02-05 19:21:34 <@nirik:matrix.scrye.com> low low ops... we have a script to deal with this I think... (moves the thing to a archive branch)
2024-02-05 19:22:42 <@phsmoura:fedora.im> !topic Planning, Upcoming work and Open floor
2024-02-05 19:22:49 <@phsmoura:fedora.im> anything for open floor?
2024-02-05 19:24:53 <@phsmoura:fedora.im> Im having troble with ocp stg routes from planet disappeared and now I cant see project status it has a TypeError page. Also, doing a research few places point to a bug in ocp? If any of you know what I did wrong otherwise I can hit fedora noc...
2024-02-05 19:25:08 <@phsmoura:fedora.im> Im having troble with ocp stg. Routes from planet disappeared and now I cant see project status it has a TypeError page. Also, doing a research few places point to a bug in ocp? If any of you know what I did wrong otherwise I can hit fedora noc...
2024-02-05 19:25:25 <@phsmoura:fedora.im> Im having troble with ocp stg. Routes from planet disappeared and now I cant see project status. It has a TypeError page. Also, doing a research few places point to a bug in ocp? If any of you know what I did wrong otherwise I can hit fedora noc...
2024-02-05 19:25:38 <@nirik:matrix.scrye.com> I have... a lot this week: update koji in stg, mass update/reboots, upgrade builders to f39 probibly, test new sigul again, mailman staging deployment, new s390x builder lpars install, install 4 new aarch64 boxes, reinstall abunch of other aarch64 boxes, and enable kiwi in first stg and then prod. ;)
2024-02-05 19:26:06 <@nirik:matrix.scrye.com> huh, not sure. I can look... the default route should always be there I thought?
2024-02-05 19:26:33 <@leo:fedora.im> not much from me...
2024-02-05 19:28:01 <@nirik:matrix.scrye.com> hey leo... if you have some time I have a thing you could poke at... the sha1 dnssec zones... we sign a bunch of zones, but they don't have DS records, so it's pointless... could you look at a patch that just removes signing from those zones?
2024-02-05 19:28:16 <@leo:fedora.im> yeah, will take a look
2024-02-05 19:29:13 <@nirik:matrix.scrye.com> that would be great... thanks.
2024-02-05 19:29:39 <@phsmoura:fedora.im> nirik: yes, it was there before. I think this started after the update.. not sure tho.. just remember seeing update warnings
2024-02-05 19:31:16 <@nirik:matrix.scrye.com> phsmoura: huh, so the route you setup we need to add in dns... planet.stg.fedoraproject.org doesn't resolve... but the default one... planet.apps.ocp.stg.fedoraproject.org should work, but it's saying unavailable...
2024-02-05 19:31:46 <@nirik:matrix.scrye.com> oh weird. it's stuck in 'containercreating'
2024-02-05 19:32:06 <@phsmoura:fedora.im> yep
2024-02-05 19:32:25 <@nirik:matrix.scrye.com> ah, it's complaining about the krb volume
2024-02-05 19:32:33 <@nirik:matrix.scrye.com> look at 'events' in the web interface.
2024-02-05 19:33:10 <@phsmoura:fedora.im> there is that issue as well, but the name in configmap and deployment is the same 
2024-02-05 19:33:30 <@phsmoura:fedora.im> maybe we can continue in fedora noc?
2024-02-05 19:35:24 <@nirik:matrix.scrye.com> sure, I think there's something wrong with naming... but I think this is the entire problem, the container never comes up because of it.
2024-02-05 19:35:35 <@nirik:matrix.scrye.com> nothing else from me and we are over time.
2024-02-05 19:36:23 <@phsmoura:fedora.im> Thanks everyone
2024-02-05 19:36:24 <@phsmoura:fedora.im> !endmeeting