2023-11-29 19:00:35 <@phsmoura:fedora.im> !startmeeting Fedora Infrastructure Ops Daily Standup Meeting
2023-11-29 19:00:36 <@meetbot:fedora.im> Meeting started at 2023-11-29 19:00:35 UTC
2023-11-29 19:00:36 <@meetbot:fedora.im> The Meeting name is 'Fedora Infrastructure Ops Daily Standup Meeting'
2023-11-29 19:00:47 <@phsmoura:fedora.im> !meetingname fedora_infrastructure_ops_daily_standup_meeting
2023-11-29 19:00:58 <@phsmoura:fedora.im> !info meeting is 30 minutes MAX. At the end of 30, its stops
!info agenda is at https://board.net/p/fedora-infra-daily
2023-11-29 19:01:05 <@phsmoura:fedora.im> hello
2023-11-29 19:01:23 <@nirik:matrix.scrye.com> !hi
2023-11-29 19:01:25 <@zodbot:fedora.im> Kevin Fenzi (kevin) - he / him / his
2023-11-29 19:01:38 <@leo:fedora.im> !hi
2023-11-29 19:01:39 <@zodbot:fedora.im> Leo Puvilland (leo) - he / him / his
2023-11-29 19:03:56 <@phsmoura:fedora.im> !info reminder: speak up if you want to work on a ticket!
2023-11-29 19:04:04 <@phsmoura:fedora.im> !topic Tickets needing review
2023-11-29 19:04:14 <@phsmoura:fedora.im> !info https://pagure.io/fedora-infrastructure/issues?status=Open&priority=1
2023-11-29 19:04:40 <@phsmoura:fedora.im> !ticket 11653
2023-11-29 19:04:41 <@zodbot:fedora.im> fedora-infrastructure #11653 (https://pagure.io/fedora-infrastructure/issue/11653): Request for 'openscanhub' repository on GitHub
2023-11-29 19:05:01 <@nirik:matrix.scrye.com> low low ops?
2023-11-29 19:06:03 <@phsmoura:fedora.im> +1
2023-11-29 19:06:15 <@phsmoura:fedora.im> !ticket 11654
2023-11-29 19:06:15 <@zodbot:fedora.im> fedora-infrastructure #11654 (https://pagure.io/fedora-infrastructure/issue/11654): email to python-bcrypt-maintainers@fedoraproject.org partially bounces
2023-11-29 19:06:37 <@nirik:matrix.scrye.com> low low ops... needs investigation.
2023-11-29 19:06:50 <@phsmoura:fedora.im> waiting pagure
2023-11-29 19:07:48 <@aheath1992:matrix.org> !hi
2023-11-29 19:07:49 <@phsmoura:fedora.im> done
2023-11-29 19:07:49 <@zodbot:fedora.im> Andrew Heath (aheath1992)
2023-11-29 19:07:59 <@phsmoura:fedora.im> moving to releng
2023-11-29 19:08:14 <@phsmoura:fedora.im> !info https://pagure.io/releng/issues?status=Open
2023-11-29 19:08:29 <@phsmoura:fedora.im> !releng 11812
2023-11-29 19:08:30 <@zodbot:fedora.im> releng #11812 (https://pagure.io/releng/issue/11812): Unretire rpms/bluecurve-icon-theme
2023-11-29 19:08:42 <@phsmoura:fedora.im> low low ops
2023-11-29 19:08:44 <@nirik:matrix.scrye.com> +1
2023-11-29 19:09:07 <@phsmoura:fedora.im> !releng 11813
2023-11-29 19:09:08 <@zodbot:fedora.im> releng #11813 (https://pagure.io/releng/issue/11813): Unretire rpms/geteltorito
2023-11-29 19:09:10 <@phsmoura:fedora.im> same
2023-11-29 19:09:18 <@nirik:matrix.scrye.com> yep
2023-11-29 19:09:51 <@humaton:fedora.im> we need to get toddlers fixed and released so the unretirements are automated
2023-11-29 19:10:23 <@nirik:matrix.scrye.com> that would be nice for sure. ;)
2023-11-29 19:11:08 <@humaton:fedora.im> yeah some code is there it needs some love
2023-11-29 19:11:28 <@phsmoura:fedora.im> !topic Planning, Upcoming work and Open floor
2023-11-29 19:11:35 <@phsmoura:fedora.im> anything for open floor?
2023-11-29 19:11:39 <@Zlopez:matrix.org> .hello
2023-11-29 19:11:43 <@humaton:fedora.im> !releng 11787
2023-11-29 19:11:44 <@zodbot:fedora.im> releng #11787 (https://pagure.io/releng/issue/11787): create EPEL 10 package signing key
2023-11-29 19:11:44 <@Zlopez:matrix.org> !hello
2023-11-29 19:11:55 <@humaton:fedora.im> so do we want ima keys as well?
2023-11-29 19:11:57 <@zodbot:fedora.im> Michal Konecny (zlopez)
2023-11-29 19:12:09 <@nirik:matrix.scrye.com> yes I would think so...
2023-11-29 19:12:30 <@humaton:fedora.im> will create them first thing in the morning
2023-11-29 19:12:57 <@nirik:matrix.scrye.com> for me this week: still sick... so appologies if I am slow or surly. ;) I made a new rhel9 torrent01 yesterday, going to switch to it today and if all goes well nuke torrent02. Then, perhaps will try and do people01
2023-11-29 19:13:23 <@Zlopez:matrix.org> !ticket 10358
2023-11-29 19:13:27 <@zodbot:fedora.im> fedora-infrastructure #10358 (https://pagure.io/fedora-infrastructure/issue/10358): IPA backup fails on ipa03 and ipa02.stg
2023-11-29 19:14:04 <@Zlopez:matrix.org> I was able to follow the rest of the migration guide, but the ipa01.stg deployment fails on DNS still pointing to it as LDAP server
2023-11-29 19:14:26 <@nirik:matrix.scrye.com> you could switch dns to ipa02.stg for a few?
2023-11-29 19:14:31 <@nirik:matrix.scrye.com> but really it should have them all in there.
2023-11-29 19:14:58 <@Zlopez:matrix.org> Not sure how this works, but currently plenty of services are not available
2023-11-29 19:15:06 <@nirik:matrix.scrye.com> Yeah, 02 is in there, but commented out:
2023-11-29 19:15:12 <@nirik:matrix.scrye.com> ; staging
_ldap._tcp.stg  IN SRV 0 100 389 ipa01.stg.iad2.fedoraproject.org.
;_ldap._tcp.stg  IN SRV 0 100 389 ipa02.stg.iad2.fedoraproject.org.
2023-11-29 19:15:45 <@Zlopez:matrix.org> The DNS is in ansible-private?
2023-11-29 19:15:57 <@Zlopez:matrix.org> I never touched it before
2023-11-29 19:16:19 <@nirik:matrix.scrye.com> no, it's in it's own repo.
2023-11-29 19:16:32 <@nirik:matrix.scrye.com> I can update it if you like? just add 02? or remove 01 and add 02?
2023-11-29 19:16:51 <@Zlopez:matrix.org> Just adding it should be enough
2023-11-29 19:17:10 <@nirik:matrix.scrye.com> yeah, was about to say we should have a SOP
2023-11-29 19:17:12 <@Zlopez:matrix.org> Do we also want to keep ipa03.stg when I'm done?
2023-11-29 19:17:36 <@nirik:matrix.scrye.com> that more closely matches prod I guess.
2023-11-29 19:17:54 <@Zlopez:matrix.org> Yes, it does
2023-11-29 19:18:23 <@Zlopez:matrix.org> How long till the DNS change will be propagated?
2023-11-29 19:18:56 <@nirik:matrix.scrye.com> 5m... or you can run the update_dns.yml playbook
2023-11-29 19:19:18 <@Zlopez:matrix.org> I will wait few minutes :-)
2023-11-29 19:19:49 <@Zlopez:matrix.org> I would just like to not left the staging in broken state before I finish for today
2023-11-29 19:20:00 <@nirik:matrix.scrye.com> yeah, thanks.
2023-11-29 19:21:36 <@nirik:matrix.scrye.com> I don't think I have much else...
2023-11-29 19:22:12 <@Zlopez:matrix.org> I will continue on IPA tomorrow
2023-11-29 19:22:42 <@nirik:matrix.scrye.com> Thanks for working on that.
2023-11-29 19:23:33 <@aheath1992:matrix.org> Nothing from my end 
2023-11-29 19:24:00 <@leo:fedora.im> not much here other than the varnish stuff? but other than that nothing
2023-11-29 19:26:17 <@Zlopez:matrix.org> Is thins ok?
```
$ host -t a _ldap._tcp.stg.fedoraproject.org
_ldap._tcp.stg.fedoraproject.org has no A record
```
2023-11-29 19:26:59 <@nirik:matrix.scrye.com> yeah, thats normal... it's a SRV record, not a A
2023-11-29 19:27:26 <@Zlopez:matrix.org> Thanks
2023-11-29 19:28:25 <@phsmoura:fedora.im> I'm finding it confusing to write the playbook for fedora planet. I took the yml from Bodhi as an example, but there are variables, roles, and so on... These details leave me a bit lost. Any tips on what I should focus on to write this playbook?
2023-11-29 19:30:16 <@Zlopez:matrix.org> phsmoura: It would be probably good to look at the ansible basics about roles https://spacelift.io/blog/ansible-roles
2023-11-29 19:31:40 <@nirik:matrix.scrye.com> the roles can be seen under roles/openshift/ so basically each role there is a simple thing that takes your apps files and templates them to fill in variables, etc.
2023-11-29 19:32:24 <@phsmoura:fedora.im> yep, but we have variable yml files in /srv
2023-11-29 19:33:16 <@nirik:matrix.scrye.com> a lot of the openshift playbooks call 'openshift/object' which just takes the name you pass it and templates it with the roles/openshift-app/$app/templates/ thing for your app
2023-11-29 19:33:45 <@nirik:matrix.scrye.com> I'm probibly not helping. ;( We should have a better doc on this all, I know it's confusing.
2023-11-29 19:34:13 <@phsmoura:fedora.im> in the end I open lots of files trying to understand it and find it hard to apply for planet
2023-11-29 19:35:14 <@phsmoura:fedora.im> ok, np.. :) Ill try to do it and any mistakes I can fix it later with the reviews, the PR is a WIP 
2023-11-29 19:35:47 <@nirik:matrix.scrye.com> You could start with just staging and just the openshift/project role and add one at a time to that?
2023-11-29 19:36:41 <@nirik:matrix.scrye.com> bodhi might also be a complex one, might be easier to look at one of the smaller/simplier ones?
2023-11-29 19:37:30 <@phsmoura:fedora.im> hmm ok, any idea of another project that would help as an example?
2023-11-29 19:37:31 <@nirik:matrix.scrye.com> fasjson, or mdapi perhaps?
2023-11-29 19:37:40 <@phsmoura:fedora.im> cool
2023-11-29 19:38:15 <@nirik:matrix.scrye.com> I just looked and our SOPs are all about managing the openshift cluster, nothing about making an app...
2023-11-29 19:38:20 <@nirik:matrix.scrye.com> unless thats in the devel guide?
2023-11-29 19:38:26 <@leo:fedora.im> yeah, i was looking trying to find that doc
2023-11-29 19:38:39 <@nirik:matrix.scrye.com> ah yes:
2023-11-29 19:38:42 <@nirik:matrix.scrye.com> https://docs.fedoraproject.org/en-US/infra/developer_guide/openshift/
2023-11-29 19:39:17 <@nirik:matrix.scrye.com> still not much info, but more at least
2023-11-29 19:39:50 <@leo:fedora.im> that actually does help though
2023-11-29 19:39:56 <@phsmoura:fedora.im> ah great, seems I need to fix something already, but that helps a bit
2023-11-29 19:40:00 <@darknao:fedora.im> And remember to use Deployment instead of DeploymentConfig :p
2023-11-29 19:40:14 <@darknao:fedora.im> (deploymentConfig are deprecated)
2023-11-29 19:40:17 <@phsmoura:fedora.im> ah so did it rigth
2023-11-29 19:40:20 <@phsmoura:fedora.im> hahah
2023-11-29 19:40:50 <@nirik:matrix.scrye.com> ah yeah, we should fix that.
2023-11-29 19:41:02 <@nirik:matrix.scrye.com> Zlopez: was I making that dns change, or were you?
2023-11-29 19:42:30 <@Zlopez:matrix.org> I did it
2023-11-29 19:43:02 <@nirik:matrix.scrye.com> ok, cool.
2023-11-29 19:43:55 <@Zlopez:matrix.org> The account.fedoraproject.org are now working, but the https://id.stg.fedoraproject.org/ipa/ui is still unavailable
2023-11-29 19:44:07 <@Zlopez:matrix.org> account.stg.fedoraproject.org
2023-11-29 19:44:28 <@Zlopez:matrix.org> Ok, no it doesn't
2023-11-29 19:44:51 <@phsmoura:fedora.im> That's all then, we are overtime.  Sorry for that, yep we can continue in another chanel
2023-11-29 19:44:59 <@phsmoura:fedora.im> thanks everyone :)
2023-11-29 19:45:16 <@phsmoura:fedora.im> !endmeeting