16:00:31 <eddiejenningsjr> #startmeeting Infrastructure (2023-06-15)
16:00:31 <zodbot> Meeting started Thu Jun 15 16:00:31 2023 UTC.
16:00:31 <zodbot> This meeting is logged and archived in a public location.
16:00:31 <zodbot> The chair is eddiejenningsjr. Information about MeetBot at https://fedoraproject.org/wiki/Zodbot#Meeting_Functions.
16:00:31 <zodbot> Useful Commands: #action #agreed #halp #info #idea #link #topic.
16:00:31 <zodbot> The meeting name has been set to 'infrastructure_(2023-06-15)'
16:00:31 <eddiejenningsjr> #meetingname infrastructure
16:00:31 <zodbot> The meeting name has been set to 'infrastructure'
16:00:31 <eddiejenningsjr> #chair nirik zlopez nb bodanel dtometzki jnsamyak lenkaseg
16:00:31 <zodbot> Current chairs: bodanel dtometzki eddiejenningsjr jnsamyak lenkaseg nb nirik zlopez
16:00:31 <eddiejenningsjr> #info Agenda is at: https://board.net/p/fedora-infra
16:00:31 <eddiejenningsjr> #info About our team: https://docs.fedoraproject.org/en-US/cpe/
16:00:32 <eddiejenningsjr> #info Fedora Infra documentation: https://docs.fedoraproject.org/en-US/infra
16:00:32 <eddiejenningsjr> #topic greetings!
16:00:47 <dtometzki> Hi
16:00:53 <eddiejenningsjr> Time appropriate greetings all!
16:00:57 <eddiejenningsjr> .hello eddiejennings
16:00:58 <zodbot> eddiejenningsjr: eddiejennings 'Eddie Jennings' <eddie@eddiejennings.net>
16:01:11 <nirik> morning everyone
16:02:20 <eddiejenningsjr> It's time to take a break from changing how I'm installing Ansible on control nodes (going to use pip instead of repo packages) and discuss some Fedora Infra :D
16:03:08 <eddiejenningsjr> #topic New folks introductions
16:03:08 <eddiejenningsjr> #info This is a place where people who are interested in Fedora Infrastructure can introduce themselves
16:03:08 <eddiejenningsjr> #info Getting Started Guide: https://fedoraproject.org/wiki/Infrastructure/GettingStarted
16:03:17 <leonkhan> Good morning everyone :)
16:03:19 <eddiejenningsjr> As we continue our greetings, do we have any new people with us today?
16:03:41 <eddiejenningsjr> If so, make yourself known, and gives us a little introduction.  We won't bite.  I promise!
16:05:25 <nirik> We aim to be a friendly bunch.
16:06:26 <eddiejenningsjr> Looks like we don't have any new faces, err, usernames today :).  On to business!
16:06:44 <eddiejenningsjr> #topic Next chair
16:06:44 <eddiejenningsjr> #info magic eight ball says:
16:06:44 <eddiejenningsjr> #info chair 2023-06-15 - eddiejennings
16:06:44 <eddiejenningsjr> #info chair 2023-06-22 - lenkaseg
16:06:44 <eddiejenningsjr> #info chair 2023-06-29 - phsmoura
16:07:32 <eddiejenningsjr> We're covered for chairs through the end of June.  The next week will be the week of July 4th (US holiday).  7/4 falls on a Tuesday.  Am I right in assuming we'll still meet on Thursday?
16:07:47 <nirik> Yeah, likely so...
16:08:04 <lenkaseg> .hi
16:08:05 <zodbot> lenkaseg: lenkaseg 'Lenka Segura' <lenka@sepu.cz>
16:08:46 <eddiejenningsjr> Thus, are there any chair volunteers for 2023-07-06?  Otherwise, I'd be willing to do it as a package deal of being on-call the week before ;)
16:09:18 <dtometzki> I can take the next in July
16:09:34 <eddiejenningsjr> Sold to dtometzki!
16:09:52 <eddiejenningsjr> #info chair 2023-07-06 - dtometzki
16:10:02 <eddiejenningsjr> Thanks for volunteering!
16:11:22 <eddiejenningsjr> We're covered for the next few weeks now, so let's move on, unless someone has a burning desire to volunteer for 2023-07-13.
16:12:11 <eddiejenningsjr> #topic announcements and information
16:12:11 <eddiejenningsjr> #info CPE Infra&Releng EU-hours team has a Monday through Thursday 30 minute meeting going through tickets at 0730 UTC in #centos-meeting
16:12:11 <eddiejenningsjr> #info CPE Infra&Releng NA-hours team has a Monday through Thursday 30 minute meeting going through tickets at 1800 UTC in #fedora-meeting-3
16:12:30 <eddiejenningsjr> Do we have any new announcements?
16:13:02 <nirik> #info we had a lovely DDoS of our dns servers yesterday. Should be in better shape the next time something like that happens.
16:13:28 <nirik> #info flock call for papers/talks is open... https://cfp.fedoraproject.org/
16:14:21 <eddiejenningsjr> Both added.
16:15:21 <eddiejenningsjr> Notwithstanding some kind of errant application, it's sad that folks think DDoSing something like that is a good idea.
16:15:36 <nirik> yeah, no clue what their motivations were...
16:15:59 <eddiejenningsjr> Maybe if they can't have access to free software, no one can ;) :(
16:16:32 <eddiejenningsjr> Anyone else have announcements?
16:18:41 <eddiejenningsjr> Seeing none.  We'll march on!
16:19:02 <eddiejenningsjr> #topic Oncall
16:19:02 <eddiejenningsjr> #info https://fedoraproject.org/wiki/Infrastructure/Oncall
16:19:02 <eddiejenningsjr> #info https://docs.fedoraproject.org/en-US/cpe/day_to_day_fedora/
16:19:02 <eddiejenningsjr> ## .oncalltakeeu .oncalltakeus
16:19:02 <eddiejenningsjr> #info dtometzki is on call from 2023-06-09 to 2023-06-15
16:19:03 <eddiejenningsjr> #info ??? is on call from 2023-06-16 to 2023-06-22
16:19:34 <eddiejenningsjr> Do we have any volunteers for oncall this week?  If not, I can take it.  It's an easy and fun way to be involved.
16:20:12 <nirik> I can take the following week if no one else wants it
16:20:22 <eddiejenningsjr> Even for folks like me who don't have much access, when there's an issue, we're the gatekeepers to the niriks of the world.
16:21:17 <nirik> and many thanks! :)
16:21:54 <eddiejenningsjr> I'll take next week, because I'm generally unavailable the next week
16:22:23 <eddiejenningsjr> #info eddiejennings is on call from 2023-06-16 to 2023-06-22
16:22:50 <eddiejenningsjr> Volunteers for 2023-06-23 to 2023-06-29?
16:24:05 <eddiejenningsjr> nirik could you take the next week (6/23-29)?
16:25:22 <nirik> yep. sign me up
16:25:57 <eddiejenningsjr> #info nirik is on call from 2023-06-23 to 2023-06-29
16:25:59 <eddiejenningsjr> Thank you :)
16:26:34 <eddiejenningsjr> Moving on...
16:26:36 <eddiejenningsjr> #info Summary of last week: (from current oncall )
16:26:47 <eddiejenningsjr> dtometzki, take it away!
16:26:51 <dtometzki> I had two pings one e-Mail issue and the other one kill processes on koji.
16:27:10 <dtometzki> i couldnt really help
16:27:34 <dtometzki> But nirik was available :-)
16:27:59 <eddiejenningsjr> But you were there to acknowledge, so the user knew the issues weren't ignored.  So for folks interested in on-call but don't have much access.  That's how you'd function :)
16:28:03 <nirik> happened along. ;)
16:28:49 <eddiejenningsjr> Speaking of nirik. . .
16:28:51 <eddiejenningsjr> #topic Monitoring discussion [nirik]
16:28:51 <eddiejenningsjr> #info https://nagios.fedoraproject.org/nagios
16:28:51 <eddiejenningsjr> #info Go over existing out items and fix
16:29:32 <nirik> lets see...
16:30:05 <nirik> we are in reasonable shape I think... we have continued to see fmn alerts from time to time. I might file a ticket on that to see if we can fix it.
16:30:52 <nirik> There's a really weird disk space alert we should look into.
16:31:17 <nirik> On some of our power9 machines /boot is showing as kind of full, but... there's not that many files in it oddly.
16:32:28 <nirik> and... for some reason we have alerts on mailman and badges messages, need to investigate.
16:32:42 <eddiejenningsjr> I imagine the files that are in there are "normal" sized.
16:33:44 <nirik> https://paste.centos.org/view/81dd48e5
16:34:47 <eddiejenningsjr> Maybe there are some old kernels in there that need to be purged.
16:35:30 <nirik> df says 959M used, du says 253M... someone is lying. ;)
16:36:50 <eddiejenningsjr> Ha!
16:37:13 <nirik> anyhow, we can move on...
16:38:02 <dtometzki> perhaps if btrfs it is an btrfs issue
16:38:35 <eddiejenningsjr> If I recall correctly, two weeks ago was our Security round table with ticket back log last week.
16:39:00 <eddiejenningsjr> It looks like there is Fedora CI on the learning topic list, but no individual tied to it.  Is that person ready to talk about it today?
16:39:27 <nirik> I think we were going to ask someone from ci to talk to us...
16:39:31 <nirik> but haven't yet.
16:39:40 <eddiejenningsjr> ah ok.
16:40:26 <eddiejenningsjr> Before we decide whether or not to dive into tickets again, let's see if we can expand our learning topic schedule, so we're covered for a little while.
16:40:36 <nirik> ok, it was xfs. I ran a xfs_repair on them and it fixed them up. ;)
16:41:09 <eddiejenningsjr> Do you have to unmount the filesystem to run xfs_repair?
16:41:13 <nirik> I'm happy to talk on any number of topics if folks let me know what they might be interested in.
16:41:17 <nirik> yep.
16:41:28 <eddiejenningsjr> That's what I thought.
16:41:30 <nirik> luckily /boot is not used after you boot.
16:42:18 <eddiejenningsjr> One topic I can do (as it's related to recent real work) is discussing the different ways with pros/cons of installing Ansible on a system.
16:43:16 <nirik> sure, sounds like a fun one.
16:44:23 <eddiejenningsjr> I'll put myself for the 22nd for that, since that would be next in rogation.
16:45:28 <eddiejenningsjr> What other topics would the gallery want nirik to speak on in the future? :)
16:47:36 <eddiejenningsjr> Sounds good, and with that. . .
16:47:37 <nirik> I'll see about coming up with some
16:47:55 <eddiejenningsjr> #topic Revisit blocked tickets
16:47:55 <eddiejenningsjr> #info Check if any blocked ticket is unblocked
16:47:55 <eddiejenningsjr> #link https://pagure.io/fedora-infrastructure/issues?status=Open&tags=blocked&priority=0&close_status=
16:48:16 <eddiejenningsjr> A quick check of the blocked tickets.  Take a look at the link, and if you know of a status change, let's discuss it
16:49:09 <nirik> nope, all blocked still as far as I know.
16:49:27 <eddiejenningsjr> Noted.
16:49:50 <nirik> I don't think we have time for backlog triage... might just go to open floor?
16:50:09 <eddiejenningsjr> I was about to link the backlog, but I imagine most of those are probably blocked.
16:50:22 <eddiejenningsjr> #topic Open Floor
16:50:24 <nirik> we are way down on tickets, which is great. ;)
16:50:35 <eddiejenningsjr> I concur.
16:50:43 <nirik> I had one open floor item...
16:50:49 <eddiejenningsjr> I do have a question for open floor as well
16:50:56 <nirik> oh wait, nevermind.
16:51:05 <nirik> I don't actually have anything. ;) go ahead.
16:52:18 <eddiejenningsjr> So this matrix instance I'm in (fedora.im) is bridged over to ye olde libera.chat IRC rooms.
16:52:18 * nirik nods
16:52:19 <eddiejenningsjr> Does anyone know of any matrix communities for RedHat?
16:52:32 <nirik> Nope, I don't think there is any... at least that I am aware of.
16:52:59 <eddiejenningsjr> I see what looked like a bridge for the #rhel channel, but I couldn't sustain a connection due to needing to have a registered nick (which I do at libera, but I'm on matrix)
16:53:02 <nirik> There's #rhel on libera.chat, but it's not plumbed
16:53:20 <nirik> (and thats not official in any way, nor often on topic of rhel. ;)
16:53:31 <eddiejenningsjr> Which brings me to another open floor item for matrix.
16:53:34 <nirik> you can register your irc side.
16:53:55 <nirik> https://kparal.wordpress.com/2021/06/01/connecting-to-libera-chat-through-matrix/ has a bunch of good info. ;)
16:54:35 <eddiejenningsjr> I'll look into that.  Since I do have an IRC nick registered
16:55:41 <eddiejenningsjr> So the good folks at Fedora provide us the fedora.im homeserver.  I feel compelled to pretty much only use this identity for chatting in Fedora spaces.  Rather than using this identity to chat on insert_any_other_matrix_room
16:56:04 <eddiejenningsjr> Anyone else feel similar?
16:56:58 <nirik> There are some matrix clients that let you use multiple accounts... but yeah, it's not perhaps ideal depending on your use cases.
16:57:38 <eddiejenningsjr> I should probably stop being lazy and learn to deploy and administer my own synapse server, so I'm using my own resources and not draining Fedora ;)
16:58:31 <eddiejenningsjr> I have to head to another meeting for work; thus, I'll end a couple of minutes early.
16:58:36 <eddiejenningsjr> Thanks for attending, everyone!
16:58:51 <nirik> thanks for running things Eddie Jennings, Jr.
16:58:58 <eddiejenningsjr> #endmeeting