16:00:27 <Zlopez[m]> #startmeeting Infrastructure (2021-02-11)
16:00:28 <zodbot> Meeting started Thu Feb 11 16:00:27 2021 UTC.
16:00:28 <zodbot> This meeting is logged and archived in a public location.
16:00:28 <zodbot> The chair is Zlopez[m]. Information about MeetBot at http://wiki.debian.org/MeetBot.
16:00:28 <zodbot> Useful Commands: #action #agreed #halp #info #idea #link #topic.
16:00:28 <zodbot> The meeting name has been set to 'infrastructure_(2021-02-11)'
16:00:45 <darknao> .hi
16:00:45 <zodbot> darknao: darknao 'Francois Andrieu' <naolwen@gmail.com>
16:00:49 <Zlopez[m]> #meetingname infrastructure
16:00:49 <zodbot> The meeting name has been set to 'infrastructure'
16:00:50 <Zlopez[m]> #chair nirik pingou smooge cverna mizdebsk mkonecny abompard siddharthvipul mobrien
16:00:50 <zodbot> Current chairs: Zlopez[m] abompard cverna mizdebsk mkonecny mobrien nirik pingou siddharthvipul smooge
16:01:02 <Zlopez[m]> #info Agenda is at: https://board.net/p/fedora-infra
16:01:06 <Zlopez[m]> #info About our team: https://docs.fedoraproject.org/en-US/cpe/
16:01:12 <Zlopez[m]> #topic aloha
16:01:23 <nirik> morning
16:01:41 <austinpowered> .hello2
16:01:41 <zodbot> austinpowered: austinpowered 'T.C. Williams' <fedoraproject@wootenwilliams.com>
16:01:43 <Zlopez[m]> It looks like the zodbot can't really handle multiple things at once from matrix
16:01:49 <Zlopez[m]> .hello zlopez
16:01:50 <zodbot> Zlopez[m]: zlopez 'Michal Konečný' <michal.konecny@psmail.xyz>
16:02:02 <siddharthvipul> heyy
16:02:04 <siddharthvipul> good morning everyone
16:02:04 <copperi> .hello2
16:02:05 <nirik> Zlopez[m]: it puts them in a 'long message' and the bot can't decode that too well.
16:02:05 <zodbot> copperi: copperi 'Jan Kuparinen' <copper_fin@hotmail.com>
16:02:06 <nils> .hello nphilipp
16:02:08 <zodbot> nils: nphilipp 'Nils Philippsen' <nphilipp@redhat.com>
16:02:10 <nils> hi!
16:02:13 <siddharthvipul> .hello siddharthvipul1
16:02:14 <zodbot> siddharthvipul: siddharthvipul1 'Vipul Siddharth' <siddharthvipul1@gmail.com>
16:02:46 <Zlopez[m]> Hello adventurers, today we will go on a quest to destroy evil bugs with the help of our mighty administrators
16:03:13 <Zlopez[m]> Let's see who new is joining us on this quest
16:03:18 <Zlopez[m]> #topic New folks introductions
16:03:25 <Zlopez[m]> #info This is a place where people who are interested in Fedora Infrastructure can introduce themselves
16:03:25 <Zlopez[m]> #info Getting Started Guide: https://fedoraproject.org/wiki/Infrastructure/GettingStarted
16:04:23 <Zlopez[m]> Any new adventurer on this quest?
16:04:30 <copperi> Maybe me ?
16:04:30 <Zlopez[m]> Don't be shy
16:04:46 <Zlopez[m]> Welcome copperi
16:05:16 <Zlopez[m]> Do you want to tell us something about you?
16:05:38 <copperi> You can find something from my profile page,
16:05:51 <nirik> welcome copperi
16:06:03 <copperi> basically has a long history of administration of servers
16:06:23 <smooge> hello copperi
16:06:54 <Zlopez[m]> copperi: Those are exactly the skills we need on our adventures :-)
16:07:10 <darknao> welcome copperi!
16:07:15 <copperi> and some coding as well
16:07:37 <Zlopez[m]> copperi: That is always helpful
16:08:37 <Zlopez[m]> If there is no one else, we'll move one
16:09:08 <Zlopez[m]> Let's see who will lead the next expedition in these dangerous places
16:09:12 <Zlopez[m]> #topic Next chair
16:09:20 * Zlopez[m] sent a long message:  < https://matrix.org/_matrix/media/r0/download/matrix.org/gcizFYIfNoVyspRHIoQVlEfY/message.txt >
16:09:51 <Zlopez[m]> It looks like we are missing leader for 2021-03-04
16:09:58 <Zlopez[m]> Any volunteers?
16:10:38 <Zlopez[m]> There will be plenty of loot :-)
16:11:02 * siddharthvipul can take it
16:11:12 <Zlopez[m]> It's yours
16:11:25 <Zlopez[m]> Lead our group of adventurers well
16:11:34 <Zlopez[m]> #info chair 2021-03-04 - siddharthvipul
16:12:38 <Zlopez[m]> Let's look at the latest news, so we can see what could be expected on our journey
16:12:43 <Zlopez[m]> #topic announcements and information
16:12:50 <Zlopez[m]> #info CPE Infra&Releng EU-hours team has a Monday through Friday 30 minute meeting going through tickets at 1030 Europe/paris in #centos-meeting
16:12:50 <Zlopez[m]> #info CPE Infra&Releng NA-hours team has a Monday through Friday 30 minute meeting going through tickets at 1800 UTC in #fedora-admin
16:12:50 <Zlopez[m]> #info Datacenter move is over, but some items still need to be done: see https://fedoraproject.org/wiki/Infrastructure/2020-post-datacenter-move-known-issues
16:13:03 <Zlopez[m]> Anything I missed?
16:13:43 <nirik> #info Fedora 34 branched off rawhide this week
16:14:02 <Zlopez[m]> Good news
16:14:46 <smooge> #info devconf.cz later this week
16:15:09 <nirik> oh shoot, thats this weekend isn't it?
16:15:30 <smooge> or am i off a week
16:15:37 <siddharthvipul> next
16:15:43 <siddharthvipul> feb 18-20
16:15:46 <Zlopez[m]> If I'm looking correctly, it starts next week
16:15:52 <Zlopez[m]> https://devconfcz2021.sched.com/
16:15:54 <smooge> I AM OFF A WEEK
16:15:58 <nirik> ah, whew
16:16:12 <smooge> .. gets back in the Tardis
16:16:39 <Zlopez[m]> smooge:  It looks like you have some form of timeshift sickness
16:16:57 * nirik was confused, thought smooge was taking a week off... was going to say 'cool, sounds nice'
16:16:58 <smooge> #info devconf.cz is feb 18-20 and talks can be found https://devconfcz2021.sched.com/
16:18:30 <Zlopez[m]> Wonderful news as I can see
16:19:18 <Zlopez[m]> We should decide who will be on watch, when the others will work
16:19:22 <Zlopez[m]> #topic Oncall
16:19:29 * Zlopez[m] sent a long message:  < https://matrix.org/_matrix/media/r0/download/matrix.org/ayPrzDADSXoESjhCljuSgHQJ/message.txt >
16:19:50 <smooge> #info https://fedoraproject.org/wiki/Infrastructure/Oncall
16:19:50 <smooge> #info nirik is oncall for 2021-02-04 to 2021-02-11
16:19:50 <smooge> #info dtometzki is oncall for 2021-02-11 to 2021-02-18
16:19:50 <smooge> #info siddharthvipul is on call for 2021-02-18 to 2021-02-25
16:19:51 <smooge> #info ??? is on call for 2021-02-25 to 2021-03-04
16:20:20 <Zlopez[m]> Did I sent too much?
16:20:33 <smooge> yeah
16:20:50 <Zlopez[m]> Anyway we are looking for the volunteer for 2021-02-25 to 2021-03-04
16:20:55 <smooge> pasting more than 1 line at a time seems to cause problems
16:21:17 <smooge> i volunteer for tribute
16:21:35 <nirik> report from last week: pretty quiet. We had a few people look at oncall when I was asleep, but they never filed tickets, so no idea what the issue was.
16:21:36 <Zlopez[m]> It looks like the number of lines is 4, because there wasn't issue till now
16:21:51 <Zlopez[m]> smooge: You got it
16:22:03 <Zlopez[m]> #info smooge is on call for 2021-02-25 to 2021-03-04
16:22:18 <Zlopez[m]> #info Summary of last week: (from current oncall )
16:22:26 <nirik> sorry, I went out of order. ;)
16:22:33 <Zlopez[m]> As nirik said it was quiet
16:23:04 <Zlopez[m]> So let's continue
16:23:19 <Zlopez[m]> Look at what our scouts reported
16:23:24 <Zlopez[m]> #topic Monitoring discussion [nirik]
16:23:30 <Zlopez[m]> #info https://nagios.fedoraproject.org/nagios
16:23:30 <Zlopez[m]> #info Go over existing out items and fix
16:23:30 <nirik> so, lets see...
16:24:20 <nirik> There is a rabbitmq queue that is alerting, but not sure how to restart it's consumer:
16:24:31 <nirik> Check queue fmc_composer
16:24:31 <nirik> 
16:24:31 <nirik> This service has 1 comment associated with it	This service problem has been acknowledged	CRITICAL 	02-11-2021 16:14:07 	1d 0h 19m 33s 	3/3 	RABBITMQ_QUEUE CRITICAL - messages CRITICAL (128265), messages_ready OK (128265) messages_unacknowledged OK (0) consumers OK (0)
16:24:46 <nirik> perhaps mboddu can restart it or tell me where it runs? ;)
16:25:24 <nirik> Also, this consumer is alerting, and I am not sure why. I restarted it:
16:25:27 <nirik> Check queue bodhi_koji_sync_listener
16:25:27 <nirik> 
16:25:27 <nirik> This service has 1 comment associated with it	This service problem has been acknowledged
16:25:27 <nirik> WARNING 	02-11-2021 16:24:11 	1d 0h 20m 42s 	3/3 	RABBITMQ_QUEUE WARNING - messages WARNING (85), messages_ready OK (85) messages_unacknowledged OK (0) consumers OK (0)
16:25:34 <mboddu> nirik: Its part of the odcs deployment, but we can clean up the queue
16:25:53 <mboddu> I need to work with jkaluza to move it under bodhi testing
16:25:54 <nirik> mboddu: I think it just needs restarting, but I am not sure what or where. I tried restarting httpd on odcs...
16:26:12 <mboddu> nirik: I can take a look
16:26:22 <nirik> all the rest of the alerts are ones we have talked about in the past...
16:26:27 <mboddu> Its running on the releng odcs backend
16:26:29 <nirik> so, I think we can move along
16:27:02 <Zlopez[m]> Ok, let's look at the knowledge we can share
16:27:10 <Zlopez[m]> #topic Learning topic
16:27:22 <Zlopez[m]> We don't have anything prepared for this meeting
16:27:47 <Zlopez[m]> There is one topic adventurers wanted to hear about: New AAA system
16:28:01 <nirik> yeah, that would be super!
16:28:10 <Zlopez[m]> Do we have anyone competent, who could talk about it?
16:28:54 <smooge> I can say 'not me'
16:29:16 <Zlopez[m]> smooge: This makes as two
16:29:49 <Zlopez[m]> And anything else, we can share with the rest of our expedition?
16:30:11 <nirik> we could ask the aaa team to provide someone sometime. ;)
16:30:27 <Zlopez[m]> That would be great
16:32:02 <Zlopez[m]> We should also add this to our Tech talks
16:32:30 <Zlopez[m]> If there is nothing else, let's go to the adventure
16:32:30 <nirik> yeah.
16:32:34 <Zlopez[m]> #topic Open Floor
16:33:07 <Zlopez[m]> Brave adventurers, this here is the open floor and bellow it a pit of lava
16:33:38 <Zlopez[m]> We usually try to go around it, but it is boring
16:33:54 <Zlopez[m]> So today let's swim through it
16:33:58 * ComputerKid dives in
16:34:12 <ComputerKid> ow, it's a little warm
16:34:13 <Zlopez[m]> I see we have first volunteer
16:35:06 <Zlopez[m]> Oh no, here swims the evil bug!
16:35:13 <Zlopez[m]> What we will do with it?
16:35:30 <copperi> Zap
16:35:34 <nirik> hit bug with sword
16:35:51 <nirik> or better: magic missile!
16:36:39 <Zlopez[m]> The bug is still going forward, it's a big bug!
16:36:45 <Zlopez[m]> Help the  ComputerKid out of lava!
16:37:05 <ComputerKid> help!
16:37:07 <ComputerKid> arghhhhh
16:37:45 * ComputerKid files an issue on the Fedora bug tracker for the big bug
16:38:50 <Zlopez[m]> Sorry, the evil bug thrown me out of the battle
16:39:06 <Zlopez[m]> I lost connection for a few minutes
16:39:16 * nirik grabs a can of RIAD-6 and sprays the bug
16:39:49 <Zlopez[m]> The bug seems to lose his ground
16:40:14 <Zlopez[m]> It's confused by the strange smell
16:40:35 <Zlopez[m]> Quick adventurers, now we have a chance
16:40:37 * ComputerKid swims for his IRC life out of the Lava pool
16:41:18 <Zlopez[m]> ComputerKid is back with the rest of the group
16:41:29 <Zlopez[m]> Hooray!
16:41:47 <seddik> hi
16:41:54 <ComputerKid> Thank goodness
16:41:57 <Zlopez[m]> The confusion of the bug is wearing off
16:42:17 <Zlopez[m]> Does anybody has any trick in his sleave?
16:43:25 <Zlopez[m]> It looks like it will end up on me
16:44:18 * Zlopez[m] Takes a big keyboard and with war cry runs toward the big bug
16:44:53 * ComputerKid cheeres Zlopez[m] on
16:44:54 <Zlopez[m]> I could use a little help here
16:45:55 <Zlopez[m]> * The big bug endures bellow the hits he take from the keyboard *
16:46:10 <Zlopez[m]> * The keys are flying to all sides *
16:46:30 <Zlopez[m]> Take this!
16:46:53 * ComputerKid takes the largest screen he can find( a CRT ) and drop kickes it at the bug
16:47:11 <Zlopez[m]> Nicely done!
16:47:30 <Zlopez[m]> The bug is flying, he didn't expected a CRT bomb
16:47:36 <ComputerKid> It lands on the bugs head, dazing it, but also looking like a cyber punk hat
16:48:27 <Zlopez[m]> ComputerKid: Let him go, it got enough
16:48:38 <Zlopez[m]> Nice teamwork everyone
16:48:48 * ComputerKid shakes his fist at the bug
16:49:21 * austinpowered applauds the effort
16:49:24 <Zlopez[m]> Even the big bug could be defeated by a team
16:49:28 <ComputerKid> lol, that was odd, but fun
16:49:46 <austinpowered> Well done!
16:50:14 <Zlopez[m]> And now, when we defeated the big evil bug, I will return to my other duties
16:50:39 <Zlopez[m]> I'm glad you were accompanying me through this adventure, adventurers
16:51:06 <Zlopez[m]> See you next week on another Fedora infra adventure
16:51:11 <Zlopez[m]> #endmeeting