16:00:08 #startmeeting Infrastructure (2021-03-04) 16:00:08 Meeting started Thu Mar 4 16:00:08 2021 UTC. 16:00:08 This meeting is logged and archived in a public location. 16:00:08 The chair is siddharthvipul. Information about MeetBot at http://wiki.debian.org/MeetBot. 16:00:08 Useful Commands: #action #agreed #halp #info #idea #link #topic. 16:00:08 The meeting name has been set to 'infrastructure_(2021-03-04)' 16:00:08 #meetingname infrastructure 16:00:08 The meeting name has been set to 'infrastructure' 16:00:09 #chair nirik pingou smooge cverna mizdebsk mkonecny abompard siddharthvipul mobrien 16:00:09 Current chairs: abompard cverna mizdebsk mkonecny mobrien nirik pingou siddharthvipul smooge 16:00:09 #info Agenda is at: https://board.net/p/fedora-infra 16:00:09 #info About our team: https://docs.fedoraproject.org/en-US/cpe/ 16:00:09 #topic aloha 16:00:28 morning 16:00:33 .hello2 16:00:34 austinpowered: austinpowered 'T.C. Williams' 16:00:36 .hi 16:00:37 mobrien: mobrien 'Mark O'Brien' 16:00:40 morning together 16:00:40 Good morning :) 16:00:48 .hello siddharthvipul1 16:00:49 siddharthvipul: siddharthvipul1 'Vipul Siddharth' 16:00:53 Hello 16:00:56 .hello t0xic0der 16:00:57 t0xic0der[m]: t0xic0der 'Akashdeep Dhar' 16:00:58 hello 16:01:08 How is everyone today? 16:01:19 Great! 😃 16:01:24 fine thanks and you ? 16:01:47 oh tomorrow is Friday, I am happy :D 16:01:54 XD 16:02:07 All good here 16:02:14 we will wait for a minute for more folks to join 16:02:58 hello 16:03:04 smooge, heyy, welcome :D 16:03:10 hello 16:03:10 #topic New folks introductions 16:03:11 #info This is a place where people who are interested in Fedora Infrastructure can introduce themselves 16:03:11 #info Getting Started Guide: https://fedoraproject.org/wiki/Infrastructure/GettingStarted 16:03:17 do we have anyone new here today? :) 16:03:28 I see all familiar names so far though :) 16:03:54 .hello zlopez 16:03:54 Zlopez[m]: zlopez 'Michal Konečný' 16:03:55 someone was asking about being an apprentice in a different channel recently 16:04:00 .hello computerkid 16:04:01 Little late today 16:04:01 ComputerKid: computerkid 'Grayson Penland' 16:04:01 .hello humaton 16:04:03 jednorozec: humaton 'Tomáš Hrčka' 16:04:08 if you are new here, don't hesitate to introduce yourself. I will wait for a minute before moving to next topic :) 16:04:13 oh hey hey, look so many people :D 16:04:20 welcome jednorozec ComputerKid and Zlopez[m] \o 16:04:23 but i am not sure 16:04:25 o/ 16:04:38 smooge, not sure about? if you are new or not? 16:04:40 haha 16:04:42 ô/ 16:05:15 good one 16:05:26 .. ponders 16:05:30 I've never seen smooge before, he must not hang around IRC much ;P 16:05:33 smooge, oooh, now I read it XD 16:05:41 it was hidden in between .hellooosss 16:05:52 smooge, there was also a ticket I remember 16:06:08 if anyone wants to be an apprentice, this would be a good place to ask :) 16:06:32 it gives you read access to a lot of servers (if you want to explore how services/infra is setup in fedora project) 16:06:43 me 16:06:47 ComputerKid, yeah, smooge is young and awesome 16:06:51 Could you please elaborate on why we would want to become one? :-) 16:06:54 me too 16:07:03 nb has been trying to get me to help out in Fedora badges infra, but IDK if there's a specific title for that 16:07:12 t0xic0der[m], as I said, if you want to see how things are setup and learn :) 16:07:29 ComputerKid, sysadmin-badges (I think you are already in there) 16:07:41 Yes, I'm in that 16:07:42 siddharthvipul: Sounds awesome. Now, how do we become one? 16:07:46 nirik or smooge can add you to fedora-apprentice iirc 16:07:53 thing is I've working with FOSS for over 15 years, I make a living out of it so It's about time I give something back 16:08:11 bodanel, never too late <3 16:08:36 now I also I some knowlegde which will be useful 16:08:46 I will move to next topic in a minute. nirik and smooge, what process would you recommend people to request to be in -apprentice group? 16:08:50 nirik: smooge Please add me to the channel too 16:08:57 nirik, which channel? 16:09:00 oop 16:09:03 I meant t0xic0der[m] ^ 16:09:03 and a better strt to help peoples here with problems 16:09:07 tell us your fas account name and we can add you, it's that simple. 16:09:13 bodanel 16:09:19 The one for apprentice? (I guess) 16:09:27 dtometzki 16:09:35 t0xic0der 16:09:42 \o/ 16:09:59 siddharthvipul, I think it's fi-apprentice 16:10:05 nirik, so 3 ( bodanel, t0xic0der and dtometzki ) 16:10:07 nils, it is :) 16:10:09 today is christmas no 16:10:19 also, heyyy nils :D 16:10:20 :-) 16:10:32 dtometzki++ t0xic0der[m]++ bodanel++ 16:10:35 let's move ahead 16:10:36 siddharthvipul, I'm laaate :) 16:10:41 XD 16:10:50 nils, oh, just glad to see you :D 16:11:04 * pingou also laaate, sorry :( 16:11:06 glad to see you too 16:11:12 added 16:11:20 pingou, I know you were in meeting, so again, happy to see you :D 16:11:21 nirik many thanks 16:11:26 welcome nils and pingou 16:11:34 nirik++ for adding folks in the group 16:11:37 nirik: Thanks for the prompt addition! :-) 16:11:41 will take a bit to sync out, but do ask questions in #fedora-admin... and welcome. 16:11:56 #topic Next chair 16:11:57 #info magic eight ball says: 16:11:57 #info chair 2021-03-04 - siddharthvipul 16:11:57 #info chair 2021-03-11 - mobrien 16:12:20 mobrien will be chairing the next meeting. Do we have a volunteer for the week after it? 16:12:21 2021-03-18 16:12:22 for the 18th it supposed to be me 16:12:37 bodanel, oh, It's not in the board, let me add you there 16:12:40 yes put me in 16:12:51 dtometzki, for the week after it will work? 16:12:55 I put bodanel for 18th 16:13:05 yes 16:13:19 dtometzki++ for the awesome enthusiasm 16:13:22 #info chair 2021-03-18 - bodanel 16:13:22 #info chair 2021-03-25 - dtometzki 16:13:28 thank you all 16:13:33 now, next topic :) 16:13:41 #topic announcements and information 16:13:41 #info CPE Infra&Releng EU-hours team has a Monday through Friday 30 minute meeting going through tickets at 1030 Europe/paris in #centos-meeting 16:13:41 #info CPE Infra&Releng NA-hours team has a Monday through Friday 30 minute meeting going through tickets at 1800 UTC in #fedora-admin 16:13:41 #info work is being done on getting COPR proper powerPC systems 16:13:42 #info Fedora 33 beta freeze started on 2021-02-23 16:14:04 let me think if we are missing something. If you have an announcement, do share 16:14:12 I will wait for a minute or 2 :) 16:14:37 Fedora 33 freaze beta ? 16:14:43 you mean 34 16:14:48 oh yess 16:14:50 #undo 16:14:50 Removing item from minutes: INFO by siddharthvipul at 16:13:42 : Fedora 33 beta freeze started on 2021-02-23 16:15:06 #info Fedora 34 beta freeze started on 2021-02-23 16:15:10 dtometzki, good catch 16:16:21 next topic 16:16:25 #topic Oncall 16:16:25 #info https://fedoraproject.org/wiki/Infrastructure/Oncall 16:16:25 #info siddharthvipul is on call for 2021-02-25 to 2021-03-04 16:16:25 #info zlopez is on call for 2021-03-04 to 2021-03-11 16:16:25 #info dtometzki is on call for 2021-03-11 to 2021-03-18 16:16:53 we have next 2 weeks covered 16:17:01 looking volunteers for 2021-03-18 to 2021-03-25 :) 16:17:05 do we have anyone? 16:17:14 * nirik can do it if no one else. 16:17:29 * ComputerKid would be happy to 16:17:49 nirik, want me to give it to ComputerKid? 16:17:53 I might need to do one time with some help though 16:17:55 :) 16:18:34 ComputerKid, do go through the wiki link given ^ and feel free to reach out to me if you want to understand what you will be responsible for in that week 16:18:36 sure... happy to have you do it and help out 16:18:49 yup, that sound good 16:18:57 and ComputerKid, in case you think you can't, don't worry. we will be there to help :) 16:19:04 #info ComputerKid is on call for 2021-03-18 to 2021-03-25 16:19:11 mostly it's just being around and answering people's initial queries... then telling them to file a ticket. ;) 16:19:44 pretty much :D 16:19:55 hehe 16:19:57 I can do that 16:20:05 Zlopez[m], you are on call for this week, do you want to take over? 16:20:47 okay, Zlopez[m] seems to be away, we will get to it in openfloor 16:20:53 #info Summary of last week: (from current oncall ) 16:21:01 #info quiet and peaceful week. 16:21:07 Koji acted weird for a while but I wasn't pinged for that (a ticket opened directly instead, which is good) 16:21:20 I don't have any memory of any `.oncall` command used :) 16:21:36 none that I remember either 16:21:44 .hello linuxmodder 16:21:45 linuxmodder: linuxmodder 'Corey W Sheldon' 16:21:54 linuxmodder, \o welcome :D 16:22:01 been lurkign totally forgot to id 16:22:12 :) 16:22:21 awesome 16:22:26 let's move ahead then :D 16:22:36 #topic Monitoring discussion [nirik] 16:22:37 #info https://nagios.fedoraproject.or/g/nagios 16:22:43 nirik, your area :) 16:22:56 lets see 16:23:25 this link work only internal ? 16:23:32 the only one newish to call out is that both our registry boxes are showing low on disk space... 16:23:34 nagios... 16:23:55 dtometzki, wrong link I see 16:24:00 dtometzki: nope, but... you need to have a kerberos ticket... ie, 'kinit YOURNAME@FEDORAPROJECT.ORG' 16:24:03 I will update the link in the end 16:24:11 ah and there's a / in the link there. 16:24:18 nirik, yeah, just noticed 16:24:21 .oncalltakeeu 16:24:22 Zlopez[m]: Kneel before zod! 16:24:24 nirik, please continue 16:24:30 s/or/g/org 16:24:32 i dont have one :-) 16:24:40 anyhow, we should look at our registry soon. not sure why disk is getting low. 16:24:40 there is an extra / in the link 16:24:45 corect link is https://nagios.fedoraproject.org/nagios/ 16:24:53 bodanel, already updated :) 16:25:15 nirik, hmm. do we prune older images from registry? 16:25:22 there's a systemd pagure alert... this is due to some new checks being added where the check script wasn't actually installed. ;) 16:25:42 siddharthvipul: yeah, I think we do... but I would have to look up details. 16:26:28 thats about it, we can move on. After beta is out we might make more effort to clean things up... 16:26:43 nirik, thanks again :) 16:27:00 okkayy, for next topic we have a new guest 16:27:03 nirik, slight tangent, would any references in #9695 have effect ont he registry space ? 16:27:17 .ticket 9695 16:27:18 nirik: Issue #9695: Ansible Cleanup: Move systems to linux-system-roles networking - fedora-infrastructure - Pagure.io - https://pagure.io/fedora-infrastructure/issue/9695 16:27:18 or are all those hosts already nuked just not playbook references 16:27:35 93 rather gettign numbers screwed up 16:27:36 no, shouldn't affect that I wouldn't think. 16:27:39 .ticket 9693 16:27:40 nirik: Issue #9693: Ansible Cleanup: Apprentice Friendly: Remove PHX2 from playbooks - fedora-infrastructure - Pagure.io - https://pagure.io/fedora-infrastructure/issue/9693 16:27:44 .ticket 9693 16:27:45 linuxmodder: Issue #9693: Ansible Cleanup: Apprentice Friendly: Remove PHX2 from playbooks - fedora-infrastructure - Pagure.io - https://pagure.io/fedora-infrastructure/issue/9693 16:27:45 ah right. 16:27:48 that one ^ 16:27:52 no, It shouldn't affect it. 16:28:26 linuxmodder, all clear to move ahead? 16:28:58 sure 16:29:02 #topic Learning topic discussion 16:29:11 #info Introduction to WebSockets - t0xic0der[m] on 2021-03-04 16:29:20 Thanks siddharthvipul 16:29:35 * nirik sits back to listen (ok, watch) 16:29:36 So we must have used applications that require bidirectional communications right? 16:29:52 Like chat applications, multiplayer games, hackmd.io etc 16:30:00 yep yep 16:30:09 So WebSockets is the underlying technology behind them 16:30:27 The communication is asynchronous, event-based and most most importantly, non-blocking 16:30:54 We can do exciting things with WebSockets 16:31:29 With bidirectional communication, we can easily (like really easily) make a multiplayer Tic TaC tOE 16:31:50 exciting 16:32:05 It takes care of all communication without having to worry about establishing a socket connection and maintaining it as it does long-poll 16:32:34 But as it is snappy, low size packets are recommended 16:32:50 Just imagine chat messages sent to and fro which are about 1GB big!!! XD 16:32:59 Makes no sense right? 16:33:03 what happens if it gets a big package ? 16:33:32 The server (if implemented intelligently) queues it for deferred transfer 16:33:53 Or if it is made by someone like me, I'll drop it rightaway 16:34:23 Undue stress on WS server cannot be afforded because they need to active most of the time for all pushes and pulls. 16:35:03 A classic consumer-producer example can be a good choice - except when they are eating small chunks and not taking down gulps (like streaming) 16:35:19 WebSockets can be used for streaming feeds too. 16:35:43 Open up a Pagure issue page and wait for someone else to comment on it 16:35:52 You'd be informed about it 16:35:54 How? 16:36:07 Using a websocket connection, that is :D 16:36:18 I was about to guess ;) 16:36:48 No continual polling. Messages are sent only when specific events happen. The here event was sending a comment. 16:36:53 siddharthvipul++ 16:37:01 Aight that's about it 16:37:09 :claps: :claps: 16:37:10 awesome 16:37:13 thank you t0xic0der[m] 16:37:16 do we have any questions? 16:37:18 I could go on forever about it cuz its so awesome! 16:37:23 cool. 16:37:29 thanks 16:37:40 Thanks everyone for hearing me out :D 16:37:46 does it matter how many clients are connected? or since it's only on events those are just idle? 16:38:14 Is Websockets how MQTT works? They sound similar in idea. 16:38:15 if clients are connected and idle, no resources are consumed 16:38:48 So nirik , they can stay connected like forever and resources would only be used when messages are sent across 16:39:02 nice 16:39:09 ComputerKid: BINGO! MQTT and WS are very similar in implementation 16:39:29 cool. 16:39:33 But I'd use MQTT for embedded apps while WS for multiplayer games XD 16:39:48 just FYI, two other things in our infra that use websockets: openshift uses them for oc rsh... and openqa uses them for live showing of screens of tests in progress. 16:40:17 nirik, TIL 16:40:20 awesome 16:40:21 MQTT and WS are different more than similar. MQTT is a queue 16:40:34 WS is just a socket that need to implement queue 16:40:38 Yes, WebSockets are also used in RTC. Screen sharing, video calls and audio calls are all facilitated by them. 16:41:04 jednorozec++ for the specific detail :-) 16:41:07 jednorozec, fair point 16:41:45 jednorozec++ 16:41:45 siddharthvipul: Karma for humaton changed to 7 (for the current release cycle): https://badges.fedoraproject.org/tags/cookie/any 16:41:47 WS with a queue could be an awesome idea for deferred pushes 16:41:59 * t0xic0der ponders 16:42:03 hmm 16:42:06 I am amazed how I have not given jednorozec a karma yet o.O 16:42:33 t0xic0der++ 16:42:33 ComputerKid: Karma for t0xic0der changed to 7 (for the current release cycle): https://badges.fedoraproject.org/tags/cookie/any 16:42:49 Thanks for the cookie, ComputerKid :P 16:43:07 Thanks for the learning segment :D 16:43:09 awesome, I will wait for a minute if we have any question 16:43:23 we can move to next topic :) which is deciding/discussing what we are learning next 16:44:21 it's a wonderfull world full of things to learn. ;) 16:44:37 #topic Ideas for upcoming learning topics 16:44:49 nirik, true :D if only we knew what we don't know haha 16:45:18 So many cool things can be created with the things we learn 16:46:02 do we have any suggestions, volunteers, asks? 16:46:21 anyone know cgroups ? 16:46:34 bodanel, I would be interested in knowing more of it :D 16:46:39 I don't and would love to know about it! bodanel 16:46:52 I would love to learn more about them. ;) 16:47:03 intresting 16:47:06 I can prepare something about that for the next week 16:47:09 seems we are getting to something *.* 16:47:18 bodanel, awesome! thank you :D 16:47:41 #info cgroups [bodanel] on 2021-03-11 16:47:54 there's a really great series of blog posts on cgroups.. 16:48:04 (which I have failed to have the time to read thru) 16:48:10 I will wait for a minute or 2 if anyone else has a thing they want to share :D 16:48:18 where ? 16:48:24 https://www.redhat.com/en/authors/marc-richter 16:48:24 nirik, would be nice to add as reference material for next call :D 16:48:29 8 parts there... 16:48:34 nice 16:48:41 "world domination with cgroups" :) 16:48:49 :) 16:48:55 I've read some of marc richter stuff, I like how he explains 16:49:03 world domination by restricting resource use kind of :P 16:49:07 yeah, he's pretty awesome. 16:49:11 <3 16:49:20 "Computers are hard" 16:49:31 okay, so we can move to the next dangerous topic 16:49:40 yeah, a good server has over 50 kg :) 16:49:42 if anyone is interested I can share things about opensource home automation / embeded SW/SW 16:49:54 HW/SW 16:50:01 jednorozec++ 16:50:01 bodanel: Karma for humaton changed to 8 (for the current release cycle): https://badges.fedoraproject.org/tags/cookie/any 16:50:02 jednorozec, oh I am! 16:50:03 jednorozec: +1 16:50:04 great ideea 16:50:18 jednorozec, would you be interested in doing it on 18th of this month? 16:50:21 I can add you on the list 16:50:26 siddharthvipul, sure 16:50:42 jednorozec: also consider doing a internal tech talk on it? ;) 16:51:12 jednorozec++ 16:51:22 nirik, if people are interested 16:51:26 I will love to do so 16:51:28 #info opensource home automation / embedded SW/HW [jednorozec] on 2021-03-18 16:51:30 cool 16:51:35 nirik, I was about to say that 16:51:41 jednorozec, I am sure people would love it 16:51:57 I'd be down to listen/watch a tech talk on them 16:51:58 would be even better if we do it after DST thing is sorted XD I can attend :P 16:52:44 okay, jednorozec let's discuss that (I would say just take the slot) 16:52:46 jednorozec: I sure am. ;) 16:52:50 moving ahead for last few minutes :) 16:53:07 #topic Open Floor 16:53:19 I have one thing here 16:53:22 .ticket 9222 16:53:23 jednorozec: Issue #9222: Grant root access on batcave - fedora-infrastructure - Pagure.io - https://pagure.io/fedora-infrastructure/issue/9222 16:53:30 I have one too 16:53:32 *puppy eyes* 16:53:57 I would say +1 to this (if it counts) usually sysadmin-mains process would be better as nirik proposes in ticket 16:54:01 if there is any process to get that access just point me to the process please 16:54:10 jednorozec: we can look into that. :) I don't want to unilatterally say yes or no... we need to discuss with existing people ;) 16:54:32 but I will do so and get back to you 16:54:37 thanks 16:54:42 nirik++ for so many things, I forgot 16:54:42 that is all I ask :) 16:54:51 t0xic0der[m], you had something 16:54:55 I have been writing this accessible container monitoring service for sometime now (siddharthvipul knows about it) that I'd love for you folks to take a look into. https://t0xic0der.medium.com/simply-accessible-container-performance-monitoring-with-supervisor-7fb47f925f3b 16:55:15 (Hope this does not go off-topic XD) 16:55:29 t0xic0der[m], it is but then it's open floor :) 16:55:48 * t0xic0der is both relieved and worried at the same time 16:56:01 did you add alerting or a database to it (I remember last we discussed you were in process) 16:56:13 cool. 16:56:30 Yes! I am in the process of adding it. Used another Redis container for it 16:56:42 t0xic0der[m], that looks interesting 16:57:00 Alerting is yet to be added though but gathering passive metrics is in progress right now. 16:57:15 Thanks nirik jednorozec :D 16:57:55 Please give it a try if you have a Docker installation lying around. 16:58:08 :) 16:58:20 alrighty, we are approaching the end, do we have anything else? 16:58:50 t0xic0der[m], I will. I have number of container running at home with no monitoring right now 16:59:26 .ticket 9559 16:59:28 siddharthvipul: Issue #9559: Fedora India mailing list issues/glitches - fedora-infrastructure - Pagure.io - https://pagure.io/fedora-infrastructure/issue/9559 16:59:32 I have one quick thing 16:59:35 jednorozec: Do give it a try. It might not be as superior as DockProm but it can be accesible! 16:59:36 nirik do we store logs of mailing list activity for more than a few months? (like around the last christmas)? 16:59:52 I have a question when we have a moment 17:00:02 siddharthvipul: well, of mails, but not admin stuff I dont think. 17:00:04 closing meeting now :) we are out of time 17:00:08 nirik, got it 17:00:11 thank you all 17:00:14 #endmeeting