16:00:14 <eddiejennings> #startmeeting Infrastructure (2021-10-21) 16:00:14 <zodbot> Meeting started Thu Oct 21 16:00:14 2021 UTC. 16:00:14 <zodbot> This meeting is logged and archived in a public location. 16:00:14 <zodbot> The chair is eddiejennings. Information about MeetBot at https://fedoraproject.org/wiki/Zodbot#Meeting_Functions. 16:00:14 <zodbot> Useful Commands: #action #agreed #halp #info #idea #link #topic. 16:00:14 <zodbot> The meeting name has been set to 'infrastructure_(2021-10-21)' 16:00:16 <Leo[m]1234> what channel is this on irc? 16:00:25 <eddiejennings> fedora-meeting-3 16:00:42 <Leo[m]1234> thx 16:00:42 <eddiejennings> #meetingname infrastructure 16:00:42 <zodbot> The meeting name has been set to 'infrastructure' 16:00:51 <eddiejennings> #chair 16:00:52 <zodbot> Current chairs: eddiejennings 16:01:07 <eddiejennings> #info Agenda is at: https://board.net/p/fedora-infra 16:01:28 <eddiejennings> #info About our team: https://docs.fedoraproject.org/en-US/cpe/ 16:01:37 <eddiejennings> #topic greetings! 16:01:41 <eddiejennings> .hello 16:01:41 <zodbot> eddiejennings: (hello <an alias, 1 argument>) -- Alias for "hellomynameis $1". 16:01:48 <eddiejennings> .hi 16:01:48 <zodbot> eddiejennings: eddiejennings 'Eddie Jennings' <eddie@eddiejennings.net> 16:01:59 <leothecat> hey! :) 16:02:13 <leothecat> on irc now 16:02:23 <mkonecny> .hello zlopez 16:02:24 <zodbot> mkonecny: zlopez 'Michal Konecny' <michal.konecny@psmail.xyz> 16:02:26 <eddiejennings> Welcome all! 16:02:34 <petebuffon> .hello petebuffon 16:02:35 <rastlinux> hi 16:02:35 <zodbot> petebuffon: petebuffon 'Peter Buffon' <pabuffon@gmail.com> 16:02:37 <leothecat> this is my first weekly meeting ;) 16:02:37 <nirik> morning 16:02:39 <austinpowered> .hello austinpowered 16:02:40 <zodbot> austinpowered: austinpowered 'T.C. Williams' <fedoraproject@wootenwilliams.com> 16:02:42 <darknao> .hi 16:02:43 <zodbot> darknao: darknao 'Francois Andrieu' <darknao@drkn.ninja> 16:02:48 <pmoura> .hello phsmoura 16:02:50 <zodbot> pmoura: phsmoura 'Pedro Moura' <moura.pedro123@gmail.com> 16:03:05 <eddiejennings> #topic New folks introductions 16:03:18 <eddiejennings> #info This is a place where people who are interested in Fedora Infrastructure can introduce themselves 16:03:20 <eddiejennings> #info Getting Started Guide: https://fedoraproject.org/wiki/Infrastructure/GettingStarted 16:03:30 <eddiejennings> Who all is new to Fedora-Infra? :D 16:03:32 <leothecat> hey :) 16:03:37 <leothecat> me :D 16:03:41 <eddiejennings> Tell us a little about yourself. 16:04:04 <lenkaseg> .hello lenkaseg 16:04:05 <zodbot> lenkaseg: lenkaseg 'Lenka Segura' <lenka@sepu.cz> 16:04:18 <leothecat> i've been using linux for a while, and have been using fedora too. 16:04:24 <leothecat> i know python and like it a lot. 16:04:29 <leothecat> happt to be here ;) 16:04:50 <eddiejennings> Welcome to the project! :D 16:04:55 <leothecat> thanks 16:04:56 <lenkaseg> Welcome leothecat 16:05:04 <petebuffon> welcome :) 16:05:07 <mkonecny> leothecat: Thanks for the issue and welcome 16:05:17 <nirik> welcome leothecat 16:05:24 <eddiejennings> Anyone else here who's new or is at their first meeting? 16:05:24 <leothecat> :) thx 16:05:29 <austinpowered> welcome leothecat 16:06:02 <leothecat> i'm still looking around :D so much infrastructure 16:06:31 <eddiejennings> Looks like leothecat is our only new person this week. 16:06:31 <pmoura> welcome leothecat 16:06:38 <eddiejennings> Moving along. 16:06:46 <eddiejennings> #topic Next Chair 16:07:05 <eddiejennings> #info magic eight ball says: 16:07:07 <eddiejennings> #info chair 2021-10-21 - eddiejennings 16:07:09 <eddiejennings> #info chair 2021-10-28 - petebuffon 16:07:11 <eddiejennings> ##info chair 2021-11-04 - ??? 16:07:17 <eddiejennings> Volunteer for November 4th? 16:07:24 <leothecat> :o 16:07:59 <lenkaseg> I could! 16:08:10 <eddiejennings> Sold! 16:08:12 <leothecat> i would but this is my first week so i'll wait ;) 16:08:28 <eddiejennings> #info chair 2021-11-04 - lenkaseg 16:08:42 <eddiejennings> Yeah, get you feet wet first. There's plenty of time to chair :D 16:08:43 <lenkaseg> I'll try from hexchat, not to be 10 mind delayed ;) 16:09:07 <eddiejennings> Anyone for Nov. 11th? 16:09:26 <eddiejennings> I think we try to stay 2 - 3 weeks ahead, so if no one now, that's not a problem. 16:10:45 <eddiejennings> Hearning none, we move along. 16:10:56 <eddiejennings> #topic announcements and information 16:11:18 <eddiejennings> #info CPE Infra&Releng EU-hours team has a Monday through Thursday 30 minute meeting going through tickets at 1030 Europe/paris in #centos-meeting 16:11:20 <eddiejennings> #info CPE Infra&Releng NA-hours team has a Monday through Thursday 30 minute meeting going through tickets at 1800 UTC in #fedora-meeting-3 16:11:32 <leothecat> cool 16:11:38 <eddiejennings> #info If your team wants support from the Fedora Program Management Team, file an isssue: https://pagure.io/fedora-pgm/pgm_team/issues?template=support_request 16:11:52 <eddiejennings> #info Fedora 35 Beta was released on 2021-09-28 16:11:54 <eddiejennings> #info Fedora 35 Final freeze is in effect 16:12:22 <eddiejennings> Any other announcements / trivia / information that needs to be posted? 16:12:41 <nirik> #info f35 go/no-go meeting right after this one at 17UTC today 16:13:01 <leothecat> nice 16:13:04 <nirik> #info tomorrow is a Red Hat recharge day, many RH folks will not be around 16:14:01 <eddiejennings> Both are noted. go/no-go meeting available for public observation? 16:14:23 <nirik> yep. anyone welcome to attend and chime in. 16:14:30 <eddiejennings> #fedora-meeting-3 I assume? 16:15:18 <nirik> I think it's in #fedora-meeting 16:15:21 * nirik looks 16:15:35 <nirik> yeah. 16:15:49 <eddiejennings> noted. Any other announcements? 16:17:07 <eddiejennings> Hearning none, merrily we roll along 16:17:15 <eddiejennings> #topic Oncall 16:17:38 <eddiejennings> #info https://fedoraproject.org/wiki/Infrastructure/Oncall 16:17:40 <eddiejennings> #info https://docs.fedoraproject.org/en-US/cpe/day_to_day_fedora/ 16:17:42 <eddiejennings> #info eddiejennings on call from 2021-10-14 to 2021-10-21 16:17:44 <eddiejennings> #info nirik on call from 2021-10-21 to 2021-10-28 16:17:46 <eddiejennings> ## .oncalltakeeu .oncalltakeus 16:17:54 <nirik> .oncalltakeus 16:17:54 <zodbot> nirik: Kneel before zod! 16:17:58 <eddiejennings> Volunteers for 2021-10-28 to 11-4 16:18:18 <eddiejennings> So my shift ends at the meeting rather than on Friday? 16:19:04 <eddiejennings> I suppose so. <-- ought to read the agenda carefully :P 16:19:19 <nirik> yeah, usually we switch at meeting unless there's a reason not to 16:19:35 <eddiejennings> We will need someone for 10/28 - 11/4 16:20:06 <eddiejennings> as well as 11/4 - 11/11 16:20:17 <leothecat> probably not me ;) 16:20:23 <darknao> i can take next week 16:20:27 <nirik> well, I would, but... I'm already doing it this week. ;) 16:20:44 <eddiejennings> Sold! 10/18 - 11/4 to darknao 16:20:56 <leothecat> what does on call do specifically? 16:21:01 <leothecat> just wondering 16:21:21 <eddiejennings> https://fedoraproject.org/wiki/Infrastructure/Oncall 16:21:27 <leothecat> thx 16:21:44 <eddiejennings> From what I've understood, you monitor this and #fedora-noc for problems. And respond to people that use .oncall 16:22:01 <eddiejennings> If you can fix the thing, great, else, have them create an issue ticket. 16:22:12 <leothecat> cool. 16:22:30 <eddiejennings> Idea = central point for pings, rather than all of infra being pinged for everything 16:22:37 <leothecat> makes sense 16:22:54 <eddiejennings> I'll take 11/4 - 11/11 16:24:02 <eddiejennings> #info darknao on call from 2021-10-28 to 2021-11-04 16:24:04 <eddiejennings> #info eddiejennings on call from 2021-11-04 to 2021-11-11 16:24:20 <eddiejennings> #info Summary of last week: (from current oncall) 16:24:25 <eddiejennings> Last week was pretty quiet. 16:24:42 <leothecat> yep 16:24:51 <eddiejennings> There was an issue with I think apps.fedoraproject.org delivering 503 errors, but it seems to be intermittent. 16:25:08 <leothecat> i filed a ticket 16:25:10 <eddiejennings> I think someone, maybe leothecat, the was going to make an official ticket about it, so it's on our radar 16:25:16 <leothecat> that part of the site is being replaced anyway 16:25:18 <eddiejennings> Excellent. Thank you! 16:26:04 <eddiejennings> And now, the floor is Nirik's for . . . 16:26:06 <eddiejennings> #topic Monitoring discussion [nirik] 16:26:19 <eddiejennings> #info https://nagios.fedoraproject.org/nagios 16:26:21 <eddiejennings> #info Go over existing out items and fix 16:26:24 <nirik> not much change since last week I don't think, lets see... 16:26:59 <nirik> we have 3 down arm builders... but turns out someone is onsite this week, so I asked them to power cycle them. Hopefully they will get time to do so. 16:27:44 <nirik> there's some rabbitmq queues that are growing. I will ask ci folks to look into those... 16:28:47 <leothecat> onsite :o 16:29:16 <eddiejennings> Thanks nirik! Any other items? 16:29:23 <nirik> I think thats about it, the rest is small stuff thats been there for a while. 16:29:27 <nirik> move on.. ;) 16:30:12 <eddiejennings> Since we had a learning topic last week, this week we'll discuss our ticket backlog. 16:30:27 <nirik> fun fun. 16:30:32 <eddiejennings> Before we do, there are two business items that need to be addressed. 16:30:54 <leothecat> buisness? 16:30:55 <eddiejennings> First, is the next learning topic. 16:31:26 <eddiejennings> Last one I have on the agenda was from last week 10/14. Does anyone have a topic that interests them or wants to present on 10/28? 16:31:56 <leothecat> the aws thing interests me 16:32:00 * nirik is happy to talk on things, but what topics interest folks? 16:32:52 <nirik> I could do a short aws intro thing... or we could sign mobrien up for it. ;) 16:33:28 <leothecat> btw the list got a reply on the aws thing 16:33:30 <leothecat> aws intro? 16:33:56 <eddiejennings> One I think would be worthwhile would be more of a discussion than learning topic: "Welcome new apprentice to Fedora Infrastructure. There's nothing in easyfix. So here's a path to follow to start contributing." 16:34:08 <nirik> yeah, as a learning topic, explain how we use aws and how it's integrated currently and such 16:34:22 <eddiejennings> +1 to aws intro 16:34:35 <nirik> eddiejennings: yeah, it's a tough one, but I'm always happy to discuss and come up with better ways . 16:34:48 <pmoura> +1 to aws intro 16:34:50 <leothecat> yeah aws intro would be nice 16:35:06 <eddiejennings> Now that I'm not 100% green anymore (maybe just 99% green), I can contribute some ideas :D 16:35:31 <leothecat> btw David Duncan replied to the aws list 16:35:41 <eddiejennings> nirik would you want to do the AWS Intro or are you going to strongarm mobrien to do it? ;) 16:35:46 <leothecat> nice 16:36:02 <nirik> eddiejennings: put me down and I can ask him if he would rather do it... and we can adjust it. 16:36:10 * nirik hasn't read email yet today, been in meetings. 16:36:53 <eddiejennings> #info 2021-10-28 - Introduction to AWS and Fedora Infrastructure [nirik] 16:36:56 <eddiejennings> for learning topics 16:37:16 <eddiejennings> Ok, now on to the fun stuff 16:37:25 <eddiejennings> #topic Fedora Infra backlog refinement 16:37:27 <eddiejennings> #info Refine oldest tickets on https://pagure.io/fedora-infrastructure/issues 16:37:48 <eddiejennings> First up (sorted by last modified -- oldest first) 16:37:52 <eddiejennings> .ticket 8291 16:37:53 <zodbot> eddiejennings: Issue #8291: Fedora messaging - Translation platform topics review - fedora-infrastructure - Pagure.io - https://pagure.io/fedora-infrastructure/issue/8291 16:38:21 <nirik> well, we already talked about this one... :) 16:38:25 <eddiejennings> I'm pretty sure almost all of these really old ones have some kind of blocker 16:38:33 <eddiejennings> Yep. 16:38:35 <eddiejennings> Moving along. 16:38:38 <nirik> we need a better way to know where we are in the backlog discussion 16:38:49 <nirik> mkonecny: did you have a list? 16:39:17 <mkonecny> nirik: No, but we should at least ping the reporter to ask if this is still relevant 16:39:48 <eddiejennings> Agreed. Original ticket wasw opened 2 years ago 16:39:55 <nirik> ok, well, on this one the reporter was waiting for us to implement acls on messages, which is waiting on us upgrading ansible,... 16:39:56 <leothecat> jeez that's 2y old 16:40:22 <nirik> sure, we can ask if it's still wanted... 16:40:48 <nirik> sometimes tickets are not easy to do and have a pile of blockers... 16:40:48 <leothecat> when are we upgrading ansible and whats blocking it? 16:40:52 <mkonecny> It's possible that this is not relevant anymore 16:41:18 <eddiejennings> Noted, and on these tickets. If there's something that you're involved in (such as that one ticket about the cron job for me), try to give it a comment every once in a while. 16:41:25 <mkonecny> leothecat: https://pagure.io/fedora-infrastructure/issue/10287 16:41:33 <nirik> we are upgrading ansible probibly in the next few months, and blocking it is determining how we want to handle collections and testing all our playbooks for compatibility. 16:41:40 <leothecat> ah k 16:41:50 * nirik can ask on the ticket. 16:41:58 <eddiejennings> Ready for the next? 16:42:01 <leothecat> we would need to upgrade for aws integration as well :P 16:42:03 <leothecat> iirc 16:42:11 <mkonecny> nirik: So we can at least add the current state to ticket, so it's updated 16:42:31 <eddiejennings> .ticket 9681 16:42:33 <zodbot> eddiejennings: Issue #9681: Install Openshift on AWS for Fedora CI - fedora-infrastructure - Pagure.io - https://pagure.io/fedora-infrastructure/issue/9681 16:43:04 <leothecat> still blocked by the account changes by davdunc looks like? 16:43:34 <nirik> this was blocked on that, but turns out he can't make those changes, so now we are asking openshift team if they can suggest any workaround. 16:43:49 <leothecat> ah k 16:43:58 <davdunc> leothecat: we are looking at workarounds -- like nirik beat me to punch. :D 16:44:09 <leothecat> cool 16:44:16 <leothecat> so we're waiting on that 16:44:27 <eddiejennings> Next ticket 16:44:31 * nirik updates the ticket 16:44:35 <eddiejennings> .ticket 5478 16:44:36 <zodbot> eddiejennings: Issue #5478: Establishing a new FAS group for Python-SIG - fedora-infrastructure - Pagure.io - https://pagure.io/fedora-infrastructure/issue/5478 16:44:46 <eddiejennings> The blocker here is the updating of the Mailmain appplication. 16:44:52 * nirik nods. ;( 16:45:01 <eddiejennings> I doubt anyone has had any time to look at that. 16:45:08 <leothecat> oh that python-sig group thing 16:45:49 <nirik> well, there's another ticket for it, but it's... hard to package. 16:46:01 <eddiejennings> This is the aformentioned ticket 16:46:06 <eddiejennings> .ticket 8455 16:46:08 <zodbot> eddiejennings: Issue #8455: Move mailman to newer release of Fedora or CentOS - fedora-infrastructure - Pagure.io - https://pagure.io/fedora-infrastructure/issue/8455 16:46:10 <nirik> yep 16:46:21 <leothecat> doesn't seem super easy :P 16:46:49 <eddiejennings> Moving along to next in the backlog 16:46:54 <eddiejennings> .ticket 9882 16:46:55 <zodbot> eddiejennings: Issue #9882: [Pagure] [database] Change group name/ID from "WebDev SIG" to "Websites & Apps" - fedora-infrastructure - Pagure.io - https://pagure.io/fedora-infrastructure/issue/9882 16:47:19 * rastlinux stepping away. work calls 16:47:30 <nirik> so, this has to be done in the db... pingou sent me info on how to do it... but I haven't tried. 16:47:50 <leothecat> so in progress 16:47:52 <nirik> but there's some confusion there, because we cant just rename it because they went and made the new name too 16:49:04 <nirik> I can talk with ryan about it and come up with a plan. 16:49:10 <eddiejennings> Sounds good 16:49:12 <leothecat> cool 16:49:17 <eddiejennings> Next ticket in the backlog 16:49:29 <eddiejennings> .ticket 9543 16:49:30 <zodbot> eddiejennings: Issue #9543: Please Koschei auto-track all my and @python-sig packages - fedora-infrastructure - Pagure.io - https://pagure.io/fedora-infrastructure/issue/9543 16:50:35 <nirik> lets ask if it's done? I am not sure what state it's actually in 16:50:39 <leothecat> not sure what the status is on that one 16:50:40 <leothecat> yeh 16:51:04 <eddiejennings> I'll add a comment to the ticket asking 16:51:10 <nirik> I just did. ;) 16:51:34 <eddiejennings> See? I just mention something and it happens! Unlimited Power! XD 16:51:49 <eddiejennings> last backlog before we go to open-discussion 16:52:02 <eddiejennings> .ticket 9692 16:52:04 <zodbot> eddiejennings: Issue #9692: STG: Move bvmhosts to new server - fedora-infrastructure - Pagure.io - https://pagure.io/fedora-infrastructure/issue/9692 16:52:40 <nirik> I think mobrien was going to work on this, but it fell off his radar? might ping him on it. 16:53:09 <mkonecny> nirik: Yeah, it's hard to keep track of everything 16:53:13 <eddiejennings> Noted. 16:53:28 <eddiejennings> Thus endeth the backlog. 16:53:35 <eddiejennings> #topic Open Floor 16:53:48 <nirik> very. ;( might be worth coming up with some kind of process to help... like check XYZ, then ABC, then pr's, then apps, or something 16:54:07 <eddiejennings> Open floor is for anything not covered that ought to be of interest. 16:54:37 <leothecat> uhh 16:54:47 <eddiejennings> I saw earlier either in #fedora-admin or mentioned in the daily standup something about trying to consolidate our docs / SOPs into one place. 16:54:58 <leothecat> yep 16:55:01 <eddiejennings> Am I mistaken or is that a thing that's being planned? 16:55:03 <nirik> yep. there's a ticket for that(tm) 16:55:21 <mkonecny> nirik: This is a good idea 16:55:39 <mkonecny> Maybe worth sharing with whole Infra & Releng team 16:55:44 <eddiejennings> If there is a ticket, I'll be happy to add myself to the contributors for it. I'm trying to push for the same kind of thing where I work now. 16:55:54 <eddiejennings> I'm a walking GitLab advertisement at work :P 16:56:03 <leothecat> haha 16:56:42 <nirik> .ticket 9892 16:56:43 <zodbot> nirik: Issue #9892: Centralise and update Fedora infra and releng SOPs - fedora-infrastructure - Pagure.io - https://pagure.io/fedora-infrastructure/issue/9892 16:56:52 <leothecat> other than the aws thing not much to discuss from me ;) 16:56:58 <nirik> so, we already have done some of this, we moved infra-docs to docs.fp.o... 16:57:27 <nirik> but docs really need working on. ;) 16:57:36 <nirik> https://docs.fedoraproject.org/en-US/infra/ 16:57:50 <leothecat> yep 16:57:57 <leothecat> the old docs are really outdated 16:58:04 <mkonecny> And we still need to redirect people to the new docs 16:58:11 <nirik> yep. 16:58:13 <mkonecny> And add RelEng SOP 16:58:22 <eddiejennings> I imagine the general preference is having a wiki-like page, rather than the docs being markdown documents within a Pagure (or other) repo? 16:58:32 <nirik> we may want to schedule a working session to gather and work on it 16:58:37 <nirik> that would let us discuss things that come up 16:58:58 <nirik> eddiejennings: we were using the wiki, for some, but we are moving away from that to a git repo of docs. 16:59:20 <nirik> wiki / infra-docs / releng docs -> docs.fedoraproject.org via git 16:59:35 <eddiejennings> Using a git repo is my preference. Seems like it's easier to edit and control 17:00:07 <nirik> it's easier to do changes over the entire collection at once... and easier to review changes 17:00:28 <nirik> wiki -> where information kills itself 17:00:34 <eddiejennings> I'll take a look at that ticket and make some comments on it. I agree a planning meeting / work session would be the next step 17:00:58 <eddiejennings> And on that note, we're right at an hour. 17:01:24 <nirik> thanks for running things eddiejennings! 17:01:29 <eddiejennings> Thus endeth the Fedora Infrastructure meeting. Feel free to keep the discussion going in #fedora-admin for all things Fedora-Infra! 17:01:40 <eddiejennings> #endmeeting