15:01:00 #startmeeting Infrastructure (2019-07-25) 15:01:00 Meeting started Thu Jul 25 15:01:00 2019 UTC. 15:01:00 This meeting is logged and archived in a public location. 15:01:00 The chair is smooge. Information about MeetBot at http://wiki.debian.org/MeetBot. 15:01:00 Useful Commands: #action #agreed #halp #info #idea #link #topic. 15:01:00 The meeting name has been set to 'infrastructure_(2019-07-25)' 15:01:00 #meetingname infrastructure 15:01:00 The meeting name has been set to 'infrastructure' 15:01:00 #topic aloha 15:01:00 #chair nirik pingou puiterwijk relrod smooge tflink cverna mizdebsk mkonecny abompard bowlofeggs 15:01:00 Current chairs: abompard bowlofeggs cverna mizdebsk mkonecny nirik pingou puiterwijk relrod smooge tflink 15:01:12 ó/ 15:01:18 morning everyone. 15:01:36 #topic New folks introductions 15:01:36 #info This is a place where people who are interested in Fedora Infrastructure can introduce themselves 15:01:36 #info Getting Started Guide: https://fedoraproject.org/wiki/Infrastructure/GettingStarted 15:01:36 #knstn introduction 15:01:41 .hello zlopez 15:01:42 mkonecny: zlopez 'Michal Konečný' 15:01:53 .hello2 15:01:54 mizdebsk: mizdebsk 'Mikolaj Izdebski' 15:02:03 .hello2 15:02:04 tflink: tflink 'Tim Flink' 15:03:04 .hello2 15:03:05 abompard: abompard 'Aurelien Bompard' 15:03:52 morning 15:04:43 #topic announcements and information 15:04:43 #info bowlofeggs is on extended leave 15:04:43 #info cverna is on extended leave 15:04:43 #info Flock2Fedora 2019-08-08 -> 2019-08-11 15:04:43 #info Blog post on retiring apps https://communityblog.fedoraproject.org/application-service-categories-and-community-handoff/ 15:04:44 #info CPE/Infrastructure workshop at FLOCK (date to be announced) 15:04:57 #info Mass rebuild is ongoing 15:05:17 nirik, relrod any other items to add to the announcements? 15:05:27 .hello nphilipp 15:05:28 nils: nphilipp 'Nils Philippsen' 15:06:30 #info rawhide package gating Phase I was pushed to production earlier today 15:06:30 not sure off hand... 15:06:31 I can't think of anything offhand 15:08:24 #info No meeting on 2019-08-08 15:08:34 #topic Oncall 15:08:34 #info https://fedoraproject.org/wiki/Infrastructure/Oncall 15:08:34 #info relrod is on call from 2019-07-11 -> 2019-07-18 15:08:34 #info nirik is on call from 2019-07-18 -> 2019-07-25 15:08:34 #info relrod is on call from 2019-07-25 -> 2019-08-01 15:08:35 #info smooge is on call from 2019-08-01 -> 2019-08-13 #flock 15:08:37 #info ?????? is on call from 2019-08-13 -> 2019-08-15 15:08:39 #info Summary of last week: (from relrod ) 15:08:53 and I messed that section up 15:08:54 yeah, I slacked on my oncall a bit... thanks relrod and smooge for taking some of that. 15:09:43 nirik, I guess that was a joke, but I don't see it as a slack. You have 2+ high priority items which you need complete focus on 15:09:54 it's been a very irq week tho... 15:09:57 trying to add in IRQ friendly oncall fails 15:10:00 lots of pings. 15:10:37 yeah.. my mornings until you got in were pretty much pings from before I woke up til late 15:10:38 I wonder if we shouldn't start trying to more educate folks... a friendly page/thing about pinging 15:10:58 please come up with one.. mine was not friendly 15:11:09 heh. will put it on my list 15:11:16 I can try to write something up 15:11:31 basically like the no naked pings wiki page 15:11:36 yeah 15:11:49 but why updating a ticket (or making one) is better than pinging people. 15:11:59 we need to get the "how to work w/ cpe" page out there 15:12:04 so we can point people to it 15:12:07 thank you for pinging @$. Please be aware that all our operators are busy and unable to take requests. Please open a ticket. Further pings without ticket numbers will be downgraded appropriately 15:12:10 and why making a ticket or doing a list post or pr or whatever and then pinging is also bad 15:12:17 pingou: yeah. 15:12:28 but perhaps more specific to irc pings. 15:12:42 we can expand on it there 15:12:56 but I guess randy is right in the end... we just need to stop responding/answering/working on things because of them... and people will move to where the work gets done 15:13:19 there is surely truth in that 15:13:22 yeah, people tend to prefer that which gets done easiest/fastest 15:13:38 I still see a lot of the second case... 15:14:00 2 seconds later: ping. I filed this ticket, please work on it now. 15:14:07 Honestly I am of the "A ping without a ticket number to someone who is not oncall is considered dead" 15:14:41 I'll get behind this 15:14:42 To be clear, working with people on irc is great, but arrange for a time in ticket instead of IRQing them 15:14:43 nirik, in that case I respond with "Your ticket is being read and will be allocated resources 15:14:56 smooge: right, but even doing that made you stop doing where you were doing. 15:15:44 anyhow, we have had this converstaion before... and will again I'm sure. ;) 15:15:58 I am almost filled out my Ping Bingo Card 15:16:12 #topic Monitoring discussion 15:16:12 #info https://nagios.fedoraproject.org/nagios 15:16:12 #info Go over existing out items and fix 15:17:59 some of them are due to mass rebuild 15:18:03 so the items on this are pretty routine. THe ppc09 swap seems to be that the boxes may need 1 less builder 15:18:17 did the autocloud-backend box get a disk replacement? 15:18:17 Or more swap 15:18:36 smooge: well, not sure thats the case, it's more than all the builders are 100% pegged due to mass rebuild... 15:20:23 anyhow, the rest we know about... 15:20:37 who is our odcs contact(s)? 15:20:53 nirik, I don't know about either the disk (relrod?) or who an odcs contact is 15:20:56 lucas? 15:21:47 no idea. 15:21:48 autocloud-backend disk is still on my list. 15:22:04 but it would be good to get them moved to a nfs volume and off gluster and perms fixed up 15:22:49 * pingou asked him 15:23:03 cool. 15:23:10 #topic Tickets discussion 15:23:10 #info https://pagure.io/fedora-infrastructure/report/Meetings%20ticket 15:23:10 we don't need to wait. ;) 15:23:27 I guess that segues into this? 15:24:02 sure. 15:24:15 we don't have anything marked, but are there any tickets people want to discuss? 15:24:39 pingou: is https://pagure.io/fedora-infrastructure/issue/7983 done/ready to close? 15:25:34 I think they are looking for more 15:25:45 It's in my todo, I'll assign the ticket to myself 15:26:20 ok, thanks 15:27:05 pingou: another one you might be able to help with... 15:27:17 https://pagure.io/fedora-infrastructure/issue/7879 15:27:41 patrick was going to walk me through doing a release, but he's been super busy... I think you have done them before there? 15:27:42 ah yes 15:27:53 I've done them 15:27:53 and there's some upstream pr's that need review 15:28:14 I kinda had stopped in purpose to encourage people to move to fedora-messaging but I guess it's time to make a new one :) 15:28:26 that Pr got merged 15:28:41 there was a second one I think... 15:28:54 nirik: happy to walk you through the release process if you want to, otherwise I can just do it 15:29:14 either way. 15:29:57 if it won't take long, I'd love to hear how to do it so I can do it later 15:30:05 if it's anoying/complex, just do it. ;) 15:30:47 nirik, sorry had a door ping 15:31:05 I'll do it, document it while I do and next time we can do it together based on these notes 15:31:34 smooge: was it next to the most expensive machine in the hospital? 15:31:41 pingou: +1 15:31:59 * smooge needs to watch that skit again 15:32:22 it was more like the 3 repairman skit 15:33:31 #topic Open Floor 15:33:45 which is also a good "And now for something Different" 15:34:19 a man with a piano up his nose? 15:35:00 someone's been watching a lot of Monty Python lately :D 15:35:20 * smooge put it on netflix but didn't remember that much nudity 15:35:22 s/a lot/not enough/ :) 15:35:25 nirik: Regarding pings with tickets: People ping you directly, because they have no idea who they should be pinging, and what is the alternative and also if anyone reads the tickets they created. It would help if when i file an issue i could see the estimated initial response time for it, then I wouldn't bother you or anyone before this time passes. Or if there is a comment about what's "oncall" means, and who and how i should 15:35:25 ping properly about ticket i created 15:35:46 i've been evesdropping unintentionally, sorry for that :) 15:35:51 the initial response time is 1-2 days 15:35:58 bookwar: yes, we are working on this sort of document for sure. 15:36:09 smooge: we don't have this info when we file a ticket 15:36:19 Also since fedora-infra channel is closed, there is no way to contact fedora-infra as a team. This is also the reason why we ping people directly 15:36:32 closed channel? 15:36:35 fedora-infra is closed to everyone 15:36:39 bookwar: we have never used that channel. 15:36:43 what channel? 15:36:50 it has been #fedora-admin 15:37:05 * pingou didn't know there was a #fedora-infra :( 15:37:20 so a while back I created #fedora-infra because several people were complaining that there too many questions about general admin in #fedora-admin 15:37:22 pingou: we made it and closed it to everyone because people would go there... it was supposed to redirect 15:37:35 It was a bad idea 15:37:38 and I regret it 15:37:41 oh ok 15:37:44 it doesn't redirect, it says to me "you need an invitation" 15:37:46 I tried to close it multiple times 15:37:48 smooge: shift happens :) 15:37:52 so i was confused 15:38:05 bookwar: we have documents in progress containing all this 15:38:17 so we should go to #fedora-admin and check for those who are on call? 15:38:17 we need to finish them and publish them 15:38:22 * nirik nods. 15:38:26 mainly because everytime we do set it up to redirect a day or so later it gets set to "you need an invitation" 15:38:38 bookwar: also the .oncall command works everywhere where zodbot is 15:38:56 bookwar: depends on what you need. If you file a ticket we should interact with you there. 15:39:04 unless it's somehow urgent 15:39:18 or you aren't sure if it's urgent. 15:39:36 but it might be. oncall person can look and find info from you. 15:39:48 ok, that's smth new i learned today, thanks, but also please add note about it in pagure default issue template if possible, i think for users it is more natural to start from there, than from standalone doc 15:40:26 Sure, a pointer to that doc from the default template sounds like a great idea. 15:42:10 thanks for the feedback bookwar... 15:42:36 bookwar, could I ask a favour and you put that in a ticket 15:42:55 smooge: ok, i can do that 15:42:56 we have come up a couple of times here.. and we usually end up with a complete 5 alarm fire right afterwords 15:43:25 it is like summoning Diablo 15:43:39 always happens with docs :) 15:43:47 "Oh could you make things easier to interact and set expectations?" "BOWELS OF HELL OPEN UP" 15:44:13 * nirik has been meanting to help those docs along all well, but ENOTIME. Perhaps tomorrow. 15:44:51 nirik, like I said 15:45:42 you open up the docs folder to review things or correct something and the next thing you know you are fighting a blood thirsty rabbit 15:45:58 rabbits are cute though 15:46:38 * pingou going to step afk 15:46:42 same here 15:46:49 ok thank you all for coming this week 15:47:13 see you next week and then I need someone to run the July 15th meeting 15:47:27 #info Smooge is on PTO 2019-08-14->2019-08-16 15:47:33 #endmeeting