15:00:55 <nirik> #startmeeting Infrastructure (2019-11-14)
15:00:55 <zodbot> Meeting started Thu Nov 14 15:00:55 2019 UTC.
15:00:55 <zodbot> This meeting is logged and archived in a public location.
15:00:55 <zodbot> The chair is nirik. Information about MeetBot at http://wiki.debian.org/MeetBot.
15:00:55 <zodbot> Useful Commands: #action #agreed #halp #info #idea #link #topic.
15:00:55 <zodbot> The meeting name has been set to 'infrastructure_(2019-11-14)'
15:00:55 <nirik> #meetingname infrastructure
15:00:55 <nirik> #topic aloha
15:00:55 <nirik> #chair nirik pingou relrod smooge tflink cverna mizdebsk mkonecny abompard bowlofeggs
15:00:55 <zodbot> The meeting name has been set to 'infrastructure'
15:00:55 <zodbot> Current chairs: abompard bowlofeggs cverna mizdebsk mkonecny nirik pingou relrod smooge tflink
15:01:07 <bowlofeggs> .hello2
15:01:08 <zodbot> bowlofeggs: bowlofeggs 'Randy Barlow' <rbarlow@redhat.com>
15:01:28 * nirik will wait for a bit for folks to come in... it's looking like a quiet thursday morning.
15:01:46 <austinpowered> good morning
15:02:15 * pingou hi
15:02:21 <cverna> hello
15:03:41 <pyratebeard> hello
15:03:55 <smooge> hey look who got stuck in traffic for an hour
15:03:56 * nirik will start at :05 after
15:04:15 <nirik> hey smooge. Oh yeah, you were going into the tower today...
15:05:27 * relrod waves, but won't be here the whole time due to an appointment this morning
15:05:30 <nirik> #topic Next chair
15:05:30 <nirik> #info magic eight ball says:
15:05:31 <nirik> 2019-11-07: mkonecny
15:05:31 <nirik> 2019-11-14: smooge
15:05:31 <nirik> 2019-11-21: pingou
15:05:32 <smooge> 3 traffic accidents made it an hour long one
15:05:42 <nirik> who wants it next week?
15:05:52 <pingou> that's me
15:05:55 <pingou> Nov 21st
15:05:58 <nirik> oh yeah.
15:05:59 <smooge> I will take next week since I missed this week
15:06:13 <smooge> pingou, can you do the one in december?
15:06:16 <smooge> or I can do that one
15:06:18 <nirik> smooge: you want to take over tooday? or ?
15:06:26 <smooge> ok I will take over now
15:06:53 <smooge> #info There will be no meeting in 2019-11-28
15:06:59 <nirik> I guess we should decide when we meet in dec...
15:07:12 <nirik> 5th and 12th, but 19th? 26th?
15:07:17 <nirik> 2nd?
15:07:21 <smooge> #info 2019-12-05 to be decided
15:07:32 <pingou> 26th and 2nd can likely be dropped
15:07:51 <smooge> #info 2019-12-12 to be decided
15:08:01 <smooge> #info 2019-12-19 to be decided
15:08:07 <smooge> #info 2019-12-26 NO Meeting
15:08:12 <nirik> yeah, I'd say lets do 5th and 12th for sure, 19th probibly? and not 26th and 2nd.
15:08:15 <smooge> #info 2019-01-02 No meeting
15:08:48 <smooge> thanks for the person updating the board
15:09:06 <smooge> magic eight ball says..
15:09:47 <smooge> well it came up with someone who is going to be moving (relrod) so I will take the 05
15:10:36 <smooge> #info people on chair list please volunteer for next meeting or be volunteered
15:10:40 <smooge> #topic New folks introductions
15:10:40 <smooge> #info This is a place where people who are interested in Fedora Infrastructure can introduce themselves
15:10:40 <smooge> #info Getting Started Guide: https://fedoraproject.org/wiki/Infrastructure/GettingStarted
15:10:48 <relrod> yeah 5th is questionable for me since it's 4 days before moving, 12th is definitely out because I'll be driving all day
15:10:50 <smooge> do we have any new people
15:10:56 <ks3> Me!
15:11:25 <cverna> ks3: welcome
15:11:27 <pingou> hi ks3, welcome!
15:11:45 <smooge> welcome ks3
15:11:50 <ks3> Thanks! Send the intro email to the list, just looking for ways to get involved.
15:13:36 <smooge> cool ks3. to answer your question.. we aren't looking for most of those tickets to be fixed quickly
15:13:59 <smooge> most have been around for multiple years so we are just wanting progress on them evne if gradual
15:14:26 <smooge> does that make sense?
15:14:55 <ks3> Yep, sounds reasonable. I can take a look and propse one if there’s isn’t a specific one that’s preferred.
15:16:03 <ks3> I think I saw something about an apprentice group as well, should I be joining that or doing anything else to get started?
15:16:27 <smooge> yes. let me know your fas account and I will add it to the group
15:17:34 <smooge> any other new people this week?
15:17:46 <smooge> #topic announcements and information
15:17:46 <smooge> #info f31 final freeze now over
15:17:46 <smooge> #info aarch64 hardware mostly sorted, will be installing soon
15:17:46 <smooge> #info koji backups are done on secondary host. Slowdown in koji still occurring.
15:17:46 <smooge> #info mass update/reboot cycle completed
15:18:02 <smooge> #info bodhi 5.0 relesed
15:18:54 <smooge> any other announcements?
15:19:26 <smooge> pingou, cverna did you guys have anything for your teams?
15:19:37 * nirik tries to recall what he did this week... it's been a blur
15:19:57 <pingou> smooge: bodhi 5.0 :)
15:20:49 <smooge> my week has been meetings about meetings for meetings
15:21:17 <relrod> My week has been fires.
15:21:21 <nirik> yeah, tuesday was meetings then long hours of getting updates pushes working again.
15:21:28 <relrod> ^
15:21:29 <nirik> many thanks to relrod and mboddu there
15:21:47 <relrod> nirik: and to you too
15:21:51 <mboddu> Its been a fun week so far
15:21:52 <smooge> ok well the meetings will continue until morale improves
15:21:57 <smooge> #topic Oncall
15:21:58 <smooge> #info https://fedoraproject.org/wiki/Infrastructure/Oncall
15:21:58 <smooge> #info cverna is on call 2019-11-07->2019-11-14
15:21:58 <smooge> #info pingou is on call 2019-11-14->2019-11-21
15:21:58 <smooge> #info ?? is on call 2019-11-21->2019-11-28
15:21:59 <smooge> #info ?? is on call 2019-11-28->2019-12-05
15:22:03 <mboddu> And thanks nirik and relrod
15:22:59 <pingou> so who is oncall the last week of November
15:23:03 <pingou> and the first week of December?
15:23:13 <bowlofeggs> there's a big US holiday on the 28th
15:23:25 <bowlofeggs> so probably hsouldn't be a US person for the 28th and 29th
15:23:31 <nirik> I'm not going anywhere, I can take it. unless someone else wants it
15:23:38 <pingou> I guess that's why there is no meeting then :)
15:25:08 <smooge> I will take 28->05
15:25:49 <pingou> and kevin took the week earlier
15:26:00 <pingou> so that makes it:
15:26:01 <smooge> I put kevin for the week before
15:26:02 <pingou> #info kevin is on call 2019-11-21->2019-11-28
15:26:04 <pingou> #info smooge is on call 2019-11-28->2019-12-05
15:26:08 <smooge> yep
15:26:56 <nirik> sure
15:28:13 <smooge> last week I think oncall was pretty quiet
15:28:17 <smooge> #topic Monitoring discussion
15:28:17 <smooge> #info https://nagios.fedoraproject.org/nagios
15:28:17 <smooge> #info Go over existing out items and fix
15:30:23 <nirik> I think they are all pretty known... except for
15:30:37 <nirik> proxy101 mirrorlist. I'm not sure how to debug that with the new mirrorlists.
15:30:49 <nirik> and disk space on sundries01
15:31:48 <smooge> so I will look at mirorlist after the 4 fires I have in pm's
15:32:11 <nirik> ok, if you could give us a bit of a tutorial/info on it that would be great...
15:33:41 <smooge> i will once I understand it.
15:34:06 <smooge> mainly I understand that we are using a user-level container as the mirrorlist user
15:34:29 <smooge> all the files which are stored etc are thus in /home/fedora/mirrormanager(?) and run out of there
15:35:05 <smooge> this allows for someone who is just the mirrormanager to debug things versus being root
15:35:48 <smooge> but I will document and present next meeting
15:36:00 <nirik> ok
15:36:46 <smooge> #topic backlog discussion
15:36:47 <smooge> #info go over our backlog and discuss and determine priority
15:36:47 <smooge> #link https://pagure.io/fedora-infrastructure/issue/8178
15:36:47 <smooge> #info topic: provision new aarch64 builders
15:36:47 <smooge> #link https://pagure.io/fedora-infrastructure/issue/8157
15:36:48 <smooge> #info topic: ansible: enable ansible-report as a hook
15:37:10 <nirik> I cleaned up some errors the other week...
15:37:17 <nirik> but I haven't looked at warnings much
15:37:24 <smooge> i am trying to get time to work on the aarch64 builder problems.. at this point I will be at next week before I can do so
15:38:08 <nirik> I have 1 of them running vm's...
15:38:13 <nirik> 1 of them is installed and ready for vms
15:38:22 <nirik> the rest I don't know yet.
15:38:52 <cverna> I did a bit of experiment on the ansible-review to have it as a pre-receive hook, but it seems really picky to the input and I am not sure if that's worth the effort
15:38:55 <nirik> we likely also need to allocate some to osbs?
15:39:05 <smooge> I thought I had 7 others which were on the network since they had gotten dhcp on one interface.. but as kevin found out on the first one he went to work on.. they don't work always
15:39:37 <smooge> at this point I think we have more things being wanted than we have working systems
15:39:38 <cverna> yep 6 vms for osbs (3 stg, 3 prod) would be great
15:39:46 <nirik> smooge: don't think so...
15:39:55 <smooge> note working
15:40:07 <nirik> there are 17. 4 for qa, 2 for osbs... rest for builders.
15:40:13 <nirik> ah, indeed, thats true.
15:40:25 <nirik> also, there is a firmware update.
15:40:32 <nirik> which I am not sure how to apply...
15:41:02 <smooge> there are 16 we found.. of which 1 has completely working networks 8 have somewhat working nad 7 dont
15:41:04 <nirik> anyhow,, we will make progress as time permits.
15:41:26 <nirik> we were invoiced for 17, so if they only sent us 16, we are owed another. :)
15:41:40 <nirik> but anyhow...
15:41:48 <cverna> buy 17 get one less :)
15:42:30 <smooge> I skipped tickets
15:42:33 <smooge> #topic Tickets discussion
15:42:33 <smooge> #info https://pagure.io/fedora-infrastructure/report/Meetings%20ticket
15:42:33 <smooge> #info no tickets marked for the meeting
15:42:33 <smooge> #info Fedora CoreOS Team requests
15:42:33 <smooge> #link https://hackmd.io/5uB7hOJKSjGUt65iLgPnbA#Existing-requests-for-Fedora-Infra
15:42:47 <nirik> dustymabe is traveling this week I think.
15:43:04 <smooge> #topic Open Floor
15:45:03 <smooge> ok if there is nothing for open floor
15:45:12 <smooge> I am going to thank you all for coming this week
15:45:31 <smooge> and I am going to close this meeting so I can get some coffee
15:45:34 <smooge> thanks again
15:45:44 <smooge> #endmeeting