15:01:24 <smooge> #startmeeting Infrastructure (2019-02-14)
15:01:24 <zodbot> Meeting started Thu Feb 14 15:01:24 2019 UTC.
15:01:24 <zodbot> This meeting is logged and archived in a public location.
15:01:24 <zodbot> The chair is smooge. Information about MeetBot at http://wiki.debian.org/MeetBot.
15:01:24 <zodbot> Useful Commands: #action #agreed #halp #info #idea #link #topic.
15:01:24 <zodbot> The meeting name has been set to 'infrastructure_(2019-02-14)'
15:01:24 <smooge> #meetingname infrastructure
15:01:24 <zodbot> The meeting name has been set to 'infrastructure'
15:01:24 <smooge> #topic aloha
15:01:24 <smooge> #chair nirik pingou puiterwijk relrod smooge tflink threebean cverna mkonecny
15:01:24 <zodbot> Current chairs: cverna mkonecny nirik pingou puiterwijk relrod smooge tflink threebean
15:01:34 <smooge> hello everyone
15:01:42 <mkonecny> .hello zlopez
15:01:43 <zodbot> mkonecny: zlopez 'Michal Konečný' <michal.konecny@packetseekers.eu>
15:01:45 <cverna> hello
15:01:59 <nirik> morning
15:02:10 <tflink> morning
15:02:26 <cyberworm54> Morning everyone!
15:02:39 <armnhmr> Good morning
15:04:56 <smooge> #topic New folks introductions
15:04:56 <smooge> #info This is a place where people who are interested in Fedora Infrastructure can introduce themselves
15:04:56 <smooge> #info Getting Started Guide: https://fedoraproject.org/wiki/Infrastructure/GettingStarted
15:05:29 <smooge> we had a new person join earlier today but they can't make these meeting times
15:05:32 <bowlofeggs> .hello2
15:05:33 <zodbot> bowlofeggs: bowlofeggs 'Randy Barlow' <rbarlow@redhat.com>
15:05:44 <smooge> any other new people?
15:06:55 <smooge> #topic announcements and information
15:06:55 <smooge> #info nirik will have sparse hours due to house move
15:06:55 <smooge> #info new Taskotron deployment almost complete - once complete and ready for production, will let us replace the remaining F27 machines
15:06:55 <smooge> #info fedora-packages deployed on f29 boxes - cverna
15:06:55 <smooge> #info copr updated by Frostyx earlier today. looks good.
15:06:56 <smooge> #info s390x builders are having problems with builds. puiterwijk is tryin a solution
15:06:58 <smooge> #info autosigner replaced
15:07:00 <smooge> #info ???
15:07:23 <smooge> any other announcements for this week?
15:08:05 * nirik has comment on that s390x stuff, but we can take it out of meeting
15:08:15 <smooge> okie dokie
15:08:40 <smooge> i have comments too.. most of them sea-dog lingo
15:08:55 <bowlofeggs> #info bodhi 3.13 still in stg
15:09:16 <smooge> looking to deploy to prod next week?
15:09:53 <nirik> or friday at 5?
15:10:10 <bowlofeggs> smooge: hopefully, but i haven't finished my testing yet
15:10:24 <smooge> ok friday at 1700 and 2 beers in hand it is then
15:11:21 <smooge> #topic Oncall
15:11:21 <smooge> #info bowlofeggs is on call from 2019-02-07 -> 2019-02-14
15:11:21 <smooge> #info smooge is on call from 2019-02-14 -> 2019-02-21
15:11:21 <smooge> #info ?????? is on call from 2019-02-21 -> 2019-02-28
15:11:21 <smooge> #info Summary of last week: (from bowlofeggs )
15:11:40 <bowlofeggs> not too crazy of a week - there was one time i made the call to interrupt admins (sorry)
15:11:53 <bowlofeggs> otherwise i just triaged tickets and asked other people to file tickets
15:12:36 <smooge> zodbot: alias add oncall "echo smooge (Stephen Smoogen) is oncall. Please file a ticket if you don't hear from me ( https://pagure.io/fedora-infrastructure/issues ) My current hours are 1000 UTC to 1800 UTC Monday through Friday"
15:12:36 <zodbot> smooge: Kneel before zod!
15:12:56 <smooge> ok who would like to take oncall next week? nirik you are out I think
15:12:58 <nirik> I might be able to take the next week... depending on when my move happens
15:13:06 <nirik> yeah, dunno yet.
15:13:23 <smooge> so I think we can decide this next week as needed
15:13:25 <puiterwijk> I can take it for next week I guess
15:15:03 <smooge> thank you bowlofeggs for the work
15:15:09 <smooge> puiterwijk, I will put you down
15:15:26 <smooge> #topic Monitoring discussion
15:15:26 <smooge> #info https://nagios.fedoraproject.org/nagios
15:15:26 <smooge> #info Go over existing out items and fix
15:15:58 <smooge> So most of the pages I saw this week looked to be memory leaks in something feeding fedmsg on boxes or koji
15:17:06 <nirik> the aarch64-c21 ones are because I installed rhel8 beta on that node...and there's no nagios or nrpe yet since we have no epel8
15:17:23 <smooge> ah ok
15:18:20 <nirik> to help debug that armv7 hang/pause thing. ;(
15:18:55 <smooge> the this hardware isn't under warranty, we are never getting an updated firmware to fix things and good luck
15:19:24 <nirik> well, it happens on other aarch64 hw too... it's a fedora bug somehow, but where I am not sure.
15:19:25 <cverna> osbs-aarch64-master01 is currently being deployed so that should become green soon hopefully :)
15:19:39 <smooge> cool
15:19:48 <smooge> any other monitoring items?
15:19:51 <cverna> osbs-master01.stg.phx2.fedoraproject.org not sure why this one is red, I am pretty sure it is up
15:20:09 <cverna> might need to restart the nrpe service
15:21:20 <nirik> and might need a firewall rule added, since osbs takes over those.
15:22:13 <smooge> #topic Tickets discussion
15:22:13 <smooge> #info https://pagure.io/fedora-infrastructure/report/Meetings%20ticket
15:22:51 <smooge> There were no tickets marked for todays meeting but is there anyone that needs to be looked at?
15:23:17 <smooge> #topic Priorities for next week?
15:23:17 <smooge> #info please put tickets needing to be focused on here
15:23:49 <smooge> Any gotchas, things we need to multiple people working together on?
15:24:20 <nirik> next week is f30 branching... need to make sure that goes smoothly.
15:24:34 <nirik> I think the week after we may want to look at a mass update/reboot cycle.
15:26:19 <smooge> yeah.. freeze starts 2017-03-05
15:26:21 <nirik> if pagure 5.2 is done next week, we need to coordinate that upgrade
15:26:37 <puiterwijk> nirik: 5.3 you mean?
15:26:44 <puiterwijk> 5.2 is out already
15:27:40 <nirik> sorry yeah
15:27:46 <smooge> 5.3 should be released tomorrow
15:28:07 <smooge> and yeah.. another out of meeting conversation :)
15:28:48 <smooge> I will put in the calendar that we plan to have update/reboots from 2019-02-26 -> 2019-03-01
15:29:06 <nirik> huh, I thought pingou was out tomorrow... but ok. ;)
15:31:16 <smooge> he is but he said he will aim on getting it done
15:31:51 <smooge> or maybe I misunderstood
15:31:55 <smooge> yeah I probably did
15:32:20 <smooge> I am going to milk this dayquil excuse for a day or two more
15:32:31 <smooge> ok anyway
15:32:43 <smooge> #topic Open Floor
15:33:17 * bowlofeggs takes the gavel from smooge and swings it around wildly, then hands it back
15:34:11 <tflink> ow, my eye!
15:34:12 <smooge> doooooooood colors
15:34:34 <smooge> man this is like maaagic
15:34:50 <smooge> first it was gone.. then it was back
15:34:54 <mkonecny> It's magic time
15:35:13 <smooge> ok with that I think we can call this meeting closed if no one else has an item.
15:36:17 <smooge> and with that.
15:36:22 <smooge> thank you all for coming this week
15:36:26 <smooge> #endmeeting