14:00:59 <smooge> #startmeeting Infrastructure (2018-10-17)
14:00:59 <zodbot> Meeting started Thu Oct 18 14:00:59 2018 UTC.
14:00:59 <zodbot> This meeting is logged and archived in a public location.
14:00:59 <zodbot> The chair is smooge. Information about MeetBot at http://wiki.debian.org/MeetBot.
14:00:59 <zodbot> Useful Commands: #action #agreed #halp #info #idea #link #topic.
14:00:59 <zodbot> The meeting name has been set to 'infrastructure_(2018-10-17)'
14:00:59 <smooge> #meetingname infrastructure
14:00:59 <smooge> #topic aloha
14:00:59 <smooge> #chair nirik pingou puiterwijk relrod smooge tflink threebean cverna mkonecny
14:00:59 <zodbot> The meeting name has been set to 'infrastructure'
14:00:59 <zodbot> Current chairs: cverna mkonecny nirik pingou puiterwijk relrod smooge tflink threebean
14:01:24 <mkonecny> hi smooge
14:01:37 <nirik> morning
14:01:47 <smooge> hello all
14:01:57 <relrod> morning
14:01:57 <cverna> morning all
14:02:17 <abompard> hey folks!
14:02:20 <chris787> o/
14:02:29 <smooge> good morning Europe
14:02:37 <smooge> s/morning/afternoon/
14:03:06 <smooge> #topic New folks introductions
14:03:06 <smooge> #info This is a place where people who are interested in Fedora Infrastructure can introduce themselves
14:03:07 <smooge> #info Getting Started Guide: https://fedoraproject.org/wiki/Infrastructure/GettingStarted
14:03:13 <smooge> any new people this week
14:05:03 <smooge> #topic announcements and information
14:05:04 <smooge> #info tflink is on extended PTO
14:05:04 <smooge> #info Final Freeze has started 2018-10-09
14:05:04 <smooge> #info version 0.13.2 of release-monitoring.org deployed in production - mkonecny
14:05:17 <smooge> we are currently in final freeze
14:05:29 <smooge> any other info for this week?
14:06:10 <smooge> #topic Oncall
14:06:10 <smooge> #info relrod is on call from 2018-10-18 -> 2018-10-25
14:06:10 <smooge> #info smooge is on call from 2018-10-25 -> 2018-11-01
14:06:10 <smooge> #info ??? is on call from 2018-11-01 -> 2018-11-08
14:06:11 <smooge> #info Summary of last week: (from smooge )
14:06:52 <smooge> ok I am on call and will be turning it over to relrod shortly. I will be on call the week after that also. I need someone to sign up for the 1st and probably the next week
14:07:16 <smooge> this week had 2 major problems:
14:07:32 <smooge> 1. cogent decided to make a routing loop and took down our secondary data center
14:08:12 <smooge> 2. someone left a default password cloud system up and someone found it. They then decided to use it as a scanner for other bad hosts
14:08:29 <smooge> that caused network problems and nirik finally found fixed yesterday
14:08:50 <nirik> I can take the 1st-08th...
14:10:15 <smooge> ok thanks.
14:10:21 <smooge> #topic Apprentice Open office minutes
14:10:22 <smooge> #info A time where apprentices may ask for help or look at problems.
14:10:31 <smooge> Any questions from apprentices this week?
14:11:11 * nirik thinks it's pretty quiet this morning... almost... too quiet. ;)
14:11:37 <smooge> ok.. well I think we are at
14:11:40 <smooge> #topic Open Floor
14:11:56 <smooge> I don't think this is the record fastest infrastructure meeting but close to it
14:12:04 <cverna> I have a small troll considering what is going on on devel list :)
14:12:15 <smooge> no
14:12:24 <cverna> should we have a infra category https://discussion.fedoraproject.org/
14:12:35 <cverna> smooge: ok :)
14:12:39 <nirik> well, I am kinda doing 'wait and see' about that...
14:12:40 <smooge> we could but I am not going to look at it
14:13:02 <nirik> I think if we move too many things to it before we have decided anything we just split our attention.
14:13:36 <cverna> yes wait and see sounds like a good position
14:13:53 <nirik> I was looking at it's rss feeds, and they are... not ideal. ;(
14:15:08 <mkonecny> I have one ticket I want to ask about
14:15:15 <mkonecny> https://pagure.io/fedora-infrastructure/issue/7313
14:15:16 <smooge> mkonecny, okie dokie
14:15:40 <nirik> yeah, I don't know whats going on there. ;(
14:15:52 <mkonecny> Another user reported this today, this time the-new-hotness didn't received fedmsg
14:16:19 <cverna> is it worth waiting for fedora-messaging ?
14:16:35 <nirik> it's only 'sometimes' right? sometimes it works?
14:16:38 <mkonecny> jcline is already working on PR for Anitya
14:16:50 * jcline looks up
14:16:53 <nirik> (the worst kind of problem)
14:17:01 <mkonecny> nirik: sometimes it works
14:17:13 <mkonecny> I see messages in fedmsg channel
14:17:37 <mkonecny> hi jcline :-)
14:17:43 <nirik> do the ones hotness didn't see show up there in fedmsg channel?
14:18:06 <mkonecny> nirik: You mean in datagrepper?
14:18:57 <nirik> either in datagrepper or in #fedora-fedmsg....
14:19:07 <nirik> ie, that would show they were emited, but hotness didn't get them
14:19:27 <mkonecny> Didn't checked
14:20:04 <mkonecny> But according to one user, who reported this they didn't
14:21:30 <nirik> could we add some debugging to log when it emits a message and to what?
14:21:31 <jcline> Hmm. Well, some messages are making it, so I'd say it's probably the huge chain of unreliable sockets we've got going. Plus yeah, I'm nearly done with the anitya conversion
14:22:27 <cverna> I think it sounds fair to wait for fedora-messaging and see if that improve things
14:22:28 <mkonecny> nirik: I can try to get fedmsg-tail running on pod and compare this to datagrepper
14:22:54 <jcline> nirik, sadly it looks like there's no log statement on publish in fedmsg
14:23:04 <nirik> bummer
14:23:55 <jcline> zmq might log it
14:23:55 <nirik> yeah, fedmsg-tail might be good...
14:24:07 <nirik> but yeah, if we can move it over that might be best
14:24:28 <mkonecny> But it will take long before all listening clients will switch to fedora-messaging, or is fedora-messaging compatible with fedmsg?
14:25:11 <jcline> mkonecny, there are bridges so anything on fedmsg makes it to the broker and anything on the broker goes to fedmsg
14:25:30 <jcline> So the-new-hotness could change now, even though anitya hasn't yet
14:25:42 <jcline> Although we need to get the broker deployed in production
14:26:12 <mkonecny> ok, so if Anitya will emit only fedora-messaging messages even the fedmsg consumers will get it?
14:26:32 <jcline> Yep
14:26:36 <mkonecny> Super
14:26:46 <smooge> ok anything else?
14:27:30 <smooge> #endmeeting