18:00:07 <nirik> #startmeeting Infrastructure (2017-02-02)
18:00:07 <zodbot> Meeting started Thu Feb  2 18:00:07 2017 UTC.  The chair is nirik. Information about MeetBot at http://wiki.debian.org/MeetBot.
18:00:07 <zodbot> Useful Commands: #action #agreed #halp #info #idea #link #topic.
18:00:07 <zodbot> The meeting name has been set to 'infrastructure_(2017-02-02)'
18:00:07 <nirik> #meetingname infrastructure
18:00:07 <zodbot> The meeting name has been set to 'infrastructure'
18:00:07 <nirik> #topic aloha
18:00:07 <nirik> #chair smooge relrod nirik abadger1999 lmacken dgilmore threebean pingou puiterwijk pbrobinson
18:00:07 <zodbot> Current chairs: abadger1999 dgilmore lmacken nirik pbrobinson pingou puiterwijk relrod smooge threebean
18:00:07 <nirik> #topic New folks introductions
18:00:19 <bt0> .hello bt0dotninja
18:00:21 <zodbot> bt0: bt0dotninja 'Alberto Rodriguez Sanchez' <hotgalan@gmail.com>
18:00:32 <bt0> Hello everyone o/
18:00:34 <clime> Hello
18:00:37 <nirik> morning everyone.
18:00:44 <athos> hi :)
18:00:59 <cverna> . himynameis cverna
18:01:00 <zodbot> cverna: cverna 'Slim Shady' <cverna@tutanota.com>
18:01:02 * nirik will wait a few for folks to wander in.
18:01:06 <marc84> hi everyone
18:02:39 <jcline> .hello jcline
18:02:40 <zodbot> jcline: jcline 'Jeremy Cline' <jeremy@jcline.org>
18:02:58 <nirik> any new folks today that would like to give a short one line introduction of themselves?
18:03:16 * doteast waves
18:03:50 <nirik> ok, I guess lets drive in...
18:03:52 <bowlofeggs> .hello bowlofeggs
18:03:54 <zodbot> bowlofeggs: bowlofeggs 'Randy Barlow' <randy@electronsweatshop.com>
18:04:10 <nirik> #topic announcements and information
18:04:10 <nirik> #info mass rebuild coming up this week - releng folks.
18:04:10 <nirik> #info new new hotness in stg, coming to prod soon - jcline
18:04:10 <nirik> #info Nearing end of year for RH budget cycles - everyone
18:04:11 <nirik> #info cleaned up space on db-koji01 (was alerting every night at logrotate time) - kevin
18:04:12 <nirik> #info Feb apprentice nag email is out, answer today! - kevin
18:04:14 <nirik> #info updating certificates on webservers is hard.
18:04:22 <nirik> anyone have any items they want to add or discuss from there?
18:04:47 <x3mboy> .hello x3mboy
18:04:48 <zodbot> x3mboy: x3mboy 'Eduard Lucena' <eduardlucena@gmail.com>
18:05:04 <nirik> Oh, I forgot to list that I solved https://pagure.io/fedora-infrastructure/issue/4507 yesterday after a bunch of digging. It was a pretty weird issue. ;)
18:05:49 <smooge> nirik, congrats!
18:05:59 <smooge> nirik, I hate those sorts of redirect puzzles
18:06:03 <nirik> (basically apache has a built in redirector for if you request a directory and don't have a trailing / on it
18:06:17 <nirik> it redirects you so all the links in the index work.
18:06:35 <nirik> but turns out it uses ServerName for that and we didn't have that set, so it was defaulting to http://
18:06:52 <nirik> yeah, it was a anoying one. 2 years...
18:07:49 <cverna> nirik++
18:07:49 <zodbot> cverna: Karma for kevin changed to 25 (for the f25 release cycle):  https://badges.fedoraproject.org/tags/cookie/any
18:07:49 <nirik> #topic fas3 status?
18:08:06 <nirik> I don't know that we have any of the folks who were looking at fas3 here today...
18:08:17 <nirik> I know ryanlerch has been testing it out a lot and reporting issues.
18:09:05 <nirik> Hopefully things will ramp up next week some with people back from travels.
18:09:45 <nirik> anyone have anything more on fas3? or questions?
18:09:52 <cverna> what is the plan for fas3 ? date ?
18:10:11 <cverna> if any :p
18:10:18 <nirik> there's no date, but hopefully soon. ;)
18:10:28 <nirik> before alpha freeze I think is the hope
18:10:28 <smooge> I think those questions can't be answered without people who aren't here :)
18:10:40 <cverna> :)
18:11:09 <nirik> #topic fedorahosted migration status
18:11:17 <nirik> not much new to report here either...
18:11:29 <nirik> but we are down to the last month before our announced sunsetting.
18:11:55 <cverna> we were suppose to have a chat at devconf about fedora-badges but I dont think it happened
18:12:06 <nirik> I keep getting sidetracked, but hopefully soon I can make sure at least all the popular ones are done.
18:12:21 <nirik> yeah, badges and freemedia still need sorting
18:12:29 <nirik> There's a badges ticket. I can ping on it.
18:12:37 <cverna> I wanted to try the import just to test pagure-importer, but I don't have xmlrpc permission
18:13:15 <cverna> nirik: could you add me the permission, so at least I can make sure there is no issues with the import
18:13:26 <nirik> https://pagure.io/fedora-infrastructure/issue/5553
18:13:36 <nirik> cverna: for badges?
18:13:43 <cverna> yeah
18:13:54 <nirik> yeah, I can.
18:14:31 <cverna> I will try a raw out of the box import in stg
18:14:56 <doteast> sorry, topic rollback: fas/fas3 uses memcached, right? nagios has only one check for memcached, do we need more?
18:16:02 <nirik> cverna: added
18:16:09 <nirik> doteast: I am not entirely sure. ;)
18:16:23 <nirik> fas does use memcached, but one on each server locally.
18:16:23 * pingou late
18:16:34 <nirik> hey pingou
18:16:48 <doteast> what about memcached01/02?
18:17:01 <nirik> fas does not use them at all.
18:17:16 <nirik> for security reasons we don't want it sharing cache with other less important apps
18:17:47 <nirik> in general for monitoring we should try and help smooge finish up his new nagios setup... and add/fix things there.
18:18:07 <smooge> please
18:18:39 <doteast> sure
18:19:01 <doteast> smooge, how can I help
18:19:45 <smooge> well look over the nagios_server roles. Then look over how noc01.stg is working (or not).
18:19:53 <nirik> #info nirik to try and update migration list for hosted and make sure we have any projects that are important moved or scheduled to move.
18:19:54 <smooge> I will have a noc02.stg soonish
18:20:23 <doteast> smooge, did you decide on what/how to template?
18:20:26 <nirik> #info will try and get badges and freemedia moving this next week if we can.
18:21:27 <cverna> nirik: thanks
18:21:51 <smooge> doteast, I did as many of the existing ones as I could as templates. A couple need some work because our logic for certain servicegroups is insane
18:22:00 <nirik> I'd love to finish releng too... but I need to bug pingou about that one. ;)
18:22:21 <smooge> well cargo cultish.. it made sense 8 years ago.. now it just keeps things working ish
18:22:31 <pingou> nirik: hopefully next week things will calm down :)
18:22:37 <doteast> :)
18:22:47 <nirik> pingou: ok. Do let me know if there's anything I can do on it.
18:22:57 <pingou> nirik: will do :)
18:23:38 <doteast> smooge, I'll have a look and try to catch up with you
18:23:39 <nirik> pingou: sidenote: I added a change to the pagure_ev systemd unit file in ansible... might want to merge that upstream? just setting NOFILES to some large value so it doesn't run out
18:24:02 <pingou> nirik: oh, I'd love that upstream as well yes
18:24:52 <nirik> it's kinda of workaround, but oh well.
18:25:20 <nirik> ok, anything else on fedorahosted moving?
18:26:20 <nirik> #topic Moving SOPs to the proposed infra-docs sphinx project (https://docs.pagure.org/infra-docs/)
18:26:33 <nirik> is this leftover from last week? or more discussion?
18:26:36 <nirik> jcline: ^
18:27:19 <jcline> So everyone seemed to have a positive response so I just wanted to see how we wanted to handle migrating from the old sop repo to the new one
18:27:58 <nirik> well, I'd like to make sure we have a copy on batcave... in case of pagure being down
18:28:04 <jcline> Also to see if anyone had objections who was out last week due to the conference
18:28:33 <nirik> I guess just setup a time/date, make sure content is synced and we can change the repo on batcave to just pull from pagure?
18:28:55 <smooge> how do I push changes from batcave to it?
18:28:57 <nirik> also likely there are other docs to update... like the wiki
18:29:14 <nirik> smooge: you don't. You use PR's and merge them in pagure...
18:29:29 * cverna likes the new infra-docs page :)
18:29:38 <pingou> the SOP itself were looking good
18:29:59 <pingou> the best practices section might require some more discussions and some tweaking
18:30:11 <pingou> I've been meaning to reply to jcline 's email about that but haven't yet
18:30:13 <jcline> pingou, yeah I just dropped stuff I had from various places for a demo
18:30:39 <jcline> I plan on backing all those out and adding things as PRs where everyone can discuss the fine details and agree
18:30:40 <nirik> there was suggestion on the list to use the new docs builder setup too... but really this is getting overcomplex for this use case IMHO
18:30:58 <pingou> nirik: there is a PR on pagure to support mirroring to external hosts :)
18:31:07 <nirik> that would be lovely
18:31:27 <pingou> I just need an info from puiterwijk to make it not use ~/.ssh/config which is a little error prone
18:31:47 <smooge> I expect I will need an SOP on how to make PR's and merge
18:32:33 <jcline> smooge, I think I have one partially written up
18:32:33 <nirik> someone should make a hyperdetailed one of those for general pagure use. I know github has some, but it would be nice to have a pagure specific one...
18:32:42 <nirik> cool!
18:34:01 <nirik> one big plus here is that I can now give someone a link to an exact section of a SOP. ;)
18:34:12 <jcline> Okay, so I'll pick a date/time and detail the mirroring setup. Is there a pagure group I can add to be the repo owners like the github fedora-infra group?
18:34:39 <nirik> not that I know of. We really really need to setup fas->pagure group syncing. ;(
18:34:40 <jcline> If not that'd be convenient to have so I don't have to add everyone manually :(
18:34:41 <pingou> https://docs.pagure.org/pagure/usage.html definitively could use more info
18:35:36 * nirik nods.
18:37:26 <nirik> so I guess the fas group sync would be something we would need to write. Should I add a ticket for it and hope that someone with more time than puiterwijk can work on it? ;)
18:38:40 <pingou> a ticket could be helpful anyway :)
18:38:46 <sayan> I think so yes
18:38:49 <nirik> sure. I can file that...
18:38:53 <sayan> a ticket should be there
18:39:09 <nirik> #info jcline to look at scheduiling a time for the docs move and coordinating
18:39:26 <nirik> #info nirik will file a ticket for the fas groups -> pagure groups sync script.
18:39:31 <nirik> anything else on this?
18:40:09 * jcline is satisfied
18:40:34 <nirik> #topic Apprentice Open office hours
18:40:49 <nirik> Any apprentices with questions comments ideas or looking for things to work on?
18:42:11 <smooge> looks like no
18:42:21 <smooge> or I got channel split
18:42:26 <nirik> indeed.
18:42:30 <nirik> #topic Open Floor
18:42:35 <nirik> Anyone have anything for open floor?
18:42:41 <sayan> Yep
18:43:03 <smooge> Pet Peeve... people should not do conference calls on speaker phone with multiple phones in a room
18:43:34 <sayan> I pinged jflory7 but did not get reply for badges migration. I thinking to start that tomorrow itself
18:44:00 <sayan> maybe jflory7 has not returned from DevConf yet
18:44:16 <smooge> sayan, cverna might be interested in helping you?
18:44:36 <nirik> yeah, cverna was going to test a stg run. ;) might see how that goes, but yeah, we should move it forward.
18:44:45 <sayan> smooge: yes, cverna and vivek_ would be my guide :)
18:45:18 <vivek_> ?
18:45:23 <vivek_> oh
18:45:30 <sayan> just the update I wanted to share
18:45:40 <smooge> ok cool
18:46:11 <nirik> Oh, everyone should keep in mind alpha freeze is coming up at the end of the month...
18:46:14 <cverna> sayan: ping me on irc if you have any trouble
18:46:27 <nirik> so we have basically this month to land things we want to make sure are done before the f26 cycle really kicks in
18:46:56 <sayan> cverna: sure
18:48:09 <nirik> ok. If nothing else will close things out in a minute * %RAND
18:49:04 <nirik> ok. Thanks for coming everyone. Do continue in #fedora-admin, #fedora-apps and #fedora-noc.
18:49:06 <nirik> #endmeeting