14:00:42 <smooge> #startmeeting Infrastructure (2018-06-28)
14:00:42 <smooge> #meetingname infrastructure
14:00:42 <smooge> #topic aloha
14:00:42 <zodbot> Meeting started Thu Jun 28 14:00:42 2018 UTC.
14:00:42 <zodbot> This meeting is logged and archived in a public location.
14:00:42 <zodbot> The chair is smooge. Information about MeetBot at http://wiki.debian.org/MeetBot.
14:00:42 <zodbot> Useful Commands: #action #agreed #halp #info #idea #link #topic.
14:00:42 <zodbot> The meeting name has been set to 'infrastructure_(2018-06-28)'
14:00:42 <zodbot> The meeting name has been set to 'infrastructure'
14:00:43 <smooge> #chair nirik pingou puiterwijk relrod smooge tflink threebean
14:00:43 <zodbot> Current chairs: nirik pingou puiterwijk relrod smooge tflink threebean
14:01:07 <nirik> morning everyone
14:01:10 <suanand> hi
14:01:11 <tflink> morning
14:01:26 <bhavin192> .hello2
14:01:27 <zodbot> bhavin192: bhavin192 'Bhavin Gandhi' <bhavin7392@gmail.com>
14:01:30 <clime> hello
14:01:41 <relrod> morning
14:01:48 <creaked> morning
14:01:50 <cverna> good morning
14:01:51 <aikidouke> .hello2
14:01:52 <creaked> .hello2
14:01:53 <zodbot> aikidouke: aikidouke 'None' <zachvatwork@gmail.com>
14:01:56 <zodbot> creaked: creaked 'Will Chellman' <creaked@gmail.com>
14:02:06 <aikidouke> guten morgen
14:03:46 <ksinny> .hello sinnykumari
14:03:47 <zodbot> ksinny: sinnykumari 'Sinny Kumari' <ksinny@gmail.com>
14:03:55 <smooge> #topic New folks introductions
14:03:55 <smooge> #info This is a place where people who are interested in Fedora Infrastructure can introduce themselves
14:04:02 <smooge> Hi are there any new people here?
14:04:09 <mklvr> I'm new here.
14:04:15 <bhavin192> Hello everyone
14:04:23 <aikidouke> welcome!
14:04:37 <mklvr> I sent this introduction to the mailing list last week: https://paste.fedoraproject.org/paste/NX-4xwq-lmR9YEmAaZsP~w
14:04:57 <smooge> hello mklvr and bhavin192
14:05:07 <nirik> welcome.
14:05:26 <mklvr> Hi everyone
14:05:31 <cverna> welcome
14:05:55 <puiterwijk> .hello2
14:05:58 <zodbot> puiterwijk: puiterwijk 'Patrick "マルタインアンドレアス" Uiterwijk' <puiterwijk@redhat.com>
14:07:04 <smooge> mklvr,  thank you for the introduction. I have just added you to the apprentice group
14:07:16 <mklvr> Great! I was going to ask about that :)
14:07:29 <smooge> Any other questions for this section?
14:07:29 * threebean waves
14:07:44 <smooge> #topic announcements and information
14:07:44 <smooge> #info bowlofeggs is on PTO
14:07:44 <smooge> #info abompard is on PTO
14:07:44 <smooge> #info pingou is on PTO
14:07:45 <smooge> #info tflink is going on extended PTO
14:07:46 <smooge> #info major Ibiblio outage 2018-07-10
14:07:47 <smooge> #info all staging virthosts have been moved
14:07:48 <smooge> #info only 1 virthost is at - CPU
14:07:50 <smooge> #info there will be a short outage on proxy14 today
14:07:52 <smooge> #info FLOCK in Dresden is 2018-08-08
14:07:54 <smooge> #info visit to PHX2 will be happenening 2018-08-15->2018-08-18
14:07:56 <smooge> Lots of little things
14:08:25 <smooge> there are probably a lot of other items.. I know relrod and nirik have been working on newcloud and other things
14:08:43 <nirik> I will be scheduling mass update/reboot outages next monday/tuesday
14:08:51 <puiterwijk> #info HSTS for fedoraproject.org has been enabled, make sure everything *.fedoraproject.org uses HTTPS
14:09:14 * nirik thought we already did that. huh
14:09:22 <puiterwijk> nirik: we didn't after the move to getfedora.org
14:09:33 <puiterwijk> The getfedora.org redirects dropped the HSTS headers
14:09:34 <nirik> ah, the redirect was messing it up?
14:09:38 <puiterwijk> Yeah
14:09:58 <nirik> good catch seeing that.
14:10:00 <puiterwijk> So I've re-added the HSTS headers to fedoraproject.org, and resubmitted us to the HSTS preload list (we got dropped because we were no longer satisfying the requirements)
14:10:21 <puiterwijk> (note that id.fedoraproject.org was in the HSTS preload list separately, and has never been dropped. So the Identity system was always forced to use HTTPS)
14:11:17 <mizdebsk> some of rarely used domains are not working with forced https redirects as our wildcard cert does not cover them
14:11:26 <smooge> ?
14:11:37 <puiterwijk> mizdebsk: in that case, we'll find them now, and they'll need to be fixed
14:11:39 <smooge> can you send me a list on those
14:11:45 <smooge> thanks
14:11:49 <mizdebsk> sure
14:11:54 <puiterwijk> So yeah, if you find any of such domains, please inform me or create infra tickets
14:12:01 <mizdebsk> ok, will do
14:12:02 <smooge> actually make a ticket and we will see what needs to be done
14:12:07 <smooge> or what puiterwijk said
14:12:49 <threebean> #info New release of greenwave is being prepared https://docs.pagure.org/greenwave/release-notes.html  dcallagh is double checking that bodhi integration still works before we push anything out.
14:14:14 * mboddu is here now
14:14:21 <smooge> any other announcements?
14:14:39 <nirik> #info mass update reboots next monday/tuesday. outages to be filed soon.
14:14:45 <smooge> ah fudge thanks
14:14:59 <smooge> I was going to bring up a point on those
14:15:32 <smooge> we have found a problem where hosts have different Mac address on install than later boots
14:16:30 <smooge> so we are probably going to have a slower reboot/fix cycle
14:16:35 <nirik> yeah. ;(
14:16:38 <smooge> for some systems.
14:16:51 <nirik> really we should try and reproduce it and file a bug... because I bet others hit it too
14:17:10 <smooge> yep
14:17:11 <nirik> I can try and do that sometime
14:17:58 <smooge> but in the meantime we need to go over all guests and make sure the mac address in their ifcfg-eth0 matches the one in the libvirt/*/*.xml file
14:18:21 <smooge> so if not it is fixed
14:18:59 <nirik> well, it doesn't mess up until after the reboot. ;(
14:20:13 <smooge> is the xml file changing?
14:20:21 <smooge> anyway.. need to focus on meeting
14:20:26 <relrod> there's a `virsh send-key` command, I can probably write a script to run on virthost that hackishly fixes VMs...
14:20:34 <smooge> #topic Oncall
14:20:35 <smooge> #info Smooge is on call from 2018-06-27->2018-07-05
14:20:35 <smooge> #info Kevin is on call from 2018-07-06->2018-07-12
14:20:35 <smooge> #info ?? is on call from 2018-07-13->2018-07-19
14:20:48 <smooge> relrod, are you up to taking from the 13th to the 19th?
14:20:57 <relrod> sure
14:21:24 <nirik> I'm not sure if the xml file changes... I can try and duplicate before monday so we know more at least
14:21:26 <smooge> hey wait.. I am on call
14:21:36 <smooge> sorry I need to fix that
14:21:43 <nirik> calling all smooges
14:22:30 <smooge> #topic Office hours - how did it go? - kevin
14:23:01 <smooge> cverna, nirik I think this is your section?
14:23:24 <nirik> yeah... just wondering if we are getting much uptake?
14:23:35 <cverna> yes, so we had 2 so far, I think mostly aikidouke was around :)
14:23:37 <nirik> folks coming by then? worth keeping doing?
14:23:45 <aikidouke> i found it useful for sure :)
14:23:56 <nirik> great!
14:24:12 <nirik> lets keep going with it for a while more. :)
14:24:19 <aikidouke> I fixed a $thing, but my fix broke a $thing, and someone else fixed my fix
14:24:42 <aikidouke> so yay
14:24:46 <cverna> I think it does not cost much to keep doing, I try to be around in the irc channel answering questions
14:25:16 <smooge> thanks cverna I found it useful to see what was going on
14:25:31 <smooge> OK anything else on this?
14:25:51 <mklvr> Where can I find the time for the office hours?
14:26:06 <aikidouke> I found it interesting that one of the other folks around was thing the same thing I was as I first started
14:26:24 <smooge> cverna, when is the next one?
14:26:28 <sapo> mklvr: There's an email update coming.
14:26:28 <mizdebsk> mklvr, https://apps.fedoraproject.org/calendar/infrastructure/
14:26:30 <aikidouke> essentially - your nervous about working on a thing
14:26:44 <cverna> mklvr: https://apps.fedoraproject.org/calendar/infrastructure/2018/7/3/#m9255
14:26:59 <mklvr> Thanks
14:27:08 <aikidouke> but really the sysadmin-main has put nice gaurdrails in place to limit damage :)
14:27:09 <cverna> it is every tuesday at 18:00 UTV
14:27:12 <cverna> UTC*
14:27:33 * nirik wasn't around much for the last one, but was the one before. will try and clear time.
14:29:50 <smooge> ok next up
14:29:53 <smooge> #topic Flock again - kevin
14:30:09 <nirik> just wanted to touch bases with everyone...
14:30:19 <nirik> have you all submitted talks/workshops?
14:30:28 <clime> yup here
14:30:35 <nirik> and note that you can see all the submissions and add comments
14:30:54 <nirik> https://pagure.io/flock/issues/
14:31:01 <cverna> I think we can move to next topic :)
14:31:27 <nirik> sure, move on. Just wanted to remind people.
14:32:31 <smooge> ok please review various talks and next week we will go over which ones people want ot see
14:32:34 <smooge> #topic pkgdb retirement - kevin
14:32:48 <smooge> <dramatic music>
14:33:01 <clime> :)
14:33:58 <nirik> so...
14:34:07 <nirik> we have one endpoint thats still being used on pkgdb
14:34:18 <smooge> can we shut that one down too?
14:34:21 <nirik> for gnome-software
14:34:26 <puiterwijk> I think the endpoint for "latest release", right?
14:34:28 <smooge> yep ok
14:34:36 <nirik> yes... but how is the question.
14:34:40 <nirik> puiterwijk: yes
14:35:00 <nirik> so, we could populate the pdc endpoint that has this info now.
14:35:08 <nirik> however, pdc is also going bye bye
14:35:28 <smooge> what does gnome-software use for other os's?
14:35:52 <nirik> and changing to pdc would require changes in the format. Different apis
14:36:05 <nirik> smooge: I don't think it does dist upgrades on any other os
14:36:29 <relrod> nirik: Is it literally just one endpoint? Could we write pkgdb-lite, that implements that endpoint (and whatever is needed to keep it updated) and nothing else?
14:36:32 <nirik> If the replacement for pdc is out soon, we can just wait and have them repoint it then.
14:36:52 <nirik> relrod: it is, but I was thinking even simpler... just a static json file.
14:37:03 <relrod> or that :)
14:37:04 <threebean> static-json-file++
14:37:23 <mboddu> nirik: Do you know the changes that are required documented some where? For new PDC purposes?
14:37:41 <smooge> goes to write a jboss servlet which serves a static json file
14:37:58 <threebean> the pdc replacement I think will maybe not be out soon.  it wasn't clear that anyone had immediate time to work on it at the end of the last meeting.
14:38:00 <nirik> The advantage of retiring pkgdb now rather than later is that we can then see if anything we forgot about uses it.
14:38:08 <smooge> agreed.
14:38:25 <tflink> what about critpath? is that going to be covered by something else?
14:38:27 <nirik> mbooth: pdc has the changes in a plugin I think, we just need to populate it. but it's a different api.
14:38:39 <threebean> tflink: I think that was going to be pulled into Bodhi, iirc.
14:38:53 <mizdebsk> yes, it will be moved to bodhi
14:38:57 <tflink> before pkgdb is retired?
14:39:14 <mizdebsk> i think critpath is currently taken from pdc, not pkgdb
14:39:17 <nirik> well, thats another question if we are still getting that from pkgdb
14:39:25 <nirik> but I thought it moved to pdc. yeah
14:39:26 <threebean> mizdebsk: that strikes me as right, too.
14:39:37 <tflink> taskotron still uses pkgdb to get lists of critpath packages
14:40:05 * mizdebsk was not aware taskotron uses critpath at all
14:40:06 <tflink> but we don't do it all that often, a static file can work so long as it's updated as needed
14:40:26 <smooge> .... so much sausage making ....
14:40:31 <tflink> it's used for abidiff
14:41:03 <cverna> I think the plan was to move it to bodhi because bodhi was the only consumer of critpath tho
14:41:13 <nirik> well, I guess we will need to sort that out then before anything else.
14:41:29 <nirik> which I guess we can do out of meeting.
14:41:55 <smooge> #info currently pkgdb serves gnome-software and taskotron.
14:42:03 <nirik> yeah, there is a update-critpath that loads to pdc
14:42:05 <smooge> #info and maybe soemthing else
14:42:06 <cverna> yes I need to tell vgolwala to hold on, because he was about to start looking at implementing it in bodhi
14:42:18 <relrod> I'm happy to take on the gnome-software static JSON script, but not sure where to get the data for it from yet...
14:43:18 <nirik> relrod: it's this: https://admin.fedoraproject.org/pkgdb/api/collections
14:44:01 <nirik> cverna: would bodhi have a api to expose it to others?
14:44:05 <vgolwala> cverna: okay, skipping that for now then!
14:44:38 <smooge> can we discuss this out of meeting?
14:44:47 <cverna> sure
14:44:48 <relrod> +1
14:45:05 <nirik> thanks everyone. Glad I brought it up. ;)
14:45:17 <smooge> #topic bugzilla5 in September - aikidouke
14:45:18 <smooge> #info https://pagure.io/fedora-infrastructure/issue/7028
14:45:51 <aikidouke> thx smooge - actually looked at the ticket and nirik and threebean have already had some discussions
14:46:14 <aikidouke> do either of you want to say a bit about it? or is this an off-meeting longer discussion?
14:46:31 <nirik> yeah... just waiting for more details. Hopefully we can handle it as we know.
14:46:43 * aikidouke nods
14:46:50 <threebean> yeah,
14:47:19 <aikidouke> well apprentices, qa folks, or whomever may want to test bugzilla5 - there is a test instance
14:47:38 <smooge> thanks for bringing it up aikidouke
14:47:47 <smooge> these major changes usually require a lot of work
14:48:25 <aikidouke> http://bugzilla5.redhat.com
14:48:40 <aikidouke> :) good to move on?
14:48:50 <smooge> #topic Tickets discussion
14:48:50 <smooge> #info https://pagure.io/fedora-infrastructure/report/Meetings%20ticket
14:49:59 <nirik> lets go thru each? or we are low on time, want to do just one or two?
14:50:17 <smooge> .ticket 6470
14:50:23 <zodbot> smooge: Issue #6470: Regenerate infra dist-repos regularly - fedora-infrastructure - Pagure - https://pagure.io/fedora-infrastructure/issue/6470
14:50:36 <nirik> so this keeps hitting us...
14:50:46 <nirik> I think mizdebsk had some possible solutions in ticket.
14:50:47 <puiterwijk> Why is this marked as meeting? We have a solution, just need to request releng to make it so
14:50:51 <mizdebsk> solution for this is pretty simple
14:51:07 <mizdebsk> either proper one (upstream), or workaround (changing tag structure)
14:51:10 <nirik> puiterwijk: well, unclear if there was desire to do something else or what... ie, whats the next step
14:51:24 <nirik> if it's releng, lets file there. ;)
14:51:26 <puiterwijk> nirik: the last comment is you agreeing with me + mizdebsk on a solution?
14:51:47 <puiterwijk> So someone just needs to create the tags and swap things around...
14:51:49 <nirik> ha. indeed
14:51:59 <puiterwijk> Thus my confusion :)
14:52:01 * mizdebsk would do it but has no admin permission in koji
14:52:15 <puiterwijk> Give me a few minutes and I'll have it done...
14:52:28 <nirik> ok, perhaps I confused this with another similar ticket or something. :) sorry
14:52:41 <nirik> cool. Would be nice to have fixed.
14:52:46 <smooge> #info ticket 6470 will be done after this meeting
14:52:58 * mboddu looking at the ticket
14:52:59 <smooge> .ticket 6459
14:53:05 <zodbot> smooge: Issue #6459: [RFR] transtats - fedora-infrastructure - Pagure - https://pagure.io/fedora-infrastructure/issue/6459
14:53:10 <suanand> this should be just a few edits in YMLs and build + deploy
14:54:05 <smooge> which yamls?
14:54:11 <suanand> we tried deploying it, and come up with this: https://github.com/transtats/transtats/tree/devel/deploy/openshift
14:54:39 <suanand> YMLs which are here: https://infrastructure.fedoraproject.org/cgit/ansible.git/tree/roles/openshift-apps/transtats/files
14:54:58 <nirik> ah yeah.
14:55:09 <suanand> both have similar structure now :)
14:55:26 <nirik> suanand: when might be a good time you are around we can try it and discuss with you? I think just no one has had time...
14:55:52 <suanand> early next week: monday, tue?
14:56:21 <smooge> what time utc wise?
14:56:24 <nirik> I can try and work on it tuesday... how about 18UTC in our office hours? or is that too late?
14:56:25 <suanand> i will be here, happy to have a ping
14:56:29 <suanand> i am in IST
14:57:00 <suanand> ah, okay
14:57:15 <suanand> no problem, I will be available
14:57:38 <smooge> ok cool
14:57:48 <nirik> great.
14:58:05 <suanand> thanks nirik, smooge :)
14:58:10 <smooge> #info ticket 6459 will be worked on next tuesday by nirik and suanand
14:58:25 <smooge> .ticket 5316
14:58:27 <zodbot> smooge: Issue #5316: New package review tickets page - RFE for filter - fedora-infrastructure - Pagure - https://pagure.io/fedora-infrastructure/issue/5316
14:59:02 <smooge> .ticket 5315
14:59:05 <zodbot> smooge: Issue #5315: New package review tickets page - RFE for ON_QA - fedora-infrastructure - Pagure - https://pagure.io/fedora-infrastructure/issue/5315
14:59:17 <nirik> so this is a request to update our reviewstatus pages with some new functionality.
14:59:17 <smooge> these seem related?
14:59:23 <nirik> yep.. very similar
14:59:50 <nirik> great ones for new folks ^ :)
15:00:36 <nirik> Not sure what else to say... just needs someone to work on them, and they should be pretty easy.
15:00:42 <nirik> happy to help out with pointers
15:00:51 <nirik> and our time is up. ;)
15:00:52 <smooge> ok any apprentices please look at those tickets and we can talk about them on office hours on Tuesday
15:01:11 <smooge> #topic Open Floor
15:01:20 <puiterwijk> #info ticket #6470 should now be finished
15:01:26 <smooge> thank you all for coming to todays meeting
15:01:30 <smooge> thank you puiterwijk
15:01:33 * tflink has one question for open floor
15:01:33 <clime> thank you!
15:01:36 <cverna> thanks smooge
15:01:41 <smooge> tflink, ok
15:02:02 <nirik> puiterwijk: thanks much!
15:02:06 <mboddu> thanks smooge
15:02:10 <tflink> is there enough information to figure out re-imaging the taskotron bare-metal hosts while I'm not around?
15:02:28 <mboddu> puiterwijk: Thanks, once the PR is in for branching script, I will review and merge it
15:03:44 <smooge> tflink, the infra-docs says the file was last changed in 2014?
15:04:09 <smooge> should we do a reimage before you leave on PTO?
15:04:19 <smooge> and when do you go again?
15:04:38 <tflink> kparal and frantisekz can handle most of it, just not the things like changing kickstarts and doing the initial reimage of the baremetal boxen
15:04:58 <tflink> the bare metal machines are just fedora virthosts
15:05:25 <tflink> the taskotron master has a custom kickstart but that should be as easy as changing the release number - it's mostly custom disk layout
15:05:41 <tflink> I start my leave on monday
15:06:00 * tflink doesn't remember off the top of his head what release the bare metal machines are at right now
15:06:30 <smooge> ok is there one we can redo on Friday?
15:06:41 <tflink> they're F27 right now
15:06:45 <smooge> and my apologies if someone else has a meeting scheduled here
15:06:58 <nirik> yeah, they should be 27...
15:06:59 <tflink> we can take it to admin, doesn't need to be in meeting
15:07:08 <smooge> tflink, let us do it in #admin
15:07:09 <smooge> thanks
15:07:20 <smooge> Thank you all again.. and say good night tflink
15:07:28 <tflink> good night
15:07:29 <puiterwijk> good night tflink
15:07:29 <smooge> #endmeeting