18:00:34 <nirik> #startmeeting Infrastructure (2015-11-12)
18:00:34 <zodbot> Meeting started Thu Nov 12 18:00:34 2015 UTC.  The chair is nirik. Information about MeetBot at http://wiki.debian.org/MeetBot.
18:00:34 <zodbot> Useful Commands: #action #agreed #halp #info #idea #link #topic.
18:00:34 <nirik> #meetingname infrastructure
18:00:34 <nirik> #topic aloha
18:00:34 <nirik> #chair smooge relrod nirik abadger1999 lmacken dgilmore mdomsch threebean pingou puiterwijk pbrobinson
18:00:34 <zodbot> The meeting name has been set to 'infrastructure'
18:00:34 <zodbot> Current chairs: abadger1999 dgilmore lmacken mdomsch nirik pbrobinson pingou puiterwijk relrod smooge threebean
18:00:35 <nirik> #topic New folks introductions / Apprentice feedback
18:01:02 * threebean is here
18:01:10 * dotEast2015 here
18:01:10 <smdeep> .hellomynameis smdeep
18:01:11 <zodbot> smdeep: smdeep 'Sudeep Mukherjee' <smdeep@gmail.com>
18:01:16 * aikidouke present
18:01:42 <nirik> morning everyone
18:01:52 <smdeep> morning
18:02:00 <pcreech|work> morning
18:02:20 <nirik> any new folks like to introduce themselves? or apprentices with questions or comments?
18:02:30 <d3prof3t> hi guys
18:02:40 <cortopy> Hi there, first meeting here
18:03:02 <smdeep> nirik, I am an apprentice and I would like to start in earnest from next week
18:03:11 <smdeep> Been a festival season here in India
18:03:16 <smdeep> this
18:03:18 <smdeep> week
18:03:24 <nirik> cool. ;) no problems...
18:03:26 <aikidouke> happy diwali
18:03:30 <nirik> welcom cortopy
18:03:38 <smdeep> :)
18:03:49 <cortopy> I sent an email this week to the mailing list introducing myself
18:04:00 <cortopy> not sure what the dynamic is, should I say a few lines about me?
18:04:53 <nirik> sure, please do. ;)
18:05:11 <nirik> and let us know if you are more interested in sysadmin work or application development type stuff.... or both!
18:05:22 <cortopy> Ok, I'm Juan from London
18:05:40 <cortopy> I was thinking about starting with something small like ansible
18:05:59 <cortopy> I read about the meeting next week, and thought it'd be a great starting point
18:06:09 <smdeep> cortopy, would love to learn with you
18:06:11 <cortopy> sysadmin would be great
18:06:22 <cortopy> server setups, mnitoring,etc.
18:06:24 <nirik> yeah, we are having a apprentice work day next wed... hopefully we can help folks get involved there.
18:06:45 <cortopy> also interested in app development, but not sure what languages are used by the Fedora project
18:06:59 <cortopy> I can write Python, JS, and basic bash
18:07:19 <nirik> most of our stuff is using python... with flask and pyrimid.
18:07:55 <nirik> anyhow, see me after the meeting over in #fedora-admin and I can get you started in the apprentice group. ;)
18:08:00 <cortopy> I kind of gathered that's the case by reading the discussions in the mailing list
18:08:12 <cortopy> Ok, that's great. Thanks nirik
18:08:14 <nirik> any other new folks like to introduce themselves? or questions?
18:08:17 * kushal is here
18:08:37 <djb_> hello
18:08:51 <d3prof3t> looking forward to the apprentice day :)
18:09:11 <smdeep> d3prof3t, same here
18:09:15 <djb_> is there a certain format that is followed for intros?
18:09:33 <d3prof3t> smdeep, cool
18:09:40 <nirik> djb_: just a line or two about yourself and what your interests are.
18:11:35 <djb_> ok, I work as a network admin, been using fedora off and on since fedora core 5 along other distros. My interests are systems and programming though, I have very little expereince in the latter other than tinkering and do messing around with my raspberrys
18:12:00 <nirik> cool. Are you more interested in the sysadmin side of things then? or application development?
18:14:21 <nirik> ok, lets move on to status and info...
18:14:25 <nirik> #topic announcements and information
18:14:25 <nirik> #info Setup ticket for phx2 site visit in jan: https://fedorahosted.org/fedora-infrastructure/ticket/4948
18:14:25 <nirik> #info Setup ticket for re-arranging networks: https://fedorahosted.org/fedora-infrastructure/ticket/4949
18:14:25 <nirik> #info Have done some ansible 2.0 testing and upstream has been fixing issues - kevin
18:14:28 <nirik> #info Got reproducer for sigul batch signing issues and updated bug - kevin
18:14:28 * relrod here late -- sorry :(
18:14:30 <nirik> #info arm02/arm04/buildvm's all re-installed as Fedora 23 - kevin
18:14:36 <nirik> anything else anyone would like to note or discuss from there?
18:14:40 <nirik> welcome relrod
18:15:59 <djb_> more of the sys admin side but I'd like to be involved with code too
18:16:05 <threebean> did mdapi get deployed?
18:16:33 <nirik> threebean: I think so in stg at least, but not sure.
18:16:37 <threebean> cool :)
18:16:40 * mirek-hm is here
18:16:56 <nirik> There's some old tickets to discuss in the discussion section.
18:17:02 <threebean> yeah!
18:17:03 <nirik> welcome threebean, mirek-hm.
18:17:04 <threebean> https://apps.stg.fedoraproject.org/mdapi
18:17:26 <aikidouke> should I jump in here?
18:17:33 <nirik> #topic discussion - old tickets
18:17:46 <nirik> aikidouke: sure, if you want to run this section, fine by me. ;)
18:17:58 <aikidouke> :) keep me on track please
18:17:59 <nirik> #chair aikidouke
18:17:59 <zodbot> Current chairs: abadger1999 aikidouke dgilmore lmacken mdomsch nirik pbrobinson pingou puiterwijk relrod smooge threebean
18:18:03 <aikidouke> .ticket 1055
18:18:04 <zodbot> aikidouke: #1055 (Fedora Search Engine) – Fedora Infrastructure - https://fedorahosted.org/fedora-infrastructure/ticket/1055
18:18:12 <nirik> yeah, so this is still out there...
18:18:23 <nirik> but it's a ton of work and the last people working on it seem to have moved on.
18:18:46 <aikidouke> right - that is kind of what I thought - is anyone working on replacing mediawiki still?
18:19:01 <nirik> no? that was never planned that I know of
18:19:26 <aikidouke> ok...I'm making that up then...so verdict on this? would we cancel or close it?
18:19:28 <nirik> The wiki search is horrible, so it's something that could be replaced by an external search product.
18:19:51 <nirik> well, I guess we could close it and reopen someday if someone else wants to try again.
18:20:05 <aikidouke> should we put that to a vote?
18:20:23 * kushal wants to write a search engine :)
18:20:28 <kushal> someday :D
18:20:43 <nirik> I don't think there's a need to do that... does anyone disagree?
18:21:19 <aikidouke> I do not disagree - just wanted to discuss...going once on disagreements?
18:21:21 <nirik> lets close it with a 'file new ticket or reopen if someone wants to move this forward again'
18:21:28 <relrod> +1 to close. Current FOSS search engine options are... lacking, at best
18:21:50 <aikidouke> anyone else?
18:22:11 <kushal> +1 to close.
18:22:30 <aikidouke> ok - I will close that with 'file new ticket or reopen' if I can
18:22:42 <aikidouke> next up - Fedora elections infra license
18:22:44 <aikidouke> .ticket 1510
18:22:46 <zodbot> aikidouke: #1510 (Status of converting Elections to conform with Infrastructure Licensing) – Fedora Infrastructure - https://fedorahosted.org/fedora-infrastructure/ticket/1510
18:23:23 <nirik> nb was working on that.
18:23:27 * nirik re-reads tho
18:23:31 <aikidouke> 7 months ago pingou asked if this was still needed b/c the elections process had changed since the original request
18:24:22 <nirik> yeah, close.
18:24:25 <nirik> no longer needed.
18:24:30 <nirik> new elections is GPLv2
18:24:44 <kushal> close it with a comment then.
18:24:50 <aikidouke> great
18:25:09 * nirik nods.
18:25:26 <aikidouke> .ticket 3525
18:25:27 <zodbot> aikidouke: #3525 (New mediawiki redirect behaviour is annoying) – Fedora Infrastructure - https://fedorahosted.org/fedora-infrastructure/ticket/3525
18:25:41 <aikidouke> so this hasnt been touched in two + years
18:25:54 <aikidouke> one user did not like the redirect behavior?
18:26:15 <nirik> yeah, I think there was thought about fixing it or chaning it or adding a pref, but that never got done.
18:26:28 <smooge> close
18:26:36 <aikidouke> anyone disagree?
18:27:01 <nirik> I could see close or ask in ticket if anyone is still planning anything here, and close in a week if no answer.
18:27:01 <aikidouke> moving on then
18:27:16 <nirik> close is fine, someone can reopen if they plan to work on it.
18:27:23 <aikidouke> .ticket 4458
18:27:25 <zodbot> aikidouke: #4458 (downloads from fedoraproject.org are slow) – Fedora Infrastructure - https://fedorahosted.org/fedora-infrastructure/ticket/4458
18:27:38 <nirik> I'd like to ping folks again on this and see if anyone is still seeing it.
18:27:49 <nirik> Even if they are I suspect there's not much we can do.
18:28:00 <aikidouke> ok sounds good - should i post a comment in ticket?
18:28:54 <nirik> I can.
18:29:02 <aikidouke> ok - good deal
18:29:10 <aikidouke> thats all I had for old tickets
18:29:19 <smooge> cool thanks
18:29:26 <aikidouke> ty
18:29:28 <dotEast2015> aikidouke, thanks
18:29:53 <nirik> thanks aikidouke. :)
18:30:02 <aikidouke> :) happy to do it
18:30:19 <pingou> aikidouke++ for cleaning up old tickets!
18:30:20 <zodbot> pingou: Karma for aikidouke changed to 2 (for the f23 release cycle):  https://badges.fedoraproject.org/tags/cookie/any
18:30:22 <nirik> we will get down to 0 in no time. ;)
18:30:28 <nirik> pingou: you ready to talk about mdapi?
18:30:34 <pingou> nirik: sure am
18:30:36 <nirik> https://fedoraproject.org/wiki/Infrastructure/GettingStarted
18:30:42 <nirik> sigh. wayland.
18:30:49 <nirik> #topic Learn about: mdapi - pingou
18:30:55 <nirik> take it away pingou
18:31:05 <pingou> so mdapi for MetaData API
18:31:28 <pingou> it lives at: https://apps.stg.fedoraproject.org/mdapi/ for in staging instance and http://209.132.184.236/ for its dev instance
18:31:57 <pingou> basically, the idea is to serve as quickly as possible information stored in the metadata of the yum repositories we have
18:32:13 <pingou> there are basically 3 sqlite DBs in the yum repo metadata
18:32:37 <pingou> the main one, that will serve info such as package, version, release, epoch, source package and so on
18:32:43 <pingou> this is what https://apps.stg.fedoraproject.org/mdapi/rawhide/pkg/kernel uses
18:32:43 <smooge> .nsg zodbot aikidouke++
18:33:06 <smooge> needs to leanr to type
18:33:07 <pingou> the second is the filelists db
18:33:24 <pingou> as the name says it provides the list of all the files in every packages
18:33:34 <pingou> so that you can do things like yum/dnf install /usr/bin/ansible
18:33:47 <pingou> for example https://apps.stg.fedoraproject.org/mdapi/rawhide/files/guake
18:33:54 <pingou> finaly, there is the other db
18:33:59 <nirik> so this is to be used by things that don't want to use dnf api or such overhead? or?
18:34:09 <pingou> that containts, amon other the changelog, used at: https://apps.stg.fedoraproject.org/mdapi/rawhide/changelog/kernel
18:34:16 <pingou> nirik: yes
18:34:38 <pingou> it should be snappier than using dnf's api as there is no download of the cache involved
18:34:51 <pingou> but relies on network
18:35:04 <pingou> so there are cases where it might be slower I guess
18:35:26 <pingou> currently when you ask for a package it looks at: updates-testing, updates, release
18:35:28 <threebean> you can ask it to give you the info for just one package, instead of having to download the dbs containing all the info for all the packages, and extracting that yourself.
18:35:30 <pingou> for a given branch
18:35:39 <pingou> (branches being listed at: https://apps.stg.fedoraproject.org/mdapi/branches )
18:35:59 <pingou> I have been doing the fun part of the work, writing it :)
18:36:12 <pingou> threebean has been doing the more serious and tedious part: using it :)
18:36:15 <nirik> cool. what things do we have planned to use it? or ?
18:36:17 <threebean> :p
18:36:29 <pingou> fedora-packages  ( https://apps.fedoraproject.org/packages ) is being re-written to use it
18:36:53 <pingou> we still need to improve it to add element such as provides, excludes, requires & co
18:36:58 <nirik> nice.
18:37:04 <pingou> so we could also use it to build quickly dependency trees or so
18:37:18 <threebean> fedora-packages historically has suffered from locally caching and querying those sqlite dbs which it had a tendency to mis-use and corrupt.  now it can use mdapi to get the data in what feels like a more sane way.
18:37:23 * pingou has plans to play a little bit with it for this kinds of questions
18:37:45 <pingou> mdapi opens a single db session for every requests made
18:37:55 <nirik> so how does it update or how often/expensive is updating?
18:38:10 <pingou> but sqlite has been handling the load fine so far
18:38:21 <pingou> so the update of the metadata is done via a cron script
18:38:33 <pingou> running every 20 minutes (which is also the refresh time for koji's repo iirc)
18:38:41 <pingou> and icing on the cake
18:38:58 <pingou> this cron publishes a fedmsg message announcing what changes in the databases :)
18:39:02 <threebean> example message:  https://apps.stg.fedoraproject.org/datagrepper/id?id=2015-513db0b1-e190-414c-9f21-ba69e97a73cb&is_raw=true&size=extra-large
18:39:07 <pingou> (all thanks to threebean awesomness)
18:39:27 <pingou> so fedora-packages can do smart cache invalidation upon seeing these messages
18:39:45 <pingou> (no changes in F23: keep the old info, changes in rawhide: update)
18:40:13 <pingou> threebean: awesome, I had not seen mdapi was plugged in already :)
18:40:27 * nirik thinks everyone clicked on that. waiting for answer. ;)
18:40:45 * dotEast2015 :)
18:42:56 <pingou> I think we covered most of it
18:42:59 <pingou> it's all in python3
18:43:11 <nirik> cool. I think this is something that we will find more uses for as we think of them over time. :)
18:43:13 <pingou> uses aiohttp which is a small web framework on the top of asyncio
18:43:14 <nirik> could be quite handy
18:43:33 <pingou> yes, I think we can make use of it :)
18:44:02 <nirik> I wonder... was looking at repo2json eariler... If we couldn't do this for our rhel repos too. Might be too much information tho... dunno.
18:44:39 <pingou> nirik: yeah, I'd love to, maybe we could ask
18:45:39 <nirik> sure, just a thought.
18:45:54 <nirik> ok, any other questions for pingou ?
18:46:17 <pingou> oh and finally we deployed it as systemd service using the web-server in aiohttp
18:46:21 <pingou> w/o proxy in front
18:46:26 <pingou> we'll see how that goes
18:46:39 <nirik> yep. always easy to adjust as we go.
18:46:53 <kushal> pingou +1 :)
18:46:55 <nirik> thanks pingou!
18:47:00 <nirik> #topic Open Floor
18:47:03 <pingou> welcome :)
18:47:13 <nirik> anyone have anything for open floor? questions, comments, favorate type of coffee?
18:47:22 <kushal> nirik, so I though I can talk here before replying to the list.
18:47:22 <pingou> earl-grey?
18:47:33 * smdeep prefers Arabic coffee
18:47:43 <aikidouke> hot, black, and plentiful
18:47:44 <smdeep> Darjeeling tea
18:47:50 <nirik> reminder: we will be having a apprentice work day next wed in #fedora-admin... come if you can and we will try and help onramp folks and get them working on fun things.
18:47:58 <smdeep> Green is my latest passion for tea
18:48:12 <kushal> nirik, Yes, we need mostly add new new images, and then run instances for short life time, for testing or writing more test cases.
18:48:14 <smdeep> Sure nirik
18:48:22 <kushal> nirik, how to go ahead for this?
18:48:55 <nirik> kushal: well, how many folks are we talking about? will they change much? or just a constant group?
18:49:19 <nirik> if its changing often I would like to try and get the openid stuff in place.
18:49:31 <kushal> nirik, for starting around 4 people, (they will not change much), but in future may get more people.
18:49:53 <kushal> nirik, not changing often.
18:50:15 <nirik> we could just hard code those in for now... if you can file a ticket with the people's login names? they will need fas accounts with their ssh keys in there so we can upload them to openstack
18:50:28 <nirik> and should we just use the existing cloud-sig tenant? that would be easiest.
18:50:37 <kushal> nirik, Okay, sounds good to me.
18:50:49 <kushal> nirik, what is the amount of ram/cpu/instance for that tenant?
18:51:00 <nirik> not sure off hand, can look.
18:51:13 <kushal> nirik, you can tell me after meeting, thanks :)
18:51:20 <kushal> nirik, this is good enough to start with.
18:51:43 <kushal> nirik, btw, I will create a screencast about how to use the cloud, I hope that is okay?
18:51:56 <nirik> sure.
18:52:05 <nirik> yeah, we can also easily increase things if they hit limits.
18:52:16 <kushal> nirik, cool
18:52:17 <nirik> I wouldn't expect them to if it's just short term testing
18:52:24 <kushal> nirik, I also do not.
18:52:52 * nirik nods.
18:52:57 <nirik> ok, anything else for open floor?
18:53:03 <nirik> or shall we call it a meeting?
18:53:11 <smooge> call it
18:53:19 * dotEast2015 :)
18:53:23 * smooge gets his requesite 4 lines in a meeting
18:53:32 <aikidouke> thanks for organizing nirik
18:53:47 <nirik> no problem. Thanks for coming everyone!
18:53:50 <nirik> #endmeeting