15:00:32 <siddharthvipul> #startmeeting Infrastructure (2020-07-23)
15:00:32 <zodbot> Meeting started Thu Jul 30 15:00:32 2020 UTC.
15:00:32 <zodbot> This meeting is logged and archived in a public location.
15:00:32 <zodbot> The chair is siddharthvipul. Information about MeetBot at http://wiki.debian.org/MeetBot.
15:00:32 <zodbot> Useful Commands: #action #agreed #halp #info #idea #link #topic.
15:00:32 <zodbot> The meeting name has been set to 'infrastructure_(2020-07-23)'
15:00:32 <siddharthvipul> #meetingname infrastructure
15:00:32 <zodbot> The meeting name has been set to 'infrastructure'
15:00:32 <siddharthvipul> #chair nirik pingou smooge cverna mizdebsk mkonecny abompard siddharthvipul mobrien
15:00:32 <siddharthvipul> #info Agenda is at: https://board.net/p/fedora-infra
15:00:32 <siddharthvipul> #info About our team: https://docs.fedoraproject.org/en-US/cpe/
15:00:32 <zodbot> Current chairs: abompard cverna mizdebsk mkonecny mobrien nirik pingou siddharthvipul smooge
15:00:33 <siddharthvipul> #topic aloha
15:00:53 <nirik> morning
15:01:08 <siddharthvipul> good morning ^^
15:01:16 <pingou> ó/ folks
15:01:21 <siddharthvipul> Mohan had other commitments that he couldn't skip
15:01:27 <siddharthvipul> so I am replacing him for the meeting
15:01:29 <mobrien[m]> hi all
15:01:33 <gchang> hi!
15:02:00 <siddharthvipul> gchang: hey, welcome!
15:03:02 <siddharthvipul> let's wait 1 more minute for more people to join and then we can move ahead with the agenda
15:03:13 <darknao> .hello
15:03:13 <zodbot> darknao: (hello <an alias, 1 argument>) -- Alias for "hellomynameis $1".
15:03:27 <darknao> .hello darknao
15:03:28 <zodbot> darknao: darknao 'Francois Andrieu' <naolwen@gmail.com>
15:03:37 <siddharthvipul> darknao: \o
15:03:52 <siddharthvipul> #topic New folks introductions
15:03:52 <siddharthvipul> #info This is a place where people who are interested in Fedora Infrastructure can introduce themselves
15:03:52 <siddharthvipul> #info Getting Started Guide: https://fedoraproject.org/wiki/Infrastructure/GettingStarted
15:04:18 <siddharthvipul> do we have any new members here who would like to introduce themselves?
15:07:01 <siddharthvipul> gchang: hey, are you around?
15:07:58 <gchang> yup! i introduced myself a few meetings ago haha
15:08:15 <siddharthvipul> nirik: gchang is interested in working with Fedora Infrastructure! Mohan and I had a call yesterday around this. Can we have them be blessed in apprentice group
15:08:25 <siddharthvipul> gchang: oops, must have missed it.. apologies :)
15:08:31 <gchang> no worries!
15:09:09 <nirik> sure... whats your fas login gchang ? also gchang ?
15:09:55 <gchang> yup!
15:11:09 <nirik> done. will take a bit to sync out.
15:11:19 <siddharthvipul> #topic Next chair
15:11:19 <siddharthvipul> #info magic eight ball says:
15:11:19 <siddharthvipul> #info 2020-08-06 - mobrien[m]
15:11:25 <siddharthvipul> oh, nirik, thank you :)
15:11:37 <siddharthvipul> any volunteers for 2020-08-13?
15:12:12 <mkonecny> siddharthvipul: I could take it
15:12:16 <siddharthvipul> mkonecny: sold!
15:12:26 <siddharthvipul> #info 2020-08-13 - mkonecny
15:13:20 <siddharthvipul> #topic announcements and information
15:13:20 <siddharthvipul> #info CPE Sustaining EU-hours team has a Monday through Friday 30 minute meeting going through tickets at 0830 UTC in #centos-meeting
15:13:21 <siddharthvipul> #info CPE Sustaining NA-hours team has a Monday through Friday 30 minute meeting going through tickets at 1800 UTC in #fedora-admin
15:13:21 <siddharthvipul> #info Fedora Infrastructure will be moving in 2020-06 from its Phoenix Az datacenter to one near Herndon Va. A lot of planning will be involved on this. Please watch out for announcements on changes.
15:13:22 <siddharthvipul> #info Fedora Communishift move has started but will take longer than expected. Current estimate for bringing back into production is TBD
15:13:25 <siddharthvipul> #info https://fedoraproject.org/wiki/Infrastructure/2020-post-datacenter-move-known-issues has a list of known items from post datacenter move
15:13:28 <siddharthvipul> #info CFP for Nest with Fedora is now officially open! https://communityblog.fedoraproject.org/nest-with-fedora-cfp-open/
15:14:27 <pingou> registration as well
15:14:33 <mobrien[m]> https://hopin.to/events/nest-with-fedora
15:14:37 <siddharthvipul> right! let me fetch the link
15:14:41 <pingou> #info Registration for nest open: https://hopin.to/events/nest-with-fedora
15:14:47 <siddharthvipul> pingou: Merci :)
15:15:22 <mkonecny> will we be automatically registered if your talk is accepted?
15:15:37 <nirik> yeah, hopefully some nice talks... although I might not catch the early part of the day ones.
15:15:49 <siddharthvipul> mkonecny: I don't think so (but also not sure).. register anyway for safety
15:16:06 <mkonecny> siddharthvipul: Ok, thanks
15:16:34 <siddharthvipul> do we have any other announcement? I feel like I am wrapping meeting too soon :P
15:17:03 <siddharthvipul> but well, if I do a poor job, it will be on mboddu right? since I am just a proxy
15:17:14 <nirik> ha. :)
15:17:29 <siddharthvipul> #topic Oncall
15:17:29 <siddharthvipul> #info https://fedoraproject.org/wiki/Infrastructure/Oncall
15:17:53 <siddharthvipul> #info mboddu is oncall for 2020-07-23 -> 2020-07-30
15:17:54 <siddharthvipul> #info mobrien[m] is oncall for 2020-07-30 to 2020-08-06
15:18:46 <siddharthvipul> volunteer needed for 2020-08-06 to 2020-08-13
15:18:50 <siddharthvipul> anyone? :)
15:19:17 <mkonecny> siddharthvipul: I can take it
15:19:24 <mobrien[m]> I'm also open to swapping this week if it suits someone better
15:19:27 <siddharthvipul> mkonecny: :fire: :fire: :)
15:20:29 <siddharthvipul> mobrien[m]: do you mind continuing this week?
15:20:46 <siddharthvipul> if you have something else pressing, mkonecny do you mind swapping? :)
15:21:12 <mkonecny> I would prefer the week from 2020-08-06
15:21:34 <mobrien[m]> Either week is good with me. I just put the offer out
15:21:45 <mobrien[m]> I can try take it now
15:21:48 <siddharthvipul> mobrien[m]: ah, then let's continue with the plan :)
15:21:50 <siddharthvipul> #info is mkonecny oncall for 2020-08-06 to 2020-08-13
15:21:59 <siddharthvipul> mobrien[m]: please go ahead and do the job :D
15:22:03 <mobrien[m]> .oncalltakeeu
15:22:03 <zodbot> mobrien[m]: Error: You don't have the alias.add capability. If you think that you should have this capability, be sure that you are identified before trying again. The 'whoami' command can tell you if you're identified.
15:22:19 <mobrien[m]> .whoami
15:22:19 <siddharthvipul> mobrien[m]: we can retry it once you have verified with zodbot
15:22:21 <zodbot> mobrien[m]: I don't recognize you. You can message me either of these two commands: "user identify <username> <password>" to log in or "user register <username> <password>" to register.
15:22:32 <siddharthvipul> #info Summary of last week: (from current oncall )
15:23:07 <siddharthvipul> mboddu was on call this week, he informed me the things he wanted to highlight before going away
15:23:23 <siddharthvipul> 1. Someone not able to login into bz - https://pagure.io/fedora-infrastructure/issue/9175
15:23:40 <siddharthvipul> meetbot.fp.o was not accessible, but it happened to only the reporter and got fixed by itself
15:23:45 <siddharthvipul> 2.^
15:24:08 <siddharthvipul> and that's about it.. nothing urgent fire noticed from what I understand
15:24:14 <nirik> cool
15:24:51 <siddharthvipul> #info 1 ticket filed, 1 auto fixed (unreproducable) ping
15:24:57 <siddharthvipul> #topic Monitoring discussion [nirik]
15:24:57 <siddharthvipul> #info https://nagios.fedoraproject.org/nagios
15:26:34 <siddharthvipul> nirik: do we have anything to highlight?
15:27:01 <nirik> let me see...
15:27:30 <nirik> I think things are pretty much the same as last week.. no one has had time to try and clean things up more.
15:28:31 <nirik> so, lets skip and move on today
15:29:15 <siddharthvipul> alright :)
15:29:17 <siddharthvipul> #topic Data-Center Move update
15:29:54 <siddharthvipul> nirik: smooge: any updates here needed?
15:30:44 <pingou> we have a few machines left to rebuilt
15:30:49 <pingou> then it's about bringing up the apps
15:31:14 <pingou> but we want to deploy noggin in staging, for that we need openshift which itself is currently blocked by a networking issue
15:31:24 <nirik> yep. thats about the size of it.
15:31:36 <siddharthvipul> pingou: thank you for taking it ^^
15:31:56 <siddharthvipul> since we don't have a topic in agenda to learn this week, I am jumping to open floor
15:31:57 <siddharthvipul> #topic Open Floor
15:31:59 <pingou> and once we have noggin up, we'll be able to a) port the servers to it (manage accounts locally & co) as well as start porting the apps)
15:32:41 <siddharthvipul> oops, too soon
15:33:06 <pingou> so we can't quite start on other apps such as dist-git or koji because the questions on: "how do we manage who has access to the host and how they can log in" need noggin to be solved
15:33:16 <pingou> eol
15:33:52 <nirik> yep.
15:35:38 <amoloney> nirik: have you a *rough* guestimate on when Noggin will be ready to be installed in stg? It needs a security audit and I want to try get that scheduled with Patrick before then
15:36:33 <nirik> not really, since I am blocked on installing openshift... so that needs unblocked, then I need to get openshift installed (a day or so) and then noggin team needs to deploy it...
15:37:04 <nirik> best case; early next week, worst case late next week/week after?
15:37:14 <amoloney> I see...
15:37:24 <amoloney> anything I can do to help the openshift blocker?
15:37:34 <amoloney> Im ok to shout at people if I need to :)
15:38:26 <amoloney> and those dates are what I was guestimating earlier anyway (in my head) so I can adjust the project dates to reflect this
15:38:27 <nirik> if it's still blocked after today yeah, we can start yelling
15:38:37 <amoloney> and its helpful to know the sequence of blockers :)
15:38:47 <pingou> nirik: btw, siddharthvipul  and Saffronique|w have quite a bit of experience installing openshift these days ;-)
15:38:50 <smooge> currently the person who can make the changes is stuck with a bunch of other fires
15:39:04 <smooge> they will be working on it this afternoon at the earliest
15:39:12 <pingou> I've heard they've lost count of how many instances they've deployed :D
15:39:23 <amoloney> yeah Id rather not shout at the fireman....
15:39:27 <mkonecny> Do we want to deploy OpenShift 4?
15:39:29 <mobrien[m]> * mobrien would like to be a fly on the wall for openshift install if possible
15:39:36 <nirik> pingou: well, I definitely want to pick their brains on OCP4 installs, but for now, I figured we would just install 3.11 like we had before
15:39:37 <siddharthvipul> pingou: I was almost done typing and then removed. yes! Saffronique|w and (very little me) have some experience
15:40:03 <nirik> well, we could, but I think it would delay things... and it's somethign we could look at later.
15:40:11 <pingou> nirik: to avoid the too many moving pieces?
15:40:30 <mkonecny> siddharthvipul: I thought you also documented the process
15:40:38 <siddharthvipul> mkonecny: we did :)
15:40:41 <nirik> yes, and the 'adjust completely new install to our deployment methods'
15:40:56 <Saffronique|w> https://github.com/centosci/ocp4-docs/tree/master/sops/installation mkonecny
15:40:56 <siddharthvipul> mkonecny: https://centosci.github.io/ocp4-docs/
15:40:57 <nirik> I'd love to read docs? pointers?
15:41:03 <siddharthvipul> nirik: https://centosci.github.io/ocp4-docs/
15:41:09 <nirik> cool
15:41:17 <nirik> this is on bare metal or vms?
15:41:21 <Saffronique|w> bare metal
15:41:24 <siddharthvipul> bare-metal
15:41:51 <nirik> yeah, so... we might be able to scrape up enough bare metal, but will need to adjust vlans and install machines and such...
15:41:51 <pingou> teamwork++
15:42:01 <nirik> but we can install 3.11 on vm's today
15:42:15 * defolos expects zodbot giving a cookie to a sneaky user calling themselves teamwork
15:42:35 <pingou> .karma c
15:42:36 <zodbot> pingou: Karma for c has been increased 0 times and decreased 0 times this release cycle for a total of 0 (0 all time)
15:42:43 <pingou> come on c++
15:43:11 <nirik> we likely do not have enough hardware for both stg and prod clusters on bare metal
15:43:13 <pingou> nirik: I agree w/ the not too many moving pieces at one
15:45:14 <nirik> but I would like to move prod to 4.x...
15:45:29 <nirik> but then stg is different. so dunno. we can ponder on it.
15:45:47 <pingou> +1
15:46:46 <nirik> but perhaps we just put prod and stg in the same cluster with different egress rules. lots of possible options.
15:48:57 <mobrein[m]> .oncalltakeeu
15:48:57 <zodbot> mobrein[m]: Error: You don't have the alias.add capability. If you think that you should have this capability, be sure that you are identified before trying again. The 'whoami' command can tell you if you're identified.
15:49:07 <nirik> I can add the capability...
15:49:16 <mobrein[m]> thanks
15:49:55 <nirik> if I can recall how. ;)
15:52:17 <nirik> did you register with it?
15:52:33 <nirik> you need to register an account on it and then I can add the perm. ;)
15:52:40 <nirik> we can do this out of meeting tho.
15:53:49 <mobrein[m]> Lets look once the meeting is over
15:54:27 <darknao> I'll be really interested by taking part of this ocp4 install when the time comes, and if that's possible
15:54:52 <nirik> sure!
15:55:24 <nirik> it's kinda scary how automated things are... you just have to set things up and... whoosh, away it goes. ;)
15:55:48 <darknao> i've already deployed a few instances myself at $dayjob, but it should be interesting to see how it is set up here
15:59:13 <siddharthvipul> awesome.. I will end the meeting in 1 minute :)
16:00:34 <siddharthvipul> #endmeeting