14:43:28 <jbair> #startmeeting Fedora CI SIG
14:43:28 <zodbot> Meeting started Wed May 20 14:43:28 2020 UTC.
14:43:28 <zodbot> This meeting is logged and archived in a public location.
14:43:28 <zodbot> The chair is jbair. Information about MeetBot at http://wiki.debian.org/MeetBot.
14:43:28 <zodbot> Useful Commands: #action #agreed #halp #info #idea #link #topic.
14:43:28 <zodbot> The meeting name has been set to 'fedora_ci_sig'
14:43:34 <bookwar> while jbair is looking for right keywords
14:43:40 <jbair> exactly what I was doing
14:43:44 <jbair> I'll still probably get it wrong :)
14:44:09 <jbair> #topic Jenkins master
14:44:29 <bookwar> .hello2
14:44:30 <zodbot> bookwar: bookwar 'Aleksandra Fedorova' <alpha@bookwar.info>
14:44:31 <siddharthvipul> hey all, I am new here and looking forward to get involved deep in Fedora CI and help communication with CentOS CI side
14:44:37 <siddharthvipul> .hello siddharthvipul1
14:44:38 <zodbot> siddharthvipul: siddharthvipul1 'Vipul Siddharth' <siddharthvipul1@gmail.com>
14:44:38 <jbair> .hello2
14:44:40 <zodbot> jbair: Sorry, but you don't exist
14:44:41 <jbair> forgot about that one :)
14:44:46 <bookwar> siddharthvipul++
14:44:46 <zodbot> bookwar: Karma for siddharthvipul1 changed to 18 (for the current release cycle):  https://badges.fedoraproject.org/tags/cookie/any
14:44:50 <jimbair> .hello2
14:44:51 <zodbot> jimbair: jimbair 'Jim Bair' <jbair@redhat.com>
14:44:54 <jimbair> so pedantic, zod
14:44:57 <jimbair> anyway.
14:45:06 <bgoncalv> .hello2
14:45:07 <zodbot> bgoncalv: bgoncalv 'Bruno Goncalves' <bgoncalv@redhat.com>
14:46:32 <siddharthvipul> so here is the formal hello
14:46:38 <siddharthvipul> hello everyone :D
14:47:11 <bookwar> jimbair: so, talking about jenkins?
14:47:11 <jimbair> hi!
14:47:17 <siddharthvipul> hoping to help keeping CI happy, we have some things going on in CentOS CI Infra side and hopefully we will communicate with you all soon
14:47:19 <jimbair> I saw it as the first item, so yes :)
14:47:42 <bookwar> siddharthvipul: actuallu jenkins question goes to you
14:47:58 <siddharthvipul> wrong day to come I guess :P
14:48:03 <siddharthvipul> bookwar: sure, please ask
14:48:04 <bookwar> so is there a timeline for openshift 4 cluster? when it will be available?
14:48:14 <bookwar> i heard centos infra is going to have one
14:48:15 <siddharthvipul> right! so we have a cluster up and running
14:48:32 <siddharthvipul> there is some storage and jenkins cluster work going on
14:48:33 <bookwar> the new one?
14:48:37 <siddharthvipul> basically playing around with it
14:48:44 <siddharthvipul> bookwar: yes, 4.4.4 :)
14:48:58 <jimbair> oh wow, newer than 4.3 - is 4.4 the new stable openshift release?
14:49:19 <siddharthvipul> we updated it to 4.4.4 from 4.4.3 the day before yesterday
14:49:23 <siddharthvipul> so it's super new and shiny
14:49:44 <bookwar> can you host Fedora CI Jenkins there? do you want to administrate Jenkins master, or can you give us the access to the openshift project so we do the deployment ourselves?
14:50:36 <siddharthvipul> bookwar: the idea of that cluster is to move everything there and have better access control (as in giving it to folks easily) so I am interested in discussing which one works the best for you
14:51:10 <bstinson> we're happy to host Fedora CI Jenkins there, we'd like to hand out admin to this group on an openshift project so that this group controls its own destiny
14:51:14 <tflink> glad to hear the upgrade work is ongoing :)
14:51:22 <bookwar> siddharthvipul: i think we would prefer to build our setup, which will save time for both us
14:51:29 <bookwar> both our teams*
14:51:34 <siddharthvipul> bookwar: bookwar: right :D
14:51:38 <siddharthvipul> tflink: :)
14:51:55 <jimbair> we have a group in FAS called fedora-ci-admins that's a good reference for who needs access
14:52:08 <siddharthvipul> jimbair: noted
14:52:20 <jimbair> I don't think openshift can tie into FAS but you can load the users in that group and add them into a fedora-ci project in openshift I would assume
14:52:44 <bookwar> siddharthvipul: where do you track infra requests?
14:52:59 <tflink> I remember hearing that openshift didn't have a concept of groups for project ACLs
14:53:07 <siddharthvipul> bookwar: we have an internal jira where are doing it
14:53:45 <tflink> or maybe that's just the way communishift was setup - they found a way to make it work but it wasn't a sure thing
14:53:49 <siddharthvipul> I know it's not the best.. let me discuss with others to see if there is a place we can track external requests.. I will get back to you all later for this
14:53:50 <tflink> but I digress
14:54:55 <bookwar> siddharthvipul: yes, i think we need an open contact point
14:55:44 <siddharthvipul> bookwar: so far it's just been deployment related work. in phase 2 of it we will be focusing on migration
14:55:50 <bookwar> we can use a pagure project "fedora-ci", or taiga project, if it helps. Maybe have the  tag in fedora-infra tracker?
14:56:04 <siddharthvipul> where we will need some contact place.. we will look into it
14:56:15 <bookwar> siddharthvipul: sure, thanks
14:56:19 <siddharthvipul> bookwar: sounds good, let me discuss it with brian and others :)
14:56:30 <jimbair> siddharthvipul: thank you for your help!
14:56:31 <bstinson> i think we can work out those details when we're ready to start migration. fedora-ci is one of the most important projects to support through this process
14:56:47 <siddharthvipul> bstinson++
14:56:47 <zodbot> siddharthvipul: Karma for bstinson changed to 2 (for the current release cycle):  https://badges.fedoraproject.org/tags/cookie/any
14:56:50 <bookwar> bstinson: nice to hear that )
14:57:33 <bookwar> bgoncalv: do you want to talk about outages? are there ongoing issues?
14:57:39 <jimbair> #topic Jenkins Outages
14:57:57 <bgoncalv> bookwar: currently there is no outage, we just noticed slow performance
14:58:08 <jimbair> I know we had one yesterday which was solved by scaling Jenkins down to 0 and back up to 1 which moved us to a new node (hyp)
14:58:15 <bgoncalv> jimbair: will monitor them and see if anything changes
14:58:16 <jimbair> NFS wasn't happy for some reaosn
14:58:38 <jimbair> bgoncalv: yep - slow currently, I'll monitor with bstinson and make sure it doesn't get worse - so far it's not breaking jobs
14:58:46 <jimbair> git checkouts are slower than they should be currently but not breaking
14:59:02 <bstinson> i need to bug a few noisy neighbors again
14:59:13 <jimbair> :)
14:59:26 <jimbair> This is why I bought a house - noisy neighbors are the worst
15:00:06 <bookwar> jimbair: and the auth problem? we still haven't figured it out?
15:00:20 <jimbair> nope - still waiting for response to our bug - may need to see who I can bug
15:00:22 <jimbair> let me find that again
15:00:50 <jimbair> #link https://github.com/openshift/jenkins/issues/1056
15:01:00 <jimbair> I can replicate it in crc so something is....weird.
15:01:04 <bookwar> thanks
15:01:21 <jimbair> the plugin expects some data to be in the jenkins config so it could be the plugin? I may duplicate the bug over there too but I want to talk to someone first
15:01:30 <jimbair> no replies yet though
15:02:10 <jimbair> bookwar: did you want to talk about CI messages?
15:02:22 <bookwar> jimbair: i think that's bruno
15:02:35 <bgoncalv> I've added the topic, just to know what is our next step
15:02:37 <jimbair> #topic Deprecation of CI Messages
15:02:45 <bgoncalv> there are few repos that gating.yaml will need to be updated
15:02:50 <jimbair> #link https://pagure.io/fedora-ci/general/issue/110
15:03:26 <bgoncalv> bookwar: how to we handle this do we send an email to package owners?
15:03:50 <bgoncalv> gating.yaml on all active branches should be updated
15:04:11 <bookwar> how hard it is to create pr with the fix?
15:04:23 <bookwar> is it possible to automate it?
15:04:37 <bookwar> ot just there 10 packages
15:04:50 <bookwar> we can probably handle that if we split them
15:04:51 <bgoncalv> I don't know, how hard will be to open the PRs
15:04:55 <bgoncalv> ti patch is simple
15:05:08 <bgoncalv> so 10 package in 3 branches?
15:05:15 <bgoncalv> f31, f32 and master?
15:05:19 <bookwar> no, just the master
15:06:03 <bookwar> option 1: send announcement to ci@ and devel@ and do the deprecation in three days
15:06:31 <bookwar> option 2: create pull requests and the rest as in option 1
15:06:48 <bookwar> any votes? :)
15:07:15 <bgoncalv> if we create PRs for master we need to inform developers to brackport changes if they plan to do builds for f31 and f32
15:08:07 <bgoncalv> depends on who will create the PRs
15:08:08 <bgoncalv> ;)
15:08:28 <bookwar> can you do one to show how it is done?
15:08:40 <bgoncalv> sure
15:09:02 <bookwar> ok, then let's do just one, and announcement
15:09:46 <bookwar> i can help with announcement if you like
15:10:14 <bgoncalv> thanks
15:11:02 <bookwar> jimbair: i think we have a deal
15:11:06 <jimbair> #topic open discussion
15:11:12 <jimbair> Anything else we want to bring up?
15:12:27 <siddharthvipul> nothing much, thank you all :)
15:12:31 <siddharthvipul> see you in the next one
15:12:41 <bookwar> thanks for coming
15:13:56 <jimbair> siddharthvipul: thank you again for your help!
15:14:14 <jimbair> siddharthvipul: our teams are in Brno and US so we are around at various times, depending on when you need to reach out
15:14:19 <jimbair> email works great too :)
15:14:24 <siddharthvipul> jimbair: ^^ thank you
15:14:39 <siddharthvipul> I am usually on EU time zone.. so anything works :)
15:15:31 <jimbair> siddharthvipul: most of the team is around during your time so you're good :) I don't login until 3PM Brno time (I'm in Texas)
15:16:08 <jimbair> But thanks again for your help - ping us anytime if we can help clarify anything
15:17:32 <jimbair> Anything else?
15:17:41 <jimbair> otherwise I can try to remember which tag closes it out ;)
15:17:47 <siddharthvipul> jimbair: :) awesome
15:18:19 <siddharthvipul> jimbair++ for moderating the meeting (hint closemeeting)
15:18:19 <zodbot> siddharthvipul: Karma for jimbair changed to 2 (for the current release cycle):  https://badges.fedoraproject.org/tags/cookie/any
15:19:00 <siddharthvipul> oops, I meant endmeeting
15:19:12 <jimbair> yeah it's start and end - it's real weird
15:19:35 <jimbair> #endmeeting
15:19:51 <jimbair> nope :D always forget haha
15:20:00 <siddharthvipul> jimbair: nick change I geuss
15:20:20 <jimbair> https://fedoraproject.org/wiki/Zodbot#Meeting_Functions
15:20:24 <jimbair> still says end?
15:20:25 <jimbair> #stopmeeting
15:20:28 <jimbair> nope
15:20:36 <jimbair> We're just stuck in a meeting forever it would seem =)
15:20:46 <bookwar> :)
15:20:55 <bstinson> jimbair: you need to renick to jbair
15:20:55 <siddharthvipul> jimbair: I think you need to change back the nick that you started the meeting with :P (I think, could be wrong)
15:21:01 <jimbair> ooooh
15:21:02 <bstinson> ^that :)
15:21:03 <jimbair> good catch
15:21:07 <jbair> #endmeeting