18:02:14 <nirik> #startmeeting Fedora Infrastructure Ops Daily Standup Meeting 18:02:14 <zodbot> Meeting started Fri Apr 3 18:02:14 2020 UTC. 18:02:14 <zodbot> This meeting is logged and archived in a public location. 18:02:14 <zodbot> The chair is nirik. Information about MeetBot at http://wiki.debian.org/MeetBot. 18:02:14 <zodbot> Useful Commands: #action #agreed #halp #info #idea #link #topic. 18:02:14 <zodbot> The meeting name has been set to 'fedora_infrastructure_ops_daily_standup_meeting' 18:02:14 <nirik> #chair cverna mboddu nirik smooge 18:02:14 <nirik> #info meeting is 30 minutes MAX. At the end of 30, its stops 18:02:14 <zodbot> Current chairs: cverna mboddu nirik smooge 18:02:15 <nirik> #info agenda is at https://board.net/p/fedora-infra-daily 18:02:15 <nirik> #topic Tickets needing review 18:02:16 <nirik> #info https://pagure.io/fedora-infrastructure/issues?status=Open&priority=1 18:02:27 <nirik> ha, no needs review? 18:02:37 * mboddu is here 18:02:40 <mboddu> And I have one 18:03:04 <nirik> sure, fire away 18:03:21 <mboddu> Well, its already closed, but wanted to check anyway 18:03:26 <mboddu> .releng 9380 18:03:27 <zodbot> mboddu: Issue #9380: Clean up side-tags in koji.stg - releng - Pagure.io - https://pagure.io/releng/issue/9380 18:03:32 <smooge> hello 18:03:45 <mboddu> Why isn't the clean up script not running in stg? 18:03:51 <fm-admin> pagure.issue.comment.added -- kevin commented on ticket fedora-infrastructure#8809: "add carlwgeorge to infra-sig" https://pagure.io/fedora-infrastructure/issue/8809#comment-640017 18:04:11 <mboddu> I couldn't get time to look at it, I wthought of looking later today 18:04:17 <nirik> there isn't one? 18:04:35 <nirik> or there wasn't one when we deployed it, there might be one now upstream in koji... 18:05:10 <mboddu> I thought there was one 18:05:12 * mboddu checks 18:05:20 <nirik> not that I know of. 18:05:41 <cverna> yeah I don't think there was one :( 18:05:48 <cverna> but we need one for sure 18:06:06 <nirik> well, we need to figure out critera, but yeah, we could. 18:06:14 <mboddu> https://pagure.io/koji/issue/2005 18:06:36 <mboddu> Well, https://pagure.io/koji/pull-request/2006 is the fix and I think we deployed it in prod 18:06:54 <cverna> ha nice 18:07:27 <nirik> I don't think it is... the plugin merge was not in the 1.20.1 stable relase... only going to land in 1.21 18:08:22 <smooge> argle bargle. could I get help on https://pagure.io/fedora-infrastructure/issue/8810 my fix is not working 18:08:36 <mboddu> Oh, never mind then, sorry, I thought it went in to prod 18:08:43 <mboddu> But we still to discuss the criteria 18:09:04 <nirik> yeah... so one thing we could do now is set it to delete them when empty... 18:09:07 <mboddu> I am guessing "--empty-delay 7" should do it 18:09:45 <nirik> sure, we could do that. 18:09:47 <mboddu> nirik: ^ yeah, this checks if the side tags are empty for last 7 days and deletes them, we could reduce the time 18:09:55 <mboddu> But 7 days seems good enough 18:10:21 <nirik> well, there's also a remove_empty option to the sidetag plugin, but I am not sure how it works fully 18:11:20 <mboddu> Oh, I didn't know that 18:11:42 <mboddu> Well, anyway, thats all I got 18:11:46 * mboddu updates the ticket 18:11:46 <nirik> it seems like it could nuke a side tag before builds land in it... 18:12:25 <nirik> but yeah, we should nuke empty ones... I don't think we should nuke old ones initially at least. Perhaps a report to shame the people who keep them around a long time? 18:13:04 <nirik> I have some progress to report on the backups volume... 18:13:41 <nirik> ntap-phx2-c01-fedora01-nfs.storage.phx2.redhat.com:/fedora_backups 30T 28T 1.6T 95% /fedora_backups 18:13:41 <nirik> ntap-phx2-c01-fedora01-nfs.storage.phx2.redhat.com:/fedora_backups 30T 18T 12T 62% /fedora_backups 18:13:51 <mboddu> Well, if we go with more than 7 days option, people wouldn't mind and they can always create a new side if they want to 18:13:59 <nirik> and I am still rming. 18:14:22 <nirik> mboddu: sure, but if we delete ones that have builds in them people might mind... 18:14:35 <mboddu> Well, they are empty, right 18:14:57 <mboddu> They are empty for 7 days 18:15:16 <mboddu> "delete empty tags older than DAYS" 18:15:27 <mboddu> If I understand it correctly 18:15:56 <nirik> yeah, sorry, I wasn't clear there... when I said " I don't think we should nuke old ones initially at least. Perhaps a report to shame the people who keep them around a long time?" I meant deleting sidetags with builds after N days... 18:16:16 <nirik> (which the cleanup script can also optionally do) 18:16:33 <mboddu> Oh, yeah, we could that as well 18:16:54 <mboddu> But maybe, we set it for 14 days, just in case 18:16:58 <nirik> they should really be short lived, so if people are keeping them around a long time we need to ask them why. 18:17:20 <mboddu> I know KDE, GNOME stuff takes more than 14 days 18:17:53 <nirik> it shouldn't I wouldn't think... 18:18:14 <nirik> but I could be wrong. we can ask before we push anything. 18:18:45 <mboddu> Back in the days when they used to request side tags, they used to take more than 14 days, and even like python, golang and other languages related side tags take more than 14 days 18:19:20 <kalev> as for the GNOME side tags, I've been requesting named side tags for GNOME builds to more easily work as a team on the update 18:19:23 <nirik> sure, something large like that might. 18:19:36 <kalev> so that people wouldn't have to remember a gibberish name, but instead just know they can use f32-gnome 18:19:40 <nirik> those should be the exception tho 18:19:48 <nirik> kalev: sure. makes sense. 18:19:58 <kalev> if you don't automatically clean up the manually created ones, I think the self-service tag 14 day garbage collection should be fine 18:20:13 <mboddu> kalev: Sure, I am happy to do it, but lot of other people opted for the side tag plugin rather than asking releng 18:20:19 * kalev nods. 18:20:47 <nirik> there's a exception list if we want on the cleanup script. 18:21:01 <nirik> and it shouldn't mess with non side* tags anyhow 18:21:59 <nirik> anyhow, any other tickets to discuss, reviews pending, etc? 18:22:01 <kalev> maybe send and email to the owner after a week, and then delete a week after? or look at history, if nothing has happened over a week in the tag, only then delete? 18:22:28 <mboddu> nirik: Right, but the problem is identifying them, since the tags are created using fxx-build-sie-blah 18:24:00 <mboddu> Okay, I think everyone agrees on "delete the tags that are empty for more than 7 days" 18:24:17 <nirik> mboddu: koji knows. ;) 18:24:26 <nirik> + tags = session.listSideTags() 18:24:55 <nirik> +1 (as soon as we have the script in 1.21.0 we can look at deploying) 18:25:23 <mboddu> Tags that are created for more than X days, but still not empty, we can think look at how to handle them when we get there 18:25:30 <nirik> sure 18:26:09 <mboddu> nirik: Sure, koji knows, but it doesn't know what side tag it created for huge python rebuild (which is what we are trying to skip) 18:26:18 <nirik> ok, if nothing else will close out then... thanks for coming 18:26:30 <mboddu> But, yeah, we can look back at it 18:26:32 <nirik> mboddu: sure. 18:26:54 * mboddu has nothing else 18:27:08 <nirik> #endmeeting