I have reduced my /work/ usage to 16 MB.

On Thu, Jun 1, 2017 at 3:05 PM, Bradley T Yale <[log in to unmask]> wrote:

I deleted/moved 351 GB in mc_production.

The following things are owned by other users though, and ~6 GB more can be freed up if no longer needed:


762M: /work/hallb/hps/mc_production/Luca/lhe/Vegas_10_10_2016/


3.1G: /work/hallb/hps/mc_production/MG5/dst/

2G: /work/hallb/hps/mc_production/postTriSummitFixes/tritrig/1pt05/NOSUMCUT/

25M:  /work/hallb/hps/mc_production/logs/slic/ap/

16M: /work/hallb/hps/mc_production/logs/readout/beam-tri/1pt92/

Matt G:

35M: /work/hallb/hps/mc_production/dst/

11M: /work/hallb/hps/mc_production/logs/dqm/

There is also 2 GB of old 2.2 GeV A' MC, which should no longer be relevant, but I didn't want to do anything with it since it had mock data stuff in there:


From: [log in to unmask] <[log in to unmask]EDU> on behalf of Nathan Baltzell <[log in to unmask]>
Sent: Thursday, June 1, 2017 1:23:19 PM
Cc: [log in to unmask]
Subject: Re: [Hps-analysis] Fwd: [Clas_offline] Fwd: ENP consumption of disk space under /work
Here’s the most relevant usage

649G    mrsolt/
570G    sebouh/
459G    mc_production/
228G    holly
159G    mccaky/
78G     rafopar/
45G     omoreno/
44G     spaul
39G     fxgirod
34G     jeremym

3.2T    tweakpass6
50G     tweakpass6fail
64G     tpass7
2.4G    tpass7b
39G     tpass7c
6.5G    t_tweakpass_a
373G    pass6/skim
201G    pass6/dst

3.5T    pass0
690G    feeiter4
94M     feeiter0
327M    feeiter1
339M    feeiter2
338M    feeiter3
15G     noPass
24G     pass0_allign
52G     pass0fail
4.5G    tmp_test
281G    tpass1
11G     upass0

On Jun 1, 2017, at 11:05, Stepan Stepanyan <[log in to unmask]> wrote:

> FYI, we need to move files.
> Stepan
>> Begin forwarded message:
>> From: Harut Avakian <[log in to unmask]>
>> Subject: [Clas_offline] Fwd: ENP consumption of disk space under /work
>> Date: June 1, 2017 at 5:01:24 PM GMT+2
>> To: "[log in to unmask]" <[log in to unmask]>
>> Dear All,
>> As you can see from the e-mail below,  keeping all our work disk space requires some additional funding.
>> Option 3 will inevitably impact on farm operations, removing of ~20% space from Lustre.
>> We can also choose something between options 1) and 3).
>> Please revise the content and move at least 75% of what is in /work/clas  to either /cache or /volatile? 
>> The current Hall-B usage includes:
>> 550G    hallb/bonus
>> 1.5T    hallb/clase1
>> 3.6T    hallb/clase1-6
>> 3.3T    hallb/clase1dvcs
>> 2.8T    hallb/clase1dvcs2
>> 987G    hallb/clase1f
>> 1.8T    hallb/clase2
>> 1.6G    hallb/clase5
>> 413G    hallb/clase6
>> 2.2T    hallb/claseg1
>> 3.9T    hallb/claseg1dvcs
>> 1.2T    hallb/claseg3
>> 4.1T    hallb/claseg4
>> 2.7T    hallb/claseg5
>> 1.7T    hallb/claseg6
>> 367G    hallb/clas-farm-output
>> 734G    hallb/clasg10
>> 601G    hallb/clasg11
>> 8.1T    hallb/clasg12
>> 2.4T    hallb/clasg13
>> 2.4T    hallb/clasg14
>> 28G    hallb/clasg3
>> 5.8G    hallb/clasg7
>> 269G    hallb/clasg8
>> 1.2T    hallb/clasg9
>> 1.3T    hallb/clashps
>> 1.8T    hallb/clas-production
>> 5.6T    hallb/clas-production2
>> 1.4T    hallb/clas-production3
>> 12T    hallb/hps
>> 13T    hallb/prad
>> Regards,
>> Harut
>> P.S. Few times we had crashes and they may also happen in future, so keeping important files in /work is not recommended.
>> You can see the list of lost files in /site/scicomp/lostfiles.txt  and  /site/scicomp/lostfiles-jan-2017.txt
>> -------- Forwarded Message --------
>> Subject:     ENP consumption of disk space under /work
>> Date:        Wed, 31 May 2017 10:35:51 -0400
>> From:        Chip Watson <[log in to unmask]>
>> To:  Sandy Philpott <[log in to unmask]>, Graham Heyes <[log in to unmask]>, Ole Hansen <[log in to unmask]>, Harut Avakian <[log in to unmask]>, Brad Sawatzky <[log in to unmask]>, Mark M. Ito <[log in to unmask]>
>> All,
>> As I have started on the procurement of the new /work file server, I
>> have discovered that Physics' use of /work has grown unrestrained over
>> the last year or two.
>> "Unrestrained" because there is no way under Lustre to restrain it
>> except via a very unfriendly Lustre quota system.  As we leave some
>> quota headroom to accommodate large swings in usage for each hall for
>> cache and volatile, then /work continues to grow.
>> Total /work has now reached 260 TB, several times larger than I was
>> anticipating.  This constitutes more than 25% of Physics' share of
>> Lustre, compared to LQCD which uses less than 5% of its disk space on
>> the un-managed /work.
>> It would cost Physics an extra $25K (total $35K - $40K) to treat the 260
>> TB as a requirement.
>> There are 3 paths forward:
>> (1) Physics cuts its use of /work by a factor of 4-5.
>> (2) Physics increases funding to $40K
>> (3) We pull a server out of Lustre, decreasing Physics' share of the
>> system, and use that as half of the new active-active pair, beefing it
>> up with SSDs and perhaps additional memory; this would actually shrink
>> Physics near term costs, but puts higher pressure on the file system for
>> the farm
>> The decision is clearly Physics', but I do need a VERY FAST response to
>> this question, as I need to move quickly now for LQCD's needs.
>> Hall D + GlueX,  96 TB
>> CLAS + CLAS12, 98 TB
>> Hall C,                35 TB
>> Hall A <unknown, still scanning>
>> Email, call (x7101), or drop by today 1:30-3:00 p.m. for discussion.
>> thanks,
>> Chip
>> _______________________________________________
>> Clas_offline mailing list
>> [log in to unmask]
> _______________________________________________
> Hps-analysis mailing list
> [log in to unmask]

Use REPLY-ALL to reply to list

To unsubscribe from the HPS-SOFTWARE list, click the following link:

Use REPLY-ALL to reply to list

To unsubscribe from the HPS-SOFTWARE list, click the following link:

Use REPLY-ALL to reply to list

To unsubscribe from the HPS-SOFTWARE list, click the following link: