Overview: Different Classes of Storage

Purpose

Path

Persistence

Backup Strategy

Visibility

Remarks

valuable user data

/afs/ifh.de/user/<initial>/<user>

permanent

automatic, daily backup

on all machines

contact: <uco-zn AT desy DOT de>

group data

/afs/ifh.de/group/

permanent

backup for all AFS volumes names of which start with g., but not gn.

on all machines

AFS Backup
contact: your group AFS admin

group data

/acs (dCache)

permanent

for valuable data copy on second tape pool on request

on batch farm, work group server, host transfer.ifh.de

Mass Storage Service
contact: <uco-zn AT desy DOT de>

group data

/lustre/fs?/group
/lustre/fs?/user/user

permanent

no backup

farm, wgs, pax clusters

intended for massively parallel access, typically data with high turnover rate, limited amounts, see also Lustre

group data

/nfs/group/

permanent

no backup, backup only on request

on requested hosts, but not on the batch farm; export to desktops is completely insecure

Backup_policy_under_TSM
contact: your group admin

temporary batch job data

$TMPDIR (not /tmp)

temporary

no

on the execution host only

Batch System Usage
contact: <uco-zn AT desy DOT de>

Some information about basic filesystem characteristics are explained in cluster-storage-20100517.pdf . A more comprehensive and in-depth version was given in the technical seminar 2010-06-29.

General Recommendations

Hints using AFS

Problems with NFS

Storage_Resources_Usage (last edited 2015-09-15 12:36:38 by GötzWaschk)