🔍 Detailed dataset info using ps¶
datatrail ps --helpUsage: datatrail ps [OPTIONS] SCOPE DATASET
Details of a dataset.
Options:
-s, --show-files Show file names.
-v, --verbose Verbosity: v=INFO, vv=DEBUG.
-q, --quiet Set log level to ERROR.
--help Show this message and exit.
Details of a dataset.
Options:
-s, --show-files Show file names.
-v, --verbose Verbosity: v=INFO, vv=DEBUG.
-q, --quiet Set log level to ERROR.
--help Show this message and exit.
The ps command is used to get information about a child dataset. It can
display the datasets replication and deletion policies, in addition to the
size and number of files in the dataset.
Dataset policies and size at minoc
Bash
$> datatrail ps kko.event.baseband.raw 308892599
Datatrail: 308892599 kko.event.baseband.raw at Minoc
┏━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━━━━━━━━━┓
┃ Storage Element ┃ Number of Files ┃ Size of Files [GB] ┃
┡━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━━━━━━━━━┩
│ minoc │ 1024 │ 5.34 │
└─────────────────┴─────────────────┴────────────────────┘
Datatrail: Policies for 308892599 kko.event.baseband.raw
┏━━━━━━━━━━━━━┳━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━┳━━━━━━━━━┳━━━━━━━━━━━━━━━━━━━━━┓
┃ Policy ┃ Storage Element ┃ Priority ┃ Default ┃ Delete After [days] ┃
┡━━━━━━━━━━━━━╇━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━╇━━━━━━━━━╇━━━━━━━━━━━━━━━━━━━━━┩
│ Replication │ chime │ low │ True │ - │
├─────────────┼────────────────────────────────────┼──────────┼─────────┼─────────────────────┤
│ Deletion │ minoc │ low │ True │ 36500 │
│ │ arc │ high │ True │ 60 │
│ │ chime │ medium │ True │ 90 │
│ │ kko │ medium │ True │ 90 │
├─────────────┼────────────────────────────────────┼──────────┼─────────┼─────────────────────┤
│ Belongs to │ B0531+21.commissioning.pulsar.temp │ │ │ │
└─────────────┴────────────────────────────────────┴──────────┴─────────┴─────────────────────┘
This command is also able to display a list of files for each storage element,
if the --show-files or -s flag is passed.
Listing dataset's files
Bash
$> datatrail ps kko.event.baseband.raw 308892599 --show-files
┏━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┓
┃ Datatrail: Files for 308892599 kko.event.baseband.raw ┃
┡━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┩
│ Storage Element: minoc │
│ Common Path: data/kko/baseband/raw/2023/08/07/astro_308892599/ │
│ - baseband_308892599_129.h5 │
│ - baseband_308892599_1013.h5 │
│ - baseband_308892599_171.h5 │
│ - baseband_308892599_250.h5 │
│ - baseband_308892599_269.h5 │
│ - baseband_308892599_284.h5 │
│ - baseband_308892599_295.h5 │
│ - baseband_308892599_306.h5 │
│ - baseband_308892599_353.h5 │
│ - baseband_308892599_926.h5 │
│ - baseband_308892599_933.h5 │
│ - baseband_308892599_201.h5 │
│ - baseband_308892599_393.h5 │
│ - baseband_308892599_429.h5 │
│ - baseband_308892599_542.h5 │
│ - baseband_308892599_565.h5 │
│ - baseband_308892599_604.h5 │
│ - baseband_308892599_615.h5 │
│ - baseband_308892599_657.h5 │
│ - baseband_308892599_672.h5 │
│ - baseband_308892599_10.h5 │
│ - baseband_308892599_110.h5 │
│ - baseband_308892599_111.h5 │
: