parkit Documentation¶
parkit is a CLI toolkit for archiving CCBR project data to HPC-DME (/CCBR_Archive/GRIDFTP/...).
For most users, the recommended interface is projark, which provides guided deposit and retrieve workflows for entire CCBR project folder(s).
What's New¶
Use the version selector at the top of the page to view the docs for a specific release. Full details are in the Release Notes and the CHANGELOG.
v3.3.0¶
projark deposit/projark retrieve--staging-dir(orPROJARK_STAGING_DIR): choose where tarballs, split parts and downloads are staged (default/scratch/$USER).- Free-space preflight:
projark depositaborts before creating any HPC-DME collection if the staging filesystem cannot hold the tarball (about 2× when it will be split);projark retrievechecks space before downloading. - Safer staging: only folders carrying a
.projark_stagingmarker are ever deleted, and staging may not overlap the source folder. See Operational Guidance and the v3.3.0 release notes.
v3.2.0¶
parkit syncapi/parkit checkapisynctrack HPC_DME_APIsreleases/X.Y.Zbranches (latest stable release by default, or--ref/HPC_DME_APIs_REF) with meaningful exit codes. See v3.2.0 release notes.- Removed the hard-coded personal fallback path for the HPC_DME_APIs repository.
v3.1.0¶
projark ls <projectnumber>andparkit ls <collection-path>list vault contents.- Several
projark deposit/retrievefixes. See v3.1.0 release notes.
Quick Start¶
projark --version
projark deposit --help
projark retrieve --help
projark ls --help
Recommended Path¶
- Complete environment setup from Getting Started.
- Use projark Deposit (Recommended) to archive data.
- Use projark Retrieve when you need data back.
Notes¶
projarkis intended for Helix (helix.nih.gov).- All runs should be executed in
tmux,screen, or an Open OnDemand graphical session. - Disclaimer: Open OnDemand is currently available only on Biowulf compute nodes, not directly on Helix. Since
projarkis Helix-only today, usetmux/screenon Helix; Open OnDemand support is future-facing until Helix access is available. projarklogs include ISO 8601 timestamps.projarksends completion/failure email to$USER@nih.govfromNCICCBR@mail.nih.gov.- Docs are versioned; use the version selector to match the docs to your installed
parkit(projark --version).