BUGFIX: Change ownership to executing USER and group to atlab. Also automatically gzip the log output
This is a continuing revision for !17 (merged) and !18 (closed). Changes from !18 (closed) have been added here for convenience in resolving merge conflicts.
Major changes:
- Set user:group ownership to $USER:atlab.
- Set permissions to
rws
for the containing directory andr--
for the log itself - Automatically
gzip
the log file - Implements changes suggested in #17 (closed).
run-mmpol
now creates a single directory to store the raw policy output, the split gz files, and the parquet files plus anything else associated with the run. The directory name matches the name of the log file.
Minor changes:
- Full device path is used in the prefix, changing
/
to-
. All metadata entries in the file/directory names are separated by_
for clarity - Added dry-run option to all 3 scripts for testing. Dry runs submit no jobs and make no changes to any directory structure.
- Changed methods for finding the raw log once it's created and moving/renaming it
- Removed default device from
run-mmpol.sh
. Now the device must be specified regardless of which script is run.
Syntax Changes:
- Encased all called variables in
"{}"
for clarity in variable substitution. - Replaced ```` syntax with
$()
when performing command substitution
Issues Fixed:
- Fixes #26 (closed)
- Fixes #17 (closed)
Edited by Matthew K Defenderfer