QCG-PilotJob Manager options¶
The list of all options can be obtained by running either the wrapper command:
$ qcg-pm-service --help
or directly call the Python module:
$ python -m qcg.pilotjob.service –help
Those options can be passed to QCG-PilotJob Manager in batch mode as command line arguments,
or as an argument server_args
during instantiating the LocalManager class.
The full list of currently supported options is presented below.
$ qcg-pm-service --help
usage: service.py [-h] [--net] [--net-port NET_PORT]
[--net-pub-port NET_PUB_PORT] [--net-port-min NET_PORT_MIN]
[--net-port-max NET_PORT_MAX] [--file]
[--file-path FILE_PATH] [--wd WD] [--envschema ENVSCHEMA]
[--resources RESOURCES] [--report-format REPORT_FORMAT]
[--report-file REPORT_FILE] [--nodes NODES]
[--log {critical,error,warning,info,debug,notset}]
[--system-core] [--disable-nl] [--show-progress]
[--governor] [--parent PARENT] [--id ID] [--tags TAGS]
[--slurm-partition-nodes SLURM_PARTITION_NODES]
[--slurm-limit-nodes-range-begin SLURM_LIMIT_NODES_RANGE_BEGIN]
[--slurm-limit-nodes-range-end SLURM_LIMIT_NODES_RANGE_END]
[--slurm-resources-file SLURM_RESOURCES_FILE]
[--resume RESUME] [--enable-proc-stats] [--enable-rt-stats]
[--wrapper-rt-stats WRAPPER_RT_STATS]
[--nl-init-timeout NL_INIT_TIMEOUT]
[--nl-ready-treshold NL_READY_TRESHOLD] [--disable-pub]
[--nl-start-method NL_START_METHOD]
optional arguments:
-h, --help show this help message and exit
--net enable network interface
--net-port NET_PORT port to listen for network interface (implies --net)
--net-pub-port NET_PUB_PORT
port to publish events (implies --net)
--net-port-min NET_PORT_MIN
minimum port range to listen for network interface if
exact port number is not defined (implies --net)
--net-port-max NET_PORT_MAX
maximum port range to listen for network interface if
exact port number is not defined (implies --net)
--file enable file interface
--file-path FILE_PATH
path to the request file (implies --file)
--wd WD working directory for the service
--envschema ENVSCHEMA
job environment schema [auto|slurm]
--resources RESOURCES
source of information about available resources
[auto|slurm|local] as well as a method of job
execution (through local processes or as a Slurm sub
jobs)
--report-format REPORT_FORMAT
format of job report file [text|json]
--report-file REPORT_FILE
name of the job report file
--nodes NODES configuration of available resources (implies
--resources local)
--log {critical,error,warning,info,debug,notset}
log level
--system-core reserve one of the core for the QCG-PJM
--disable-nl disable custom launching method
--show-progress print information about executing tasks
--governor run manager in the governor mode, where jobs will be
scheduled to execute to the dependant managers
--parent PARENT address of the parent manager, current instance will
receive jobs from the parent manaqger
--id ID optional manager instance identifier - will be
generated automatically when not defined
--tags TAGS optional manager instance tags separated by commas
--slurm-partition-nodes SLURM_PARTITION_NODES
split Slurm allocation by given number of nodes, where
each group will be controlled by separate manager
(implies --governor)
--slurm-limit-nodes-range-begin SLURM_LIMIT_NODES_RANGE_BEGIN
limit Slurm allocation to specified range of nodes
(starting node)
--slurm-limit-nodes-range-end SLURM_LIMIT_NODES_RANGE_END
limit Slurm allocation to specified range of nodes
(ending node)
--slurm-resources-file SLURM_RESOURCES_FILE
path to the file with slurm resources description
--resume RESUME path to the QCG-PilotJob working directory to resume
--enable-proc-stats gather information about launched processes from
system
--enable-rt-stats gather exact start & stop information of launched
processes
--wrapper-rt-stats WRAPPER_RT_STATS
exact start & stop information wrapper path
--nl-init-timeout NL_INIT_TIMEOUT
node launcher init timeout (s)
--nl-ready-treshold NL_READY_TRESHOLD
percent (0.0-1.0) of node launchers registered when
computations should start
--disable-pub disable status publisher interface
--nl-start-method NL_START_METHOD
method to start node launchers (ssh,slurm - default)