QCG-PilotJob

A python service for easy execution of many tasks inside a single allocation.

Basics

• Overview
• Installation
  • PyPi
  • GitHub

Usage

• Examples
  • Example API application
  • Example batch usage
• Modes of execution
  • Scheduling systems
  • Local execution
• Parallelism
  • MPI
  • OpenMP
• QCG-PilotJob Manager options

Further reading

• Key concepts
  • Modules
  • Queue & scheduler
  • Executors
• Execution environments
  • Slurm execution environment
  • QCG Execution environment
• Execution models
• File based interface
  • File interface usage
  • Requests file
  • Commands
• Iteration resources schedulers
  • maximum-iters
  • split-into
• Resuming prematurely interrupted computations
  • General
  • Invocation
  • Operation
  • Issues
• Performance statistics
  • Performance measurements and data collection
  • Analysis tool - qcg-pm-report
• Performance tuning
  • Reserving a core for QCG PJM
• Processes statistics
  • How it works
  • How to use

Miscellaneous

• Log files
• Dictionary

API Docs

• qcg.pilotjob.api package

Indices and tables

• Index
• Module Index
• Search Page

Authors

Bartosz Bosak, Piotr Kopta, Tomasz Piontek (PSNC)