poller.py – Poller for parallel QIIME scripts.

Description:

Script for polling parallel runs to check completion.

Usage: poller.py [options]

Input Arguments:

Note

[REQUIRED]

-f, --check_run_complete_file

Path to file containing a list of files that must exist to declare a run complete [REQUIRED]

[OPTIONAL]

-r, --check_run_complete_f

Function which returns True when run is completed [default: qiime.parallel.poller.basic_check_run_complete_f]

-p, --process_run_results_f

Function to be called when runs complete [default: qiime.parallel.poller.basic_process_run_results_f]

-m, --process_run_results_file

Path to file containing a map of tmp filepaths which should be written to final output filepaths [default: None]

-c, --clean_up_f

Function called after processing result [default: qiime.parallel.poller.basic_clean_up_f]

-d, --clean_up_file

List of files and directories to remove after run [default: None]

-t, --time_to_sleep

Time to wait between calls to status_callback_f (in seconds) [default: 3]

Output:

No output created.

Poller example:

Runs the poller, which checks for the existence of two input files (file1.txt and file2.txt) and merges their contents. A cleanup file is provided that instructs the poller to remove the newly merged file.

poller.py -f run_complete.txt -m poller_test_completed.txt -d clean_up.txt