Inheritance diagram for parallel.parallel_task_helper.ParallelTaskHelper:

Public Member Functions
def	__init__
def	override_arg
def	initialize
def	generateJobs
def	executeJobs
def	postExecution
def	sum_dictionaries
def	go
Static Public Member Functions
def	getReferencedMSs
def	restoreSubtableAgreement
def	bypassParallelProcessing
def	getBypassParallelProcessing
def	isParallelMS
def	findAbsPath
def	listToCasaString
Private Attributes
	_arg
	_arguser
	_taskName
	_executionList
	_jobQueue
	__originalParams
	__bypass_parallel_processing
	_cluster
	_consolidateOutput
	_sequential_return_list
Static Private Attributes
int	__bypass_parallel_processing

Detailed Description

This is the extension of the TaskHelper to allow for parallel
operation.  For simple tasks all that should be required to make
a task parallel is to use this rather than the TaskHelper method
above

Definition at line 12 of file parallel_task_helper.py.

Constructor & Destructor Documentation

def parallel.parallel_task_helper.ParallelTaskHelper.__init__	(	self,
		task_name,
		args = `{}`
	)

Definition at line 22 of file parallel_task_helper.py.

Member Function Documentation

def parallel.parallel_task_helper.ParallelTaskHelper.bypassParallelProcessing ( switch = 1 ) [static]

# jagonzal (CAS-4287): Add a cluster-less mode to by-pass parallel processing for MMSs as requested 
switch=1 => Process each sub-Ms sequentially
switch=2 => Process the MMS as a normal MS

Definition at line 267 of file parallel_task_helper.py.

def parallel.parallel_task_helper.ParallelTaskHelper.executeJobs ( self )

Definition at line 88 of file parallel_task_helper.py.

References parallel.parallel_task_helper.ParallelTaskHelper.__bypass_parallel_processing, parallel.parallel_task_helper.ParallelTaskHelper._cluster, parallel.parallel_task_helper.ParallelTaskHelper._executionList, parallel.parallel_task_helper.ParallelTaskHelper._jobQueue, and parallel.parallel_task_helper.ParallelTaskHelper._sequential_return_list.

Referenced by parallel.parallel_task_helper.ParallelTaskHelper.go().

def parallel.parallel_task_helper.ParallelTaskHelper.findAbsPath ( input ) [static]

Definition at line 305 of file parallel_task_helper.py.

def parallel.parallel_task_helper.ParallelTaskHelper.generateJobs ( self )

This is the method which generates all of the actual jobs to be
done.  The default is to asume the input vis is a reference ms and
build one job for each referenced ms.

Reimplemented in task_partition.PartitionHelper.

Definition at line 51 of file parallel_task_helper.py.

References parallel.parallel_task_helper.ParallelTaskHelper._arg, parallel.parallel_task_helper.ParallelTaskHelper._arguser, parallel.parallel_task_helper.ParallelTaskHelper._taskName, and taskinit.mstool.

Referenced by parallel.parallel_task_helper.ParallelTaskHelper.go().

def parallel.parallel_task_helper.ParallelTaskHelper.getBypassParallelProcessing ( ) [static]

# jagonzal (CAS-4287): Add a cluster-less mode to by-pass parallel processing for MMSs as requested 
switch=1 => Process each sub-Ms sequentially
switch=2 => Process the MMS as a normal MS

Definition at line 276 of file parallel_task_helper.py.

def parallel.parallel_task_helper.ParallelTaskHelper.getReferencedMSs ( vis ) [static]

Definition at line 193 of file parallel_task_helper.py.

References taskinit.mstool.

def parallel.parallel_task_helper.ParallelTaskHelper.go ( self )

Definition at line 171 of file parallel_task_helper.py.

References parallel.parallel_task_helper.ParallelTaskHelper._arg, parallel.parallel_task_helper.ParallelTaskHelper._taskName, parallel.parallel_task_helper.ParallelTaskHelper.executeJobs(), parallel.parallel_task_helper.ParallelTaskHelper.generateJobs(), parallel.parallel_task_helper.ParallelTaskHelper.initialize(), and parallel.parallel_task_helper.ParallelTaskHelper.postExecution().

def parallel.parallel_task_helper.ParallelTaskHelper.initialize ( self )

This is the setup portion.
Currently it:
   * Finds the full path for the input vis.

Reimplemented in task_partition.PartitionHelper.

Definition at line 43 of file parallel_task_helper.py.

References parallel.parallel_task_helper.ParallelTaskHelper._arg.

Referenced by parallel.parallel_task_helper.ParallelTaskHelper.go(), tests.test_uvcontsub3.zeroth.setUp(), tests.test_uvcontsub.zeroth.setUp(), tests.test_uvcontsub3.fourth.setUp(), tests.test_split.SplitChecker.setUp(), tests.test_uvcontsub.fourth.setUp(), tests.test_uvcontsub3.combspw.setUp(), tests.test_uvcontsub3.knowncombspw.setUp(), and tests.test_uvcontsub.combspw.setUp().

def parallel.parallel_task_helper.ParallelTaskHelper.isParallelMS ( vis ) [static]

This method will let us know if we can do the simple form
of parallelization by invoking on many referenced mss.

Definition at line 285 of file parallel_task_helper.py.

References taskinit.mstool.

def parallel.parallel_task_helper.ParallelTaskHelper.listToCasaString ( inputList ) [static]

This Method will take a list of integers and try to express them as a 
compact set using the CASA notation.

Definition at line 319 of file parallel_task_helper.py.

Referenced by task_partition.PartitionHelper._createPrimarySplitCommand(), task_partition.PartitionHelper._createScanSeparationCommands(), task_partition.PartitionHelper._createSPWSeparationCommands(), tests.test_partitionHelper.PartitionHelperTest.testDefaultSeparationCommands(), and tests.test_partitionHelper.PartitionHelperTest.testSpwSeparationCommands().

def parallel.parallel_task_helper.ParallelTaskHelper.override_arg	(	self,
		arg,
		value
	)

Definition at line 40 of file parallel_task_helper.py.

References parallel.parallel_task_helper.ParallelTaskHelper._arguser.

def parallel.parallel_task_helper.ParallelTaskHelper.postExecution ( self )

Reimplemented in task_partition.PartitionHelper.

Definition at line 116 of file parallel_task_helper.py.

References parallel.parallel_task_helper.ParallelTaskHelper.__bypass_parallel_processing, parallel.parallel_task_helper.ParallelTaskHelper._cluster, parallel.parallel_task_helper.ParallelTaskHelper._consolidateOutput, parallel.parallel_task_helper.ParallelTaskHelper._sequential_return_list, parallel.parallel_task_helper.ParallelTaskHelper._taskName, and parallel.parallel_task_helper.ParallelTaskHelper.sum_dictionaries().

Referenced by parallel.parallel_task_helper.ParallelTaskHelper.go().

def parallel.parallel_task_helper.ParallelTaskHelper.restoreSubtableAgreement	(	vis,
		mastersubms = `''`,
		subtables = `[]`
	)	`[static]`

Tidy up the MMS vis by replacing the subtables of all SubMSs
by the subtables from the SubMS given by "mastersubms".
If specified, only the subtables in the list "subtables"
are replaced, otherwise all.
If "mastersubms" is not given, the first SubMS of the MMS
will be used as master.

Definition at line 211 of file parallel_task_helper.py.

References taskinit.mstool, and taskinit.tbtool.