pe \- pipeline execution
.SH SYNOPSIS
.B pe
\fI[-v] [-d] [-l] [db=database_name] map=map_file\f.SH DESCRIPTION
\fIpe\fR executes a series of strategy level servers in a pipeline.
\fIpe\fR is launched with the name of the \fImap_file\fR that defines its processing. The map file specifies the strategy level servers to be run, the hosts they are to be run on, the sequence in which to run them, the dataset they are to process, and any DSDS support for dataset name resolution or data archiving.
\fIpe\fR is run as a PVM (Parallel Virtual Machine) task. A pvm daemon must be running on each host specified in the map file. .NXR ""
.SH OPTIONS
.NXR "module command" "options"
.IP \fB-v\fR 5
The verbose flag.
.IP \fB-d\fR 5
The debug flag. Brings up a dbx window on each server.
.IP \fB-l\fR 5
The lago flag. Starts a lago_svc which may be need for the retrieval of data
which is not on-line.
.IP \fBdb=\fR 5
The name of the database to connect to. The default is the test1 database.
.SH EXAMPLES
.NXR(e) ""
.EX
#This is a map file that specifies a pipeline to be run by PE. #
#Control Statements:
#DSDSOUT=n
# DSDS will be asked to allocate n megabytes for the output of # this pipe. The output directory that DSDS assigns can be used in # the name template env variable "prog:" by specifying {dbase}. # Notice that if you do not specify d=1 (see below) for a server, # but did specify DSDSOUT then you must set a default {dbase} so that # the name template will also map the input. #ELBOW=1
# Indicates that the next server is to wait for all previous servers to # complete before starting.
#ONESERVER=1
# Indicates to only run one copy of the next server. This server will # handle all the input files itself. Note that this also implies # an ELBOW=1 because all the previous files must be available. #!
# A shell escape command. Any setenv is intercepted and interpreted # locally for the PE environment. No metachars for a setenv. #Line Tokens:
#p= The name of the server process to run. #h= The host names that all the servers are to run on. Multiple copies of # the servers can be run on the same host by specifying the host name # more than once.
#d= A non-zero indicates that this servers input will be obtained from # DSDS. Otherwise a name template, found in the env variable of the # name of the "prog:" in the ds name, will be used to determine the # input directory.
#a= A non-zero indicates that this server's output is to be archived. # This will be a nop unless DSDSOUT=n is specified. #in= The dataset name for the pipe's input data. This isn't necessarily # called "in", but whatever the server's input ds argument is called. #arg= Optional argument name and value to override any default argument # values for a server.
#
#Any control statement must be on a separate line. #Any non-control line must start with p= ,and must be a separate line. #The very first p= line must contain a h= . #Any p= line may optionally contain an a=1. #Any p= line may optionally contain an d=1. #Any p= line may optionally contain any argument value for the server. #Any line, except a "!" line, may be extended by ending it with " \". !setenv dbase /mnt/jim/data
!setenv cat {dbase}/{prog}{#%03d#prog}/{level}/{series} !echo "The env vrbl cat = " `printenv cat` DSDSOUT=50
p=gvcalc h=rumble d=1 a=1 \\
in1=prog:cat[13],level:lev0,series:Fg1,sel:[98-100],fmt:%04d \\ in2=prog:cat[13],level:lev0,series:Fg2,[],fmt:%04d \\ in3=prog:cat[13],level:lev0,series:Fg3,[],fmt:%04d \\ in4=prog:cat[13],level:lev0,series:Fg4,[],fmt:%04d \\ in0=prog:cat[13],level:lev0,series:Fg0,[],fmt:%04d \\ outlog_rule=/scr2/jim/data/logs/V_mdi.log \\ outlog=prog:,level:,series:,sel:[] \\
calib=/home/soi/new/src/pipe/CALIB.fits \\ out=prog:cat[13],level:lev1,series:V_mdi,[] .EE
.SH FILES
none
.SH SEE ALSO
.EX
SOI-TN-104 "Naming of Datasets for SOI"
SOI-TN-107 "Programming in the SOI Analysis Environment"
SOI-TN-109 "SSSC Implementation Version 1.0"
.EE
.SH DIAGNOSTICS
.SH BUGS
.SH AUTHOR
Jim Aloise
.rs
.SH HISTORY
1994-02-14 SOI Version 0.8
.#$Id: pe.1,v 1.3 1994/05/03 20:43:31 jim Exp $ .#$Source: /home/soi/CM/man/man1/RCS/pe.1,v $
.#$Author: jim $