INGEST_SCI160K_SVC(1)

PRELIMINARY: MODULE STILL UNDER DEVELOPMENT

NAME

     ingest_sci160k -  ingest 160k science telemetry data

SYNOPSIS MAP

     !setenv mdi wd:{dbase}/{level}/{series}/{#%06d#series}
     DSDSOUT=1200
     p=ingest_sci160k a=n \
       in=/stage/hrsc_tape/ \
       out=prog:mdi,level:raw,series:sci160k[2608] \
       format=[Lockheed | tlm+sfdu | tlm | tlm-hdr]

DESCRIPTION

     ingest_sci160k is a strategy level module that runs via a pe
     map file to ingest the high rate science telemetry data into
     the DSDS storage. The module will accept either Goddard for-
     matted data or Lockheed formatted data.

     The default "format=" value is "tlm+sfdu" which is the  nor-
     mal Goddard format.

     The series number is normally the Goddard tape number  being
     processed.

     If pe is run with the -v option set, the  input  and  output
     keylists are printed to the history file.

OPTIONS

     in=Directory_Name   The directory containing the data to  be
                         ingested

     out=Dataset_Name    No Default

     format=Lockheed     Telemetry file names are assumed  to  be
                         prefixed with "MDI_HRSC.". It is assumed
                         that there are 4 bytes of  system  clock
                         time  at  the  start  of  each telemetry
                         packet.

     format=tlm+sfdu     The station file names are found in  the
                         "REFERENCE=" line of each file prepended
                         with ".SFDU".  The  data  is  without  4
                         bytes  of system clock time at the start
                         of each packet.  Each  station  file  is
                         assumed to start with a 48 byte Data Set
                         File Header constructed by Goddard.

     format=tlm          The same as "tlm+sfdu" but  without  the
                         SFDU   files.   The  station  files  are
                         assumed to be prefixed with "MDI_HRSC.".

     format=tlm-hdr      The same as "tlm"  but  without  the  48
                         byte Data Set File Header.

EXTENDED DESCRIPTION

     The source of Goddard data is an 8mm tape received from God-
     dard for each day of 160k data. The data consists of station
     file telemetry and an SFDU file associated with each station
     file on the tape. The directory and file formats on the tape
     are given by the Goddard document: "Interface Control  Docu-
     ment  Between  the SDPF and SOHO Consumers" 560-230.97 April
     1995.  The Goddard tape is tar'ed into a  staging  directory
     and  this  directory  is  given  as  an  input  parameter to
     ingest_sci160k. All station files and SFDU  files  are  ing-
     ested into DSDS storage as a single dataset.

     The source of 160k data may also be Lockheed  generated  tfr
     files.   These files are copied into a staging directory and
     given a file name prefix of "MDI_HRSC.". The staging  direc-
     tory  is  given as an input parameter to ingest_sci160k. The
     tfr file and any other files in the  staging  directory  are
     ingested into DSDS storage as a single dataset.

     Besides ingesting the telemetry data into DSDS  storage  and
     cataloging  the  resulting dataset, ingest_sci160k also gen-
     erates an index file for each station file or  tfr  file  in
     the staging directory. This index file gives the location of
     the start of each data  product  (image)  in  the  telemetry
     file.   The  index file also contains the data product code,
     packet sequence counter, number of packets and ref time  for
     the start of each data product.

     An information file is also output that contains the station
     file names, number of packets and start and end ref times in
     the station file.

     Although the module will accept either Goddard  or  Lockheed
     formatted  data,  it  was  built  with four different format
     options due to variously formatted  data  arriving.  One  of
     these  four  options are given for any run of ingest_sci160k
     by the "format=" keyword value:

     The  ingest_sci160k  is  normally   run   as   the   server,
     ingest_sci160k_svc, from a pe map file. The map file is nor-
     mally made by the dohrsc program which processes  160k  data
     from the station files through to the level 0 extracted data
     products. A typical map file would be:

     p=ingest_sci160k a=n \
       in=/stage/hrsc_tape/ \
       out=prog:mdi,level:raw,series:sci160k[1000]

     where 1000 is the output dataset series number and  will  be
     the  Goddard  tape  id  label  number  (assigned  by the MDI
     processing center at Stanford).

FILES

     MDI_HRSC.* for each station file.
     MDI_HRSC.*.index for each station file.
     ingest_hrsc_station.info with info on all station files.
     ingest_sci160k_<tid>.log the history log file.

DIAGNOSTICS

     Returns INGEST_HRSC_ERROR, defined in  soi_error.h,  on  any
     error.

BUGS

AUTHOR

     Jim Aloise

HISTORY

     1995-05-30     SOI Version 1.0