e2e - Module

Description

This is experimental and under rapid development: please do not use!

The NRAO End-to-End project (e2e) has the goal of providing end-to-end processing of data from telescopes. This is being developed for NRAO telescopes (VLA, VLBA, GBT, EVLA), but is being designed for general use.

The e2e module implements two inter-related services.

An archive: A repository for observations from telescopes, and for pipeline-processed results.
A pipeline: A facility for processing data from specific projects in the archive, and inserting processed results in the archive.

These services are designed to be used both from within AIPS++ and from the web.

An overview of the tools:

e2ecatalogs: is responsible for constructing and accessing catalogs.
e2epipeline: is responsible for constructing and executing scripts to process data.
e2epipelinequery: is responsible for serving queries to e2epipeline.
e2emakefiles: contains the various Glish makefiles that process data.
e2estandards: is responsible for specifying standard values to be used in processing (e.g. cellsizes, image sizes, solution intervals, etc.).
e2epublish: is responsible for publishing results to a standard location, as FITS files, and with information web pages.
e2emsutils: has utility helper functions for MeasurementSet access.
e2eimagingutils: has utility helper functions for imaging.
e2edisplayutils: has utility helper functions for display.
e2epipelineutils: has utility helper functions for the pipeline.
e2echromepipe: connects glish to a web server.

This module uses a standard directory layout, rooted at the environmental variable E2EROOT. This allows various and mirrored copies of archives to be used. However, the subdirectory structure must be as expected.

archive: Archive root
archive/catalogs: Catalogs
archive/catalogs/TELESCOPE: Catalogs for telescope TELESCOPE
archive/data: Original (and untouched) data
archive/data/TELESCOPE: Data for telescope TELESCOPE. This directory and below have telescope-dependent contents to reflect the differing nature of data from various telescopes.
archive/data/VLA/tapes: Data tape images for the VLA.
archive/results: Results from processing
archive/results/projects: Results from processing for projects
archive/results/projects/PROJECT: Results from processing for project PROJECT. All results must be indexed by a file PROJECT.html or PROJECT.xml.
archive/results/calibrators: Calibrator source list
processing: Processing area root. This has little substructure as yet.

Tools

e2ecatalogs	Tool for constructing catalogs for e2e processing
e2echromepipe	Connects glish to a web server
e2edisplayutils	Helper tool for e2e processing
e2eimagingutils	Helper tool for e2e processing
e2emakefiles	Tool for makefiles for e2e processing
e2emsutils	Helper tool for e2e processing
e2epipeline	Tool for pipeline processing
e2epipelineutils	Helper tool for e2e processing
e2epublish	Tool for publishing results of e2e processing
e2estandards	Tool for providing standards for e2e processing
mscatalog	Tool for constructing catalogs of MeasurementSets

Next: mscatalog - Tool Up: NRAO Previous: vlafillertest - Function Contents Index