Pipeline As a Web Service (PAWS)
On demand data reduction from the AAT archive
2dFdr PAWS
A test version of our 2dFdr Pipeline As a Web Service (PAWS) is now available from https://beta.datacentral.org.au/query.
This page contains some initial documentation that we will grow over time.
The 2dFdr PAWS system allows users to request On Demand reductions of 2dF+AAOmega observations.
Reductions will take place on Data Central systems without users having to worry about downloading data or installing 2dFdr.
Instructions
The current workflow is as follows:
- Load the query page of the new AAT archive from the link above.
- Select Instrument: 2dF+AAOmega.
- Select Observation Type: OBJECT
- Enter other details to find observations you want to reduce.
- Ensure you are logged in via your Data Central credentials (Login button at top right of page)
- Once logged in, select data you want reduced.
- Click the Reduce with 2dFdr PAWS button.
- A new tab (popup) will appear, asking you to select some default parameters.
- Click the Make it so button to submit the job.
- You will receive an email at the start and end of each job.
- The status of your jobs may be seen at https://paws.datacentral.org.au/status
- Once files are reduced you may select from several download options or explore the data interactively.
- When appropriate, spectra from different gratings (e.g. 580V and 385R) are spliced together.
- A pdf of each reduced data product are also produced (individual reduced frames and spliced spectra).
Caveats and notes
- The initial set of 2dFdr parameters is not exhaustive and may be revised based upon user feedback.
- For testing purposes we currently use 2dFdr 7.3. This will be updated in the near future.
- The 2dFdr version used is logged to log.2dfdr_aaorun_version.txt in the data products folder.
- Log files record the output of individual 2dFdr commands (executed via the command line aaorun program).
- Flux standards are not yet included in the reductions, even if requested (ndf_class of MFFLX).
- You do not need to selection calibration files, only science observations (ndf_class of MFOBJECT).
- The scripts that prepare the data for reduction searches the AAT archive for calibrations within:
- 30 days (Arcs and Flat Fields) and,
- 90 days (Biases and Darks).
- We may revisit these windows if users encounter difficulties.
- The scripts that prepare the data for reduction searches the AAT archive for calibrations within:
Feedback
- Please contact us to give feedback