Environment Canada Signature Bar Canada Wordmark
Meteorological Service of Canada français Contact Us WMO

World Ozone and Ultraviolet Radiation Data Centre (WOUDC)

 
Introduction
Contributors
Data
Publications
Related Links
Updates
Meetings
Documentation
Software
Help
Home

How to Use the Data Archive

Table of Contents

  1. General Registration and Data Submission Information
  2. Data Submission - Procedures
  3. The extCSV File Format Standard for Data Submission
  4. Data Set Security Issues
  5. Data Retrieval
  6. Acknowledgement of Data Sources
  7. Further Information

1. General Data Submission Information

The WOUDC file format standard for data submission is the Extended Comma Separated Values (extCSV) Format. The extCSV format was designed and developed by E.J. Carty and E.W. Hare for use at the WOUDC, but the file format standard may be used for other data management applications. The WOUDC will continue to accept WODC data submitted in the old 80-column format, however, data originators are encouraged to use the extCSV data format standard.

Submission of data files is done using personal file transfer protocol (ftp) accounts assigned to data originators by the WOUDC. Data submitted on paper forms, diskettes or CDs will be also accepted.


2. Data Submission - Procedures

Application Process

If you are a first time data originator or you currently submit data to the WOUDC and would like to apply for a personal ftp account, follow the instructions listed below.

Data orginators are asked to follow the five steps below for arranging data submissions to the WOUDC for ozone and/or UV data sets.

Five Steps

Step 1: Write a Data Sponsorship Statement (DSS) using the template given here (if appropriate). Contact the WOUDC for assistance or clarification if needed. Also refer to the UV Guide or Ozone Guide. A DSS provides a valuable description of the instrument maintenance and calibration history and originators of data are encouraged to submit a DSS.

NOTE: An DSS will provide the detailed description of the data quality including calibration, quality control and measurement accuracy. It can also stipulate conditions under which the data may be used. Refer to the Data Set Security Issues section for details. This file can be an ASCII text, PDF or HTML file named as follows: AGENCY ID_DSS.txt, AGENCY ID_DSS.pdf or AGENCY ID_DSS.html respectively. For example, the agency Meteorological Service of Canada, with the agency ID of MSC, will have a DSS named MSC_DSS.txt, MSC_DSS.pdf or MSC_DSS.html.

Step 2: Submit to the WOUDC a completed DSS along with an Agency (data originator) Profile. An Agency Form is available under the section Application Forms: Agency Statement.

Step 3: Upon approval of the DSS and Agency Profile, a data submission agreement will be established whereby the details of the file format for submission may be negotiated between the data originator and the WOUDC. If special agreements, provisos, or security restrictions are required, they will be established at this point. Refer to the Data Set Security Issues section of this web page.

Step 4: The WOUDC will assign an FTP account (with a personal username/password) to be used exclusively for data submission. Data may also be submitted using other media such as email, CD-ROM or DVD.

Step 5: The frequency of data submission is suggested to be monthly.

Application Forms


3. The extCSV File Format Standard for Data Submission

Comma Separated Value (CSV) is a common file format that can be directly imported into database, spreadsheet and analysis applications. Written in ASCII, these files are portable to differing computer platforms. The WOUDC has extended the standard CSV syntax rules to support comments and multiple data content within individual files. The "Extended CSV" (extCSV) is now the WOUDC standard file format for data submission.

A Brief Description of the Extended CSV (extCSV) File Format

The extCSV file submission format provides the data originator the option to submit data at much higher temporal or spatial resolution than the traditional WODC 80-column data sets. This format is also used for WOUDC file output products.

Information about the extCSV data file format is available on the documentation page with examples of individual data types, formatted in extCSV.


4. Data Set Security Issues

The WOUDC data output is freely available for public use and all files are write protected with read only access. There are special circumstances, however, which require a single user or group of users to have the ability to freely exchange data at a level of security which permits both read and write access to that specified group. Link to the Data Set Security Issues page for a more detail led description of of data s ecurity issues.

In response to this need for a higher level of security, special "secure" directories and user access through a specified username/password will be made available to interested individuals or groups. The general procedure to access these new directories by means of the Internet File Transfer Protocol (FTP) will remain the same, just the username and password will be different. Files and documentation may then be freely exchanged within this second level and be protected from "public" viewing. These options are available to data originators. Refer to the options in the WOUDC Data Submission Agreement.

The submission of data either to the "secure" or public directories is acceptable, the latter being preferred. Originators should note that users of public data are advised by the WOUDC to abide at all times by whatever stipulations the originator has requested. Refer to the Data User's Protocol Form.

To get special directory access, the user will have to complete the information and sign the Data User's Protocol Form before access is granted.


5. Data Retrieval

All data posted by the WOUDC reside on an FTP server which is accessible from this web site through your web-viewer. To connect to the archive, go to the data page. However, when downloading a large number of files, it is recommended to use ftp application software which will require a special username and password. Contact the WOUDC for this information.

The data contained within the WOUDC Data Archive are to be used for non-profit, scientific and educational purposes only. The WMO Executive Council/Committee on Atmospheric Sciences (EC/CAS) Panel of Experts Working Group on Environmental Pollution and Atmospheric Chemistry remind users of the data to acknowledge and honour the following statement.

"For Scientific purposes, access to these data is unlimited and provided without charge. By their use you accept that an offer of co-authorship will be made through personal contact with the data providers or owners whenever substantial use is made of their data. In all cases, an acknowledgement must be made to the data providers or owneres and to the data centre when these data are used within a publication."



The general directory structure of the WOUDC ftp site is as follows:

  • Archive-New Format
  • Documentation
  • Metadata
  • Other Data
  • Projects-Campaigns
  • Publications
  • Software
  • Summaries

The Archive New-Format directory contains the extended Comma Separated Values (or extCSV) formatted data files. These files are now the WOUDC standard file format for posting data sets.

The Documentation directory contains meeting reports and guidebooks.

The Metadata directory contains agency information and data revision histories.

The Other Data directory contains data files submitted to the WOUDC in a "non-standard" file format. In some cases, the WOUDC has reformatted these data to conform to the new extCSV format.

The Projects-Campaigns directory contains data from special projects, campaigns or assessments. The format of the data files in this directory will vary depending upon the project needs.

The Publications directory contains Data Publications on DVD and Meeting reports.

The Software directory contains data file format converter routines and data QA and processing programs.

The Summaries directory contains "value added" summary data sets based on either ozone or UV data extracted from the WOUDC archive. The format of these data files may vary to suit the specific needs of either the WOUDC or users of the data. Refer to the Data Summaries and Reports section on the main data page.

General Data Disclaimer

The WOUDC reserves the right to limit access to the Data Archive and to alter or change the layout and content of both this web site and ftp site without notice.

Interested data clients are reminded that the data within the archive must be considered preliminary. While the WOUDC examines data sets for format and ranges of values, the originators of these data are ultimately responsible for data quality, and should always be consulted if there are questions.


6. Acknowledgement of Data Sources

When publishing data retrieved from the WOUDC, you are expected to acknowledge the WOUDC and the agencies who author these data as the data source using the following citation rules.

7. Further Information

Contact the WOUDC should you require further assistance with accessing or retrieving data.


Formats : [Print]
Skip to page content (access key:2)
Created : 2002-12-31
Modified : 2009-03-26
Url of this page : http://www.woudc.org/data/UsingArchive_e.html