Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.
Wiki Markup
h2. Data Products

Here's the place to learn and talk about our data products -- both current and future.

h3. Featured Data Product

[Metadata|http://wiki.neptunecanada.ca/display/DP/Metadata] is now available with many different data products. New data products include: COVIS [Diffuse|http://wiki.neptunecanada.ca/display/DP/41] and [Imaging|http://wiki.neptunecanada.ca/display/DP/40] plots and mat files, [Kongsberg Rotary|http://wiki.neptunecanada.ca/display/DP/48], [BioSonics MAT|http://wiki.neptunecanada.ca/display/DP/19], VPS cast (IDs [56|http://wiki.neptunecanada.ca/display/DP/56] through [60|http://wiki.neptunecanada.ca/display/DP/60]), [Time Series Scalar Profile Plot|http://wiki.neptunecanada.ca/display/DP/61] (only available for profiling devices). Available in the next release: [Nortek ADCP Ensemble-Averaged MAT and NetCDF|http://wiki.neptunecanada.ca/display/DP/62].



{section}{column:width=50%}

h3. Current Data Products

|| ID || NEPTUNE Canada \\ || || ID \\ || Interoperability Partners \\ ||
| 1 | [Time Series Scalar Data|1] | | 15 | [ISDM Data Product|DP:15] \\ |
| 2 | [Time Series Scalar Plot|DP:2] \\ | | 16 \\ | [PANGAEA Data  Product|DP:16] |
| 3 | [Borehole Temperature Time Series Plot|DP:3] \\ | | 17 \\ | [POKM Data  Product|DP:17] |
| 4 | [Log File|DP:4] \\ | | | |
| 5 | [RDI ADCP Time Series|DP:5] \\ | | | |
| 7 | [WAV Audio File|DP:7] \\ | | | |
| 8 | [CSV With NaNs|DP:8]\\ | | | |
| 9 | [RDI ADCP Daily Current Plot|DP:9] | | | |
| 10 | [RDI ADCP Daily Intensity Plot|DP:10] | | | |
| 11 | [RDI ADCP Daily Correlation Plot|DP:11] | | | |
| 12 | [RDI ADCP Daily Percent Good Plot|DP:12] | | | |
| 14 | [Video File|DP:14] | | | |
| 18 | [AGO Time Series  Plot|DP:18] | | | |
| 19 | [BioSonics Time Series|DP:19] | | | |
| 20 | [Satlantic ISUS Time Series|DP:20] | | | |
| 21 | [Time Series Staircase Plot|DP:21] | | | |
| 22 | [Nortek Profiler Time Series|DP:22] \\ | | | |
| 24 | [ASL AWCP Time Series|DP:24] \\ | | | |
| 25 | [CSEM Receiver Time Series|DP:25] \\ | | | |
| 26 | [RDI Wave Time Series|DP:26] \\ | | | |
| 27 | [Satlantic Radiometer Time Series|DP:27] \\ | | | |
| 33 | [COVIS Plume Imaging Raw Files|DP:33] | | | |
| 34 | [COVIS Diffuse Flow Raw Files|DP:33] | | | |
| 35 | [COVIS Plume Doppler Raw Files|DP:35] | | | |
| 36 \\ | [RDI ADCP Ensemble-Averaged Time Series|DP:36] \\ | | | |
| 40 \\ | [COVIS Plume Imaging Time Series|http://wiki.neptunecanada.ca/display/DP/40] \\ | | | |
| 41 \\ | [COVIS Diffuse Flow Time Series|http://wiki.neptunecanada.ca/display/DP/41] \\ | | | |
| 48 \\ | [Kongsberg Mesotech Rotary Sonar Data Product|http://wiki.neptunecanada.ca/display/DP/48] \\ | | | |
| 49 \\ | [Nortek Profiler Daily Currents Plot|DP:49] \\ | | | |
| 52 | [Imagenex Data Product|DP:52] | | | |
| 56 \\ | [Time Series Scalar VPS Cast Data Product|http://wiki.neptunecanada.ca/display/DP/56] \\ | | | |
| 57 \\ | [Satlantic Radiometer VPS Cast Data Product|http://wiki.neptunecanada.ca/display/DP/57] \\ | | | |
| 58 \\ | [Nortek Time Series VPS Cast Data Product|http://wiki.neptunecanada.ca/display/DP/58] \\ | | | |
| 59 \\ | [Satlantic ISUS VPS Cast Data Product|http://wiki.neptunecanada.ca/display/DP/59] \\ | | | |
| 60 \\ | [ASL AWCP VPS Cast Data Product|http://wiki.neptunecanada.ca/display/DP/60] \\ | | | |
| 61 \\ | [Time Series Scalar Profile Plot|http://wiki.neptunecanada.ca/display/DP/61] \\ | | | |
| 62 \\ | [Nortek ADCP Ensemble-Averaged MATTime and NetCDFSeries|http://wiki.neptunecanada.ca/display/DP/62]\\ | | | |
{column}\\
{column:width=50%}

h3. Metadata

[Metadata|http://wiki.neptunecanada.ca/display/DP/Metadata] reports are now available with many different data products, including the scalar data products. These PDF reports are produced automatically when a data search is completed and are made available via a link adjacent to the data, see step 3 in [data search help|http://wiki.neptunecanada.ca/display/help/Data+Search+Help]. The reports contain extensive information about the data, including instrument location, deployment, calibration, data quality and data gaps.


h3. Conventions

*Timestamps:* Timestamps are always in UTC and follow the  ISO8601 convention: yyyymmddTHHMMSS.FFFZ. In some cases, the millisecond  portion is omitted.

*Filenames:* Note that the underscore character, "_", is used to separate the components of the names. It is also used to replace any spaces in the name to maintain compatibility.

For an instrument type search, files are named as DEVICECODE\_{color:#000000}SENSORCODE{color}\_yyyymmddTHHMMSSZ\-{color:#000000}MODE{color}.EXT where:

* DEVICECODE is a descriptive string unique to each instrument.
* SENSORCODE is a string unique to each sensor, and is only included if a single-sensor data product was requested.
* yyyymmddTHHMMSSZ is the timestamp (ISO8601 format) which represents  the initial time for data in the file. May have millisecond information: yyyymmddTHHMMSS.FFFZ, where 'FFF' are the milliseconds.
* MODE is optional text which allows files to be differentiated, as  necessary, when they refer to the same device and share the same  extension. For instance, the VPS cast products supply the end date here.
* EXT is the file extension.

For location search, files are named as STATIONNAME\_{color:#000000}DEVICECATEGORY{color}\_SENSORNAME_yyyymmddTHHMMSSZ\-{color:#000000}MODE{color}.EXT where
* STATIONNAME is the station name, including site tree nodes separated by dashes, for example: _BarkleyCanyon-VPSUpperSlope._
* {color:#000000}DEVICECATEGORY{color} is the device category, such as 'CTD'. If there is more than one device in the category, the file will contain multiple devices.
* SENSORNAME is the sensor name and is omitted for a device-level data product that contains multiple sensors.
* yyyymmddTHHMMSSZ is the timestamp (ISO8601 format) which represents  the initial time for data in the file. May have millisecond information: yyyymmddTHHMMSS.FFFZ, where 'FFF' are the milliseconds.
* MODE is optional text which allows files to be differentiated, as   necessary, when they refer to the same device and share the same   extension. For instance, the VPS cast products supply the end date here.
* EXT is the file extension.

h3. File formats

Additional resources for available file formats is available [here|DP:File Formats].









!data_products_mosaic.png|border=1,align=center!
{column}
{section}
If you have any data product related questions or would like to see additional data products, please [let us know|contact:Contact us].
{recently-updated}
----
{portal:USER_PORTAL}

h3.