Skip to end of metadata
Go to start of metadata

COVIS Plume Doppler Raw Data Files

This is a description of this raw DOPPLER mode data from COVIS.

Oceans 2.0 API filterdataProductCode=CPDRF

Revision History

  • 20111123: Initial product released

Formats

TAR

The TAR.GZ files contain the raw data and the metadata needed to process and interpret in files of CSV, JSON and BIN formats. The following table lists the types of files and the information each contains. All of the JSON files are ascii text and human readable (with some effort). Similarly the CSV files can be read directly as ascii or loaded into a spreadsheet program like Excel. The BIN files are binary. Further details are supplied within the examples below.

File Type

Contents

sweep.json

Main metadata including timestamp, acquisition mode (“imaging”), and various sonar parameters (transmit pulse length, frequency, etc.). Some parameters can be set by direct interaction with the sonar and some are fixed.

attitude.csv

This contains data from the attitude sensor (time, pitch, roll, heading). All measurements are in degrees. Pitch and Roll are gravity referenced. Heading is magnetic. There is one record per rotator stop.

rotator.csv

This file contains data from the rotator motors (pitch, roll, yaw). All measurements are in degrees relative to an arbitrary reference. There is one record per rotator stop.

index.csv

This file is derived from the above two files but contains one record per sonar ping. It lists the pings (numbering from 1 up) and gives the time (seconds, microseconds), rotator data (pitch, roll, yaw), and attitude data ( pitch, roll, heading) for each ping.

rec_7000_xxxxxx.json

These are the metadata for each ping. Some of this information may overlap with sweep.json and some of it is set by the experimenter.

rec_7038_xxxxxx.bin

These are the actual data files ping-by-ping. They are in binary format. There should be one rec_7038_x.bin for every rec_7000_x.json.

 

Oceans 2.0 API filter: extension=tar

 

Examples:

The examples are from APLUWCOVISMBSONAR001_20101001T121520.649Z-DOPPLER.tar.gz

attitude.csv – This the first three lines of a particular file.

time	kPAngle	kRAngle	kHeading
15:20.8	18.73	0.07	213.98
15:29.1	19.69	0.07	214.08

where

  • time is the minutes:seconds at which the data is measured.
  • kPAngle is the pitch in degrees
  • kR Angle is the roll in degrees
  • kHeading is the magnetic direction (in degrees) the sonar is pointing

index.csv – This the first three lines of a particular file.

ping	seconds	microseconds	pitch	roll	yaw	kPAngle	kRAngle	kHeading
1	1.29E+09	145954	201.3	225.5	132	18.7	0.1	214
2	1.29E+09	351400	201.3	225.5	132	18.7	0.1	214

where the columns are

  • Ping is the ping number. It always starts at 1.
  • Seconds
  • Microseconds
  • Pitch is from the same data as in rotator.csv
  • Roll is from the same data as in rotator.csv
  • Yaw is from the same data as in rotator.csv
  • kPAngle is from the same data as in attitude.csv
  • kRAngle is from the same data as in attitude.csv
  • kHeading is from the same data as in attitude.csv

Note that the attitude and rotator data should be consistent but may disagree since they are independently measured.

rotator.csv

time	pitch	roll	yaw
15:20.8	201.3	225.5	132
15:29.1	200.2	225.5	132

where the columns are

  • Time in minutes:seconds.deciseconds
  • Pitch in degrees
  • Roll in degrees
  • Yaw in degrees
    --------

rec_7000_xxxxxx.json – Reson format for ascii metadata file documented in rec7000.pdf 

rec_7038_xxxxxx.bin – Reson format for binary data documented in rec7008.pdf 

Discussion

Note that the data format is basically the same for the Doppler and Imaging imaging modes (the Diffuse mode is slightly different mostly because the pitch of the sonar is constant).

The difference in the modes relates to the sonar setup, that is which receiver and transmitter are used or what pulse length is used. The table below listed the relevant parameters for each period of ongoing operation.

  • The Doppler mode uses a larger pulse length and a higher ping count to increase averaging; the reliability of the eventual velocity estimates depends on the amount of averaging possible.
  • The Imaging mode uses a shorter pulse length to increase the resolution of the resulting image. Resolving smaller details is more important here than increasing the averaging power, especially as the backscatter intensity estimates are fairly robust.
  • The Diffuse mode differs in using the shortest pulse length (for high resolution of smaller features) and it is the only mode to use the 200 kHz transmitter.

Sweep count, start position, position increments, position steps, and settling time control the operation of the rotators. Ping count, ping rate, and delay control the overall collection of pings as well as how the pings are coordinated with the rotator motions. Two different source transducers are available (200 kHz and 400 KHz); different modes use different transmitters. The sonar range controls how long the sonar listens and records for each ping (sufficient time for two way travel over the specified range). The pulse width controls the resolution along the ping. Transmit power controls the energy put into the water with each ping. Reciever gain controls how much the received signal is amplified before digitizing. All the rest of the relevant parameters (like sampling rate for the digitization) are the same for all three modes. This information is collected in the sweep.json files, whether it varies between mode or not.

STARTTIMESEQUENCESEQUENCEPARAMETERSPLUMEDOPPLERDIFFUSE
DATE(UTC)RATE (HOURS)DESCRIPTION
05/10/201022:006PlumeSweep Count321
PlumeStart Position (P deg, R deg, M deg)0021220021200212
PlumePosition Increments (deg, deg, deg)100100100
DopplerPosition Steps63401
DopplerSettling Time000
Diffuse
Ping Count22010
Ping Rate (Hz)555
Delay012n/a
Source Transducertc2160_400khztc2160_400khztc2162_200khz
Sonar Range (m)757550
Pulse Width (mS)11.50.3
Transmit Power (dB)220220200
Receiver Gain (dB)404030
09/10/20100:003PlumeSweep Count321
PlumeStart Position (P deg, R deg, M deg)0021220021200212
PlumePosition Increments (deg, deg, deg)100100100
DopplerPosition Steps63401
DopplerSettling Time000
Diffuse
Ping Count22010
Ping Rate (Hz)555
Delay012n/a
Source Transducertc2160_400khztc2160_400khztc2162_200khz
Sonar Range (m)757550
Pulse Width (mS)11.50.3
Transmit Power (dB)220220200
Receiver Gain (dB)404030
23/10/20100:003PlumeSweep Count321
PlumeStart Position (P deg, R deg, M deg)0021220021200212
PlumePosition Increments (deg, deg, deg)100100100
DopplerPosition Steps63401
DopplerSettling Time000
Diffuse
Ping Count22010
Ping Rate (Hz)555
Delay012n/a
Source Transducertc2160_400khztc2160_400khztc2162_200khz
Sonar Range (m)757550
Pulse Width (mS)11.50.3
Transmit Power (dB)220220200
Receiver Gain (dB)505030
23/10/20103:003PlumeSweep Count321
PlumeStart Position (P deg, R deg, M deg)0021220021200212
PlumePosition Increments (deg, deg, deg)100100100
DopplerPosition Steps63401
DopplerSettling Time000
Diffuse
Ping Count22010
Ping Rate (Hz)555
Delay012n/a
Source Transducertc2160_400khztc2160_400khztc2162_200khz
Sonar Range (m)757550
Pulse Width (mS)11.50.3
Transmit Power (dB)220220200
Receiver Gain (dB)404030
26/10/20100:003PlumeSweep Count321
PlumeStart Position (P deg, R deg, M deg)20021220021200212
PlumePosition Increments (deg, deg, deg)100100100
DopplerPosition Steps43401
DopplerSettling Time000
Diffuse
Ping Count22010
Ping Rate (Hz)555
Delay012n/a
Source Transducertc2160_400khztc2160_400khztc2162_200khz
Sonar Range (m)757550
Pulse Width (mS)11.50.3
Transmit Power (dB)220220200
Receiver Gain (dB)505030
Sep-11
STARTTIMESEQUENCESEQUENCEPARAMETERSPLUMEDOPPLERDIFFUSE
DATE(UTC)RATEDESCRIPTION
26/09/201118:003PlumeSweep Count321
PlumeStart Position (P deg, R deg, M deg)20021220021200212
PlumePosition Increments (deg, deg, deg)100100100
DopplerPosition Steps43401
DopplerSettling Time000
Diffuse
Ping Count22010
Ping Rate (Hz)555
Delay012n/a
Source Transducertc2160_400khztc2160_400khztc2162_200khz
Sonar Range (m)757550
Pulse Width (mS)11.50.3
Transmit Power (dB)220220200
Receiver Gain (dB)505030
NC SCHEDULED MAINTAINANCE SHUTDOWN, LAST COVIS OPERATION 9/27/11, 1200 UTC
STARTTIMESEQUENCESEQUENCEPARAMETERSPLUMEDOPPLERDIFFUSE
DATE(UTC)RATEDESCRIPTION
28/09/20110:003PlumeSweep Count321
PlumeStart Position (P deg, R deg, M deg)20021220021200212
PlumePosition Increments (deg, deg, deg)100100100
DopplerPosition Steps43401
DopplerSettling Time000
Diffuse
Ping Count22010
Ping Rate (Hz)555
Delay012n/a
Source Transducertc2160_400khztc2160_400khztc2162_200khz
Sonar Range (m)757550
Pulse Width (mS)11.50.3
Transmit Power (dB)220220200
Receiver Gain (dB)535030
Run Time Esimate (min)10.0947.55
STARTTIMESEQUENCESEQUENCEPARAMETERSPLUMEDOPPLERDIFFUSE
DATE(UTC)RATEDESCRIPTION
14/10/20110:003PlumeSweep Count111
DopplerStart Position (P deg, R deg, M deg)20021220021200212
DiffusePosition Increments (deg, deg, deg)100100100
Position Steps43401
Settling Time000
Ping Count64010
Ping Rate (Hz)225
Delay4240
Source Transducertc2160_400khztc2160_400khztc2162_200khz
Sonar Range (m)757550
Pulse Width (mS)0.51.50.3
Transmit Power (dB)220220200
Receiver Gain (dB)535030
Run Time Esimate (min)11.9760.47
Approx Run Time Actual (min)1667
STARTTIMESEQUENCESEQUENCEPARAMETERSPLUMEDOPPLERDIFFUSE
DATE(UTC)RATEDESCRIPTION
14/10/20113:003PlumeSweep Count111
DopplerStart Position (P deg, R deg, M deg)20021220021200212
DiffusePosition Increments (deg, deg, deg)100100100
Position Steps43401
Settling Time000
Ping Count64010
Ping Rate (Hz)225
Delay290
Source Transducertc2160_400khztc2160_400khztc2162_200khz
Sonar Range (m)757550
Pulse Width (mS)0.51.50.3
Transmit Power (dB)220220200
Receiver Gain (dB)535030
Run Time Esimate (min)9.140.47
Approx Run Time Actual (min)10.736.2
STARTTIMESEQUENCESEQUENCEPARAMETERSPLUMEDOPPLERDIFFUSE
DATE(UTC)RATEDESCRIPTION
14/10/20116:003PlumeSweep Count111
DopplerStart Position (P deg, R deg, M deg)20021220021200212
DiffusePosition Increments (deg, deg, deg)100100100
Position Steps43401
Settling Time000
Ping Count64010
Ping Rate (Hz)225
Delay2100
Source Transducertc2160_400khztc2160_400khztc2162_200khz
Sonar Range (m)757550
Pulse Width (mS)0.51.50.3
Transmit Power (dB)220220200
Receiver Gain (dB)535030
Run Time Esimate (min)9.141.8
Approx Run Time Actual (min)10.738.6
NC SCHEDULED MAINTAINANCE SHUTDOWN, LAST COVIS OPERATION 11/14/11, 2100 UTC
STARTTIMESEQUENCESEQUENCEPARAMETERSPLUMEDOPPLERDIFFUSE
DATE(UTC)RATEDESCRIPTION
29/11/20110:003PlumeSweep Count111
DopplerStart Position (P deg, R deg, M deg)20021220021200212
DiffusePosition Increments (deg, deg, deg)100100100
Position Steps43401
Settling Time000
Ping Count64010
Ping Rate (Hz)225
Delay2100
Source Transducertc2160_400khztc2160_400khztc2162_200khz
Sonar Range (m)757550
Pulse Width (mS)0.51.50.3
Transmit Power (dB)220220200
Receiver Gain (dB)535030
Run Time Esimate (min)9.141.8
Approx Run Time Actual (min)10.738.6

To comment on this product, click Add Comment below.

  • No labels