Release Notes
Detailed release notes are available on internal wiki.
Release notes summaries on this page:
28 April 2014
Data Search
- Improved the performance of searches for complex data products in cases where the file already exists in the archive.
- Reduced the size of hydrophone spectrogram and ADCP PDF files, which will allow them to be created more quickly.
- Modified ADCP current plots to explain that black areas indicate areas where there is no data.
Plotting Utility
- The Plotted Values table now displays the QAQC (quality control) flag for each data point.
- You can now choose between "Clean" and "Raw" data when plotting data using Options >> Plot Properties. "Raw" displays all data even if some values may not be valid (eg. temporary spikes). "Clean" displays only data that has passed the QAQC tests. NOTE that QAQC tests have not yet been defined for all instruments and all time ranges; if no tests are defined for your instrument and time range, "Clean" will display the same as "Raw". At this time the only way you can tell if QAQC tests are defined is to check the "Flag" column in the Plotted Values table - a 0 value means no tests defined, 1 means all QAQC tests passed, 4 means one or more QAQC tests failed. For complete definitions see the CSV or ODV (TXT) data products in Data Search.
- The information icon in Plot Properties (letter "i" in a blue dot) now gives some information about "Clean" and "Raw".
- The label under each plot now indicates whether "Clean" or "Raw" data is being displayed (again, "Clean" assumes QAQC tests have been defined for your instrument and time range).
- "Average" and "All" has been renamed to "Downsampled" and "Not Downsampled" in Plot Properties.
Internal
- Made some minor improvements to the Cruise maintenance pages.
- Created an FTP job to archive images captured by the Nikon D800 DSLR camera (which is not yet deployed).
- Added a "Take Event Sample" button for Sediment Traps in the device attribute page.
- Created a new group of Observatory level QAQC tests for mobile instruments.
2 April 2014
Digital Fishers
- Developed a new way of creating new Digital Fishers campaigns. See the Digital Fishers Campaign List item on the Tools menu. This should make it easier for non-programmers to create and test campaigns in the future before deploying them. Up to now it was not possible to view a new campaign without actually deploying it but now it can be previewed and corrected if necessary. Further improvements may be coming later. The Digital Fishers Video Management page has been hidden but is still available if needed.
- Relocated the videos played by Digital Fishers from Amazon to our internal servers.
- Upgraded SeaTube and Digital Fishers to use the latest version of JWPlayer (6.5) for streaming videos. This will allow videos from these applications to be viewed on iPhones and iPads.
Data Search
- Searches for most data products should now be faster and more reliable due to file system improvements.
- Added a hydrophone spectrograms data product choice to Data Search for the Arctic network.
- Rebranded all Data Search plots (PNG and PDF) to use the ONC logo.
- Greatly improved the speed and reliability of searches for BioSonics Echosounder .MAT data products.
- Most Arctic network data products now include metadata reports.
Data and Instruments
- Oxygen saturation data is now available from Aanderaa Oxygen Optodes located on ferries.
- Developed a parser to handle data from the navigation device used on ships we use on our maintenance cruises, and also from the navigation device used on our ROV submersibles.
Internal Features
- When a queued task is canceled, the name of the host that was running the task is now displayed.
- Did some planning and initial software development for the WARN project (Web-enabled Awareness Research Network) which will eventually provide notifications that the start of an earthquake and/or tsunami has just been detected in our area.
- Made the canceling of running tasks more robust.
- Scientific data is now written to the Cassandra database as well as to Oracle. This does not include quarterscalar data. Many other tasks were completed in the migration to Cassandra.
- Modified the driver for the Omegabus to make it more flexible.
- Migrated all Data Search data products (including metadata reports), quick plot, and Plotting Utility to use the new quarterscalardata table for all cases where data averaged over periods of 15 minutes and above are needed. This should improve performance, simplify the software, and reduce the chances of errors.
- The Simulator for the RM Young meteorological station now supports both push and pull modes.
18 February 2014
Data Search:
- Improved the rendering of hydrophone spectrograms when using the PDF format.
- Improved the contents of Data Search failure e-mails to include data options and site information.
- When data products are generated, now the status will change to "Completed" only after both the data product and metadata report have been generated.
- Sped up production of COVIS and BioSonics data products where the files already exist in the archives.
QA/QC
- Improved the QAQC section of metadata reports to show the test limits (attribute values) in some cases.
- Finished implementing Observatory level QAQC tests for all observatories (rather than just VENUS).
Other:
- In Task Monitor, tasks that cannot be cancelled while running now have their check box disabled so you cannot attempt to cancel them. As well, jobs that are in the process of being cancelled can be found by checking the new "Cancelling" checkbox in the filter area.
- Changed SensorCode to SensorName in SNMP traps from junction boxes.
- In the Junction Box Alarm page, the tabs are now in order of J number rather than breaker number.
- Made additional improvements to support the eventual switch to the Cassandra database.
- Developed a parser for the SCIMPI device.
- Modified the Site Maintenance page to handle mobile devices, such as devices mounted on ferries and drifting buoys.
- Improved the Omegabus transmitter driver/parser.
- Developed a UDP simulator for the Nikon camera.
- Developed a new parser for the Wetlabs ECO-FLS.
23 January 2014
Data Search:
- Prepared Data Search to handle the data products for the new SCIMPI device deployed to Clayoquot Slope (running autonomously for now) but will not be made searchable until the data is ready.
- Added additional data products for hydrophones, including .wav and .mp3 audio, .png and .pdf spectrograms, and .mp4 videos to show moving spectrograms with sound. Note that only limited videos are available at this time.
QAQC:
- Added a new feature to allow data files to be annotated with QAQC (quality flag) information. This can be done using the File Upload page (not yet on the menus but available to privileged users at dmas.uvic.ca/FileUpload) or by FTP. At this time the flags are only internal but will affect the QAQC information in data products in a later release.
- Added the initial code to support allowing Observatory level QAQC tests to be created for any observatory (currently only supports VENUS).
- Created a "Station Area Range Test" formula for Station level QAQC tests.
Other:
- Created a new post-processing job for hydrophone data (147).
- Created a new scheduled job (145) for hydrophone spectrogram video generation.
- Changes were made to support the archival of Slocum glider files.