This page contains the current year's release notes and new features, primarily for Oceans 2.0 / DMAS, as well as any applications created/maintained by the ONC software engineering group, including mobile Apps and desktop/PC applications. In progress project status may be presented as well.

Previous years:

The information below is written in plain language as much as possible. Detailed release notes are available on internal confluence pages (requires login).

December 3, 2019

Major release for Oceans 2.0. 

Instruments

• AIS parsing: design and investigation

• Sandbox improvements: improvements to support user's code, more usability issues
• Improvements the Community Fishers / Citizen Scientist data acquisition Android App, including app update system

Community Fishers

• Integration testing and fixes

Automated Testing

• Automated task testing framework design

• Automated webservice testing expanded coverage and test improvements
• Continuous deployment: process changes for requirements and design reviews (in progress)

Data Products

• New data product for ASL echosounders: a CSV format that's compatible with EchoView data viewing and analysis software
• New data product options for ASL echosounders: Target Strength now available for all formats, ZAP noise reduction now optional (matches ASL processing)
• A weekly long-term spectral average plot is now available for all hydrophones
• Change to support automated State of Ocean plot generation (all plots are now up to date)
• Bug fixes in these areas: CODAR, ice buoy, rotary sonar

Maintenance and Production Developer

• Replace manual search templates for State of Ocean / Environment plots and products with an automated job (deployed last month, now active)
• System console improvements: version/revision/deployment date now displayed
• Various other bug fixes and small projects

SeaTubeV3 - CANARIE & NOAA & ONC

• User interface and styling consistency for SeaTube V3
• Bug fixes

Dashboards - CANARIE

• Automated testing for sharing and video player
• Live video

MINTED - CANARIE

• UI for sitedevicesubsets and siteDevice (in progress)
• Requirements and design for versioning data, including updating DOIs (in progress)
• Citation logic and metadata improvements (in progress)

CIOOS / ERDDAP

• Mobile scalar data is now available on ERDDAP
• Saanich inlet data on CIOOS metadata server for demo only

Tickets Released: Oceans 2.0: 19.11.000 (accessible to internal users only). Total: 100.

November 7, 2019

Major release for Oceans 2.0. 

Instruments

• Fixed an issue blocking a new calibration formula

• Camera system driver improved
• Sandbox usability update complete. Starting further improvements to support user's code.
• Improvements the Community Fishers / Citizen Scientist data acquisition Android App

Community Fishers

• Handling different instruments, reliability, bugs and refactoring
• On-demand .cor file data product product

Automated Testing

• Automated UI testing tool improvements (with Selenium)

• Automated UI testing expanded coverage
• Continuous deployment: MATLAB migration from SVN to Git repository, new review process (in progress)

Data Products

• CODAR quality controlled surface currents data product revised, released and activated (available in all apps, including Data Preview), changes include:
  made grid files available in Data Search, revamped MAT file structure, updated plotting, additional GDOP testing, bug fixes, automated testing
• Bug fixes: RDI netCDF products on mobile devices, edge case on ASL echosounders and more
• Migrated code repository to Git/BitBucket, updated/modernized pathing
• Maintain and expand search automation, particularly in support of Git migration and FGDC deprecation

Maintenance and Production Developer

• Fixes to ONC websites, including converting remaining http (non-secure) pages and links
• FGDC metadata report deprecated from Data Search
• Various other bug fixes and small projects

SeaTubeV3 - CANARIE & NOAA & ONC

• Continuing fixes and various improvements for V3
• User interface panel designs and usability improvements

Dashboards - CANARIE

• Completed advanced sharing screen & permissions
• Video component improvements (in progress)

MINTED - CANARIE

• UI for sitedevicesubsets and siteDevice (in progress)
• Requirements for versioning data (in progress)

CIOOS / ERDDAP

• In progress

Tickets Released: Oceans 2.0: 19.10.000 (accessible to internal users only). Total: 95.

October 3, 2019

Major release for Oceans 2.0. 

Instruments

• Didson sonar driver

• UMN sampler parser / driver fixes
• Sandbox update (in progress)
• Finalize EEW PNSN integration

Community Fishers

• Handling different instruments, reliability, bugs and refactoring

Automated Testing

• Automated UI testing tool improvements (with Selenium)

• Automated UI testing expanded coverage
• Continuous deployment (in progress)

Data Products

• CODAR quality controlled surface currents data product deployed (not yet available to public - seeking internal user feedback)
• Bug fixes

Maintenance and Production Developer

• Project reporting scheduled job for World Data System International Technology Office
• Improved loading indicators
• New system console available
• Various other bug fixes

SeaTubeV3 - CANARIE & NOAA & ONC

• Big push to finish functional requirements for NOAA
• Useability testing and improvements (in progress)
• Click on annotation marker brings up related information
• Bug fixes

Dashboards - CANARIE

• Advanced sharing screen & permissions

MINTED - CANARIE

• UI for sitedevicesubsets (in progress)
• Requirements gathering (in progress)

CIOOS / ERDDAP

• Upgrade ERDDAP server version (to be deployed after release)
• expand coverage, include mobile sensors/device and other complex data sets (in progress)

Tickets Released: Oceans 2.0: 19.09.000 (accessible to internal users only). Total: 66.

September 4, 2019

Major release for Oceans 2.0. 

Instruments

• Didson sonar driver (in progress)

• Sandbox update (in progress)
• Community Fishers: updates to handle AML CTDs

Automated Testing

• Automated UI testing tool improvements (with Selenium)

• Expanded automation UI testing coverage
• Progress on moving toward continuous deployment

Data Products

• CODAR data products (in progress)
• Bug fixes

Maintenance and Production Developer

• Add URLs to device work flow
• Various other bug fixes

Complex Data Viewer / Hydrophone

• Gathering requirements for Aquadopp and other complex data sets

SeaTubeV3 - CANARIE & NOAA & ONC

• Annotation export, refactor to use taxon-based system
• Performance improvements
• Digital Fishers UI improvements
• Bug fixes

Dashboards - CANARIE

• bug fixes

MINTED - CANARIE

• Requirements and development ongoing

Tickets Released: Oceans 2.0: 19.08.000 (accessible to internal users only). Total: 60.

Aug 7, 2019

Major release for Oceans 2.0. HydroCal 19.06.000 released on July 24th. 

Instruments

• Didson sonar driver (in progress)

• Geographic status map for EEW
• Sandbox update is half finished: usability and task machine integration improvements
• Community Fishers: minor fixes to data pipeline

Automated Testing

• Automated UI testing tool improvements (with Selenium)

• All developers spent time adding automated UI tests to replace their manual regression tests. 52% complete, aim to finish by September.
• Oceans-Next PROD server online, pages embedded in Oceans 2.0 (these pages are in beta, not yet available to public)
• Progress on moving toward continuous deployment

Data Products

• Major HydroCal update released (July 24th). Improved support for HF calibrations, specifically:
  • Handles start/stops/reloads of calibrations much better
  • Handles loading older versions of calibration data files and settings files
  • Added ability to recover badly synchronized data by cross-correlating to target tones
  • Improved spacing around plots
  • Various UI changes to display and interaction, including warnings for missing parameters that would caused calibrations to fail
  • Fixed cal sheet mis-alignment
  • Changed a number of defaults: source voltage ramp rates, sample rates
  • Made more parameters configurable, including the low voltage alert
  • Changed filename and date stamping to the date of the data acquisition instead of file creation
  • Improved re/post-processing of the data, plus added the ability (optionally) to reprocess the reference data, including changing some parameters
  • Add quality metrics: correlation and signal to noise ratios - this allows users to compare multiple runs and pick the best result
• CODAR data products (started)
• Bug fixes

Maintenance and Production Developer

• Fixed Network Console load speed
• Support fault reset functionality on ONC "miniJB" type junction boxes
• Web service improvements and documentation (getByDevice method in the ScalarData service)
• Various other bug fixes

Complex Data Viewer / Hydrophone

• Working on complex data viewer front-end and making additional option sets available for spectrogram product generation in the back-end

SeaTubeV3 - CANARIE & NOAA & ONC

• All SeaTube V2 functionality in V3 (on Oceans-Next), plus new features
• Working on completing functions, beginning maintenance phase (after successful demo), prep for ONC and NOAA new requirements

Dashboards - CANARIE

• clean up, fixes (in progress)
• demo, development phase completion

MINTED - CANARIE

• Instrument footprints
• Scoping, requirements and development ongoing

Tickets Released: Oceans 2.0: 19.07.000 (accessible to internal users only). Total: 79.

HydroCal: HC.19.06.000 (link accessible to internal users only). Total: 22

July 4, 2019

Major release.

Instruments

• WERA Integration (added support for USORT files)

• Created a new webservice to access RDI ADCP data with averaging from specific bins. This is to provide ocean current data to Port Metro Vancouver.
• Community Fishers data access project: clean up and fixes
• Small driver changes

Automated Testing

• Automated UI testing implemented with Selenium

• All developers spent time adding automated UI tests to replace their manual regression tests
• Develop infrastructure for Oceans Next webserver
• Automated DAF testing final demo of phase 1

Data Products

• Major HydroCal update to support HF hydrophone field testing - separate release coming later in July
• RDI ADCP minor fix to comments and NaN'ing in specific scenarios

Maintenance and Production Developer

• RDI ADCP complex parser: added screening, fixed bugs and made it match Matlab data products and manufacturer's processing suite
• JIRA service desk is now available in Oceans 2.0
• Web service improvements and documentation
• Various other bug fixes

Complex Data Viewer / Hydrophone

• Requirements and implementation (in progress)

SeaTubeV3 - CANARIE & NOAA & ONC

• Primary development phase for CANARIE is ending, transition to maintenance and minor feature updates (NOAA and ONC development is ongoing)
• Completion of features, improvements and bug fixes
• Continuing moving features into SeaTubeV3 on Ocean Next webserver, to replace SeaTube Pro (current public version) and SeaTubeV2 (NOAA variant)
• Demo prep

Dashboards - CANARIE

• Primary development phase is ending, making dashboards webserver (Oceans Next) available in production
• clean up, fixes (in progress)
• Demo prep

MINTED - CANARIE

• Added concepts of batched commits and data areas to the database (in progress)

Tickets Released: Oceans 2.0: 19.06.000 (accessible to internal users only). Total: 138.

June 4, 2019

Major release.

Instruments

• WERA Integration (FTP job and file archiving)

• Community Fishers Android app: supports USB and RBR devices
• Community Fishers data access project: web portal ready, working on data pipeline
• Phytoplankton sampler drivers

Web Presence

• Website fully online for World Data System - International Technology Office 

Automated Testing

• UI improvements

• Live automatic DAF testing (nearly complete)

Data Products

• WERA animated GIF data products available in Data Search and Data Preview

Maintenance

• Internal maintenance for QA and build systems
• Security improvements on device details page
• ONC web search ordered by date
• ONC staff photos all same size
• Various other bug fixes

Complex Data Viewer / Hydrophone

• Project initiation

SeaTubeV3 - CANARIE & NOAA

• Many components updated/modified in SeaTube V2 and copied to the new Oceans Next SeaTube (V3) (in progress), including:
• Support for multiple user-configurable Digital Fishers campaigns
• Ocean Biogeographic Information System (OBIS) statistics on annotations
• Cruise Summary Reports (initial version)

Dashboards - CANARIE

• Widgets and dashboards (in progress)
• Standardized behaviour improved

MINTED - CANARIE

• Working on services (in progress)

Tickets Released: Oceans 2.0: 19.05.000 (accessible to internal users only). Total: 161.

May 1, 2019

Major release.

Instruments

• Declarative parsers: last test file integrated into declarative tests. Project complete.

• Community Fishers Android app: working on USB driver
• Community Fishers data access project: web portal ready, working on data pipeline
• New and modified drivers and parsers in support of maintenance cruises: chemical samplers, microscopes, RBR BPR and more.

Web Presence

• Website for World Data System - International Technology Office
• Website for CIOOS, CKAN server (in progress)

Automated Testing

• Added testing history

• Live automatic DAF testing (in progress)

Maintenance

• System and status console pages ready in new front-end. Allows batching of various system commands from a UI: cache reloads in particular.
• Web service fixes to date ranges: documentation and vocabulary
• Improved speed for data product upload
• Many bugs fixed in search hydrophone page: data access violations, improper file downloads
• Various other bugs

SeaTubeV3 - CANARIE

• Updates and features in initial release
• Updates to annotations, digital fishers
• Building components in new framework
• Bug fixes

Dashboards - CANARIE

• More widgets in progress
• Creating pages

MINTED - CANARIE

• Progress on assigning DOIs to datasets

Tickets Released: Oceans 2.0: 19.04.000 (accessible to internal users only). Total: 63.

April 1, 2019

Major release.

Instruments

• Declarative parsers done

• Community Fishers Android app: working on USB driver
• Community Fishers data access project: data model done, workflow design, geospatial areas defined, integration of data products and processing
• Driver and parser updates in support of upcoming field maintenance: SeaFET, STRAW driver & FTP online and more
• World magnetic model update
• Bug fixes for parsers found in DAF testing and by improved reprocessing automated testing

Web Presence

• Two conference sites created in Liferay

Automated Testing

• Improvements for reprocessing/data acquisition framework (DAF) automated testing

• Live automatic DAF testing: UI built, basic validation, checks on device attributes and topology, set up and removal of device metadata

Maintenance

• Various bug fixes
• Archiver performance improved with efficient QAQC writing
• Back-end support for sending system commands in batches, front-end in progress
• Web service updates to unify the behaviour of dateTo parameters

Earthquake Early Warning

• Small bug fixes

SeaTubeV3 - CANARIE

• Design complete for SeaTubeV3
• Building components in new framework
• Changes for NOAA

Dashboards - CANARIE

• More widgets
• Creating wrappers for base components

MINTED - CANARIE

• Progress on the base level case

Tickets Released: Oceans 2.0: 19.03.000 (accessible to internal users only). Total: 97.

March 5, 2019

Major release.

Instruments

• Declarative parsers: mitigating test cases, adding documentation

• Community Fishers Android app: working on USB driver
• Community Fishers data products and portal project: data model design, workflow design
• STRAW (test neutrino detection project) virtual machine integration and driver
• Driver and parser fixes in support of upcoming field maintenance: mini-junction box and more
• Bug fixes for parsers found by improved reprocessing automated testing

Web Presence

• Data Search "V2" released: Geospatial search and Data Search UI improvements final user testing, improvements
• Two conference sites, including a new simpler submission system

Automated Testing

• Improvements for reprocessing/data acquisition framework (DAF) automated testing

• Progress on automating manual DAF testing

Maintenance

• Various bug fixes
• Progress on improving archiving time
• Progress on metrics and event detection/reaction

Data Products

• State of Ocean product updates
• Various bug fixes

Earthquake Early Warning

• Data from PNSN (Pacific NorthWest Seismic Network) is on online and contributing
• Documentation

SeaTubeV3 - CANARIE

• Design for mobile and desktop SeaTube

Dashboards - CANARIE

• Mock-ups to stakeholders
• Building widget components

MINTED - CANARIE

• Requisition DOI's for siteDevices

Tickets Released: Oceans 2.0: 19.02.000 (accessible to internal users only). Total: 54.

February 7, 2019

Major release.

Instruments

• Declarative parsers nearly done, mitigating test cases, adding documentation

• Updates to Community Fishers Android app (bug fixes), working on RBR driver and parser
• Community Fishers data products and portal project: requirements complete, working on design

Web Presence

• Geospatial search and Data Search UI improvements final round of testing
• Conference websites

Automated Testing

• Improvements Data Search automation system

• Data Search automation coverage increased to > 90%, project complete.
• Progress on reprocessing automated testing, automated data acquisition framework testing

Maintenance

• Good progress (10 tickets): improvements to back-end, particularly sites cache
• Progress on event monitoring and metrics for data acquisition framework

Data Products

• State of Ocean data products updated to include pressure data and have consistent gap filling
• SIDSSE Underwater Ultraviolet Raman Spectrometer (UURS) data products released

Earthquake Early Warning

• Integration of PNSN (Pacific NorthWest Seismic Network) data ready to switch on

SeaTubeV3 - CANARIE

• Requirements complete, designs in progress
• Building page components

Dashboards - CANARIE

• Progress on new front-end technologies and tools (liferay)
• Requirements and mock-ups with user feedback

MINTED - CANARIE

• Investigation and requirements (no features)
• Workflows investigated

Tickets Released: Oceans 2.0: 19.01.000 (accessible to internal users only). Total: 134.

January 8, 2019

Major release. Smaller than usual due to holiday break.

Instruments

• Moved more parsers from java into declarative parsers, added more unit tests.

• Updates to sensor load system that handles variations within devicetypes for the declarative parsers.
• Adding declarative parsers to Community Fishers App
• Community Fishers data products and portal project initiation

Web Presence

• Geospatial search and Data Search UI improvements (not yet publicly available)

Automated Testing

• Improvements Data Search automation system

• Added test cases to Data Search automation (increased coverage metric from 40% to 58%, remaining cases are simple file products and scalar data products (tested elsewhere))

Maintenance

• Various bug fixes, including but not limited to:
• Cache improvements
• Add more data acquisition metrics to Grafana, add configurations and work on reactions

Data Products

• HydroCal software updated with new metadata fields (serial numbers), handling biased wav data, saturation detection, calibration m-file metadata improved, calibration m-files now produced by default.

Earthquake Early Warning

• Progress on integration of PNSN (Pacific NorthWest Seismic Network) data

SeaTubeV3 - CANARIE

• Investigation of new technologies and requirements (no features)
• Building page components

Dashboards - CANARIE

• Investigation of new technologies and requirements (no features)

MINTED - CANARIE

• Investigation and requirements (no features)

Tickets Released: Oceans 2.0: 18.12.000 (accessible to internal users only). Total: 47.

                                HydroCal App: HC.18.12.000 (accessible to internal users only). Total: 1.