This page contains the current year's release notes and new features, primarily for Oceans 2.0 / DMAS, as well as any applications created/maintained by the ONC software engineering group, including mobile Apps and desktop/PC applications. In progress project status may be presented as well.
Previous years:
The information below is written in plain language as much as possible. Detailed release notes are available on internal confluence pages (requires login).
December 3, 2019
Major release for Oceans 2.0.
Instruments
AIS parsing: design and investigation
- Sandbox improvements: improvements to support user's code, more usability issues
- Improvements the Community Fishers / Citizen Scientist data acquisition Android App, including app update system
Community Fishers
- Integration testing and fixes
Automated Testing
Automated task testing framework design
- Automated webservice testing expanded coverage and test improvements
- Continuous deployment: process changes for requirements and design reviews (in progress)
Data Products
- New data product for ASL echosounders: a CSV format that's compatible with EchoView data viewing and analysis software
- New data product options for ASL echosounders: Target Strength now available for all formats, ZAP noise reduction now optional (matches ASL processing)
- A weekly long-term spectral average plot is now available for all hydrophones
- Change to support automated State of Ocean plot generation (all plots are now up to date)
- Bug fixes in these areas: CODAR, ice buoy, rotary sonar
Maintenance and Production Developer
- Replace manual search templates for State of Ocean / Environment plots and products with an automated job (deployed last month, now active)
- System console improvements: version/revision/deployment date now displayed
- Various other bug fixes and small projects
SeaTubeV3 - CANARIE & NOAA & ONC
- User interface and styling consistency for SeaTube V3
- Bug fixes
Dashboards - CANARIE
- Automated testing for sharing and video player
- Live video
MINTED - CANARIE
- UI for sitedevicesubsets and siteDevice (in progress)
- Requirements and design for versioning data, including updating DOIs (in progress)
- Citation logic and metadata improvements (in progress)
CIOOS / ERDDAP
- Mobile scalar data is now available on ERDDAP
- Saanich inlet data on CIOOS metadata server for demo only
Tickets Released: Oceans 2.0: 19.11.000 (accessible to internal users only). Total: 100.
November 7, 2019
Major release for Oceans 2.0.
Instruments
Fixed an issue blocking a new calibration formula
- Camera system driver improved
- Sandbox usability update complete. Starting further improvements to support user's code.
- Improvements the Community Fishers / Citizen Scientist data acquisition Android App
Community Fishers
- Handling different instruments, reliability, bugs and refactoring
- On-demand .cor file data product product
Automated Testing
Automated UI testing tool improvements (with Selenium)
- Automated UI testing expanded coverage
- Continuous deployment: MATLAB migration from SVN to Git repository, new review process (in progress)
Data Products
- CODAR quality controlled surface currents data product revised, released and activated (available in all apps, including Data Preview), changes include:
made grid files available in Data Search, revamped MAT file structure, updated plotting, additional GDOP testing, bug fixes, automated testing - Bug fixes: RDI netCDF products on mobile devices, edge case on ASL echosounders and more
- Migrated code repository to Git/BitBucket, updated/modernized pathing
- Maintain and expand search automation, particularly in support of Git migration and FGDC deprecation
Maintenance and Production Developer
- Fixes to ONC websites, including converting remaining http (non-secure) pages and links
- FGDC metadata report deprecated from Data Search
- Various other bug fixes and small projects
SeaTubeV3 - CANARIE & NOAA & ONC
- Continuing fixes and various improvements for V3
- User interface panel designs and usability improvements
Dashboards - CANARIE
- Completed advanced sharing screen & permissions
- Video component improvements (in progress)
MINTED - CANARIE
- UI for sitedevicesubsets and siteDevice (in progress)
- Requirements for versioning data (in progress)
CIOOS / ERDDAP
- In progress
Tickets Released: Oceans 2.0: 19.10.000 (accessible to internal users only). Total: 95.
October 3, 2019
Major release for Oceans 2.0.
Instruments
Didson sonar driver
- UMN sampler parser / driver fixes
- Sandbox update (in progress)
- Finalize EEW PNSN integration
Community Fishers
- Handling different instruments, reliability, bugs and refactoring
Automated Testing
Automated UI testing tool improvements (with Selenium)
- Automated UI testing expanded coverage
- Continuous deployment (in progress)
Data Products
- CODAR quality controlled surface currents data product deployed (not yet available to public - seeking internal user feedback)
- Bug fixes
Maintenance and Production Developer
- Project reporting scheduled job for World Data System International Technology Office
- Improved loading indicators
- New system console available
- Various other bug fixes
SeaTubeV3 - CANARIE & NOAA & ONC
- Big push to finish functional requirements for NOAA
- Useability testing and improvements (in progress)
- Click on annotation marker brings up related information
- Bug fixes
Dashboards - CANARIE
- Advanced sharing screen & permissions
MINTED - CANARIE
- UI for sitedevicesubsets (in progress)
- Requirements gathering (in progress)
CIOOS / ERDDAP
- Upgrade ERDDAP server version (to be deployed after release)
- expand coverage, include mobile sensors/device and other complex data sets (in progress)
Tickets Released: Oceans 2.0: 19.09.000 (accessible to internal users only). Total: 66.
September 4, 2019
Major release for Oceans 2.0.
Instruments
Didson sonar driver (in progress)
- Sandbox update (in progress)
- Community Fishers: updates to handle AML CTDs
Automated Testing
Automated UI testing tool improvements (with Selenium)
- Expanded automation UI testing coverage
- Progress on moving toward continuous deployment
Data Products
- CODAR data products (in progress)
- Bug fixes
Maintenance and Production Developer
- Add URLs to device work flow
- Various other bug fixes
Complex Data Viewer / Hydrophone
- Gathering requirements for Aquadopp and other complex data sets
SeaTubeV3 - CANARIE & NOAA & ONC
- Annotation export, refactor to use taxon-based system
- Performance improvements
- Digital Fishers UI improvements
- Bug fixes
Dashboards - CANARIE
- bug fixes
MINTED - CANARIE
- Requirements and development ongoing
Tickets Released: Oceans 2.0: 19.08.000 (accessible to internal users only). Total: 60.
Aug 7, 2019
Major release for Oceans 2.0. HydroCal 19.06.000 released on July 24th.
Instruments
Didson sonar driver (in progress)
- Geographic status map for EEW
- Sandbox update is half finished: usability and task machine integration improvements
- Community Fishers: minor fixes to data pipeline
Automated Testing
Automated UI testing tool improvements (with Selenium)
- All developers spent time adding automated UI tests to replace their manual regression tests. 52% complete, aim to finish by September.
- Oceans-Next PROD server online, pages embedded in Oceans 2.0 (these pages are in beta, not yet available to public)
- Progress on moving toward continuous deployment
Data Products
- Major HydroCal update released (July 24th). Improved support for HF calibrations, specifically:
- Handles start/stops/reloads of calibrations much better
- Handles loading older versions of calibration data files and settings files
- Added ability to recover badly synchronized data by cross-correlating to target tones
- Improved spacing around plots
- Various UI changes to display and interaction, including warnings for missing parameters that would caused calibrations to fail
- Fixed cal sheet mis-alignment
- Changed a number of defaults: source voltage ramp rates, sample rates
- Made more parameters configurable, including the low voltage alert
- Changed filename and date stamping to the date of the data acquisition instead of file creation
- Improved re/post-processing of the data, plus added the ability (optionally) to reprocess the reference data, including changing some parameters
- Add quality metrics: correlation and signal to noise ratios - this allows users to compare multiple runs and pick the best result
- CODAR data products (started)
- Bug fixes
Maintenance and Production Developer
- Fixed Network Console load speed
- Support fault reset functionality on ONC "miniJB" type junction boxes
- Web service improvements and documentation (getByDevice method in the ScalarData service)
- Various other bug fixes
Complex Data Viewer / Hydrophone
- Working on complex data viewer front-end and making additional option sets available for spectrogram product generation in the back-end
SeaTubeV3 - CANARIE & NOAA & ONC
- All SeaTube V2 functionality in V3 (on Oceans-Next), plus new features
- Working on completing functions, beginning maintenance phase (after successful demo), prep for ONC and NOAA new requirements
Dashboards - CANARIE
- clean up, fixes (in progress)
- demo, development phase completion
MINTED - CANARIE
- Instrument footprints
- Scoping, requirements and development ongoing
Tickets Released: Oceans 2.0: 19.07.000 (accessible to internal users only). Total: 79.
HydroCal: HC.19.06.000 (link accessible to internal users only). Total: 22
July 4, 2019
Major release.
Instruments
WERA Integration (added support for USORT files)
- Created a new webservice to access RDI ADCP data with averaging from specific bins. This is to provide ocean current data to Port Metro Vancouver.
- Community Fishers data access project: clean up and fixes
- Small driver changes
Automated Testing
Automated UI testing implemented with Selenium
- All developers spent time adding automated UI tests to replace their manual regression tests
- Develop infrastructure for Oceans Next webserver
- Automated DAF testing final demo of phase 1
Data Products
- Major HydroCal update to support HF hydrophone field testing - separate release coming later in July
- RDI ADCP minor fix to comments and NaN'ing in specific scenarios
Maintenance and Production Developer
- RDI ADCP complex parser: added screening, fixed bugs and made it match Matlab data products and manufacturer's processing suite
- JIRA service desk is now available in Oceans 2.0
- Web service improvements and documentation
- Various other bug fixes
Complex Data Viewer / Hydrophone
- Requirements and implementation (in progress)
SeaTubeV3 - CANARIE & NOAA & ONC
- Primary development phase for CANARIE is ending, transition to maintenance and minor feature updates (NOAA and ONC development is ongoing)
- Completion of features, improvements and bug fixes
- Continuing moving features into SeaTubeV3 on Ocean Next webserver, to replace SeaTube Pro (current public version) and SeaTubeV2 (NOAA variant)
- Demo prep
Dashboards - CANARIE
- Primary development phase is ending, making dashboards webserver (Oceans Next) available in production
- clean up, fixes (in progress)
- Demo prep
MINTED - CANARIE
- Added concepts of batched commits and data areas to the database (in progress)
Tickets Released: Oceans 2.0: 19.06.000 (accessible to internal users only). Total: 138.
June 4, 2019
Major release.
Instruments
WERA Integration (FTP job and file archiving)
- Community Fishers Android app: supports USB and RBR devices
- Community Fishers data access project: web portal ready, working on data pipeline
- Phytoplankton sampler drivers
Web Presence
- Website fully online for World Data System - International Technology Office
Automated Testing
UI improvements
- Live automatic DAF testing (nearly complete)
Data Products
- WERA animated GIF data products available in Data Search and Data Preview
Maintenance
- Internal maintenance for QA and build systems
- Security improvements on device details page
- ONC web search ordered by date
- ONC staff photos all same size
- Various other bug fixes
Complex Data Viewer / Hydrophone
- Project initiation
SeaTubeV3 - CANARIE & NOAA
- Many components updated/modified in SeaTube V2 and copied to the new Oceans Next SeaTube (V3) (in progress), including:
- Support for multiple user-configurable Digital Fishers campaigns
- Ocean Biogeographic Information System (OBIS) statistics on annotations
- Cruise Summary Reports (initial version)
Dashboards - CANARIE
- Widgets and dashboards (in progress)
- Standardized behaviour improved
MINTED - CANARIE
- Working on services (in progress)
Tickets Released: Oceans 2.0: 19.05.000 (accessible to internal users only). Total: 161.
May 1, 2019
Major release.
Instruments
Declarative parsers: last test file integrated into declarative tests. Project complete.
- Community Fishers Android app: working on USB driver
- Community Fishers data access project: web portal ready, working on data pipeline
- New and modified drivers and parsers in support of maintenance cruises: chemical samplers, microscopes, RBR BPR and more.
Web Presence
- Website for World Data System - International Technology Office
- Website for CIOOS, CKAN server (in progress)
Automated Testing
Added testing history
- Live automatic DAF testing (in progress)
Maintenance
- System and status console pages ready in new front-end. Allows batching of various system commands from a UI: cache reloads in particular.
- Web service fixes to date ranges: documentation and vocabulary
- Improved speed for data product upload
- Many bugs fixed in search hydrophone page: data access violations, improper file downloads
- Various other bugs
SeaTubeV3 - CANARIE
- Updates and features in initial release
- Updates to annotations, digital fishers
- Building components in new framework
- Bug fixes
Dashboards - CANARIE
- More widgets in progress
- Creating pages
MINTED - CANARIE
- Progress on assigning DOIs to datasets
Tickets Released: Oceans 2.0: 19.04.000 (accessible to internal users only). Total: 63.
April 1, 2019
Major release.
Instruments
Declarative parsers done
- Community Fishers Android app: working on USB driver
- Community Fishers data access project: data model done, workflow design, geospatial areas defined, integration of data products and processing
- Driver and parser updates in support of upcoming field maintenance: SeaFET, STRAW driver & FTP online and more
- World magnetic model update
- Bug fixes for parsers found in DAF testing and by improved reprocessing automated testing
Web Presence
- Two conference sites created in Liferay
Automated Testing
Improvements for reprocessing/data acquisition framework (DAF) automated testing
- Live automatic DAF testing: UI built, basic validation, checks on device attributes and topology, set up and removal of device metadata
Maintenance
- Various bug fixes
- Archiver performance improved with efficient QAQC writing
- Back-end support for sending system commands in batches, front-end in progress
- Web service updates to unify the behaviour of dateTo parameters
Earthquake Early Warning
- Small bug fixes
SeaTubeV3 - CANARIE
- Design complete for SeaTubeV3
- Building components in new framework
- Changes for NOAA
Dashboards - CANARIE
- More widgets
- Creating wrappers for base components
MINTED - CANARIE
- Progress on the base level case
Tickets Released: Oceans 2.0: 19.03.000 (accessible to internal users only). Total: 97.
March 5, 2019
Major release.
Instruments
Declarative parsers: mitigating test cases, adding documentation
- Community Fishers Android app: working on USB driver
- Community Fishers data products and portal project: data model design, workflow design
- STRAW (test neutrino detection project) virtual machine integration and driver
- Driver and parser fixes in support of upcoming field maintenance: mini-junction box and more
- Bug fixes for parsers found by improved reprocessing automated testing
Web Presence
- Data Search "V2" released: Geospatial search and Data Search UI improvements final user testing, improvements
- Two conference sites, including a new simpler submission system
Automated Testing
Improvements for reprocessing/data acquisition framework (DAF) automated testing
- Progress on automating manual DAF testing
Maintenance
- Various bug fixes
- Progress on improving archiving time
- Progress on metrics and event detection/reaction
Data Products
- State of Ocean product updates
- Various bug fixes
Earthquake Early Warning
- Data from PNSN (Pacific NorthWest Seismic Network) is on online and contributing
- Documentation
SeaTubeV3 - CANARIE
- Design for mobile and desktop SeaTube
Dashboards - CANARIE
- Mock-ups to stakeholders
- Building widget components
MINTED - CANARIE
- Requisition DOI's for siteDevices
Tickets Released: Oceans 2.0: 19.02.000 (accessible to internal users only). Total: 54.
February 7, 2019
Major release.
Instruments
Declarative parsers nearly done, mitigating test cases, adding documentation
- Updates to Community Fishers Android app (bug fixes), working on RBR driver and parser
- Community Fishers data products and portal project: requirements complete, working on design
Web Presence
- Geospatial search and Data Search UI improvements final round of testing
- Conference websites
Automated Testing
Improvements Data Search automation system
- Data Search automation coverage increased to > 90%, project complete.
- Progress on reprocessing automated testing, automated data acquisition framework testing
Maintenance
- Good progress (10 tickets): improvements to back-end, particularly sites cache
- Progress on event monitoring and metrics for data acquisition framework
Data Products
- State of Ocean data products updated to include pressure data and have consistent gap filling
- SIDSSE Underwater Ultraviolet Raman Spectrometer (UURS) data products released
Earthquake Early Warning
- Integration of PNSN (Pacific NorthWest Seismic Network) data ready to switch on
SeaTubeV3 - CANARIE
- Requirements complete, designs in progress
- Building page components
Dashboards - CANARIE
- Progress on new front-end technologies and tools (liferay)
- Requirements and mock-ups with user feedback
MINTED - CANARIE
- Investigation and requirements (no features)
- Workflows investigated
Tickets Released: Oceans 2.0: 19.01.000 (accessible to internal users only). Total: 134.
January 8, 2019
Major release. Smaller than usual due to holiday break.
Instruments
Moved more parsers from java into declarative parsers, added more unit tests.
- Updates to sensor load system that handles variations within devicetypes for the declarative parsers.
- Adding declarative parsers to Community Fishers App
- Community Fishers data products and portal project initiation
Web Presence
- Geospatial search and Data Search UI improvements (not yet publicly available)
Automated Testing
Improvements Data Search automation system
- Added test cases to Data Search automation (increased coverage metric from 40% to 58%, remaining cases are simple file products and scalar data products (tested elsewhere))
Maintenance
- Various bug fixes, including but not limited to:
- Cache improvements
- Add more data acquisition metrics to Grafana, add configurations and work on reactions
Data Products
- HydroCal software updated with new metadata fields (serial numbers), handling biased wav data, saturation detection, calibration m-file metadata improved, calibration m-files now produced by default.
Earthquake Early Warning
- Progress on integration of PNSN (Pacific NorthWest Seismic Network) data
SeaTubeV3 - CANARIE
- Investigation of new technologies and requirements (no features)
- Building page components
Dashboards - CANARIE
- Investigation of new technologies and requirements (no features)
MINTED - CANARIE
- Investigation and requirements (no features)
Tickets Released: Oceans 2.0: 18.12.000 (accessible to internal users only). Total: 47.
HydroCal App: HC.18.12.000 (accessible to internal users only). Total: 1.