Page History

...

The information below is written in plain language as much as possible. Detailed release notes are available on internal confluence pages (requires login)

.

January 9, 2020

Major release for Oceans 2.0. The holiday break usually means fewer features are developed. 

Instruments

• AIS parsing: design (in-progress)

• Data acquisition bottleneck detection and reaction: investigation, design (in-progress)
• Sandbox improvements: improvements to support user's code, more usability and reliability issues
• Improvements the Community Fishers / Citizen Scientist data acquisition Android App: reconnect/retry data transfer, fix some bluetooth/wifi issues

Community Fishers

• Integration with Data Search (in-progress)
• Refactor plot generation
• Bug fixes and testing

Automated Testing

• Automated task testing framework implementation

• Automated UI testing: expanded coverage, test improvements, structural changes for maintainability
• Continuous deployment: separate front and back-end compilation for faster builds

Data Products

• New data product for ASL echosounders: manufacturer's raw binary .01A files (these are compatible with EchoView and other 3rd party software)
• Prevent jitter in CODAR GIFs
• World Magnetic Model update
• Bug fixes in these areas:
  • SIMBA ice buoy
  • Kongsberg Rotary SONAR (thanks to Chris de Moustier),
  • stuck searches
  • RDI ensemble/average time out of order when accessing live data

Maintenance and Production Developer

• Auto refresh in Plotting Utility is now available in saved plots
• Manual QAQC job handles overlaps
• World Magnetic Model update
• Security improvements
• System console improvements: dequeue/queisce function and status now displayed, UI improvements, including search and refresh
• Various other bug fixes and small projects

SeaTubeV3 - CANARIE & NOAA & ONC

• Upgrade Material-UI to V4 (enables new features to be developed)
• Video player re-implementation, making it useable for both dashboards and SeaTube
• Improvements to Digital Fishers main page and management pages
• SeaTubeV3 and annotations available on-ship without internet or if Oceans2.0 is down
• SeaTubeV3 theme improvements
• Bug fixes

Dashboards - CANARIE

• Users can now see all dashboards shared with them

MINTED - CANARIE

• UI for sitedevicesubsets
• Requirements and design for versioning data and metadata improvements, including updating DOIs (in-progress)
• DOIs for fixed deployments

CIOOS / ERDDAP

• Ongoing

Tickets Released: Oceans 2.0: 19.12.000 (accessible to internal users only). Total: 191.

December 3, 2019

Major release for Oceans 2.0. 

Instruments

• AIS parsing: design and investigation

• Sandbox improvements: improvements to support user's code, more usability issues
• Improvements the Community Fishers / Citizen Scientist data acquisition Android App, including app update system

Community Fishers

• Integration testing and fixes

Automated Testing

• Automated task testing framework design

• Automated webservice testing expanded coverage and test improvements
• Continuous deployment: process changes for requirements and design reviews (in-progress)

Data Products

• New data product for ASL echosounders: a CSV format that's compatible with EchoView data viewing and analysis software
• New data product options for ASL echosounders: Target Strength now available for all formats, ZAP noise reduction now optional (matches ASL processing)
• A weekly long-term spectral average plot is now available for all hydrophones
• Change to support automated State of Ocean plot generation (all plots are now up to date)
• Bug fixes in these areas: CODAR, ice buoy, rotary sonar

Maintenance and Production Developer

• Replace manual search templates for State of Ocean / Environment plots and products with an automated job (deployed last month, now active)
• System console improvements: version/revision/deployment date now displayed
• Various other bug fixes and small projects

SeaTubeV3 - CANARIE & NOAA & ONC

• User interface and styling consistency for SeaTube V3
• Bug fixes

Dashboards - CANARIE

• Automated testing for sharing and video player
• Live video

MINTED - CANARIE

• UI for sitedevicesubsets and siteDevice (in-progress)
• Requirements and design for versioning data, including updating DOIs (in-progress)
• Citation logic and metadata improvements (in-progress)

CIOOS / ERDDAP

• Mobile scalar data is now available on ERDDAP
• Saanich inlet data on CIOOS metadata server for demo only

...

Major release for Oceans 2.0. 

Instruments

• Fixed an issue blocking a new calibration formula

• Camera system driver improved
• Sandbox usability update complete. Starting further improvements to support user's code.
• Improvements the Community Fishers / Citizen Scientist data acquisition Android App

Community Fishers

• Handling different instruments, reliability, bugs and refactoring
• On-demand .cor file data product product

Automated Testing

• Automated UI testing tool improvements (with Selenium)

• Automated UI testing expanded coverage
• Continuous deployment: MATLAB migration from SVN to Git repository, new review process (in-progress)

Data Products

• CODAR quality controlled surface currents data product revised, released and activated (available in all apps, including Data Preview), changes include:
  made grid files available in Data Search, revamped MAT file structure, updated plotting, additional GDOP testing, bug fixes, automated testing
• Bug fixes: RDI netCDF products on mobile devices, edge case on ASL echosounders and more
• Migrated code repository to Git/BitBucket, updated/modernized pathing
• Maintain and expand search automation, particularly in support of Git migration and FGDC deprecation

Maintenance and Production Developer

• Fixes to ONC websites, including converting remaining http (non-secure) pages and links
• FGDC metadata report deprecated from Data Search
• Various other bug fixes and small projects

SeaTubeV3 - CANARIE & NOAA & ONC

• Continuing fixes and various improvements for V3
• User interface panel designs and usability improvements

Dashboards - CANARIE

• Completed advanced sharing screen & permissions
• Video component improvements (in-progress)

MINTED - CANARIE

• UI for sitedevicesubsets and siteDevice (in-progress)
• Requirements for versioning data (in-progress)

CIOOS / ERDDAP

• In progress

Tickets Released: Oceans 2.0: 19.10.000 (accessible to internal users only). Total: 95.

...

Major release for Oceans 2.0. 

Instruments

• Didson sonar driver

• UMN sampler parser / driver fixes
• Sandbox update (in-progress)
• Finalize EEW PNSN integration

Community Fishers

• Handling different instruments, reliability, bugs and refactoring

Automated Testing

• Automated UI testing tool improvements (with Selenium)

• Automated UI testing expanded coverage
• Continuous deployment (in-progress)

Data Products

• CODAR quality controlled surface currents data product deployed (not yet available to public - seeking internal user feedback)
• Bug fixes

Maintenance and Production Developer

• Project reporting scheduled job for World Data System International Technology Office
• Improved loading indicators
• New system console available
• Various other bug fixes

SeaTubeV3 - CANARIE & NOAA & ONC

• Big push to finish functional requirements for NOAA
• Useability testing and improvements (in-progress)
• Click on annotation marker brings up related information
• Bug fixes

Dashboards - CANARIE

• Advanced sharing screen & permissions

MINTED - CANARIE

• UI for sitedevicesubsets (in-progress)
• Requirements gathering (in-progress)

CIOOS / ERDDAP

• Upgrade ERDDAP server version (to be deployed after release)
• expand coverage, include mobile sensors/device and other complex data sets (in-progress)

Tickets Released: Oceans 2.0: 19.09.000 (accessible to internal users only). Total: 66.

...

Major release for Oceans 2.0. 

Instruments

• Didson sonar driver (in-progress)

• Sandbox update (in-progress)
• Community Fishers: updates to handle AML CTDs

Automated Testing

• Automated UI testing tool improvements (with Selenium)

• Expanded automation UI testing coverage
• Progress on moving toward continuous deployment

Data Products

• CODAR data products (in-progress)
• Bug fixes

Maintenance and Production Developer

• Add URLs to device work flow
• Various other bug fixes

...

• Gathering requirements for Aquadopp and other complex data sets

SeaTubeV3 - CANARIE & NOAA & ONC

• Annotation export, refactor to use taxon-based system
• Performance improvements
• Digital Fishers UI improvements
• Bug fixes

Dashboards - CANARIE

• bug fixes

MINTED - CANARIE

• Requirements and development ongoing

...

Major release for Oceans 2.0. HydroCal 19.06.000 released on July 24th. 

Instruments

• Didson sonar driver (in-progress)

• Geographic status map for EEW
• Sandbox update is half finished: usability and task machine integration improvements
• Community Fishers: minor fixes to data pipeline

Automated Testing

• Automated UI testing tool improvements (with Selenium)

• All developers spent time adding automated UI tests to replace their manual regression tests. 52% complete, aim to finish by September.
• Oceans-Next PROD server online, pages embedded in Oceans 2.0 (these pages are in beta, not yet available to public)
• Progress on moving toward continuous deployment

Data Products

• Major HydroCal update released (July 24th). Improved support for HF calibrations, specifically:
  • Handles start/stops/reloads of calibrations much better
  • Handles loading older versions of calibration data files and settings files
  • Added ability to recover badly synchronized data by cross-correlating to target tones
  • Improved spacing around plots
  • Various UI changes to display and interaction, including warnings for missing parameters that would caused calibrations to fail
  • Fixed cal sheet mis-alignment
  • Changed a number of defaults: source voltage ramp rates, sample rates
  • Made more parameters configurable, including the low voltage alert
  • Changed filename and date stamping to the date of the data acquisition instead of file creation
  • Improved re/post-processing of the data, plus added the ability (optionally) to reprocess the reference data, including changing some parameters
  • Add quality metrics: correlation and signal to noise ratios - this allows users to compare multiple runs and pick the best result
• CODAR data products (started)
• Bug fixes

Maintenance and Production Developer

• Fixed Network Console load speed
• Support fault reset functionality on ONC "miniJB" type junction boxes
• Web service improvements and documentation (getByDevice method in the ScalarData service)
• Various other bug fixes

...

• Working on complex data viewer front-end and making additional option sets available for spectrogram product generation in the back-end

SeaTubeV3 - CANARIE & NOAA & ONC

• All SeaTube V2 functionality in V3 (on Oceans-Next), plus new features
• Working on completing functions, beginning maintenance phase (after successful demo), prep for ONC and NOAA new requirements

Dashboards - CANARIE

• clean up, fixes (in-progress)
• demo, development phase completion

MINTED - CANARIE

• Instrument footprints
• Scoping, requirements and development ongoing

...

July 4, 2019

Major release.

Instruments

• WERA Integration (added support for USORT files)

• Created a new webservice to access RDI ADCP data with averaging from specific bins. This is to provide ocean current data to Port Metro Vancouver.
• Community Fishers data access project: clean up and fixes
• Small driver changes

Automated Testing

• Automated UI testing implemented with Selenium

• All developers spent time adding automated UI tests to replace their manual regression tests
• Develop infrastructure for Oceans Next webserver
• Automated DAF testing final demo of phase 1

Data Products

• Major HydroCal update to support HF hydrophone field testing - separate release coming later in July
• RDI ADCP minor fix to comments and NaN'ing in specific scenarios

Maintenance and Production Developer

• RDI ADCP complex parser: added screening, fixed bugs and made it match Matlab data products and manufacturer's processing suite
• JIRA service desk is now available in Oceans 2.0
• Web service improvements and documentation
• Various other bug fixes

...

• Requirements and implementation (in-progress)

SeaTubeV3 - CANARIE & NOAA & ONC

• Primary development phase for CANARIE is ending, transition to maintenance and minor feature updates (NOAA and ONC development is ongoing)
• Completion of features, improvements and bug fixes
• Continuing moving features into SeaTubeV3 on Ocean Next webserver, to replace SeaTube Pro (current public version) and SeaTubeV2 (NOAA variant)
• Demo prep

Dashboards - CANARIE

• Primary development phase is ending, making dashboards webserver (Oceans Next) available in production
• clean up, fixes (in-progress)
• Demo prep

MINTED - CANARIE

• Added concepts of batched commits and data areas to the database (in-progress)

Tickets Released: Oceans 2.0: 19.06.000 (accessible to internal users only). Total: 138.

...

June 4, 2019

Major release.

Instruments

• WERA Integration (FTP job and file archiving)

• Community Fishers Android app: supports USB and RBR devices
• Community Fishers data access project: web portal ready, working on data pipeline
• Phytoplankton sampler drivers

...

• Website fully online for World Data System - International Technology Office 

Automated Testing

• UI improvements

• Live automatic DAF testing (nearly complete)

Data Products

• WERA animated GIF data products available in Data Search and Data Preview

...

• Many components updated/modified in SeaTube V2 and copied to the new Oceans Next SeaTube (V3) (in-progress), including:
• Support for multiple user-configurable Digital Fishers campaigns
• Ocean Biogeographic Information System (OBIS) statistics on annotations
• Cruise Summary Reports (initial version)

Dashboards - CANARIE

• Widgets and dashboards (in-progress)
• Standardized behaviour improved

MINTED - CANARIE

• Working on services (in-progress)

Tickets Released: Oceans 2.0: 19.05.000 (accessible to internal users only). Total: 161.

...

May 1, 2019

Major release.

Instruments

• Declarative parsers: last test file integrated into declarative tests. Project complete.

• Community Fishers Android app: working on USB driver
• Community Fishers data access project: web portal ready, working on data pipeline
• New and modified drivers and parsers in support of maintenance cruises: chemical samplers, microscopes, RBR BPR and more.

...

• Website for World Data System - International Technology Office
• Website for CIOOS, CKAN server (in-progress)

Automated Testing

• Added testing history

• Live automatic DAF testing (in-progress)

Maintenance

• System and status console pages ready in new front-end. Allows batching of various system commands from a UI: cache reloads in particular.
• Web service fixes to date ranges: documentation and vocabulary
• Improved speed for data product upload
• Many bugs fixed in search hydrophone page: data access violations, improper file downloads
• Various other bugs

...

• Updates and features in initial release
• Updates to annotations, digital fishers
• Building components in new framework
• Bug fixes

Dashboards - CANARIE

• More widgets in progress
• Creating pages

MINTED - CANARIE

• Progress on assigning DOIs to datasets

...

April 1, 2019

Major release.

Instruments

• Declarative parsers done

• Community Fishers Android app: working on USB driver
• Community Fishers data access project: data model done, workflow design, geospatial areas defined, integration of data products and processing
• Driver and parser updates in support of upcoming field maintenance: SeaFET, STRAW driver & FTP online and more
• World magnetic model update
• Bug fixes for parsers found in DAF testing and by improved reprocessing automated testing

...

• Two conference sites created in Liferay

Automated Testing

• Improvements for reprocessing/data acquisition framework (DAF) automated testing

• Live automatic DAF testing: UI built, basic validation, checks on device attributes and topology, set up and removal of device metadata

...

• Design complete for SeaTubeV3
• Building components in new framework
• Changes for NOAA

Dashboards - CANARIE

• More widgets
• Creating wrappers for base components

MINTED - CANARIE

• Progress on the base level case

...

March 5, 2019

Major release.

Instruments

• Declarative parsers: mitigating test cases, adding documentation

• Community Fishers Android app: working on USB driver
• Community Fishers data products and portal project: data model design, workflow design
• STRAW (test neutrino detection project) virtual machine integration and driver
• Driver and parser fixes in support of upcoming field maintenance: mini-junction box and more
• Bug fixes for parsers found by improved reprocessing automated testing

...

• Data Search "V2" released: Geospatial search and Data Search UI improvements final user testing, improvements
• Two conference sites, including a new simpler submission system

Automated Testing

• Improvements for reprocessing/data acquisition framework (DAF) automated testing

• Progress on automating manual DAF testing

...

• Various bug fixes
• Progress on improving archiving time
• Progress on metrics and event detection/reaction

Data Products

• State of Ocean product updates
• Various bug fixes

...

• Design for mobile and desktop SeaTube

Dashboards - CANARIE

• Mock-ups to stakeholders
• Building widget components

MINTED - CANARIE

• Requisition DOI's for siteDevices

...

February 7, 2019

Major release.

Instruments

• Declarative parsers nearly done, mitigating test cases, adding documentation

• Updates to Community Fishers Android app (bug fixes), working on RBR driver and parser
• Community Fishers data products and portal project: requirements complete, working on design

...

• Geospatial search and Data Search UI improvements final round of testing
• Conference websites

Automated Testing

• Improvements Data Search automation system

• Data Search automation coverage increased to > 90%, project complete.
• Progress on reprocessing automated testing, automated data acquisition framework testing

...

• Good progress (10 tickets): improvements to back-end, particularly sites cache
• Progress on event monitoring and metrics for data acquisition framework

Data Products

• State of Ocean data products updated to include pressure data and have consistent gap filling
• SIDSSE Underwater Ultraviolet Raman Spectrometer (UURS) data products released

...

• Requirements complete, designs in progress
• Building page components

Dashboards - CANARIE

• Progress on new front-end technologies and tools (liferay)
• Requirements and mock-ups with user feedback

MINTED - CANARIE

• Investigation and requirements (no features)
• Workflows investigated

...

Major release. Smaller than usual due to holiday break.

Instruments

• Moved more parsers from java into declarative parsers, added more unit tests.

• Updates to sensor load system that handles variations within devicetypes for the declarative parsers.
• Adding declarative parsers to Community Fishers App
• Community Fishers data products and portal project initiation

...

• Geospatial search and Data Search UI improvements (not yet publicly available)

Automated Testing

• Improvements Data Search automation system

• Added test cases to Data Search automation (increased coverage metric from 40% to 58%, remaining cases are simple file products and scalar data products (tested elsewhere))

...

• Various bug fixes, including but not limited to:
• Cache improvements
• Add more data acquisition metrics to Grafana, add configurations and work on reactions

Data Products

• HydroCal software updated with new metadata fields (serial numbers), handling biased wav data, saturation detection, calibration m-file metadata improved, calibration m-files now produced by default.

...

• Investigation of new technologies and requirements (no features)
• Building page components

Dashboards - CANARIE

• Investigation of new technologies and requirements (no features)

MINTED - CANARIE

• Investigation and requirements (no features)

...