Page History

...

The information below is written in plain language as much as possible. Detailed release notes are available on internal confluence pages (requires login).

November 7, 2019

Major release for Oceans 2.0. 

Instruments

• Fixed an issue blocking a new calibration formula

• Camera system driver improved
• Sandbox usability update complete. Starting further improvements to support user's code.
• Improvements the Community Fishers / Citizen Scientist data acquisition Android App

Community Fishers

• Handling different instruments, reliability, bugs and refactoring
• On-demand .cor file data product product

Automated Testing

• Automated UI testing tool improvements (with Selenium)

• Automated UI testing expanded coverage
• Continuous deployment (in progress)

Data Products

• CODAR quality controlled surface currents data product revised, released and activated (available in all apps, including Data Preview), changes include:
  made grid files available in Data Search, revamped MAT file structure, updated plotting, additional GDOP testing, bug fixes, automated testing
• Bug fixes: RDI netCDF products on mobile devices, edge case on ASL echosounders and more
• Migrated code repository to Git/BitBucket, updated/modernized pathing
• Maintain and expand search automation, particularly in support of Git migration and FGDC deprecation

Maintenance and Production Developer

• Fixes to ONC websites, including converting remaining http (non-secure) pages and links
• FGDC metadata report deprecated from Data Search
• Automated UI testing improvements, fixes and expanded coverage
• Continuous deployment: MATLAB migration from SVN to Git repository, new review process (in progress)
• Various other bug fixes and small projects

SeaTubeV3 - CANARIE & NOAA & ONC

• Continuing fixes and various improvements for V3
• User interface panel designs and usability improvements

Dashboards - CANARIE

• Completed advanced sharing screen & permissions
• Video component improvements (in progress)

MINTED - CANARIE

• UI for sitedevicesubsets and siteDevice (in progress)
• Requirements for versioning data (in progress)

CIOOS / ERDDAP

• In progress

Tickets Released: Oceans 2.0: 19.10.000 (accessible to internal users only). Total: 95.

.

October 3, 2019

Major release for Oceans 2.0. 

Instruments

• Didson sonar driver

• UMN sampler parser / driver fixes
• Sandbox update (in progress)
• Finalize EEW PNSN integration

Community Fishers

• Handling different instruments, reliability, bugs and refactoring

Automated Testing

• Automated UI testing tool improvements (with Selenium)

• Automated UI testing expanded coverage
• Continuous deployment (in progress)

Data Products

• CODAR quality controlled surface currents data product deployed (not yet available to public - seeking internal user feedback)
• Bug fixes

Maintenance and Production Developer

• Project reporting scheduled job for World Data System International Technology Office
• Improved loading indicators
• New system console available
• Various other bug fixes

SeaTubeV3 - CANARIE & NOAA & ONC

• Big push to finish functional requirements for NOAA
• Useability testing and improvements (in progress)
• Click on annotation marker brings up related information
• Bug fixes

Dashboards - CANARIE

• Advanced sharing screen & permissions

MINTED - CANARIE

• UI for sitedevicesubsetssitedevicesubsets (in progress)
• Requirements gathering (in progress)

CIOOS / ERDDAP

• Upgrade ERDDAP server version (to be deployed after release)
• expand coverage, include mobile sensors/device and other complex data sets (in progress)

Tickets Released: Oceans 2.0: 19.09.000 (accessible to internal users only). Total: 6766.

September 4, 2019

Major release for Oceans 2.0. 

Instruments

• Didson sonar driver (in progress)

• Sandbox update (in progress)
• Community Fishers: updates to handle AML CTDs

Automated Testing

• Automated UI testing tool improvements (with Selenium)

• Expanded automation UI testing coverage
• Progress on moving toward continuous deployment

Data Products

• CODAR data products (in progress)
• Bug fixes

Maintenance and Production Developer

• Add URLs to device work flow
• Various other bug fixes

...

• Gathering requirements for Aquadopp and other complex data sets

SeaTubeV3 - CANARIE & NOAA & ONC

• Annotation export, refactor to use taxon-based system
• Performance improvements
• Digital Fishers UI improvements
• Bug fixes

Dashboards - CANARIE

• bug fixes

MINTED - CANARIE

• Requirements and development ongoing

...

Major release for Oceans 2.0. HydroCal 19.06.000 released on July 24th. 

Instruments

• Didson sonar driver (in progress)

• Geographic status map for EEW
• Sandbox update is half finished: usability and task machine integration improvements
• Community Fishers: minor fixes to data pipeline

Automated Testing

• Automated UI testing tool improvements (with Selenium)

• All developers spent time adding automated UI tests to replace their manual regression tests. 52% complete, aim to finish by September.
• Oceans-Next PROD server online, pages embedded in Oceans 2.0 (these pages are in beta, not yet available to public)
• Progress on moving toward continuous deployment

Data Products

• Major HydroCal update released (July 24th). Improved support for HF calibrations, specifically:
  • Handles start/stops/reloads of calibrations much better
  • Handles loading older versions of calibration data files and settings files
  • Added ability to recover badly synchronized data by cross-correlating to target tones
  • Improved spacing around plots
  • Various UI changes to display and interaction, including warnings for missing parameters that would caused calibrations to fail
  • Fixed cal sheet mis-alignment
  • Changed a number of defaults: source voltage ramp rates, sample rates
  • Made more parameters configurable, including the low voltage alert
  • Changed filename and date stamping to the date of the data acquisition instead of file creation
  • Improved re/post-processing of the data, plus added the ability (optionally) to reprocess the reference data, including changing some parameters
  • Add quality metrics: correlation and signal to noise ratios - this allows users to compare multiple runs and pick the best result
• CODAR data products (started)
• Bug fixes

Maintenance and Production Developer

• Fixed Network Console load speed
• Support fault reset functionality on ONC "miniJB" type junction boxes
• Web service improvements and documentation (getByDevice method in the ScalarData service)
• Various other bug fixes

...

• Working on complex data viewer front-end and making additional option sets available for spectrogram product generation in the back-end

SeaTubeV3 - CANARIE & NOAA & ONC

• All SeaTube V2 functionality in V3 (on Oceans-Next), plus new features
• Working on completing functions, beginning maintenance phase (after successful demo), prep for ONC and NOAA new requirements

Dashboards - CANARIE

• clean up, fixes (in progress)
• demo, development phase completion

MINTED - CANARIE

• Instrument footprints
• Scoping, requirements and development ongoing

...

July 4, 2019

Major release.

Instruments

• WERA Integration (added support for USORT files)

• Created a new webservice to access RDI ADCP data with averaging from specific bins. This is to provide ocean current data to Port Metro Vancouver.
• Community Fishers data access project: clean up and fixes
• Small driver changes

Automated Testing

• Automated UI testing implemented with Selenium

• All developers spent time adding automated UI tests to replace their manual regression tests
• Develop infrastructure for Oceans Next webserver
• Automated DAF testing final demo of phase 1

Data Products

• Major HydroCal update to support HF hydrophone field testing - separate release coming later in July
• RDI ADCP minor fix to comments and NaN'ing in specific scenarios

Maintenance and Production Developer

• RDI ADCP complex parser: added screening, fixed bugs and made it match Matlab data products and manufacturer's processing suite
• JIRA service desk is now available in Oceans 2.0
• Web service improvements and documentation
• Various other bug fixes

...

• Requirements and implementation (in progress)

SeaTubeV3 - CANARIE & NOAA & ONC

• Primary development phase for CANARIE is ending, transition to maintenance and minor feature updates (NOAA and ONC development is ongoing)
• Completion of features, improvements and bug fixes
• Continuing moving features into SeaTubeV3 on Ocean Next webserver, to replace SeaTube Pro (current public version) and SeaTubeV2 (NOAA variant)
• Demo prep

Dashboards - CANARIE

• Primary development phase is ending, making dashboards webserver (Oceans Next) available in production
• clean up, fixes (in progress)
• Demo prep

MINTED - CANARIE

• Added concepts of batched commits and data areas to the database (in progress)

...

June 4, 2019

Major release.

Instruments

• WERA Integration (FTP job and file archiving)

• Community Fishers Android app: supports USB and RBR devices
• Community Fishers data access project: web portal ready, working on data pipeline
• Phytoplankton sampler drivers

...

• Website fully online for World Data System - International Technology Office 

Automated Testing

• UI improvements

• Live automatic DAF testing (nearly complete)

Data Products

• WERA animated GIF data products available in Data Search and Data Preview

...

• Many components updated/modified in SeaTube V2 and copied to the new Oceans Next SeaTube (V3) (in progress), including:
• Support for multiple user-configurable Digital Fishers campaigns
• Ocean Biogeographic Information System (OBIS) statistics on annotations
• Cruise Summary Reports (initial version)

Dashboards - CANARIE

• Widgets and dashboards (in progress)
• Standardized behaviour improved

MINTED - CANARIE

• Working on services (in progress)

...

May 1, 2019

Major release.

Instruments

• Declarative parsers: last test file integrated into declarative tests. Project complete.

• Community Fishers Android app: working on USB driver
• Community Fishers data access project: web portal ready, working on data pipeline
• New and modified drivers and parsers in support of maintenance cruises: chemical samplers, microscopes, RBR BPR and more.

...

• Website for World Data System - International Technology Office
• Website for CIOOS, CKAN server (in progress)

Automated Testing

• Added testing history

• Live automatic DAF testing (in progress)

...

• Updates and features in initial release
• Updates to annotations, digital fishers
• Building components in new framework
• Bug fixes

Dashboards - CANARIE

• More widgets in progress
• Creating pages

MINTED - CANARIE

• Progress on assigning DOIs to datasets

...

April 1, 2019

Major release.

Instruments

• Declarative parsers done

• Community Fishers Android app: working on USB driver
• Community Fishers data access project: data model done, workflow design, geospatial areas defined, integration of data products and processing
• Driver and parser updates in support of upcoming field maintenance: SeaFET, STRAW driver & FTP online and more
• World magnetic model update
• Bug fixes for parsers found in DAF testing and by improved reprocessing automated testing

...

• Two conference sites created in Liferay

Automated Testing

• Improvements for reprocessing/data acquisition framework (DAF) automated testing

• Live automatic DAF testing: UI built, basic validation, checks on device attributes and topology, set up and removal of device metadata

...

• Design complete for SeaTubeV3
• Building components in new framework
• Changes for NOAA

Dashboards - CANARIE

• More widgets
• Creating wrappers for base components

MINTED - CANARIE

• Progress on the base level case

...

March 5, 2019

Major release.

Instruments

• Declarative parsers: mitigating test cases, adding documentation

• Community Fishers Android app: working on USB driver
• Community Fishers data products and portal project: data model design, workflow design
• STRAW (test neutrino detection project) virtual machine integration and driver
• Driver and parser fixes in support of upcoming field maintenance: mini-junction box and more
• Bug fixes for parsers found by improved reprocessing automated testing

...

• Data Search "V2" released: Geospatial search and Data Search UI improvements final user testing, improvements
• Two conference sites, including a new simpler submission system

Automated Testing

• Improvements for reprocessing/data acquisition framework (DAF) automated testing

• Progress on automating manual DAF testing

...

• Various bug fixes
• Progress on improving archiving time
• Progress on metrics and event detection/reaction

Data Products

• State of Ocean product updates
• Various bug fixes

...

• Design for mobile and desktop SeaTube

Dashboards - CANARIE

• Mock-ups to stakeholders
• Building widget components

MINTED - CANARIE

• Requisition DOI's for siteDevices

...

February 7, 2019

Major release.

Instruments

• Declarative parsers nearly done, mitigating test cases, adding documentation

• Updates to Community Fishers Android app (bug fixes), working on RBR driver and parser
• Community Fishers data products and portal project: requirements complete, working on design

...

• Geospatial search and Data Search UI improvements final round of testing
• Conference websites

Automated Testing

• Improvements Data Search automation system

• Data Search automation coverage increased to > 90%, project complete.
• Progress on reprocessing automated testing, automated data acquisition framework testing

...

• Good progress (10 tickets): improvements to back-end, particularly sites cache
• Progress on event monitoring and metrics for data acquisition framework

Data Products

• State of Ocean data products updated to include pressure data and have consistent gap filling
• SIDSSE Underwater Ultraviolet Raman Spectrometer (UURS) data products released

...

• Requirements complete, designs in progress
• Building page components

Dashboards - CANARIE

• Progress on new front-end technologies and tools (liferay)
• Requirements and mock-ups with user feedback

MINTED - CANARIE

• Investigation and requirements (no features)
• Workflows investigated

...

Major release. Smaller than usual due to holiday break.

Instruments

• Moved more parsers from java into declarative parsers, added more unit tests.

• Updates to sensor load system that handles variations within devicetypes for the declarative parsers.
• Adding declarative parsers to Community Fishers App
• Community Fishers data products and portal project initiation

...

• Geospatial search and Data Search UI improvements (not yet publicly available)

Automated Testing

• Improvements Data Search automation system

• Added test cases to Data Search automation (increased coverage metric from 40% to 58%, remaining cases are simple file products and scalar data products (tested elsewhere))

...

• Various bug fixes, including but not limited to:
• Cache improvements
• Add more data acquisition metrics to Grafana, add configurations and work on reactions

Data Products

• HydroCal software updated with new metadata fields (serial numbers), handling biased wav data, saturation detection, calibration m-file metadata improved, calibration m-files now produced by default.

...

• Investigation of new technologies and requirements (no features)
• Building page components

Dashboards - CANARIE

• Investigation of new technologies and requirements (no features)

MINTED - CANARIE

• Investigation and requirements (no features)

...