Versions Compared

Old Version 835

changes.mady.by.user Ben Biffard

Saved on

compared with

New Version 836

changes.mady.by.user Ben Biffard

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

The information below is written in plain language as much as possible. Detailed release notes are available on internal confluence pages (requires login).

Anchor
20191003
20191003

October 3, 2019

Major release for Oceans 2.0. 

Instruments

  • Didson sonar driver

  • UMN sampler parser / driver fixes
  • Sandbox update (in progress)
  • Finalize EEW PNSN integration

Community Fishers

  • Handling different instruments, reliability, bugs and refactoring

Automated Testing

  • Automated UI testing tool improvements (with Selenium)

  • Automated UI testing expanded coverage
  • Continuous deployment (in progress)

Data Products

  • CODAR quality controlled surface currents data product deployed (not yet available to public - seeking internal user feedback)
  • Bug fixes

Maintenance and Production Developer

  • Project reporting scheduled job for World Data System International Technology Office
  • Improved loading indicators
  • New system console available
  • Various other bug fixes

SeaTubeV3 - CANARIE & NOAA & ONC

  • Big push to finish functional requirements for NOAA
  • Useability testing and improvements (in progress)
  • Click on annotation marker brings up related information
  • Bug fixes

Dashboards - CANARIE

  • Advanced sharing screen & permissions

MINTED - CANARIE

  • UI for sitedevicesubsets
  • Requirements gathering

CIOOS / ERDDAP

  • Upgrade ERDDAP server version (to be deployed after release)
  • expand coverage, include mobile sensors/device and other complex data sets (in progress)

Tickets Released: Oceans 2.0: 19.09.000 (accessible to internal users only). Total: 67.

Anchor
20190904
20190904

September 4, 2019

Major release for Oceans 2.0. 

Instruments

  • Didson sonar driver (in progress)

  • Sandbox update (in progress)
  • Community Fishers: updates to handle AML CTDs

Automated Testing

  • Automated UI testing tool improvements (with Selenium)

  • Expanded automation UI testing coverage
  • Progress on moving toward continuous deployment

Data Products

  • CODAR data products (in progress)
  • Bug fixes

Maintenance and Production Developer

  • Add URLs to device work flow
  • Various other bug fixes

Complex Data Viewer / Hydrophone

  • Gathering requirements for Aquadopp and other complex data sets

SeaTubeV3 - CANARIE & NOAA & ONC

  • Annotation export, refactor to use taxon-based system
  • Performance improvements
  • Digital Fishers UI improvements
  • Bug fixes

Dashboards - CANARIE

  • bug fixes

MINTED - CANARIE

  • Requirements and development ongoing

Tickets Released: Oceans 2.0: 19.08.000 (accessible to internal users only). Total: 60.

Anchor
20190807
20190807

Aug 7, 2019

Major release for Oceans 2.0. HydroCal 19.06.000 released on July 24th. 

Instruments

  • Didson sonar driver (in progress)

  • Geographic status map for EEW
  • Sandbox update is half finished: usability and task machine integration improvements
  • Community Fishers: minor fixes to data pipeline

Automated Testing

  • Automated UI testing tool improvements (with Selenium)

  • All developers spent time adding automated UI tests to replace their manual regression tests. 52% complete, aim to finish by September.
  • Oceans-Next PROD server online, pages embedded in Oceans 2.0 (these pages are in beta, not yet available to public)
  • Progress on moving toward continuous deployment

Data Products

  • Major HydroCal update released (July 24th). Improved support for HF calibrations, specifically:
    • Handles start/stops/reloads of calibrations much better
    • Handles loading older versions of calibration data files and settings files
    • Added ability to recover badly synchronized data by cross-correlating to target tones
    • Improved spacing around plots
    • Various UI changes to display and interaction, including warnings for missing parameters that would caused calibrations to fail
    • Fixed cal sheet mis-alignment
    • Changed a number of defaults: source voltage ramp rates, sample rates
    • Made more parameters configurable, including the low voltage alert
    • Changed filename and date stamping to the date of the data acquisition instead of file creation
    • Improved re/post-processing of the data, plus added the ability (optionally) to reprocess the reference data, including changing some parameters
    • Add quality metrics: correlation and signal to noise ratios - this allows users to compare multiple runs and pick the best result
  • CODAR data products (started)
  • Bug fixes

Maintenance and Production Developer

  • Fixed Network Console load speed
  • Support fault reset functionality on ONC "miniJB" type junction boxes
  • Web service improvements and documentation (getByDevice method in the ScalarData service)
  • Various other bug fixes

Complex Data Viewer / Hydrophone

  • Working on complex data viewer front-end and making additional option sets available for spectrogram product generation in the back-end

SeaTubeV3 - CANARIE & NOAA & ONC

  • All SeaTube V2 functionality in V3 (on Oceans-Next), plus new features
  • Working on completing functions, beginning maintenance phase (after successful demo), prep for ONC and NOAA new requirements

Dashboards - CANARIE

  • clean up, fixes (in progress)
  • demo, development phase completion

MINTED - CANARIE

  • Instrument footprints
  • Scoping, requirements and developement ongoing

...

July 4, 2019

Major release.

Instruments

  • WERA Integration (added support for USORT files)

  • Created a new webservice to access RDI ADCP data with averaging from specific bins. This is to provide ocean current data to Port Metro Vancouver.
  • Community Fishers data access project: clean up and fixes
  • Small driver changes

Automated Testing

  • Automated UI testing implemented with Selenium

  • All developers spent time adding automated UI tests to replace their manual regression tests
  • Develop infrastructure for Oceans Next webserver
  • Automated DAF testing final demo of phase 1

Data Products

  • Major HydroCal update to support HF hydrophone field testing - separate release coming later in July
  • RDI ADCP minor fix to comments and NaN'ing in specific scenarios

Maintenance and Production Developer

  • RDI ADCP complex parser: added screening, fixed bugs and made it match Matlab data products and manufacturer's processing suite
  • JIRA service desk is now available in Oceans 2.0
  • Web service improvements and documentation
  • Various other bug fixes

Complex Data Viewer / Hydrophone

  • Requirements and implementation (in progress)

SeaTubeV3 - CANARIE & NOAA & ONC

  • Primary development phase for CANARIE is ending, transition to maintenance and minor feature updates (NOAA and ONC development is ongoing)
  • Completion of features, improvements and bug fixes
  • Continuing moving features into SeaTubeV3 on Ocean Next webserver, to replace SeaTube Pro (current public version) and SeaTubeV2 (NOAA variant)
  • Demo prep

Dashboards - CANARIE

  • Primary development phase is ending, making dashboards webserver (Oceans Next) available in production
  • clean up, fixes (in progress)
  • Demo prep

MINTED - CANARIE

  • Added concepts of batched commits and data areas to the database (in progress)

...

June 4, 2019

Major release.

Instruments

  • WERA Integration (FTP job and file archiving)

  • Community Fishers Android app: supports USB and RBR devices
  • Community Fishers data access project: web portal ready, working on data pipeline
  • Phytoplankton sampler drivers

...

  • Website fully online for World Data System - International Technology Office 

Automated Testing

  • UI improvements

  • Live automatic DAF testing (nearly complete)

Data Products

  • WERA animated GIF data products available in Data Search and Data Preview

...

  • Internal maintenance for QA and build systems
  • Security improvements on device details page
  • ONC web search ordered by date
  • ONC staff photos all same size
  • Various other bug fixes

Complex Data Viewer / Hydrophone

  • Project initiation

SeaTubeV3 - CANARIE & NOAA

  • Many components updated/modified in SeaTube V2 and copied to the new Oceans Next SeaTube (V3) (in progress), including:
  • Support for multiple user-configurable Digital Fishers campaigns
  • Ocean Biogeographic Information System (OBIS) statistics on annotations
  • Cruise Summary Reports (initial version)

Dashboards - CANARIE

  • Widgets and dashboards (in progress)
  • Standardized behaviour improved

MINTED - CANARIE

  • Working on services (in progress)

...

May 1, 2019

Major release.

Instruments

  • Declarative parsers: last test file integrated into declarative tests. Project complete.

  • Community Fishers Android app: working on USB driver
  • Community Fishers data access project: web portal ready, working on data pipeline
  • New and modified drivers and parsers in support of maintenance cruises: chemical samplers, microscopes, RBR BPR and more.

...

  • Website for World Data System - International Technology Office
  • Website for CIOOS, CKAN server (in progress)

Automated Testing

  • Added testing history

  • Live automatic DAF testing (in progress)

...

  • Updates and features in initial release
  • Updates to annotations, digital fishers
  • Building components in new framework
  • Bug fixes

Dashboards - CANARIE

  • More widgets in progress
  • Creating pages

MINTED - CANARIE

  • Progress on assigning DOIs to datasets

...

April 1, 2019

Major release.

Instruments

  • Declarative parsers done

  • Community Fishers Android app: working on USB driver
  • Community Fishers data access project: data model done, workflow design, geospatial areas defined, integration of data products and processing
  • Driver and parser updates in support of upcoming field maintenance: SeaFET, STRAW driver & FTP online and more
  • World magnetic model update
  • Bug fixes for parsers found in DAF testing and by improved reprocessing automated testing

...

  • Two conference sites created in Liferay

Automated Testing

  • Improvements for reprocessing/data acquisition framework (DAF) automated testing

  • Live automatic DAF testing: UI built, basic validation, checks on device attributes and topology, set up and removal of device metadata

...

  • Design complete for SeaTubeV3
  • Building components in new framework
  • Changes for NOAA

Dashboards - CANARIE

  • More widgets
  • Creating wrappers for base components

MINTED - CANARIE

  • Progress on the base level case

...

March 5, 2019

Major release.

Instruments

  • Declarative parsers: mitigating test cases, adding documentation

  • Community Fishers Android app: working on USB driver
  • Community Fishers data products and portal project: data model design, workflow design
  • STRAW (test neutrino detection project) virtual machine integration and driver
  • Driver and parser fixes in support of upcoming field maintenance: mini-junction box and more
  • Bug fixes for parsers found by improved reprocessing automated testing

...

  • Data Search "V2" released: Geospatial search and Data Search UI improvements final user testing, improvements
  • Two conference sites, including a new simpler submission system

Automated Testing

  • Improvements for reprocessing/data acquisition framework (DAF) automated testing

  • Progress on automating manual DAF testing

...

  • Various bug fixes
  • Progress on improving archiving time
  • Progress on metrics and event detection/reaction

Data Products

  • State of Ocean product updates
  • Various bug fixes

...

  • Design for mobile and desktop SeaTube

Dashboards - CANARIE

  • Mock-ups to stakeholders
  • Building widget components

MINTED - CANARIE

  • Requisition DOI's for siteDevices

...

February 7, 2019

Major release.

Instruments

  • Declarative parsers nearly done, mitigating test cases, adding documentation

  • Updates to Community Fishers Android app (bug fixes), working on RBR driver and parser
  • Community Fishers data products and portal project: requirements complete, working on design

...

  • Geospatial search and Data Search UI improvements final round of testing
  • Conference websites

Automated Testing

  • Improvements Data Search automation system

  • Data Search automation coverage increased to > 90%, project complete.
  • Progress on reprocessing automated testing, automated data acquisition framework testing

...

  • Good progress (10 tickets): improvements to back-end, particularly sites cache
  • Progress on event monitoring and metrics for data acquisition framework

Data Products

  • State of Ocean data products updated to include pressure data and have consistent gap filling
  • SIDSSE Underwater Ultraviolet Raman Spectrometer (UURS) data products released

...

  • Requirements complete, designs in progress
  • Building page components

Dashboards - CANARIE

  • Progress on new front-end technologies and tools (liferay)
  • Requirements and mock-ups with user feedback

MINTED - CANARIE

  • Investigation and requirements (no features)
  • Workflows investigated

...

Major release. Smaller than usual due to holiday break.

Instruments

  • Moved more parsers from java into declarative parsers, added more unit tests.

  • Updates to sensor load system that handles variations within devicetypes for the declarative parsers.
  • Adding declarative parsers to Community Fishers App
  • Community Fishers data products and portal project initiation

...

  • Geospatial search and Data Search UI improvements (not yet publicly available)

Automated Testing

  • Improvements Data Search automation system

  • Added test cases to Data Search automation (increased coverage metric from 40% to 58%, remaining cases are simple file products and scalar data products (tested elsewhere))

...

  • Various bug fixes, including but not limited to:
  • Cache improvements
  • Add more data acquisition metrics to Grafana, add configurations and work on reactions

Data Products

  • HydroCal software updated with new metadata fields (serial numbers), handling biased wav data, saturation detection, calibration m-file metadata improved, calibration m-files now produced by default.

...

  • Investigation of new technologies and requirements (no features)
  • Building page components

Dashboards - CANARIE

  • Investigation of new technologies and requirements (no features)

MINTED - CANARIE

  • Investigation and requirements (no features)

...

Major release. Released a major revision for the Community Fishers App.

Instruments

  • Moved more parsers from java into declarative parsers: 26 more, all but 5 remaining.

  • Added modify by to parser history

  • Released the Community Fishers App to support community-based CTD casts. Major functionality added to support AML CTDs. Additional features to more easily manage and swap devices, online updates, add bluetooth support, improved wifi support, added manual GPS entry.

...

  • Various bug fixes, including but not limited to: 
  • Allow sensorCategoryCode to be case insensitive
  • Improved cache loading times for ferries
  • Task management parameter modification

Data Products

  • State of Ocean data products are gap filled, handle cases where deployments occur within a resample time period
  • State of Ocean plot maintenance for VENUS cruise
  • Added option to plot both PLAN0 and PLAN1 data for Nortek Signature ADCPs, added both plots to Data Preview
  • Added option for a correlation screen for Nortek Signature ADCPs
  • Added a fail over for matlab webservice calls
  • Added chunking in matlab QAQC result retrieve to prevent running out of memory
  • Allow ice buoy data products to access all sensors
  • Fixed bugs: water column data products, ADCP edge case of one record, handle inconsistent creation and deployment bad dates

...

  • Investigation, various bug fixes, requirements and planning (no features)
  • Map scale in SeaTube
  • Export annotations by dive

Dashboards - CANARIE

  • Investigation and requirements: user interviews (no features)

MINTED - CANARIE

  • Project start up (no features)

...

November 5, 2018

Major release.

Instruments

  • Moved more parsers from java into declarative parsers: 38 devicetypes

  • Continuing progress on the Community Fishers App to support community-based CTD casts.

  • Added ability to view previous parser versions

...

  • Various bug fixes, including but not limited to:
  • Added modification history to ERDDAP dataset maintenance
  • Added sensorCategoryCode to scalardata service so that users can access a specific sensor's data more easily
  • Improved display of drifters in Data Search map, improved performance, fixed icon sizes

Data Products

  • Live Raw Data / Log files now available through Data Search
  • SIMBA / ice buoy plots to plot by sensor number by default, with new option to plot by sensor elevation
  • Added feedback to users when they're plotting too much data in ferry plots

...

  • Investigation, various bug fixes, requirements and planning
  • Added sorting by organization to SeaTube search tree.
  • Added hover over to provide more information

Dashboards - CANARIE

  • Investigation, requirements and planning (no features)

...

Major release, branched as normal on September 30th, deployment delayed due to inshore maintenance expedition.

Instruments

  • Moved more parsers from java into declarative parsers.

  • Improved declarative parser UI, including history. Parsers can now be easily updated in real-time from the device details pages.

  • Good progress on the Community Fishers App to support community-based CTD casts.

...

  • Various bug fixes, including but not limited to: jwPlayer license fix, google maps API fix.
  • Completed switch to https. Can now add features like JIRA service desk. 
  • Rinko parser update in real-time.
  • Improved Data Search display of drifters and improved loading time.

Data Products

  • HydroCal software delivered to client on September 5th.
  • HydroCal bug fixes and client acceptance feedback fixes (still included in the first release). 
  • State of Ocean plot maintenance

...

  • Investigation, various bug fixes, requirements and planning (no features)

Dashboards - CANARIE

  • Investigation, requirements and planning (no features)

...

September 4, 2018

Major release. 

Instruments

  • Created two new parsers and drivers for both Pro-Oceanus Gas Tension device and SBE 39 device for Queen of Alberni.

  • Moved parser definitions into the database and added a parser definition tab to device listings page for viewing and editing parser definitions from the UI.

  • Updated the Watchman500 and Folger Pinnacle mini-jb parsers to support recent changes.

  • Fixed a bug with SubC cameras and their laser not working correctly; other bug fixes.

...

  • Various bug fixes.
  • Separate Data Preview searches into a new queue for better control and higher priority for user searches.
  • Removed filedownloadservice and several SOAP services.

Data Products

...

August 8, 2018

Major release. 

Instruments

  • Archive Gascoyne Bay data directly for improved performance
  • New commands added to SeaScript (device command language) to clear and flush device memory and gather statistics
  • Bug fixes

...

  • Various bug fixes.
  • New user interface for data attributions
  • Improve data attributions to remove the citation fields and simplify

Data Products

  • Improvements to daily spectrograms
  • Progress on HydroCal, stand-alone software for ONC's hydrophone calibration system
  • Bug fixes

...

Major release. First release using GIT.

Instruments

  • Updated Data Search page to support multiple map providers.
  • Finished and tested drivers and parsers for the four devices related to the SIDSSE project.
  • Finished and tested drivers and parsers for both POCAM’s, SDOM’s, and Mini Junction Boxes  for the STRAW project.
  • Further updates to parsers for Wally devices.
  • Added photo download support for SubC cameras.
  • Finished and tested drivers & parsers for DBoxes.
  • Updates to Loki driver and parser.

...

  • Various bug fixes.
  • Fixed bug in the CORK parser.
  • Rolled out first iteration of Data Search clustering for Drifter icons.

Data Products

  • Fixed a bug that affected some cases of RDI ADCP bin-mapping, causing an error in values when compared to winADCP of about 0.3% overall on average.
  • Re-write of seismometer data products to handle new seismometer metadata and configurations.
  • New daily collated spectrograms for hydrophones. These new plots were also added to Data Preview.
  • Additional bug fixes.

...

June 6, 2018

Major release.

Instruments

  • DAF testing, driver and parser development and support for upcoming cruises, in particular, support for new devices for the STRAW project and new installations at Endeavour

...

Maintenance

  • Various bug fixes

Data Products

...

Major release, several new features and official releases.

Instruments

  • Drivers for POCAM Camera, Mk. 5 + 6 (STRAW project)
  • Updated Camera Controls
  • BPR wakes more reliably
  • PVCS (ferry value control system) and QAQC changes (quality assurance quality control flagging)

...

  • Various bug fixes
  • Instrument report page (for data stewardship team, but could be made accessible)

Data Products

...

Larger-than-normal release in preparation for several official releases and demonstrations of significant projects in the next month or so.

Instruments

  • Parsing data from two additional Placentia Bay Buoys for Memorial University

...

  • Various bug fixes
  • SeaTube, Digital Fishers and the live Cameras pages now support html5 playback - this is a big improvement for mobile devices and browsers like Chrome.
  • Frame grab improvements in SeaTube, including not having to log in. 

Data Products

  • Drifter data products: new track plot data products are available to support DFO drifters. Formats include PNG/PDF, and animated GIF and a Google Earth KML file.

...

Normal release. Ramping up towards completing several large projects.

Instruments

  • Parsing data for the Red Island Shoal Buoy at Memorial University
  • DFO Drifter jobs implemented (transfer, archiving, parsing data, plus cloning to generate new drifter devices)
  • DFO Drifter parser and QAQC

...

Normal release, now using the fix version feature in JIRA (all released tickets will now be linked below).

Instruments

  • Support ASCII for CORK devices

  • Add BPR data import as a scheduled job

  • Data acquisition for Memorial University Buoys and DFO drifters (in progress)

  • Filtering out bad data (QAQC) for some ferry instruments when vessel is in port and/or pump flow is reduced

...

This was a smaller-than-normal release, due to the holiday break.

Instruments

  • Underwater Listening Station (ULS) parser for V2 AMAR hydrophones

  • Improvements to the Pump Control and Valve System (PVCS) for the ferries

  • Filtering out bad data (QAQC) for some ferry instruments when vessel is in port and/or pump flow is reduced

...