Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

This page contains the current year's release notes and new features, primarily for Oceans 23.0 / DMAS, as well as any applications created/maintained by the ONC software engineering development group, including mobile Apps and desktop/PC applications

Previous years:

2017 Release Notes

2016 Release Notes

2015 Release Notes

2014 Release Notes

2013 Release Notes

2012 Release Notes

2011 Release Notes

2010 Release Notes

. In progress project status may be presented as well. The information below is written in plain language as much as possible. Detailed release notes are available on internal confluence pages (requires login). Anchor2019040120190401

April 1, 2019

Major release.

Instruments

  • Declarative parsers done

  • Community Fishers Android app: working on USB driver
  • Community Fishers data access project: data model done, workflow design, geospatial areas defined, integration of data products and processing
  • Driver and parser updates in support of upcoming field maintenance: SeaFET, STRAW driver & FTP online and more
  • World magnetic model update
  • Bug fixes for parsers found in DAF testing and by improved reprocessing automated testing

Web Presence

  • Two conference sites created in Liferay

Automated Testing

  • Improvements for reprocessing/data acquisition framework (DAF) automated testing

  • Live automatic DAF testing: UI built, basic validation, checks on device attributes and topology, set up and removal of device metadata

Maintenance

  • Various bug fixes
  • Archiver performance improved with efficient QAQC writing
  • Back-end support for sending system commands in batches, front-end in progress
  • Web service updates to unify the behaviour of dateTo parameters

Earthquake Early Warning

  • Small bug fixes

SeaTubeV3 - CANARIE

  • Design complete for SeaTubeV3
  • Building components in new framework
  • Changes for NOAA

Dashboards - CANARIE

  • More widgets
  • Creating wrappers for base components

MINTED - CANARIE

  • Progress on the base level case

Tickets Released: Oceans 2.0: 19.03.000 (accessible to internal users only). Total: 97.

...

March 5, 2019

Major release.

Instruments

  • Declarative parsers: mitigating test cases, adding documentation

  • Community Fishers Android app: working on USB driver
  • Community Fishers data products and portal project: data model design, workflow design
  • STRAW (test neutrino detection project) virtual machine integration and driver
  • Driver and parser fixes in support of upcoming field maintenance: mini-junction box and more
  • Bug fixes for parsers found by improved reprocessing automated testing

Web Presence

  • Data Search "V2" released: Geospatial search and Data Search UI improvements final user testing, improvements
  • Two conference sites, including a new simpler submission system

Automated Testing

  • Improvements for reprocessing/data acquisition framework (DAF) automated testing

  • Progress on automating manual DAF testing

Maintenance

  • Various bug fixes
  • Progress on improving archiving time
  • Progress on metrics and event detection/reaction

Data Products

  • State of Ocean product updates
  • Various bug fixes

Earthquake Early Warning

  • Data from PNSN (Pacific NorthWest Seismic Network) is on online and contributing
  • Documentation

SeaTubeV3 - CANARIE

  • Design for mobile and desktop SeaTube

Dashboards - CANARIE

  • Mock-ups to stakeholders
  • Building widget components

MINTED - CANARIE

  • Requisition DOI's for siteDevices

Tickets Released: Oceans 2.0: 19.02.000 (accessible to internal users only). Total: 54.

...

February 7, 2019

Major release.

Instruments

  • Declarative parsers nearly done, mitigating test cases, adding documentation

  • Updates to Community Fishers Android app (bug fixes), working on RBR driver and parser
  • Community Fishers data products and portal project: requirements complete, working on design

Web Presence

  • Geospatial search and Data Search UI improvements final round of testing
  • Conference websites

Automated Testing

  • Improvements Data Search automation system

  • Data Search automation coverage increased to > 90%, project complete.
  • Progress on reprocessing automated testing, automated data acquisition framework testing

Maintenance

  • Good progress (10 tickets): improvements to back-end, particularly sites cache
  • Progress on event monitoring and metrics for data acquisition framework

Data Products

  • State of Ocean data products updated to include pressure data and have consistent gap filling
  • SIDSSE Underwater Ultraviolet Raman Spectrometer (UURS) data products released

Earthquake Early Warning

  • Integration of PNSN (Pacific NorthWest Seismic Network) data ready to switch on

SeaTubeV3 - CANARIE

  • Requirements complete, designs in progress
  • Building page components

Dashboards - CANARIE

  • Progress on new front-end technologies and tools (liferay)
  • Requirements and mock-ups with user feedback

MINTED - CANARIE

  • Investigation and requirements (no features)
  • Workflows investigated

Tickets Released: Oceans 2.0: 19.01.000 (accessible to internal users only). Total: 134.

...

January 8, 2019

Major release. Smaller than usual due to holiday break.

Instruments

  • Moved more parsers from java into declarative parsers, added more unit tests.

  • Updates to sensor load system that handles variations within devicetypes for the declarative parsers.
  • Adding declarative parsers to Community Fishers App
  • Community Fishers data products and portal project initiation

Web Presence

  • Geospatial search and Data Search UI improvements (not yet publicly available)

Automated Testing

  • Improvements Data Search automation system

  • Added test cases to Data Search automation (increased coverage metric from 40% to 58%, remaining cases are simple file products and scalar data products (tested elsewhere))

Maintenance

  • Various bug fixes, including but not limited to:
  • Cache improvements
  • Add more data acquisition metrics to Grafana, add configurations and work on reactions

Data Products

  • HydroCal software updated with new metadata fields (serial numbers), handling biased wav data, saturation detection, calibration m-file metadata improved, calibration m-files now produced by default.

Earthquake Early Warning

  • Progress on integration of PNSN (Pacific NorthWest Seismic Network) data

SeaTubeV3 - CANARIE

  • Investigation of new technologies and requirements (no features)
  • Building page components

Dashboards - CANARIE

  • Investigation of new technologies and requirements (no features)

MINTED - CANARIE

  • Investigation and requirements (no features)

Tickets Released: Oceans 2.0: 18.12.000 (accessible to internal users only). Total: 47.

                                HydroCal App: HC.18.12.000 (accessible to internal users only). Total: 1.

...

December 6, 2018

Major release. Released a major revision for the Community Fishers App.

Instruments

  • Moved more parsers from java into declarative parsers: 26 more, all but 5 remaining.

  • Added modify by to parser history
  • Released the Community Fishers App to support community-based CTD casts. Major functionality added to support AML CTDs. Additional features to more easily manage and swap devices, online updates, add bluetooth support, improved wifi support, added manual GPS entry.

Web Presence

  • Working on Geospatial search and Data Search UI improvements (no features added yet)

Infrastructure and Internal Tools

  • Continued improvements to web service automation, added servlet testing.

  • Added JVM, service-level and data acquisition metrics.
  • Added ability to turn on/off and configure metrics gathering.
  • Added metrics to system dashboards: graphana.

Maintenance

  • Various bug fixes, including but not limited to: 
  • Allow sensorCategoryCode to be case insensitive
  • Improved cache loading times for ferries
  • Task management parameter modification

Data Products

  • State of Ocean data products are gap filled, handle cases where deployments occur within a resample time period
  • State of Ocean plot maintenance for VENUS cruise
  • Added option to plot both PLAN0 and PLAN1 data for Nortek Signature ADCPs, added both plots to Data Preview
  • Added option for a correlation screen for Nortek Signature ADCPs
  • Added a fail over for matlab webservice calls
  • Added chunking in matlab QAQC result retrieve to prevent running out of memory
  • Allow ice buoy data products to access all sensors
  • Fixed bugs: water column data products, ADCP edge case of one record, handle inconsistent creation and deployment bad dates

Earthquake Early Warning

  • Made deployments faster
  • Used October 22 earthquake events as test cases and made associated improvements

SeaTubeV3 - CANARIE

  • Investigation, various bug fixes, requirements and planning (no features)
  • Map scale in SeaTube
  • Export annotations by dive

Dashboards - CANARIE

  • Investigation and requirements: user interviews (no features)

MINTED - CANARIE

  • Project start up (no features)

Tickets Released: Oceans 2.0: 18.11.000 (accessible to internal users only). Total: 143.

                                Community Fishers App: CS.18.12.000 (accessible to internal users only). Total: 43.

...

November 5, 2018

Major release.

Instruments

  • Moved more parsers from java into declarative parsers: 38 devicetypes

  • Continuing progress on the Community Fishers App to support community-based CTD casts.

  • Added ability to view previous parser versions

Web Presence

  • Liferay investigation and training

Infrastructure and Internal Tools

  • Continued improvements on web service automation tests: added numerous new test cases, update tests to improve pass/fail.

Maintenance

  • Various bug fixes, including but not limited to:
  • Added modification history to ERDDAP dataset maintenance
  • Added sensorCategoryCode to scalardata service so that users can access a specific sensor's data more easily
  • Improved display of drifters in Data Search map, improved performance, fixed icon sizes

Data Products

  • Live Raw Data / Log files now available through Data Search
  • SIMBA / ice buoy plots to plot by sensor number by default, with new option to plot by sensor elevation
  • Added feedback to users when they're plotting too much data in ferry plots

Earthquake Early Warning

  • Data acquisition support for RBR tilt meters
  • Updated CAP message to meet standard
  • CAP messages available via ftp server

SeaTubeV3 - CANARIE

  • Investigation, various bug fixes, requirements and planning
  • Added sorting by organization to SeaTube search tree.
  • Added hover over to provide more information

Dashboards - CANARIE

  • Investigation, requirements and planning (no features)

Tickets Released: Oceans 2.0: 18.10.000 (accessible to internal users only). Total: 87.

.

...

October 10, 2018

Major release, branched as normal on September 30th, deployment delayed due to inshore maintenance expedition.

Instruments

  • Moved more parsers from java into declarative parsers.

  • Improved declarative parser UI, including history. Parsers can now be easily updated in real-time from the device details pages.
  • Good progress on the Community Fishers App to support community-based CTD casts.

Web Presence

  • Updates to oceannetworks.ca: community pages, wiring the abyss, science landing page.
  • Conference pages template in liferay 7.1.

Infrastructure and Internal Tools

  • Big push on web service automation tests: 95% now passing due to improvements to the response comparison and checking (uses a lot of regex). This will improve quality of deployed software and speed our release cycle.

Maintenance

  • Various bug fixes, including but not limited to: jwPlayer license fix, google maps API fix.
  • Completed switch to https. Can now add features like JIRA service desk. 
  • Rinko parser update in real-time.
  • Improved Data Search display of drifters and improved loading time.

Data Products

  • HydroCal software delivered to client on September 5th.
  • HydroCal bug fixes and client acceptance feedback fixes (still included in the first release). 
  • State of Ocean plot maintenance

Earthquake Early Warning

  • Testing, bug fixes, support for field deployments. Correlator/associator deployed live. 
  • Automated testing improvements

SeaTubeV3 - CANARIE

  • Investigation, various bug fixes, requirements and planning (no features)

Dashboards - CANARIE

  • Investigation, requirements and planning (no features)

Tickets Released: Oceans 2.0: 18.09.000 (accessible to internal users only). Total: 74.

                                HydroCal: HC.18.08.000 (accessible to internal users only). Total: 7.

...

September 4, 2018

Major release. 

Instruments

  • Created two new parsers and drivers for both Pro-Oceanus Gas Tension device and SBE 39 device for Queen of Alberni.

  • Moved parser definitions into the database and added a parser definition tab to device listings page for viewing and editing parser definitions from the UI.

  • Updated the Watchman500 and Folger Pinnacle mini-jb parsers to support recent changes.

  • Fixed a bug with SubC cameras and their laser not working correctly; other bug fixes.

Empower Sandbox and API

  • Added a share feature.
  • Bug fixes.
  • Final demonstration took place in August and project was closed.

Web Presence

  • Progress on new pages for annual reporting

Infrastructure and Internal Tools

  • Modularized core infrastructure.

  • Continued to improve handling of dependencies.

  • Began modularizing driver framework.

  • Modularized the device-related code and parts of earthquake correlation code

Maintenance

  • Various bug fixes.
  • Separate Data Preview searches into a new queue for better control and higher priority for user searches.
  • Removed filedownloadservice and several SOAP services.

Data Products

Earthquake Early Warning

  • Completed additions to the associator / correlator event detection, such as using maximum peak displacement for magnitude estimates.
  • Improvements to Kalman Filter.
  • Work on the iPhone App - new protocol

SeaTubeV2

  • Improve permissions handling

  • Improvements to annotations search and filtering. Added annotations export.

  • WMS servers integration to show bathymetry, added a page to configure the bathymetry

  • Improvements to search function

  • Completion NOAA SeaTube project "SeaTube V2"

Tickets Released: 18.08.000 (accessible to internal users only). Total: 130.

...

August 8, 2018

Major release. 

Instruments

  • Archive Gascoyne Bay data directly for improved performance
  • New commands added to SeaScript (device command language) to clear and flush device memory and gather statistics
  • Bug fixes

Empower Sandbox and API

  • Task Monitor is now Task Management and was moved to the More menu
  • Improve permissions and access on the Task Management page
  • Last minute changes and fixes for the final delivery and demonstration

Infrastructure and Internal Tools

  • Finished refactoring/cleanup of infrastructure code to prepare for modularization.

  • Investigate loosely coupling the driver framework to driver implementations.

  • Improve handling of external dependencies.

Maintenance

  • Various bug fixes.
  • New user interface for data attributions
  • Improve data attributions to remove the citation fields and simplify

Data Products

  • Improvements to daily spectrograms
  • Progress on HydroCal, stand-alone software for ONC's hydrophone calibration system
  • Bug fixes

Earthquake Early Warning

  • Added client software test message sending on a schedule
  • Added the backup datacenter that will receive all data and be able to replace the primary in few seconds or less if the primary fails.
  • Fixes to automated tests

NOAA SeaTubeV2

  • Interactivity between dive trace and video and annotation

  • Annotation export is now a data product

  • Numerous bug fixes for previous releases

Tickets Released: 18.07.000 (accessible to internal users only). Total: 108.

...

July 3, 2018

Major release. First release using GIT.

Instruments

  • Updated Data Search page to support multiple map providers.
  • Finished and tested drivers and parsers for the four devices related to the SIDSSE project.
  • Finished and tested drivers and parsers for both POCAM’s, SDOM’s, and Mini Junction Boxes  for the STRAW project.
  • Further updates to parsers for Wally devices.
  • Added photo download support for SubC cameras.
  • Finished and tested drivers & parsers for DBoxes.
  • Updates to Loki driver and parser.

Empower Sandbox and API

  • Added support for MATLAB to the sandbox (not yet connected in PROD)
  • Improvements to the Task Monitor UI
  • Added Empower API to CANARIE registry
  • Lots of clean-up and completion of various issues to close the project

Web Presence

  • Numerous updates to support the cruises: banners, modifications to the Wiring the Abyss and expedition pages
  • Prince Rupert Regional Ocean Observatory page (community page meant for a display for the Prince Rupert Port Authority) 

Infrastructure and Internal Tools

  • Migrated to use GIT / Bitbucket as our versioning system
  • Metrics page on search automation
  • Moved search automation into the test tree

Maintenance

  • Various bug fixes.
  • Fixed bug in the CORK parser.
  • Rolled out first iteration of Data Search clustering for Drifter icons.

Data Products

  • Fixed a bug that affected some cases of RDI ADCP bin-mapping, causing an error in values when compared to winADCP of about 0.3% overall on average.
  • Re-write of seismometer data products to handle new seismometer metadata and configurations.
  • New daily collated spectrograms for hydrophones. These new plots were also added to Data Preview.
  • Additional bug fixes.

Earthquake Early Warning

  • Added functionality for EEW machines to reload and update the caches over activeMQ. 
  • Added a web service to allow beta testers to generate CAP messages and verify that their software correctly receives and reacts to a cap message.
  • Driver and parser for RBR tiltmeters.

NOAA SeaTubeV2

  • Hide video for a dive.

  • Display attributes last used for selected taxon.

  • Export sensor values for each annotation.

  • Filter annotations by sensor values (NOAA only).

  • Set livestream URLs per cruise, values not replicated so they can be defined differently for different machines.

  • New Taxon Button Set Configuration screen which displays a preview of button sets.

Tickets Released: 18.06.000 (accessible to internal users only). Total: 175.

...

June 6, 2018

Major release.

Instruments

  • DAF testing, driver and parser development and support for upcoming cruises, in particular, support for new devices for the STRAW project and new installations at Endeavour

Empower Sandbox and API

  • Added automated testing for Sandbox
  • Improvements to RawData service

Infrastructure and Internal Tools

  • GIT migration research

Maintenance

  • Various bug fixes

Data Products

Earthquake Early Warning

  • Improvements to correlator queue

NOAA SeaTubeV2 and Fisheries Science Reporting System

  • Numerous improvements for the taxonomy system, including UI elements
  • Added WoRMS common names
  • Export annotations with associated environmental and positional data, export annotations for a single dive with taxon defintion
  • Add the ability to view, edit, create taxons and taxonomy, including creating button sets and previewing their layout
  • Added some support for multiple simultaneous streams

Tickets Released: 18.05.000 (accessible to internal users only). Total: 166.

...

May 7, 2018

Major release, several new features and official releases.

Instruments

  • Drivers for POCAM Camera, Mk. 5 + 6 (STRAW project)
  • Updated Camera Controls
  • BPR wakes more reliably
  • PVCS (ferry value control system) and QAQC changes (quality assurance quality control flagging)

Empower Sandbox and API

  • Officially released the API to the public
  • Fixed a number of automation tests
  • Added new automation tests for sandbox services
  • Added a parameter to get the latest reading for external web services
  • Split sandbox tasks from scheduled tasks and added permission checking to TaskMonitor
  • Fixed an issue where row limits for scalardata were not being applied correctly
  • Added support for compiled (C/C++ code)
  • Did an iteration on the UI design of TaskMonitor
  • Checked the acceptance criteria for the API
  • Modified archivefiles service to have a similar structure as other services

Infrastructure

  • Continuing cleanup and modularization (OSGi-fication) of core infrastructure code: extracted observatory and searchtree modules, preparing to extract device, sensor and deps modules
  • Improved cache handling

Maintenance

  • Various bug fixes
  • Instrument report page (for data stewardship team, but could be made accessible)

Data Products

Earthquake Early Warning

  • Progress on epicentre and magnitude 'correlator', notification and message routing architecture
  • Added a new calibration feature: external device triggering
  • Can now send a serialized cache over ActiveMQ to remote stations (allows easier deployments and updates to remote stations)

NOAA SeaTubeV2

Completed almost all NOAA requested enhancements including:

  • Live dive annotation and display
  • Annotations include standardized vocabulary (taxonomies)
  • Annotation quick entry
  • Optimized screen use
  • Environmental values display

Fisheries Science Reporting System

  • Finishing up event scheduling including automated scheduling using Liferay’s quartz functionality

Tickets Released: 18.04.000 (accessible to internal users only). Total: 289.

...

April 3, 2018

Larger-than-normal release in preparation for several official releases and demonstrations of significant projects in the next month or so.

Instruments

  • Parsing data from two additional Placentia Bay Buoys for Memorial University

Empower Sandbox and API

  • Standardized date parameters for web services
  • Added a second output format for the RawDataService
  • Standardized archivefiles service to conform to the ONC API standard
  • Sandbox is ready for user testing in the QA (limited access) environment ("alpha testing" phase)
  • Improvements to the Task Monitor and Scheduler page

Infrastructure

  • Continuing cleanup and modularization (OSGi-fication) of core infrastructure code

Maintenance

  • Various bug fixes
  • SeaTube, Digital Fishers and the live Cameras pages now support html5 playback - this is a big improvement for mobile devices and browsers like Chrome.
  • Frame grab improvements in SeaTube, including not having to log in. 

Data Products

  • Drifter data products: new track plot data products are available to support DFO drifters. Formats include PNG/PDF, and animated GIF and a Google Earth KML file.

Earthquake Early Warning

  • Progress on epicentre and magnitude 'correlator', notification and message routing architecture
  • Updates to calculated values for magnitude estimation for the updated 'correlator' event detection
  • Completion of the routing slip infrastructure. The routing slip allows data processing on shorestations to be dynamic and go to go across multiple machines. In the case of EEW it allows us to send data from one shorestation to a second central shorestation for event detection.

DFO and NOAA projects

  • Released a preliminary version of SeaTubeV2, which is an enhanced version SeaTube combining SeaScribe and SeaTube functionality targeted for NOAA. This isn’t the official release, that will happen at the end of April.

  • Continued work on our Event Management functionality including full automation coverage. Most functionality is complete; events can be created and run and notifications generated. 
  • Modifications to handle thousands of drifters (Data Search step 1 primarily).

Tickets Released: 18.03.000 (accessible to internal users only). Total: 232

...

March 7, 2018

Normal release. Ramping up towards completing several large projects.

Instruments

  • Parsing data for the Red Island Shoal Buoy at Memorial University
  • DFO Drifter jobs implemented (transfer, archiving, parsing data, plus cloning to generate new drifter devices)
  • DFO Drifter parser and QAQC

Empower Sandbox and API

  • Progress on building a sandbox for user to upload and run scripts (nothing released yet)
  • Upgraded our old scheduler and put the functionality into the current Task Monitor page
  • Standardized API calls that use time parameters
  • Fixed a bug in the API where our log was filling up with useless messages
  • Fixed a bug where certain API calls would cause a Null Pointer Exception

Infrastructure

  • Partial cleanup and modularization of core infrastructure code

Maintenance

  • Updated SeaTube to stream only non-Flash video (html5)
  • Updated SeaTube’s JWPlayer instance which added a few new things like 2X and 0.5X speed playback
  • Added the ability to cancel individual queued reprocessing files on the Reprocess Console
  • Added ERDDAP Dataset information to the Site, SiteDevice and Device pages
  • Added an automated abstract submission confirmation email feature to the ISSMMT conference page
  • Created a site for the CVAUI2018 Workshop
  • Various bug fixes

Data Access and Products

  • Data Preview now uses https for embedded images (plots)
  • State of Oceans / Environment plots will now always have yearly ticks
  • Water column data products in final review and automated testing phase

Earthquake Early Warning

  • Progress on epicentre and magnitude 'correlater', notification and message routing architecture
  • Automated testing improvements, reliability

DFO and NOAA projects

  • For NOAA SeaTube, continuing progress, lots of great features in progress but no visible changes for users
  • For the fisheries data repository, completed much of the Event Management functionality along with good automated test coverage. It is now possible to create events and test them to determine if the content and recipients are correct.

Tickets Released: 18.02.000 (accessible to internal users only). Total: 135.

...

February 5, 2018

Normal release, now using the fix version feature in JIRA (all released tickets will now be linked below).

Instruments

  • Support ASCII for CORK devices

  • Add BPR data import as a scheduled job
  • Data acquisition for Memorial University Buoys and DFO drifters (in progress)

  • Filtering out bad data (QAQC) for some ferry instruments when vessel is in port and/or pump flow is reduced

Empower Sandbox and API

  • Progress on building a sandbox for user to upload and run scripts (nothing released yet)
  • Modifications to API for standardized nomenclature and new methods (rawdataservice)

Infrastructure

  • OSGi modularization (on-going)
  • Performance improvements

Data Access and Products

  • Improvements to data access restrictions and attribution
  • Links added to State of Oceans / Environment plots in Data Preview: users can get the data and file behind these plots
  • fileSize reporting for API
  • Water column data product preparation (PropertyCode now appears in MAT files, more features to come)

Earthquake Early Warning

  • Progress on EEW heartbeats, notification architecture, iPhone app
  • Automated testing improvements, reliability

DFO and NOAA projects

  • Continuing progress, lots of great features in progress but no visible changes for users

Tickets Released: 18.01.000 (accessible to internal users only). Total: 231.

...

January 3, 2018

This was a smaller-than-normal release, due to the holiday break.

Instruments

  • Underwater Listening Station (ULS) parser for V2 AMAR hydrophones

  • Improvements to the Pump Control and Valve System (PVCS) for the ferries

  • Filtering out bad data (QAQC) for some ferry instruments when vessel is in port and/or pump flow is reduced

Empower Sandbox and API

  • Progress on building a sandbox for user to upload and run scripts (nothing released yet)
  • API returns a 503 error when server down for scheduled maintenance

Data Access and Products

  • Improvements to data access restrictions (applies to both API and front-end apps like Data Search)
  • Updates and bug fixes for State of Ocean plots
  • Bug fixes for seismometer, video QAQC (corrects for time index mis-match ..finally!), ODV with many deployments
  • Bug fixed by adding a new feature for spectrograms: an audio data only option

Earthquake Early Warning

  • Reduced the size/bandwidth of remote station data traffic
  • Improved reliability and maintainability of remote stations
  • Improve infrastructure to better support notifications (in progress)

DFO and NOAA projects

...

"Major" releases include all completed items at that time (monthly), while "minor" releases are updates to the previous major release with bug fixes and specific features. Detailed release notes are available on internal confluence pages (internal users only).

Expand
titleClick here to see previous years new features / release notes...

Children Display

March 5, 2023

Major release

Maintenance

New Features or Improvements

  • Add Modified By and Modified Date on Device Workflow Admin page
  • Database improvements: improve a number of constraints on field lengths, remove a few deprecated tables, update a few _hist tables to _trx tables for better auditing.
  • Remove deprecated code: CANARIE Registry, adcpdata API
  • Quarter-scalar-data-generation-cassandra limit number of records to be processed each time
  • Update date format for QAQC reprocess and QAQC deletion jobs
  • Change property value from sensortypename to sensortypecode in Data Search URL

Bug Fixes

  • CSV/JSON data products header should report metadata file name with .xml not .pdf
  • User Management: "Select All" doesn't select all data products
  • Plotting Utility: Quarter scalar data includes data outside of deployment when it should not
  • Updates and bug fixes in automated testing

Community Fishers

  • Feature of the month! See: https://community.oceannetworks.ca/posts/oceans-30-software-updates-for-february
    → Added button to download all cast from a station
  • Reworked selected download check boxes on Cast Selection pop-up
  • Added support for Rinko-FT devices in the Community Fishers Pipeline and Data Products
  • Initial implementation backend & webservice to get CommunityFishersDevicePackage info
    • added xChange sensor information
    • added last verification date, last calibration date per device
    • moved CommunityFishersDevicePackage to device bundle

Community Fishers - APP

  • The Community Fishers App version CF.3.2.10 has been released with a summary found here: https://jira.oceannetworks.ca/projects/DMAS/versions/13379
  • Or alternatively, a brief rundown:
    • automated tracking of android tablet version
    • removed auto update notification
    • added new help menus/manuals
    • integrated Wi-Fi and Bluetooth connection more closely with Android
    • fixed loading from archived log/ctd data creating an unclose-able menu
    • various performance improvements under the hood

Acoustic Instruments Data Viewer

  • added a reference URL to custom taxons (front-end)
  • Fixed: Data Search for all available data doesn't return all the data (high-priority bug)

Data Products

  • Two very minor bug fixes and automated testing improvements.

Infrastructure

  • Restricted/testing environments only allow a subset of users to log in (secondary security to VPN/firewalls)
  • Remove abandoned "Camera Shut Down" application and "Complex Data Viewer" (v1 & v2) pages
  • Abort a deployment & shut down if Oceans 3 tries & fails to connect to its database
  • Modernize code behind Taxonomy Management page

Dashboards

  • Data Source Selector Widget now shows sources in a table
  • Location Selector now uses public API/locations service (much faster)
  • Fix: Audio player now goes to the correct location to play FLAC files
  • Fix: Data Player Widget can now be used anonymously 

CIOOS Pacific

  • Add tab to Agreements to edit and view local context labels

ExperiMINTED

  • Remove incorrect ERROR logging in the DOI registration job (378)
  • Link available from Data Search page to go to Search History page 
  • When running a batch an email can be sent under various conditions

Earthquake Early Warning, API and Tasks

  • Now continually sending acceleration data to IRIS on some high bandwidth land sites
  • Add message to API when requesting restricted data
  • Improved response descriptions on the open API page
  • Add better messaging when a default value is used on dataProductDelivery API
  • Wrap text on browser telnet console page
  • Simplify logic for running tasks and don't send tasks over the scheduler topic

SeaTube

  • Finished most phase 1 features in supporting 10+ on-ship servers
  • In-progress: DateTimePicker for MUI 5 updates, annotation ingestion parser, refactoring DiveLog to use the same framework as the DeckLog
  • Minor improvements and bug fixes

Instruments

  • Subc MK5/6 driver zoom function updated
    • Device does not report current zoom location.  Driver now generates the current zoom location by counting the number of zooms in from the maximum zoom out.
    • Add new sensor attributes for the total number of zoom positions and largest zoom step size, accounting for differences in model years.
  • In-progress: Camera Interface Board driver

Tickets Released: Oceans 3.0: 24.02.000 (accessible to internal users only). Total: 168. Automated Testing: AT.24.02.000 total: 8.

Expand

Bug

  • [DMAS-32067] - Large amount of text in some fields prevents account from being created and gives an unhelpful error message
  • [DMAS-67313] - Since 2021-12-01, The datasync queues are receiving thousands of messages
  • [DMAS-74241] - Save button is displayed on some pages for anonymous users
  • [DMAS-75460] - CSV/JSON products metadata file name in header should say .xml not .pdf
  • [DMAS-78229] - Data Search for all available data doesn't return all the data
  • [DMAS-78337] - Task DOI-Registration-job-deviceTypes (378) is failing every run
  • [DMAS-78715] - Pamguard configuration file uploader not working
  • [DMAS-78902] - Pamguard sub-tasks status not updated with parent batch
  • [DMAS-78958] - Disable the save button in the AddCollectionDialog on playlist discovery when fields are not filled in
  • [DMAS-78962] - Add missing task type entry for pamguard batch
  • [DMAS-79058] - In playlist playback page, the play speed control will go back to normal speed after a clip is done even the display is the same
  • [DMAS-79112] - Playlists with missing clips display the text "clip-thumbnail" as the clip thumbnail
  • [DMAS-79124] - Search failure in state of ocean plot in QA for negative values
  • [DMAS-79165] - Enable strict null checking for Task Management
  • [DMAS-79172] - Community Fisher pipeline error when editing end time
  • [DMAS-79197] - dmas-ldap-export.sh writes comments to ldif export
  • [DMAS-79212] - User Management: "Select All" doesn't select all data products
  • [DMAS-79217] - Error loading some older earthquake detail pages
  • [DMAS-79220] - The Running Tide Camera zoom is not responding to sea script
  • [DMAS-79228] - organizationagreementdevice has null deviceid
  • [DMAS-79252] - Audio Player not playing FLAC file
  • [DMAS-79265] - A taxon or taxonomy with no children displays as having a child in the tree widget
  • [DMAS-79267] - Fix the spelling of the Synchronizer Management page URL
  • [DMAS-79279] - Data Player Widget fails to make service calls to fetch spectrogram data
  • [DMAS-79286] - The thumbnail image is not display well for fixed location camera in playlist
  • [DMAS-79289] - Error initializing archive file manager in QA
  • [DMAS-79296] - OrganizationService not working
  • [DMAS-79299] - Quarter scalar data includes data outside of deployment when it should not
  • [DMAS-79304] - In QA calibration formulas cannot be saved anymore since the "Save" button was removed
  • [DMAS-79306] - Unable to see deployments if there is a deployment with a null dateTo value
  • [DMAS-79312] - ArchiveFileManager getByDevice results in NPE
  • [DMAS-79313] - Can's sync anything in QA
  • [DMAS-79326] - Changing a taxon's common name fails with an org.hibernate.SessionException: Session is closed
  • [DMAS-79389] - Data Player Widget makes repeated webservice calls when accessed anonymously
  • [DMAS-79394] - Applied QAQC tab on device details page does not work as expected in QA
  • [DMAS-79395] - Fix misuse of getmatlabjobdatabytaskid function in castdatacorrectionpostprocessjob
  • [DMAS-79409] - UVic task machines must not listen to the datasync queue
  • [DMAS-79419] - Fix QA bug of Save Button not appearing on some pages
  • [DMAS-79426] - fix archive file api not filtering restriction warning messages correctly in QA
  • [DMAS-79435] - Race condition in Expedition Management landing page
  • [DMAS-79441] - Unable to save or edit an annotation
  • [DMAS-79443] - Can't sync message in QA due to ClassNotFoundException
  • [DMAS-79447] - NullPointerException when saving synchronzer deployment with null dateTo
  • [DMAS-79449] - API /scalardata/device returns incorrect actualSamples when rowLimit is set
  • [DMAS-79451] - Quarter scalar job never terminates in QA
  • [DMAS-79456] - Updating a synchronizer deployment doesn't update modifyby or modifydate
  • [DMAS-79457] - Synchronizer management page crashes when toggling Start Now while editing a deployment
  • [DMAS-79473] - Erroneous ISO19115 xml metadata for Camera System in QA search automation
  • [DMAS-79474] - QA machines fail to *restart* due to ClassNotFoundException
  • [DMAS-79482] - Issue for Save button on SiteDeviceSubsetMaintenance
  • [DMAS-79489] - hostname not set correctly when task queued for not uvic shorestation in QA
  • [DMAS-79498] - .gz files don't appear in Data Search .zip download
  • [DMAS-79515] - Cannot cancel a running task

User Story

  • [DMAS-76402] - As a system admin, I want to manage which datasync queues receive messages so that I don't have to do too much manual clean up
  • [DMAS-77348] - Link to Search History Page from Data Search to improve accessibility of page
  • [DMAS-77692] - As a Community Fishers users, I want to download all casts from one station on Community Fishers Map without having to go to Data Search
  • [DMAS-77978] - As a batch management user I would like to have batch tasks automatically run in sequence
  • [DMAS-78339] - As a dev, I would like to see consistent date format on UI pages
  • [DMAS-78482] - As a system admin, I want to see whether synchronizers are deployed so I know which message queues need to be managed
  • [DMAS-78483] - As a system admin, I want to create synchronizer deployments so I don't need to manage their queues myself
  • [DMAS-78484] - As a system admin, I want to edit synchronizer deployments so I can end deployments
  • [DMAS-78575] - As an API user, I'd like better messaging when I hit restricted data
  • [DMAS-78797] - As a user, I would like to see Modified Date and Modified By info on Device Workflow Admin page
  • [DMAS-79057] - Ensure all ST-related synchronized tables use ModGenerator
  • [DMAS-79224] - Clean up activation and bundling of DataSyncServiceActivator
  • [DMAS-79429] - Define Storybook usage and standards

Task

  • [DMAS-35284] - Quarter-scalar-generation: limit number of records to be processed each time
  • [DMAS-67742] - Change property value from sensortype name to sensortype code on url of data search
  • [DMAS-73214] - Deprecate CANARIE registry endpoints and supporting code
  • [DMAS-74080] - Remove DataProductFormatAttribution table
  • [DMAS-77454] - change cruiselivestream_hist_seq to cruiselivestream_trx_seq
  • [DMAS-77899] - Convert organizationagreement varchar columns to text to allow any length
  • [DMAS-77990] - Prototype a script to export a subset of users from one LDAP instance to another
  • [DMAS-78603] - Add unit tests for getmatlabgetjobdatabytaskid
  • [DMAS-78975] - Clean up unused and uneeded parts of NeptuneVelocityServlet
  • [DMAS-79094] - Support parsing path params in DmasRestService
  • [DMAS-79144] - Update Required Date Format in QAQC Results Deletion and Reprocess Jobs
  • [DMAS-79149] - Delete unused CSD application
  • [DMAS-79191] - Move task email sending into a single place
  • [DMAS-79194] - Clarify what networking tools a user needs to run npm run deploy:oceans3
  • [DMAS-79208] - OpenAPI - update description fields for all the different services
  • [DMAS-79210] - Simplify renovate build process
  • [DMAS-79215] - organizationagreement has hist and trx tables
  • [DMAS-79221] - Remove deprecated adcpdata service
  • [DMAS-79232] - Support using TypedBaseDAO.saveOrUpdateList on types with non-zero unsaved PK values
  • [DMAS-79254] - Update label id for dropdowns on the DeviceActions page for testing purpose
  • [DMAS-79270] - Support Rinko-FT devices in the Community Fishers Pipeline and Data Products
  • [DMAS-79278] - If Hibernate fails to connect to the DB during a deployment with --watch, shut down affected servers so they don't spam the logs
  • [DMAS-79301] - Remove the abandoned ComplexDataViewer page
  • [DMAS-79308] - Support hiding some columns from the table of deployed synchronizers on the Synchronizer Management page
  • [DMAS-79309] - simplify logic for when a task can be ran and bypass scheduler topic
  • [DMAS-79348] - Update recurring search user info to align with current use
  • [DMAS-79352] - Add the Synchronizer Management app to Ocean3 menu
  • [DMAS-79357] - Remove the ChartContainer react component
  • [DMAS-79368] - wrap text on telnet console page
  • [DMAS-79397] - Update earthquake catalog page with correct detection area lat lon
  • [DMAS-79398] - Set user permissions for the Synchronizer Management page
  • [DMAS-79400] - Add synchronizer id to the synchronizer deployment UI
  • [DMAS-79420] - Update directory where EEW mseed files get downloaded to

Implementation

  • [DMAS-76355] - Generate IDs for synchronizable objects using a server's synchronizerId
  • [DMAS-76898] - Write skeleton code for device details GeneralTabPage
  • [DMAS-78159] - Write the Cypress skeleton code for the GeneralTabForm component
  • [DMAS-78270] - Replace the original Taxonomy page with the new one
  • [DMAS-78320] - Save changes to taxons and taxonomies
  • [DMAS-78327] - Get a list of active & future synchronizer deployments from the backend
  • [DMAS-78328] - Display a table of active and upcoming synchronizer deployments
  • [DMAS-78329] - Extend the create dialog to support editing a synchronizer deployment
  • [DMAS-78331] - Save a new synchronizer deployment in the backend
  • [DMAS-78332] - Save new synchronizer deployments on clicking Save in the create dialog
  • [DMAS-78333] - Add a Create Deployment button to the synchronizer management page's table widget
  • [DMAS-78340] - update date format for modified date or modify date on Actions, DeviceType, DeviceCategory, Organizations pages
  • [DMAS-78342] - update date format for modify date or modfied date on Device Sync and DataPreviewManagement pages
  • [DMAS-78344] - update date format for modified date or modify date on qaqc auto test finder and auto test details pages
  • [DMAS-78437] - Display a form on clicking the Create Deployment button
  • [DMAS-78438] - Add validation to the Create Deployment dialog
  • [DMAS-78485] - Update a synchronizer deployment in the backend
  • [DMAS-78486] - Update an existing deployment on clicking Save in the edit dialog
  • [DMAS-78637] - Implement users receiving optional emails when batch pauses or completes - ONC
  • [DMAS-78638] - Clean up the paths of the new taxonomy page in Oceans Next
  • [DMAS-78794] - Update "Playlist Created" snackbar to link to the playlist
  • [DMAS-78813] - Extract QAQC persistence code to OSGi bundles
  • [DMAS-78865] - Re-implement Buttons.jsx Save
  • [DMAS-78894] - Create tab for network console for local context project and service for getting project id
  • [DMAS-78895] - Create front end based off design for displaying local context project
  • [DMAS-78906] - Create a table view for displaying data sources
  • [DMAS-78948] - Return an error when TaxonomyMatrixAttributeService can't update or delete a taxon
  • [DMAS-78964] - Add a reference URL to custom taxons (frontend)
  • [DMAS-78978] - Return an IResourceName from NeptuneVelocityServlet.getResourceId
  • [DMAS-78983] - Have synchronizers connect to all synchronizers' datasync queues for publication
  • [DMAS-78987] - Create a management service for the synchronizer management UI
  • [DMAS-79004] - Convert Create*, Add* Buttons to use new format
  • [DMAS-79034] - Use locations/tree public service to get tree
  • [DMAS-79071] - add Modified Date and Modified By to Process
  • [DMAS-79072] - Update mapping files to use ModGenerator
  • [DMAS-79073] - Remove now-unused sequences and defaults using them
  • [DMAS-79074] - Implement users receiving optional emails when batch pauses or completes - Oceans Next
  • [DMAS-79079] - populate data product availability tables for live data when archive file entries are created
  • [DMAS-79083] - Return a list of synchronizers from the backend when /internal/synchronizer is called
  • [DMAS-79093] - Update useSnackbars hook to accept and use the `actions` prop
  • [DMAS-79098] - Create synchronizers for task servers and rename existing prod synchronizers to match hostnames
  • [DMAS-79147] - Support a messageType field distinct from the messageClass
  • [DMAS-79179] - Write the skeleton code for GeneralTabPanel
  • [DMAS-79180] - Write skeleton code for GeneralTabForm
  • [DMAS-79184] - Hook up the buttons in GeneralTabForm so they work
  • [DMAS-79229] - Create a service call to return all MQ locations
  • [DMAS-79243] - Create a new DiveLogDashboard component
  • [DMAS-79250] - add Modified Date and Modified By to Phase
  • [DMAS-79263] - Rebundle DataSyncServiceActivator
  • [DMAS-79264] - Clean up DataSyncServiceActivator activation
  • [DMAS-79266] - add Modified Date and Modified By to Task Editor
  • [DMAS-79271] - Rebundle enums in IFileLocationConfig
  • [DMAS-79272] - Remove dependency of extension.synchronization.api on core.usermanagement.api
  • [DMAS-79288] - Return Files from FileLocation
  • [DMAS-79300] - Implement skeleton webservice to get device package info
  • [DMAS-79319] - Implement ability to get all Community Fishers Device Packages
  • [DMAS-79325] - Move CommunityFishersDevicePackage to device bundle
  • [DMAS-79401] - Create wrapper on Community Fishers device packages with extra info for info page
  • [DMAS-79408] - Create an API for annotation converters
  • [DMAS-79428] - add message when a default value is used in the data search api
  • [DMAS-79431] - Create styleguide for buttons
  • [DMAS-79434] - Configure backend to allow for CORS preflight OPTIONS call and PATCH permissions
  • [DMAS-79436] - Replace logging jars with pax-logging-api
  • [DMAS-79439] - add modify info to deviceprocessgroup table
  • [DMAS-79448] - Add last verification date, last calibration date per device

Test

  • [DMAS-78302] - Update UI tests to work with the new taxonomy page

Bug (ST)

  • [DMAS-79303] - Response from /internal/synchronizers/deployments is missing a deployment's organization & user
  • [DMAS-79311] - RDI ADCP Wave devices are getting a datasets.xml section for Codar device types

Requirement

  • [DMAS-78518] - Gather requirements for Community and device package UI

February 15, 2023

Minor release for CF AML-6 CTD parser and logging issue.

Tickets Released: Oceans 3.0: 24.01.002 (accessible to internal users only). Total: 2.

February 12, 2023

Major release, covering December thru January.

Maintenance

New Features or Improvements

  • Standardized data format for Modified By and Modified Date Oceans 3.0 pages
  • Python API library documentation update
  • Update web services to add Modified By and Modified Date for device workflow admin page
  • Allow to close enlarged images on Search Hydrophone Data page
  • Add new data source filter "Restrict data source selection to map-view" on Data Search page. Off by default to prevent tree-trimming.
  • Add another order by (modifydate desc) for deviceattributes or sensorattributes on Device Details display
  • Draggable dialog box on Device Category page
  • Allow colons in the field label of fornfield entries
  • Remove groundfault alarm setting for mini JunctionBox with 400 volt ports
  • Lots of new or updated or fixed automated tests

Bug Fixes

  • Fix ticket creation which was broken by Jira upgrade

Internal projects

  • Java 17 upgrade project is officially complete
  • Various small deployment improvements: better logging, reduce errors, improve validator warnings
  • Support refactoring ship-shore-synchronizing managers into OSGi-services mid-season
  • Drop support for IE9

Dashboards (in support of Acoustic Data Viewer)

  • DEV/QA only data selector widget beta

CIOOS

  • Use correct version of DOI link now that CKAN supports it
  • Local Contexts - in progress - support association of Local Contexts project ID with Organization Agreement, display labels associated with project
  • Fixed issue with CKAN harvest jobs not finishing

ExperiMINTED/Task Management

  • Remove pagination for Batch Tasks - all top-level batch tasks now show on one page to make sequencing simpler
  • Batches now support auto-run 
  • We now support a pipeline job which will run the specified set of jobs sequentially
  • Bug fix: running DOI registration jobs metadataOnly updates DataCite correctly again 

EEW

  • Fixed a bug where site detections could show up multiple times if they didn't have a p-wave or s-wave attached on the earthquake detail page.

API

  • Removed userId parameter from ScalarDataAPIService (not the public API service) to improve security.
  • Support default data product options in the data product delivery service. Also ignore any incorrect options a user provides. Response contains the corrected URL.
  • Remove scalar data get by station API
  • Have user input persist on the OpenAPI  page if they enter it while logged out and then log in to try their query.
  • Add deviceCode filter to the OpenAPI  deployment service page. The API already supported it but it wasnt listed on the OpenAPI page.
  • Improve performance of the get location and get location tree services
  • Update all public API services to support an appToken (for dashboards)
  • Update the citation response from delivery API services to include fields for the DOI, landing page link, and query pid in addition to the citation string.
  • Added filters to the location tree service so it has all the same ones as the get location service.

Data Products

  • Bug fixes: Nortek data for rest of day is missing after a configuration change (in some cases), slow/stuck RDI reading with gappy data
  • Better plot titles for supporting global data
  • ERDDAPnetCDFpostProcessor ready: added features for automatic dataset switch over as we populate, handling of re-postprocessing, chunking for reliability, filters by device and time for live and re-postprocessing, edge cases

SeaTube

  • Finished Playlist update project phase 1
  • In-progress: supporting 10+ onship servers
  • Some minor improvements
  • A few bugs fixed

Community Fishers

  • Fixed multiple lasso tool bugs
  • Fixed CF duration limit accidentally applied to all siteDeviceSubset types
  • Fixed CF App Wi-Fi Regression Test patch for CF.3.2.10
  • Added DeviceTypeAttribute to track android SDK version for devicetype 267
  • Dropped the ErddapDatasetAttribute and ErddapDatasetAttribute_hist table
  • Converted CFOverlay to a functional typescript component
  • Refactored Cast Selection popup out of CFOverlay
  • Added mapId to the context so it isn't passed around everywhere
  • Fixed lasso tool on CF map contains undefined reference to assignedCastData
  • Added I18n to cut down on code maintenance for Buttons in React

Tickets Released: Oceans 3.0: 24.01.000, 24.01.001 (accessible to internal users only). Total: 254. Automated Testing: AT.24.01.000 total: 44.

Expand

Bug

  • [DMAS-78840] - The mat-format data products for the AZFP Echosounder (55036) at DDL have unexpected units in the profileData
  • [DMAS-79231] - Tasks that cannot be executed due to singleton constraint result in a NPE
  • [DMAS-74752] - Order device attributes by datefrom desc, modifydate desc on device details/additional attributes page
  • [DMAS-77991] - Description collapse text displays for all playlists in Firefox
  • [DMAS-78330] - Synchronization managers can't be referenced
  • [DMAS-78418] - I can't modify or delete button sets I create
  • [DMAS-78592] - Data Search filter misbehaves when changing between tree types with active filters
  • [DMAS-78594] - Links to DOI Dataset Landing Pages broken for all CKANs
  • [DMAS-78621] - Can't set Junction Box alarm values for BPS miniJB028
  • [DMAS-78699] - Fix tests failing due to update of esri-leaflet to v3.0.12
  • [DMAS-78721] - Lassoing irregular shapes causes duplicate cast lasso items
  • [DMAS-78738] - Titles in matlab plots don't know about South
  • [DMAS-78753] - Fix VideoTest.testShareVideo
  • [DMAS-78762] - Data access restriction doesn't work in ST dive log
  • [DMAS-78763] - Unnecessary error messages while reordering my video clips
  • [DMAS-78769] - Playlist Playback page crashes when a playlist has no clips
  • [DMAS-78771] - SeaTube Chat Log widget's minimum height depends on the window height
  • [DMAS-78782] - CastPopup occasionally fails tests when ran locally.
  • [DMAS-78783] - Downloading clips from a playlist while not logged in displays an error "Network error"
  • [DMAS-78795] - main branch of Oceans Next not building on Windows
  • [DMAS-78805] - Position and show/hide issues on the video control bar of Playlist Playback page.
  • [DMAS-78822] - Bathymetry page is failed to load.
  • [DMAS-78835] - Metadata change task and DOI registration task are assigned 0 sequence numbers
  • [DMAS-78845] - SiteDevice Subset upcast/downcast changes have globally affected all subset types
  • [DMAS-78857] - Deployments sometimes fail with `tail: invalid number of lines '+Binary'`
  • [DMAS-78873] - Fix failing storybook build
  • [DMAS-78885] - Oceans Next isn't reporting jest test results
  • [DMAS-78888] - Oceans 3 fails to restart in QA2
  • [DMAS-78912] - Some pages don't load from the start:oceans3 script
  • [DMAS-78917] - There are expeditions/dives missing in on-shore dive logger
  • [DMAS-78931] - CKAN of dataset record is not available even though devices have been added through ERDDAP, CKAN jobs
  • [DMAS-78946] - Bug in the parser for Nortek Aquadopp Profiler 2MHz, specifically at Folger Pinnacle on 2024-Jan-06
  • [DMAS-78955] - lasso button is being duplicated on the geospatial page
  • [DMAS-78963] - Error when editing existing playlists
  • [DMAS-78968] - Adding a collection does not close the "Create Collection" dialog
  • [DMAS-78985] - lasso tool on CF map contains undefined reference to assignedCastData
  • [DMAS-78994] - Fix failing test case in TaxonomyDetailWidget.cy.tsx
  • [DMAS-79003] - Null Pointer Exception When Logging in on Dev
  • [DMAS-79027] - Clip deletion failing due to missing playlistHdrId
  • [DMAS-79032] - Investigate QAQC Reprocess (job ID 359) failure for taskId 36661223
  • [DMAS-79045] - Geospatial map lasso tool removes selected casts when performing new lasso
  • [DMAS-79049] - Device Workflow Admin Phase Filter not showing up in QA
  • [DMAS-79065] - Selecting casts with lasso after choosing 'Select all casts' doesn't revert button to 'select all casts'
  • [DMAS-79084] - In QA, I can't update the datatype of a taxonomy attribute, or add options to it
  • [DMAS-79090] - Device Workflow Admin Process Filter not showing up in QA
  • [DMAS-79092] - DOI title mismatch between datacite and ONC database
  • [DMAS-79106] - Accessing ComplexDataPlayer as an anonymous user will crash the browser
  • [DMAS-79109] - Device Workflow Admin page can not add/delete phase
  • [DMAS-79110] - Pressure data for RDI ADCP 150 kHz (SN 8580) for SOG East is incorrect in MAT and RDI data prdocuts
  • [DMAS-79121] - Cannot generate dataProducts for historical casts at a station via the Community Fishers Map
  • [DMAS-79125] - Error occurring in Batch Management when deselecting a batch
  • [DMAS-79134] - Earthquake Detail Page site detection table is showing duplicate sites
  • [DMAS-79142] - error when trying an open api query when logged out
  • [DMAS-79146] - Applying filters or enabling drifter/cf sampling stations on QA DataSearch causes device tree to reload collapsed
  • [DMAS-79170] - modifyDate and modifyBy is null for a new Process, Phase or phasephasetask
  • [DMAS-79200] - imagenex-837-postprocess-job generate *.837 files with zero filesize in qa with release/24.01.000
  • [DMAS-79207] - The XML configuration files for the AZFP Echosounder (55036) at DDL are incorrect after 2023-11-24 22:06
  • [DMAS-79219] - piggyback device connect multiple ports to different port of parent device in topology is broken

Epic

  • [DMAS-74103] - As a software developer, I want to upgrade our tools to use Java 17 so that we can make use of the latest features and ongoing support

User Story

  • [DMAS-73635] - As a ST developer, I would like to support more than 10 onship servers
  • [DMAS-75300] - As a software developer, I want to upgrade dev dependencies to match the versions used in the new Equinox
  • [DMAS-77737] - As a software developer, I would like more constraints on database updates and deletes in the QA and DEV databases
  • [DMAS-78371] - As a software developer, I want synchronizer database tables to use a module prefix
  • [DMAS-78447] - As a dev, I would like to have modifydate and modifyby coumns and trx table for device workflow related database tables
  • [DMAS-78474] - As a user, I would like to see consistent names for fields Modified Date and Modified By
  • [DMAS-78481] - As a software developer, I want a synchronizer management skeleton page for me to build on
  • [DMAS-78494] - As a scientist using SeaTube, I want to be able to lock a playlist against editing so that links from published papers can't be broken
  • [DMAS-78552] - As a software developer, I want to drop support for testing old branches with Java 8 in order to simplify maintenance and test processes
  • [DMAS-78684] - As a ST user, I want to be able to create, edit, and delete playlist group from the group panel
  • [DMAS-78708] - As a SeaTube user, I want video snapshots to use a more appropriate quality
  • [DMAS-78933] - Add stories for map buttons, menus, sizeables sliders
  • [DMAS-78939] - Add storybooks for steppers

Task

  • [DMAS-37728] - remove navdata configproperties in database
  • [DMAS-46729] - Jan Schluter would like a "restrict to visible area" tickbox instead of automatic filtering in data search
  • [DMAS-47205] - ServerManagementService appears to be inactive
  • [DMAS-67409] - As a data partner, I would like to see ScalarDataAPIService validate its user's identity so that data access restrictions can be enforced
  • [DMAS-73306] - As a user, I would like to see an alert when future dates are used in QAQC Results Deletion Job
  • [DMAS-74927] - As an app developer, it would be useful to have quick access to the android version of a tablet used in CF
  • [DMAS-75613] - As a dev, I would like to see dialog box on device category dragable
  • [DMAS-76872] - Always proxy through qamon/ncdeploy when deploying from Jenkins
  • [DMAS-76942] - Add job.failed.email.recipients job parameter for QAQC reprocessing job
  • [DMAS-76961] - Make each of the data product options in the Dataset Landing Page for query PID options table links to the wiki
  • [DMAS-77026] - Improve email content for the support request
  • [DMAS-77818] - Print any errors thrown when installing OSGi bundles in QA/prod
  • [DMAS-77950] - Remove the page header bar on the playlist playback page
  • [DMAS-78013] - Lazily load Playlist apps when running Oceans Next in playground mode
  • [DMAS-78301] - Replace loading spinners on Thumbnails with a Skeleton component
  • [DMAS-78338] - Populate the synchronizer database tables
  • [DMAS-78356] - Adjust styling in PlaylistList to add space between thumbnail and text
  • [DMAS-78357] - Redirect the SeaTubeV3 Playlist playback route to the new Playlist Playback page
  • [DMAS-78411] - Make DataSyncServiceActivator agnostic to whether a synchronizable manager is an OSGi service or not
  • [DMAS-78528] - Refactor AsyncAutocomplete to use cancellable service calls and create storybook
  • [DMAS-78585] - Design where playlist lock/unlock buttons and icons will go, how it will affect the playback page
  • [DMAS-78639] - Allow colons in the field label of formfield entries.
  • [DMAS-78692] - Search Hydrophone Data page does not allow to close zoomed images
  • [DMAS-78711] - As a user, I would like to see consistent display for Modified By on dmas UI pages
  • [DMAS-78732] - Update the playlist discovery page's Modified column if a playlist's clips are modified
  • [DMAS-78739] - Update Dockerfile to use Node v20
  • [DMAS-78796] - As a dev, I would like to include modifyby and modifydate in the web services for device workflows
  • [DMAS-78804] - Inconsistent date formats in notification emails
  • [DMAS-78824] - Add story with docs for AvailabilityChart
  • [DMAS-78827] - Add stories for Filters and DragScroll
  • [DMAS-78837] - scalardata get by station failing to return data
  • [DMAS-78842] - The Jenkins storybook build should email the senior developers on failure
  • [DMAS-78846] - Switch configuration to avoid needing to import React in every single file
  • [DMAS-78853] - Unassigned casts inside station perimeter
  • [DMAS-78854] - On the openapi page if a user fills out a service query while not logged in the form should keep the values after login
  • [DMAS-78880] - OpenApi deployment page is missing the deviceCode filter
  • [DMAS-78886] - Configure logging for OSGi tests
  • [DMAS-78887] - Equinox validation should fail with a better message if gemini.service exists but /usr/local/gemini doesn't
  • [DMAS-78908] - improve the performance of the get location tree public api call
  • [DMAS-78909] - Update code coverage reports for Oceans Next
  • [DMAS-78910] - Update code coverage reports for Oceans 3
  • [DMAS-78913] - need able to deploy oceans-next code to qadivelogger4.onc.uvic.ca through Jenkins
  • [DMAS-78925] - Run DigitalFishers UI tests in Renovate builds
  • [DMAS-78940] - Add appToken support to external services not supporting it yet
  • [DMAS-78943] - Implement TaxonAsyncAutocomplete into Dive and Deck Log
  • [DMAS-78959] - Add new field auto-requeue to tm_tasktype
  • [DMAS-78960] - Update openAPI page and documentation for resample periods
  • [DMAS-78979] - CKAN harvester won't stop
  • [DMAS-78989] - Don't attempt to use Matlab if matlab as a service is turned off (Dev)
  • [DMAS-79006] - Remove pagination for the first level of batch tasks
  • [DMAS-79017] - Improve task original date query
  • [DMAS-79021] - Update dependency react-virtualized-auto-sizer to v1.0.21
  • [DMAS-79031] - Remove sequenceNumber from DAO objects
  • [DMAS-79060] - Sort the AppMenu in Oceans Next
  • [DMAS-79089] - Remove the current playlist from the list of Copy To Playlist options on Playlist Playback page
  • [DMAS-79091] - Update tests for the ModifiedBy value on UI page
  • [DMAS-79105] - update post refresh scripts with new task type column
  • [DMAS-79201] - As a data steward, I would like the sensortype description field to be longer, to make state-type sensor values clearer
  • [DMAS-79234] - Add logging to JMSExceptionHandler and GenericJMSConnection
  • [DMAS-79257] - Correct checkstyle issues in GenericJMSConnection

Implementation

  • [DMAS-77504] - Implement Data Source Selection Widget
  • [DMAS-77738] - Add where clause constraint to all database table updates and deletes
  • [DMAS-77993] - Convert CFOverlay to a functional typescript component
  • [DMAS-78032] - Make FormFieldService available anonymously
  • [DMAS-78218] - Drop JDK options from Integration Testing build scripts
  • [DMAS-78259] - Refactor Cast Selection Poppup out of CFOverlay
  • [DMAS-78288] - Display read-only metadata when selecting a taxonomy or taxon
  • [DMAS-78291] - Display a form with taxons' default attributes
  • [DMAS-78293] - Delete a taxon or taxonomy when clicking Delete Taxonomy or Delete Taxon
  • [DMAS-78294] - Add a taxonomy when clicking Add User Defined Taxonomy
  • [DMAS-78296] - Add a taxon when clicking Add Taxon
  • [DMAS-78321] - Autosave changes to default attributes
  • [DMAS-78325] - Make a servlet for the synchronizer management UI
  • [DMAS-78326] - Make a React page for synchronizer management
  • [DMAS-78372] - Create new prefixed synchronizer tables
  • [DMAS-78373] - Update hibernate mapping files to use prefixed synchronizer tables
  • [DMAS-78374] - Remove unprefixed synchronizer database tables
  • [DMAS-78436] - Make a base web service supporting multi-verb REST services
  • [DMAS-78448] - Add modifydate and modifyby columns in phase, phasephasetask, phasetype, process, processgroup, processphase and processtype tables
  • [DMAS-78449] - creat trx for phase, phasephasetask, phasetask, phasetype, process, processgroup, processphase and processtype database tables
  • [DMAS-78466] - Drop ErddapDatasetAttribute table
  • [DMAS-78495] - Add a lock button to the playlist details header bar on the playback page
  • [DMAS-78496] - Add columns "locked" and "lockreason" to playlist_hdr
  • [DMAS-78497] - Add persistence and web service code for "locked" and "lockreason"
  • [DMAS-78498] - Lock a playlist when a user confirms their click on the lock button
  • [DMAS-78499] - When a playlist is locked, display an unlock button in the playlist details header instead of a lock button
  • [DMAS-78500] - If a playlist is locked, display it as read-only on playlist discovery
  • [DMAS-78501] - If a playlist is locked, display it as read-only on playlist playback
  • [DMAS-78502] - If a playlist is locked, reject edits to it in web services
  • [DMAS-78545] - Drop support for deploying Oceans Next to Gemini
  • [DMAS-78547] - Update Modified Date/Modified By field names for React pages created by other groups
  • [DMAS-78566] - Add UI indicator and controls for automatic batch task execution
  • [DMAS-78568] - Implement batch task auto-queueing
  • [DMAS-78583] - Disable locked playlists in selection dropdowns for adding clips in Oceans Next
  • [DMAS-78598] - Update dataproduct discovery service to show default values, request service to use default values, and open api page to display defaults in description text
  • [DMAS-78626] - Add a reference URL to custom taxons (backend)
  • [DMAS-78664] - Add a method to PlaylistService to update a group name
  • [DMAS-78665] - Create a new Expedition Admin - ONC group
  • [DMAS-78671] - Update ExpeditionOrganization.java to use the new group
  • [DMAS-78674] - Update SeaTube.jsx to use the new group
  • [DMAS-78675] - Create a Dialog for creating a playlist group
  • [DMAS-78676] - Create a dialog for editing a playlist group name
  • [DMAS-78678] - Create a dialog for deleting a playlist group
  • [DMAS-78679] - Disable the add group button if there aren't any ungrouped playlists
  • [DMAS-78713] - Add translations with a button base component
  • [DMAS-78716] - Enable authentication when running UI tests in QA2
  • [DMAS-78722] - Implement date chunking when searching for days to create NetCDF files in ErddapNetCdfPostProcessor
  • [DMAS-78723] - When generating NetCDF for Erddap always produce a NetCDF file even when sourceFile does not have sufficient data
  • [DMAS-78724] - Implement filtering options for ErddapNetCDFPostProcessor
  • [DMAS-78774] - update column names to Modified Date and Modified By on Network Console page
  • [DMAS-78793] - Refactor Create/Update Playlist buttons in SeaTube Search to be disabled/have loading indicators
  • [DMAS-78806] - Hide locked playlists in selection dropdowns for adding clips in SeaTube Pro
  • [DMAS-78811] - Extract StudyArea persistence code to OSGi bundles
  • [DMAS-78812] - Extract data acquisition metrics to OSGi bundles
  • [DMAS-78818] - Check if a taxon's originTaxonomy is editable in the default attributes form
  • [DMAS-78820] - Add mapId to the context so it isn't passed around everywhere
  • [DMAS-78823] - Update Modified Date/Modified By field names for Device Details, Site Device and Dive page
  • [DMAS-78825] - Add a Properties table for imported taxonomies and their taxons
  • [DMAS-78828] - Replace Jetty with Tomcat in dev
  • [DMAS-78829] - Run dev on the root context path
  • [DMAS-78830] - Remove the distinction between dev and prod bndrun files
  • [DMAS-78833] - Update VideoSnapshotService to use the appropriate quality source for snapshots
  • [DMAS-78834] - Set the video quality to use for playlist thumbnails
  • [DMAS-78841] - Remove several unused dependencies
  • [DMAS-78847] - Derive the location of Oceans Next automatically
  • [DMAS-78849] - Only allow open tasks to swap sequence numbers
  • [DMAS-78851] - have the running status chip on task management be green
  • [DMAS-78852] - Change "Group" to "Collection" for current playlist group components
  • [DMAS-78856] - Set the video quality to use for dive log snapshots
  • [DMAS-78864] - Extract labels from Buttons.jsx and organize them into translations.json (en)
  • [DMAS-78871] - Default the locking service code to use the previous lock values if none are passed
  • [DMAS-78875] - Implement basic task pipelines
  • [DMAS-78889] - Remove unnecessary notes about .ssh/known_hosts in Oceans Next deployment Jenkinsfile
  • [DMAS-78892] - Add projectid column to organizationagreement table
  • [DMAS-78893] - Create dal layer for organization agreement local context project id column
  • [DMAS-78896] - Increase mod count
  • [DMAS-78907] - Refactor TaxonForm.tsx into different components for editing and adding
  • [DMAS-78911] - Update global.baseurl in dev
  • [DMAS-78915] - Update Modified Date/Modified By field names for Expedition Maintenance, Sensor Maintenance - Additional Attributes Tab, SeaScript Editor
  • [DMAS-78924] - Deprecate the old Button.jsx file and add a warning comment to the top of Buttons.jsx
  • [DMAS-78935] - Refactor GenericSystemCommandActivator as an OSGi whiteboard
  • [DMAS-78944] - Convert High and MediumEmphasisSubmitButton to use new format
  • [DMAS-78945] - Convert DeleteButtonRed to new format
  • [DMAS-78954] - Convert ImageUploadButton, ChooseFileButton, MediumEmphasisChooseFileButton to new format
  • [DMAS-78965] - Convert Generic*, FloatRight* Buttons to use new format
  • [DMAS-78973] - add default values for modifyby and modifydate in device workflow related tables
  • [DMAS-78976] - General cleanup of unused features of NeptuneVelocityServlet
  • [DMAS-78984] - Make use of taskOutput in ErddapNetCdfPostProcessor
  • [DMAS-78993] - Compare creation date of NetCDF file to source file during job run
  • [DMAS-79009] - Create batchable task that deletes files from Erddap NetCdf file store - SQL
  • [DMAS-79010] - Create batchable task that deletes files from Erddap NetCdf file store - Java
  • [DMAS-79016] - Refactor the ToolbarButtons used in Buttons.jsx
  • [DMAS-79018] - Update public api citation response
  • [DMAS-79019] - Improve batch task pagination
  • [DMAS-79020] - Handle source archivefiles that span multiple days
  • [DMAS-79037] - remove sequencenumber from ONC DAO objects
  • [DMAS-79039] - Create RDI ADCP Cassandra to NetCdf changeover job - Java
  • [DMAS-79040] - Create RDI ADCP Cassandra to NetCdf changeover job - SQL
  • [DMAS-79046] - Add DeviceTypeAttribute to track android SDK version for devicetype 267
  • [DMAS-79050] - Implement API location tree filters
  • [DMAS-79051] - Add column to tasktype
  • [DMAS-79055] - Add ADCP Wave device type to ERDDAP RDI ADCP NetCDF Generation Job
  • [DMAS-79061] - add Modified Date and Modified By to Process Group
  • [DMAS-79068] - Batch Task pagination service changes
  • [DMAS-79069] - Use new /netcdf_data volume to store NetCdf files for use with Erddap
  • [DMAS-79077] - Use a timeout when generating NetCdf files for Erddap
  • [DMAS-79080] - Allow multiple blacklist/whitelist dateranges to be specified for one device
  • [DMAS-79199] - Sometimes NetCdf files can be generated each time the job runs when they should not be

Test

  • [DMAS-76365] - Update the synchronizing test plan to properly document where messages should be sent
  • [DMAS-78918] - Need test group-user synchronization for the new group in QA

Bug (ST)

  • [DMAS-78622] - Deleting a taxon doesn't work if it has been imported
  • [DMAS-78870] - Add padding that Button.jsx adds to reduce visual changes when refactoring
  • [DMAS-78966] - Support an argument on the --jdk option for Oceans 3 deployments
  • [DMAS-78992] - Error colored buttons don't style correctly when disabled
  • [DMAS-79012] - Fix Batch Task Pagination ONC
  • [DMAS-79013] - Fix Batch Task Pagination Oceans next
  • [DMAS-79076] - Investigate NetCdf generation getting stuck/slow in Matlab
  • [DMAS-79195] - phasetask_trx table phasetaskreferences nullable

Investigation

  • [DMAS-38792] - Investigate why SensorReadingCache entries expire after 60s

Documentation

  • [DMAS-78525] - Update external wiki documentation with new scalar data service parameter

Requirement

  • [DMAS-78801] - Create requirements for Local Context-Data Agreement association

Design

  • [DMAS-78936] - Document the design for the stages leading to being able to use generic command messages on the system console

January 16, 2023

Minor release to fix bugs in SubC camera control and scalarData service, plus update connection pool limits.

Tickets Released: Oceans 3.0: 23.11.003 (accessible to internal users only). Total: 3.

January 10, 2023

Minor release to update acoustic scintillation driver (no downtime)

Tickets Released: Oceans 3.0: 23.11.002 (accessible to internal users only). Total: 1.

...