You are viewing an old version of this page. View the current version.

Compare with Current View Page History

« Previous Version 939 Next »

This page contains the current year's release notes and new features, primarily for Oceans 3.0, as well as any applications created/maintained by the ONC software development group, including mobile Apps and desktop/PC applications. In progress project status may be presented as well. The information below is written in plain language as much as possible. "Major" releases include all completed items at that time (monthly), while "minor" releases are updates to the previous major release with bug fixes and specific features. Detailed release notes are available on internal confluence pages (internal users only).

November 2, 2023

Major release.

Maintenance

New Features or Improvements

  • Limit each user's disc usage on /ftp/pub: searches will stay queued and emails will be sent
  • Drop several deprecated database tables ( e.g., sensorcategory, devicecategorymatrix, devicecategorymatrix_hist)
  • Remove FKs in hist or trx tables, fill in null values in datecreated or lastaccess in dmasuser database table
  • Deprecate the Cambridge Bay lite page task and page (replaced by Dashboards)
  • More clear pop-up alert when a duplicate attribution is created on the Data Agreements page
  • Trim IP address before it is saved
  • Lots of new or updated selenium tests
  • Many document updates
    Bug Fixes:
  • Incorrect search status in the return of  DataSearchService (fixes a SeaTube Video Export issue)
  • Snapshotting does not work some times in SeaTube Pro
  • Not able to add user group form when all users is selected on the User Management page
  • Support Request form bug fixes

Internal projects

  • Feature: upgraded to Java 17 (already released in 23.08.001)
  • Deprecation: remove redundant OBIS Settings page (previously replaced with SeaTube Configuration)
  • Bugfix: return all readings from /api/archivefiles by location for sites with many deployments, with small query row limits
  • Bugfix: delete user-defined taxons with default attributes
  • Bugfix: delete attribute options from user-defined taxons
  • Bugfix: improve session persistence across restarts
  • Bugfix: when clicking Query Annotations button from Device Details or Sensor Maintenance, only open it in one new tab

Data Products

  • AquaSCAT data products mapped and documented, will be released soon (in-progress)
  • MATLAB API client library improvements (in-progress)
  • Community Fisher plot attribution to show role
  • Seismometer plot range fix: add dynamic scaling if data is out of expected range
  • Bug fixes: hydrophone search failure due to bad date range on file, sensorcategory deprecated, ffprobe/ffmpeg refactor and bug fix

Data Policy

  • Support selecting a time-limited portion of a site device for association (editing agreement/site device associated time ranges coming soon)

CIOOS

  • Use file link to ISO in ERDDAP to improve dataset load performance 

ExperiMINTED

  • Make reason mandatory for a DOI batch

  • Default sequencing for batch tasks implemented and displayed

Dashboards

  •  Improved table on Management page so it uses the full page and can be searched 

Earthquake Early Warning

  • Set a webserver to receive notifications from Telus
  • Update the position of PNSN devices when new data comes in
  • If the second character of the channel code for a PNSN device is an H set the device name to seismometer instead of accelerometer

OpenAPI

  • Add more information about the ISO 8601 duration date format on the openAPI page
  • Update the rawdata service to get raw data for the parent if a user queries a piggyback device
  • Fix the search statistic query so its not calculating seconds and calling them hours. Should result in more accurate estimates from the dataProductDelivery API.

Community Fishers

  • Added tooltip/title to unassigned cast listing in lasso selection popup
  • Make use of Task output in Community Fishers Pipeline Jobs
  • Handle device level searches for Community Fishers ISO 19115 that use new search format. 
  • Refactored the date filter into it's own component
  • Refactored the help and support request popups into a single file
  • Refactored the history table and Polygon into their own components
  • Refactored Geospatial Search page to have a single context for casts
    Bug Fixes:
  • DB error when generating a new DOI
  • Unable to make public Dashboard private
  • Community Fishers ISO XML no longer lists community and instead lists ONCS as owner of all CF casts
  • Search bar for Community Fishers Map does not center map on searched location

Instruments

  • Progress on Rayfin driver improvements

SeaTube

  • Many new features in Playlists
  • Design for supporting 10 plus on-ship servers (in-progress)
  • Minor improvements & bug fixes

Tickets Released: Oceans 3.0: 23.10.000 (accessible to internal users only). Total: 137. Automated Testing: AT.23.10.000 total: 33.

Bug

  • [DMAS-74675] - Two alerts pop up when creating a duplicate attribution on the Data Agreements page of Network Console
  • [DMAS-76477] - Add user group form is disabled when All Users is selected on the User Management page
  • [DMAS-77384] - Deleting a taxon with an attribute fails with a foreign key constraint violation
  • [DMAS-77407] - Plots of LME/N/Z channels on new Guralp Orcus Seismometer(s) aren't right
  • [DMAS-77584] - DataSearchService doesn't return correct status even there is error in the result
  • [DMAS-77727] - ST annotation search failed to return expect results while filtering by a taxon
  • [DMAS-77747] - React player failed to update to v2.13.0
  • [DMAS-77807] - Make reason mandatory when creating batch
  • [DMAS-77900] - add database constraint for various "code" columns
  • [DMAS-77918] - Getting a DB error when generating a new DOI
  • [DMAS-78031] - Oceans 3 to deployments to QA2 sometimes fail
  • [DMAS-78048] - Fix failing SiteDeviceMaintenanceTest tests
  • [DMAS-78053] - Page is not re-rendering after delete from playlist playback page
  • [DMAS-78061] - Rowlimit parameter of archivefiles web service (getListByLocation) is not working as expected
  • [DMAS-78076] - Task schedule activator is occasionally shut down when it shouldn't be
  • [DMAS-78128] - Simulators encounter an exception while loading sessions from persistent storage
  • [DMAS-78129] - Playlist Widget Cypress test broken in main
  • [DMAS-78131] - Deletions of an attribute's options not being saved
  • [DMAS-78132] - Loading Data Preview displays an error message "Invalid parameter fields. Expected a ',' or ']' at character 5"
  • [DMAS-78134] - Update PNSN meta data generation code to identify seismometers
  • [DMAS-78136] - Fix Failing GenerationAndDisplay UI Tests
  • [DMAS-78141] - Clicking "Query Annotations" from Device Details navigates to Annotation Search... in two new tabs
  • [DMAS-78171] - ClassCastException during deployment on 23.08.001 in QA
  • [DMAS-78178] - Renovate automerge on UI testing repo is not working
  • [DMAS-78194] - Community Fishers ISO XML no longer lists community and instead lists ONCS as owner of all CF casts
  • [DMAS-78200] - EEW AccelerationDownloadContinualJob task generating many thousands of WARNings
  • [DMAS-78210] - Search bar for Community Fishers Map does not center map on searched location
  • [DMAS-78211] - Integration tests sometimes log (expected) shutdown errors while waiting for Oceans 3 startup
  • [DMAS-78224] - Failed to save"Support Request" to database in QA
  • [DMAS-78228] - Integration tests sometimes fail to communicate with SystemConsoleService
  • [DMAS-78229] - Data Search for all available data doesn't return all the data
  • [DMAS-78239] - DMAS search failed in PROD: 17-Oct-2023 Hydrophone Search
  • [DMAS-78242] - Search Statistic Query using seconds for hour column
  • [DMAS-78250] - Can't access CTD data from SoG Central via Data Search (Instruments by Location)
  • [DMAS-78258] - Automatic ticket creation broken since Jira Service Desk uninstalled
  • [DMAS-78261] - QA test automation search failing
  • [DMAS-78269] - ESRIDynamicMapLayer cypress test is failing after upgrade to leaflet-geosearch upgrade
  • [DMAS-78273] - Changing the ExpeditionManagement layout too many times causes all Oceans 3 pages to fail to load
  • [DMAS-78277] - Unable to make public Dashboard private
  • [DMAS-78299] - DeviceCategoryService hitting database constraint preventing inaccurate audit trail in qa
  • [DMAS-78313] - Playlist playback shows errors when loading a playlist with clips whose source video no longer exists
  • [DMAS-78345] - Network Console update hitting DB constraint
  • [DMAS-78353] - AnnotationService is hitting DB constraint during automated testing
  • [DMAS-78359] - TaxonButtonSetService is hitting DB constraint when saving an object during automated testing
  • [DMAS-78365] - Taxonomy page crashes when you navigate to a taxon in qa
  • [DMAS-78368] - Support Request shows "Failed to load. Try refreshing the page." all the time in QA
  • [DMAS-78369] - SiteDeviceSubsetMaintenance test failing
  • [DMAS-78381] - Tens of thousands of errors while processing ActiveMQObjectMessages
  • [DMAS-78390] - Matlab searches querying database and expecting sensor category ID which no longer exists which is causing all scalar searches to fail
  • [DMAS-78407] - Both expedition and dive can't be synched between servers
  • [DMAS-78412] - SearchResultService is returning zip files that are corrupt/not valid

User Story

  • [DMAS-73146] - As a dataProductDelivery API user, I would like to cancel and maybe restart searches
  • [DMAS-76361] - Remove OBIS settings UI and old menu navigation from Oceans3 code
  • [DMAS-76628] - As scientific programmer, I'd like to run matlab code in a scheduled job without a file state or other trigger
  • [DMAS-76966] - As a ST user, I would like to select video quality when I am trying to playback my playlist, so that I can adapt to different Internet network bandwidth.   
  • [DMAS-76967] - As a ST user, I would like to select video quality when I download my playlist/clips, so that I can adapt to different Internet network bandwidth.   
  • [DMAS-77386] - As a sys operator, limit each user's disc usage on /ftp/pub
  • [DMAS-77608] - As a ST user, I would like create a new playlist (or add to an existing) by copying certain clips from other playlists, so that I can modify/playback/download the playlist later.
  • [DMAS-77808] - As a playlist creator, I want to change the quality of a clip in one of my playlists
  • [DMAS-77936] - As a playlist owner, I want to see a basic thumbnail on my playlists and clips so I can tell them apart

Task

  • [DMAS-45321] - Move the Cruise persistence layer to an OSGi module
  • [DMAS-57796] - As an API user I would like to return raw data for piggyback devices (children)
  • [DMAS-76994] - Improvements for cancelling searches and tasks
  • [DMAS-77198] - Deprecate the cambridge bay lite page task and page
  • [DMAS-77465] - ip address or ip port with empty space before/after real value should not be saved
  • [DMAS-77499] - As a software developer, I would like the Geospatial Search page to use a single context for casts
  • [DMAS-77562] - Revise header on Dive Log Dashboard
  • [DMAS-77698] - Upgrade Cypress to 13
  • [DMAS-77867] - Add tooltip/title to unassigned cast listing in lasso selection popup
  • [DMAS-77941] - As a data steward, I would like SeaTube V3 not to offer Original quality as an option
  • [DMAS-77967] - remove mentioned of case sensitive paramters from external api wiki
  • [DMAS-78002] - Make use of Task output in Community Fishers Pipeline Jobs
  • [DMAS-78018] - Please add support for opening the playlist playback page while using right click or middle click on the thumbnail 
  • [DMAS-78020] - Update the IP of the production Postgres replica in dev hibernate.properties
  • [DMAS-78058] - Update PNSN device meta data based on the most recent message received
  • [DMAS-78080] - Change landing page links to work in Dev mode if applicable
  • [DMAS-78139] - Support testing OSGi services that shouldn't be active at the UVic DC
  • [DMAS-78149] - Investigate 2023-10-09 missed earthquake detection
  • [DMAS-78150] - Add link explaining iso8601 duration format in date from/to fields on the OpenAPI page
  • [DMAS-78165] - remove FKs in existing _hist or _trx database tables
  • [DMAS-78166] - fill in value for datecreated in dmasusers with datecreated=null
  • [DMAS-78173] - Delete SeaTubeV2 code
  • [DMAS-78174] - Delete "old react" code for the Parser Definition tab of Device Details
  • [DMAS-78191] - Refactor ffmpeg and ffprobe matlab wrapper functions to throw errors in all cases.
  • [DMAS-78203] - Handle device level searches for Community Fishers ISO 19115 that use new search format.
  • [DMAS-78208] - Investigate the 2023-10-16 missed earthquake detection
  • [DMAS-78209] - fill in value for lastaccess in dmasusers with lastaccess=null
  • [DMAS-78249] - Change MATLAB client library documentation on external confluence
  • [DMAS-78266] - Owner of data no longer acknowledged on plots? it just says their names.
  • [DMAS-78315] - remove devicecategorymatrix database table
  • [DMAS-78350] - Fix illegal reflective operation warnings coming from dom4j
  • [DMAS-78351] - Investigate the 2023-10-24 earthquake

Requirement

  • [DMAS-78237] - Requirements for setting the order of batch tasks

Design

  • [DMAS-76903] - Create Design for how dataProductDelivery API could support cancel and restart
  • [DMAS-78236] - Design for setting the order of batch tasks

Implementation

  • [DMAS-50763] - Create a generic reorderable list component
  • [DMAS-76861] - Write DDL scripts to create a table, sequence, transaction table, and audit trigger
  • [DMAS-77018] - Delete sensorcategory table and remove sensor category Id from the sensor type table
  • [DMAS-77700] - Add a video quality selector to the playlist playback page
  • [DMAS-77701] - Persist a user's selected playlist playback quality on the frontend
  • [DMAS-77723] - remove task with taskdefinitionid 166
  • [DMAS-77724] - remove CambridgeBayLite backend code
  • [DMAS-77739] - Add modifydate and modifyby constraint to all tables that contain audit columns
  • [DMAS-77769] - Copy clips to a new/existing playlist on clicking the Copy button
  • [DMAS-77776] - Add a quality selector to the Download Clips dialog
  • [DMAS-77810] - Save the clip quality when saving a clip from SeaTube search
  • [DMAS-77811] - Set the quality for every playlist_line in the DB
  • [DMAS-77865] - Create data product entries and mappings for Aquascat products
  • [DMAS-77874] - Update service to return multiple date spans available to save as new organization agreement resources
  • [DMAS-77916] - Change DashboardTable to use stateless table instead of sortable table
  • [DMAS-77921] - Use the reorderable list to implement the playlist clip list
  • [DMAS-77925] - Update the clip list when a clip name is changed
  • [DMAS-77927] - Update the video player when a clip quality is changed
  • [DMAS-77937] - Display the thumbnail of each clip in the clip list
  • [DMAS-77938] - Display the thumbnail of the first clip of each playlist as its thumbnail on the playlist discovery page
  • [DMAS-77952] - Add a method to an appropriate web service that returns all the qualities available for a single device and time range
  • [DMAS-77959] - Java Code change limiting user disc usage
  • [DMAS-77981] - Add a column to the task type table for default sequence
  • [DMAS-77982] - Have sequence value set for new batch tasks
  • [DMAS-77983] - Display the sequence value and set it to be the default batch task table order
  • [DMAS-77992] - Refactor the history table and Polygon into their own components
  • [DMAS-78030] - Update front end to accept new service response for site devices
  • [DMAS-78056] - Update ag_organizationagreementresource table to not allow overlapping dates
  • [DMAS-78083] - Update reference(s) to SeaTube V3 in Oceans-next
  • [DMAS-78127] - Replace the url in datasets.xml with a local path to the mounted /ftp/pub folder
  • [DMAS-78133] - Add a default quality selector to the Edit Clip form
  • [DMAS-78168] - Create Database Properties for Configuration
  • [DMAS-78175] - Refactor the help and support request popups into a single file
  • [DMAS-78180] - Remove the OBIS settings page from Oceans 3
  • [DMAS-78188] - Use the user-selected quality in the video download task
  • [DMAS-78189] - Respect user's selected quality when getting the list of clips to play
  • [DMAS-78192] - Refactor the date filter into it's own component
  • [DMAS-78193] - email user and some users in the config about the max storage reach
  • [DMAS-78268] - Make a new servlet and URL for the taxonomy page
  • [DMAS-78272] - Add a skeleton for the new taxonomy page in Oceans Next

Test

  • [DMAS-77491] - add open api selenium tests for data product delivery cancel and restart
  • [DMAS-77866] - Create test cases in QA / search automation for Aquascat data products

October 16, 2023

Minor release (matlab only - no downtime): fix issue with saving very large scalar mat files, fix issue with Nortek Sig55 ADCP device attribute, further improve videofileQAQC job

Tickets Released: Oceans 3.0: 23.08.002 (accessible to internal users only). Total: 3.

October 11, 2023

Minor release: deploy java 17 and fixes for: ADCP plots (scaling and collating), videoFileQAQC job getting stuck and excessive logging, annotation link in Hydrophone Search, java logging, SeaTube filter for bad files and test synchronization.

Tickets Released: Oceans 3.0: 23.08.001 (accessible to internal users only). Total: 9.

October 5, 2023

Major release. September release was postponed due to maintenance expeditions, so this release contains more features & fixes than usual.

Maintenance

New Features or Improvements

  • Recover sourcesensorid in qaqcresult
  • Drop several deprecated database tables (e.g., sitedevice_hist, parserdefinition_hist, organization_hist, devicedetail, BudgetExpenses, BudgetExpenseCategory, CurrencyRate, Currency, Item, ItemType, Tax, taskhistorydetail, taskhistory, task, taskschedule, taskschedule_hist, jobdetail, jobdetail_hist, jobdatamap, jobdatamap_hist, tasktype, reprocess)
  • Add modifyby and modifydate for unitofmeasure and user_org database tables
  • Add index in im_licence database table
  • Hide Actions from main menu for anonymous user
  • Improve Data Search map to initially show all deployments
  • Update error message for cable deletion
  • Add new column "Color Bands" on Cables page and database
  • Save support request to database
  • Added a new page to display a list of support requests
  • Topology improvement to avoid device connect to itself or one deviceport connect to two parent deviceports
  • Add SensorType page
  • Upgraded react-leaflet to ^4.0.0

Bug Fixes:

  • Invalid ISO19115 XML generated for organization with empty email address
  • Sort issue on DeviceAction Listing page
  • Not able to access data products on Data Search page - configuration fix only
  • Plotting Utility cannot show all data for long time series
  • "Log in as" info update issue
  • Devicecode display issue on QAQC Auto Test Details page
  • Filter for CODARs in data preview
  • User Management page user tab fails to load user information
  • File management doesn't return archiveReadyName as expected

Internal projects

  • Improvement: only allow users with RW device listing access to update/delete/clone devices
  • Improvement: simplify Annotation Search deep links
  • Improvement: improve Digital Fishers clip shuffling
  • Deprecation: remove SensorObservationService
  • Java 17 improvement: reduce space required on Oceans 3 hosts during Java 17 transition
  • Java 17 bugfix: fix changing log levels from the system console
  • Java 17 bugfix: fix Annotation Search querying
  • Java 17 bugfix: fix adding addDataChangeTasks to batches
  • Java 17 bugfix: fix various JSON parsing issues
  • Java 17 bugfix: properly load sensors of cloned devices

Acoustic Instruments Data Viewer

  • Add a Device Selection Widget type to sy_widgettype

Community Fishers

  • Fixed Geospatial Map page is misbehaving when date, history table, or lasso tool is open
  • Fixed when editing the date of a siteDeviceSubset the datasets.xml entry sometimes gets old dates
  • Changed title of "Community Fisher's Geospatial Map"
  • Fixed references to the Map in GeospatialSearch, SimpleMap and CFLayerGroup are out of sync
  • Fixed tooltip labels
  • Fixed entry's in siteDeviceSubset table have siteDeviceSubsetName that do not follow convention
  • Renamed community fishers' Constants file to DataProductConstants
  • Refactored community fishers data products to use service calls to obtain metadata required to generate data products
  • Fixed community Fishers Map incompatible with Safari
  • Change CastSiteDeviceSubsetService.getDevicesForCast() to return deviceIds and their hierarchy
  • Fixed geospatial map is trying to access old data preview searches
  • Added cast datasets.xml sections include every device involved in the cast
  • Refactor geospatial map to unify details on casts and products
  • Added new parameter to Cast Data Erddap Dataset Creation job to allow for regeneration of erddapDataset and dataset.xml 
  • Investigated usage of active prop on leaflet ToolTip in Community fishers assigned cast data layer
  • Deprecated job 432, Cast Re-post-process Job (batch processing now works with regular job)

Earthquake Early Warning

  • Add 31 PNSN sites into the EEW event detection server
  • Fixed invalid characters appearing in RBR Quartz3 BPR Zero data stream
  • Update the earthquake detail page to change the map depending on which ONC notification is selected
  • Fixed clicking on map markers on the earthquake detail page
  • Support for earthquake simulations that included data from all our sites and 150 PNSN sites

OpenAPI

  • Case-insensitive for API web services
  • OpenAPI hide Fill Example button when the service does not have an example
  • OpenAPI dateformat in default string miss negative sign
  • Add cancel and restart functionality to data product request public API

Data Products

  • Refactor MATLAB code base:
    • eliminate use of old/slow json reader libraries
    • eliminate calls to "eval" which are vulnerable to exploits
    • delete old oracle references (requires updating the configuration scripts during this deployment)
  • Add warnings on resampling spatial data (matlab, java DP plus plotting utility and scalardata API)
  • NetCDF fixes: make dimensions consistent, standardize use of netCDF4
  • Trim hydrophone spectral files to search range
  • Bugs: duplicate sensornames

Instruments

Aquorea Lights Driver

  • Modified to work as stand-alone driver. Was originally developed to work in conjunction with the rayfin driver.
  • Now polls device for various metrics on driver start and at configured sample period.

SubC Mk5 Driver

  • Updated laser command to work when connected to the LED port.
  • New commands enableManualFocus and enableAutoFocus
  • New commands added to seascript.

Arctic Email Job

  • Minor bug fixes, job was refactored for the last release.

Pamguard

  • Various usability fixes.

SeaTube

  • Finished Darwin export support for both NOAA and ONC in SeaTube Search
  • Start enhancing SeaTube playlist to support much more features 
  • Continue on design to support more than 10 on-ship servers.
  • Bug fixes and small improvements.

Data Policy

  • Nearing completion  of being able to associate site devices with agreements with a date range
    • Note that agreements are associated with licences so we'll be able to derive a sitedevice's (aka dataset's) licence for reporting in ISO XML19915, etc

Dashboards

  • Support cloning a dashboard
  • Can reorder Readings on the Latest Readings widget
  • Fix issue with going to full screen video in Firefox

CIOOS/CF

  • Can regenerate a cast in ERDDAP
  • Fix issues with casts in ERDDAP
  • Starting using GCMD vocabulary to generate vocab for cast ERDDAP datasets

ExperiMINTED

  • Now use JAXB to generate DataCite.xml
  • Batch management rewrite to support future changes
    • Support auto-refresh in batch management
  • Link to data product option documentation from Search History (Dataset Landing Page next month)

Tickets Released: Oceans 3.0: 23.08.000 (accessible to internal users only). Total: 302. Automated Testing: AT.23.08.000, CT.23.08.000 total: 66.

Usability

  • [DMAS-77690] - Change title of "Community Fisher's Geospatial Map"

Bug

  • [DMAS-47706] - Digital Fishers is not true random
  • [DMAS-72908] - Invalid XML generated for Organizations with an empty email address
  • [DMAS-75154] - updating historic device attribute does not get captured in batch task trigger group
  • [DMAS-75723] - Geospatial map is trying to access old data preview searches
  • [DMAS-75883] - Device Action Listing Page Sort By Device Action Id Does Not Provide Correct Ordering
  • [DMAS-76378] - Atlantic stations invisible on Data Search map
  • [DMAS-76832] - TaskManager addDataChangeTask failing in java 17
  • [DMAS-76858] - Log level does not get updated when changing on System Console page in Java 17
  • [DMAS-76885] - Oceans 3 doesn't respect the user's preference for whether to share their name
  • [DMAS-77023] - Batches show as Completed even when there are tasks that are not Completed
  • [DMAS-77220] - LicenceManagement doesn't display
  • [DMAS-77404] - Annotation Entry widget in Seatube briefly appears upon loading and then disappears and cannot be readded
  • [DMAS-77408] - Annotation searches in QA failing with snackbar "Failed to retrieve annotations: SyntaxError: JSON5: invalid character '<' at 1:1"
  • [DMAS-77431] - When editing the date of a siteDeviceSubset the datasets.xml entry sometimes gets old dates
  • [DMAS-77440] - DataProductService fails to deserialize SeaTube annotation exports
  • [DMAS-77445] - Cannot create a new data agreement in Network Console in QA
  • [DMAS-77456] - DataProductService logs an exception when sending search failure emails when no recipients are defined
  • [DMAS-77460] - Entry's in siteDeviceSubset table have siteDeviceSubsetName that do not follow convention
  • [DMAS-77476] - Full screen video not working in firefox
  • [DMAS-77482] - Cannot Delete Taxonomy - "ROVOperations"
  • [DMAS-77483] - Cannot cancel tasks in QA due to runtime error
  • [DMAS-77495] - Redundant error message for API service call related to no device being found at a location
  • [DMAS-77497] - Cannot create new taxon
  • [DMAS-77500] - qadivelogger3 fails to start up because of errors connecting to MQ
  • [DMAS-77501] - Sensors of cloned devices do not show up in the UI in Java 17
  • [DMAS-77517] - QA shorestations fail to serialize sensors on startup
  • [DMAS-77521] - Oceans 3 fails to build in Jenkins with the error: Unknown symbol DefaultSensor
  • [DMAS-77525] - Integration Testing is deploying Oceans Next to Gemini
  • [DMAS-77526] - Handle case of duplicate sensor names - matlab DP
  • [DMAS-77576] - Error when trying to update a Taxon
  • [DMAS-77619] - Fix leaflet compilation errors when running cypress
  • [DMAS-77631] - Any logged-in user can update or clone a device, and anonymous users can delete cloned devices
  • [DMAS-77661] - OpenAPI dateFormat in default string is missing negative sign
  • [DMAS-77678] - Emails from DMAS no longer contain expected information.
  • [DMAS-77680] - After changing my username, "Log in as" info in the header doesn't get changed until I logout then login
  • [DMAS-77691] - Community Fishers Map incompatible with Safari
  • [DMAS-77693] - SeaTube Map not currently loading properly with positional data
  • [DMAS-77702] - Playlist Playback cannot be accessed due to error in parsing playlistHdrId from the URL
  • [DMAS-77742] - Stop babel loader from updating past version 8
  • [DMAS-77748] - DMAS Search Failed Notification: 04-Sep-2023 12:28:41 UTC, Ocean Sonics icListen AF Hydrophone 2523, Audio Data, SearchHdrId 16222923, UserId 122920
  • [DMAS-77749] - Fix failing typescript dependency update to v5.2.2
  • [DMAS-77750] - Video widget appears to disappear after opening full screen after adding it
  • [DMAS-77758] - Fix playlist playback servlet to read playlistHdrId correctly
  • [DMAS-77826] - In QA when the Google map tiles are selected the tiles do not load.
  • [DMAS-77827] - DMAS Search Failed Notification: 12-Sep-2023 17:05:55 UTC, China Creek-China Creek Shore Station, Time Series Scalar Data, SearchHdrId 16235988, UserId 119830
  • [DMAS-77844] - Button Set Config is not working
  • [DMAS-77853] - ExpeditionManagement page menu not displaying widgets on load
  • [DMAS-77855] - In QA, there is no default camera in the drop down of resource selection while annotating a dive
  • [DMAS-77873] - Investigate JunctionBoxDevice cache loading fatal incident and prevent it from happening again
  • [DMAS-77890] - Deployment moves from "verify" to "watch" stages too soon
  • [DMAS-77895] - User Management page user tab fails to load user information
  • [DMAS-77902] - Select All button on playlist playback page doesn't work properly when the list has been scrolled
  • [DMAS-77920] - Clicking on a playlist thumbnail displays a 404 page in dev
  • [DMAS-77922] - PAMGUARD failing to retrieve acoustic files
  • [DMAS-77953] - Clicking on map markers on the earthquake detail page doesnt work
  • [DMAS-77968] - QAQC Auto Test Details tool - Device code is undefined in description
  • [DMAS-77987] - snapshotting does not work form some times in SeaTube Pro
  • [DMAS-78009] - AnnotationsV2 fails to render after clearing the date
  • [DMAS-78022] - Playlists (title and description) appear to be editable by non-owners via the playback page
  • [DMAS-78049] - 'View all Annotations For The Selected Day' button fails to open annotation search link
  • [DMAS-78052] - Occasionally cannot manually start a task
  • [DMAS-78059] - The map in SeaTube does not automatically zoom in to the dive path
  • [DMAS-78065] - error messages during gemini start
  • [DMAS-78066] - Data Preview not showing data preview annotation
  • [DMAS-78072] - Remove ability to clone to an existing playlist

User Story

  • [DMAS-74658] - As a NOAA user, I want an option to include OBIS parameters in annotation filters and searches
  • [DMAS-74760] - As a geospatial map user I would like one source of truth for casts and products
  • [DMAS-76187] - As a dev, I would like a page to only display Sensor Type information
  • [DMAS-76901] - As a dev, I would like to save support request to database
  • [DMAS-76906] - As a Data Steward I want erddapDatasets to automatically be created for applicable casts
  • [DMAS-76964] - As a ST user, I would like to play/forward/backward and choose any clip to play, so that I can quickly navigate and play my desired clips.
  • [DMAS-77088] - As a NOAA user of SeaTube, I want an option to export SeaTube annotation search results in Darwin Core format
  • [DMAS-77163] - As a ST user, I would like to see and edit generic metadata for playlists, so that I can quickly find out accurate information about my playlists
  • [DMAS-77164] - As a ST user, I would like playlist clips to have a custom name and description so that I can quickly find out accurate information about my playlists' clips
  • [DMAS-77178] - As a playlist creator, I want to edit basic metadata on clips in my playlists so I can remember more information about them
  • [DMAS-77209] - please add modifyby and modifydate columns in unitofmeasure table
  • [DMAS-77519] - As a user, I would like to have a UI page to view SupportRequest records
  • [DMAS-77523] - As a Data Steward user, I would like to see a column "Color bands" in the Cables table in Oceans 3.0
  • [DMAS-77546] - Use GCMD taxon/resource mappings to populate ERDDAP keywords for CF CASTS
  • [DMAS-77557] - As a SeaTube user, I want a standalone playlist discovery page, so that I have more space to navigate and search playlists
  • [DMAS-77609] - As a ST user, I would like to clone an existing playlist, so that I can modify/playback/download the playlist later.
  • [DMAS-77770] - As a ST user, I want to be able to see the details of a clip so I know more about it
  • [DMAS-77778] - As a ST user, I want to download several clips from a playlist
  • [DMAS-77780] - As a ST user, I want to delete several clips from a playlist
  • [DMAS-77784] - As a ST user, I want to be able to delete a playlist so that I can manage my playlists better
  • [DMAS-77785] - As a ST user, I want to be able to download a playlist
  • [DMAS-77793] - Remove the old playlist management page and update the DMAS menu
  • [DMAS-77797] - As a playlist creator, I want to be able to edit the name and description of a playlist
  • [DMAS-77803] - As a ST user, I want to be able to share a playlist
  • [DMAS-77969] - Add Logout button to Dev Playground

Task

  • [DMAS-66429] - Improve performance of quarter-scalar-data-generation-historical job to allow for longer term QAQC reprocessing jobs
  • [DMAS-67696] - Recover sourceSensorId to trustable sensorId for qaqcresult (both prior to and after 2019 implementation)
  • [DMAS-67865] - which table, sitedevice_hist and sitedevice_trx, is currently used in dmas code?
  • [DMAS-69883] - Remove tables no longer needed after Budget Module removal in DMAS-58123
  • [DMAS-70029] - Upgrade react-leaflet to ^4.0.0
  • [DMAS-73615] - Add warnings about averaging mobile data to time series scalar Java data products
  • [DMAS-73617] - Add a warning about averaging mobile data in Plotting Utility
  • [DMAS-73704] - Add a warning about averaging mobile data in scalardata API
  • [DMAS-73726] - Consolidate list of potential enhancements for ST playlists
  • [DMAS-73929] - Move over organization_hist data to new oroganization_trx table and delete old hist table
  • [DMAS-73937] - Add unique index to licence name in im_licence table
  • [DMAS-74705] - Investigate usage of active prop on leaflet ToolTip in Community fishers assigned cast data layer
  • [DMAS-74898] - Refactor community fishers data products to use service calls to obtain metadata required to generate dataproducts
  • [DMAS-74902] - Reorder latest readings list without having to re-select variables
  • [DMAS-76103] - Verify case sensitivity required for the API webservices.
  • [DMAS-76130] - OpenAPI Page Should Hide the Fill Example Button when the Service Does Not Have An Example
  • [DMAS-76257] - Sensors should not be grouped/combined for location searches when their sensor types do not match
  • [DMAS-76449] - Populate path for all search types (was: Determine the work needed to get all search types to populate "path")
  • [DMAS-76453] - Trim extra data from daily spectral MAT files
  • [DMAS-76579] - Improve the Cables deletion error message when an extension details entry remains
  • [DMAS-76645] - Prevent raw file generation from overwriting its own files
  • [DMAS-76653] - Drop unused tables: primarily task* tables
  • [DMAS-76757] - Add a loading indicator for the React dialogs' Dropdown Fields
  • [DMAS-76783] - Add a database constraint so that values can't be updated without also updating modifyby/modifydate for all applicable tables
  • [DMAS-76784] - Refactor DP matlab code to not use "eval"
  • [DMAS-76959] - Make each of the data product options in the SearchHistory options table links to the wiki
  • [DMAS-77040] - Email job and postprocessing job for Spanish Antarctica project
  • [DMAS-77129] - Upgrade prettier to v3 and eslint-plugin-prettier in one PR
  • [DMAS-77219] - Make licence table component full width on /LicenceManagement
  • [DMAS-77259] - Upgrade plotly from 1.x to 2.x
  • [DMAS-77307] - Disable and remove SensorObservationService
  • [DMAS-77339] - add modifyby and modifydate in user_org and user_org_trx database table
  • [DMAS-77364] - Update JSON parsing in TaxonomyService to ensure Java 17 compatibility
  • [DMAS-77382] - Oceans 3.0 Help button update
  • [DMAS-77397] - Allow global properties to be updated through the OSGi console
  • [DMAS-77421] - Change AnnotationServiceV3 to send its "fields" parameter as JSON
  • [DMAS-77451] - Document requirements and figure out design for a new playlist management page
  • [DMAS-77459] - Add all applicable siteDeviceSubsets to erddap in QA to test
  • [DMAS-77462] - As a SeaTube Search user, I would like to see annotation review information in the search results
  • [DMAS-77463] - As a SeaTube Search user, I would like to have annotation review information included in all export formats
  • [DMAS-77481] - SeaTube Search search results table doesn't display the number of results returned
  • [DMAS-77494] - Refactor DP matlab code to not use parse_json or loadjson
  • [DMAS-77507] - As a scientific developer I would like dead Oracle queries removed
  • [DMAS-77518] - Log parameter parsing errors in DmasAPIService at debug level
  • [DMAS-77539] - Rename community fishers' Constants file to DataProductConstants
  • [DMAS-77551] - Don't warn about a missing -XX:+DisableExplicitGC in Equinox during deployment validation
  • [DMAS-77552] - Remove all stale copies of Oceans 3 during a deployment
  • [DMAS-77564] - Make the Toolbar toggleable for the StatelessTable
  • [DMAS-77574] - Add new parameter to Cast Data Erddap Dataset Creation job to allow for regeneration of erddapDataset and dataset.xml section
  • [DMAS-77575] - For cast datasets.xml sections include every device involved in the cast
  • [DMAS-77587] - Add Searching plugin to the StatelessTable
  • [DMAS-77591] - Nortek netCDF and mat dimensions are not consistent
  • [DMAS-77623] - Fix some compiler and checkstyle warnings reported in Eclipse
  • [DMAS-77636] - dataset is missing from the resourcetype for the related identifier pop-up
  • [DMAS-77643] - Deprecate job 432, Cast Re-post-process Job
  • [DMAS-77656] - Testing Automated ticket generation
  • [DMAS-77679] - Save the quality of a video clip at the time it is created
  • [DMAS-77732] - Disable Renovate automerge on major version updates
  • [DMAS-77735] - Builds are timing out on component tests
  • [DMAS-77755] - As a software developer, I would like to have a user management function to support user sync UI test
  • [DMAS-77766] - Add clip selection checkboxes to the clip list on the playback page
  • [DMAS-77767] - Standardize NetCDF data products to netcdf4_classic format and refactor
  • [DMAS-77814] - Fix the improper weightedmean logic
  • [DMAS-77830] - Add equals and hashCode methods to composite primary keys
  • [DMAS-77842] - Add import order rule to eslintrc
  • [DMAS-77847] - Clean up underused code in core.system.util
  • [DMAS-77875] - Open the playlist playback page when clicking on a playlist's thumbnail
  • [DMAS-77876] - Change the URL of the playlist playback page from /app/playlist-playback/[id] to /app/playlists/[id]
  • [DMAS-77883] - update Support Request Table's Group Privilege to Internal User
  • [DMAS-77885] - Investigate Earthquake on September 18th 2023
  • [DMAS-77886] - Update openapi urls from service-device or service-location to service/device or service/location
  • [DMAS-77892] - Update matlab deployment script to copy over QA2 database connection files
  • [DMAS-77906] - Color Limits on ADCP daily plots are biased to data that isn't real. Can we set a condition to fix this?
  • [DMAS-77919] - Downgrade "ambiguous configuration" log messages
  • [DMAS-77951] - Update the earthquake detail map when selecting different onc detections
  • [DMAS-77964] - Allow anonymous users to view the new playback page
  • [DMAS-77985] - Allow SeaTube Search to export as DwC-A searches with additional filters
  • [DMAS-77997] - Don't log "ls: cannot access '/usr/local/gemini/onc_stale/*': No such file or directory" during deployment
  • [DMAS-78000] - Geospatial Map page is misbehaving when date, history table, or lasso tool is open
  • [DMAS-78003] - Disable the "Source link" icon in playlist playback
  • [DMAS-78012] - Return quality for playlistlines from playlist services
  • [DMAS-78051] - TopologyView should enable button after operationtype changes

Requirement

  • [DMAS-77452] - Extract & assemble requirements for playlist management page redesign

Design

  • [DMAS-77020] - Create mockups for a playlist playback page that includes the ability to select clips from a list
  • [DMAS-77168] - Playlist metadata database design
  • [DMAS-77171] - Design the UI to edit and view playlist metadata
  • [DMAS-77174] - Clip metadata database design
  • [DMAS-77549] - Make mockups for playlist display in the playlist discovery page
  • [DMAS-77550] - Make mockups to show options to edit clip details on the player page

Implementation

  • [DMAS-49308] - Add support for cloning a dashboard to dashboard mgmt
  • [DMAS-53983] - Implement batch monitoring
  • [DMAS-69541] - Create script to set sourceSensorId for non_instrument_level qaqcresults and run them in prod db
  • [DMAS-73506] - Drop sitedevice_hist table
  • [DMAS-74662] - UI support for Darwin Core export as a download option
  • [DMAS-75557] - Add cypress tests for components to be refactored
  • [DMAS-76557] - Implement Test Driven Development with Cypress for SensorType page front end
  • [DMAS-76710] - Improve fields and UI for displaying and creating organization agreement resources
  • [DMAS-76860] - Read the paths to the Oceans 3 and database repositories from a configuration file
  • [DMAS-76982] - create connection between java code and database
  • [DMAS-77001] - JAXB Implementation for Related Identifiers
  • [DMAS-77098] - Jaxb Implementation for DOI Datacite Metadata Create/Update
  • [DMAS-77157] - Make it possible to run the Darwin Core export as a data product
  • [DMAS-77169] - Add any new database columns to store playlist metadata
  • [DMAS-77170] - Make playlist metadata available to get/set in service calls
  • [DMAS-77172] - Implement the playlist metadata UI
  • [DMAS-77175] - Add any new database columns to store clip metadata
  • [DMAS-77176] - Make clip metadata available to get/set in service calls
  • [DMAS-77223] - Create a video widget for the Seatube Playlist Playback page
  • [DMAS-77228] - Fix existing linting errors
  • [DMAS-77230] - Create a playlist widget that displays the videos in a playlist
  • [DMAS-77263] - Implement persistence for clip metadata
  • [DMAS-77342] - add modifyby and modifydate to unitofmeasure database table
  • [DMAS-77355] - Extend the Darwin Core export to support a full seatube annotation filter
  • [DMAS-77356] - Run a Darwin Core export from SeaTube search
  • [DMAS-77396] - Adjust the export logic based on which organization's dive is being exported
  • [DMAS-77403] - Update tm_tasktype 128 in DB to match Darwin Core job renaming
  • [DMAS-77406] - Add new route to the playlist playback page
  • [DMAS-77411] - Decode URL-encoded string parameters in GET requests
  • [DMAS-77412] - URL-encode string parameters in Oceans Next service calls
  • [DMAS-77413] - URL-encode the filter string in the AnnotationsV2 page URL
  • [DMAS-77418] - Change email task to the "Remote Resource Download" category
  • [DMAS-77423] - Refactor OBISDatasetExportCSV and related classes
  • [DMAS-77430] - Create CollapsibleText component for use in Playlist descriptions (and possibly other things)
  • [DMAS-77436] - Delete Searchs automatically after a user downloads them
  • [DMAS-77449] - Create a table of playlists
  • [DMAS-77464] - Create PlaylistPlayback servlet and add to web.xml
  • [DMAS-77468] - Add support for widget clone to dashboard edit frontend part 2
  • [DMAS-77470] - Allow users to cancel searches in the data product delivery public api
  • [DMAS-77471] - Allow users to restart searches in the data product delivery public api
  • [DMAS-77485] - Delete taxonomy ROVOperations and its taxons
  • [DMAS-77505] - Update spatial averaging warning text in MATLAB time series products
  • [DMAS-77520] - create UI page to display SupportRequest records
  • [DMAS-77545] - Aquorea Lights Simulator
  • [DMAS-77558] - Build playlist discovery skeleton code
  • [DMAS-77559] - Add a playlist discovery servlet to Oceans 3
  • [DMAS-77588] - Clean up DmasMail
  • [DMAS-77589] - Check email recipients before sending
  • [DMAS-77602] - Backend implementation for batch update
  • [DMAS-77614] - Increase spotbugs strictness
  • [DMAS-77616] - Add new parameter to Cast Data Erddap Dataset Creation job to allow for regeneration of erddapDataset and dataset.xml section - SQL
  • [DMAS-77617] - Add new parameter to Cast Data Erddap Dataset Creation job to allow for regeneration of erddapDataset and dataset.xml section - Java
  • [DMAS-77638] - Add Device Type to resourcetype table
  • [DMAS-77639] - Update ResourceService to support Device Type
  • [DMAS-77668] - add a column varchar 'ColorBand' to the database table IM_CABLEEXTENSION
  • [DMAS-77682] - Improve response time when getting all Erddap datasets for display in ErddapManagement
  • [DMAS-77683] - update related java code for "Color Bands"
  • [DMAS-77720] - add a column "Color Coating" between columns "Name" and "Agreement" on Cables UI page
  • [DMAS-77722] - disable web page CambridgeBayLite
  • [DMAS-77728] - Extract log control (and configuration?) to bundles
  • [DMAS-77729] - Get a logging backend from pax-logging-log4j, not the log4j jar
  • [DMAS-77730] - Load log4j configuration from Configuration Admin
  • [DMAS-77731] - Use configuration admin to change loggers' levels
  • [DMAS-77733] - Modify share dialog to allow sharing a dashboard to multiple users
  • [DMAS-77751] - Implement saving GCMD keywords for Community Fishers Erddap records
  • [DMAS-77764] - Add clone buttons to the playlist discovery & playback pages
  • [DMAS-77765] - Clone a playlist on clicking the clone button from either playlist discovery or playback
  • [DMAS-77768] - Add a "Copy to playlist" button at the bottom of the clip list on the playback page
  • [DMAS-77771] - Create a skeleton of a clip details widget
  • [DMAS-77773] - Display clip details in the widget
  • [DMAS-77774] - Add a "Download" button at the bottom of the clip list on the playback page
  • [DMAS-77775] - Download selected clips on clicking the Download button
  • [DMAS-77779] - Change datatype of erddapdatast.keywordsvocabulary to text
  • [DMAS-77781] - Add a "Delete" button at the bottom of the clip list on the playback page
  • [DMAS-77782] - Delete selected clips on clicking the Delete button
  • [DMAS-77783] - Display clip name and description in the clip list
  • [DMAS-77786] - Add Delete buttons to the action menus on the playlist discovery and playback pages
  • [DMAS-77787] - Add download buttons to the action menus on the playlist discovery and playback pages
  • [DMAS-77788] - Download a playlist on clicking the Download action item
  • [DMAS-77789] - Delete a playlist on clicking the Delete action button
  • [DMAS-77790] - Add an action menu to the playlist details on the playback page
  • [DMAS-77791] - Add a Share button to the action menus on the playlist discovery and playback pages
  • [DMAS-77792] - Share a playlist on clicking the Share action button
  • [DMAS-77794] - Update the Oceans 3 menu to point to the new playlist discovery page
  • [DMAS-77795] - Remove the old playlist management servlet
  • [DMAS-77796] - Remove old playlist management components
  • [DMAS-77798] - Implement the playlist metadata editor
  • [DMAS-77799] - Set the device name as the title for new clips in the SeaTube dashboard
  • [DMAS-77800] - Set the device name as the title for new clips in SeaTube Pro
  • [DMAS-77801] - Set the device name as the title for new clips from SeaTube Search
  • [DMAS-77809] - Save the clip quality when saving a clip from SeaTube pro
  • [DMAS-77838] - update java code for UnitOfMeasure
  • [DMAS-77878] - Update servlet url for playback page
  • [DMAS-77879] - Update frontend url for dev playground playback page
  • [DMAS-77898] - Change CastSiteDeviceSubsetService.getDevicesForCast() to return deviceIds and their hierarchy
  • [DMAS-77923] - Create a skeleton of a clip editor dialog
  • [DMAS-77924] - Add a form to the clip editor that lets the owner set the clip name and description
  • [DMAS-77926] - update java code for User_Org
  • [DMAS-77935] - Add a playlist edit button to the action menu in the playlist playback page
  • [DMAS-77943] - Suppress errors about failing to read module-info.class in jackson libraries in Java 8
  • [DMAS-78011] - Remove the "urlContext" parameter from getComponentProps() in ExpeditionManagement.java and SeaTubeIngestion.java

Test

  • [DMAS-77221] - Add API tests for creator/modifier retrieval for deck logs

Bug (ST)

  • [DMAS-77075] - Update DataAvailbility chart by removing requiresNetwork
  • [DMAS-77473] - Handle null dataset sections during add command
  • [DMAS-77477] - DataProductDelivery run open api page does not always auto-refresh after five seconds
  • [DMAS-77684] - QA Erddap is not loading all datasets
  • [DMAS-77688] - Fix deep links to annotation searches from other pages
  • [DMAS-77715] - Do not create dataset sections in datasets.xml for casts that have NaN or 0,0 for lat lon values
  • [DMAS-77716] - User related synchronization issues
  • [DMAS-77717] - Cannot submit a support request form in QA
  • [DMAS-77824] - Fix tooltip labels
  • [DMAS-77825] - References to the Map in GeospatialSearch, SimpleMap and CFLayerGroup are out of sync
  • [DMAS-77854] - Downgrade react-grid-layout to 1.3.4
  • [DMAS-77872] - Fix Support Request's support request id order error
  • [DMAS-77905] - Deployment to QA fails: org.apache.felix.scr can't find ConfigurationAdmin

Investigation

  • [DMAS-74661] - Review metadata in OBIS export files - adapt for NOAA dives
  • [DMAS-77759] - investigate to see any java code need be update for two new columns in unitofmeasure table

Documentation

  • [DMAS-77438] - update documentation for data product delivery download
  • [DMAS-77490] - Update data product delivery documentation
  • [DMAS-77618] - Add new parameter to Cast Data Erddap Dataset Creation job to allow for regeneration of erddapDataset and dataset.xml section - Docs
  • [DMAS-77658] - Update/Create documentation for the SupportRequest React Page
  • [DMAS-77891] - Create Documentation for the Sensor Type


September 25, 2023

Minor release: SeaTube fixed camera fix, PAMGuard data prep fix

Tickets Released: Oceans 3.0: 23.06.007 (accessible to internal users only). Total: 2.

September 20, 2023

Minor release: SubC Camera driver fix, ERDDAP datasets fix

Tickets Released: Oceans 3.0: 23.06.006 (accessible to internal users only). Total: 4.

August 30, 2023

Minor release: fix Hydrophone Page Searches, Junction Box device attribute not visible, fix for BPR driver

Tickets Released: Oceans 3.0: 23.06.004, 23.06.005 (accessible to internal users only). Total: 3.

August 28, 2023

Minor release (no web downtime): Aquora lights driver fix

Tickets Released: Oceans 3.0: 23.06.003 (accessible to internal users only). Total: 1.

August 24, 2023

Minor release: Aquora lights driver, speed up DOI registration, Data Preview filter update. Bug fixes for Community Fishers, BioSonics data products, CODAR and Nortek Sig55 NetCDF files, SeaTube missing footage, iso file service.

Tickets Released: Oceans 3.0: 23.06.002 (accessible to internal users only). Total: 14.

August 15, 2023

Minor release: fixes for Community Fishers missing plot and Data Search cache issue, hide instrument security tier info externally

Tickets Released: Oceans 3.0: 23.06.001 (accessible to internal users only). Total: 8.

August 8, 2023

Major release. July release was postponed due to maintenance expeditions, so this release contains more features & fixes than usual.

Maintenance

New Features or Improvements
  • Deprecate Coastbuster
  • Remove AnnotationSearch UI page and related permissions (now fully replaced with the new UI)
  • Email system for Support Request 
  • Several small UI usability update
    • Add space between id and name for modifyby column on Device Sync page
    • Change field names from modifyby and modifydate to modifiedby and modifieddate
    • Add loading indicator on multiple pages (Cables, SiteDevice Listing, QAQC auto tests finder, QAQC auto tests details, sensor maintenance)
    • Add paging for Page Permissions tab on User Management page 
    • Keep fixed height for header of qaqc auto tests details page at different screen sizes 
    • Add scroll bar for set the process in DeviceWorkFlowAdmin page
    • Consistent capitalization for sensor data rating uniqueness error message
  • New button on sensor maintenance tab of device details page to create qaqc auto tests with some pre-filled in information,
  • QAQC auto tests finder page: ability to display all (include closed) qaqc tests, auto complete device field
  • QAQC auto tests details page: attributecode is added beside attributeid, auto-complete device field, auto field description field with devicecode,
  • Hide instrument security Tier from non-ONC users
  • Update privacy policy link on login and registration pages
  • Update Help links on Plotting Utility
  • Add unique constraint on token field in sy_token database table
  • Drop parserdefinition_hist database table - replaced by a new table
  • Create Readonly isolated formfield UI page
  • Display task output on the task management page
  • Make dayofweek field on task schedule editable on Task Management page
  • Provide better feedback in an API( response when DMAS system is down
  • Provide more descriptive error message when no device is found at a location

  • Restart reprocessing tasks that were in progress when a task machine starts
  • Fix BPR reprocessing so it can be done across multiple task machines and process files out of chronological order
  • Get correct list of seascript jobs displaying on camera control page
  • Fix issue where data acquisition sometimes doesn't work when a device has the attribute useMessageBuffering set to false
  • Remove date constraint on Dataset Landing Page when search_dtlid is searched
  • Updates on AutomaticSchedulingJob (doc, name and description)
  • Lots of new or updated automated tests, many documentation updates, answer questions, support users, etc.
Bug Fixes
  • Heap issue caused by ScalarDataAPIService
  • URL display issue for tabs on device details page
  • Find by name issue on File Management page
  • Social media links on Digital Fishers page
  • Sort feature for data rating tab on sensor maintenance page
  • Sort feature for DateTo column of IP tab on Device Details page
  • Modifyby display issue on Derived Sensor Parser Definition tab of Sensor Maintenance page
  • Correct A4 constant value in Seabird43Util

  • Misspelled task parameter singelton

Internal projects

  • Bugfix: NetworkConsoleService can't leak secrets
  • Bugfix: User sessions are more reliably persisted across restarts in Java 17
  • Bugfix: Web service queries with JSON are properly encoded/decoded in Java 17
  • Bugfix: A few constraint violation exceptions in web service save methods are reported to the user but not logged
  • Feature: Simpler internal API for parsing & validating web service parameters
  • Improvements: Renovate runs much more reliably (automatically updates 3rd party libraries), build improvements

Data Products

  • Add a 4 hour resample period to the automatic resampling period selection for plots (matches a change in Plotting Utility)
  • Update data product options on IOS hydrophones to dissuade filling /ftp/pub
  • Added logging / warning in VideoFileQAQC for conflicting file durations
  • Bug files: CODAR availability PDFs were coming out as PNGs, add back a tolerance for BioSonics ping overrun, fix Nortek Sig55 data product option documentation link

SeaTube

  • Feature: Display a countdown timer on the WTA page to the start of the next expedition
  • Feature: Delete clips from a video playlist
  • Feature: Download multiple clips from a video playlist (as a single stitched file or as multiple files)
  • Feature: Display Okeanos turbidity sensors in SeaTube sensor panel
  • Feature: Search and export deck log annotations from SeaTube Search
  • Feature: Filter and search annotations by number of reviews and percent positive reviews
  • Improvement: Dive & DiveListing pages are only visible to dive logger admin users, and only modifiable by system admin users
  • Fix minor issues in: deck logs, WTA page, UI tests, add more modifyby/date info, improve snackbars, drop unused tables

Community Fishers

  • Added option to include taskId in matlab calls from MatlabFunctionRunner: enables task/batch specific parameters
  • Improved logging to narrow down where cancel message disconnect happens
  • Now only delete search FTP directory from web server for completed user-deleted searches
  • Fixed using the wrong character for apostrophes in ISO19115 XML Metadata files
  • Fixed Geospatial Map Casts cannot be downloaded in QA
  • Fixed layout overflow when selecting multiple casts with the Lasso tool
  • Created Cypress tests for cast popup components in the geospatial map
  • Changed formatting on Community Fisher's Geospatial Map search bar
  • Fixed Clearing the CF date range filter does not restore unassigned cast icons to map
  • Modified the settings/gear dialog just to do date filtering
  • Modified the lasso dialog just to do cast selection and downloading
  • Added new download history icon and dialog to CF map
  • Added test to geospatial map to check if all casts are re-populated after clearing the filter
  • CF cast map labels now clickable
  • Modified the calendar filter icon to reflect if a filter is applied or not.
  • Fixed Internal service error not fully handled for GeospatialMap Cast Download
  • Converted siteDeviceSubset_hist to siteDeviceSubset_trx
  • Converted im_sitedevicesubsetcastdefinition_hist to im_sitedevicesubsetcastdefinition_trx

Acoustic Instruments Data Viewer

  • Allow default attributes to be added to imported taxons if there new taxonomy is editable
  • Fixed Audio Widget attempts to fetch URLs from PROD in QA
  • Fixed Uncaught TypeError is thrown on adding widgets to the Dashboard
  • Fixed Data Player Widget in QA attempts to load images for unavailable data configurations

CIOOS Pacific

  • Update citation in ISO 19115 so citations are shown correctly in CKAN (added "https://" to the doi.org URL)
  • Restore spaces to EOVs in ISO 19115
  • Fix: Ensure owner is included in ISO 19115 when there is no data agreement

CIOOS & Community Fishers

  • Support for device type 935
  • Support CAST ERDDAP datasets in ERDDAP management & datasets.xml
  • ERDDAP datasets for site device subsets are automatically created
  • Fix: can not view ERDDAP datasets for a site device when not logged in
  • JDBC Driver (EJ.3.0.0):
    • data can be retrieved for CAST ERDDAP datasets
    • Support sensor ids as source names instead of sensor codes

Dashboards

  • Loop back on video now supported when playing the Latest Video
  • We now allow widgets to be any size
  • Data Preview widget now supports all SOO plots
  • Text widgets now support links
  • Fix: full screen video now possible

ExperiMINTED

  • Search history:
    • clean up sorting
    • Improve performance
    • Fix: Searches created by Hydrophone viewer are now correct and don't crash search history
  • Batching: Add Batch Task button remains active unless batch is closed
  • Dataset Landing Page: Full edit support for related identifiers 
  • Internal / minor changes: improved tests and test coverage, snackbar improvements

Instruments, Parsers, Seascript

  • Bars driver changed to readline driver. Recent changes to firmware have made this driver less reliable. New driver is compatible with older bars driver, not susceptible to future firmware changes.
  • AML 3 Driver: New driver type for the BC Ferries. (No deployment needed other than MTC for DAF testing.)
  • Pattern Matcher Parser: New parser type that uses regular expressions. Suitable for non standard data structures (i.e. not csv, xml, json, key/value, etc). Developed for AML 3 data but generalized so it can be used for other types of data.
  • XML Parser Update: Updated to work fully multi-threaded (needed for multi queue). Can parse attributes and suppors xpath field names if needed. Improved error handling.
  • Json Parser Update: Simplified configuration. Can use parser features available in other parsers (formulas, some string functions, date parsing). Improved error handling. Documentation in progress.
  • Seascript random pause command

OpenApi Improvements

  • Support ISO 8601 Duration timestamps on OpenAPI page
  • Added copy URL button
  • Moved clear button to top of page
  • Speed up location get by tree method

Earthquake Early Warning

  • Support PNSN devices in both UVic and Kamloops correlators
  • Add magnitude evolution plot to earthquake detail page

Tickets Released: Oceans 3.0: 23.06.000 (accessible to internal users only). Total: 311. Automated Testing: AT.23.06.000, total: 63.

Bug

  • [DMAS-54830] - Add Batch Task Button stays active unless the batch is closed
  • [DMAS-55921] - Data not sent from driver when useMessageBuffering set to false
  • [DMAS-57451] - SeaTube page doesn't work for some screen size
  • [DMAS-64299] - Dashboards Video Widget does not display correct error message when there are no videos available
  • [DMAS-66399] - A device category list has a device type in it
  • [DMAS-66642] - Video full screen is not working
  • [DMAS-67731] - Seatube Search losing value for 'Creators' field
  • [DMAS-73319] - Other widgets do not synchronize when video widget is disabled
  • [DMAS-74244] - Url Links to different tabs in Sensor Maintenance page is not working as intended
  • [DMAS-74513] - IP tab on Device Details page is blank when directly accessing the url
  • [DMAS-75714] - Device Details Page is not updating the url when a new tab is clicked
  • [DMAS-75833] - Citation should link to doi
  • [DMAS-76100] - FileManagement "Download Selected Files as Archive Ready" option is ignored when downloading a single uncompressed file
  • [DMAS-76291] - Device listing page snackbar component sometimes not displaying
  • [DMAS-76338] - CODAR FTP job seems to pick up .tmp files
  • [DMAS-76411] - Square brackets in the filter for AnnotationService are not being url encoded
  • [DMAS-76417] - Fix typescript errors that appear when running cypress
  • [DMAS-76496] - Device quarantine checking fails on shorestations without database access
  • [DMAS-76530] - Audio Widget attempts to fetch urls from PROD in QA
  • [DMAS-76541] - NetworkConsoleService allows anonymous users to read (some) Oceans 3.0 configuration properties
  • [DMAS-76634] - Social Media Links on the Digital Fishers Page are no longer present
  • [DMAS-76712] - Uncaught TypeError is thrown on adding widgets to the Dashboard
  • [DMAS-76747] - User Management becomes unresponsive when selecting the IPP group for PNSN Accelerometer
  • [DMAS-76762] - File Management no longer finding files by name
  • [DMAS-76769] - Data Preview URL returns incorrect plot for certain search tree nodes
  • [DMAS-76774] - Header disappeared after switching tabs on device details page in QA
  • [DMAS-76779] - Last name is undefined in Modify by on the Derived Sensor Parser Definition tab of Sensor Maintenance page
  • [DMAS-76792] - Error when loading OpenAPI page (QA only)
  • [DMAS-76807] - Empty error snack bars appear for external user visiting Seatube link
  • [DMAS-76809] - Data Player Widget in QA attempts to load images for unavailable data configurations
  • [DMAS-76822] - The table loading indicator for the Site Device List page is not present
  • [DMAS-76830] - Default preferredExpeditionName is showing in all instances where it is not defined in the URL
  • [DMAS-76834] - Device Synchronization Table Modify By Column does not have a space between the user's name and id
  • [DMAS-76852] - Parser definition highlights incorrectly changed lines when comparing to older versions from history
  • [DMAS-76874] - Automatic merge failure from 23.05.000 to main
  • [DMAS-76880] - DMAS Search Failed Notification: 19-Jun-2023 21:29:50 UTC, Strait of Georgia CODAR Array, CODAR Data Availability, SearchHdrId 14673137, UserId 42732
  • [DMAS-76934] - Wiring The Abyss not showing deck log annotations
  • [DMAS-76940] - Task Definition Schedule cannot be updated
  • [DMAS-76953] - Using the wrong character for apostrophes in ISO19115 XML Metadata files
  • [DMAS-76955] - Eclipse tries to import ca.uvic.dmas.core.system bundles in place of project templates in ca.uvic.dmas.templates/resources
  • [DMAS-76980] - Page permission deletions failing on User Management page
  • [DMAS-76987] - Geospatial Map Casts cannot be downloaded in QA
  • [DMAS-76992] - Requests to ScalarDataAPIService caused heap issues on dcweb2
  • [DMAS-77042] - Sensor Maintenance Data Rating Does not Sort By Id correctly all the time
  • [DMAS-77049] - Attempting to sort by 'Date To' if an undefined end date exists results in the table disappearing in the Ip tab of a Device Details page
  • [DMAS-77050] - Sensor Data Rating Uniqueness Error Message should have consistent capitalization
  • [DMAS-77051] - List of jobs displayed on Camera page is not correct
  • [DMAS-77065] - @types packages aren't being automerged by Renovate
  • [DMAS-77072] - Fix Duplicate Device Issue with IPP Tab of User Management Page
  • [DMAS-77089] - Instrument Point People Tab cannot add valid device on table page other than the first page
  • [DMAS-77119] - Change formatting on Community Fisher's Geospatial Map search bar
  • [DMAS-77121] - Unable to get ERDDAP datasets for a site device when not logged in
  • [DMAS-77145] - Data Product Option Links under Data Search link to wrong pages for Nortek Signature 55
  • [DMAS-77149] - Clearing the CF date range filter does not restore unassigned cast icons to map
  • [DMAS-77213] - Misspelled task parameter singelton
  • [DMAS-77217] - File archiving fail for 2 hours of data for Biosonics Echosounder at Folger Deep
  • [DMAS-77218] - Inconsistent click behavior on CF cast map labels
  • [DMAS-77243] - Internal service error not fully handled for GeospatialMap Cast Download
  • [DMAS-77251] - Correct A4 constant value in Seabird43Util.java
  • [DMAS-77279] - Internal Server Error Alert appears when adding a task to a phase
  • [DMAS-77280] - Process Group cannot be deleted from Device Workflow Admin Page in QA
  • [DMAS-77282] - Internal 500 returned on Geo Spatial map when downloading dataproducts
  • [DMAS-77315] - File Management Pagination does not work
  • [DMAS-77321] - CruiseIds parameter not being passed to the dataproductdelivery service
  • [DMAS-77325] - Errors displaying in Taxonomy
  • [DMAS-77327] - Task Definition Page cannot create new Task Definitions
  • [DMAS-77328] - CastDataCorrection cannot generate matlab command when processing with reference values
  • [DMAS-77330] - Task Definition will not save when the Task Type Batchable is set to be 'CodeRunner'
  • [DMAS-77340] - Updates on existing playlist descriptions display error for duplicate playlist name
  • [DMAS-77358] - Unable to update event definition json on event maintenance page

User Story

  • [DMAS-46541] - As an API user I need the rawdata service documentation to be well structured, complete and correct
  • [DMAS-73632] - Remove date constrain on Dataset Landing Page when search_dtlid is searched
  • [DMAS-76102] - As a dev, i would like to remove old annotation search page in dmas system
  • [DMAS-76443] - As a dev, I would like a page to only display FormField information
  • [DMAS-76564] - As a data specialist, I would like improvements to the QAQC Auto Test Details page
  • [DMAS-76565] - As a data specialist, I would like improvements to the QAQC Auto Test Finder page
  • [DMAS-76567] - As a data specialist, I would like improvements to the Sensor Details page
  • [DMAS-76723] - As a ST user, I would like to delete selected video clips that are in my playlist, so that I can better manage my clips.
  • [DMAS-76812] - As a Data Steward, I would like 'dayofweek' to be editable in the task management - task schedule UI
  • [DMAS-76990] - As a ST user, I would like to search/export annotations in a deck log
  • [DMAS-77002] - Selecting multiple casts with the Lasso tool can cause a layout overflow limiting functionality
  • [DMAS-77144] - As a CF map user I'd like a better integrated work flow for cast selection

Task

  • [DMAS-51040] - Loop back not working in Video Widget
  • [DMAS-56206] - As an API user, I would like a more descriptive error message when no device is found at a location
  • [DMAS-73263] - Remove parserdefinition_hist
  • [DMAS-74271] - Setup a minimum size for Sensor Display widget for an anonymous user
  • [DMAS-74856] - As an API dataProductdelivery user the request method is not consistent
  • [DMAS-74901] - Remove minimums on all widgets to make layouts more flexible (was: Make text widget size smaller)
  • [DMAS-74928] - Update ISO xml metadata to include ONC as "owner" role in addition to custodian and distributor
  • [DMAS-74997] - Support Windows in Oceans Next's deploy.sh
  • [DMAS-75824] - As a data steward, I would like an improved way to set the process in DeviceWorkflowAdmin
  • [DMAS-75879] - Use JAXB for DOIDataset's XML in DMAS
  • [DMAS-76135] - Implement magnitude evlolution plots into the EQ catalog event page
  • [DMAS-76412] - Create Cypress tests for cast popup components in the geospatial map
  • [DMAS-76423] - Convert siteDeviceSubset_hist to siteDeviceSubset_trx and convert im_sitedevicesubsetcastdefinition_hist to im_sitedevicesubsetcastdefinition_trx
  • [DMAS-76479] - Stop logging unique constraint violations in PhoneManager and WebsiteManager
  • [DMAS-76483] - Stop logging unique constraint violations in TaxonomyManagerImpl
  • [DMAS-76484] - Ensure user sessions are correctly serialized through a restart
  • [DMAS-76489] - Stop completely unnecessary logging of an error message shown to API users
  • [DMAS-76494] - Assign da_devicequarantine primary keys from a sequence
  • [DMAS-76503] - Deprecate Coastbuster
  • [DMAS-76560] - Add Load Indicator for Cables Tables
  • [DMAS-76604] - Improve performance when modifying Deck Log widgets positions, sizes, etc
  • [DMAS-76611] - Don't cache Docker images created by Renovate builds
  • [DMAS-76624] - Update qanoaa1's device IPs in the refresh script
  • [DMAS-76643] - Use DeclarativeDataParserFactory to create instances of DataParser
  • [DMAS-76644] - Add time-format PnYnMnDTnHnMnS (ISO 8601 Duration) to OpenAPI
  • [DMAS-76648] - Remove access to SeaTube Dive Page
  • [DMAS-76652] - Integration testing shouldn't abort if a deployment stage can't allocate a build node quickly
  • [DMAS-76654] - Add 4 hour resample period to automatic resampling periods list for Data Search plots
  • [DMAS-76661] - Remove sort from some columns in SearchHistoryTable
  • [DMAS-76663] - Remove former employee Derrick Evans as a valid reviewer for Renovate's pull requests in Oceans Next
  • [DMAS-76664] - Automerge Renovate's upgrades to the Cypress monorepo
  • [DMAS-76665] - Update database documentation to describe when scripts should be run in QA2
  • [DMAS-76667] - Investigate simulated earthquake events 527 and 546
  • [DMAS-76673] - Test the Release Branch
  • [DMAS-76675] - Assign the entire code review shortlist to each Renovate pull request
  • [DMAS-76676] - Clean up the formatting of Renovate's PR body notes
  • [DMAS-76688] - Remove Release Branch Test Indicator
  • [DMAS-76698] - Reduce /ftp/pub usage by IOS hydrophone audio data products
  • [DMAS-76704] - Provide better feedback in an API response if the system is down
  • [DMAS-76705] - Change dashboards to use useSnackbar instead of withSnackbars
  • [DMAS-76713] - Add warning and flag for videofileqaqc when files' duration doesn't agree
  • [DMAS-76715] - Ensure TextField has label with "for"
  • [DMAS-76734] - Fix automatic merge conflict
  • [DMAS-76773] - Update CameraSystemParserHelper to use ISensorConstants.SENSOR_CODE_LIGHT1 instead of ISensorConstants.SENSOR_CODE_LIGHT
  • [DMAS-76790] - Truncate Oceans 3 hostnames in deployment notification text
  • [DMAS-76793] - Improve test for LiveExpeditionEmbedUtil
  • [DMAS-76838] - Allow Renovate to automerge updates to playwright-webkit
  • [DMAS-76841] - Remove unused database tables playlist and playlistdetail
  • [DMAS-76846] - Truncate Oceans Next hostnames in deployment notification text
  • [DMAS-76873] - Make DmasAPIResponse.getPayload generic
  • [DMAS-76875] - Resolve Auto merge conflict
  • [DMAS-76884] - EarthquakeCorrelatorRealEarthquakeTests are slowing down the jenkins build
  • [DMAS-76923] - Remove a couple unnecessary methods of ArchiveFileManager
  • [DMAS-76927] - Clean up core.infrastructure persistence layers in onc-core
  • [DMAS-76928] - QAQC Autotests Finder Page should have a loading bar for the table
  • [DMAS-76930] - Support adding links to Text Widget content
  • [DMAS-76944] - The Tables under the Sensor Maintenance Tabs should have loading bars
  • [DMAS-76946] - Speed up get location tree public api service
  • [DMAS-76951] - Remove redundant method GlobalProperties.loadRuntimeProperties
  • [DMAS-76963] - Display task output on the task management page
  • [DMAS-76986] - Automerge updates to ts-jest
  • [DMAS-76995] - Reprocessing and batch tasks should automatically restart where they left off after deployments/restarts
  • [DMAS-77040] - Email job and postprocessing job for Spanish Antarctica project
  • [DMAS-77090] - Limit access and disable buttons on Dive Listing page
  • [DMAS-77091] - Investigate the 2023-07-07 earthquake
  • [DMAS-77092] - update privacy policy link and wording on login page
  • [DMAS-77135] - BPR reprocessing has to be ran on a single task machine
  • [DMAS-77141] - Support device type 935 in CommunityFisherProcessingCommentUtil
  • [DMAS-77197] - Add documentation and update name and description for the "AutomaticSchedulingJob"
  • [DMAS-77211] - Automerge Renovate's upgrades to the cypress-real-events repo
  • [DMAS-77214] - Remove unused dependency swagger-ui
  • [DMAS-77216] - Replace deprecated ExpectedException JUnit rule with assertThrows
  • [DMAS-77224] - Improve echosounder plot limits to avoid having too much data out of the limits
  • [DMAS-77249] - Add visual indication to cast download table to represent if a product has errored or otherwise failed to download.
  • [DMAS-77268] - Plotting Utility > Help Tab: Update of links to knowledge base page

Design

  • [DMAS-75843] - Create mockups for exporting data in Darwin Core format in SeaTube Search
  • [DMAS-76749] - Design the UI for selecting and deleting / downloading clips
  • [DMAS-77006] - Design changes to the SeaTube Search page to support exporting Deck Log annotations
  • [DMAS-77007] - Design API changes to the seatubeV3/annotations and dataProductDelivery calls coming from the SeaTube Search page

Implementation

  • [DMAS-74581] - remove annotation search from resource name
  • [DMAS-75804] - Move the clear button to top of page
  • [DMAS-75809] - Auto-update the status in the DataProductDeliveryService RunRequest
  • [DMAS-75812] - JSON response field and CURL link
  • [DMAS-75818] - Design & Implement UI To Delete and Update a Related Identifier
  • [DMAS-75993] - Set up the persistence layer generator's codebase
  • [DMAS-76105] - remove codes for old annotation from oceans 3.0 codebase
  • [DMAS-76278] - Add Delete, Edit, and Re-synchronize Related Identifier functions of DOIDatasetService
  • [DMAS-76352] - Create new synchronizer table and related entities
  • [DMAS-76353] - Create DAL for new synchronizer table
  • [DMAS-76386] - Add an ID to snackbars in Oceans Next
  • [DMAS-76430] - Implement backend for saving SiteDeviceSubset erddapdatasets to database
  • [DMAS-76510] - Implement creating datasets.xml entry for SiteDeviceSubset cases (Community Fishers)
  • [DMAS-76512] - Implement the email of request support
  • [DMAS-76525] - remove references to sensorcategory in dmas code
  • [DMAS-76557] - Implement Test Driven Development with Cypress for SensorType page front end
  • [DMAS-76563] - Implement react code for change of attaching file
  • [DMAS-76582] - Clean up error handling in DmasAPIService
  • [DMAS-76583] - Add a JSON parser to WebParameters
  • [DMAS-76584] - Update web services to get JSON parameters from WebParameters where possible
  • [DMAS-76585] - URL-decode JSON parameters
  • [DMAS-76587] - URL-encode JSON parameters in Oceans Next service calls
  • [DMAS-76589] - Refactor Cypress tests for WTA page based on improved test plan
  • [DMAS-76599] - Implement database changes
  • [DMAS-76601] - Implement Backend Changes for SensorType page
  • [DMAS-76614] - Create new synchronizer_type table and related entities
  • [DMAS-76616] - Create DAL for new synchronizer_type table
  • [DMAS-76630] - DMAS changes pass taskids to all matlab post processors. File and non file
  • [DMAS-76640] - SQL to add new task type
  • [DMAS-76657] - Implement Backend changes for FormFiled page
  • [DMAS-76671] - Create new synchronizer_deployment table and related entities
  • [DMAS-76677] - Create DAL for new synchronizer_deployment table
  • [DMAS-76679] - Create generic MatlabPostProcessor implementation
  • [DMAS-76685] - Show all the tests even tests that are closed if Active Only is not checked
  • [DMAS-76687] - Remove link to Dive page from Expedition Management
  • [DMAS-76691] - Add taskId as input argument to all matlab post processors
  • [DMAS-76692] - Fix automatic merge failure from release to main
  • [DMAS-76696] - Implementation for speeding up the SearchHistoryService
  • [DMAS-76700] - Add checkbox "Active Only"
  • [DMAS-76701] - Create new mqlocation table and related entities
  • [DMAS-76702] - Create new mqlocation table and related entities
  • [DMAS-76703] - Create DAL for new mqlocation table
  • [DMAS-76709] - Improve component test coverage of org agreement resource panel
  • [DMAS-76726] - Update Service / API tests for the WTA page
  • [DMAS-76728] - front end implementation
  • [DMAS-76732] - Declarative Parser - Improvement to mapping string responses
  • [DMAS-76748] - add an auto QAQC test directly from sensor page
  • [DMAS-76750] - Front End: Implement functionality to select and delete clips from a Playlist
  • [DMAS-76761] - Allow default attributes to be added to imported taxons if there new taxonomy is editable
  • [DMAS-76771] - add java code for qaqctestdetailService
  • [DMAS-76777] - SQL create table
  • [DMAS-76794] - Add data variables to Community Fishers datasets.xml
  • [DMAS-76811] - Show the Attribute Code in addition to the Attribute ID in QAQC testdetail
  • [DMAS-76813] - implementation - New Url Links to different tabs in Sensor Maintenance page
  • [DMAS-76816] - Back End: Update PlaylistManagementService to include Download call that accepts an array of playlistLineIds
  • [DMAS-76819] - add modified by name
  • [DMAS-76820] - Back-end: Update PlaylistLineService to accept list of playlist lines for deletion
  • [DMAS-76839] - Add synchronizable column to mqlocation table and related entities
  • [DMAS-76840] - Update DAL for mqlocation table with new synchronizable column
  • [DMAS-76848] - remove the coastbuster page from the admin menu
  • [DMAS-76850] - Remove GlobalProperties.getProperty
  • [DMAS-76853] - Back-end: Allow display of one or two turbidity sensor(s) in ST sensor panel
  • [DMAS-76855] - remove coastbuster tasks
  • [DMAS-76859] - Read the paths to the Oceans 3 and database repositories from command line options
  • [DMAS-76878] - Support Day of week in taskmanagement schedule
  • [DMAS-76887] - Add modifyby and modifydate columns to cruiselivestream and cruiselivestream_hist
  • [DMAS-76888] - Track the modifyby and modifydate of CruiseLivestream in Oceans 3
  • [DMAS-76889] - replace cruiselivestream_hist with cruiselivestream_trx
  • [DMAS-76890] - New parser type that uses pattern matching
  • [DMAS-76894] - Remove DmasAPIService.errorResponse
  • [DMAS-76902] - create database table to save emails from support request
  • [DMAS-76908] - Change output of step two of Community Fishers pipeline from cast files to a list of SiteDeviceSubsetIds
  • [DMAS-76909] - Extract the datasets.xml editing code (update, add, delete) from ErddapManagementService so that it can be used in multiple locations
  • [DMAS-76911] - Create new job responsible for creating community fishers erddapdatasets - SQL
  • [DMAS-76913] - Trigger updates to erddapDataset when casts are updated
  • [DMAS-76914] - Implement react code for device autocomplete
  • [DMAS-76915] - Front End: Implement functionality to download selected clips from a Playlist
  • [DMAS-76916] - Remove usage of cast file from matlab code for step 3 of community fishers pipeline
  • [DMAS-76924] - Write siteDeviceSubsetIds instead of cast files into cast correction dir when triggered from webservice
  • [DMAS-76948] - Back-end: Allow for clips to be downloaded as individual files
  • [DMAS-76949] - Front-end: UI to allow the user to select their preferred download option
  • [DMAS-76950] - delete neptune_header_light.vm 's coastbusterFileService
  • [DMAS-76952] - Auto-fill the description of new QAQC tests
  • [DMAS-76957] - Update QA and Dev post database refresh scripts to not email info@oceannetworks.ca when requesting support in those environments
  • [DMAS-76958] - Update FieldsFilter to remove requiresNetwork
  • [DMAS-76975] - Front-end: Allow turbidity sensors to display in Sensor Readings panel
  • [DMAS-76976] - auto fill test description with deviceCode
  • [DMAS-76979] - create database table to save emails from support request
  • [DMAS-76988] - clean up database table for coastbuster
  • [DMAS-77009] - Update seatubeV3/annotations web service to allow for both diveIds and cruiseIds to be provided in the parameters so annotations for both dives and deck logs are returned
  • [DMAS-77011] - Support export of deck log annotations through the DataProductDelivery service call
  • [DMAS-77021] - Search by Device with autoComplete
  • [DMAS-77024] - Write skeleton code for a playlist playback dashboard
  • [DMAS-77030] - Automatically requeue failed reprocess tasks cancelled during jvm restart
  • [DMAS-77034] - Add Button to Deck Log Filter dialog that opens the SeaTube Search Page
  • [DMAS-77035] - Add support for selecting Deck Logs on the SeaTube Search page
  • [DMAS-77036] - Display deck log search results when selected in SeaTube Search
  • [DMAS-77037] - Add support for exporting Deck Log annotations on the SeaTube Search page
  • [DMAS-77038] - Enable searching deck logs from Expedition Management
  • [DMAS-77046] - Configure pylint and CI
  • [DMAS-77052] - Add option to include taskId in matlab calls from MatlabFunctionRunner
  • [DMAS-77054] - Use getJson in device workflow services
  • [DMAS-77055] - Create new job responsible for creating community fishers erddapdatasets - Java
  • [DMAS-77057] - Upgrade JUnit to 4.13
  • [DMAS-77082] - Add backend support to filter annotations by number of OBIS reviews and percent of OBIS reviews that are positive
  • [DMAS-77083] - Display OBIS fields in the dive log annotation list filter
  • [DMAS-77085] - Include the OBIS columns ('#' and '%') in regular ST search exports
  • [DMAS-77093] - Cancel button should back to sensor detail page
  • [DMAS-77096] - XML Parser refactor
  • [DMAS-77103] - Connect new erddap dataset job to community fishers pipeline - java
  • [DMAS-77104] - Connect new erddap dataset job to community fishers pipeline - sql
  • [DMAS-77111] - return original page
  • [DMAS-77113] - Back-End - Populate cruiseName for Deck Logs in SeaTubeSearch
  • [DMAS-77133] - Update service to get creators and modifiers to support deck log
  • [DMAS-77139] - Update SeaTube Search front end's long-running search dialog
  • [DMAS-77143] - Update group permissions for the Dive Listing page
  • [DMAS-77146] - Hide instrument Security Tier from non-ONC users in Device Listing React table
  • [DMAS-77147] - Hide instrument Security Tier from non-ONC users in Device Details General tab
  • [DMAS-77148] - Hide instrument Security Tier from non-ONC users in Device Search Results table
  • [DMAS-77153] - Add column title "magnitude evolution" to the earthquake organization table
  • [DMAS-77154] - Modify the settings/gear dialog just to do date filtering
  • [DMAS-77155] - Disable SeaTube Search's search button if it won't search anything
  • [DMAS-77158] - Modify the lasso dialog just to do cast selection and downloading
  • [DMAS-77159] - Rewrite the ST search results table using the StatelessTable API
  • [DMAS-77161] - Add new download history icon and dialog to CF map
  • [DMAS-77162] - Add test to geospatial map to check if all casts are re-populated after clearing the filter
  • [DMAS-77194] - Handle backend response for hidden Security Tier from non-ONC users
  • [DMAS-77196] - Improve logging to narrow down where cancel message disconnect happens
  • [DMAS-77227] - Only delete search FTP directory from web server for completed searches
  • [DMAS-77231] - Include OBIS parameters in the filter for regular SeaTube Search
  • [DMAS-77236] - Modify the calendar filter icon to reflect if a filter is applied or not.

Test

  • [DMAS-67595] - add web service tests
  • [DMAS-76260] - Update webservice automation test for erddap services
  • [DMAS-76843] - Fix Jest tests after adding a space in the Device Sync Table modify by column
  • [DMAS-76891] - Create web service tests for new Download operation in PlaylistManagementService
  • [DMAS-76900] - Create web service tests for new Delete operation in PlaylistLineService
  • [DMAS-77258] - Add webservice tests to check get does not require privileges but posts still do

Bug (ST)

  • [DMAS-72916] - Re-add spaces to EOV keywords so CKAN upload works correctly
  • [DMAS-76463] - Fix Bugs in Data Preview Management Draggable Dialog Boxes on the Frontend
  • [DMAS-76842] - Add a space to the Modify By Column of the Device Synchronization Table through the backend
  • [DMAS-76931] - SensorId=9856 without # works now, and fix always #calibration_tab first
  • [DMAS-76973] - Correct Parameters for Search Hydrophone Data Searches
  • [DMAS-76974] - Create Database Script to Correct Existing Hydrophone Search Parameters
  • [DMAS-76991] - Taxon buttons cannot be saved on the Taxon Button Set Config page
  • [DMAS-77192] - IndexOutOfBoundsException during annotation export
  • [DMAS-77240] - SeaTube search export fails with a JSONException when including OBIS reviews

Investigation

  • [DMAS-75990] - Investigate tools to generate Java source code

Documentation

  • [DMAS-76690] - Document new tasktype
  • [DMAS-76868] - Update Documentation for referrer field in Request Support email
  • [DMAS-76910] - Document new job used to automatically create community fishers erddapDatasets

July 25, 2023

Minor release (no-downtime): fix for BioSonics data product indexing error

Tickets Released: Oceans 3.0: 23.05.006 (accessible to internal users only). Total: 1.

July 18, 2023

Minor release (no-downtime): make CKAN metadata UUID static

Tickets Released: Oceans 3.0: 23.05.005 (accessible to internal users only). Total: 1.

June 21, 2023

Minor release: cumulative update, including: fix for device cache, discontinue service desk replace with support emails, add seascript random duration pause, Data Search delete/cancel fixes, driver & parser updates.

Tickets Released: Oceans 3.0: 23.05.004 (accessible to internal users only). Total: 16.

June 14, 2023

Minor release: fixes for Community Fishers cor file data products, add count down to expedition page, fix deck log annotations

Tickets Released: Oceans 3.0: 23.05.003 (accessible to internal users only). Total: 6.

June 7, 2023

Minor release: improve use of PNSN devices in Earthquake Early Warning

Tickets Released: Oceans 3.0: 23.05.002 (accessible to internal users only). Total: 2.

June 6, 2023

Major release, immediately followed by a minor release (no down time)

Maintenance

New Features or Improvements

  • Filter feature in batch section of Task Management page
  • Draggable dialog box on Data Preview Management page
  • Organization page: trim organization name; add modified by and modified date on dialog box; more clearer message when non-unique organization name is entered
  • Link to external release notes in Oceans 3.0 menu  ← HI!!
  • Devicetypeid and devicetypename in the general tab of Device Detail page
  • Deprecate event tab of device detail page
  • Remove notification fields on deviceaction maintenance page
  • Denote mobile position sensors in the header of csv & json data products
  • Upgrade to parallel version of GZip
  • Improve performance of archive file API getListByLocation
  • Warning message when create an annotation with datefrom>dateto
  • Update logo colour
  • Bump Telnet Console line length to 400 characters
  • Lots of new or updated selenium tests
  • Many document updates

Bug Fixes

  • Incorrect error message when creating new device sync
  • /dmas in urls in OpenAPI example responses
  • Typo in alert message on Topology page
  • Logout issue on Landing page
  • Caches dequeueing issue on shorestations
  • NullPointerException in qaqcrestdetailsService
  • Remove duplicate dmasgroup names
  • Pamguard tasks sometimes stop unexpectedly
  • Attempted fix of device cache issue, will put more extensive/complete fix in upcoming minor release
  • Ferry data streaming
  • fix bug causing slow reprocessing (minor release 23.05.001)

Internal projects

  • Upgrade PostgreSQL Java driver
  • Java 17 upgrade (in progress)
  • Refactoring

Community Fishers

  • Fixed error on salinity compensation calculation when run on no data
  • Correctly set the date_issued value for dataset.xml files
  • Added createdate column to siteDeviceSubset and siteDeviceSubset_hist tables
  • Place additional information in pipeline cast data correction and ingestion emails

Acoustic Data Viewer

  • Fixed QA Audio Widget from pulling prod data
  • Converted DataPlayerForm to functional React component

Data Products

  • matlab-as-a-service improvements: better handling of MATLAB fatal errors in postprocess jobs, increase memory monitoring timeout
  • Citation fixes: attribution end date incorrect, order citation authors alphabetically
  • Minor fixes: 
    • Improved warning messaging for erroneous hydrophone calibration metadata
    • Reduce CODAR ruv file hold off time for latest preview searches
    • Update Nortek Sig55 data products to be handle PLAN0/1 configurations and options 

EEW

  • Various small fitlet improvements
  • Added 31 PNSN instruments to the event detection algorithm
  • Expanded our detection area 1 degree East

ExperiMINTED 

  • Search History Pagination

Data Policy

  • Prototype for associating site devices with agreements

CIOOS / CF

  • Support saving date created for CASTs for use in ISO 19115

SeaTube

  • Added support for WTA page in Oceans 3.0. Now live for DFO expedition. Added support for Apple's mobile devices. 
  • In-progress: support more than 10 on-ship servers, playlist management.
  • Bug fixes, simple UI improvements, added more UI automated tests

Instruments

  • Axis Camera Driver
    • New commands: defog, defogLevel, wdr and a new form of takePicture that allows taking a burst of pictures. All new commands are available through SeaScript and the camera web page.
    • Pause command now supports fractional seconds.
    • Bug fixes

Tickets Released: Oceans 3.0: 23.05.000, 23.05.001 (accessible to internal users only). Total: 140+1. Automated Testing: AT.23.05.000, total: 33.

Bug

  • [DMAS-54953] - Parser Definition is not passing batch correctly to DeviceParserDefinitionService
  • [DMAS-64189] - An attribute management admin user can update duplicated option values
  • [DMAS-66216] - Unsaved button attribute changes remain even after Cancel is clicked
  • [DMAS-66856] - Annotation list shows no data after adding the widget back to layout
  • [DMAS-67048] - Input is not kept for some NOAA dives
  • [DMAS-75127] - Typo in alert message on Topology page
  • [DMAS-75448] - Raw file generation is trying to create multiple files with the same name for (maybe) an RBR tiltmeter
  • [DMAS-75882] - Error snackbar pops out when createing new device synchronization in QA
  • [DMAS-75916] - Video clips should not show in ST Pro for a fixed location camera
  • [DMAS-75928] - Log out on Landing page does not work as expected
  • [DMAS-75932] - PAMGUARD tasks sometimes stop unexpectedly
  • [DMAS-75964] - Fix Bugs in Data Preview Management Draggable Dialog Boxes
  • [DMAS-76124] - In PlaylistVideoTest , the snackbar generated from the Copy Link button has an unexpected xpath
  • [DMAS-76165] - Fix Non-Unique Organization Name Error Message
  • [DMAS-76195] - Failed to retrieve sensor info error for PVCS View page
  • [DMAS-76220] - Fix Blank Error-Handling for Organization Name on the Organization Page
  • [DMAS-76319] - Fix failing tests in SeaScriptManagement
  • [DMAS-76347] - Improve MatlabFilePostProcessor error handling for the case where Matlab crashes processing a file
  • [DMAS-76359] - The Menu in Camera Control in DDL Camera appears to have a bug that prevents from changing the parameters also some additional menu functions needs to be added. Laser is not responding to seascript and camera control.
  • [DMAS-76362] - Attribute Updated snackbar shows when save fails in TaxonomyAttributeManagement
  • [DMAS-76370] - qaweb2 is logging PSQL errors from ArchiveFileStateDAO.getReadingRangeForDeviceByDate
  • [DMAS-76409] - COR Files not showing names of communities when downloaded from the geospatial map - bug in citationText for non-DOI case
  • [DMAS-76446] - Fix nullpointerException geofence test in QA
  • [DMAS-76458] - Order non-DOI citation owner/author list alphabetically in the DP code
  • [DMAS-76478] - Duplicate user groups can be created on the User Management page
  • [DMAS-76500] - fix ArchiveFileByDeviceQueryBuilderImpl error
  • [DMAS-76504] - Plotting Utility widget ( InteractivePlotWidget ) will not display plot
  • [DMAS-76515] - No space available in /var on a Jenkins docker agent
  • [DMAS-76522] - Dive/Cruise details taking up too much horizontal space in the WTA page
  • [DMAS-76537] - Community Fishers salinity compensation calculation will error if run on no data
  • [DMAS-76553] - Revert file name change
  • [DMAS-76568] - NullPointerException in QaqcTestDetailsService
  • [DMAS-76571] - unable to plot sensor data for RBR Quartz3 BPR zero SN 207223 after reprocessing
  • [DMAS-76572] - Increase timeout on matlab memory monitoring
  • [DMAS-76581] - Multiple query PIDs rows (still) being returned for one search detail and multiple DOIs
  • [DMAS-76602] - SoVI ferry instruments data is not flowing
  • [DMAS-76608] - Fix broken WTA page
  • [DMAS-76619] - NotSerializableExceptions during cache loading on hosts running Java 17
  • [DMAS-76622] - Fix formatting errors and change CR to LF in main
  • [DMAS-76623] - Fix failing SearchHistory tests
  • [DMAS-76625] - Saving device attribute and sensor attribute labels is failing in QA
  • [DMAS-76646] - Attribution end date incorrect in MAT file data products
  • [DMAS-76649] - MatlabFilePostProcessor task runs that timeout show completed in task management
  • [DMAS-76651] - WTA Video Player not working correctly on iOS devices
  • [DMAS-76672] - DMAS Search Failed Notification: 31-May-2023 16:02:07 UTC, Nortek Signature55 Current Profiler 200066, Nortek Time Series, SearchHdrId 14498894, UserId 112710
  • [DMAS-76680] - build failure in oceans-next with release/23.05.000
  • [DMAS-76686] - WTA page failing to load on occasion

User Story

  • [DMAS-42562] - As a developer, I would like ArchiveFileManager refactored to be simpler
  • [DMAS-73603] - As a data steward, I would like to add a field in the Batch section of the Task Management to enter Task Id of choice
  • [DMAS-76268] - As a dev, I would like to add a link to external release notes in dmas menu
  • [DMAS-76283] - As a deployment engineer, I want to verify that the Java 17 runtime environment has been correctly configured
  • [DMAS-76349] - As a Data Steward, I would like the devicetypeid and devicetype name showing in the General Tab of Device Listing for specific devices
  • [DMAS-76594] - As a dev, i would like to deprecate the event tab on device detail page
  • [DMAS-76595] - As a Data Steward, i would like to remove notification fields in deviceaction maintenance page

Task

  • [DMAS-74574] - As a time series scalar CSV user, I would like more information about mobile position sensors in the header
  • [DMAS-75611] - Add Modified By and Modified Date fields when user create or update organization
  • [DMAS-75847] - Integrate React-Query with Oceans3
  • [DMAS-76145] - Update ONC logos in Oceans 3.0 to use the new ONC blue
  • [DMAS-76148] - Request - replace our GZip library with a parallel version
  • [DMAS-76201] - Experiment with better theming to adhere to the branding guidelines of ONC
  • [DMAS-76249] - Create Cypress test for Live Video player component
  • [DMAS-76327] - Show warning in oceans-next when there is an unused import or variable
  • [DMAS-76341] - Add linting for easy autofixable eslint errors for typescript
  • [DMAS-76366] - Annotation tool should give me a gentle warning when I create an annotation with DateFrom>DateTo
  • [DMAS-76389] - Describe what to do when fixing issues in Renovate PRs
  • [DMAS-76404] - Create useSearchHistoryService hook
  • [DMAS-76413] - Fix failing test for testing-library 9.2.x
  • [DMAS-76421] - As a API user I find that getListByLocation is much slower than getListByDevice for archivefiles
  • [DMAS-76456] - Remove redundant ArchiveFileNamePredicate
  • [DMAS-76459] - Improvements for hydrophone calibration file data product: add warning and refactor
  • [DMAS-76471] - Convert DataPlayerForm to functional React component
  • [DMAS-76480] - Check for null values when comparing DmasUserWatchers
  • [DMAS-76481] - Don't log user error in UserManagementService
  • [DMAS-76485] - Prevent concurrent modification of ScalarDataStatementCache
  • [DMAS-76487] - Improve user folder creation checks
  • [DMAS-76493] - Refactor the useWebService hook to handle types better
  • [DMAS-76502] - Get instances of ArchiveFilePredicate from a factory
  • [DMAS-76535] - Add multiple-column support to the StatelessTable
  • [DMAS-76545] - Improve handling of late RUV CODAR data for latest preview searches
  • [DMAS-76552] - Write Cypress tests for Stateless table component
  • [DMAS-76558] - Modify data product code sensor combining logic to be based on sensorname, -sensorcode- sensortype and unit of measure
  • [DMAS-76569] - Update Renovate's Github access token
  • [DMAS-76576] - Clean up Jenkins' docker volumes more often
  • [DMAS-76596] - Pass inputProps into dropdown for passing better aria content to improve accessibility and testing
  • [DMAS-76610] - Setting up the EEW coverage area
  • [DMAS-76613] - For Nortek Signature 55 profilers, the configuration parameters in the MAT data products are not accurate
  • [DMAS-76660] - Increase the local Cassandra connection pool to 2k requests/node
  • [DMAS-76670] - Make Facebook livestream embeddable on WTA page
  • [DMAS-76678] - Change BARS driver to a readln driver
  • [DMAS-76684] - Document api additions for WTA page

Design

  • [DMAS-75845] - Create Design for getting all of user's search history on the search history page

Implementation

  • [DMAS-73604] - implement field for taskid
  • [DMAS-74456] - Implement a UI for operating on associations between site devices and organization data agreements
  • [DMAS-74591] - Implement Generic System Message
  • [DMAS-75539] - Implement the consistent dialog header into the Geospatial Map's selection dialogs
  • [DMAS-75850] - Use ArchiveFileManager.getByDevice wherever possible
  • [DMAS-75960] - Create a service for creating OrganizationAgreementDatasets
  • [DMAS-75961] - Update NetworkConsole to have a tab for the UI
  • [DMAS-75962] - Create a UI for viewing resources associated with an agreement with ability to create associations
  • [DMAS-75972] - Implement design for getting date created of casts - Java
  • [DMAS-76041] - Implement Pagination for User Search History
  • [DMAS-76246] - Upgrade postgres driver jar to the latest compatible version
  • [DMAS-76274] - Add pagination to front end Search History using react-query
  • [DMAS-76276] - Add Editable Column to pi_relatedidentifier table
  • [DMAS-76277] - Populate pi_relatedidentifier table from existing XML
  • [DMAS-76281] - Add Editable field to RelatedIdentifier
  • [DMAS-76296] - Don't try to shut down both Equinox and Gemini
  • [DMAS-76301] - Add close button to lasso selection
  • [DMAS-76302] - Don't fail validation if a host includes extra java agents
  • [DMAS-76315] - Add a symlink ~/dmas to whichever of Gemini/Equinox is currently running
  • [DMAS-76336] - Implement additional information in Community Fishers Pipeline cast ingestion emails
  • [DMAS-76382] - Split work for SearchHistoryService into it's own PR
  • [DMAS-76383] - Split work for React-Query and related files into their own PR
  • [DMAS-76384] - Split work for adding pagination to stateless table into it's own PR
  • [DMAS-76390] - Implement additional information in Community Fishers Pipeline cast data correction emails
  • [DMAS-76396] - add a link to external release notes in dmas menu
  • [DMAS-76414] - Implement design for getting date created of casts - SQL
  • [DMAS-76415] - Don't allow variable assignment mid-string
  • [DMAS-76422] - Add devicetypeid and devicetype name in the General Tab of Device Listing
  • [DMAS-76432] - Add synchronized column to the related identifier table
  • [DMAS-76474] - deprecate the event tab on device detail page
  • [DMAS-76505] - remove notification fields in deviceaction maintenance page in oceans 3
  • [DMAS-76506] - remove notiffication fields on deviceaction maintenance page in oceans-next
  • [DMAS-76520] - Log when a ppp message expires from the DeviceDataMessageCacheModule
  • [DMAS-76556] - Require non-null data preview rule descriptions in the database
  • [DMAS-76592] - Add the mail.request.support.to configuration to configproperty
  • [DMAS-76600] - Bump reading/line limit to 400 characters for Telnet Console
  • [DMAS-76615] - Add a dependency from the SitePosition cache to the Device cache

Test

  • [DMAS-76356] - Create regression test for Matlab crashing on bad hydrophone file

Bug (ST)

  • [DMAS-76222] - Fix Blank Error-Handling for Organization Name in the ONC repository
  • [DMAS-76223] - Fix Blank Error-Handling for Organization Name in the Oceans Next Repository
  • [DMAS-76343] - Integration testing deployment reports validation warnings for all hosts, but only some should have them
  • [DMAS-76464] - Fix Bugs in Data Preview Management Draggable Dialog Boxes on the Backend
  • [DMAS-76521] - fitlets occasionally fail to publish messages
  • [DMAS-76669] - qaweb2 memory leak caused by 348,741 instances of DataParserImpl and 152 instances of PrototypeServiceFactoryComponentManager

Documentation

  • [DMAS-76427] - Create Documentation for the Navigation Bar
  • [DMAS-76470] - update device general tab document
  • [DMAS-76507] - update documents for removing notification field on deviceaction maitenance page

May 24, 2023

Minor release: add logging to help diagnose device cache issue, display correct text on Wiring the Abyss page

Tickets Released: Oceans 3.0: 23.04.002 (accessible to internal users only). Total: 2.

May 16, 2023

Minor release: improvements for Wiring the Abyss page and expedition support, CF map, EEW and other fixes

Tickets Released: Oceans 3.0: 23.04.001 (accessible to internal users only). Total: 15.

Bug

  • [DMAS-75546] - Chart Widget Zoom Out Causes 'Error: Cancelled' Message
  • [DMAS-76288] - JSON error with Community Fishers Map
  • [DMAS-76290] - Cast Date Filter on Community Fishers Map Not Filtering
  • [DMAS-76360] - JSON5 error in Task Management when creating a batch
  • [DMAS-76379] - Live expedition app display error when there is a dive without a dive lead
  • [DMAS-76380] - Maximum annotation parameter failed when the number is greater than the actual count
  • [DMAS-76399] - Shorestations are creating cacheloader requests, but not dequeueing them

User Story

  • [DMAS-76435] - As a WTA web master, I would like to have the live expedition lay out support multiple screen size
  • [DMAS-76439] - As a WTA web master, I would like to not display live expedition info while an expedition is not active

Task

  • [DMAS-76189] - Modification of the Earthquake Catalogue
  • [DMAS-76363] - Investigate timecode issues
  • [DMAS-76381] - Please improve Live Expedition app loading behavior
  • [DMAS-76392] - Update Code using EarthquakeSite object to work when search tree node id is null (pnsn devices)
  • [DMAS-76395] - Remove /dmas from URLs in OpenAPI example responses

Bug (ST)

May the 4th, 2023

Deploy a major release we do.

Maintenance

New Features or Improvements

  • Remove yellow color from Plotting Utility color schema
  • Added a new page for maintaining DeviceType metadata
  • Search hydrophone page UI improvements to prevent users from committing extraordinarily large searches
  • Dialog box on Organization page now draggable
  • Support new ferry machine
  • Hydrophone calibration m-file upload fills out all needed sensitivity vectors
  • Remove "only run one task machine at a time" text on ReprocessConsole
  • Change DMAS log level from info to debug for DatastaxScalarDataDAO
  • Remove IP info on Event tab of DeviceDetail page

Bug Fixes

  • Improve Data Search and Search Hydrophone page loading times by removing a no longer needed archive query
  • Google map API key is new generated and implemented in Oceans 3.0 and Oceans-next
  • Fix pamguard batch page to only show pamguard batch tasks
  • "Failed to retrieve sensor info" error on PVCS view page
  • Remove duplicate date in CSV data product for averaging processing type

Internal projects

  • Fix handling of access restrictions in /api/archivefiles?method=getByDevice
  • Return an error message when an API service call fails for internal reasons (http 500 error)
  • Java 17 is ready for testing, this includes various preparation and improvements to deployment processes and scripts
  • Minor fix to data availability calculations (probably not noticeable to users)
  • React upgrade: add more automated tests around Leaflet to better test behaviour after upgrade

CIOOS - Community Fishers

  • Improved maintainability and robustness of ERDDAP
    • Merge ErddapDatasetService into ErddapManagementService, i.e. ErddapDatasetService has been removed
    • Refactor datasets.xml generation code
  • Add support to store and display Site Device Subset ERDDAP datasets

Data Policy

  • (in-progress)  Organization Agreement services to support associating site devices with agreements

ExperiMINTED 

  • (internal) Improve maintainability of Search History page
  • (in-progress) Add paging support to backend Search History service
  • (in-progress) More backend support for pi_relatedidentifiers

Data Products

  • Improve display of sample period data in the header of time series scalar ODV
  • Add "C" channel for some seismometers and add non-cardinal directions to option set
  • Add an "index" to connect qaqc final flag values to the qaqc test that contributed that final flag, available in time series scalar MAT files only. 
  • Allow writing MAT files greater than 2 GB (switches to v7.3 MAT files for large sizes), instead of dropping data, also throws lots of warnings. Our MAT files should never be more than ~ 1 GB.
  • Small changes: live raw data access fixes, refactoring due R2022b upgrade, search status reporting improvements for hydrophone data when data is not available via format conversion, improve backscatter calculation for ADCPs, remove filepostprocessor.class parameter for tasks, java AD file retrieval fix for file modes, exclude QAQC structure except for non-resample time series scalar MAT files.

SeaTube

  • Added support for WTA page in Oceans 3.0.
  • Added Oceans Next deployment info in our System Console, so we can tell the remote server versions.   
  • In-progress: Map Layer, supporting more than 10 on-ship server, PlayList management app, UI improvements and tests
  • Some small bug fixes

Community Fishers

  • Support multiple fluorometer piggybacks on CF device package
  • Corrected lassoed cast date filtering on CF map
  • Parameterized progress indicators/download buttons in cast popup to single component

Acoustic Instruments Data Viewer

  • Corrected population of toolbox options and limits
  • Added FLAC Support to Audio Widget with use of HTML5 audio element
  • Fixed fails to display images for valid data

Earthquake Early Warning

  • Fix some bugs where earthquake catalog job might sometimes miss an NRCan/USGS detection
  • Potentially fixed the issue where we lose data during an earthquake detection
  • Added lls delta trms value to earthquake details page as well as what algorithm epi/mag algorithm was used for each notification
  • Removed apple push reaction from eew event (it never worked outside of the test phone)
  • Update event maintenance page to support posting more than 1 MB data (EEW event definition got to large when adding PNSN devices)

OpenAPI

  • Changes to service parameter values now persist when switching between services
  • Data product request service parameters dpRunId and dpRequestId are now auto populated based on the response from the request and run services
  • dataProductDelivery download method now downloads the file rather then showing the file contents in the response view (response view is now hidden)
  • Make OpenAPI page inaccessible for anonymous users, redirect them to log-in page (all API requires a user identifying token)
  • Remove some confusing examples in the OpenAPI content
  • Add OpenAPI wiki link on Landing Page API help button
  • Add serchresultcomment info in the return of dataProductDelivery

Instruments

  • Parser Definition Edit Screen - Improved Usability:
    • Parser changes are not automatically reverted if attempt to save is not successful.
    • New button 'Run Tests', helpful for iterative changes to the parser.
    • When a test failure occurs, the fail reason is displayed. It will show the parser version, test number and fail reason.
    • Tests do additional checks such as verify test is parsed with the parser version where it is specified and checks if piggyback is configured correctly.
  • Acoustic Scintillation simulator now has ability to simulate file transfers.
  • Fixed problem where PVCS event was causing spurious logging in the raw data log.

Tickets Released: Oceans 3.0: 23.04.000 (accessible to internal users only). Total: 152. Automated Testing: AT.23.04.000, total: 36.

Bug

  • [DMAS-58090] - SeaTube playlist 385 displays an error snackbar "e[(intermediate value)] is undefined"
  • [DMAS-73041] - Annotation List Filter only works with lower case attribute values
  • [DMAS-73121] - Attribute Data not cleared when taxonomy is cleared
  • [DMAS-73670] - CSV files have duplicate date when processing type "averaging" is used
  • [DMAS-74556] - Data Search has very slow loading for hydrophones in the data product selection
  • [DMAS-74996] - The PVCSSPeedEvent continues to send driver commands even when driver is stopped
  • [DMAS-75729] - Wav files from on the fly conversion have error(s) in the header?
  • [DMAS-75835] - Fix failing test in Telnet
  • [DMAS-75880] - Discrepancy between AZFP data products - MAT and "raw" ASL files are inconsistent
  • [DMAS-75903] - Cypress coverage not available for typescript files
  • [DMAS-75912] - Data Player Widget does not populate toolbox options and limits
  • [DMAS-75931] - PAMGUARD batch tasks doesn't show tasks after window refresh
  • [DMAS-75963] - Vanessa's playlist - issues with download
  • [DMAS-76004] - qaeewarc1 reported an error on startup: Cannot invoke MetricsCounter.addToCounter because metricsCounter is null
  • [DMAS-76005] - Timestamp and Action columns should be fixed in Deck Log table
  • [DMAS-76010] - DeckLog Annotation Table Sorting Icon on "TimeStamp" column is initially in wrong direction
  • [DMAS-76013] - Text in DataPreview card can overflow container
  • [DMAS-76021] - Filesource was null on archived video files in DEV database
  • [DMAS-76026] - Unable to change page size on annotations table
  • [DMAS-76044] - Non-DOI/non-minted citation text missing "Society" on publisher name
  • [DMAS-76047] - PnsnSenderPreprocessorServiceActivator doesnt handle sites with no searchtreenode
  • [DMAS-76050] - Non-DOI/non-minted citation text incorrect for CBO test case
  • [DMAS-76054] - Java AD file retrieval searches return a few incorrect results
  • [DMAS-76059] - dcweb2 is logging PSQL errors from ArchiveFileStateDAO
  • [DMAS-76061] - In deck log Annotation Entry widget, the resource dropdown shouldn't have ROV and devices connected to that ROV
  • [DMAS-76078] - Failed cache reload after changing a parser definition using UI
  • [DMAS-76081] - Sensor names and units on Cast Scalar Multi Profile Plot can collide
  • [DMAS-76109] - Navigating to the OpenAPI Page as an Anonymous User Results in a Redirect to the Insufficient Privileges Page
  • [DMAS-76126] - Remove OpenAPI Examples From the Data Product Delivery Run, Status, and Download Methods
  • [DMAS-76138] - Fix filename used to extract live log files
  • [DMAS-76141] - Organization Draggable Dialog Should Not Allow Simultaneous Opening of Both Create and Edit Dialogs
  • [DMAS-76144] - AslEchosounderReader has identical operands error in variable type check
  • [DMAS-76151] - Some matlab DP that depend on java streaming raw log files are timing out in QA search automation
  • [DMAS-76153] - Disconnect apple push notification and driver command reaction from EEW event
  • [DMAS-76154] - DataPlayer fails to display images for valid data
  • [DMAS-76162] - Fix sorting bug in DeviceType
  • [DMAS-76179] - /api/archivefiles?method=getListByDevice... ignores data access restrictions
  • [DMAS-76209] - Fix Jenkinsfile - remove commented steps
  • [DMAS-76229] - Integration Testing fails to checkout feature branches of Oceans 3
  • [DMAS-76232] - Inconsistent "backscatter" values for Holyrood Nortek AWAC data products
  • [DMAS-76256] - Cassandra raw files failed 2023-04-25 UTC
  • [DMAS-76259] - Difference in Nortek ADCP data products found in search automation - dataQualityComment
  • [DMAS-76273] - Timestamp is reset when stopping then playing live video
  • [DMAS-76290] - Cast Date Filter on Community Fishers Map Not Filtering
  • [DMAS-76322] - Fix broken unit tests in oceans-next build for 23.04.000

User Story

  • [DMAS-57444] - As a system operator, I want to run Oceans 3.0 on Java 17 so that the system is secure
  • [DMAS-75410] - As a data steward, I would like a page where I can easily see and manage Device Type information
  • [DMAS-75728] - As a software developer, I want the Oceans Next version to be displayed in the System Console alongside the Oceans 3.0 version
  • [DMAS-76127] - As a deployment engineer, I want to be able to start and stop several Oceans 3 hosts at once

Task

  • [DMAS-74560] - Search Hydrophone Data is able to generate long time range searches without any warnings
  • [DMAS-74830] - Hydrophone data product request return different messages in Oceans3.0 and via API call
  • [DMAS-75393] - Can ErddapManagementService and ErddapDatasetService be consolidated into one service
  • [DMAS-75426] - Software support for AML-6 with extra Turner fluorometers
  • [DMAS-75529] - Add TextEditor.jsx cypress tests
  • [DMAS-75612] - make edit organization or create organization panel dragable
  • [DMAS-75858] - Check all getdeviceattribute usage, add isRequired flag as required
  • [DMAS-75873] - Add logic to device attribute page for hydrophones for fixing empty entries with less calibration vectors than previous deployments
  • [DMAS-75927] - Remove filepostprocessor.class parameter from jobs that previously used task type of GenericFilePostProcessor
  • [DMAS-76017] - Seismic data product SD for high-rate data channel currently unavailble for CH* and EH* channel options
  • [DMAS-76034] - Clarify for the user "SeaTube Ready" check box - front end
  • [DMAS-76035] - Add a timeout to cypress component tests in CI
  • [DMAS-76057] - Support aligned and depth binned data ingestion for new community fishers device package.
  • [DMAS-76062] - As a ST logger, I would like to have device ID info while I am choosing a device/device data resource in Annotation Entry widget of Deck Log app.
  • [DMAS-76063] - Parameterize progress indicators/download buttons in cast popup to single component
  • [DMAS-76065] - Saved Plot in Plotting Utility Does't Save Line Colours, & no Yellow Lines
  • [DMAS-76083] - Notify a user when their API request fails because of an internal error
  • [DMAS-76110] - IP information should not show up in Device Listing Event tab
  • [DMAS-76123] - Email me when Jenkins' docker cleanup build fails
  • [DMAS-76140] - Round all magnitudes to one decimal place on earthquake catalog
  • [DMAS-76143] - Add support to the stateless table component to support "fixing" specific columns to the left and right to prevent reordering
  • [DMAS-76149] - Investigate 2023-04-13 and 2023-04-19 earthquakes
  • [DMAS-76150] - Run docker prune on all available Jenkins docker agents, not a hard-coded list
  • [DMAS-76161] - Update SearchHydrophoneData button text
  • [DMAS-76181] - Adding OpenAPI Wiki to the Landing Page Panel
  • [DMAS-76189] - Modification of the Earthquake Catalogue
  • [DMAS-76193] - Add modifyBy and modifyDate fields to the data preview managment dialog
  • [DMAS-76194] - Change modifyBy and Date to match Modified by and Modified Date column names
  • [DMAS-76199] - Improve ODV data product sample period and sample size fields
  • [DMAS-76205] - remove "only run one task machine at a time" on ReprocessConsole
  • [DMAS-76211] - Hundreds of thousands of unneeded DMAS logs for class DatastaxScalarDataDAO
  • [DMAS-76221] - Write web service tests for updated CruiseService and DiveListing calls
  • [DMAS-76225] - Reduce size of post request when updating event definitions
  • [DMAS-76248] - Handle undeletable .nfs files when cancelling a search
  • [DMAS-76280] - Update the EEWMQClient version in bitbucket
  • [DMAS-76294] - Index the final QAQC flag to it's originating test in scalar MAT files
  • [DMAS-76306] - MAT files handle file sizes larger than GB

Requirement

  • [DMAS-76072] - Document changed requirements for deck log support

Design

Implementation

  • [DMAS-69782] - Add cruise date range validation to cruise table
  • [DMAS-74139] - Add Flac Support to Audio Widget and use HTML5 audio element
  • [DMAS-75413] - Implement Test Driven Development with Cypress for DeviceType page front end
  • [DMAS-75514] - Acoustic Scintilation simulator - simulate file transfer
  • [DMAS-75557] - Add cypress tests for components to be refactored
  • [DMAS-75591] - Add filtering logic to search history filter dialog (front end)
  • [DMAS-75603] - Implement database changes
  • [DMAS-75647] - Slow down Renovate
  • [DMAS-75800] - Add a query to get all the RelatedIdentifiers for a given DoiDataset
  • [DMAS-75807] - Keep input to one service when navigating away and back
  • [DMAS-75887] - Add the Oceans Next version to the System Console
  • [DMAS-75973] - Move Filtering from SearchHistoryTable to SearchHistoryPage
  • [DMAS-75984] - Abort Oceans 3 deployment if the JVM doesn't shut down quickly enough
  • [DMAS-75996] - Rename the column "doiDatasiteId" in pi_relatedidentifier to "doiDatasetId"
  • [DMAS-76002] - Create a hook for using snackbars so we don't have to use withSnackbars
  • [DMAS-76071] - Add an option to deploy_onc to shut down a set of Oceans 3 instances
  • [DMAS-76074] - Create skeleton code for the Live Expedition Embed iframe
  • [DMAS-76080] - Add comment next to checkboxes in YUI code to inform user of what they do
  • [DMAS-76096] - Add check for unique name and code, add pagesize all
  • [DMAS-76098] - Update Unique constraint and remove leading whitespace
  • [DMAS-76115] - Add component for displaying Dive/Cruise details
  • [DMAS-76116] - Add component for the live video display
  • [DMAS-76117] - Add component that displays the annotations for a dive / deck log
  • [DMAS-76118] - Selected Plot Properties Should Override Colour Scheme
  • [DMAS-76121] - Check the response from `sudo service equinox start`
  • [DMAS-76128] - Add an option to deploy_onc to start a set of Oceans 3 hosts
  • [DMAS-76129] - Shutdown should shut down all running instances of Oceans 3, regardless of JDK version
  • [DMAS-76132] - Refactor Dataset.xml generation code for separation of concerns
  • [DMAS-76133] - Add intercardinal directions to seismometer vertical velocity options
  • [DMAS-76139] - Add a servlet to oceans 3 to host the embeddable page
  • [DMAS-76147] - Update seatubeV3/annotations web service to refactor main call to exclude sensor data
  • [DMAS-76152] - Edit SeaTubeV3 CruiseService call to use its diveId
  • [DMAS-76156] - Add a temporary command to deploy_onc to validate that Equinox init scripts are correct
  • [DMAS-76160] - Add an option to getByDevice that returns a list of files and whether more files exist past the row limit
  • [DMAS-76164] - Auto fill in dpRequestId and runId with the result from requesting a dataproduct on the openapi page
  • [DMAS-76168] - Merge ErddapDatasetService into ErddapManagementService - front end
  • [DMAS-76169] - Merge ErddapDatasetService into ErddapManagementService - back end
  • [DMAS-76170] - OpenAPI dataProductDelivery service download method should not show the response for non scalar data products
  • [DMAS-76177] - Small updates to the DeviceType page
  • [DMAS-76190] - Implement capability to display siteDeviceSubset datasets in Erddap Management and Erddap Management table - backend/YUI
  • [DMAS-76200] - Refactor tryDBquery after moving to R2022b
  • [DMAS-76208] - Update OpenAPI data product delivery parameter and service descriptions
  • [DMAS-76213] - Implement capability to display siteDeviceSubset datasets in Erddap Management and Erddap Management table - frontend/react
  • [DMAS-76216] - Add the livestream url and organization name to the payload of CruiseService (operation 25)
  • [DMAS-76217] - Update front end to support new payload field, livestreamUrl, from CruiseService
  • [DMAS-76219] - Add route to WTA page in Oceans Next
  • [DMAS-76251] - Add scientistName field to the payload of DiveListingService
  • [DMAS-76265] - Update CruiseService operation=25 to also return the livestream's deviceId
  • [DMAS-76266] - Update logic for determining the current dive in the WTA page
  • [DMAS-76270] - Update servlet to allow page access to anonymous users
  • [DMAS-76295] - Add timestamp tooltip to Live Expedition annotations on hover
  • [DMAS-76307] - Add external link to dive/deck log on the WTA page
  • [DMAS-76309] - Add error message for invalid cruiseId for WTA page embed

Test

  • [DMAS-76052] - Create test case for new community fishers device package.
  • [DMAS-76064] - Confirm data product support for new Community Fishers Device package

Bug (ST)

  • [DMAS-76048] - Update expected value for dataproducts webservice test
  • [DMAS-76099] - Automatic cache trigger failed after editing on Device Type page in QA
  • [DMAS-76226] - deploy_onc is failing to check that the destination host has free space
  • [DMAS-76252] - Typescript Error in ChatLogIngestion related to changes made to the CruiseService
  • [DMAS-76282] - Syntax errors in install_onc
  • [DMAS-76284] - Validation of qaweb2 failed with "Incorrect garbage collector -XX:+UseG1GC"... but that's the correct garbage collector

Documentation

  • [DMAS-75230] - Update Data product discovery service external documentation
  • [DMAS-76122] - Update the seismometer data product option documentation to specify which IRIS codes will be returned
  • [DMAS-76142] - Write Test Plan for WTA page

April 20, 2023

Minor release: logging fixes (to help diagnose problems), fix for videoFileQAQC, fix for archivefiles service not returning the next chunk/page link, remove some inactive EEW subscriptions.

Tickets Released: Oceans 3.0: 23.03.002 (accessible to internal users only). Total: 5.

April 13, 2023

Minor release: support for new hybrid ferries, SeaTube fix, support Community Fishers device packages with 5 piggybacks, archivefiles API fix for unexpected empty response, fix for videoFileQAQC postprocessor, remove yellow from Plotting Utility default colour scheme.

Tickets Released: Oceans 3.0: 23.03.001 (accessible to internal users only). Total: 6.

April 5, 2023

Major release

Maintenance

New feature or improvement

  • Colour schema editor for Plotting Utility
  • New device-type page (partly complete)
  • Additional constraints for "Move File" scheduled job
  • Notify PAMGUARD users of data or forward data to user before data are erased from user directory
  • Driver start date and last reading added to Device Console page
  • Replace use of unpkg react with internal react library (sometimes unpkg goes down)
  • Leaflet Upgrade (in-progress)

Bug fixes

  • "Select All" checkbox doesn't display a tooltip for scheduled jobs
  • Newly-created task does not appear in task tree 
  • Effective dateTo of QAQC display incorrectly on sensor maintenance page
  • Citation text in data products (edge cases)
  • Authentication Keyword Typo in ONC Repository

Community Fishers

  • Fixed ERDDAP: cannot retrieve data for JDCB datasets
  • Created DAL for im_siteDeviceSubsetCastDefinition_hist table
  • Removed siteDeviceId column from erddapdataset (no longer needed)
  • Added "light map" link to map and help drop down
  • Added logging to community fishers data preview generation job
  • Centered the close "X" not on station search bar
  • Removed scroll bar from long System Status messages
  • Fix for empty cor files not setting search result state and to better handle no data cases

AID Viewer

  • Create Cypress tests for AudioPlayerWidgetConfig

Internal projects

  • Removed several deprecated & broken servlets
  • Partly clean up ArchiveFile handling to try to prevent future server-crashing queries
  • Java 17: improve sanity checks in deployment scripts, prepare QA for upgrade
  • Several deployment system and developer environment improvements

ExperiMINTED

Related Identifiers

  • Bug fix: Field drop-downs populate correctly after re-opening Add Related Identifier dialog
  • Bug fix: Ensure the Dataset Landing Page refreshes correctly when new DOI is searched for

Search History

  • Add filter for query date range
  • Improvement in search history query performance
  • Bug fix: Only the DOI active at the time of the search is displayed in the history

CIOOS

  • ERDDAP title change - EN/FR text separator changed from "/" to "|" to make it consistent for the CDE CIOOS tool

Data Policy

  • Site Device Service enhancements to support queries from updated Agreement Licence UI
  • UI in progress

Instruments

Declarative Parser Changes

  • New declarative parser type KeyValuePair parser.  Suitable for devices that return data as single key/value pair readings or lists of key/value pair readings.
  • New sensor attribute used in parsing 'ParserField'.  This is used in cases where the value returned by a device maps to a different sensor depending on deployment. For example, a device reporting a value for 'port3' may map to a laser in one deployment and a UV light in another.  The ParserField sensor attribute allows mapping the reported value to the correct sensor.
  • New feature for mapping string responses to numeric responses.  Some devices return a range of string responses that need to be mapped to numeric values for storage as a sensor value. For example a device reports one of north, north east, east, etc and it needs to be mapped to a numeric value.

Axis Camera Driver

  • Approximately 15 new commands for changing settings.  Commands are available through SeaScript and through the camera control page.  Camera control page also displays the current values of these settings.
  • Take picture and related functions now supported.  Commands are available through SeaScript and camera control page.  Available resolutions are queried from the camera and displayed in the camera web page.
  • Documentation for new seascript commands: Seascript Language Dictionary#AxisCamera (internal link)

EEW

  • Earthquake catalog will now display P-wave detections from sites even if we didn't send out any notification for the earthquake
  • OpenAPI project/page complete
  • Created job to process hydrohpone .acc files

SeaTube

  • Start working on Darwin Core export for NOAA but it is paused due to missing Extended Measurement or Fact (EMoF) file
  • Continue working on Map Layer
  • Start working on supporting more than 10 on-ship servers
  • Start working on ST PlayList management app
  • Finish adding Oceans Next deployment info in our System Console, so we can tell the remote server versions. Need further testing.  
  • Some simple UI improvements 
  • Some small bug fixes

Data Products

  • Update date created attribute in netCDF and add support for this in search automation
  • Add java-side time out system for postprocess jobs, remove MATLAB internal timeout, refactor postprocess task parameter (no more need for filepostprocessor.class parameter)
  • Make postprocess tasks cancellable
  • Bug fixes: bad apostrophe in seismometer DP

Tickets Released: Oceans 3.0: 23.03.000 (accessible to internal users only). Total: 120. Automated Testing: AT.23.03.000, total: 33.

Bug

  • [DMAS-67822] - System Status message has scroll bar
  • [DMAS-73329] - Calls to SearchStatsService caused a QA crash
  • [DMAS-74717] - update DOI version for Nanometrics Titan (S/N 001110) after batch versioning
  • [DMAS-75318] - Error: Annotation content is require, add a taxon or comment
  • [DMAS-75352] - Multiple detail rows are displayed when only one search detail exists
  • [DMAS-75355] - Make UI test pass for cloneDevice
  • [DMAS-75381] - CruiseService can produce invalid JSON
  • [DMAS-75570] - File State edit dialogue spelling mistakes: "States" and "Processes"
  • [DMAS-75628] - Close "X" not centered on station search bar
  • [DMAS-75644] - Save not behaving correctly for Select attribute on Taxonomy Attribute Management page in QA
  • [DMAS-75709] - Invalid response from citationText service where it was valid before
  • [DMAS-75724] - Empty Cor files do not set search result state to no data
  • [DMAS-75731] - Attempting to Run Deprecated Or User Defined Tasks Is Not Aborted With Errors
  • [DMAS-75759] - auth.properties is overwritten by the production build, but not QA
  • [DMAS-75761] - Gradle warns about implicit dependencies between some (more) tasks
  • [DMAS-75765] - Erddap cannot retrieve data for JDCB datasets
  • [DMAS-75791] - Applied QAQC dateTo is now on Sensor Maintenance page
  • [DMAS-75794] - Renovate is failing to update package-lock.json
  • [DMAS-75823] - Weird values are appearing to DMAS derived sensors post Reprocessing when sensor exists in Raw Data Stream & parser
  • [DMAS-75834] - Landing Page is blank in QA and Prod
  • [DMAS-75836] - Capture Time input is locked to the video if video is removed from a layout that includes it
  • [DMAS-75852] - Add Related Identifier Dialog dropdown not working after being closed
  • [DMAS-75871] - Dataviewer widget fails to render after attempting to open config/toolbox
  • [DMAS-75874] - Selecting a new DOI or Query PID doesn't change parts of the Dataset Landing Page
  • [DMAS-75917] - Expedition Video Preprocessor job (id=438) complete with error
  • [DMAS-75924] - Color column in "Plot Properties" does not change color for the plot on Plotting Utility page
  • [DMAS-75930] - Choosing the google layer in Seatube V3 causes a crash due to an invalid key
  • [DMAS-75933] - DMAS Search Failed Notification: 27-Mar-2023 05:30:17 UTC, Barkley Canyon-Barkley Upper Slope, Seismometer Data, SearchHdrId 14163126, UserId 15356
  • [DMAS-75946] - file cleanup job failed to remove files in qa and prod
  • [DMAS-75977] - User's colour scheme is not used when the plot is regenerated on Plotting Utility page
  • [DMAS-75983] - Newly created related identifiers are not saved in QA
  • [DMAS-76015] - Fix failed JUnit test in AxisCameraParserTest
  • [DMAS-76016] - QA DMAS Search Failed Notification: 27-Apr-2018 18:38:18 UTC, Cambridge Bay-Underwater Network, Ice Profiler, SearchHdrId 2733391, UserId 21837
  • [DMAS-76019] - Choosing the google maps layer in the Community Fishers Map causes a crash due to invalid key
  • [DMAS-76023] - Error while downloading xml metadata file in historical casts view
  • [DMAS-76033] - Cast data correction job is resulting in errors.
  • [DMAS-76036] - Earthquake catalog job doesnt always find new nrcan usgs detections
  • [DMAS-76038] - Java AD file retrieval searches return incorrect results

User Story

  • [DMAS-74441] - As a Device Console user I would like to see last-reading and driver start date even if the device status shows disconnected
  • [DMAS-74774] - As a Plotting Utility user, I want to customize the line colours in my plots
  • [DMAS-75788] - As ST user, I would like to have better indication to tell if a playlist download is failed

Task

  • [DMAS-73814] - Create separate material UI themes for Oceans 2 and Oceans 3 colours
  • [DMAS-74639] - Investigate November 26th earthquake
  • [DMAS-74734] - Add logging to community fishers data preview generation job
  • [DMAS-74863] - Remove deprecated pages from DMAS
  • [DMAS-75251] - Replace Autocomplete.test.jsx enzyme tests
  • [DMAS-75254] - Replace ExpandableContainer.test enzyme tests
  • [DMAS-75442] - Add date_created global attribute to all netCDF data products
  • [DMAS-75458] - Notify PAMGUARD users of data or forward data to user before data are erased from FTP
  • [DMAS-75481] - As a data steward, I would like add additional constraints to the Move Files Job
  • [DMAS-75502] - Clarify for the user "Active" check boxes, Cruise Management - backend
  • [DMAS-75525] - Update colour scheme on website icon to new ONC blue
  • [DMAS-75578] - Demo Deck Log app to DMAS developers and have some workshop to introduce some features in detail
  • [DMAS-75620] - Update non-DOI/non-minted citation text to include owner role organizations in CSV/JSON data products
  • [DMAS-75635] - Display sites that detected a pwave on the earthquake catalog for missed detections
  • [DMAS-75652] - Create cypress tests for AudioPlayerWidgetConfig
  • [DMAS-75726] - Allow developers to prune Docker images on docker nodes without needing to SSH to Jenkins
  • [DMAS-75769] - Add a configurable time-out optionally available for all matlab post-processors
  • [DMAS-75770] - Implement cancellation for all matlab postprocess tasks
  • [DMAS-75787] - Please change the ST playlist download error report email/jira to more ST related template
  • [DMAS-75793] - Remove 'matlab.output.args.count" task parameter from taskdefinition and from any documentation
  • [DMAS-75884] - Clarify for the user "Active" check boxes, Dive Management - front end
  • [DMAS-75904] - Change Geospatial Map help & light map links to open in new tabs
  • [DMAS-75968] - Remove siteDeviceId column from erddapdataset
  • [DMAS-75982] - Change / to | in ERDDAP titles

Design

  • [DMAS-75126] - Frontend design for DOI relationships
  • [DMAS-75866] - Class design for cancellable post process tasks

Implementation

  • [DMAS-47171] - SearchMap appears to be an inactive servlet
  • [DMAS-69372] - Implement take picture function in axis camera
  • [DMAS-73859] - Generate unit test/cypress combined report
  • [DMAS-74057] - update colour management in PU plots
  • [DMAS-74459] - Implement service to search for and limit site devices with various parameters
  • [DMAS-74909] - Convert ConfigurationContent to Functional Component
  • [DMAS-74910] - Convert ResourceConfiguration to Functional Component
  • [DMAS-75404] - Create trx table for erddapdataset
  • [DMAS-75414] - Implement Backend changes for DeviceType page
  • [DMAS-75425] - Database Script to Add Preset Colour Schemes
  • [DMAS-75589] - Add filter button that opens empty dialog to search history
  • [DMAS-75621] - Clean up ArchiveFileManager.getByDevice
  • [DMAS-75667] - Implement design for adding link to geospatial map light page
  • [DMAS-75684] - Add filtering to search history DAO (back end)
  • [DMAS-75742] - Create scheduled job to process hydrohpone acc files
  • [DMAS-75767] - New Sensor Attribute 'ParserField'
  • [DMAS-75771] - Remove matlab zombie stopper time-out code once java-side time-outs are ready
  • [DMAS-75792] - Include the JDK version in the deployment message
  • [DMAS-75795] - Check if the JVM is running before installing new code
  • [DMAS-75798] - Create the RelatedIdentifier database table
  • [DMAS-75799] - Implement RelatedIdentifier persistence code
  • [DMAS-75802] - Add parameter for job timeout to video qaqc jobs
  • [DMAS-75806] - Get rid of filter box
  • [DMAS-75808] - API token field is redundant
  • [DMAS-75810] - Data product Request template is currently incomplete
  • [DMAS-75811] - Some minor changes to layout for main page
  • [DMAS-75814] - Add service logic for empty returns
  • [DMAS-75817] - Implement timeout for matlab commands
  • [DMAS-75825] - Change anonymous user to use default colour scheme
  • [DMAS-75827] - Add description of how to use colour schemes to the help section
  • [DMAS-75828] - Set the valid versions of node to be used by Oceans Next
  • [DMAS-75840] - Modify declarative parser to support key-value pair readings
  • [DMAS-75865] - implement the code
  • [DMAS-75872] - Implement cancellation for MatlabFilePostProcessor
  • [DMAS-75876] - Dont send devices from NRCan sites to Shake Alert
  • [DMAS-75877] - Declarative parser - mapping string responses to values
  • [DMAS-75888] - Setup DOILandingPage to refresh when related identifier changes
  • [DMAS-75891] - Speed up SQL calls in search history service (doidatasetservice operation 3) call
  • [DMAS-75894] - SQL to update taskTypeClass of file post process jobs
  • [DMAS-75896] - Update web services api link on landing page to point to the open api page instead of the wiki page
  • [DMAS-75978] - Oceans Next deployment announcements should say whether it was deployed to Java 8 or 17

Test

  • [DMAS-75830] - Create regression test for matlab command timeout feature
  • [DMAS-75860] - Write Test Plan for Map Layer Management
  • [DMAS-75957] - Write regression test for Matlab File Post Processor cancellation and update documentation

Bug (ST)

  • [DMAS-75796] - Task machines fail to connect to matlab in Java 17
  • [DMAS-75857] - QA2 task machines aren't starting up properly with Java 17
  • [DMAS-75911] - Audio player widget fails with a service error when retrieving audio files
  • [DMAS-75955] - Failed to get ArchiveFile by locationCode
  • [DMAS-75974] - Jenkins isn't cleaning up docker images on schedule
  • [DMAS-75979] - Deployments should recognize that the framework has started when it reaches level 6+
  • [DMAS-76008] - Fix font on OpenAPI overview page

Investigation

  • [DMAS-75889] - List the libraries included in Equinox along with their status

Documentation

  • [DMAS-75898] - Write a test plan for testing across multiple windows

March 31, 2023

Minor release: online fix for SeaTube seekbar (no downtime)

Tickets Released: Oceans 3.0: 23.02.003 (accessible to internal users only). Total: 1.

March 21, 2023

Minor release: SeaTube export fix, logging fix, cql raw data fix, new seascript commands for Axis cameras

Tickets Released: Oceans 3.0: 23.02.002 (accessible to internal users only). Total: 4.

March 13, 2023

Minor release: ERRDAP driver fix, MATLAB stuck dead task fix, Axis camera seascript support

Tickets Released: Oceans 3.0: 23.02.001 (accessible to internal users only). Total: 3.

March 9, 2023

Major release

Maintenance

New features or improvements
  • Automated geofencing QAQC test (second version based on feedback)
  • GoogleMap page is removed from O3 menu
  • Add devicetype information and filter to DeviceListing page
  • UI message when incorrect deviceid is entered in search field on Device Listing page
  • Lots of new Selenium tests (e.g., new devicelisting page, ParserDefinition tab of Device Detail page, Data Monitoring tab of Device Console page)
  • Create scheduled job for processing archiver cql error files - job wont run automatically until more testing is done
Bug fixes
  • Citation info edge case in data products
  • Label display issue on Junction Box view tab of Device Console page
  • Data availability issue in step 2 of data search page for one edge case
  • Fix bugs in Selenium scripts

Internal projects

External-facing
  • Java upgrade: QA/production environment (formerly named "Gemini", now "Equinox") has been rebuilt & upgraded (Equinox 3.18.200, Tomcat 6.0.69, other dependencies at latest versions)
  • Java upgrade: framework startup errors & Tomcat errors (maybe?) will be properly formatted and logged in dmas.log
  • Improvement: File Management default date range changed to reduce its risk of crashing the JVM
  • Bugfix: allow taxonomies/taxons with taxonomy matrix attributes and taxon references to be deleted from the UI
  • Feature: support heap space monitoring on machines other than the web server
Internal only
  • Java upgrade: support integration testing in Java 8 or Java 17
  • Improvement: Refactoring of group membership-checking code to simplify use and fix dependency issues
  • Bugfix: support integration testing on feature branches of Oceans 3
  • Improvement: Make Oceans Next deployments more resilient to webpack upgrades
  • Improvement: Automate cleanup of unimportant (but large) files from archived CI builds
  • Improvement: Deployment scripts will watch for errors logged with serious but rarely-used log levels FATAL, SEVERE, AUDIT during system startup
  • Improvement: Support "shotgun-style" code reviews in Bitbucket (assign n >= 2 reviewers; allow merge after any 2 approvals) with overrides to force full approval of large or critical changes
  • Bugfix: various UI tests
  • Improvement: clean up UI test page object initialization
  • Bugfix: don't force so much re-review on Renovate dependency upgrades
  • Improvement: validate Jenkins pipelines in branch CI

Community Fishers

  • Create service to generate processing comment for cast dataproducts in Java
  • Drop ErddapSensorAttribute table (for CIOOS)
  • Remove siteDeviceId column from erddapdataset and erddapdataset_hist trigger (for CIOOS)
  • Remove dependency on Matlab Engine API for Java
  • Change output of Matlab logs from UDP port to processes output stream
  • Order of casts in lasso selection tool now newest to oldest

Acoustic Instruments Data Viewer

  • Convert existing code for Spectrogram widget to utilize Typescript, React hooks & Cypress testing
  • Convert existing code for Audio Player widget to utilize Typescript

SeaTube

  • Finished the Deck Log phase one implementation and gave the demo to users (mostly via previous minor release)
  • End-to-end tests for supporting embedded time code in our video stream
  • ST web services improvement to support both new Deck Log app and WTA at same time 
  • ST Playlist Improvement due to the resolution flags are changed to null for fixed location video files
  • Manual test ST for support React 17 upgrade 
  • NOAA on ship servers synchronization tests 
  • Other small improvements
  • Some minor bug fixes

Earthquake Early Warning

  • Support sending IRIS meta for our sites when sending live data to ShakeAlert
  • Add site map to the earthquake catalog page
  • Fix some bugs with the scheduled jobs populating the earthquake catalog page

OpenAPI

ExperiMINTED

  • Add a relation identifier to a DOI
  • Search History page tweaks:
    • get the latest 100 searches, not just those after 2022-12-10
    • columns are sortable
    • improved column sizing

Data Policy

  • New tables and DAL layer for agreement / site device association

Data Products

  • MATLAB upgrade to R2022b, includes logging system upgrade (log levels and better error handling), matlab-as-a-service custom API that decouples MATLAB version dependency on Java dependency
  • DOI citations added for netCDF products
  • Documentation, internal improvements: warning & logging content, unit tests for append_pdfs, netCDF comparator update
  • Bug fixes: CODAR slowness, citation fixes

Instruments

  • Quarantine at Archiver: Archiver will now quarantine devices as soon as they are quarantined. Previously the quarantine would only take effect on the archiver after if had processed the backlog.
  • Download raw file from AD in BPR Import Job
  • UV Light support in Axis camera driver with seascript commands

Tickets Released: Oceans 3.0: 23.02.000 (accessible to internal users only). Total: 167. Automated Testing: AT.23.02.000, total: 40.

Bug

  • [DMAS-48271] - Data availability bar in step 2 of data search shows "No Data Available" when we have archive file in database
  • [DMAS-64371] - A method to get English vernaculars may not only be getting English vernaculars
  • [DMAS-64616] - Misleading snackbar message for invalid annotation entries
  • [DMAS-73256] - Comment box contains empty space when button is selected
  • [DMAS-73363] - Chat Log Widget search button does not have a tooltip
  • [DMAS-73609] - Unable to update deviceattributeIds where only devicetypeattributeid exists
  • [DMAS-74638] - Archiver should also respect the Quarantine state of a device
  • [DMAS-75098] - ConnectedDevice labels sporadically disappear from DC JunctionBox tab
  • [DMAS-75156] - Task Management "Select All" checkbox doesn't display a tooltip for scheduled jobs
  • [DMAS-75168] - ManualEntryForm cypress tests failing
  • [DMAS-75171] - TabbedButtonSetSelector cypress tests failing
  • [DMAS-75237] - can't play my playlists
  • [DMAS-75333] - Monthly CODAR preview searches are slow and throwing lots of warnings
  • [DMAS-75347] - Lots of warnings for channelCentreFrequecyOverride device attribute not found
  • [DMAS-75349] - Widgets that are only allowed to have a single instance of the widget on a Dashboard can be added in secondary screens
  • [DMAS-75370] - Cannot Add Attribution to an Agreement Data Product
  • [DMAS-75372] - Integration Testing fails to checkout feature branches of Oceans 3
  • [DMAS-75386] - Storybook builds fail with a TypeError "The "id" argument must be of type string. Received an instance of Object"
  • [DMAS-75389] - Pages with REST style url's don't load properly in the Ocean's Next dev server
  • [DMAS-75399] - Resource validation needs to be improved in Manual Entry
  • [DMAS-75400] - Highlight color of annotation table not displaying correctly in Oceans 3
  • [DMAS-75402] - Quick Save on button sets allow annotations outside of the expedition's date range and with a Dive resource type
  • [DMAS-75407] - Oceans next pages are not loading in Oceans 3
  • [DMAS-75417] - Gradle warns about implicit dependencies between some tasks
  • [DMAS-75418] - Storybook builds fail with a TypeError "TypeError: The 'compilation' argument must be an instance of Compilation"
  • [DMAS-75421] - Date Pickers crash the page when the user attempts to open them in oceans next
  • [DMAS-75428] - Deck Log page warns of unsaved changes when closing/reloading in Firefox
  • [DMAS-75430] - Deck Log keyboard entry submission occurs for all open keyboard entries
  • [DMAS-75432] - Automatic merges from release -> main are failing in Oceans Next
  • [DMAS-75443] - Icons from Oceans Next are missing when it's running as an OSGi bundle
  • [DMAS-75445] - Oceans Next storybook build is failing
  • [DMAS-75446] - Deleting a taxonomy & all its taxons sometimes fails to remove all metadata linked by foreign keys
  • [DMAS-75464] - Storybook build fails due to SSL errors
  • [DMAS-75472] - Incorrect Deployments being used for citations with no DOI
  • [DMAS-75480] - Fix assemblers causing cache load errors (OrganizationResourceRole and OrganizationAgreement)
  • [DMAS-75487] - Correct merge conflicts between release and main
  • [DMAS-75489] - Choosing a Command in the System Console Causes the Page To Go Blank in QA with main branch
  • [DMAS-75493] - sensor tab of device detail page is broken in QA
  • [DMAS-75494] - Alert message "No form sections could be found using the provided" pops up when displaying forms on some pages in QA
  • [DMAS-75501] - QA & Prod builds have a slow load time
  • [DMAS-75508] - Authentication Keyword Typo in ONC Repository
  • [DMAS-75510] - Dive log annotations cannot be saved after react 17 upgrade
  • [DMAS-75532] - Quarantine or Unquarantine device does not work in QA
  • [DMAS-75534] - CSV/JSON search failures in QA for "getAuthor"
  • [DMAS-75543] - The SeaTubeConfiguration page has strange "No Taxonomy (Expedition)" inheritance behaviour
  • [DMAS-75566] - ONC Light driver logs warning on start.
  • [DMAS-75574] - Device Dropdown (DeviceActionMaintenance) doesn't populate
  • [DMAS-75588] - Publication date in citation text is inaccurate
  • [DMAS-75615] - Captured time is incorrect (which is local time), but after saving the annotation, the timestamp in the annotation table is correct (which is UTC time).
  • [DMAS-75637] - Take Snapshots not working in SeaTube on QA
  • [DMAS-75642] - Recording Video not working in SeaTube on QA
  • [DMAS-75645] - Device Listing page is blank in QA
  • [DMAS-75662] - Deck Log crashes when annotation edited in a specific order
  • [DMAS-75665] - Search failure in QA automation for createCitationInfo
  • [DMAS-75666] - Newly-Created Task Does Not Appear in Task Tree Until it has a Record in the TaskSchedule Database Table
  • [DMAS-75682] - Deployments to qadivelogger3.onc.uvic.ca are failing to install bundles
  • [DMAS-75683] - Baynes Sound Serial Expander Can - Number Format Error
  • [DMAS-75687] - Fix incorrect timerangevalue in File Management
  • [DMAS-75695] - Pagination Broken On AnnotationsSearchV2 table
  • [DMAS-75698] - SiteDeviceSubsetMaintenance page fails to render in QA
  • [DMAS-75704] - Scheduling post-process-arctic-buoys-parser-job (Job Id: 114) is Aborted with Errors in QA, but works in prod
  • [DMAS-75710] - Search failure in QA automation for TS netCDF incorrect number of arguments
  • [DMAS-75716] - The function crypto.randomUUID isn't available on divelogger machines
  • [DMAS-75718] - QAQC page is empty in QA
  • [DMAS-75719] - Cast popup closes when attempting to view historical casts on Community Fishers Map
  • [DMAS-75722] - Cannot Add Resource Role on Device Detail Page
  • [DMAS-75732] - QAQC and other 4 react pages form is empty in QA

User Story

  • [DMAS-67558] - As a scientific programmer, investigate and refactor to support latest version of MATLAB (R2022b)
  • [DMAS-73748] - As a software developer I would like creation of overlapping casts to be blocked at the database level
  • [DMAS-74165] - As a Data Specialist, I would like modification to automated geofencing QAQC test
  • [DMAS-74212] - As a software developer I would like to support Matlab version R2022a/b with matlab-as-a-service
  • [DMAS-74848] - As a software developer, I want to remove obsolete and deprecated code from GroupPrivilegeManager and DmasUserManager so I can streamline development
  • [DMAS-75274] - As a data steward, I would like the devicetypeid and devicetypename exposed in DeviceListing and update the page

Task

  • [DMAS-39311] - Disable Equinox logging in /usr/local/gemini/logs
  • [DMAS-73719] - Upgrade oceans next to React 17
  • [DMAS-73847] - ST - rename "Advanced" button (takes you from annotation filter to search)
  • [DMAS-74689] - Order of casts in lasso selection tool not consecutive
  • [DMAS-74690] - Change the default date range in File Management
  • [DMAS-75150] - Convert existing code for Spectrogram widget to utilize Typescript, react hooks & cypress testing
  • [DMAS-75169] - provide a demo to Data Stewards on the functionality and confirm tool meets their needs
  • [DMAS-75284] - Create Scheduled Job For processing cassandra cql error files
  • [DMAS-75297] - Don't log redirects to the login page
  • [DMAS-75310] - as a Data Steward, I need the job 229-bpr-import to be modified for it to work
  • [DMAS-75314] - Convert existing code for Audio Player widget to utilize Typescript
  • [DMAS-75348] - update qa post refresh script with sql for eew mtc test site
  • [DMAS-75357] - Add message when incorrect id entered for device id for /DeviceListing
  • [DMAS-75382] - Create unit test for append_pdfs
  • [DMAS-75384] - Refactor DatasetManager keyword code for simplification and cleanliness
  • [DMAS-75398] - Provide a list of devices connected to the ship to the Deck Log so the resource list can be populated in Manual Entry
  • [DMAS-75405] - Upgrade cypress and related tools
  • [DMAS-75416] - See if possibly extraneous method in DeviceSensorSearchTreeUtilI can be removed
  • [DMAS-75423] - Update/replace attribution fields in netCDF products with citations
  • [DMAS-75449] - Support Wiring the Abyss page in ONC web site with the new Deck Log app
  • [DMAS-75451] - Update SearchHistoryTable to allow sorting on certain columns
  • [DMAS-75454] - Add source column to SearchHistoryTable
  • [DMAS-75457] - adding station map to all events in Earthquake Catalogue
  • [DMAS-75462] - Make some code and design changes to SearchHistoryTable
  • [DMAS-75469] - GoogleMap function not working
  • [DMAS-75470] - Display the ship's positional data on the deck log page
  • [DMAS-75506] - Improvements to the Earthquake catalog job
  • [DMAS-75518] - Change the quick entry widget's keyboard entry toggle key
  • [DMAS-75560] - Update eventdefinition hist table to track changes to the device selector json column
  • [DMAS-75569] - Update Jenkins cleanup scripts
  • [DMAS-75576] - Update link for Thomson De-tided data product option
  • [DMAS-75593] - Add heap space monitoring to production task machines
  • [DMAS-75624] - Abort `deploy_onc deploy --watch` if a FATAL message is logged
  • [DMAS-75630] - Validate Jenkinsfile syntax in feature branch CI builds
  • [DMAS-75641] - remove date range limit on doiDataset search query
  • [DMAS-75643] - Remove Record button for playlists
  • [DMAS-75656] - Make the Search History table header bold
  • [DMAS-75657] - Add a loading bar that shows when searches are loading
  • [DMAS-75658] - Update non-DOI/non-minted citation text to exclude ONC when having roles of custodian, distributor, publisher (DP code)
  • [DMAS-75711] - Error Logs about pnsn data without an iris mapping should be warning logs
  • [DMAS-75725] - Lots of null pointer exceptions on qaextshore1
  • [DMAS-75727] - Handle citationText response in case of no data product mapping (DP code)

Requirement

  • [DMAS-75427] - Requirements for System to Maintain Colour Schemes

Design

  • [DMAS-75409] - Design for System to Maintain Colour Schemes

Implementation

  • [DMAS-73803] - Add EXCLUDE Clause to SiteDeviceSubset table so overlapping SiteDeviceSubsets Cannot be created
  • [DMAS-74150] - Rebuild Oceans 3's runtime environment ("Gemini")
  • [DMAS-74151] - Add an option to deploy_onc to select the version of Java to use for build and deployment
  • [DMAS-74457] - Create database tables for Organization Agreement Resources
  • [DMAS-74458] - Create DAL layer for OrganizationAgreementResource
  • [DMAS-74681] - Move organization agreement code out of onc-core
  • [DMAS-74907] - Convert SeaTubeConfigurationPage to Functional Component
  • [DMAS-74994] - Add devicetypeid and devicetypename exposed in DeviceListing and update the page
  • [DMAS-75012] - Disentangle UM and CU persistence bundles
  • [DMAS-75094] - Remove siteDeviceId column from erddapdataset and erddapdataset_hist trigger
  • [DMAS-75187] - Prefer DmasUser over user IDs where possible in DmasGroupManager
  • [DMAS-75189] - script to create two new table for geofencing qaqc
  • [DMAS-75212] - Create service to generate processing comment for cast dataproducts in Java
  • [DMAS-75263] - Drop ErddapSensorAttribute table
  • [DMAS-75299] - Conditionally install bundles in Equinox instead of manually excluding some bundles
  • [DMAS-75326] - create scheduled job to store iris meta data in our database
  • [DMAS-75327] - Update PNSNMessage to include iris meta data
  • [DMAS-75334] - Change agreement management code back to assemble with beans
  • [DMAS-75335] - Fix managers in agreement management to use domain objects
  • [DMAS-75339] - Clean up temp files created by unit tests
  • [DMAS-75363] - Clean up wowza-date-time-generator README and Javadocs
  • [DMAS-75367] - Rename the production runtime to Equinox
  • [DMAS-75396] - Update deployment with new script names
  • [DMAS-75431] - Don't require passing an observatory ID to GroupPrivilegeManager when it can be derived
  • [DMAS-75477] - Modify DOIDataset Service Update Operation to allow updating of Related Identifiers
  • [DMAS-75482] - Remove dependency on Matlab Engine API for Java
  • [DMAS-75503] - File archiver task should always reject zero sized files
  • [DMAS-75516] - Change output of Matlab logs from UDP port to processes output stream
  • [DMAS-75520] - Clean up documentation links on OpenAPI page
  • [DMAS-75533] - Update DeviceService.js in oceans-next to Typescript
  • [DMAS-75540] - backend code to implement geofencing qaqc
  • [DMAS-75558] - Implement ability to store SiteDeviceSubsetDatasets in ISO19115datasetrecord
  • [DMAS-75561] - Support deploying Oceans Next to Equinox
  • [DMAS-75562] - Deploy Oceans Next to Equinox in integration tests when built with Java 17
  • [DMAS-75594] - Support a custom delay after taking a heap dump
  • [DMAS-75626] - ONC Implementation for incorrect deviceID warning
  • [DMAS-75627] - Oceans next implementation for invalid deviceid warning
  • [DMAS-75632] - Fix automatic merge failure from release to main
  • [DMAS-75633] - Validate Jenkinsfile syntax in Oceans Next
  • [DMAS-75654] - Add link to api documentation on open api main page

Test

  • [DMAS-69931] - Test ST annotation in live mode
  • [DMAS-69933] - Test the archived video files have the correct timestamp in the file name
  • [DMAS-74655] - Test matlab-as-a-service with R2022a in QA/QA2 and time spent making/commenting on systems tickets
  • [DMAS-75345] - Test R2022a data product in QA search automation

Bug (ST)

  • [DMAS-75279] - False positive comparison failures for netCDF files in search automation for R2022a/b
  • [DMAS-75513] - Fix deviceType bug
  • [DMAS-75625] - qaweb2 is logging errors while checking group membership
  • [DMAS-75699] - Double log of "Acquiring MatlabExecutionEngine for this job run" from MatlabFilePostProcessor
  • [DMAS-75750] - java_home is set to an invalid directory on ncdeploy

Documentation

  • [DMAS-75447] - Update documentation for netCDF citation updates

March 2, 2023

Minor release: bug fixes for citation text (searching for date range on archived files causes crashes, fixes for incorrect deployments and missing attributions), annotations, video and hydrophone post-processors

Tickets Released: Oceans 3.0: 23.01.003 (accessible to internal users only). Total: 8.

Bug

  • [DMAS-75472] - Incorrect Deployments being used for citations with no DOI
  • [DMAS-75597] - tskgpu1 throwing 400+ heap space errors overnight
  • [DMAS-75600] - Manual Entry widget allows the user to save annotations outside the time range of the expedition
  • [DMAS-75618] - Annotations created on datacentres with certain locations have the wrong ID
  • [DMAS-75631] - Error in hydrophone post-processor: too small file handling broken by new audio conversion option

Task

  • [DMAS-75619] - Update non-DOI/non-minted citation text to include all attributing organizations (DP code)

Implementation

  • [DMAS-75548] - Stop both Equinox and Gemini during a deployment

Bug (ST)

  • [DMAS-75629] - Skip small / corrupt files in videoFileQAQC and send warning email

February 21, 2023

Minor release: deploy Deck Log features

Tickets Released: Oceans 3.0: 23.01.002 (accessible to internal users only). Total: 5.

Implementation

  • [DMAS-75466] - Back end changes to support both the Wiring the Abyss page and new Deck Log app
  • [DMAS-75475] - Adjust the way the Deck Log is accessed through Expedition Management
  • [DMAS-75478] - Add column to cruise table for Deck Log Code
  • [DMAS-75486] - Update Expedition Maintenance page to include Deck Log Code field
  • [DMAS-75488] - Update the expedition/tree web service to return "Deck Log" nodes with Cruises that are SeaTube Ready

February 16, 2023

Minor release: raw file generation issue (not really a bug)

Tickets Released: Oceans 3.0: 23.01.001 (accessible to internal users only). Total: 1.

February 15, 2023

Major release

Maintenance

New Features or Improvements
  • Rebuild DeviceListing page with React
  • Remove limit of memo field on Device Detail page
  • Update Citation in csv data product header to include dataset DOIs
  • Add one data product icon on Data Search page
  • Improve search tree loading time (improve generation time, and payload size), affects most search trees
  • Improve user search on User Management page
  • Deprecation functionality for Task Management
  • Automated geofencing QAQC test
  • Create trx tables for qaqc related database tables
  • Update RdiAdcpComplexParser to ignore invalid data like Negative ArraySize
  • Fixed topology extension cache so extension Ids should always show up on the topology page (also fixes duplicate extensionIds getting saved)
  • Calibration formulas now support $null for example: if($77062upto21800m=1,$73462,$null)
  • Selenium and Cypress tests added/updated
Bug Fixes
  • Camera video archived with filesource=null
  • TopologyCache
  • Min/max qaqc flags for data gaps in csv data product
  • Generic File Post Processing job

SeaTube

  • Major features released for Deck Log application
  • Continue work on Map Layer and WORMS update
  • Annotation ingestion for Cordell Bank
  • One bug investigation (missing file resolution flag for some videos)

Data Products

  • Changes to support an upcoming MATLAB version update: backend java changes, videoQAQC job can now run in current MATLAB version with added error handling
  • Citation structures and information updated in file products with new DOI Citation strings as documented here: https://wiki.oceannetworks.ca/display/DP/Data+Citations
  • QAQC structure added to time series MAT files containing information and flags for all tests applied to the data
  • Added a new option to disable (by default) on-the-fly generation of audio formats, this reduces the likelihood of users filling the working space and running slow searches
  • Minor updates for a plotting and PDF printing edge cases

Community Fishers

  • Corrected Task Management tree miss-alignment
  • Corrected blue icons to green for unassigned casts after lassoing and then clearing selection
  • Corrected odd messaging about FTP transfer in the DataProductDelivery API
  • Fixed failing UI test in Plotting Utility

Acoustic Instruments Data Viewer

  • Convert existing code for Spectrogram widget to utilize Typescript, React hooks & Cypress testing

Internal projects

  • Preparing to run in Java 17 in QA
  • Update default git branch name ("main" replaces "master")

CIOOS

  • Data model restructuring for ERDDAP
  • OBIS Export - fixed issues with event.csv, occurrence.csv and meta.xml content
  • CKAN
    • fixed issue with duplicate EOVs
    • support comma separate list of site device ids in CKAN metadata upload job

ExperiMINTED

  • Added Search History (PID navigator) prototype page which shows last 100 searches made by a user after 2022-12-10
  • Instrument search - fix issue with search path not showing in search cart

Earthquake Early Warning

  • Fix MMI contours on the earthquake detail page, used to be 50% larger than they should be and then as of last month are 100% larger than they should be
  • Move eewclient and cacheloader queues over to the new jms framework that was created as part of the multiqueue project
  • Earthquake catalog page now has all earthquakes with magnitude over 3.0 (in area and time of interest)

OpenAPI

  • The openAPI page can now be accessed through the url /api in addition to /OpenAPI
  • The openAPI page now has a loading indicator while a request is being processed
  • Filter relevent data product options on https://qa.oceannetworks.ca/OpenAPI#get-/dataProductDelivery-request
  • Add data product options to the response of the data product discovery public API

Instruments

  • Multi queue performance improvement
  • Seascrsipt support for idleDriver and activateDriver
  • ONC Lights driver enhancement

Tickets Released: Oceans 3.0: 23.01.000 (accessible to internal users only). Total: 171. Automated Testing: AT.23.01.000, total: 37.

Bug

  • [DMAS-73981] - As a data steward, I would like some bugs fixed for the occurrence.csv for OBIS
  • [DMAS-74012] - As a data steward, I would like some bugs fixed for the meta.xml for OBIS
  • [DMAS-74691] - Icons for unassigned casts render blue after lassoing and then clearing selection
  • [DMAS-74886] - Data gaps not marked with correct min/max QAQC flags in CSV minmax avg test cases
  • [DMAS-74948] - Running a dataproduct search that produces collated PDFs twice locally results in duplicate PDFs being collated into one file
  • [DMAS-74953] - csv data product doesnt handle data ratings of 0 correctly
  • [DMAS-74981] - Control icons are missing from the simulator console
  • [DMAS-74982] - Video widget refresh crashes dashboard
  • [DMAS-74987] - Junction box alarm settings page is looking for a missing file processing.gif
  • [DMAS-75070] - Data Search plots (png, pdf) missing data for "Depth" sensor when PU shows data. (work related to Navigation data commissioning work in DATA-4562)
  • [DMAS-75100] - OSGi tests intermittently time out in Jenkins
  • [DMAS-75137] - Verification of RemoteCacheReloadServiceActivatorImpl failed on multiple shorestations
  • [DMAS-75141] - Task Management tree is miss-aligned
  • [DMAS-75178] - EEW Correlator at eduCloud logging issues with EEWClientActivator
  • [DMAS-75179] - Gap filling in CSV/JSON no longer respects the sample rate, fills at 1 sec intervals
  • [DMAS-75186] - Topology ExtID field is buggy - concatenating things that it shouldn't
  • [DMAS-75193] - Oceans 3.0 gradle builds intermittently fail with an OutOfMemoryError
  • [DMAS-75214] - Decklog AnnotationTable Reset Button Bug
  • [DMAS-75227] - Fix MapLayer ServiceActivationTest
  • [DMAS-75243] - Deck Log title is not correct, is only displaying "Screen X of Y"
  • [DMAS-75244] - Cross-window communication is broken in the Deck Log
  • [DMAS-75255] - Fixed camera video is archiving with filesource=NULL on a regular basis
  • [DMAS-75258] - Deck Log link from Expedition Management not working in webpack
  • [DMAS-75260] - ColumnChooser menu in StatelessTable appears detatched from the table an only opens in the top right corner of Deck Log
  • [DMAS-75267] - Oceans 3 CI builds sometimes fail with "The message received from the daemon indicates that the daemon has disappeared."
  • [DMAS-75283] - Instrument search drops path info in cart (was: Instrument search Java CSV data product truncates its DateTo and drops path info in the search cart)
  • [DMAS-75287] - Couldn't create a new or update an existing annotation for deck log in QA
  • [DMAS-75288] - The browser tab is closing when reloading the deck log page
  • [DMAS-75290] - Validation is missing for many cases in the Deck Log's Annotation Entry form
  • [DMAS-75298] - Attribute value fields in Annotation Entry display incorrectly sometimes
  • [DMAS-75301] - Add Deck Log page logo same as other pages
  • [DMAS-75309] - Deck log annotation entry's date validation is incorrect
  • [DMAS-75312] - Data Search logs an error about a missing image
  • [DMAS-75316] - video file QAQC no longer detects corrupt video file
  • [DMAS-75337] - Jenkins Java build agent is out of /tmp space
  • [DMAS-75366] - Fix error in matlab codarnetcdfpostprocess
  • [DMAS-75369] - Fix dataset manager to ensure taxons are actually distinct
  • [DMAS-75371] - Autocomplete is not compatible with Data source selector
  • [DMAS-75374] - Dates are shown in Pacific time instead of UTC, also dateFrom is displayed for dateTo
  • [DMAS-75375] - Device Control buttons have flipped gradients
  • [DMAS-75390] - ErddapManagementTable does not display siteDeviceId or deviceId when accessed via deeplink
  • [DMAS-75397] - NullPointerException for sensor when reload cache in dev and qa
  • [DMAS-75434] - Insertion into parserdefinition Table does not trigger an Insert Operation in the parserdefinition_trx Table
  • [DMAS-75439] - Error On JunctionboxBreakerService in QA
  • [DMAS-75459] - Oceans Next deployment failed on release/23.01.000

User Story

  • [DMAS-57229] - As a software developer, I'd like the /DeviceListing page updated to React
  • [DMAS-69901] - As a software developer, I want to rename the default git branch from "master" to "main" for consistency with git hosting tools
  • [DMAS-74664] - As a dev, I would like to update DataPreviewManagement Cypress code to fit newer testing-library form
  • [DMAS-74858] - As a dev, I would like to create a method for deprecating jobs that is visible through the UI

Task

  • [DMAS-64430] - As a dev, I would like to improve Data Search loading time and reduce it's data overhead
  • [DMAS-73999] - create a data search icon for the .apt files
  • [DMAS-74143] - Improvements for user management user search
  • [DMAS-74440] - Citation line text in CSV data product header replaced with $citation.citation
  • [DMAS-74465] - Odd messaging about FTP transfer in the DataProductDelivery API
  • [DMAS-74609] - Create new manual entry form component
  • [DMAS-74852] - There are duplicate EOVs/ECVs listed in CKAN records when multiple sensors are mapped to the same keyword, we want only distinct EOVs/ECVs added to the landing page
  • [DMAS-74872] - Start all OSGi bundles in QA and prod
  • [DMAS-74943] - Update attribution structures and comments in MATLAB data products to use/be compatible with DOI citations
  • [DMAS-74984] - Remove some unused camera control and data search Javascript and CSS
  • [DMAS-74986] - Fix Oceans 3 unit tests failing intermittently in Jenkins
  • [DMAS-75076] - Make basic project templates for persistence bundles
  • [DMAS-75080] - Disable hydrophone on-the-fly audio data conversion by default with a new option
  • [DMAS-75081] - Add a QAQC result information to time series scalar MAT files
  • [DMAS-75085] - Update database script commit process in the README
  • [DMAS-75118] - Button Set Widget should save its configuration (currently open button sets) to local storage
  • [DMAS-75120] - Create a communication diagram to show how the widgets in the deck log communicate
  • [DMAS-75121] - Move Organization web backend to usermanagement
  • [DMAS-75181] - Add Content Refresh Button to DeckLog Annotation Table
  • [DMAS-75183] - Reduce Oceans Next coverage temporarily
  • [DMAS-75185] - create trx table for qaqc, qaqcformula, qaqctestgroup,qaqctestgroupdetail tables
  • [DMAS-75188] - Add default resource selection for Deck Log to the SeaTubeConfiguration page
  • [DMAS-75190] - add constraint on im_topologyextension table for unique combination of (topologyid, extensionid)
  • [DMAS-75191] - Add Auto Reload Menu Option to DeckLog Annotation Table Widget
  • [DMAS-75201] - As a Data Steward, I need to be able to assign NULL values to sensor data when a condition is met in a JEP function
  • [DMAS-75221] - Allow users to delete annotations using the Annotation Table Widget
  • [DMAS-75223] - Allow users to "copy link" to an annotation in a Deck Log
  • [DMAS-75226] - Add global default resource for Deck Log (No Taxonomy (Expedition))
  • [DMAS-75235] - Create default layouts for the Deck Log for both logged in and anonymous users
  • [DMAS-75238] - Saving or updating an annotation from the Manual Entry widget should trigger the table to refresh
  • [DMAS-75248] - Add organizationId and cruiseId to the payload of CruiseService operation 25
  • [DMAS-75249] - Update CruiseService call to use operation 25 in the Deck Log so users don't need to be logged in
  • [DMAS-75250] - Add a cruiseId parameter to the seatube/permissions service so that permissions for deck log annotations can be retrieved
  • [DMAS-75265] - Load default attributes for taxons when selected
  • [DMAS-75272] - The "copy link" feature will scroll to and highlight the requested annotation in a Deck Log annotation table
  • [DMAS-75275] - ONC Lights Driver - Modify remote commands to retry if not successful
  • [DMAS-75277] - Seascript - add support activateDriver and idleDriver commands for all drivers
  • [DMAS-75285] - Investigate January 28th missed earthquake detection
  • [DMAS-75289] - Improve the annotation table's default configuration
  • [DMAS-75293] - Allow CKAN Upload Job 366 to take a comma separated list of site devices to run with
  • [DMAS-75303] - Improve Deck Log layout for users with write permission
  • [DMAS-75304] - Improve the resource fields in Annotation Entry
  • [DMAS-75308] - Sort the attributes before populate into the form
  • [DMAS-75311] - Update annotation deletion call to handle cruises
  • [DMAS-75328] - Make Deck Log layouts the same across all decklogs instead of per cruise
  • [DMAS-75329] - Fix CSS for background color of deck log
  • [DMAS-75332] - Remove Dive as a Resource Type from Deck Log's Annotation Entry form
  • [DMAS-75338] - Align the action icons in the Annotation Table
  • [DMAS-75354] - Alphabetize data product options from the data product public api service
  • [DMAS-75395] - Protect the Oceans Next deployment build against changes to npm script names

Implementation

  • [DMAS-57879] - Update backend to display react version of page
  • [DMAS-73905] - postprocess Kongsberb SMB files job on demand
  • [DMAS-74687] - Create Deck Log App and Dashboard
  • [DMAS-74698] - Change all finder statements to match newer style
  • [DMAS-74699] - Fix cypress tests
  • [DMAS-74878] - Add warning message to reprocess console
  • [DMAS-74889] - Create service call to retrieve user groups for Group Selector
  • [DMAS-74892] - Set the Java version to 17 in CI
  • [DMAS-74900] - Merge DmasGroupManager.isDmasAdmin and DmasGroupUserManager.isMemberOfAdminGroup
  • [DMAS-74914] - Create URL validation field component
  • [DMAS-74920] - Implement Service to Return Data Search History
  • [DMAS-74930] - script for a job to postprocess on demand
  • [DMAS-74934] - Update default branch name in Oceans 3 deployment scripts
  • [DMAS-74935] - Update default branch name in Oceans Next deployment scripts
  • [DMAS-74940] - Update the default branch name in the Data Products deployment script
  • [DMAS-74942] - Update the default branch name of each repository
  • [DMAS-74988] - Create SeaTube service call to retrieve SeaTube organizations
  • [DMAS-75008] - Disentangle DmasGroupManager and DmasGroupUserManager
  • [DMAS-75072] - Add support for multi-window layouts to Deck Log
  • [DMAS-75087] - Add resourceTypeId and resourceId to erddapdataset table - SQL
  • [DMAS-75088] - Drop usage of siteDeviceId and instead use resourceId and resourceTypeId with erddapdataset - Java
  • [DMAS-75090] - Build the runtime environment's dependency list from Maven repositories
  • [DMAS-75103] - Wrap the new manual entry component in a Widget and add to Deck Log
  • [DMAS-75104] - Add a listener that the manual entry for will populate with the correct data when a button set button is clicked
  • [DMAS-75107] - Create a widget that wraps the annotation table component
  • [DMAS-75108] - Make the edit button on the table communicate with manual entry for editing annotations
  • [DMAS-75109] - Add service method to get annotations for a cruise instead of a dive
  • [DMAS-75113] - Connect back-end service to front end code
  • [DMAS-75114] - Add a button in Expedition Management to link to Deck Logs at the cruise level
  • [DMAS-75115] - Add a flag to the cruise page to indicate that the cruise is "SeaTube Ready"
  • [DMAS-75122] - Make back end changes to show the new dedicated Deck Log page
  • [DMAS-75124] - Allow manual entry/the deck log to save/edit annotations for a cruise
  • [DMAS-75129] - Add column to cruise table for "Deck Log Ready"
  • [DMAS-75135] - redo the open api implementation of the data product delivery request service
  • [DMAS-75140] - Refactor the ManualEntryForm's ManualEntryFormContext to use ServiceContext
  • [DMAS-75144] - Rename 'isDeckLogReady' column to 'ready' on cruise table
  • [DMAS-75151] - Make front end changes to show the new dedicated Deck Log page
  • [DMAS-75152] - Add Quick Save to Button Set widget to auto-save annotations
  • [DMAS-75155] - Remove temporary code that tries to look for a dive labelled as a deck log
  • [DMAS-75160] - Specify the scope of OSGi console commands used in the Oceans 3 deployment script
  • [DMAS-75161] - Specify the scope of OSGi console commands used in the Oceans Next prod-ish deployment script
  • [DMAS-75164] - Update backend Expedition Management tree call to include deck log readiness
  • [DMAS-75174] - Create method to display deprecated jobs in task management
  • [DMAS-75175] - Create button to deprecate and restore jobs
  • [DMAS-75176] - Update existing deprecated jobs in database to use consistent method
  • [DMAS-75184] - Update Expedition Management expedition details call to include deck log readiness
  • [DMAS-75197] - Java code for two geofencing qaqc table
  • [DMAS-75199] - Implement search history page
  • [DMAS-75219] - Support Caching for FormSectionResource Table
  • [DMAS-75220] - Add indexes on resourcetypeid and resourceid columns in FormSectionResource table
  • [DMAS-75222] - Allow AnnotationEntryWidget to Save Automatically when Quick Save is On
  • [DMAS-75225] - Return searchSourceId With QueryPids
  • [DMAS-75229] - Update the data product discovery service to return data product options
  • [DMAS-75262] - Remove dal for ErddapSensorAttribute
  • [DMAS-75266] - Remove erddapsensorattribute_datasetid_fk from erddapsensorattribute
  • [DMAS-75278] - Add an indicator that the api is processing a request
  • [DMAS-75281] - Add search history to entry.jsx
  • [DMAS-75282] - Add search history to web.xml
  • [DMAS-75346] - Change version check in LogWriter to check for R2022a

Test

  • [DMAS-74523] - Check to see if we can retire MATLAB R2014a completely
  • [DMAS-74945] - Test R2022b data products in QA search automation

Bug (ST)

  • [DMAS-74682] - Search failure notifications fail for new instrument searches
  • [DMAS-75009] - Minor event.csv changes
  • [DMAS-75010] - Add survey footprint
  • [DMAS-75192] - Video file QAQC matlab job is failing to produce results
  • [DMAS-75259] - Kongsberg rotary sonar plots drop the angle labels in R2022b
  • [DMAS-75315] - Minor issues in CSV/JSON citations found by search automation in QA
  • [DMAS-75317] - Change DOIDatasetService payload queryPidId to queryPid
  • [DMAS-75353] - Query PID not showing in Search History table

Investigation

  • [DMAS-75116] - Investigate what the "Active" flag on the cruise page does and if we could reuse it

Documentation

  • [DMAS-73898] - Write documentation for the new Stateless Table (and Table) components
  • [DMAS-75095] - Update attribution documentation on DP home and other DP pages

January 30, 2023

Minor release: topology and earthquake catalogue fixes

Tickets Released: Oceans 3.0: 22.12.001 (accessible to internal users only). Total: 2.

January 16, 2023

Major release

Maintenance

  • Fix QAQC flag inconsistency issue between API compared to data products
  • Quarantine device filter checkbox for devices with piggybacks
  • Remove fax from organization page
  • Fix small bugs for CSV data products with min/max options
  • Sensor-level data rating display improvement
  • Parserdefinition tab on device detail page with React
  • Many Selenium tests updated

Sea Tube

  • Continue on WoRMS update
  • Continue on the integration of the Deck Log app
  • Continue on Map Layer app
  • Testing on the back-end implementation of Cordell Bank annotation ingestion
  • Continue on the front-end design/implementation of Cordell Bank annotation ingestion
  • Converted OBIS test setting config page from old React to Ocean Next 
  • Few bug fixes

Internal Projects

  • Automate dependency upgrades for UI tests
  • Upgrade build tooling (gradle, YUI JS/CSS/Node compilers)
  • Remove broken/deprecated SOAP web services
  • Progress towards Java 17 (build tooling, bug fixes)
  • Add support for managing logging on a per-package level through the OSGi console

EEW & OpenAPI

CIOOS

  • OBIS Export now fully supports new annotation review schema

Data Policy

  • Module restructure - moved code to new module, Metadata Products - MP, which houses functionality around generating outputs from metadata, e.g. ISO 19115

ExperiMINTED

  • Instrument searches now use search_dtl table to enable these types of searches to have a query PID

React 17 Upgrade

  • Nearing completion, changes include faster builds

Community Fishers

  • Fixed Date Filter on geospatial map for Webpack
  • Drop siteDeviceId column from im_iso19115datasetrecord

Community Fishers App

  • Create CF App Version 3.2.9
  • Fix errors when building community-fishers in Jenkins
  • Increased the text size on the data visualizations
  • Create and test new Community Fishers App compatible with AML Firmware version 3.1.2

Acoustic Instruments Data Viewer

  • Add UI option for the spectrogramFrequencyUpperLimit dpo in the hydrophone toolbox
  • Modify dataviewer widget to give accurate dates after shrinking

Data Products

  • Added new Satlantic Radiometer calibration
  • Fixes to support upcoming MATLAB R2022b upgrade, including an upgraded logging system:
    • support new warn once method
    • find and replace all disp and warning calls with new equivalent in our dataproduct code
    • implement matlab changes to send logs to UDP socket 
  • Map and test device-level CSV/JSON time series scalar data products for Node and Junction Box devices
  • Testing and minor changes in support of new min/max options for time series scalar data products
  • Support instrument searches that use the search_dtl table (so that these searches can have queryPID / DOIs)
  • Handle erroneous ASL echosounder data (special case where it's firmware was corrupted and it dropped two channels)
  • Update logos on plots to new ONC blue
  • Bug fixes: seismometer data products: IRIS webservice bad formatting (problem on their end but we can handle it), Didson bad data

Tickets Released: Oceans 3.0: 22.12.000 (accessible to internal users only). Total: 98. Automated Testing: AT.22.12.000, total: 20.

Bug

  • [DMAS-69507] - Quarantine Device Filter Checkbox Broken on Device Console
  • [DMAS-69881] - Apparent memory leak in Archivers
  • [DMAS-73043] - Same request for averaged data in API and Data Search returns different results
  • [DMAS-74529] - DMAS Search Failed Notification: 16-Nov-2022 19:11:30 UTC, null, Video Export, SearchHdrId 12969504, UserId 116120
  • [DMAS-74646] - Junction box device type not prioritized
  • [DMAS-74663] - ASL echosounder when reporting only one channel gets tagged with the wrong channel info
  • [DMAS-74701] - Community fishers Date Filter on geospatial map works in Webpack only
  • [DMAS-74718] - unneeded scroll bars
  • [DMAS-74758] - Compile error in Eclipse: javax.xml.bind cannot be resolved in EEWSimulationIntegrationTest
  • [DMAS-74782] - NestedAutoComplete doesn't lose focus when clicked off of it
  • [DMAS-74810] - XML metadata reports dropped from all instrument searches in QA/master
  • [DMAS-74811] - Error in CF annotation CSV data product in QA search automation
  • [DMAS-74817] - Multiqueue Performance Improvements
  • [DMAS-74825] - Accessing AD files byDeviceDateStrExt with searchForwardOnly set to true results in incorrect query
  • [DMAS-74832] - Oceans 3 CI builds don't report an outdated jettyBase.bndrun
  • [DMAS-74838] - Fix DataPreviewManagementPage delete and default values
  • [DMAS-74868] - failed to deploy master branch of oceans 3.0 in QA
  • [DMAS-74873] - DMAS Search Failed Notification: 15-Dec-2022 21:15:51 UTC, Didson 3000 SN374, Sound Metrics Sonar Data, SearchHdrId 13398992, UserId 115850
  • [DMAS-74874] - Sensor-level Data Ratings Mirroring Device-level Data Ratings in O3.0
  • [DMAS-74887] - Red buttons in QA replaced with white
  • [DMAS-74906] - DMAS Search Failed Notification: 22-Dec-2022 05:30:27 UTC, Endeavour-Endeavour East, Seismometer Data, SearchHdrId 13627734, UserId 15356
  • [DMAS-74918] - DMAS Search Failed Notification: 25-Dec-2022 05:30:33 UTC, Endeavour-West Flank, Seismometer Data, SearchHdrId 13654404, UserId 15356
  • [DMAS-74922] - Oceans 3.0 master is failing to build
  • [DMAS-74929] - Task 255 "Generic File Post-processing job" failing every time
  • [DMAS-74933] - Failed to deploy Oceans 3 because of build errors
  • [DMAS-74949] - Reprocessing RDIADCP150WHS24623_20221003T000000.000Z.txt fails
  • [DMAS-74952] - QA YUI pages are missing some CSS and most of their content
  • [DMAS-74958] - Cannot add more than one instrument search to datasearch cart in qa
  • [DMAS-74960] - Search Tree Maintenance page doesn't render in QA
  • [DMAS-74964] - Matlab unit test LoggerTest leaves injected mocks in place after test
  • [DMAS-74974] - Unable to run OBIS Export task
  • [DMAS-74975] - YUI tabs have flipped gradients
  • [DMAS-74977] - archiver is throwing lots of errors in QA
  • [DMAS-75001] - Failed to deploy to QA2 because of conflicting dependencies
  • [DMAS-75014] - Extension ID will not show after editing in Topology page
  • [DMAS-75086] - Oceans 3 is using the wrong consistency level for reads & writes in Cassandra

User Story

  • [DMAS-42022] - As a seismometer data product user, I would like support for Guralp seismometer and accelerometers and related improvements
  • [DMAS-72940] - As a scalar data user, I would like CSV/JSON data products to support min/max and min/max+avg options

Task

  • [DMAS-67642] - Update external documentation for Oceans 3 - API, help and everything else
  • [DMAS-67928] - Add device-level Java scalar data products for Nodes and Junction Boxes
  • [DMAS-74196] - Add UI option for the spectrogramFrequencyUpperLimit dpo in the hydrophone toolbox
  • [DMAS-74223] - Create MapLayerService GET call to return map layers accessible by the current user
  • [DMAS-74333] - Added MapLayer to web.xml
  • [DMAS-74372] - Add groupprivilege for map layer resource
  • [DMAS-74437] - Create MapLayerService create, delete, and update calls
  • [DMAS-74464] - update calibration details for Satlantic Radiometers DI's 12106 and 12107
  • [DMAS-74472] - remove fax from organization metadata
  • [DMAS-74557] - As a Data Steward, I'd like to see the character limitation for device 'Memo' field removed
  • [DMAS-74568] - Modify dataviewer widget to give accurate dates after shrinking
  • [DMAS-74679] - Support new instrument searches with search_dtl records
  • [DMAS-74771] - Update data products ONC logo with new ONC blue
  • [DMAS-74775] - Remove old DataPreviewManagementCode from ONC Repo
  • [DMAS-74802] - Merge the bundles ca.uvic.dmas.core.system.util.impl and ca.uvic.dmas.core.system.util.command
  • [DMAS-74826] - Delete extension id column from topology table
  • [DMAS-74833] - Earthquake Historical Job incorrectly setting earthquake type
  • [DMAS-74854] - include dpo_audiodownsample parameter in OpenAPI definition
  • [DMAS-74857] - Add description and citation columns to the map_layer table
  • [DMAS-74871] - Increase Cassandra timeout a bit more to avoid search failures and other issues
  • [DMAS-74894] - Update Obis Service getSettings to Include DMAS_Admin info
  • [DMAS-74915] - Fix failing build due to test coverage
  • [DMAS-74992] - Dont allow duplicate extensionIds for a topology or extensionIds that are already part of a different topology in the same time range

Requirement

  • [DMAS-74652] - Requirements for storing and retrieving iso19115datasetrecords by siteDeviceSubsetId

Design

  • [DMAS-73714] - Database design to support storing ISO19115 for siteDeviceSubset

Implementation

  • [DMAS-47182] - AxisServlet appears to be an inactive servlet
  • [DMAS-73327] - re-write the parserdefintion tab with react
  • [DMAS-74099] - Replace gradle-js-plugin and gradle-css-plugin with gradle-minify-plugin
  • [DMAS-74149] - Upgrade gradle to 7.6
  • [DMAS-74214] - Implement matlab changes to send logs to UDP socket
  • [DMAS-74450] - Refactor DataProductDelivery API to Create search_dtls with Instrument category searches
  • [DMAS-74474] - update UI code to remove fax column
  • [DMAS-74475] - update phone database table
  • [DMAS-74500] - Update OBIS Export to use new review schema
  • [DMAS-74545] - Update annotation service to use new review schema
  • [DMAS-74563] - Rename dataset packages and update documentation
  • [DMAS-74618] - Drop siteDeviceId column from im_iso19115datasetrecord - SQL
  • [DMAS-74628] - Upgrade gradle-node-plugin
  • [DMAS-74648] - Write SQL To convert old (1 month-ish) Instrument by Category searches to contain search_dtls
  • [DMAS-74792] - add some small improvements to the open api page
  • [DMAS-74800] - Add an OSGi command to set the log level for a single package
  • [DMAS-74822] - Find and replace all disp and warning calls with new equivalent in our dataproduct code
  • [DMAS-74845] - Add warn once method
  • [DMAS-74849] - Merge redundant versions of isMemberOfAdminGroup
  • [DMAS-74851] - Restore sampleTime field and data in min/max resampled JSON
  • [DMAS-74862] - Update backendcode to remove OrganizationFax
  • [DMAS-74869] - Create new TextField base component with self-contained state
  • [DMAS-74870] - Merge HibernateEnvironment and HibernateSession
  • [DMAS-74877] - Implement fixes after replacing matlab logging with Logger
  • [DMAS-74883] - Create Group Selector app component
  • [DMAS-74899] - Upgrade xstream to 1.4.19
  • [DMAS-74908] - Convert OrganizationList to Functional Component
  • [DMAS-74932] - script to delete some sensorattributes

Bug (ST)

  • [DMAS-67620] - tryDBquery.m returning empty string instead of expected value ('null')
  • [DMAS-74694] - Time series scalar JSON product with averaging has extra fields (for min/max)
  • [DMAS-74895] - Some earthquake correlator tests fail when run in Java 17
  • [DMAS-74896] - Missing space between time of min and min value in ODV with min/max or min/max+avg
  • [DMAS-74916] - SensorObservationService fails to run in Java 17
  • [DMAS-74931] - Tiff2pdf is not working with Matlab R2022b
  • [DMAS-74985] - Fix display issue for the new react page of Parser Definition View
  • No labels