New Features Release Notes

Bug

• [DMAS-74752] - Order device attributes by datefrom desc, modifydate desc on device details/additional attributes page
• [DMAS-77991] - Description collapse text displays for all playlists in Firefox
• [DMAS-78330] - Synchronization managers can't be referenced
• [DMAS-78418] - I can't modify or delete button sets I create
• [DMAS-78592] - Data Search filter misbehaves when changing between tree types with active filters
• [DMAS-78594] - Links to DOI Dataset Landing Pages broken for all CKANs
• [DMAS-78621] - Can't set Junction Box alarm values for BPS miniJB028
• [DMAS-78699] - Fix tests failing due to update of esri-leaflet to v3.0.12
• [DMAS-78721] - Lassoing irregular shapes causes duplicate cast lasso items
• [DMAS-78738] - Titles in matlab plots don't know about South
• [DMAS-78753] - Fix VideoTest.testShareVideo
• [DMAS-78762] - Data access restriction doesn't work in ST dive log
• [DMAS-78763] - Unnecessary error messages while reordering my video clips
• [DMAS-78769] - Playlist Playback page crashes when a playlist has no clips
• [DMAS-78771] - SeaTube Chat Log widget's minimum height depends on the window height
• [DMAS-78782] - CastPopup occasionally fails tests when ran locally.
• [DMAS-78783] - Downloading clips from a playlist while not logged in displays an error "Network error"
• [DMAS-78795] - main branch of Oceans Next not building on Windows
• [DMAS-78805] - Position and show/hide issues on the video control bar of Playlist Playback page.
• [DMAS-78822] - Bathymetry page is failed to load.
• [DMAS-78835] - Metadata change task and DOI registration task are assigned 0 sequence numbers
• [DMAS-78845] - SiteDevice Subset upcast/downcast changes have globally affected all subset types
• [DMAS-78857] - Deployments sometimes fail with `tail: invalid number of lines '+Binary'`
• [DMAS-78873] - Fix failing storybook build
• [DMAS-78885] - Oceans Next isn't reporting jest test results
• [DMAS-78888] - Oceans 3 fails to restart in QA2
• [DMAS-78912] - Some pages don't load from the start:oceans3 script
• [DMAS-78917] - There are expeditions/dives missing in on-shore dive logger
• [DMAS-78946] - Bug in the parser for Nortek Aquadopp Profiler 2MHz, specifically at Folger Pinnacle on 2024-Jan-06
• [DMAS-78955] - lasso button is being duplicated on the geospatial page
• [DMAS-78963] - Error when editing existing playlists
• [DMAS-78968] - Adding a collection does not close the "Create Collection" dialog
• [DMAS-78985] - lasso tool on CF map contains undefined reference to assignedCastData
• [DMAS-78994] - Fix failing test case in TaxonomyDetailWidget.cy.tsx
• [DMAS-79003] - Null Pointer Exception When Logging in on Dev
• [DMAS-79027] - Clip deletion failing due to missing playlistHdrId
• [DMAS-79032] - Investigate QAQC Reprocess (job ID 359) failure for taskId 36661223
• [DMAS-79045] - Geospatial map lasso tool removes selected casts when performing new lasso
• [DMAS-79049] - Device Workflow Admin Phase Filter not showing up in QA
• [DMAS-79065] - Selecting casts with lasso after choosing 'Select all casts' doesn't revert button to 'select all casts'
• [DMAS-79084] - In QA, I can't update the datatype of a taxonomy attribute, or add options to it
• [DMAS-79090] - Device Workflow Admin Process Filter not showing up in QA
• [DMAS-79092] - DOI title mismatch between datacite and ONC database
• [DMAS-79106] - Accessing ComplexDataPlayer as an anonymous user will crash the browser
• [DMAS-79109] - Device Workflow Admin page can not add/delete phase
• [DMAS-79110] - Pressure data for RDI ADCP 150 kHz (SN 8580) for SOG East is incorrect in MAT and RDI data prdocuts
• [DMAS-79121] - Cannot generate dataProducts for historical casts at a station via the Community Fishers Map
• [DMAS-79125] - Error occurring in Batch Management when deselecting a batch
• [DMAS-79134] - Earthquake Detail Page site detection table is showing duplicate sites
• [DMAS-79142] - error when trying an open api query when logged out
• [DMAS-79146] - Applying filters or enabling drifter/cf sampling stations on QA DataSearch causes device tree to reload collapsed
• [DMAS-79170] - modifyDate and modifyBy is null for a new Process, Phase or phasephasetask

Epic

• [DMAS-74103] - As a software developer, I want to upgrade our tools to use Java 17 so that we can make use of the latest features and ongoing support

User Story

• [DMAS-73635] - As a ST developer, I would like to support more than 10 onship servers
• [DMAS-75300] - As a software developer, I want to upgrade dev dependencies to match the versions used in the new Equinox
• [DMAS-77737] - As a software developer, I would like more constraints on database updates and deletes in the QA and DEV databases
• [DMAS-78447] - As a dev, I would like to have modifydate and modifyby coumns and trx table for device workflow related database tables
• [DMAS-78474] - As a user, I would like to see consistent names for fields Modified Date and Modified By
• [DMAS-78494] - As a scientist using SeaTube, I want to be able to lock a playlist against editing so that links from published papers can't be broken
• [DMAS-78552] - As a software developer, I want to drop support for testing old branches with Java 8 in order to simplify maintenance and test processes
• [DMAS-78684] - As a ST user, I want to be able to create, edit, and delete playlist group from the group panel
• [DMAS-78708] - As a SeaTube user, I want video snapshots to use a more appropriate quality
• [DMAS-78933] - Add stories for map buttons, menus, sizeables sliders
• [DMAS-78939] - Add storybooks for steppers

Task

• [DMAS-37728] - remove navdata configproperties in database
• [DMAS-46729] - Jan Schluter would like a "restrict to visible area" tickbox instead of automatic filtering in data search
• [DMAS-47205] - ServerManagementService appears to be inactive
• [DMAS-67409] - As a data partner, I would like to see ScalarDataAPIService validate its user's identity so that data access restrictions can be enforced
• [DMAS-73306] - As a user, I would like to see an alert when future dates are used in QAQC Results Deletion Job
• [DMAS-74927] - As an app developer, it would be useful to have quick access to the android version of a tablet used in CF
• [DMAS-75613] - As a dev, I would like to see dialog box on device category dragable
• [DMAS-76872] - Always proxy through qamon/ncdeploy when deploying from Jenkins
• [DMAS-76942] - Add job.failed.email.recipients job parameter for QAQC reprocessing job
• [DMAS-76961] - Make each of the data product options in the Dataset Landing Page for query PID options table links to the wiki
• [DMAS-77026] - Improve email content for the support request
• [DMAS-77818] - Print any errors thrown when installing OSGi bundles in QA/prod
• [DMAS-77950] - Remove the page header bar on the playlist playback page
• [DMAS-78013] - Lazily load Playlist apps when running Oceans Next in playground mode
• [DMAS-78301] - Replace loading spinners on Thumbnails with a Skeleton component
• [DMAS-78338] - Populate the synchronizer database tables
• [DMAS-78356] - Adjust styling in PlaylistList to add space between thumbnail and text
• [DMAS-78357] - Redirect the SeaTubeV3 Playlist playback route to the new Playlist Playback page
• [DMAS-78411] - Make DataSyncServiceActivator agnostic to whether a synchronizable manager is an OSGi service or not
• [DMAS-78528] - Refactor AsyncAutocomplete to use cancellable service calls and create storybook
• [DMAS-78585] - Design where playlist lock/unlock buttons and icons will go, how it will affect the playback page
• [DMAS-78639] - Allow colons in the field label of formfield entries.
• [DMAS-78692] - Search Hydrophone Data page does not allow to close zoomed images
• [DMAS-78711] - As a user, I would like to see consistent display for Modified By on dmas UI pages
• [DMAS-78732] - Update the playlist discovery page's Modified column if a playlist's clips are modified
• [DMAS-78739] - Update Dockerfile to use Node v20
• [DMAS-78796] - As a dev, I would like to include modifyby and modifydate in the web services for device workflows
• [DMAS-78804] - Inconsistent date formats in notification emails
• [DMAS-78824] - Add story with docs for AvailabilityChart
• [DMAS-78827] - Add stories for Filters and DragScroll
• [DMAS-78837] - scalardata get by station failing to return data
• [DMAS-78842] - The Jenkins storybook build should email the senior developers on failure
• [DMAS-78846] - Switch configuration to avoid needing to import React in every single file
• [DMAS-78853] - Unassigned casts inside station perimeter
• [DMAS-78854] - On the openapi page if a user fills out a service query while not logged in the form should keep the values after login
• [DMAS-78880] - OpenApi deployment page is missing the deviceCode filter
• [DMAS-78886] - Configure logging for OSGi tests
• [DMAS-78887] - Equinox validation should fail with a better message if gemini.service exists but /usr/local/gemini doesn't
• [DMAS-78908] - improve the performance of the get location tree public api call
• [DMAS-78909] - Update code coverage reports for Oceans Next
• [DMAS-78910] - Update code coverage reports for Oceans 3
• [DMAS-78913] - need able to deploy oceans-next code to qadivelogger4.onc.uvic.ca through Jenkins
• [DMAS-78925] - Run DigitalFishers UI tests in Renovate builds
• [DMAS-78940] - Add appToken support to external services not supporting it yet
• [DMAS-78943] - Implement TaxonAsyncAutocomplete into Dive and Deck Log
• [DMAS-78959] - Add new field auto-requeue to tm_tasktype
• [DMAS-78960] - Update openAPI page and documentation for resample periods
• [DMAS-78989] - Don't attempt to use Matlab if matlab as a service is turned off (Dev)
• [DMAS-79006] - Remove pagination for the first level of batch tasks
• [DMAS-79017] - Improve task original date query
• [DMAS-79021] - Update dependency react-virtualized-auto-sizer to v1.0.21
• [DMAS-79031] - Remove sequenceNumber from DAO objects
• [DMAS-79060] - Sort the AppMenu in Oceans Next
• [DMAS-79089] - Remove the current playlist from the list of Copy To Playlist options on Playlist Playback page
• [DMAS-79091] - Update tests for the ModifiedBy value on UI page
• [DMAS-79105] - update post refresh scripts with new task type column

Implementation

• [DMAS-77504] - Implement Data Source Selection Widget
• [DMAS-77738] - Add where clause constraint to all database table updates and deletes
• [DMAS-77993] - Convert CFOverlay to a functional typescript component
• [DMAS-78032] - Make FormFieldService available anonymously
• [DMAS-78218] - Drop JDK options from Integration Testing build scripts
• [DMAS-78259] - Refactor Cast Selection Poppup out of CFOverlay
• [DMAS-78288] - Display read-only metadata when selecting a taxonomy or taxon
• [DMAS-78291] - Display a form with taxons' default attributes
• [DMAS-78293] - Delete a taxon or taxonomy when clicking Delete Taxonomy or Delete Taxon
• [DMAS-78294] - Add a taxonomy when clicking Add User Defined Taxonomy
• [DMAS-78296] - Add a taxon when clicking Add Taxon
• [DMAS-78321] - Autosave changes to default attributes
• [DMAS-78325] - Make a servlet for the synchronizer management UI
• [DMAS-78326] - Make a React page for synchronizer management
• [DMAS-78372] - Create new prefixed synchronizer tables
• [DMAS-78373] - Update hibernate mapping files to use prefixed synchronizer tables
• [DMAS-78374] - Remove unprefixed synchronizer database tables
• [DMAS-78436] - Make a base web service supporting multi-verb REST services
• [DMAS-78448] - Add modifydate and modifyby columns in phase, phasephasetask, phasetype, process, processgroup, processphase and processtype tables
• [DMAS-78449] - creat trx for phase, phasephasetask, phasetask, phasetype, process, processgroup, processphase and processtype database tables
• [DMAS-78466] - Drop ErddapDatasetAttribute table
• [DMAS-78495] - Add a lock button to the playlist details header bar on the playback page
• [DMAS-78496] - Add columns "locked" and "lockreason" to playlist_hdr
• [DMAS-78497] - Add persistence and web service code for "locked" and "lockreason"
• [DMAS-78498] - Lock a playlist when a user confirms their click on the lock button
• [DMAS-78499] - When a playlist is locked, display an unlock button in the playlist details header instead of a lock button
• [DMAS-78500] - If a playlist is locked, display it as read-only on playlist discovery
• [DMAS-78501] - If a playlist is locked, display it as read-only on playlist playback
• [DMAS-78502] - If a playlist is locked, reject edits to it in web services
• [DMAS-78545] - Drop support for deploying Oceans Next to Gemini
• [DMAS-78547] - Update Modified Date/Modified By field names for React pages created by other groups
• [DMAS-78566] - Add UI indicator and controls for automatic batch task execution
• [DMAS-78568] - Implement batch task auto-queueing
• [DMAS-78583] - Disable locked playlists in selection dropdowns for adding clips in Oceans Next
• [DMAS-78598] - Update dataproduct discovery service to show default values, request service to use default values, and open api page to display defaults in description text
• [DMAS-78626] - Add a reference URL to custom taxons (backend)
• [DMAS-78664] - Add a method to PlaylistService to update a group name
• [DMAS-78665] - Create a new Expedition Admin - ONC group
• [DMAS-78671] - Update ExpeditionOrganization.java to use the new group
• [DMAS-78674] - Update SeaTube.jsx to use the new group
• [DMAS-78675] - Create a Dialog for creating a playlist group
• [DMAS-78676] - Create a dialog for editing a playlist group name
• [DMAS-78678] - Create a dialog for deleting a playlist group
• [DMAS-78679] - Disable the add group button if there aren't any ungrouped playlists
• [DMAS-78713] - Add translations with a button base component
• [DMAS-78716] - Enable authentication when running UI tests in QA2
• [DMAS-78722] - Implement date chunking when searching for days to create NetCDF files in ErddapNetCdfPostProcessor
• [DMAS-78723] - When generating NetCDF for Erddap always produce a NetCDF file even when sourceFile does not have sufficient data
• [DMAS-78724] - Implement filtering options for ErddapNetCDFPostProcessor
• [DMAS-78774] - update column names to Modified Date and Modified By on Network Console page
• [DMAS-78793] - Refactor Create/Update Playlist buttons in SeaTube Search to be disabled/have loading indicators
• [DMAS-78806] - Hide locked playlists in selection dropdowns for adding clips in SeaTube Pro
• [DMAS-78811] - Extract StudyArea persistence code to OSGi bundles
• [DMAS-78812] - Extract data acquisition metrics to OSGi bundles
• [DMAS-78818] - Check if a taxon's originTaxonomy is editable in the default attributes form
• [DMAS-78820] - Add mapId to the context so it isn't passed around everywhere
• [DMAS-78823] - Update Modified Date/Modified By field names for Device Details, Site Device and Dive page
• [DMAS-78825] - Add a Properties table for imported taxonomies and their taxons
• [DMAS-78828] - Replace Jetty with Tomcat in dev
• [DMAS-78829] - Run dev on the root context path
• [DMAS-78830] - Remove the distinction between dev and prod bndrun files
• [DMAS-78833] - Update VideoSnapshotService to use the appropriate quality source for snapshots
• [DMAS-78834] - Set the video quality to use for playlist thumbnails
• [DMAS-78841] - Remove several unused dependencies
• [DMAS-78847] - Derive the location of Oceans Next automatically
• [DMAS-78849] - Only allow open tasks to swap sequence numbers
• [DMAS-78851] - have the running status chip on task management be green
• [DMAS-78852] - Change "Group" to "Collection" for current playlist group components
• [DMAS-78856] - Set the video quality to use for dive log snapshots
• [DMAS-78864] - Extract labels from Buttons.jsx and organize them into translations.json (en)
• [DMAS-78871] - Default the locking service code to use the previous lock values if none are passed
• [DMAS-78875] - Implement basic task pipelines
• [DMAS-78889] - Remove unnecessary notes about .ssh/known_hosts in Oceans Next deployment Jenkinsfile
• [DMAS-78892] - Add projectid column to organizationagreement table
• [DMAS-78893] - Create dal layer for organization agreement local context project id column
• [DMAS-78896] - Increase mod count
• [DMAS-78907] - Refactor TaxonForm.tsx into different components for editing and adding
• [DMAS-78911] - Update global.baseurl in dev
• [DMAS-78915] - Update Modified Date/Modified By field names for Expedition Maintenance, Sensor Maintenance - Additional Attributes Tab, SeaScript Editor
• [DMAS-78924] - Deprecate the old Button.jsx file and add a warning comment to the top of Buttons.jsx
• [DMAS-78935] - Refactor GenericSystemCommandActivator as an OSGi whiteboard
• [DMAS-78944] - Convert High and MediumEmphasisSubmitButton to use new format
• [DMAS-78945] - Convert DeleteButtonRed to new format
• [DMAS-78954] - Convert ImageUploadButton, ChooseFileButton, MediumEmphasisChooseFileButton to new format
• [DMAS-78965] - Convert Generic*, FloatRight* Buttons to use new format
• [DMAS-78973] - add default values for modifyby and modifydate in device workflow related tables
• [DMAS-78976] - General cleanup of unused features of NeptuneVelocityServlet
• [DMAS-78984] - Make use of taskOutput in ErddapNetCdfPostProcessor
• [DMAS-78993] - Compare creation date of NetCDF file to source file during job run
• [DMAS-79009] - Create batchable task that deletes files from Erddap NetCdf file store - SQL
• [DMAS-79010] - Create batchable task that deletes files from Erddap NetCdf file store - Java
• [DMAS-79016] - Refactor the ToolbarButtons used in Buttons.jsx
• [DMAS-79018] - Update public api citation response
• [DMAS-79019] - Improve batch task pagination
• [DMAS-79020] - Handle source archivefiles that span multiple days
• [DMAS-79037] - remove sequencenumber from ONC DAO objects
• [DMAS-79039] - Create RDI ADCP Cassandra to NetCdf changeover job - Java
• [DMAS-79040] - Create RDI ADCP Cassandra to NetCdf changeover job - SQL
• [DMAS-79046] - Add DeviceTypeAttribute to track android SDK version for devicetype 267
• [DMAS-79050] - Implement API location tree filters
• [DMAS-79051] - Add column to tasktype
• [DMAS-79055] - Add ADCP Wave device type to ERDDAP RDI ADCP NetCDF Generation Job
• [DMAS-79061] - add Modified Date and Modified By to Process Group
• [DMAS-79068] - Batch Task pagination service changes
• [DMAS-79069] - Use new /netcdf_data volume to store NetCdf files for use with Erddap
• [DMAS-79077] - Use a timeout when generating NetCdf files for Erddap
• [DMAS-79080] - Allow multiple blacklist/whitelist dateranges to be specified for one device

Test

• [DMAS-76365] - Update the synchronizing test plan to properly document where messages should be sent
• [DMAS-78918] - Need test group-user synchronization for the new group in QA

Bug (ST)

• [DMAS-78622] - Deleting a taxon doesn't work if it has been imported
• [DMAS-78870] - Add padding that Button.jsx adds to reduce visual changes when refactoring
• [DMAS-78966] - Support an argument on the --jdk option for Oceans 3 deployments
• [DMAS-78992] - Error colored buttons don't style correctly when disabled
• [DMAS-79012] - Fix Batch Task Pagination ONC
• [DMAS-79013] - Fix Batch Task Pagination Oceans next
• [DMAS-79076] - Investigate NetCdf generation getting stuck/slow in Matlab
• [DMAS-79195] - phasetask_trx table phasetaskreferences nullable

Investigation

• [DMAS-38792] - Investigate why SensorReadingCache entries expire after 60s

Documentation

• [DMAS-78525] - Update external wiki documentation with new scalar data service parameter

Design

• [DMAS-78936] - Document the design for the stages leading to being able to use generic command messages on the system console