This page contains the current year's release notes and new features, primarily for Oceans 3.0, as well as any applications created/maintained by the ONC software development group, including mobile Apps and desktop/PC applications. In progress project status may be presented as well. The information below is written in plain language as much as possible. "Major" releases include all completed items at that time (monthly), while "minor" releases are updates to the previous major release with bug fixes and specific features. Detailed release notes are available on internal confluence pages (internal users only).
Add Modified By and Modified Date on Device Workflow Admin page
Database improvements: improve a number of constraints on field lengths, remove a few deprecated tables, update a few _hist tables to _trx tables for better auditing.
Remove deprecated code: CANARIE Registry, adcpdata API
Quarter-scalar-data-generation-cassandra limit number of records to be processed each time
Update date format for QAQC reprocess and QAQC deletion jobs
Change property value from sensortypename to sensortypecode in Data Search URL
Bug Fixes
CSV/JSON data products header should report metadata file name with .xml not .pdf
User Management: "Select All" doesn't select all data products
Plotting Utility: Quarter scalar data includes data outside of deployment when it should not
integrated Wi-Fi and Bluetooth connection more closely with Android
fixed loading from archived log/ctd data creating an unclose-able menu
various performance improvements under the hood
Acoustic Instruments Data Viewer
added a reference URL to custom taxons (front-end)
Fixed: Data Search for all available data doesn't return all the data (high-priority bug)
Data Products
Two very minor bug fixes and automated testing improvements.
Infrastructure
Restricted/testing environments only allow a subset of users to log in (secondary security to VPN/firewalls)
Remove abandoned "Camera Shut Down" application and "Complex Data Viewer" (v1&v2) pages
Abort a deployment & shut down if Oceans 3 tries & fails to connect to its database
Modernize code behind Taxonomy Management page
Dashboards
Data Source Selector Widget now shows sources in a table
Location Selector now uses public API/locations service (much faster)
Fix: Audio player now goes to the correct location to play FLAC files
Fix: Data Player Widget can now be used anonymously
CIOOS Pacific
Add tab to Agreements to edit and view local context labels
ExperiMINTED
Remove incorrect ERROR logging in the DOI registration job (378)
Link available from Data Search page to go to Search History page
When running a batch an email can be sent under various conditions
Earthquake Early Warning, API and Tasks
Now continually sending acceleration data to IRIS on some high bandwidth land sites
Add message to API when requesting restricted data
Improved response descriptions on the open API page
Add better messaging when a default value is used on dataProductDelivery API
Wrap text on browser telnet console page
Simplify logic for running tasks and don't send tasks over the scheduler topic
SeaTube
Finished most phase 1 features in supporting 10+ on-ship servers
In-progress: DateTimePicker for MUI 5 updates, annotation ingestion parser, refactoring DiveLog to use the same framework as the DeckLog
Minor improvements and bug fixes
Instruments
Subc MK5/6 driver zoom function updated
Device does not report current zoom location. Driver now generates the current zoom location by counting the number of zooms in from the maximum zoom out.
Add new sensor attributes for the total number of zoom positions and largest zoom step size, accounting for differences in model years.
[DMAS-76402] - As a system admin, I want to manage which datasync queues receive messages so that I don't have to do too much manual clean up
[DMAS-77348] - Link to Search History Page from Data Search to improve accessibility of page
[DMAS-77692] - As a Community Fishers users, I want to download all casts from one station on Community Fishers Map without having to go to Data Search
[DMAS-77978] - As a batch management user I would like to have batch tasks automatically run in sequence
[DMAS-78339] - As a dev, I would like to see consistent date format on UI pages
[DMAS-78482] - As a system admin, I want to see whether synchronizers are deployed so I know which message queues need to be managed
[DMAS-78483] - As a system admin, I want to create synchronizer deployments so I don't need to manage their queues myself
[DMAS-78484] - As a system admin, I want to edit synchronizer deployments so I can end deployments
[DMAS-78575] - As an API user, I'd like better messaging when I hit restricted data
[DMAS-78797] - As a user, I would like to see Modified Date and Modified By info on Device Workflow Admin page
[DMAS-79057] - Ensure all ST-related synchronized tables use ModGenerator
[DMAS-79224] - Clean up activation and bundling of DataSyncServiceActivator
[DMAS-79429] - Define Storybook usage and standards
Task
[DMAS-35284] - Quarter-scalar-generation: limit number of records to be processed each time
[DMAS-67742] - Change property value from sensortype name to sensortype code on url of data search
[DMAS-73214] - Deprecate CANARIE registry endpoints and supporting code
Standardized data format for Modified By and Modified Date Oceans 3.0 pages
Python API library documentation update
Update web services to add Modified By and Modified Date for device workflow admin page
Allow to close enlarged images on Search Hydrophone Data page
Add new data source filter "Restrict data source selection to map-view" on Data Search page. Off by default to prevent tree-trimming.
Add another order by (modifydate desc) for deviceattributes or sensorattributes on Device Details display
Draggable dialog box on Device Category page
Allow colons in the field label of fornfield entries
Remove groundfault alarm setting for mini JunctionBox with 400 volt ports
Lots of new or updated or fixed automated tests
Bug Fixes
Fix ticket creation which was broken by Jira upgrade
Internal projects
Java 17 upgrade project is officially complete
Various small deployment improvements: better logging, reduce errors, improve validator warnings
Support refactoring ship-shore-synchronizing managers into OSGi-services mid-season
Drop support for IE9
Dashboards (in support of Acoustic Data Viewer)
DEV/QA only data selector widget beta
CIOOS
Use correct version of DOI link now that CKAN supports it
Local Contexts - in progress - support association of Local Contexts project ID with Organization Agreement, display labels associated with project
Fixed issue with CKAN harvest jobs not finishing
ExperiMINTED/Task Management
Remove pagination for Batch Tasks - all top-level batch tasks now show on one page to make sequencing simpler
Batches now support auto-run
We now support a pipeline job which will run the specified set of jobs sequentially
Bug fix: running DOI registration jobs metadataOnly updates DataCite correctly again
EEW
Fixed a bug where site detections could show up multiple times if they didn't have a p-wave or s-wave attached on the earthquake detail page.
API
Removed userId parameter fromScalarDataAPIService (not the public API service) to improve security.
Support default data product options in the data product delivery service. Also ignore any incorrect options a user provides. Response contains the corrected URL.
Remove scalar data get by station API
Have user input persist on the OpenAPI page if they enter it while logged out and then log in to try their query.
Add deviceCode filter to the OpenAPI deployment service page. The API already supported it but it wasnt listed on the OpenAPI page.
Improve performance of the get location and get location tree services
Update all public API services to support an appToken (for dashboards)
Update the citation response from delivery API services to include fields for the DOI, landing page link, and query pid in addition to the citation string.
Added filters to the location tree service so it has all the same ones as the get location service.
Data Products
Bug fixes: Nortek data for rest of day is missing after a configuration change (in some cases), slow/stuck RDI reading with gappy data
Better plot titles for supporting global data
ERDDAPnetCDFpostProcessor ready: added features for automatic dataset switch over as we populate, handling of re-postprocessing, chunking for reliability, filters by device and time for live and re-postprocessing, edge cases
SeaTube
Finished Playlist update project phase 1
In-progress: supporting 10+ onship servers
Some minor improvements
A few bugs fixed
Community Fishers
Fixed multiple lasso tool bugs
Fixed CF duration limit accidentally applied to all siteDeviceSubset types
Fixed CF App Wi-Fi Regression Test patch for CF.3.2.10
Added DeviceTypeAttribute to track android SDK version for devicetype 267
Dropped the ErddapDatasetAttributeand ErddapDatasetAttribute_histtable
Converted CFOverlay to a functional typescript component
Refactored Cast Selection popup out of CFOverlay
Added mapId to the context so it isn't passed around everywhere
Fixed lasso tool on CF map contains undefined reference to assignedCastData
Added I18n to cut down on code maintenance for Buttons in React
[DMAS-79003] - Null Pointer Exception When Logging in on Dev
[DMAS-79027] - Clip deletion failing due to missing playlistHdrId
[DMAS-79032] - Investigate QAQC Reprocess (job ID 359) failure for taskId 36661223
[DMAS-79045] - Geospatial map lasso tool removes selected casts when performing new lasso
[DMAS-79049] - Device Workflow Admin Phase Filter not showing up in QA
[DMAS-79065] - Selecting casts with lasso after choosing 'Select all casts' doesn't revert button to 'select all casts'
[DMAS-79084] - In QA, I can't update the datatype of a taxonomy attribute, or add options to it
[DMAS-79090] - Device Workflow Admin Process Filter not showing up in QA
[DMAS-79092] - DOI title mismatch between datacite and ONC database
[DMAS-79106] - Accessing ComplexDataPlayer as an anonymous user will crash the browser
[DMAS-79109] - Device Workflow Admin page can not add/delete phase
[DMAS-79110] - Pressure data for RDI ADCP 150 kHz (SN 8580) for SOG East is incorrect in MAT and RDI data prdocuts
[DMAS-79121] - Cannot generate dataProducts for historical casts at a station via the Community Fishers Map
[DMAS-79125] - Error occurring in Batch Management when deselecting a batch
[DMAS-79134] - Earthquake Detail Page site detection table is showing duplicate sites
[DMAS-79142] - error when trying an open api query when logged out
[DMAS-79146] - Applying filters or enabling drifter/cf sampling stations on QA DataSearch causes device tree to reload collapsed
[DMAS-79170] - modifyDate and modifyBy is null for a new Process, Phase or phasephasetask
[DMAS-79200] - imagenex-837-postprocess-job generate *.837 files with zero filesize in qa with release/24.01.000
[DMAS-79207] - The XML configuration files for the AZFP Echosounder (55036) at DDL are incorrect after 2023-11-24 22:06
[DMAS-79219] - piggyback device connect multiple ports to different port of parent device in topology is broken
Epic
[DMAS-74103] - As a software developer, I want to upgrade our tools to use Java 17 so that we can make use of the latest features and ongoing support
User Story
[DMAS-73635] - As a ST developer, I would like to support more than 10 onship servers
[DMAS-75300] - As a software developer, I want to upgrade dev dependencies to match the versions used in the new Equinox
[DMAS-77737] - As a software developer, I would like more constraints on database updates and deletes in the QA and DEV databases
[DMAS-78371] - As a software developer, I want synchronizer database tables to use a module prefix
[DMAS-78447] - As a dev, I would like to have modifydate and modifyby coumns and trx table for device workflow related database tables
[DMAS-78474] - As a user, I would like to see consistent names for fields Modified Date and Modified By
[DMAS-78481] - As a software developer, I want a synchronizer management skeleton page for me to build on
[DMAS-78494] - As a scientist using SeaTube, I want to be able to lock a playlist against editing so that links from published papers can't be broken
[DMAS-78552] - As a software developer, I want to drop support for testing old branches with Java 8 in order to simplify maintenance and test processes
[DMAS-78684] - As a ST user, I want to be able to create, edit, and delete playlist group from the group panel
[DMAS-78708] - As a SeaTube user, I want video snapshots to use a more appropriate quality
[DMAS-78933] - Add stories for map buttons, menus, sizeables sliders
[DMAS-37728] - remove navdata configproperties in database
[DMAS-46729] - Jan Schluter would like a "restrict to visible area" tickbox instead of automatic filtering in data search
[DMAS-47205] - ServerManagementService appears to be inactive
[DMAS-67409] - As a data partner, I would like to see ScalarDataAPIService validate its user's identity so that data access restrictions can be enforced
[DMAS-73306] - As a user, I would like to see an alert when future dates are used in QAQC Results Deletion Job
[DMAS-74927] - As an app developer, it would be useful to have quick access to the android version of a tablet used in CF
[DMAS-75613] - As a dev, I would like to see dialog box on device category dragable
[DMAS-76872] - Always proxy through qamon/ncdeploy when deploying from Jenkins
[DMAS-76942] - Add job.failed.email.recipients job parameter for QAQC reprocessing job
[DMAS-76961] - Make each of the data product options in the Dataset Landing Page for query PID options table links to the wiki
[DMAS-77026] - Improve email content for the support request
[DMAS-77818] - Print any errors thrown when installing OSGi bundles in QA/prod
[DMAS-77950] - Remove the page header bar on the playlist playback page
[DMAS-78013] - Lazily load Playlist apps when running Oceans Next in playground mode
[DMAS-78301] - Replace loading spinners on Thumbnails with a Skeleton component
[DMAS-78338] - Populate the synchronizer database tables
[DMAS-78356] - Adjust styling in PlaylistList to add space between thumbnail and text
[DMAS-78357] - Redirect the SeaTubeV3 Playlist playback route to the new Playlist Playback page
[DMAS-78411] - Make DataSyncServiceActivator agnostic to whether a synchronizable manager is an OSGi service or not
[DMAS-78528] - Refactor AsyncAutocomplete to use cancellable service calls and create storybook
[DMAS-78585] - Design where playlist lock/unlock buttons and icons will go, how it will affect the playback page
[DMAS-78639] - Allow colons in the field label of formfield entries.
[DMAS-78692] - Search Hydrophone Data page does not allow to close zoomed images
[DMAS-78711] - As a user, I would like to see consistent display for Modified By on dmas UI pages
[DMAS-78732] - Update the playlist discovery page's Modified column if a playlist's clips are modified
[DMAS-78583] - Disable locked playlists in selection dropdowns for adding clips in Oceans Next
[DMAS-78598] - Update dataproduct discovery service to show default values, request service to use default values, and open api page to display defaults in description text
[DMAS-78626] - Add a reference URL to custom taxons (backend)
[DMAS-78664] - Add a method to PlaylistService to update a group name
[DMAS-78665] - Create a new Expedition Admin - ONC group
[DMAS-78671] - Update ExpeditionOrganization.java to use the new group
[DMAS-78674] - Update SeaTube.jsx to use the new group
[DMAS-78675] - Create a Dialog for creating a playlist group
[DMAS-78676] - Create a dialog for editing a playlist group name
[DMAS-78678] - Create a dialog for deleting a playlist group
[DMAS-78679] - Disable the add group button if there aren't any ungrouped playlists
[DMAS-78713] - Add translations with a button base component
[DMAS-78716] - Enable authentication when running UI tests in QA2
[DMAS-78722] - Implement date chunking when searching for days to create NetCDF files in ErddapNetCdfPostProcessor
[DMAS-78723] - When generating NetCDF for Erddap always produce a NetCDF file even when sourceFile does not have sufficient data
[DMAS-78724] - Implement filtering options for ErddapNetCDFPostProcessor
[DMAS-78774] - update column names to Modified Date and Modified By on Network Console page
[DMAS-78793] - Refactor Create/Update Playlist buttons in SeaTube Search to be disabled/have loading indicators
[DMAS-78806] - Hide locked playlists in selection dropdowns for adding clips in SeaTube Pro
[DMAS-78811] - Extract StudyArea persistence code to OSGi bundles
[DMAS-78812] - Extract data acquisition metrics to OSGi bundles
[DMAS-78818] - Check if a taxon's originTaxonomy is editable in the default attributes form
[DMAS-78820] - Add mapId to the context so it isn't passed around everywhere
[DMAS-78823] - Update Modified Date/Modified By field names for Device Details, Site Device and Dive page
[DMAS-78825] - Add a Properties table for imported taxonomies and their taxons