This page contains the current year's release notes and new features, primarily for Oceans 3.0, as well as any applications created/maintained by the ONC software development group, including mobile Apps and desktop/PC applications. In progress project status may be presented as well. The information below is written in plain language as much as possible. "Major" releases include all completed items at that time (monthly), while "minor" releases are updates to the previous major release with bug fixes and specific features. Detailed release notes are available on internal confluence pages (internal users only).
March 13, 2023
Minor release: ERRDAP driver fix, MATLAB stuck dead task fix, Axis camera seascript support
Automated geofencing QAQC test (second version based on feedback)
GoogleMap page is removed from O3 menu
Add devicetype information and filter to DeviceListing page
UI message when incorrect deviceid is entered in search field on Device Listing page
Lots of new Selenium tests (e.g., new devicelisting page, ParserDefinition tab of Device Detail page, Data Monitoring tab of Device Console page)
Create scheduled job for processing archiver cql error files - job wont run automatically until more testing is done
Bug fixes
Citation info edge case in data products
Label display issue on Junction Box view tab of Device Console page
Data availability issue in step 2 of data search page for one edge case
Fix bugs in Selenium scripts
Internal projects
External-facing
Java upgrade: QA/production environment (formerly named "Gemini", now "Equinox") has been rebuilt & upgraded (Equinox 3.18.200, Tomcat 6.0.69, other dependencies at latest versions)
Java upgrade: framework startup errors & Tomcat errors (maybe?) will be properly formatted and logged in dmas.log
Improvement: File Management default date range changed to reduce its risk of crashing the JVM
Bugfix: allow taxonomies/taxons with taxonomy matrix attributes and taxon references to be deleted from the UI
Feature: support heap space monitoring on machines other than the web server
Internal only
Java upgrade: support integration testing in Java 8 or Java 17
Improvement: Refactoring of group membership-checking code to simplify use and fix dependency issues
Bugfix: support integration testing on feature branches of Oceans 3
Improvement: Make Oceans Next deployments more resilient to webpack upgrades
Improvement: Automate cleanup of unimportant (but large) files from archived CI builds
Improvement: Deployment scripts will watch for errors logged with serious but rarely-used log levels FATAL, SEVERE, AUDIT during system startup
Improvement: Support "shotgun-style" code reviews in Bitbucket (assignn >= 2reviewers; allow merge after any 2 approvals) with overrides to force full approval of large or critical changes
Bugfix: various UI tests
Improvement: clean up UI test page object initialization
Bugfix: don't force so much re-review on Renovate dependency upgrades
Improvement: validate Jenkins pipelines in branch CI
Community Fishers
Create service to generate processing comment for cast dataproducts in Java
Drop ErddapSensorAttribute table (for CIOOS)
Remove siteDeviceId column from erddapdataset and erddapdataset_hist trigger (for CIOOS)
Remove dependency on Matlab Engine API for Java
Change output of Matlab logs from UDP port to processes output stream
Order of casts in lasso selection tool now newest to oldest
Acoustic Instruments Data Viewer
Convert existing code for Spectrogram widget to utilize Typescript, React hooks & Cypress testing
Convert existing code for Audio Player widget to utilize Typescript
SeaTube
Finished the Deck Log phase one implementation and gave the demo to users (mostly via previous minor release)
End-to-end tests for supporting embedded time code in our video stream
ST web services improvement to support both new Deck Log app and WTA at same time
ST Playlist Improvement due to the resolution flags are changed to null for fixed location video files
Manual test ST for support React 17 upgrade
NOAA on ship servers synchronization tests
Other small improvements
Some minor bug fixes
Earthquake Early Warning
Support sending IRIS meta for our sites when sending live data to ShakeAlert
Add site map to the earthquake catalog page
Fix some bugs with the scheduled jobs populating the earthquake catalog page
OpenAPI
Improve presentation of data product options on the openAPI page
Add the openAPI page to the main menu under more→ web services
get the latest 100 searches, not just those after 2022-12-10
columns are sortable
improved column sizing
Data Policy
New tables and DAL layer for agreement / site device association
Data Products
MATLAB upgrade to R2022b, includes logging system upgrade (log levels and better error handling), matlab-as-a-service custom API that decouples MATLAB version dependency on Java dependency
DOI citations added for netCDF products
Documentation, internal improvements: warning & logging content, unit tests for append_pdfs, netCDF comparator update
Bug fixes: CODAR slowness, citation fixes
Instruments
Quarantine at Archiver: Archiver will now quarantine devices as soon as they are quarantined. Previously the quarantine would only take effect on the archiver after if had processed the backlog.
Download raw file from AD in BPR Import Job
UV Light support in Axis camera driver with seascript commands
Bug [DMAS-48271] - Data availability bar in step 2 of data search shows "No Data Available" when we have archive file in database [DMAS-64371] - A method to get English vernaculars may not only be getting English vernaculars [DMAS-64616] - Misleading snackbar message for invalid annotation entries [DMAS-73256] - Comment box contains empty space when button is selected [DMAS-73363] - Chat Log Widget search button does not have a tooltip [DMAS-73609] - Unable to update deviceattributeIds where only devicetypeattributeid exists [DMAS-74638] - Archiver should also respect the Quarantine state of a device [DMAS-75098] - ConnectedDevice labels sporadically disappear from DC JunctionBox tab [DMAS-75156] - Task Management "Select All" checkbox doesn't display a tooltip for scheduled jobs [DMAS-75168] - ManualEntryForm cypress tests failing [DMAS-75171] - TabbedButtonSetSelector cypress tests failing [DMAS-75237] - can't play my playlists [DMAS-75333] - Monthly CODAR preview searches are slow and throwing lots of warnings [DMAS-75347] - Lots of warnings for channelCentreFrequecyOverride device attribute not found [DMAS-75349] - Widgets that are only allowed to have a single instance of the widget on a Dashboard can be added in secondary screens [DMAS-75370] - Cannot Add Attribution to an Agreement Data Product [DMAS-75372] - Integration Testing fails to checkout feature branches of Oceans 3 [DMAS-75386] - Storybook builds fail with a TypeError "The "id" argument must be of type string. Received an instance of Object" [DMAS-75389] - Pages with REST style url's don't load properly in the Ocean's Next dev server [DMAS-75399] - Resource validation needs to be improved in Manual Entry [DMAS-75400] - Highlight color of annotation table not displaying correctly in Oceans 3 [DMAS-75402] - Quick Save on button sets allow annotations outside of the expedition's date range and with a Dive resource type [DMAS-75407] - Oceans next pages are not loading in Oceans 3 [DMAS-75417] - Gradle warns about implicit dependencies between some tasks [DMAS-75418] - Storybook builds fail with a TypeError "TypeError: The 'compilation' argument must be an instance of Compilation" [DMAS-75421] - Date Pickers crash the page when the user attempts to open them in oceans next [DMAS-75428] - Deck Log page warns of unsaved changes when closing/reloading in Firefox [DMAS-75430] - Deck Log keyboard entry submission occurs for all open keyboard entries [DMAS-75432] - Automatic merges from release -> main are failing in Oceans Next [DMAS-75443] - Icons from Oceans Next are missing when it's running as an OSGi bundle [DMAS-75445] - Oceans Next storybook build is failing [DMAS-75446] - Deleting a taxonomy & all its taxons sometimes fails to remove all metadata linked by foreign keys [DMAS-75464] - Storybook build fails due to SSL errors [DMAS-75472] - Incorrect Deployments being used for citations with no DOI [DMAS-75480] - Fix assemblers causing cache load errors (OrganizationResourceRole and OrganizationAgreement) [DMAS-75487] - Correct merge conflicts between release and main [DMAS-75489] - Choosing a Command in the System Console Causes the Page To Go Blank in QA with main branch [DMAS-75493] - sensor tab of device detail page is broken in QA [DMAS-75494] - Alert message "No form sections could be found using the provided" pops up when displaying forms on some pages in QA [DMAS-75501] - QA & Prod builds have a slow load time [DMAS-75508] - Authentication Keyword Typo in ONC Repository [DMAS-75510] - Dive log annotations cannot be saved after react 17 upgrade [DMAS-75532] - Quarantine or Unquarantine device does not work in QA [DMAS-75534] - CSV/JSON search failures in QA for "getAuthor" [DMAS-75543] - The SeaTubeConfiguration page has strange "No Taxonomy (Expedition)" inheritance behaviour [DMAS-75566] - ONC Light driver logs warning on start. [DMAS-75574] - Device Dropdown (DeviceActionMaintenance) doesn't populate [DMAS-75588] - Publication date in citation text is inaccurate [DMAS-75615] - Captured time is incorrect (which is local time), but after saving the annotation, the timestamp in the annotation table is correct (which is UTC time). [DMAS-75637] - Take Snapshots not working in SeaTube on QA [DMAS-75642] - Recording Video not working in SeaTube on QA [DMAS-75645] - Device Listing page is blank in QA [DMAS-75662] - Deck Log crashes when annotation edited in a specific order [DMAS-75665] - Search failure in QA automation for createCitationInfo [DMAS-75666] - Newly-Created Task Does Not Appear in Task Tree Until it has a Record in the TaskSchedule Database Table [DMAS-75682] - Deployments to qadivelogger3.onc.uvic.ca are failing to install bundles [DMAS-75683] - Baynes Sound Serial Expander Can - Number Format Error [DMAS-75687] - Fix incorrect timerangevalue in File Management [DMAS-75695] - Pagination Broken On AnnotationsSearchV2 table [DMAS-75698] - SiteDeviceSubsetMaintenance page fails to render in QA [DMAS-75704] - Scheduling post-process-arctic-buoys-parser-job (Job Id: 114) is Aborted with Errors in QA, but works in prod [DMAS-75710] - Search failure in QA automation for TS netCDF incorrect number of arguments [DMAS-75716] - The function crypto.randomUUID isn't available on divelogger machines [DMAS-75718] - QAQC page is empty in QA [DMAS-75719] - Cast popup closes when attempting to view historical casts on Community Fishers Map [DMAS-75722] - Cannot Add Resource Role on Device Detail Page [DMAS-75732] - QAQC and other 4 react pages form is empty in QA User Story [DMAS-67558] - As a scientific programmer, investigate and refactor to support latest version of MATLAB (R2022b) [DMAS-73748] - As a software developer I would like creation of overlapping casts to be blocked at the database level [DMAS-74165] - As a Data Specialist, I would like modification to automated geofencing QAQC test [DMAS-74212] - As a software developer I would like to support Matlab version R2022a/b with matlab-as-a-service [DMAS-74848] - As a software developer, I want to remove obsolete and deprecated code from GroupPrivilegeManager and DmasUserManager so I can streamline development [DMAS-75274] - As a data steward, I would like the devicetypeid and devicetypename exposed in DeviceListing and update the page Task [DMAS-39311] - Disable Equinox logging in /usr/local/gemini/logs [DMAS-73719] - Upgrade oceans next to React 17 [DMAS-73847] - ST - rename "Advanced" button (takes you from annotation filter to search) [DMAS-74689] - Order of casts in lasso selection tool not consecutive [DMAS-74690] - Change the default date range in File Management [DMAS-75150] - Convert existing code for Spectrogram widget to utilize Typescript, react hooks & cypress testing [DMAS-75169] - provide a demo to Data Stewards on the functionality and confirm tool meets their needs [DMAS-75284] - Create Scheduled Job For processing cassandra cql error files [DMAS-75297] - Don't log redirects to the login page [DMAS-75310] - as a Data Steward, I need the job 229-bpr-import to be modified for it to work [DMAS-75314] - Convert existing code for Audio Player widget to utilize Typescript [DMAS-75348] - update qa post refresh script with sql for eew mtc test site [DMAS-75357] - Add message when incorrect id entered for device id for /DeviceListing [DMAS-75382] - Create unit test for append_pdfs [DMAS-75384] - Refactor DatasetManager keyword code for simplification and cleanliness [DMAS-75398] - Provide a list of devices connected to the ship to the Deck Log so the resource list can be populated in Manual Entry [DMAS-75405] - Upgrade cypress and related tools [DMAS-75416] - See if possibly extraneous method in DeviceSensorSearchTreeUtilI can be removed [DMAS-75423] - Update/replace attribution fields in netCDF products with citations [DMAS-75449] - Support Wiring the Abyss page in ONC web site with the new Deck Log app [DMAS-75451] - Update SearchHistoryTable to allow sorting on certain columns [DMAS-75454] - Add source column to SearchHistoryTable [DMAS-75457] - adding station map to all events in Earthquake Catalogue [DMAS-75462] - Make some code and design changes to SearchHistoryTable [DMAS-75469] - GoogleMap function not working [DMAS-75470] - Display the ship's positional data on the deck log page [DMAS-75506] - Improvements to the Earthquake catalog job [DMAS-75518] - Change the quick entry widget's keyboard entry toggle key [DMAS-75560] - Update eventdefinition hist table to track changes to the device selector json column [DMAS-75569] - Update Jenkins cleanup scripts [DMAS-75576] - Update link for Thomson De-tided data product option [DMAS-75593] - Add heap space monitoring to production task machines [DMAS-75624] - Abort `deploy_onc deploy --watch` if a FATAL message is logged [DMAS-75630] - Validate Jenkinsfile syntax in feature branch CI builds [DMAS-75641] - remove date range limit on doiDataset search query [DMAS-75643] - Remove Record button for playlists [DMAS-75656] - Make the Search History table header bold [DMAS-75657] - Add a loading bar that shows when searches are loading [DMAS-75658] - Update non-DOI/non-minted citation text to exclude ONC when having roles of custodian, distributor, publisher (DP code) [DMAS-75711] - Error Logs about pnsn data without an iris mapping should be warning logs [DMAS-75725] - Lots of null pointer exceptions on qaextshore1 [DMAS-75727] - Handle citationText response in case of no data product mapping (DP code) Requirement [DMAS-75427] - Requirements for System to Maintain Colour Schemes Design [DMAS-75409] - Design for System to Maintain Colour Schemes Implementation [DMAS-73803] - Add EXCLUDE Clause to SiteDeviceSubset table so overlapping SiteDeviceSubsets Cannot be created [DMAS-74150] - Rebuild Oceans 3's runtime environment ("Gemini") [DMAS-74151] - Add an option to deploy_onc to select the version of Java to use for build and deployment [DMAS-74457] - Create database tables for Organization Agreement Resources [DMAS-74458] - Create DAL layer for OrganizationAgreementResource [DMAS-74681] - Move organization agreement code out of onc-core [DMAS-74907] - Convert SeaTubeConfigurationPage to Functional Component [DMAS-74994] - Add devicetypeid and devicetypename exposed in DeviceListing and update the page [DMAS-75012] - Disentangle UM and CU persistence bundles [DMAS-75094] - Remove siteDeviceId column from erddapdataset and erddapdataset_hist trigger [DMAS-75187] - Prefer DmasUser over user IDs where possible in DmasGroupManager [DMAS-75189] - script to create two new table for geofencing qaqc [DMAS-75212] - Create service to generate processing comment for cast dataproducts in Java [DMAS-75263] - Drop ErddapSensorAttribute table [DMAS-75299] - Conditionally install bundles in Equinox instead of manually excluding some bundles [DMAS-75326] - create scheduled job to store iris meta data in our database [DMAS-75327] - Update PNSNMessage to include iris meta data [DMAS-75334] - Change agreement management code back to assemble with beans [DMAS-75335] - Fix managers in agreement management to use domain objects [DMAS-75339] - Clean up temp files created by unit tests [DMAS-75363] - Clean up wowza-date-time-generator README and Javadocs [DMAS-75367] - Rename the production runtime to Equinox [DMAS-75396] - Update deployment with new script names [DMAS-75431] - Don't require passing an observatory ID to GroupPrivilegeManager when it can be derived [DMAS-75477] - Modify DOIDataset Service Update Operation to allow updating of Related Identifiers [DMAS-75482] - Remove dependency on Matlab Engine API for Java [DMAS-75503] - File archiver task should always reject zero sized files [DMAS-75516] - Change output of Matlab logs from UDP port to processes output stream [DMAS-75520] - Clean up documentation links on OpenAPI page [DMAS-75533] - Update DeviceService.js in oceans-next to Typescript [DMAS-75540] - backend code to implement geofencing qaqc [DMAS-75558] - Implement ability to store SiteDeviceSubsetDatasets in ISO19115datasetrecord [DMAS-75561] - Support deploying Oceans Next to Equinox [DMAS-75562] - Deploy Oceans Next to Equinox in integration tests when built with Java 17 [DMAS-75594] - Support a custom delay after taking a heap dump [DMAS-75626] - ONC Implementation for incorrect deviceID warning [DMAS-75627] - Oceans next implementation for invalid deviceid warning [DMAS-75632] - Fix automatic merge failure from release to main [DMAS-75633] - Validate Jenkinsfile syntax in Oceans Next [DMAS-75654] - Add link to api documentation on open api main page Test [DMAS-69931] - Test ST annotation in live mode [DMAS-69933] - Test the archived video files have the correct timestamp in the file name [DMAS-74655] - Test matlab-as-a-service with R2022a in QA/QA2 and time spent making/commenting on systems tickets [DMAS-75345] - Test R2022a data product in QA search automation Bug (ST) [DMAS-75279] - False positive comparison failures for netCDF files in search automation for R2022a/b [DMAS-75513] - Fix deviceType bug [DMAS-75625] - qaweb2 is logging errors while checking group membership [DMAS-75699] - Double log of "Acquiring MatlabExecutionEngine for this job run" from MatlabFilePostProcessor [DMAS-75750] - java_home is set to an invalid directory on ncdeploy Documentation [DMAS-75447] - Update documentation for netCDF citation updates
March 2, 2023
Minor release: bug fixes for citation text (searching for date range on archived files causes crashes, fixes for incorrect deployments and missing attributions), annotations, video and hydrophone post-processors
Update Citation in csv data product header to include dataset DOIs
Add one data product icon on Data Search page
Improve search tree loading time (improve generation time, and payload size), affects most search trees
Improve user search on User Management page
Deprecation functionality for Task Management
Automated geofencing QAQC test
Create trx tables for qaqc related database tables
UpdateRdiAdcpComplexParser to ignore invalid data like Negative ArraySize
Fixed topology extension cache so extension Ids should always show up on the topology page (also fixes duplicate extensionIds getting saved)
Calibration formulas now support $null for example: if($77062upto21800m=1,$73462,$null)
Selenium and Cypress tests added/updated
Bug Fixes
Camera video archived with filesource=null
TopologyCache
Min/max qaqc flags for data gaps in csv data product
Generic File Post Processing job
SeaTube
Major features released for Deck Log application
Continue work on Map Layer and WORMS update
Annotation ingestion for Cordell Bank
One bug investigation (missing file resolution flag for some videos)
Data Products
Changes to support an upcoming MATLAB version update: backend java changes, videoQAQC job can now run in current MATLAB version with added error handling
QAQC structure added to time series MAT files containing information and flags for all tests applied to the data
Added a new option to disable (by default) on-the-fly generation of audio formats, this reduces the likelihood of users filling the working space and running slow searches
Minor updates for a plotting and PDF printing edge cases
Community Fishers
Corrected Task Management tree miss-alignment
Corrected blue icons to green for unassigned casts after lassoing and then clearing selection
Corrected odd messaging about FTP transfer in the DataProductDelivery API
Fixed failing UI test in Plotting Utility
Acoustic Instruments Data Viewer
Convert existing code for Spectrogram widget to utilize Typescript, React hooks & Cypress testing
Internal projects
Preparing to run in Java 17 in QA
Update default git branch name ("main" replaces "master")
CIOOS
Data model restructuring for ERDDAP
OBIS Export - fixed issues with event.csv, occurrence.csv and meta.xml content
CKAN
fixed issue with duplicate EOVs
support comma separate list of site device ids in CKAN metadata upload job
ExperiMINTED
Added Search History (PID navigator) prototype page which shows last 100 searches made by a user after 2022-12-10
Instrument search - fix issue with search path not showing in search cart
Earthquake Early Warning
Fix MMI contours on the earthquake detail page, used to be 50% larger than they should be and then as of last month are 100% larger than they should be
Move eewclient and cacheloader queues over to the new jms framework that was created as part of the multiqueue project
Earthquake catalog page now has all earthquakes with magnitude over 3.0 (in area and time of interest)
OpenAPI
The openAPI page can now be accessed through the url /api in addition to /OpenAPI
The openAPI page now has a loading indicator while a request is being processed
Bug [DMAS-73981] - As a data steward, I would like some bugs fixed for the occurrence.csv for OBIS [DMAS-74012] - As a data steward, I would like some bugs fixed for the meta.xml for OBIS [DMAS-74691] - Icons for unassigned casts render blue after lassoing and then clearing selection [DMAS-74886] - Data gaps not marked with correct min/max QAQC flags in CSV minmax avg test cases [DMAS-74948] - Running a dataproduct search that produces collated PDFs twice locally results in duplicate PDFs being collated into one file [DMAS-74953] - csv data product doesnt handle data ratings of 0 correctly [DMAS-74981] - Control icons are missing from the simulator console [DMAS-74982] - Video widget refresh crashes dashboard [DMAS-74987] - Junction box alarm settings page is looking for a missing file processing.gif [DMAS-75070] - Data Search plots (png, pdf) missing data for "Depth" sensor when PU shows data. (work related to Navigation data commissioning work in DATA-4562) [DMAS-75100] - OSGi tests intermittently time out in Jenkins [DMAS-75137] - Verification of RemoteCacheReloadServiceActivatorImpl failed on multiple shorestations [DMAS-75141] - Task Management tree is miss-aligned [DMAS-75178] - EEW Correlator at eduCloud logging issues with EEWClientActivator [DMAS-75179] - Gap filling in CSV/JSON no longer respects the sample rate, fills at 1 sec intervals [DMAS-75186] - Topology ExtID field is buggy - concatenating things that it shouldn't [DMAS-75193] - Oceans 3.0 gradle builds intermittently fail with an OutOfMemoryError [DMAS-75214] - Decklog AnnotationTable Reset Button Bug [DMAS-75227] - Fix MapLayer ServiceActivationTest [DMAS-75243] - Deck Log title is not correct, is only displaying "Screen X of Y" [DMAS-75244] - Cross-window communication is broken in the Deck Log [DMAS-75255] - Fixed camera video is archiving with filesource=NULL on a regular basis [DMAS-75258] - Deck Log link from Expedition Management not working in webpack [DMAS-75260] - ColumnChooser menu in StatelessTable appears detatched from the table an only opens in the top right corner of Deck Log [DMAS-75267] - Oceans 3 CI builds sometimes fail with "The message received from the daemon indicates that the daemon has disappeared." [DMAS-75283] - Instrument search drops path info in cart (was: Instrument search Java CSV data product truncates its DateTo and drops path info in the search cart) [DMAS-75287] - Couldn't create a new or update an existing annotation for deck log in QA [DMAS-75288] - The browser tab is closing when reloading the deck log page [DMAS-75290] - Validation is missing for many cases in the Deck Log's Annotation Entry form [DMAS-75298] - Attribute value fields in Annotation Entry display incorrectly sometimes [DMAS-75301] - Add Deck Log page logo same as other pages [DMAS-75309] - Deck log annotation entry's date validation is incorrect [DMAS-75312] - Data Search logs an error about a missing image [DMAS-75316] - video file QAQC no longer detects corrupt video file [DMAS-75337] - Jenkins Java build agent is out of /tmp space [DMAS-75366] - Fix error in matlab codarnetcdfpostprocess [DMAS-75369] - Fix dataset manager to ensure taxons are actually distinct [DMAS-75371] - Autocomplete is not compatible with Data source selector [DMAS-75374] - Dates are shown in Pacific time instead of UTC, also dateFrom is displayed for dateTo [DMAS-75375] - Device Control buttons have flipped gradients [DMAS-75390] - ErddapManagementTable does not display siteDeviceId or deviceId when accessed via deeplink [DMAS-75397] - NullPointerException for sensor when reload cache in dev and qa [DMAS-75434] - Insertion into parserdefinition Table does not trigger an Insert Operation in the parserdefinition_trx Table [DMAS-75439] - Error On JunctionboxBreakerService in QA [DMAS-75459] - Oceans Next deployment failed on release/23.01.000 User Story [DMAS-57229] - As a software developer, I'd like the /DeviceListing page updated to React [DMAS-69901] - As a software developer, I want to rename the default git branch from "master" to "main" for consistency with git hosting tools [DMAS-74664] - As a dev, I would like to update DataPreviewManagement Cypress code to fit newer testing-library form [DMAS-74858] - As a dev, I would like to create a method for deprecating jobs that is visible through the UI Task [DMAS-64430] - As a dev, I would like to improve Data Search loading time and reduce it's data overhead [DMAS-73999] - create a data search icon for the .apt files [DMAS-74143] - Improvements for user management user search [DMAS-74440] - Citation line text in CSV data product header replaced with $citation.citation [DMAS-74465] - Odd messaging about FTP transfer in the DataProductDelivery API [DMAS-74609] - Create new manual entry form component [DMAS-74852] - There are duplicate EOVs/ECVs listed in CKAN records when multiple sensors are mapped to the same keyword, we want only distinct EOVs/ECVs added to the landing page [DMAS-74872] - Start all OSGi bundles in QA and prod [DMAS-74943] - Update attribution structures and comments in MATLAB data products to use/be compatible with DOI citations [DMAS-74984] - Remove some unused camera control and data search Javascript and CSS [DMAS-74986] - Fix Oceans 3 unit tests failing intermittently in Jenkins [DMAS-75076] - Make basic project templates for persistence bundles [DMAS-75080] - Disable hydrophone on-the-fly audio data conversion by default with a new option [DMAS-75081] - Add a QAQC result information to time series scalar MAT files [DMAS-75085] - Update database script commit process in the README [DMAS-75118] - Button Set Widget should save its configuration (currently open button sets) to local storage [DMAS-75120] - Create a communication diagram to show how the widgets in the deck log communicate [DMAS-75121] - Move Organization web backend to usermanagement [DMAS-75181] - Add Content Refresh Button to DeckLog Annotation Table [DMAS-75183] - Reduce Oceans Next coverage temporarily [DMAS-75185] - create trx table for qaqc, qaqcformula, qaqctestgroup,qaqctestgroupdetail tables [DMAS-75188] - Add default resource selection for Deck Log to the SeaTubeConfiguration page [DMAS-75190] - add constraint on im_topologyextension table for unique combination of (topologyid, extensionid) [DMAS-75191] - Add Auto Reload Menu Option to DeckLog Annotation Table Widget [DMAS-75201] - As a Data Steward, I need to be able to assign NULL values to sensor data when a condition is met in a JEP function [DMAS-75221] - Allow users to delete annotations using the Annotation Table Widget [DMAS-75223] - Allow users to "copy link" to an annotation in a Deck Log [DMAS-75226] - Add global default resource for Deck Log (No Taxonomy (Expedition)) [DMAS-75235] - Create default layouts for the Deck Log for both logged in and anonymous users [DMAS-75238] - Saving or updating an annotation from the Manual Entry widget should trigger the table to refresh [DMAS-75248] - Add organizationId and cruiseId to the payload of CruiseService operation 25 [DMAS-75249] - Update CruiseService call to use operation 25 in the Deck Log so users don't need to be logged in [DMAS-75250] - Add a cruiseId parameter to the seatube/permissions service so that permissions for deck log annotations can be retrieved [DMAS-75265] - Load default attributes for taxons when selected [DMAS-75272] - The "copy link" feature will scroll to and highlight the requested annotation in a Deck Log annotation table [DMAS-75275] - ONC Lights Driver - Modify remote commands to retry if not successful [DMAS-75277] - Seascript - add support activateDriver and idleDriver commands for all drivers [DMAS-75285] - Investigate January 28th missed earthquake detection [DMAS-75289] - Improve the annotation table's default configuration [DMAS-75293] - Allow CKAN Upload Job 366 to take a comma separated list of site devices to run with [DMAS-75303] - Improve Deck Log layout for users with write permission [DMAS-75304] - Improve the resource fields in Annotation Entry [DMAS-75308] - Sort the attributes before populate into the form [DMAS-75311] - Update annotation deletion call to handle cruises [DMAS-75328] - Make Deck Log layouts the same across all decklogs instead of per cruise [DMAS-75329] - Fix CSS for background color of deck log [DMAS-75332] - Remove Dive as a Resource Type from Deck Log's Annotation Entry form [DMAS-75338] - Align the action icons in the Annotation Table [DMAS-75354] - Alphabetize data product options from the data product public api service [DMAS-75395] - Protect the Oceans Next deployment build against changes to npm script names Implementation [DMAS-57879] - Update backend to display react version of page [DMAS-73905] - postprocess Kongsberb SMB files job on demand [DMAS-74687] - Create Deck Log App and Dashboard [DMAS-74698] - Change all finder statements to match newer style [DMAS-74699] - Fix cypress tests [DMAS-74878] - Add warning message to reprocess console [DMAS-74889] - Create service call to retrieve user groups for Group Selector [DMAS-74892] - Set the Java version to 17 in CI [DMAS-74900] - Merge DmasGroupManager.isDmasAdmin and DmasGroupUserManager.isMemberOfAdminGroup [DMAS-74914] - Create URL validation field component [DMAS-74920] - Implement Service to Return Data Search History [DMAS-74930] - script for a job to postprocess on demand [DMAS-74934] - Update default branch name in Oceans 3 deployment scripts [DMAS-74935] - Update default branch name in Oceans Next deployment scripts [DMAS-74940] - Update the default branch name in the Data Products deployment script [DMAS-74942] - Update the default branch name of each repository [DMAS-74988] - Create SeaTube service call to retrieve SeaTube organizations [DMAS-75008] - Disentangle DmasGroupManager and DmasGroupUserManager [DMAS-75072] - Add support for multi-window layouts to Deck Log [DMAS-75087] - Add resourceTypeId and resourceId to erddapdataset table - SQL [DMAS-75088] - Drop usage of siteDeviceId and instead use resourceId and resourceTypeId with erddapdataset - Java [DMAS-75090] - Build the runtime environment's dependency list from Maven repositories [DMAS-75103] - Wrap the new manual entry component in a Widget and add to Deck Log [DMAS-75104] - Add a listener that the manual entry for will populate with the correct data when a button set button is clicked [DMAS-75107] - Create a widget that wraps the annotation table component [DMAS-75108] - Make the edit button on the table communicate with manual entry for editing annotations [DMAS-75109] - Add service method to get annotations for a cruise instead of a dive [DMAS-75113] - Connect back-end service to front end code [DMAS-75114] - Add a button in Expedition Management to link to Deck Logs at the cruise level [DMAS-75115] - Add a flag to the cruise page to indicate that the cruise is "SeaTube Ready" [DMAS-75122] - Make back end changes to show the new dedicated Deck Log page [DMAS-75124] - Allow manual entry/the deck log to save/edit annotations for a cruise [DMAS-75129] - Add column to cruise table for "Deck Log Ready" [DMAS-75135] - redo the open api implementation of the data product delivery request service [DMAS-75140] - Refactor the ManualEntryForm's ManualEntryFormContext to use ServiceContext [DMAS-75144] - Rename 'isDeckLogReady' column to 'ready' on cruise table [DMAS-75151] - Make front end changes to show the new dedicated Deck Log page [DMAS-75152] - Add Quick Save to Button Set widget to auto-save annotations [DMAS-75155] - Remove temporary code that tries to look for a dive labelled as a deck log [DMAS-75160] - Specify the scope of OSGi console commands used in the Oceans 3 deployment script [DMAS-75161] - Specify the scope of OSGi console commands used in the Oceans Next prod-ish deployment script [DMAS-75164] - Update backend Expedition Management tree call to include deck log readiness [DMAS-75174] - Create method to display deprecated jobs in task management [DMAS-75175] - Create button to deprecate and restore jobs [DMAS-75176] - Update existing deprecated jobs in database to use consistent method [DMAS-75184] - Update Expedition Management expedition details call to include deck log readiness [DMAS-75197] - Java code for two geofencing qaqc table [DMAS-75199] - Implement search history page [DMAS-75219] - Support Caching for FormSectionResource Table [DMAS-75220] - Add indexes on resourcetypeid and resourceid columns in FormSectionResource table [DMAS-75222] - Allow AnnotationEntryWidget to Save Automatically when Quick Save is On [DMAS-75225] - Return searchSourceId With QueryPids [DMAS-75229] - Update the data product discovery service to return data product options [DMAS-75262] - Remove dal for ErddapSensorAttribute [DMAS-75266] - Remove erddapsensorattribute_datasetid_fk from erddapsensorattribute [DMAS-75278] - Add an indicator that the api is processing a request [DMAS-75281] - Add search history to entry.jsx [DMAS-75282] - Add search history to web.xml [DMAS-75346] - Change version check in LogWriter to check for R2022a Test [DMAS-74523] - Check to see if we can retire MATLAB R2014a completely [DMAS-74945] - Test R2022b data products in QA search automation Bug (ST) [DMAS-74682] - Search failure notifications fail for new instrument searches [DMAS-75009] - Minor event.csv changes [DMAS-75010] - Add survey footprint [DMAS-75192] - Video file QAQC matlab job is failing to produce results [DMAS-75259] - Kongsberg rotary sonar plots drop the angle labels in R2022b [DMAS-75315] - Minor issues in CSV/JSON citations found by search automation in QA [DMAS-75317] - Change DOIDatasetService payload queryPidId to queryPid [DMAS-75353] - Query PID not showing in Search History table Investigation [DMAS-75116] - Investigate what the "Active" flag on the cruise page does and if we could reuse it Documentation [DMAS-73898] - Write documentation for the new Stateless Table (and Table) components [DMAS-75095] - Update attribution documentation on DP home and other DP pages
January 30, 2023
Minor release: topology and earthquake catalogue fixes
Added missing data product options to the open api page for data product delivery service
CIOOS
OBIS Export now fully supports new annotation review schema
Data Policy
Module restructure - moved code to new module, Metadata Products - MP, which houses functionality around generating outputs from metadata, e.g. ISO 19115
ExperiMINTED
Instrument searches now use search_dtl table to enable these types of searches to have a query PID
React 17 Upgrade
Nearing completion, changes include faster builds
Community Fishers
Fixed Date Filter on geospatial map for Webpack
Drop siteDeviceId column from im_iso19115datasetrecord
Community Fishers App
Create CF App Version 3.2.9
Fix errors when building community-fishers in Jenkins
Increased the text size on the data visualizations
Create and test new Community Fishers App compatible with AML Firmware version 3.1.2
Acoustic Instruments Data Viewer
Add UI option for the spectrogramFrequencyUpperLimit dpo in the hydrophone toolbox
Modify dataviewer widget to give accurate dates after shrinking
Data Products
Added new Satlantic Radiometer calibration
Fixes to support upcoming MATLAB R2022b upgrade, including an upgraded logging system:
support new warn once method
find and replace all disp and warning calls with new equivalent in our dataproduct code
implement matlab changes to send logs to UDP socket
Map and test device-level CSV/JSON time series scalar data products for Node and Junction Box devices
Testing and minor changes in support of new min/max options for time series scalar data products
Support instrument searches that use the search_dtl table (so that these searches can have queryPID / DOIs)
Handle erroneous ASL echosounder data (special case where it's firmware was corrupted and it dropped two channels)
Update logos on plots to new ONC blue
Bug fixes: seismometer data products: IRIS webservice bad formatting (problem on their end but we can handle it), Didson bad data