You are viewing an old version of this page. View the current version.

Compare with Current View Page History

« Previous Version 931 Next »

This page contains the current year's release notes and new features, primarily for Oceans 3.0, as well as any applications created/maintained by the ONC software development group, including mobile Apps and desktop/PC applications. In progress project status may be presented as well. The information below is written in plain language as much as possible. "Major" releases include all completed items at that time (monthly), while "minor" releases are updates to the previous major release with bug fixes and specific features. Detailed release notes are available on internal confluence pages (internal users only).

May the 4th, 2023

Deploy a major release we do.

Maintenance

New Features or Improvements

  • Remove yellow color from Plotting Utility color schema
  • Added a new page for maintaining DeviceType metadata
  • Search hydrophone page UI improvements to prevent users from committing extraordinarily large searches
  • Dialog box on Organization page now draggable
  • Support new ferry machine
  • Hydrophone calibration m-file upload fills out all needed sensitivity vectors
  • Remove "only run one task machine at a time" text on ReprocessConsole
  • Change DMAS log level from info to debug for DatastaxScalarDataDAO
  • Remove IP info on Event tab of DeviceDetail page

Bug Fixes

  • Improve Data Search and Search Hydrophone page loading times by removing a no longer needed archive query
  • Google map API key is new generated and implemented in Oceans 3.0 and Oceans-next
  • Fix pamguard batch page to only show pamguard batch tasks
  • "Failed to retrieve sensor info" error on PVCS view page
  • Remove duplicate date in CSV data product for averaging processing type

Internal projects

  • Fix handling of access restrictions in /api/archivefiles?method=getByDevice
  • Return an error message when an API service call fails for internal reasons (http 500 error)
  • Java 17 is ready for testing, this includes various preparation and improvements to deployment processes and scripts
  • Minor fix to data availability calculations (probably not noticeable to users)
  • React upgrade: add more automated tests around Leaflet to better test behaviour after upgrade

CIOOS - Community Fishers

  • Improved maintainability and robustness of ERDDAP
    • Merge ErddapDatasetService into ErddapManagementService, i.e. ErddapDatasetService has been removed
    • Refactor datasets.xml generation code
  • Add support to store and display Site Device Subset ERDDAP datasets

Data Policy

  • (in-progress)  Organization Agreement services to support associating site devices with agreements

ExperiMINTED 

  • (internal) Improve maintainability of Search History page
  • (in-progress) Add paging support to backend Search History service
  • (in-progress) More backend support for pi_relatedidentifiers

Data Products

  • Improve display of sample period data in the header of time series scalar ODV
  • Add "C" channel for some seismometers and add non-cardinal directions to option set
  • Add an "index" to connect qaqc final flag values to the qaqc test that contributed that final flag, available in time series scalar MAT files only. 
  • Allow writing MAT files greater than 2 GB (switches to v7.3 MAT files for large sizes), instead of dropping data, also throws lots of warnings. Our MAT files should never be more than ~ 1 GB.
  • Small changes: live raw data access fixes, refactoring due R2022b upgrade, search status reporting improvements for hydrophone data when data is not available via format conversion, improve backscatter calculation for ADCPs, remove filepostprocessor.class parameter for tasks, java AD file retrieval fix for file modes, exclude QAQC structure except for non-resample time series scalar MAT files.

SeaTube

  • Added support for WTA page in Oceans 3.0.
  • Added Oceans Next deployment info in our System Console, so we can tell the remote server versions.   
  • In-progress: Map Layer, supporting more than 10 on-ship server, PlayList management app, UI improvements and tests
  • Some small bug fixes

Community Fishers

  • Support multiple fluorometer piggybacks on CF device package
  • Corrected lassoed cast date filtering on CF map
  • Parameterized progress indicators/download buttons in cast popup to single component

Acoustic Instruments Data Viewer

  • Corrected population of toolbox options and limits
  • Added FLAC Support to Audio Widget with use of HTML5 audio element
  • Fixed fails to display images for valid data

Earthquake Early Warning

  • Fix some bugs where earthquake catalog job might sometimes miss an NRCan/USGS detection
  • Potentially fixed the issue where we lose data during an earthquake detection
  • Added lls delta trms value to earthquake details page as well as what algorithm epi/mag algorithm was used for each notification
  • Removed apple push reaction from eew event (it never worked outside of the test phone)
  • Update event maintenance page to support posting more than 1 MB data (EEW event definition got to large when adding PNSN devices)

OpenAPI

  • Changes to service parameter values now persist when switching between services
  • Data product request service parameters dpRunId and dpRequestId are now auto populated based on the response from the request and run services
  • dataProductDelivery download method now downloads the file rather then showing the file contents in the response view (response view is now hidden)
  • Make OpenAPI page inaccessible for anonymous users, redirect them to log-in page (all API requires a user identifying token)
  • Remove some confusing examples in the OpenAPI content
  • Add OpenAPI wiki link on Landing Page API help button
  • Add serchresultcomment info in the return of dataProductDelivery

Instruments

  • Parser Definition Edit Screen - Improved Usability:
    • Parser changes are not automatically reverted if attempt to save is not successful.
    • New button 'Run Tests', helpful for iterative changes to the parser.
    • When a test failure occurs, the fail reason is displayed. It will show the parser version, test number and fail reason.
    • Tests do additional checks such as verify test is parsed with the parser version where it is specified and checks if piggyback is configured correctly.
  • Acoustic Scintillation simulator now has ability to simulate file transfers.
  • Fixed problem where PVCS event was causing spurious logging in the raw data log.

Tickets Released: Oceans 3.0: 23.04.000 (accessible to internal users only). Total: 152. Automated Testing: AT.23.04.000, total: 36.

Bug

  • [DMAS-58090] - SeaTube playlist 385 displays an error snackbar "e[(intermediate value)] is undefined"
  • [DMAS-73041] - Annotation List Filter only works with lower case attribute values
  • [DMAS-73121] - Attribute Data not cleared when taxonomy is cleared
  • [DMAS-73670] - CSV files have duplicate date when processing type "averaging" is used
  • [DMAS-74556] - Data Search has very slow loading for hydrophones in the data product selection
  • [DMAS-74996] - The PVCSSPeedEvent continues to send driver commands even when driver is stopped
  • [DMAS-75729] - Wav files from on the fly conversion have error(s) in the header?
  • [DMAS-75835] - Fix failing test in Telnet
  • [DMAS-75880] - Discrepancy between AZFP data products - MAT and "raw" ASL files are inconsistent
  • [DMAS-75903] - Cypress coverage not available for typescript files
  • [DMAS-75912] - Data Player Widget does not populate toolbox options and limits
  • [DMAS-75931] - PAMGUARD batch tasks doesn't show tasks after window refresh
  • [DMAS-75963] - Vanessa's playlist - issues with download
  • [DMAS-76004] - qaeewarc1 reported an error on startup: Cannot invoke MetricsCounter.addToCounter because metricsCounter is null
  • [DMAS-76005] - Timestamp and Action columns should be fixed in Deck Log table
  • [DMAS-76010] - DeckLog Annotation Table Sorting Icon on "TimeStamp" column is initially in wrong direction
  • [DMAS-76013] - Text in DataPreview card can overflow container
  • [DMAS-76021] - Filesource was null on archived video files in DEV database
  • [DMAS-76026] - Unable to change page size on annotations table
  • [DMAS-76044] - Non-DOI/non-minted citation text missing "Society" on publisher name
  • [DMAS-76047] - PnsnSenderPreprocessorServiceActivator doesnt handle sites with no searchtreenode
  • [DMAS-76050] - Non-DOI/non-minted citation text incorrect for CBO test case
  • [DMAS-76054] - Java AD file retrieval searches return a few incorrect results
  • [DMAS-76059] - dcweb2 is logging PSQL errors from ArchiveFileStateDAO
  • [DMAS-76061] - In deck log Annotation Entry widget, the resource dropdown shouldn't have ROV and devices connected to that ROV
  • [DMAS-76078] - Failed cache reload after changing a parser definition using UI
  • [DMAS-76081] - Sensor names and units on Cast Scalar Multi Profile Plot can collide
  • [DMAS-76109] - Navigating to the OpenAPI Page as an Anonymous User Results in a Redirect to the Insufficient Privileges Page
  • [DMAS-76126] - Remove OpenAPI Examples From the Data Product Delivery Run, Status, and Download Methods
  • [DMAS-76138] - Fix filename used to extract live log files
  • [DMAS-76141] - Organization Draggable Dialog Should Not Allow Simultaneous Opening of Both Create and Edit Dialogs
  • [DMAS-76144] - AslEchosounderReader has identical operands error in variable type check
  • [DMAS-76151] - Some matlab DP that depend on java streaming raw log files are timing out in QA search automation
  • [DMAS-76153] - Disconnect apple push notification and driver command reaction from EEW event
  • [DMAS-76154] - DataPlayer fails to display images for valid data
  • [DMAS-76162] - Fix sorting bug in DeviceType
  • [DMAS-76179] - /api/archivefiles?method=getListByDevice... ignores data access restrictions
  • [DMAS-76209] - Fix Jenkinsfile - remove commented steps
  • [DMAS-76229] - Integration Testing fails to checkout feature branches of Oceans 3
  • [DMAS-76232] - Inconsistent "backscatter" values for Holyrood Nortek AWAC data products
  • [DMAS-76256] - Cassandra raw files failed 2023-04-25 UTC
  • [DMAS-76259] - Difference in Nortek ADCP data products found in search automation - dataQualityComment
  • [DMAS-76273] - Timestamp is reset when stopping then playing live video
  • [DMAS-76290] - Cast Date Filter on Community Fishers Map Not Filtering
  • [DMAS-76322] - Fix broken unit tests in oceans-next build for 23.04.000

User Story

  • [DMAS-57444] - As a system operator, I want to run Oceans 3.0 on Java 17 so that the system is secure
  • [DMAS-75410] - As a data steward, I would like a page where I can easily see and manage Device Type information
  • [DMAS-75728] - As a software developer, I want the Oceans Next version to be displayed in the System Console alongside the Oceans 3.0 version
  • [DMAS-76127] - As a deployment engineer, I want to be able to start and stop several Oceans 3 hosts at once

Task

  • [DMAS-74560] - Search Hydrophone Data is able to generate long time range searches without any warnings
  • [DMAS-74830] - Hydrophone data product request return different messages in Oceans3.0 and via API call
  • [DMAS-75393] - Can ErddapManagementService and ErddapDatasetService be consolidated into one service
  • [DMAS-75426] - Software support for AML-6 with extra Turner fluorometers
  • [DMAS-75529] - Add TextEditor.jsx cypress tests
  • [DMAS-75612] - make edit organization or create organization panel dragable
  • [DMAS-75858] - Check all getdeviceattribute usage, add isRequired flag as required
  • [DMAS-75873] - Add logic to device attribute page for hydrophones for fixing empty entries with less calibration vectors than previous deployments
  • [DMAS-75927] - Remove filepostprocessor.class parameter from jobs that previously used task type of GenericFilePostProcessor
  • [DMAS-76017] - Seismic data product SD for high-rate data channel currently unavailble for CH* and EH* channel options
  • [DMAS-76034] - Clarify for the user "SeaTube Ready" check box - front end
  • [DMAS-76035] - Add a timeout to cypress component tests in CI
  • [DMAS-76057] - Support aligned and depth binned data ingestion for new community fishers device package.
  • [DMAS-76062] - As a ST logger, I would like to have device ID info while I am choosing a device/device data resource in Annotation Entry widget of Deck Log app.
  • [DMAS-76063] - Parameterize progress indicators/download buttons in cast popup to single component
  • [DMAS-76065] - Saved Plot in Plotting Utility Does't Save Line Colours, & no Yellow Lines
  • [DMAS-76083] - Notify a user when their API request fails because of an internal error
  • [DMAS-76110] - IP information should not show up in Device Listing Event tab
  • [DMAS-76123] - Email me when Jenkins' docker cleanup build fails
  • [DMAS-76140] - Round all magnitudes to one decimal place on earthquake catalog
  • [DMAS-76143] - Add support to the stateless table component to support "fixing" specific columns to the left and right to prevent reordering
  • [DMAS-76149] - Investigate 2023-04-13 and 2023-04-19 earthquakes
  • [DMAS-76150] - Run docker prune on all available Jenkins docker agents, not a hard-coded list
  • [DMAS-76161] - Update SearchHydrophoneData button text
  • [DMAS-76181] - Adding OpenAPI Wiki to the Landing Page Panel
  • [DMAS-76189] - Modification of the Earthquake Catalogue
  • [DMAS-76193] - Add modifyBy and modifyDate fields to the data preview managment dialog
  • [DMAS-76194] - Change modifyBy and Date to match Modified by and Modified Date column names
  • [DMAS-76199] - Improve ODV data product sample period and sample size fields
  • [DMAS-76205] - remove "only run one task machine at a time" on ReprocessConsole
  • [DMAS-76211] - Hundreds of thousands of unneeded DMAS logs for class DatastaxScalarDataDAO
  • [DMAS-76221] - Write web service tests for updated CruiseService and DiveListing calls
  • [DMAS-76225] - Reduce size of post request when updating event definitions
  • [DMAS-76248] - Handle undeletable .nfs files when cancelling a search
  • [DMAS-76280] - Update the EEWMQClient version in bitbucket
  • [DMAS-76294] - Index the final QAQC flag to it's originating test in scalar MAT files
  • [DMAS-76306] - MAT files handle file sizes larger than GB

Requirement

  • [DMAS-76072] - Document changed requirements for deck log support

Design

Implementation

  • [DMAS-69782] - Add cruise date range validation to cruise table
  • [DMAS-74139] - Add Flac Support to Audio Widget and use HTML5 audio element
  • [DMAS-75413] - Implement Test Driven Development with Cypress for DeviceType page front end
  • [DMAS-75514] - Acoustic Scintilation simulator - simulate file transfer
  • [DMAS-75557] - Add cypress tests for components to be refactored
  • [DMAS-75591] - Add filtering logic to search history filter dialog (front end)
  • [DMAS-75603] - Implement database changes
  • [DMAS-75647] - Slow down Renovate
  • [DMAS-75800] - Add a query to get all the RelatedIdentifiers for a given DoiDataset
  • [DMAS-75807] - Keep input to one service when navigating away and back
  • [DMAS-75887] - Add the Oceans Next version to the System Console
  • [DMAS-75973] - Move Filtering from SearchHistoryTable to SearchHistoryPage
  • [DMAS-75984] - Abort Oceans 3 deployment if the JVM doesn't shut down quickly enough
  • [DMAS-75996] - Rename the column "doiDatasiteId" in pi_relatedidentifier to "doiDatasetId"
  • [DMAS-76002] - Create a hook for using snackbars so we don't have to use withSnackbars
  • [DMAS-76071] - Add an option to deploy_onc to shut down a set of Oceans 3 instances
  • [DMAS-76074] - Create skeleton code for the Live Expedition Embed iframe
  • [DMAS-76080] - Add comment next to checkboxes in YUI code to inform user of what they do
  • [DMAS-76096] - Add check for unique name and code, add pagesize all
  • [DMAS-76098] - Update Unique constraint and remove leading whitespace
  • [DMAS-76115] - Add component for displaying Dive/Cruise details
  • [DMAS-76116] - Add component for the live video display
  • [DMAS-76117] - Add component that displays the annotations for a dive / deck log
  • [DMAS-76118] - Selected Plot Properties Should Override Colour Scheme
  • [DMAS-76121] - Check the response from `sudo service equinox start`
  • [DMAS-76128] - Add an option to deploy_onc to start a set of Oceans 3 hosts
  • [DMAS-76129] - Shutdown should shut down all running instances of Oceans 3, regardless of JDK version
  • [DMAS-76132] - Refactor Dataset.xml generation code for separation of concerns
  • [DMAS-76133] - Add intercardinal directions to seismometer vertical velocity options
  • [DMAS-76139] - Add a servlet to oceans 3 to host the embeddable page
  • [DMAS-76147] - Update seatubeV3/annotations web service to refactor main call to exclude sensor data
  • [DMAS-76152] - Edit SeaTubeV3 CruiseService call to use its diveId
  • [DMAS-76156] - Add a temporary command to deploy_onc to validate that Equinox init scripts are correct
  • [DMAS-76160] - Add an option to getByDevice that returns a list of files and whether more files exist past the row limit
  • [DMAS-76164] - Auto fill in dpRequestId and runId with the result from requesting a dataproduct on the openapi page
  • [DMAS-76168] - Merge ErddapDatasetService into ErddapManagementService - front end
  • [DMAS-76169] - Merge ErddapDatasetService into ErddapManagementService - back end
  • [DMAS-76170] - OpenAPI dataProductDelivery service download method should not show the response for non scalar data products
  • [DMAS-76177] - Small updates to the DeviceType page
  • [DMAS-76190] - Implement capability to display siteDeviceSubset datasets in Erddap Management and Erddap Management table - backend/YUI
  • [DMAS-76200] - Refactor tryDBquery after moving to R2022b
  • [DMAS-76208] - Update OpenAPI data product delivery parameter and service descriptions
  • [DMAS-76213] - Implement capability to display siteDeviceSubset datasets in Erddap Management and Erddap Management table - frontend/react
  • [DMAS-76216] - Add the livestream url and organization name to the payload of CruiseService (operation 25)
  • [DMAS-76217] - Update front end to support new payload field, livestreamUrl, from CruiseService
  • [DMAS-76219] - Add route to WTA page in Oceans Next
  • [DMAS-76251] - Add scientistName field to the payload of DiveListingService
  • [DMAS-76265] - Update CruiseService operation=25 to also return the livestream's deviceId
  • [DMAS-76266] - Update logic for determining the current dive in the WTA page
  • [DMAS-76270] - Update servlet to allow page access to anonymous users
  • [DMAS-76295] - Add timestamp tooltip to Live Expedition annotations on hover
  • [DMAS-76307] - Add external link to dive/deck log on the WTA page
  • [DMAS-76309] - Add error message for invalid cruiseId for WTA page embed

Test

  • [DMAS-76052] - Create test case for new community fishers device package.
  • [DMAS-76064] - Confirm data product support for new Community Fishers Device package

Bug (ST)

  • [DMAS-76048] - Update expected value for dataproducts webservice test
  • [DMAS-76099] - Automatic cache trigger failed after editing on Device Type page in QA
  • [DMAS-76226] - deploy_onc is failing to check that the destination host has free space
  • [DMAS-76252] - Typescript Error in ChatLogIngestion related to changes made to the CruiseService
  • [DMAS-76282] - Syntax errors in install_onc
  • [DMAS-76284] - Validation of qaweb2 failed with "Incorrect garbage collector -XX:+UseG1GC"... but that's the correct garbage collector

Documentation

  • [DMAS-75230] - Update Data product discovery service external documentation
  • [DMAS-76122] - Update the seismometer data product option documentation to specify which IRIS codes will be returned
  • [DMAS-76142] - Write Test Plan for WTA page

April 20, 2023

Minor release: logging fixes (to help diagnose problems), fix for videoFileQAQC, fix for archivefiles service not returning the next chunk/page link, remove some inactive EEW subscriptions.

Tickets Released: Oceans 3.0: 23.03.002 (accessible to internal users only). Total: 5.

April 13, 2023

Minor release: support for new hybrid ferries, SeaTube fix, support Community Fishers device packages with 5 piggybacks, archivefiles API fix for unexpected empty response, fix for videoFileQAQC postprocessor, remove yellow from Plotting Utility default colour scheme.

Tickets Released: Oceans 3.0: 23.03.001 (accessible to internal users only). Total: 6.

April 5, 2023

Major release

Maintenance

New feature or improvement

  • Colour schema editor for Plotting Utility
  • New device-type page (partly complete)
  • Additional constraints for "Move File" scheduled job
  • Notify PAMGUARD users of data or forward data to user before data are erased from user directory
  • Driver start date and last reading added to Device Console page
  • Replace use of unpkg react with internal react library (sometimes unpkg goes down)
  • Leaflet Upgrade (in-progress)

Bug fixes

  • "Select All" checkbox doesn't display a tooltip for scheduled jobs
  • Newly-created task does not appear in task tree 
  • Effective dateTo of QAQC display incorrectly on sensor maintenance page
  • Citation text in data products (edge cases)
  • Authentication Keyword Typo in ONC Repository

Community Fishers

  • Fixed ERDDAP: cannot retrieve data for JDCB datasets
  • Created DAL for im_siteDeviceSubsetCastDefinition_hist table
  • Removed siteDeviceId column from erddapdataset (no longer needed)
  • Added "light map" link to map and help drop down
  • Added logging to community fishers data preview generation job
  • Centered the close "X" not on station search bar
  • Removed scroll bar from long System Status messages
  • Fix for empty cor files not setting search result state and to better handle no data cases

AID Viewer

  • Create Cypress tests for AudioPlayerWidgetConfig

Internal projects

  • Removed several deprecated & broken servlets
  • Partly clean up ArchiveFile handling to try to prevent future server-crashing queries
  • Java 17: improve sanity checks in deployment scripts, prepare QA for upgrade
  • Several deployment system and developer environment improvements

ExperiMINTED

Related Identifiers

  • Bug fix: Field drop-downs populate correctly after re-opening Add Related Identifier dialog
  • Bug fix: Ensure the Dataset Landing Page refreshes correctly when new DOI is searched for

Search History

  • Add filter for query date range
  • Improvement in search history query performance
  • Bug fix: Only the DOI active at the time of the search is displayed in the history

CIOOS

  • ERDDAP title change - EN/FR text separator changed from "/" to "|" to make it consistent for the CDE CIOOS tool

Data Policy

  • Site Device Service enhancements to support queries from updated Agreement Licence UI
  • UI in progress

Instruments

Declarative Parser Changes

  • New declarative parser type KeyValuePair parser.  Suitable for devices that return data as single key/value pair readings or lists of key/value pair readings.
  • New sensor attribute used in parsing 'ParserField'.  This is used in cases where the value returned by a device maps to a different sensor depending on deployment. For example, a device reporting a value for 'port3' may map to a laser in one deployment and a UV light in another.  The ParserField sensor attribute allows mapping the reported value to the correct sensor.
  • New feature for mapping string responses to numeric responses.  Some devices return a range of string responses that need to be mapped to numeric values for storage as a sensor value. For example a device reports one of north, north east, east, etc and it needs to be mapped to a numeric value.

Axis Camera Driver

  • Approximately 15 new commands for changing settings.  Commands are available through SeaScript and through the camera control page.  Camera control page also displays the current values of these settings.
  • Take picture and related functions now supported.  Commands are available through SeaScript and camera control page.  Available resolutions are queried from the camera and displayed in the camera web page.
  • Documentation for new seascript commands: Seascript Language Dictionary#AxisCamera (internal link)

EEW

  • Earthquake catalog will now display P-wave detections from sites even if we didn't send out any notification for the earthquake
  • OpenAPI project/page complete
  • Created job to process hydrohpone .acc files

SeaTube

  • Start working on Darwin Core export for NOAA but it is paused due to missing Extended Measurement or Fact (EMoF) file
  • Continue working on Map Layer
  • Start working on supporting more than 10 on-ship servers
  • Start working on ST PlayList management app
  • Finish adding Oceans Next deployment info in our System Console, so we can tell the remote server versions. Need further testing.  
  • Some simple UI improvements 
  • Some small bug fixes

Data Products

  • Update date created attribute in netCDF and add support for this in search automation
  • Add java-side time out system for postprocess jobs, remove MATLAB internal timeout, refactor postprocess task parameter (no more need for filepostprocessor.class parameter)
  • Make postprocess tasks cancellable
  • Bug fixes: bad apostrophe in seismometer DP

Tickets Released: Oceans 3.0: 23.03.000 (accessible to internal users only). Total: 120. Automated Testing: AT.23.03.000, total: 33.

Bug

  • [DMAS-67822] - System Status message has scroll bar
  • [DMAS-73329] - Calls to SearchStatsService caused a QA crash
  • [DMAS-74717] - update DOI version for Nanometrics Titan (S/N 001110) after batch versioning
  • [DMAS-75318] - Error: Annotation content is require, add a taxon or comment
  • [DMAS-75352] - Multiple detail rows are displayed when only one search detail exists
  • [DMAS-75355] - Make UI test pass for cloneDevice
  • [DMAS-75381] - CruiseService can produce invalid JSON
  • [DMAS-75570] - File State edit dialogue spelling mistakes: "States" and "Processes"
  • [DMAS-75628] - Close "X" not centered on station search bar
  • [DMAS-75644] - Save not behaving correctly for Select attribute on Taxonomy Attribute Management page in QA
  • [DMAS-75709] - Invalid response from citationText service where it was valid before
  • [DMAS-75724] - Empty Cor files do not set search result state to no data
  • [DMAS-75731] - Attempting to Run Deprecated Or User Defined Tasks Is Not Aborted With Errors
  • [DMAS-75759] - auth.properties is overwritten by the production build, but not QA
  • [DMAS-75761] - Gradle warns about implicit dependencies between some (more) tasks
  • [DMAS-75765] - Erddap cannot retrieve data for JDCB datasets
  • [DMAS-75791] - Applied QAQC dateTo is now on Sensor Maintenance page
  • [DMAS-75794] - Renovate is failing to update package-lock.json
  • [DMAS-75823] - Weird values are appearing to DMAS derived sensors post Reprocessing when sensor exists in Raw Data Stream & parser
  • [DMAS-75834] - Landing Page is blank in QA and Prod
  • [DMAS-75836] - Capture Time input is locked to the video if video is removed from a layout that includes it
  • [DMAS-75852] - Add Related Identifier Dialog dropdown not working after being closed
  • [DMAS-75871] - Dataviewer widget fails to render after attempting to open config/toolbox
  • [DMAS-75874] - Selecting a new DOI or Query PID doesn't change parts of the Dataset Landing Page
  • [DMAS-75917] - Expedition Video Preprocessor job (id=438) complete with error
  • [DMAS-75924] - Color column in "Plot Properties" does not change color for the plot on Plotting Utility page
  • [DMAS-75930] - Choosing the google layer in Seatube V3 causes a crash due to an invalid key
  • [DMAS-75933] - DMAS Search Failed Notification: 27-Mar-2023 05:30:17 UTC, Barkley Canyon-Barkley Upper Slope, Seismometer Data, SearchHdrId 14163126, UserId 15356
  • [DMAS-75946] - file cleanup job failed to remove files in qa and prod
  • [DMAS-75977] - User's colour scheme is not used when the plot is regenerated on Plotting Utility page
  • [DMAS-75983] - Newly created related identifiers are not saved in QA
  • [DMAS-76015] - Fix failed JUnit test in AxisCameraParserTest
  • [DMAS-76016] - QA DMAS Search Failed Notification: 27-Apr-2018 18:38:18 UTC, Cambridge Bay-Underwater Network, Ice Profiler, SearchHdrId 2733391, UserId 21837
  • [DMAS-76019] - Choosing the google maps layer in the Community Fishers Map causes a crash due to invalid key
  • [DMAS-76023] - Error while downloading xml metadata file in historical casts view
  • [DMAS-76033] - Cast data correction job is resulting in errors.
  • [DMAS-76036] - Earthquake catalog job doesnt always find new nrcan usgs detections
  • [DMAS-76038] - Java AD file retrieval searches return incorrect results

User Story

  • [DMAS-74441] - As a Device Console user I would like to see last-reading and driver start date even if the device status shows disconnected
  • [DMAS-74774] - As a Plotting Utility user, I want to customize the line colours in my plots
  • [DMAS-75788] - As ST user, I would like to have better indication to tell if a playlist download is failed

Task

  • [DMAS-73814] - Create separate material UI themes for Oceans 2 and Oceans 3 colours
  • [DMAS-74639] - Investigate November 26th earthquake
  • [DMAS-74734] - Add logging to community fishers data preview generation job
  • [DMAS-74863] - Remove deprecated pages from DMAS
  • [DMAS-75251] - Replace Autocomplete.test.jsx enzyme tests
  • [DMAS-75254] - Replace ExpandableContainer.test enzyme tests
  • [DMAS-75442] - Add date_created global attribute to all netCDF data products
  • [DMAS-75458] - Notify PAMGUARD users of data or forward data to user before data are erased from FTP
  • [DMAS-75481] - As a data steward, I would like add additional constraints to the Move Files Job
  • [DMAS-75502] - Clarify for the user "Active" check boxes, Cruise Management - backend
  • [DMAS-75525] - Update colour scheme on website icon to new ONC blue
  • [DMAS-75578] - Demo Deck Log app to DMAS developers and have some workshop to introduce some features in detail
  • [DMAS-75620] - Update non-DOI/non-minted citation text to include owner role organizations in CSV/JSON data products
  • [DMAS-75635] - Display sites that detected a pwave on the earthquake catalog for missed detections
  • [DMAS-75652] - Create cypress tests for AudioPlayerWidgetConfig
  • [DMAS-75726] - Allow developers to prune Docker images on docker nodes without needing to SSH to Jenkins
  • [DMAS-75769] - Add a configurable time-out optionally available for all matlab post-processors
  • [DMAS-75770] - Implement cancellation for all matlab postprocess tasks
  • [DMAS-75787] - Please change the ST playlist download error report email/jira to more ST related template
  • [DMAS-75793] - Remove 'matlab.output.args.count" task parameter from taskdefinition and from any documentation
  • [DMAS-75884] - Clarify for the user "Active" check boxes, Dive Management - front end
  • [DMAS-75904] - Change Geospatial Map help & light map links to open in new tabs
  • [DMAS-75968] - Remove siteDeviceId column from erddapdataset
  • [DMAS-75982] - Change / to | in ERDDAP titles

Design

  • [DMAS-75126] - Frontend design for DOI relationships
  • [DMAS-75866] - Class design for cancellable post process tasks

Implementation

  • [DMAS-47171] - SearchMap appears to be an inactive servlet
  • [DMAS-69372] - Implement take picture function in axis camera
  • [DMAS-73859] - Generate unit test/cypress combined report
  • [DMAS-74057] - update colour management in PU plots
  • [DMAS-74459] - Implement service to search for and limit site devices with various parameters
  • [DMAS-74909] - Convert ConfigurationContent to Functional Component
  • [DMAS-74910] - Convert ResourceConfiguration to Functional Component
  • [DMAS-75404] - Create trx table for erddapdataset
  • [DMAS-75414] - Implement Backend changes for DeviceType page
  • [DMAS-75425] - Database Script to Add Preset Colour Schemes
  • [DMAS-75589] - Add filter button that opens empty dialog to search history
  • [DMAS-75621] - Clean up ArchiveFileManager.getByDevice
  • [DMAS-75667] - Implement design for adding link to geospatial map light page
  • [DMAS-75684] - Add filtering to search history DAO (back end)
  • [DMAS-75742] - Create scheduled job to process hydrohpone acc files
  • [DMAS-75767] - New Sensor Attribute 'ParserField'
  • [DMAS-75771] - Remove matlab zombie stopper time-out code once java-side time-outs are ready
  • [DMAS-75792] - Include the JDK version in the deployment message
  • [DMAS-75795] - Check if the JVM is running before installing new code
  • [DMAS-75798] - Create the RelatedIdentifier database table
  • [DMAS-75799] - Implement RelatedIdentifier persistence code
  • [DMAS-75802] - Add parameter for job timeout to video qaqc jobs
  • [DMAS-75806] - Get rid of filter box
  • [DMAS-75808] - API token field is redundant
  • [DMAS-75810] - Data product Request template is currently incomplete
  • [DMAS-75811] - Some minor changes to layout for main page
  • [DMAS-75814] - Add service logic for empty returns
  • [DMAS-75817] - Implement timeout for matlab commands
  • [DMAS-75825] - Change anonymous user to use default colour scheme
  • [DMAS-75827] - Add description of how to use colour schemes to the help section
  • [DMAS-75828] - Set the valid versions of node to be used by Oceans Next
  • [DMAS-75840] - Modify declarative parser to support key-value pair readings
  • [DMAS-75865] - implement the code
  • [DMAS-75872] - Implement cancellation for MatlabFilePostProcessor
  • [DMAS-75876] - Dont send devices from NRCan sites to Shake Alert
  • [DMAS-75877] - Declarative parser - mapping string responses to values
  • [DMAS-75888] - Setup DOILandingPage to refresh when related identifier changes
  • [DMAS-75891] - Speed up SQL calls in search history service (doidatasetservice operation 3) call
  • [DMAS-75894] - SQL to update taskTypeClass of file post process jobs
  • [DMAS-75896] - Update web services api link on landing page to point to the open api page instead of the wiki page
  • [DMAS-75978] - Oceans Next deployment announcements should say whether it was deployed to Java 8 or 17

Test

  • [DMAS-75830] - Create regression test for matlab command timeout feature
  • [DMAS-75860] - Write Test Plan for Map Layer Management
  • [DMAS-75957] - Write regression test for Matlab File Post Processor cancellation and update documentation

Bug (ST)

  • [DMAS-75796] - Task machines fail to connect to matlab in Java 17
  • [DMAS-75857] - QA2 task machines aren't starting up properly with Java 17
  • [DMAS-75911] - Audio player widget fails with a service error when retrieving audio files
  • [DMAS-75955] - Failed to get ArchiveFile by locationCode
  • [DMAS-75974] - Jenkins isn't cleaning up docker images on schedule
  • [DMAS-75979] - Deployments should recognize that the framework has started when it reaches level 6+
  • [DMAS-76008] - Fix font on OpenAPI overview page

Investigation

  • [DMAS-75889] - List the libraries included in Equinox along with their status

Documentation

  • [DMAS-75898] - Write a test plan for testing across multiple windows

March 31, 2023

Minor release: online fix for SeaTube seekbar (no downtime)

Tickets Released: Oceans 3.0: 23.02.003 (accessible to internal users only). Total: 1.

March 21, 2023

Minor release: SeaTube export fix, logging fix, cql raw data fix, new seascript commands for Axis cameras

Tickets Released: Oceans 3.0: 23.02.002 (accessible to internal users only). Total: 4.

March 13, 2023

Minor release: ERRDAP driver fix, MATLAB stuck dead task fix, Axis camera seascript support

Tickets Released: Oceans 3.0: 23.02.001 (accessible to internal users only). Total: 3.

March 9, 2023

Major release

Maintenance

New features or improvements
  • Automated geofencing QAQC test (second version based on feedback)
  • GoogleMap page is removed from O3 menu
  • Add devicetype information and filter to DeviceListing page
  • UI message when incorrect deviceid is entered in search field on Device Listing page
  • Lots of new Selenium tests (e.g., new devicelisting page, ParserDefinition tab of Device Detail page, Data Monitoring tab of Device Console page)
  • Create scheduled job for processing archiver cql error files - job wont run automatically until more testing is done
Bug fixes
  • Citation info edge case in data products
  • Label display issue on Junction Box view tab of Device Console page
  • Data availability issue in step 2 of data search page for one edge case
  • Fix bugs in Selenium scripts

Internal projects

External-facing
  • Java upgrade: QA/production environment (formerly named "Gemini", now "Equinox") has been rebuilt & upgraded (Equinox 3.18.200, Tomcat 6.0.69, other dependencies at latest versions)
  • Java upgrade: framework startup errors & Tomcat errors (maybe?) will be properly formatted and logged in dmas.log
  • Improvement: File Management default date range changed to reduce its risk of crashing the JVM
  • Bugfix: allow taxonomies/taxons with taxonomy matrix attributes and taxon references to be deleted from the UI
  • Feature: support heap space monitoring on machines other than the web server
Internal only
  • Java upgrade: support integration testing in Java 8 or Java 17
  • Improvement: Refactoring of group membership-checking code to simplify use and fix dependency issues
  • Bugfix: support integration testing on feature branches of Oceans 3
  • Improvement: Make Oceans Next deployments more resilient to webpack upgrades
  • Improvement: Automate cleanup of unimportant (but large) files from archived CI builds
  • Improvement: Deployment scripts will watch for errors logged with serious but rarely-used log levels FATAL, SEVERE, AUDIT during system startup
  • Improvement: Support "shotgun-style" code reviews in Bitbucket (assign n >= 2 reviewers; allow merge after any 2 approvals) with overrides to force full approval of large or critical changes
  • Bugfix: various UI tests
  • Improvement: clean up UI test page object initialization
  • Bugfix: don't force so much re-review on Renovate dependency upgrades
  • Improvement: validate Jenkins pipelines in branch CI

Community Fishers

  • Create service to generate processing comment for cast dataproducts in Java
  • Drop ErddapSensorAttribute table (for CIOOS)
  • Remove siteDeviceId column from erddapdataset and erddapdataset_hist trigger (for CIOOS)
  • Remove dependency on Matlab Engine API for Java
  • Change output of Matlab logs from UDP port to processes output stream
  • Order of casts in lasso selection tool now newest to oldest

Acoustic Instruments Data Viewer

  • Convert existing code for Spectrogram widget to utilize Typescript, React hooks & Cypress testing
  • Convert existing code for Audio Player widget to utilize Typescript

SeaTube

  • Finished the Deck Log phase one implementation and gave the demo to users (mostly via previous minor release)
  • End-to-end tests for supporting embedded time code in our video stream
  • ST web services improvement to support both new Deck Log app and WTA at same time 
  • ST Playlist Improvement due to the resolution flags are changed to null for fixed location video files
  • Manual test ST for support React 17 upgrade 
  • NOAA on ship servers synchronization tests 
  • Other small improvements
  • Some minor bug fixes

Earthquake Early Warning

  • Support sending IRIS meta for our sites when sending live data to ShakeAlert
  • Add site map to the earthquake catalog page
  • Fix some bugs with the scheduled jobs populating the earthquake catalog page

OpenAPI

ExperiMINTED

  • Add a relation identifier to a DOI
  • Search History page tweaks:
    • get the latest 100 searches, not just those after 2022-12-10
    • columns are sortable
    • improved column sizing

Data Policy

  • New tables and DAL layer for agreement / site device association

Data Products

  • MATLAB upgrade to R2022b, includes logging system upgrade (log levels and better error handling), matlab-as-a-service custom API that decouples MATLAB version dependency on Java dependency
  • DOI citations added for netCDF products
  • Documentation, internal improvements: warning & logging content, unit tests for append_pdfs, netCDF comparator update
  • Bug fixes: CODAR slowness, citation fixes

Instruments

  • Quarantine at Archiver: Archiver will now quarantine devices as soon as they are quarantined. Previously the quarantine would only take effect on the archiver after if had processed the backlog.
  • Download raw file from AD in BPR Import Job
  • UV Light support in Axis camera driver with seascript commands

Tickets Released: Oceans 3.0: 23.02.000 (accessible to internal users only). Total: 167. Automated Testing: AT.23.02.000, total: 40.

Bug

  • [DMAS-48271] - Data availability bar in step 2 of data search shows "No Data Available" when we have archive file in database
  • [DMAS-64371] - A method to get English vernaculars may not only be getting English vernaculars
  • [DMAS-64616] - Misleading snackbar message for invalid annotation entries
  • [DMAS-73256] - Comment box contains empty space when button is selected
  • [DMAS-73363] - Chat Log Widget search button does not have a tooltip
  • [DMAS-73609] - Unable to update deviceattributeIds where only devicetypeattributeid exists
  • [DMAS-74638] - Archiver should also respect the Quarantine state of a device
  • [DMAS-75098] - ConnectedDevice labels sporadically disappear from DC JunctionBox tab
  • [DMAS-75156] - Task Management "Select All" checkbox doesn't display a tooltip for scheduled jobs
  • [DMAS-75168] - ManualEntryForm cypress tests failing
  • [DMAS-75171] - TabbedButtonSetSelector cypress tests failing
  • [DMAS-75237] - can't play my playlists
  • [DMAS-75333] - Monthly CODAR preview searches are slow and throwing lots of warnings
  • [DMAS-75347] - Lots of warnings for channelCentreFrequecyOverride device attribute not found
  • [DMAS-75349] - Widgets that are only allowed to have a single instance of the widget on a Dashboard can be added in secondary screens
  • [DMAS-75370] - Cannot Add Attribution to an Agreement Data Product
  • [DMAS-75372] - Integration Testing fails to checkout feature branches of Oceans 3
  • [DMAS-75386] - Storybook builds fail with a TypeError "The "id" argument must be of type string. Received an instance of Object"
  • [DMAS-75389] - Pages with REST style url's don't load properly in the Ocean's Next dev server
  • [DMAS-75399] - Resource validation needs to be improved in Manual Entry
  • [DMAS-75400] - Highlight color of annotation table not displaying correctly in Oceans 3
  • [DMAS-75402] - Quick Save on button sets allow annotations outside of the expedition's date range and with a Dive resource type
  • [DMAS-75407] - Oceans next pages are not loading in Oceans 3
  • [DMAS-75417] - Gradle warns about implicit dependencies between some tasks
  • [DMAS-75418] - Storybook builds fail with a TypeError "TypeError: The 'compilation' argument must be an instance of Compilation"
  • [DMAS-75421] - Date Pickers crash the page when the user attempts to open them in oceans next
  • [DMAS-75428] - Deck Log page warns of unsaved changes when closing/reloading in Firefox
  • [DMAS-75430] - Deck Log keyboard entry submission occurs for all open keyboard entries
  • [DMAS-75432] - Automatic merges from release -> main are failing in Oceans Next
  • [DMAS-75443] - Icons from Oceans Next are missing when it's running as an OSGi bundle
  • [DMAS-75445] - Oceans Next storybook build is failing
  • [DMAS-75446] - Deleting a taxonomy & all its taxons sometimes fails to remove all metadata linked by foreign keys
  • [DMAS-75464] - Storybook build fails due to SSL errors
  • [DMAS-75472] - Incorrect Deployments being used for citations with no DOI
  • [DMAS-75480] - Fix assemblers causing cache load errors (OrganizationResourceRole and OrganizationAgreement)
  • [DMAS-75487] - Correct merge conflicts between release and main
  • [DMAS-75489] - Choosing a Command in the System Console Causes the Page To Go Blank in QA with main branch
  • [DMAS-75493] - sensor tab of device detail page is broken in QA
  • [DMAS-75494] - Alert message "No form sections could be found using the provided" pops up when displaying forms on some pages in QA
  • [DMAS-75501] - QA & Prod builds have a slow load time
  • [DMAS-75508] - Authentication Keyword Typo in ONC Repository
  • [DMAS-75510] - Dive log annotations cannot be saved after react 17 upgrade
  • [DMAS-75532] - Quarantine or Unquarantine device does not work in QA
  • [DMAS-75534] - CSV/JSON search failures in QA for "getAuthor"
  • [DMAS-75543] - The SeaTubeConfiguration page has strange "No Taxonomy (Expedition)" inheritance behaviour
  • [DMAS-75566] - ONC Light driver logs warning on start.
  • [DMAS-75574] - Device Dropdown (DeviceActionMaintenance) doesn't populate
  • [DMAS-75588] - Publication date in citation text is inaccurate
  • [DMAS-75615] - Captured time is incorrect (which is local time), but after saving the annotation, the timestamp in the annotation table is correct (which is UTC time).
  • [DMAS-75637] - Take Snapshots not working in SeaTube on QA
  • [DMAS-75642] - Recording Video not working in SeaTube on QA
  • [DMAS-75645] - Device Listing page is blank in QA
  • [DMAS-75662] - Deck Log crashes when annotation edited in a specific order
  • [DMAS-75665] - Search failure in QA automation for createCitationInfo
  • [DMAS-75666] - Newly-Created Task Does Not Appear in Task Tree Until it has a Record in the TaskSchedule Database Table
  • [DMAS-75682] - Deployments to qadivelogger3.onc.uvic.ca are failing to install bundles
  • [DMAS-75683] - Baynes Sound Serial Expander Can - Number Format Error
  • [DMAS-75687] - Fix incorrect timerangevalue in File Management
  • [DMAS-75695] - Pagination Broken On AnnotationsSearchV2 table
  • [DMAS-75698] - SiteDeviceSubsetMaintenance page fails to render in QA
  • [DMAS-75704] - Scheduling post-process-arctic-buoys-parser-job (Job Id: 114) is Aborted with Errors in QA, but works in prod
  • [DMAS-75710] - Search failure in QA automation for TS netCDF incorrect number of arguments
  • [DMAS-75716] - The function crypto.randomUUID isn't available on divelogger machines
  • [DMAS-75718] - QAQC page is empty in QA
  • [DMAS-75719] - Cast popup closes when attempting to view historical casts on Community Fishers Map
  • [DMAS-75722] - Cannot Add Resource Role on Device Detail Page
  • [DMAS-75732] - QAQC and other 4 react pages form is empty in QA

User Story

  • [DMAS-67558] - As a scientific programmer, investigate and refactor to support latest version of MATLAB (R2022b)
  • [DMAS-73748] - As a software developer I would like creation of overlapping casts to be blocked at the database level
  • [DMAS-74165] - As a Data Specialist, I would like modification to automated geofencing QAQC test
  • [DMAS-74212] - As a software developer I would like to support Matlab version R2022a/b with matlab-as-a-service
  • [DMAS-74848] - As a software developer, I want to remove obsolete and deprecated code from GroupPrivilegeManager and DmasUserManager so I can streamline development
  • [DMAS-75274] - As a data steward, I would like the devicetypeid and devicetypename exposed in DeviceListing and update the page

Task

  • [DMAS-39311] - Disable Equinox logging in /usr/local/gemini/logs
  • [DMAS-73719] - Upgrade oceans next to React 17
  • [DMAS-73847] - ST - rename "Advanced" button (takes you from annotation filter to search)
  • [DMAS-74689] - Order of casts in lasso selection tool not consecutive
  • [DMAS-74690] - Change the default date range in File Management
  • [DMAS-75150] - Convert existing code for Spectrogram widget to utilize Typescript, react hooks & cypress testing
  • [DMAS-75169] - provide a demo to Data Stewards on the functionality and confirm tool meets their needs
  • [DMAS-75284] - Create Scheduled Job For processing cassandra cql error files
  • [DMAS-75297] - Don't log redirects to the login page
  • [DMAS-75310] - as a Data Steward, I need the job 229-bpr-import to be modified for it to work
  • [DMAS-75314] - Convert existing code for Audio Player widget to utilize Typescript
  • [DMAS-75348] - update qa post refresh script with sql for eew mtc test site
  • [DMAS-75357] - Add message when incorrect id entered for device id for /DeviceListing
  • [DMAS-75382] - Create unit test for append_pdfs
  • [DMAS-75384] - Refactor DatasetManager keyword code for simplification and cleanliness
  • [DMAS-75398] - Provide a list of devices connected to the ship to the Deck Log so the resource list can be populated in Manual Entry
  • [DMAS-75405] - Upgrade cypress and related tools
  • [DMAS-75416] - See if possibly extraneous method in DeviceSensorSearchTreeUtilI can be removed
  • [DMAS-75423] - Update/replace attribution fields in netCDF products with citations
  • [DMAS-75449] - Support Wiring the Abyss page in ONC web site with the new Deck Log app
  • [DMAS-75451] - Update SearchHistoryTable to allow sorting on certain columns
  • [DMAS-75454] - Add source column to SearchHistoryTable
  • [DMAS-75457] - adding station map to all events in Earthquake Catalogue
  • [DMAS-75462] - Make some code and design changes to SearchHistoryTable
  • [DMAS-75469] - GoogleMap function not working
  • [DMAS-75470] - Display the ship's positional data on the deck log page
  • [DMAS-75506] - Improvements to the Earthquake catalog job
  • [DMAS-75518] - Change the quick entry widget's keyboard entry toggle key
  • [DMAS-75560] - Update eventdefinition hist table to track changes to the device selector json column
  • [DMAS-75569] - Update Jenkins cleanup scripts
  • [DMAS-75576] - Update link for Thomson De-tided data product option
  • [DMAS-75593] - Add heap space monitoring to production task machines
  • [DMAS-75624] - Abort `deploy_onc deploy --watch` if a FATAL message is logged
  • [DMAS-75630] - Validate Jenkinsfile syntax in feature branch CI builds
  • [DMAS-75641] - remove date range limit on doiDataset search query
  • [DMAS-75643] - Remove Record button for playlists
  • [DMAS-75656] - Make the Search History table header bold
  • [DMAS-75657] - Add a loading bar that shows when searches are loading
  • [DMAS-75658] - Update non-DOI/non-minted citation text to exclude ONC when having roles of custodian, distributor, publisher (DP code)
  • [DMAS-75711] - Error Logs about pnsn data without an iris mapping should be warning logs
  • [DMAS-75725] - Lots of null pointer exceptions on qaextshore1
  • [DMAS-75727] - Handle citationText response in case of no data product mapping (DP code)

Requirement

  • [DMAS-75427] - Requirements for System to Maintain Colour Schemes

Design

  • [DMAS-75409] - Design for System to Maintain Colour Schemes

Implementation

  • [DMAS-73803] - Add EXCLUDE Clause to SiteDeviceSubset table so overlapping SiteDeviceSubsets Cannot be created
  • [DMAS-74150] - Rebuild Oceans 3's runtime environment ("Gemini")
  • [DMAS-74151] - Add an option to deploy_onc to select the version of Java to use for build and deployment
  • [DMAS-74457] - Create database tables for Organization Agreement Resources
  • [DMAS-74458] - Create DAL layer for OrganizationAgreementResource
  • [DMAS-74681] - Move organization agreement code out of onc-core
  • [DMAS-74907] - Convert SeaTubeConfigurationPage to Functional Component
  • [DMAS-74994] - Add devicetypeid and devicetypename exposed in DeviceListing and update the page
  • [DMAS-75012] - Disentangle UM and CU persistence bundles
  • [DMAS-75094] - Remove siteDeviceId column from erddapdataset and erddapdataset_hist trigger
  • [DMAS-75187] - Prefer DmasUser over user IDs where possible in DmasGroupManager
  • [DMAS-75189] - script to create two new table for geofencing qaqc
  • [DMAS-75212] - Create service to generate processing comment for cast dataproducts in Java
  • [DMAS-75263] - Drop ErddapSensorAttribute table
  • [DMAS-75299] - Conditionally install bundles in Equinox instead of manually excluding some bundles
  • [DMAS-75326] - create scheduled job to store iris meta data in our database
  • [DMAS-75327] - Update PNSNMessage to include iris meta data
  • [DMAS-75334] - Change agreement management code back to assemble with beans
  • [DMAS-75335] - Fix managers in agreement management to use domain objects
  • [DMAS-75339] - Clean up temp files created by unit tests
  • [DMAS-75363] - Clean up wowza-date-time-generator README and Javadocs
  • [DMAS-75367] - Rename the production runtime to Equinox
  • [DMAS-75396] - Update deployment with new script names
  • [DMAS-75431] - Don't require passing an observatory ID to GroupPrivilegeManager when it can be derived
  • [DMAS-75477] - Modify DOIDataset Service Update Operation to allow updating of Related Identifiers
  • [DMAS-75482] - Remove dependency on Matlab Engine API for Java
  • [DMAS-75503] - File archiver task should always reject zero sized files
  • [DMAS-75516] - Change output of Matlab logs from UDP port to processes output stream
  • [DMAS-75520] - Clean up documentation links on OpenAPI page
  • [DMAS-75533] - Update DeviceService.js in oceans-next to Typescript
  • [DMAS-75540] - backend code to implement geofencing qaqc
  • [DMAS-75558] - Implement ability to store SiteDeviceSubsetDatasets in ISO19115datasetrecord
  • [DMAS-75561] - Support deploying Oceans Next to Equinox
  • [DMAS-75562] - Deploy Oceans Next to Equinox in integration tests when built with Java 17
  • [DMAS-75594] - Support a custom delay after taking a heap dump
  • [DMAS-75626] - ONC Implementation for incorrect deviceID warning
  • [DMAS-75627] - Oceans next implementation for invalid deviceid warning
  • [DMAS-75632] - Fix automatic merge failure from release to main
  • [DMAS-75633] - Validate Jenkinsfile syntax in Oceans Next
  • [DMAS-75654] - Add link to api documentation on open api main page

Test

  • [DMAS-69931] - Test ST annotation in live mode
  • [DMAS-69933] - Test the archived video files have the correct timestamp in the file name
  • [DMAS-74655] - Test matlab-as-a-service with R2022a in QA/QA2 and time spent making/commenting on systems tickets
  • [DMAS-75345] - Test R2022a data product in QA search automation

Bug (ST)

  • [DMAS-75279] - False positive comparison failures for netCDF files in search automation for R2022a/b
  • [DMAS-75513] - Fix deviceType bug
  • [DMAS-75625] - qaweb2 is logging errors while checking group membership
  • [DMAS-75699] - Double log of "Acquiring MatlabExecutionEngine for this job run" from MatlabFilePostProcessor
  • [DMAS-75750] - java_home is set to an invalid directory on ncdeploy

Documentation

  • [DMAS-75447] - Update documentation for netCDF citation updates

March 2, 2023

Minor release: bug fixes for citation text (searching for date range on archived files causes crashes, fixes for incorrect deployments and missing attributions), annotations, video and hydrophone post-processors

Tickets Released: Oceans 3.0: 23.01.003 (accessible to internal users only). Total: 8.

Bug

  • [DMAS-75472] - Incorrect Deployments being used for citations with no DOI
  • [DMAS-75597] - tskgpu1 throwing 400+ heap space errors overnight
  • [DMAS-75600] - Manual Entry widget allows the user to save annotations outside the time range of the expedition
  • [DMAS-75618] - Annotations created on datacentres with certain locations have the wrong ID
  • [DMAS-75631] - Error in hydrophone post-processor: too small file handling broken by new audio conversion option

Task

  • [DMAS-75619] - Update non-DOI/non-minted citation text to include all attributing organizations (DP code)

Implementation

  • [DMAS-75548] - Stop both Equinox and Gemini during a deployment

Bug (ST)

  • [DMAS-75629] - Skip small / corrupt files in videoFileQAQC and send warning email

February 21, 2023

Minor release: deploy Deck Log features

Tickets Released: Oceans 3.0: 23.01.002 (accessible to internal users only). Total: 5.

Implementation

  • [DMAS-75466] - Back end changes to support both the Wiring the Abyss page and new Deck Log app
  • [DMAS-75475] - Adjust the way the Deck Log is accessed through Expedition Management
  • [DMAS-75478] - Add column to cruise table for Deck Log Code
  • [DMAS-75486] - Update Expedition Maintenance page to include Deck Log Code field
  • [DMAS-75488] - Update the expedition/tree web service to return "Deck Log" nodes with Cruises that are SeaTube Ready

February 16, 2023

Minor release: raw file generation issue (not really a bug)

Tickets Released: Oceans 3.0: 23.01.001 (accessible to internal users only). Total: 1.

February 15, 2023

Major release

Maintenance

New Features or Improvements
  • Rebuild DeviceListing page with React
  • Remove limit of memo field on Device Detail page
  • Update Citation in csv data product header to include dataset DOIs
  • Add one data product icon on Data Search page
  • Improve search tree loading time (improve generation time, and payload size), affects most search trees
  • Improve user search on User Management page
  • Deprecation functionality for Task Management
  • Automated geofencing QAQC test
  • Create trx tables for qaqc related database tables
  • Update RdiAdcpComplexParser to ignore invalid data like Negative ArraySize
  • Fixed topology extension cache so extension Ids should always show up on the topology page (also fixes duplicate extensionIds getting saved)
  • Calibration formulas now support $null for example: if($77062upto21800m=1,$73462,$null)
  • Selenium and Cypress tests added/updated
Bug Fixes
  • Camera video archived with filesource=null
  • TopologyCache
  • Min/max qaqc flags for data gaps in csv data product
  • Generic File Post Processing job

SeaTube

  • Major features released for Deck Log application
  • Continue work on Map Layer and WORMS update
  • Annotation ingestion for Cordell Bank
  • One bug investigation (missing file resolution flag for some videos)

Data Products

  • Changes to support an upcoming MATLAB version update: backend java changes, videoQAQC job can now run in current MATLAB version with added error handling
  • Citation structures and information updated in file products with new DOI Citation strings as documented here: https://wiki.oceannetworks.ca/display/DP/Data+Citations
  • QAQC structure added to time series MAT files containing information and flags for all tests applied to the data
  • Added a new option to disable (by default) on-the-fly generation of audio formats, this reduces the likelihood of users filling the working space and running slow searches
  • Minor updates for a plotting and PDF printing edge cases

Community Fishers

  • Corrected Task Management tree miss-alignment
  • Corrected blue icons to green for unassigned casts after lassoing and then clearing selection
  • Corrected odd messaging about FTP transfer in the DataProductDelivery API
  • Fixed failing UI test in Plotting Utility

Acoustic Instruments Data Viewer

  • Convert existing code for Spectrogram widget to utilize Typescript, React hooks & Cypress testing

Internal projects

  • Preparing to run in Java 17 in QA
  • Update default git branch name ("main" replaces "master")

CIOOS

  • Data model restructuring for ERDDAP
  • OBIS Export - fixed issues with event.csv, occurrence.csv and meta.xml content
  • CKAN
    • fixed issue with duplicate EOVs
    • support comma separate list of site device ids in CKAN metadata upload job

ExperiMINTED

  • Added Search History (PID navigator) prototype page which shows last 100 searches made by a user after 2022-12-10
  • Instrument search - fix issue with search path not showing in search cart

Earthquake Early Warning

  • Fix MMI contours on the earthquake detail page, used to be 50% larger than they should be and then as of last month are 100% larger than they should be
  • Move eewclient and cacheloader queues over to the new jms framework that was created as part of the multiqueue project
  • Earthquake catalog page now has all earthquakes with magnitude over 3.0 (in area and time of interest)

OpenAPI

  • The openAPI page can now be accessed through the url /api in addition to /OpenAPI
  • The openAPI page now has a loading indicator while a request is being processed
  • Filter relevent data product options on https://qa.oceannetworks.ca/OpenAPI#get-/dataProductDelivery-request
  • Add data product options to the response of the data product discovery public API

Instruments

  • Multi queue performance improvement
  • Seascrsipt support for idleDriver and activateDriver
  • ONC Lights driver enhancement

Tickets Released: Oceans 3.0: 23.01.000 (accessible to internal users only). Total: 171. Automated Testing: AT.23.01.000, total: 37.

Bug

  • [DMAS-73981] - As a data steward, I would like some bugs fixed for the occurrence.csv for OBIS
  • [DMAS-74012] - As a data steward, I would like some bugs fixed for the meta.xml for OBIS
  • [DMAS-74691] - Icons for unassigned casts render blue after lassoing and then clearing selection
  • [DMAS-74886] - Data gaps not marked with correct min/max QAQC flags in CSV minmax avg test cases
  • [DMAS-74948] - Running a dataproduct search that produces collated PDFs twice locally results in duplicate PDFs being collated into one file
  • [DMAS-74953] - csv data product doesnt handle data ratings of 0 correctly
  • [DMAS-74981] - Control icons are missing from the simulator console
  • [DMAS-74982] - Video widget refresh crashes dashboard
  • [DMAS-74987] - Junction box alarm settings page is looking for a missing file processing.gif
  • [DMAS-75070] - Data Search plots (png, pdf) missing data for "Depth" sensor when PU shows data. (work related to Navigation data commissioning work in DATA-4562)
  • [DMAS-75100] - OSGi tests intermittently time out in Jenkins
  • [DMAS-75137] - Verification of RemoteCacheReloadServiceActivatorImpl failed on multiple shorestations
  • [DMAS-75141] - Task Management tree is miss-aligned
  • [DMAS-75178] - EEW Correlator at eduCloud logging issues with EEWClientActivator
  • [DMAS-75179] - Gap filling in CSV/JSON no longer respects the sample rate, fills at 1 sec intervals
  • [DMAS-75186] - Topology ExtID field is buggy - concatenating things that it shouldn't
  • [DMAS-75193] - Oceans 3.0 gradle builds intermittently fail with an OutOfMemoryError
  • [DMAS-75214] - Decklog AnnotationTable Reset Button Bug
  • [DMAS-75227] - Fix MapLayer ServiceActivationTest
  • [DMAS-75243] - Deck Log title is not correct, is only displaying "Screen X of Y"
  • [DMAS-75244] - Cross-window communication is broken in the Deck Log
  • [DMAS-75255] - Fixed camera video is archiving with filesource=NULL on a regular basis
  • [DMAS-75258] - Deck Log link from Expedition Management not working in webpack
  • [DMAS-75260] - ColumnChooser menu in StatelessTable appears detatched from the table an only opens in the top right corner of Deck Log
  • [DMAS-75267] - Oceans 3 CI builds sometimes fail with "The message received from the daemon indicates that the daemon has disappeared."
  • [DMAS-75283] - Instrument search drops path info in cart (was: Instrument search Java CSV data product truncates its DateTo and drops path info in the search cart)
  • [DMAS-75287] - Couldn't create a new or update an existing annotation for deck log in QA
  • [DMAS-75288] - The browser tab is closing when reloading the deck log page
  • [DMAS-75290] - Validation is missing for many cases in the Deck Log's Annotation Entry form
  • [DMAS-75298] - Attribute value fields in Annotation Entry display incorrectly sometimes
  • [DMAS-75301] - Add Deck Log page logo same as other pages
  • [DMAS-75309] - Deck log annotation entry's date validation is incorrect
  • [DMAS-75312] - Data Search logs an error about a missing image
  • [DMAS-75316] - video file QAQC no longer detects corrupt video file
  • [DMAS-75337] - Jenkins Java build agent is out of /tmp space
  • [DMAS-75366] - Fix error in matlab codarnetcdfpostprocess
  • [DMAS-75369] - Fix dataset manager to ensure taxons are actually distinct
  • [DMAS-75371] - Autocomplete is not compatible with Data source selector
  • [DMAS-75374] - Dates are shown in Pacific time instead of UTC, also dateFrom is displayed for dateTo
  • [DMAS-75375] - Device Control buttons have flipped gradients
  • [DMAS-75390] - ErddapManagementTable does not display siteDeviceId or deviceId when accessed via deeplink
  • [DMAS-75397] - NullPointerException for sensor when reload cache in dev and qa
  • [DMAS-75434] - Insertion into parserdefinition Table does not trigger an Insert Operation in the parserdefinition_trx Table
  • [DMAS-75439] - Error On JunctionboxBreakerService in QA
  • [DMAS-75459] - Oceans Next deployment failed on release/23.01.000

User Story

  • [DMAS-57229] - As a software developer, I'd like the /DeviceListing page updated to React
  • [DMAS-69901] - As a software developer, I want to rename the default git branch from "master" to "main" for consistency with git hosting tools
  • [DMAS-74664] - As a dev, I would like to update DataPreviewManagement Cypress code to fit newer testing-library form
  • [DMAS-74858] - As a dev, I would like to create a method for deprecating jobs that is visible through the UI

Task

  • [DMAS-64430] - As a dev, I would like to improve Data Search loading time and reduce it's data overhead
  • [DMAS-73999] - create a data search icon for the .apt files
  • [DMAS-74143] - Improvements for user management user search
  • [DMAS-74440] - Citation line text in CSV data product header replaced with $citation.citation
  • [DMAS-74465] - Odd messaging about FTP transfer in the DataProductDelivery API
  • [DMAS-74609] - Create new manual entry form component
  • [DMAS-74852] - There are duplicate EOVs/ECVs listed in CKAN records when multiple sensors are mapped to the same keyword, we want only distinct EOVs/ECVs added to the landing page
  • [DMAS-74872] - Start all OSGi bundles in QA and prod
  • [DMAS-74943] - Update attribution structures and comments in MATLAB data products to use/be compatible with DOI citations
  • [DMAS-74984] - Remove some unused camera control and data search Javascript and CSS
  • [DMAS-74986] - Fix Oceans 3 unit tests failing intermittently in Jenkins
  • [DMAS-75076] - Make basic project templates for persistence bundles
  • [DMAS-75080] - Disable hydrophone on-the-fly audio data conversion by default with a new option
  • [DMAS-75081] - Add a QAQC result information to time series scalar MAT files
  • [DMAS-75085] - Update database script commit process in the README
  • [DMAS-75118] - Button Set Widget should save its configuration (currently open button sets) to local storage
  • [DMAS-75120] - Create a communication diagram to show how the widgets in the deck log communicate
  • [DMAS-75121] - Move Organization web backend to usermanagement
  • [DMAS-75181] - Add Content Refresh Button to DeckLog Annotation Table
  • [DMAS-75183] - Reduce Oceans Next coverage temporarily
  • [DMAS-75185] - create trx table for qaqc, qaqcformula, qaqctestgroup,qaqctestgroupdetail tables
  • [DMAS-75188] - Add default resource selection for Deck Log to the SeaTubeConfiguration page
  • [DMAS-75190] - add constraint on im_topologyextension table for unique combination of (topologyid, extensionid)
  • [DMAS-75191] - Add Auto Reload Menu Option to DeckLog Annotation Table Widget
  • [DMAS-75201] - As a Data Steward, I need to be able to assign NULL values to sensor data when a condition is met in a JEP function
  • [DMAS-75221] - Allow users to delete annotations using the Annotation Table Widget
  • [DMAS-75223] - Allow users to "copy link" to an annotation in a Deck Log
  • [DMAS-75226] - Add global default resource for Deck Log (No Taxonomy (Expedition))
  • [DMAS-75235] - Create default layouts for the Deck Log for both logged in and anonymous users
  • [DMAS-75238] - Saving or updating an annotation from the Manual Entry widget should trigger the table to refresh
  • [DMAS-75248] - Add organizationId and cruiseId to the payload of CruiseService operation 25
  • [DMAS-75249] - Update CruiseService call to use operation 25 in the Deck Log so users don't need to be logged in
  • [DMAS-75250] - Add a cruiseId parameter to the seatube/permissions service so that permissions for deck log annotations can be retrieved
  • [DMAS-75265] - Load default attributes for taxons when selected
  • [DMAS-75272] - The "copy link" feature will scroll to and highlight the requested annotation in a Deck Log annotation table
  • [DMAS-75275] - ONC Lights Driver - Modify remote commands to retry if not successful
  • [DMAS-75277] - Seascript - add support activateDriver and idleDriver commands for all drivers
  • [DMAS-75285] - Investigate January 28th missed earthquake detection
  • [DMAS-75289] - Improve the annotation table's default configuration
  • [DMAS-75293] - Allow CKAN Upload Job 366 to take a comma separated list of site devices to run with
  • [DMAS-75303] - Improve Deck Log layout for users with write permission
  • [DMAS-75304] - Improve the resource fields in Annotation Entry
  • [DMAS-75308] - Sort the attributes before populate into the form
  • [DMAS-75311] - Update annotation deletion call to handle cruises
  • [DMAS-75328] - Make Deck Log layouts the same across all decklogs instead of per cruise
  • [DMAS-75329] - Fix CSS for background color of deck log
  • [DMAS-75332] - Remove Dive as a Resource Type from Deck Log's Annotation Entry form
  • [DMAS-75338] - Align the action icons in the Annotation Table
  • [DMAS-75354] - Alphabetize data product options from the data product public api service
  • [DMAS-75395] - Protect the Oceans Next deployment build against changes to npm script names

Implementation

  • [DMAS-57879] - Update backend to display react version of page
  • [DMAS-73905] - postprocess Kongsberb SMB files job on demand
  • [DMAS-74687] - Create Deck Log App and Dashboard
  • [DMAS-74698] - Change all finder statements to match newer style
  • [DMAS-74699] - Fix cypress tests
  • [DMAS-74878] - Add warning message to reprocess console
  • [DMAS-74889] - Create service call to retrieve user groups for Group Selector
  • [DMAS-74892] - Set the Java version to 17 in CI
  • [DMAS-74900] - Merge DmasGroupManager.isDmasAdmin and DmasGroupUserManager.isMemberOfAdminGroup
  • [DMAS-74914] - Create URL validation field component
  • [DMAS-74920] - Implement Service to Return Data Search History
  • [DMAS-74930] - script for a job to postprocess on demand
  • [DMAS-74934] - Update default branch name in Oceans 3 deployment scripts
  • [DMAS-74935] - Update default branch name in Oceans Next deployment scripts
  • [DMAS-74940] - Update the default branch name in the Data Products deployment script
  • [DMAS-74942] - Update the default branch name of each repository
  • [DMAS-74988] - Create SeaTube service call to retrieve SeaTube organizations
  • [DMAS-75008] - Disentangle DmasGroupManager and DmasGroupUserManager
  • [DMAS-75072] - Add support for multi-window layouts to Deck Log
  • [DMAS-75087] - Add resourceTypeId and resourceId to erddapdataset table - SQL
  • [DMAS-75088] - Drop usage of siteDeviceId and instead use resourceId and resourceTypeId with erddapdataset - Java
  • [DMAS-75090] - Build the runtime environment's dependency list from Maven repositories
  • [DMAS-75103] - Wrap the new manual entry component in a Widget and add to Deck Log
  • [DMAS-75104] - Add a listener that the manual entry for will populate with the correct data when a button set button is clicked
  • [DMAS-75107] - Create a widget that wraps the annotation table component
  • [DMAS-75108] - Make the edit button on the table communicate with manual entry for editing annotations
  • [DMAS-75109] - Add service method to get annotations for a cruise instead of a dive
  • [DMAS-75113] - Connect back-end service to front end code
  • [DMAS-75114] - Add a button in Expedition Management to link to Deck Logs at the cruise level
  • [DMAS-75115] - Add a flag to the cruise page to indicate that the cruise is "SeaTube Ready"
  • [DMAS-75122] - Make back end changes to show the new dedicated Deck Log page
  • [DMAS-75124] - Allow manual entry/the deck log to save/edit annotations for a cruise
  • [DMAS-75129] - Add column to cruise table for "Deck Log Ready"
  • [DMAS-75135] - redo the open api implementation of the data product delivery request service
  • [DMAS-75140] - Refactor the ManualEntryForm's ManualEntryFormContext to use ServiceContext
  • [DMAS-75144] - Rename 'isDeckLogReady' column to 'ready' on cruise table
  • [DMAS-75151] - Make front end changes to show the new dedicated Deck Log page
  • [DMAS-75152] - Add Quick Save to Button Set widget to auto-save annotations
  • [DMAS-75155] - Remove temporary code that tries to look for a dive labelled as a deck log
  • [DMAS-75160] - Specify the scope of OSGi console commands used in the Oceans 3 deployment script
  • [DMAS-75161] - Specify the scope of OSGi console commands used in the Oceans Next prod-ish deployment script
  • [DMAS-75164] - Update backend Expedition Management tree call to include deck log readiness
  • [DMAS-75174] - Create method to display deprecated jobs in task management
  • [DMAS-75175] - Create button to deprecate and restore jobs
  • [DMAS-75176] - Update existing deprecated jobs in database to use consistent method
  • [DMAS-75184] - Update Expedition Management expedition details call to include deck log readiness
  • [DMAS-75197] - Java code for two geofencing qaqc table
  • [DMAS-75199] - Implement search history page
  • [DMAS-75219] - Support Caching for FormSectionResource Table
  • [DMAS-75220] - Add indexes on resourcetypeid and resourceid columns in FormSectionResource table
  • [DMAS-75222] - Allow AnnotationEntryWidget to Save Automatically when Quick Save is On
  • [DMAS-75225] - Return searchSourceId With QueryPids
  • [DMAS-75229] - Update the data product discovery service to return data product options
  • [DMAS-75262] - Remove dal for ErddapSensorAttribute
  • [DMAS-75266] - Remove erddapsensorattribute_datasetid_fk from erddapsensorattribute
  • [DMAS-75278] - Add an indicator that the api is processing a request
  • [DMAS-75281] - Add search history to entry.jsx
  • [DMAS-75282] - Add search history to web.xml
  • [DMAS-75346] - Change version check in LogWriter to check for R2022a

Test

  • [DMAS-74523] - Check to see if we can retire MATLAB R2014a completely
  • [DMAS-74945] - Test R2022b data products in QA search automation

Bug (ST)

  • [DMAS-74682] - Search failure notifications fail for new instrument searches
  • [DMAS-75009] - Minor event.csv changes
  • [DMAS-75010] - Add survey footprint
  • [DMAS-75192] - Video file QAQC matlab job is failing to produce results
  • [DMAS-75259] - Kongsberg rotary sonar plots drop the angle labels in R2022b
  • [DMAS-75315] - Minor issues in CSV/JSON citations found by search automation in QA
  • [DMAS-75317] - Change DOIDatasetService payload queryPidId to queryPid
  • [DMAS-75353] - Query PID not showing in Search History table

Investigation

  • [DMAS-75116] - Investigate what the "Active" flag on the cruise page does and if we could reuse it

Documentation

  • [DMAS-73898] - Write documentation for the new Stateless Table (and Table) components
  • [DMAS-75095] - Update attribution documentation on DP home and other DP pages

January 30, 2023

Minor release: topology and earthquake catalogue fixes

Tickets Released: Oceans 3.0: 22.12.001 (accessible to internal users only). Total: 2.

January 16, 2023

Major release

Maintenance

  • Fix QAQC flag inconsistency issue between API compared to data products
  • Quarantine device filter checkbox for devices with piggybacks
  • Remove fax from organization page
  • Fix small bugs for CSV data products with min/max options
  • Sensor-level data rating display improvement
  • Parserdefinition tab on device detail page with React
  • Many Selenium tests updated

Sea Tube

  • Continue on WoRMS update
  • Continue on the integration of the Deck Log app
  • Continue on Map Layer app
  • Testing on the back-end implementation of Cordell Bank annotation ingestion
  • Continue on the front-end design/implementation of Cordell Bank annotation ingestion
  • Converted OBIS test setting config page from old React to Ocean Next 
  • Few bug fixes

Internal Projects

  • Automate dependency upgrades for UI tests
  • Upgrade build tooling (gradle, YUI JS/CSS/Node compilers)
  • Remove broken/deprecated SOAP web services
  • Progress towards Java 17 (build tooling, bug fixes)
  • Add support for managing logging on a per-package level through the OSGi console

EEW & OpenAPI

CIOOS

  • OBIS Export now fully supports new annotation review schema

Data Policy

  • Module restructure - moved code to new module, Metadata Products - MP, which houses functionality around generating outputs from metadata, e.g. ISO 19115

ExperiMINTED

  • Instrument searches now use search_dtl table to enable these types of searches to have a query PID

React 17 Upgrade

  • Nearing completion, changes include faster builds

Community Fishers

  • Fixed Date Filter on geospatial map for Webpack
  • Drop siteDeviceId column from im_iso19115datasetrecord

Community Fishers App

  • Create CF App Version 3.2.9
  • Fix errors when building community-fishers in Jenkins
  • Increased the text size on the data visualizations
  • Create and test new Community Fishers App compatible with AML Firmware version 3.1.2

Acoustic Instruments Data Viewer

  • Add UI option for the spectrogramFrequencyUpperLimit dpo in the hydrophone toolbox
  • Modify dataviewer widget to give accurate dates after shrinking

Data Products

  • Added new Satlantic Radiometer calibration
  • Fixes to support upcoming MATLAB R2022b upgrade, including an upgraded logging system:
    • support new warn once method
    • find and replace all disp and warning calls with new equivalent in our dataproduct code
    • implement matlab changes to send logs to UDP socket 
  • Map and test device-level CSV/JSON time series scalar data products for Node and Junction Box devices
  • Testing and minor changes in support of new min/max options for time series scalar data products
  • Support instrument searches that use the search_dtl table (so that these searches can have queryPID / DOIs)
  • Handle erroneous ASL echosounder data (special case where it's firmware was corrupted and it dropped two channels)
  • Update logos on plots to new ONC blue
  • Bug fixes: seismometer data products: IRIS webservice bad formatting (problem on their end but we can handle it), Didson bad data

Tickets Released: Oceans 3.0: 22.12.000 (accessible to internal users only). Total: 98. Automated Testing: AT.22.12.000, total: 20.

Bug

  • [DMAS-69507] - Quarantine Device Filter Checkbox Broken on Device Console
  • [DMAS-69881] - Apparent memory leak in Archivers
  • [DMAS-73043] - Same request for averaged data in API and Data Search returns different results
  • [DMAS-74529] - DMAS Search Failed Notification: 16-Nov-2022 19:11:30 UTC, null, Video Export, SearchHdrId 12969504, UserId 116120
  • [DMAS-74646] - Junction box device type not prioritized
  • [DMAS-74663] - ASL echosounder when reporting only one channel gets tagged with the wrong channel info
  • [DMAS-74701] - Community fishers Date Filter on geospatial map works in Webpack only
  • [DMAS-74718] - unneeded scroll bars
  • [DMAS-74758] - Compile error in Eclipse: javax.xml.bind cannot be resolved in EEWSimulationIntegrationTest
  • [DMAS-74782] - NestedAutoComplete doesn't lose focus when clicked off of it
  • [DMAS-74810] - XML metadata reports dropped from all instrument searches in QA/master
  • [DMAS-74811] - Error in CF annotation CSV data product in QA search automation
  • [DMAS-74817] - Multiqueue Performance Improvements
  • [DMAS-74825] - Accessing AD files byDeviceDateStrExt with searchForwardOnly set to true results in incorrect query
  • [DMAS-74832] - Oceans 3 CI builds don't report an outdated jettyBase.bndrun
  • [DMAS-74838] - Fix DataPreviewManagementPage delete and default values
  • [DMAS-74868] - failed to deploy master branch of oceans 3.0 in QA
  • [DMAS-74873] - DMAS Search Failed Notification: 15-Dec-2022 21:15:51 UTC, Didson 3000 SN374, Sound Metrics Sonar Data, SearchHdrId 13398992, UserId 115850
  • [DMAS-74874] - Sensor-level Data Ratings Mirroring Device-level Data Ratings in O3.0
  • [DMAS-74887] - Red buttons in QA replaced with white
  • [DMAS-74906] - DMAS Search Failed Notification: 22-Dec-2022 05:30:27 UTC, Endeavour-Endeavour East, Seismometer Data, SearchHdrId 13627734, UserId 15356
  • [DMAS-74918] - DMAS Search Failed Notification: 25-Dec-2022 05:30:33 UTC, Endeavour-West Flank, Seismometer Data, SearchHdrId 13654404, UserId 15356
  • [DMAS-74922] - Oceans 3.0 master is failing to build
  • [DMAS-74929] - Task 255 "Generic File Post-processing job" failing every time
  • [DMAS-74933] - Failed to deploy Oceans 3 because of build errors
  • [DMAS-74949] - Reprocessing RDIADCP150WHS24623_20221003T000000.000Z.txt fails
  • [DMAS-74952] - QA YUI pages are missing some CSS and most of their content
  • [DMAS-74958] - Cannot add more than one instrument search to datasearch cart in qa
  • [DMAS-74960] - Search Tree Maintenance page doesn't render in QA
  • [DMAS-74964] - Matlab unit test LoggerTest leaves injected mocks in place after test
  • [DMAS-74974] - Unable to run OBIS Export task
  • [DMAS-74975] - YUI tabs have flipped gradients
  • [DMAS-74977] - archiver is throwing lots of errors in QA
  • [DMAS-75001] - Failed to deploy to QA2 because of conflicting dependencies
  • [DMAS-75014] - Extension ID will not show after editing in Topology page
  • [DMAS-75086] - Oceans 3 is using the wrong consistency level for reads & writes in Cassandra

User Story

  • [DMAS-42022] - As a seismometer data product user, I would like support for Guralp seismometer and accelerometers and related improvements
  • [DMAS-72940] - As a scalar data user, I would like CSV/JSON data products to support min/max and min/max+avg options

Task

  • [DMAS-67642] - Update external documentation for Oceans 3 - API, help and everything else
  • [DMAS-67928] - Add device-level Java scalar data products for Nodes and Junction Boxes
  • [DMAS-74196] - Add UI option for the spectrogramFrequencyUpperLimit dpo in the hydrophone toolbox
  • [DMAS-74223] - Create MapLayerService GET call to return map layers accessible by the current user
  • [DMAS-74333] - Added MapLayer to web.xml
  • [DMAS-74372] - Add groupprivilege for map layer resource
  • [DMAS-74437] - Create MapLayerService create, delete, and update calls
  • [DMAS-74464] - update calibration details for Satlantic Radiometers DI's 12106 and 12107
  • [DMAS-74472] - remove fax from organization metadata
  • [DMAS-74557] - As a Data Steward, I'd like to see the character limitation for device 'Memo' field removed
  • [DMAS-74568] - Modify dataviewer widget to give accurate dates after shrinking
  • [DMAS-74679] - Support new instrument searches with search_dtl records
  • [DMAS-74771] - Update data products ONC logo with new ONC blue
  • [DMAS-74775] - Remove old DataPreviewManagementCode from ONC Repo
  • [DMAS-74802] - Merge the bundles ca.uvic.dmas.core.system.util.impl and ca.uvic.dmas.core.system.util.command
  • [DMAS-74826] - Delete extension id column from topology table
  • [DMAS-74833] - Earthquake Historical Job incorrectly setting earthquake type
  • [DMAS-74854] - include dpo_audiodownsample parameter in OpenAPI definition
  • [DMAS-74857] - Add description and citation columns to the map_layer table
  • [DMAS-74871] - Increase Cassandra timeout a bit more to avoid search failures and other issues
  • [DMAS-74894] - Update Obis Service getSettings to Include DMAS_Admin info
  • [DMAS-74915] - Fix failing build due to test coverage
  • [DMAS-74992] - Dont allow duplicate extensionIds for a topology or extensionIds that are already part of a different topology in the same time range

Requirement

  • [DMAS-74652] - Requirements for storing and retrieving iso19115datasetrecords by siteDeviceSubsetId

Design

  • [DMAS-73714] - Database design to support storing ISO19115 for siteDeviceSubset

Implementation

  • [DMAS-47182] - AxisServlet appears to be an inactive servlet
  • [DMAS-73327] - re-write the parserdefintion tab with react
  • [DMAS-74099] - Replace gradle-js-plugin and gradle-css-plugin with gradle-minify-plugin
  • [DMAS-74149] - Upgrade gradle to 7.6
  • [DMAS-74214] - Implement matlab changes to send logs to UDP socket
  • [DMAS-74450] - Refactor DataProductDelivery API to Create search_dtls with Instrument category searches
  • [DMAS-74474] - update UI code to remove fax column
  • [DMAS-74475] - update phone database table
  • [DMAS-74500] - Update OBIS Export to use new review schema
  • [DMAS-74545] - Update annotation service to use new review schema
  • [DMAS-74563] - Rename dataset packages and update documentation
  • [DMAS-74618] - Drop siteDeviceId column from im_iso19115datasetrecord - SQL
  • [DMAS-74628] - Upgrade gradle-node-plugin
  • [DMAS-74648] - Write SQL To convert old (1 month-ish) Instrument by Category searches to contain search_dtls
  • [DMAS-74792] - add some small improvements to the open api page
  • [DMAS-74800] - Add an OSGi command to set the log level for a single package
  • [DMAS-74822] - Find and replace all disp and warning calls with new equivalent in our dataproduct code
  • [DMAS-74845] - Add warn once method
  • [DMAS-74849] - Merge redundant versions of isMemberOfAdminGroup
  • [DMAS-74851] - Restore sampleTime field and data in min/max resampled JSON
  • [DMAS-74862] - Update backendcode to remove OrganizationFax
  • [DMAS-74869] - Create new TextField base component with self-contained state
  • [DMAS-74870] - Merge HibernateEnvironment and HibernateSession
  • [DMAS-74877] - Implement fixes after replacing matlab logging with Logger
  • [DMAS-74883] - Create Group Selector app component
  • [DMAS-74899] - Upgrade xstream to 1.4.19
  • [DMAS-74908] - Convert OrganizationList to Functional Component
  • [DMAS-74932] - script to delete some sensorattributes

Bug (ST)

  • [DMAS-67620] - tryDBquery.m returning empty string instead of expected value ('null')
  • [DMAS-74694] - Time series scalar JSON product with averaging has extra fields (for min/max)
  • [DMAS-74895] - Some earthquake correlator tests fail when run in Java 17
  • [DMAS-74896] - Missing space between time of min and min value in ODV with min/max or min/max+avg
  • [DMAS-74916] - SensorObservationService fails to run in Java 17
  • [DMAS-74931] - Tiff2pdf is not working with Matlab R2022b
  • [DMAS-74985] - Fix display issue for the new react page of Parser Definition View
  • No labels