This page contains the current year's release notes and new features, primarily for Oceans 2.0 / DMAS, as well as any applications created/maintained by the ONC software engineering group, including mobile Apps and desktop/PC applications. In progress project status may be presented as well.
Previous years:
The information below is written in plain language as much as possible. Detailed release notes are available on internal confluence pages (requires login).
April 14, 2021
Minor release: various fixes and features including: Data Preview GIF player improvement, SeaTubeV3 layout, Community Fishers fixes
[DMAS-58263] - Fail to add DateTo information for existing IP
[DMAS-58273] - DMAS Search Failed Notification: 09-Apr-2021 16:46:17 UTC, AML CTD Plus X 50241, Aligned and Depth-Binned Profile Data (On-Demand), SearchHdrId 8536670, UserId 94330
[DMAS-58276] - Video files at the start of dives are not played in SeaTubeV3
User Story
[DMAS-58233] - As a DFO CODAR Data Preview user, I would like to load lower resolution gifs for faster load times
[DMAS-58245] - As a dive logger, I would like a ST layout to display larger video.
Task
[DMAS-58196] - Create locations for DMAS + ActiveMQ for new ferries
[DMAS-58242] - Add small GIFs for Data Preview to work with the new GIF player
[DMAS-58393] - As a Data Steward, I would like to stop the automatic generation of JIRA tickets for Unassigned and Bad casts
Design
[DMAS-58264] - Create design for a video-focused predefined layout
Implementation
[DMAS-58248] - Add new video-focused predefined layout into STV3
[DMAS-58252] - Front-end code change for gif player to use smaller sized gifs
Test
[DMAS-57976] - Add web service tests to cover resampling changes
[DMAS-58207] - Create regression test for Gif Player
Bug (ST)
[DMAS-58221] - Update styling and functionality following testing
April 7, 2021
Major release
Maintenance and Production Developer
Bug fixes including QAQC inheritance
ONC website support, including Wiring The Abyss updates for the maintenance expedition
Migration of several pages/UI to modern REACT framework: extension + item pages
State of Ocean/Environment/Climate plots now configurable
Animated GIF player and image tiling for Data Preview
Instruments
Minor modifications to straw drivers and parsers.
Fine tuning new compass feature on Kongsberg driver to work with data products.
Minor modification to ASL MUD driver, check and turn off verbose mode.
Cancel blocked processing on shore station: Systems can now cancel blocked processes on the shore station such as the parsing routine blocking. This applies to all processes after a message is dequeued and before it is queued to the archiver.
Minor improvement to logging at shore station.
New features for binary parsers. Used in ASL MUD. Binary parsers now work with variable length records and allow specifying sensor positions relative to the payload instead of the packet. Changes wrt to ASL Mud documented here Parsing Binary Data With Dynamic Packet Size, general documentation for declarative parsers updated: Declarative Data Parser Definition File Format (internal links)
Improved logging on shore station event detection routine.
Multiple queues project (in-progress)
Users can now create PAMguard batches through the task management screen, Batch section.
Earthquake Early Warning
Correlator event expression simplification. EEW event detection expression now uses a more generalized device selector expression.
Titan driver modified so build date can be parsed. This feature requires deployment to all titan locations, not sure of the priority for deployment.
Data Products
NEW CODAR netCDF products for Combiner + Radial stations
RDI fix for correlation screen option being less than onboard correlation screen
ASL mud improvements: .01a files to use DMAS time not device time, handle varied orientation, improve handling of non-standard data, improve logging
Search automated testing improvements (internal use only)
Bug fixes + support
Data Player
No longer uses archived hydrophone images on initial load (to avoid old incompatible images)
Toolbox now programmatically gets dataproduct options for a given device
Fixed bug: plot times on ADCP current plot do not align with timeline in dataviewer
Initial changes in place for image caching (will work with Systems to activate in April)
Testing and operationalizing Matlab as a service (in-progress)
Community Fishers
Pipeline now triggered to run cast detections by raw data ingestion (not activated)
Data products to use search tree node name for station name instead of search tree node code
Geospatial Map returns most recently completed cast preview data products, not the most recent
Only generates Cast Preview Plots if older than three days or new cast is at SearchTreeNode
Fixed bug: automated creation of JIRA tickets by job #341
Androidlog files are no longer being archived
Pipeline now sends e-mail when a bad file is encountered
SeaTubeV3
ONC SeaTube support
Oceans 2 Help Desk improvements
Sensor plot now uses the dashboard plotting widget with support for plotting multiple sensors at the same time
Bug fixes
Dashboards
Fixed bug where it wasn't possible to select a run folder in a User Defined Task Widget
Can share a Dashboard to a user with Edit permissions
Correct title in Latest Readings Widget
API & CIOOS
Fixed bug where an incorrect end date was put in a CKAN record
Return data set Id from the ErddapManagementService create operation
[DMAS-50249] - Search automation falsely reports failure for AquaTec CSV data product
[DMAS-54242] - EEW Test Notification service logging error
[DMAS-56636] - failed export json format with image in QA
[DMAS-56757] - Search automation report shows data product .json expected files in the result.json column
[DMAS-57319] - CKAN record Temporal Extent End dates are inaccurate
[DMAS-57337] - jobid link on CameraControl page should be linked to taskmanagement page, not schedulerconsole
[DMAS-57340] - In some cases, QAQC reprocessing fixes incorrect QAQC flags for all sensors but Density and Sound Speed
[DMAS-57534] - How do we delete qaqcResult dateTo is beginning of next date in reprocess or qaqcreprocess?
[DMAS-57546] - qaqcreprocess does not handle "duplicate" qaqcresults correctly
[DMAS-57555] - question about how qaqcreprocess handle overlap for station level qaqc
[DMAS-57638] - User defined task widget doesn't show list of runs
[DMAS-57724] - Test automation is logging lots of vague NullPointerExceptions in GetWebServiceMetricsMVCResourceCommand
[DMAS-57734] - When running automation tests, the tool prints a number that is implied to be the number of pending tasks, but is actually the total of historical + pending tasks
[DMAS-57790] - need support for millisecond while request the video stream
[DMAS-57795] - Cache load of event definitions throwing null pointer
[DMAS-57800] - The automation tool fails to deploy and logs a hard-to-understand exception if it can't connect to qapgsql
[DMAS-57802] - Fix logging of configuration change ASL data products
[DMAS-57830] - Need update dateto of current ip when add a new ip for the same device
[DMAS-57833] - should not allow one ip active for mutliple devices
[DMAS-57868] - Changes to a Taxon cause its children to vanish from the taxonomy tree until the page is refreshed
[DMAS-57940] - Back-end changes to support taxonomy delete functionality
[DMAS-57941] - Back-end changes to support taxon button set delete functionality
[DMAS-57978] - get SitePosition from database only when cacheloading
Bug (ST)
[DMAS-57634] - Editable inherited comment attribute always saves on focus loss
[DMAS-57947] - Logging in redirects to /domain/Apps/theme/colors.css instead of the home page
[DMAS-57949] - Can't create issues from the new issue collector when not logged in
[DMAS-57957] - Not getting good compass heading values in new SMB files
March 4, 2021
Major release
Maintenance and Production Developer
Bug fixes including QAQC reprocessing, QAQC inheritance
ONC website support
Migration of several pages/UI to modern REACT framework (DeviceAction, new page Cables) (on-going)
Several other small improvements/features (in-progress)
Instruments
Wally - driver modified to match devices telemetry change in motor logging
Rayfin - take picture function in seascript now available
Straw - new status commands added, refinements to parsing.
Pro Oceanus - Burst mode enhanced to be more reliable
Seabird CTD with O2 piggyback - Driver enhanced to handle piggyback problems better
RBR Concerto Tilt Meter - Additional start up setting
BPR - Driver now support binary mode
AIS Source bug resolved
New syntax in calibration formulas where sensors can be referenced by sensor code and device attributes can be referenced by attribute code, instead of by sensorid and attributeid
New screen for uploading PAMguard configuration files
PAMguard batches are automatically scheduled, system will limit the number of concurrent PAMguard tasks
Earthquake Early Warning
jep refactored as a separate bundle. This is an optimization for EEW deployments and moves us closer to exposing the jep code publicly
Shore station - device being processed can be viewed through jconsole. Allows for quicker troubleshooting when the shore station is blocked
Improvements to PGD algorithm
Shore station threading and cache load issues
Data Products
Search automation improvements (in-progress)
Added ancillary data to RDI netCDF plus improvements
Kongsberg compass support
Support for ASL mud variant + overall AZFP improvements
Data Player
Fixed misalignment between image and timeline
Add more instruments to selection dropdown
Testing Matlab as a service (in-progress)
Community Fishers
ALM-6 with AMLx formatting
Help button with wiki links in Geospatial Map
Now able to save data off tablet to Google drive
Geospatial Map now uses Open Street Map tiles as default
Updated data search to handle multiple casts for .COR file data product
Multiple minor changes to Android Tablet App
SeaTubeV3
support adding multi attributes in a single quick button, Taxonomy Attribute Management page.
NOAA help desk rewrites in React and adding auto fill for names/email and organization information
Bug fixes
Dashboards
permissions:
don't allow display of dashboard using a URL if don't have permission
only allow access to Dashboards if logged in
only allow access to embed if logged in
only auto-refresh if tab is active, only refresh every 30s
fix issue with playing video play lists
API & CIOOS
adcpdata service - add getByLocation
scalardata service - check for resample period
archivefiles service - support download of compressed
Bug [DMAS-32109] - Step 2 of data search providing incorrect link to IRIS. [DMAS-38396] - Send Help Request from search results shows "undefined [DMAS-46794] - DeviceActionForUI class has a misspelled variable (EnginneringListId) [DMAS-48286] - Can't create a Device Action for Devices that aren't on the Observatory [DMAS-56546] - Tests failing in UserReplication [DMAS-57350] - QA hosts with DATACENTRE role become unresponsive after launching too many threads [DMAS-57442] - sitedevices are not being saved [DMAS-57533] - qaqcreprocess does not handle qaqc inheritance correctly [DMAS-57610] - Fix failing UI tests in DataViewer [DMAS-57619] - AML6 Cor dataproduct sometimes has turbidity column for cast in cor dataproduct [DMAS-57631] - Prevent a dashboard from being viewed if the user has not been given permission [DMAS-57644] - Using latest in Audio widget doesn't get the most recent file [DMAS-57657] - CKAN data records link to DataSearch but the name suggests they link to ERDDAP [DMAS-57671] - Permissions for data specialists editing device attributes not working [DMAS-57672] - Error when starting a fitlet on the latest branch [DMAS-57676] - update PGD and PD algorithms to use most recent displacement values [DMAS-57697] - Some automatic cache reloads over JMS dont work [DMAS-57725] - Search automation detected a change in header metadata for CSV products on the VPS - related to siteposition? [DMAS-57727] - the device action table doesn't show all columns within the width of page if the comment is long and no scroll bar [DMAS-57737] - BundleUtil Cannot Find DataEnrichmentCacheModule [DMAS-57743] - AIS Source driver is not outputting anything [DMAS-57760] - qaweb is unable to find sos.properties [DMAS-57771] - Requests for dashboards 115 and 137 causing significant load on web server [DMAS-57778] - Could not get french translation for device category description. Will not generate French abstract [DMAS-57792] - Latest Readings Widget isn't using the correct sensor when using location source [DMAS-57798] - Cast Scalar Profile Plot is unable to find cast location for device level searches [DMAS-57811] - 404 error caused by references to qaqc in neptune_header_light.vm [DMAS-57812] - Playlist data source in Video Widget does not select a playlist [DMAS-57831] - Plot times on ADCP current plot do not align with timeline in dataviewer. [DMAS-57834] - Error Running tests in onc-web [DMAS-57836] - master branch of Oceans 2.0 build failed [DMAS-57877] - I can't rename a customized taxon name [DMAS-57880] - hydrophoneCalibration.txt file missing from FLAC search result [DMAS-57881] - SystemConsole in QA with release/21.02.000 is broken [DMAS-57885] - Unable to create new searches with DataSearch. [DMAS-57886] - Bug causing DiveServlet not to load properly [DMAS-57894] - Fix TypeError when adding a Properties by Location data product to cart [DMAS-57898] - error saving ServiceLogState on qa web [DMAS-57899] - clicking either of the root nodes on the tree in Taxonomy crashes page [DMAS-57901] - Fix Create.instrumentsByCategory failure [DMAS-57913] - Task reference name is unknown until finishing and cant cancel running task [DMAS-57921] - Map is not loading in QA data search. Also, card pop out when selecting a device is not occurring. [DMAS-57922] - Can't delete attribute and attribute group in Taxonomy Attribute management page User Story [DMAS-45728] - Passwords can be read using inspect element in Task Management [DMAS-56773] - As a dev, I would like to see qaqc auto tests finder page rewritten in react [DMAS-56775] - As a dev, I would like to see qaqc auto test details page rewritten in react [DMAS-56889] - As a Data Search user, I would like to be able to cancel any running of my running or pending searches [DMAS-57230] - As a software developer, I'd like the /DeviceStatus page updated to React [DMAS-57379] - Cloning a device also clones the serial number of the sensors in the additional attributes tab Task [DMAS-52454] - Search Automation failing comparison on new .cor files: add to text comparator and skip 'ProcessingDate' [DMAS-56007] - New driver attribute for Nanometrics titan (350) and tiltmeter (430) for controlling sample rate [DMAS-57116] - Add DOI Attributes to ERDDAP records through dataset.xml [DMAS-57400] - Update UI tests for /FileUpload [DMAS-57449] - Make "Data Availability" title look the same as the other config titles [DMAS-57456] - simplify PPP calibration formulas [DMAS-57459] - Add UI component tests for the DataAvailabilityChart [DMAS-57512] - Add ancillary data to RDI netCDF data product- correlation, error, percent good [DMAS-57543] - Change DatasetAttributeService from using hard coded versions of the organization statement abstracts and move them to GlobalProperties [DMAS-57630] - Only allow Embed Dashboard and Widget when user signed in [DMAS-57698] - As a Task Management user, I would like the windows for the job parameters to be expandable [DMAS-57738] - Update kalman filter to use the accelerometer's sample rate attribute [DMAS-57739] - Correct code for creating default values of "Expected search failures" field in search automation configuration [DMAS-57751] - change the default sorting of the Cruise Listing to be reverse datefrom chronologically [DMAS-57766] - As ONC who doesn't have anonymous API access I want to ensure only logged in users can access Dashboards management and dashboard pages [DMAS-57789] - Write FTP Job to Transfer androidlog files from FTP directory to ArchiverlowPriority [DMAS-57844] - new item "System Status" on dmas menu [DMAS-57849] - Change 'No Data' to 'No Records Found' for React Tables Requirement [DMAS-57223] - Gather requirements [DMAS-57327] - Document general requirements for Java 9+ support [DMAS-57402] - Document requirements Design [DMAS-57224] - Design the system for associating a set of bundles to a DMAS host [DMAS-57477] - Design the new support request UI [DMAS-57816] - Need a story book mock up Implementation [DMAS-28469] - Driver for ASL Acoustic Scintillation Device [DMAS-43988] - Move the web layer to a new bundle [DMAS-56280] - Add a new react page for user defined classifiers in PAMGuard [DMAS-56860] - Write QAQC Finder front end in React [DMAS-56914] - Update QAQC Finder back end for updating to React [DMAS-57015] - Write QAQC Details front end in React [DMAS-57016] - Update QAQC Details back end for updating to React [DMAS-57024] - Automatic scheduling of Pamguard batch jobs [DMAS-57100] - When a user cancels a search they should be linked to the data search help page [DMAS-57240] - Extract JepCache into its own OSGi bundle [DMAS-57258] - Update services for use with react page of DeviceListing [DMAS-57259] - Write new React page for /DeviceListing [DMAS-57310] - Create Help button in Geospatial Map [DMAS-57347] - Do compass check in kongsberg rotary SCAN mode [DMAS-57348] - Use the compass data in the SMB post-processor heading calculation [DMAS-57403] - Use an alternate issue collector in Dev/QA [DMAS-57436] - Update backend for /DeviceStatus [DMAS-57439] - Support both Java 8 and 11 in UI tests [DMAS-57447] - Add AvailabilityChart cypress test [DMAS-57470] - Update ui tests for /DeviceStatus [DMAS-57508] - Create an issue collector form [DMAS-57510] - Update backend for DeviceSearch [DMAS-57511] - Write new react page for DeviceSearch [DMAS-57528] - Update selenium scripts for QAQC Details change to React [DMAS-57535] - Add functionality to getByDevice [DMAS-57536] - Add functionality to getByLocation [DMAS-57544] - Creating database scripts [DMAS-57572] - Update UI tests for DeviceSearch [DMAS-57623] - Update TaxonButtonSetService to handle multiple attributes for a single button [DMAS-57637] - Modify archiveFile service to accept compression parameter for accessing compressed files [DMAS-57654] - Update new Taxon Button Set Config and Manual Entry pages to handle service call changes [DMAS-57682] - Create page in the front end for Taxonomy Attribute Management [DMAS-57688] - Add getByLocation method [DMAS-57696] - Change DeviceCloner code to not clone sensorattribute values [DMAS-57700] - Add unimplemented CRUD operations to TaxonomyAttributeService [DMAS-57701] - Add method to get list of devices at a location with date ranges [DMAS-57702] - Create a taxonomy attribute group service [DMAS-57741] - Create a taxonomy attribute line service [DMAS-57752] - implement react code [DMAS-57755] - Increase Equinox's framework start level [DMAS-57765] - Update ui tests [DMAS-57773] - Add french and english organization statements for abstract to database [DMAS-57774] - Change code to use config property organization statement in creating Dataset object [DMAS-57794] - rollback java code to recover those two columns [DMAS-57810] - Refactor camera take picture driver file transfer [DMAS-57825] - Display all devices in the title and e-mail subject [DMAS-57826] - code change to make Cruise Listing be reverse datefrom chronologically sorted by default [DMAS-57854] - Update text following demo meeting [DMAS-57912] - Add page to the SeaTube menu in the navigation [DMAS-57914] - Add Attribute Management page to entry.jsx [DMAS-57920] - Allow nullable attributes for ONC expedition loggers and data stewardship Bug (ST) [DMAS-57732] - Fix misspellings in the back end code [DMAS-57733] - Fix misspellings in the React code [DMAS-57740] - master branch with Revision: 0010036539 in Oceans 2.0 deploy failed in QA [DMAS-57749] - No web pages are visible after qaweb2 finishes starting [DMAS-57772] - Any logged-in user can access TaxonomyMatrixAttributeService's POST operations [DMAS-57904] - Some OceanNext features are not working in QA Documentation [DMAS-57329] - Update development environment installation documentation
February 17, 2021
Minor release: FLAC file transfer support, SeaTube and Community Fishers improvements.
[DMAS-57395] - Fix failing test in dataPreviewGeneration
[DMAS-57415] - The datacite abstract is adding unwanted French content to the end of the abtract
[DMAS-57418] - CKAN ISO 19115 records not downloading
[DMAS-57422] - DevicePort Maintenance page has an error when trying to get newly added port
[DMAS-57465] - Link from siteDevice page to ERDDAP record is broken
[DMAS-57472] - Error occurred trying to reprocess qaqc results on dateRange DateRange [Mon Jan 14 00:00:00 UTC 2019 to Tue Jan 15 00:00:00 UTC 2019] for deviceId506
[DMAS-57480] - memory leaking from qaqcreprocess job