Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

The information below is written in plain language as much as possible. Detailed release notes are available on internal confluence pages (requires login).

September 21, 2021

Minor release: MATLAB-as-a-service feature release, rayfin driver (no downtime)

Tickets Released: Oceans 2.0: 21.07.002 (accessible to internal users only). Total: 2.

Expand

Implementation

  • [DMAS-54233] - Implement Matlab always running (Matlab as a service)
  • [DMAS-66637] - Rayfin driver - light and strobe support

September 20, 2021

Minor release: various fixes, primarily for latest preview generation

Tickets Released: Oceans 2.0: 21.08.001 (accessible to internal users only). Total: 14.

Expand

Usability

  • [DMAS-66587] - CKAN API call is generating random UUIDs for Citation Identifiers (AKA DOIs) for CKAN records - even when there are DOIs associated

Bug

  • [DMAS-64777] - Data Preview searches are no longer tasktypeid 16 "Data Product Preview Search"
  • [DMAS-66640] - AnnotationList doesn't scroll to the correct annotation when parameters are provided in the SeaTube url
  • [DMAS-66659] - Site Device Subset edit bug for CF126-4082
  • [DMAS-66672] - Check to see if device is Community fishers device does not function if device was decommissioned and search range ends before decommission date or location based search
  • [DMAS-66685] - CODAR latest preview searches not finding recently acquired files
  • [DMAS-66708] - TaxonomyService fails with "IllegalStateException: Use the other version of this method to delete from both caches" on updating a taxon

Task

  • [DMAS-66550] - Latest Data Preview searches should have their own tasktypeid
  • [DMAS-66677] - Dive Annotations not showing in SeaTubev3 (with Chrome)

Implementation

  • [DMAS-66315] - Add trx tables for tables related to taxonomy attributes
  • [DMAS-66633] - Java code for latest preview task type id
  • [DMAS-66634] - SQL change for latest preview task type id
  • [DMAS-66694] - Change annotation list's displayed annotations

Investigation

  • [DMAS-66361] - investigation-getPNG failures for 16 to 47 month plots of sensors deployed to Campbell River

September 13, 2021

Major release (delayed due to maintenance expedition)

Maintenance and Production Developer

  • qaqc UI bug fixes and improvements
  • CODAR/WERA latest data preview
  • ONC website for ONC cruise
  • Prod bugs
  • other small improvements (e.g., search feature on FileManagement and ReprocessConsole pages)

SeaTube

  • ONC Annotation List performance improvements
  • NOAA Chat Log support
  • Each organization manages their own dives
  • System admins can delete their own annotations
  • Bug fix

Data Products

  • Bug fixes: Nortek plots (data rating), ASL memory use reduction, ASL pressure sensor, Kongsberg rotary search failure, state of ocean CSV fix
  • Latest preview: data product code now prepares and puts PNGs/GIFs on /ftp/pub/latest/<STNid>/<DCid> for display in the latest tab in Data Preview
  • File archiving and management configuration changes and a new instance to reduce latency (for latest preview generation)
  • Device attribute "manager" now fills in DateTos with subsequent DateFroms (the java code already does this, this makes the two behave the same)
  • Search automation improvements - status graph accuracy and coverage

Dashboards

  • Bug fixes:
    • Non-English characters show correctly in Text Widget (and everywhere else)
    • Chart widget correctly shows Y-axis
  • Can show larger image by clicking in Image and Data Preview widgets
  • Anonymous users can access dashboards
  • User tokens and dashboard tokens are used in scalardata, archivefiles and devices public services

CIOOS

  • Logging reduced to debug for missing translations
  • Handle issue with some mobile datasets not getting uploaded to CKAN - CF names are longer than supported

Instruments

  • Driver machines subscribing to reprocess queue. Only needs deployment to data centre
  • Refactor - removal of version number in parser definition
  • Refactor - removal of unused fields in device table
  • Bugfix for handling file state in DataProductUploadService - not consistent with FileArchiverService
  • Fix for RBRLogger3 driver. Driver initialization now turns on logging to serial port. Change does not need to be deployed.
  • Fix for Seabird Seacat CTD driver. Fixes problem where driver required a restart every time the device was powered down.

Community Fishers

  • Matlab as a service will go out as a feature release after the main Aug release
  • Upgrading of site device subsite maintenance page to allow for values editing and re-postprocessing

Acoustic Instruments Data Viewer

  • added search by location to device selection component

Tickets Released: Oceans 2.0: 21.08.000 (accessible to internal users only). Total: 130.

Expand

Bug

  • [DMAS-13571] - Unicode characters are not correct during/after registration
  • [DMAS-58383] - Unable to upload metadata to CKAN for some mobilesurface datasets
  • [DMAS-64119] - Investigate funky cast (CF015-4240)
  • [DMAS-64151] - Cast detection for CF004-4263 resulted in buggy incorrect start time
  • [DMAS-64479] - DeviceActionServiceTest fails occasionally in Jenkins
  • [DMAS-64672] - Nortek plotting data products code not using the DMAS data rating - plots are very gappy
  • [DMAS-64678] - Incorrect start times in cast detection: please investigate
  • [DMAS-66299] - UI tests are failing with "Attempt to reopen Postgres connection"
  • [DMAS-66305] - Fix failing UI test in geospatial map
  • [DMAS-66358] - Task machines log Velocity ResourceNotFoundExceptions if DmasServiceManager starts before VelocityLifecycleManager
  • [DMAS-66380] - SeaTubeV3: Certain dive hangs Firefox
  • [DMAS-66382] - Chart Widget not displaying Y-axis, displays time instead
  • [DMAS-66384] - SeaTube and Oceans 2.0 very slow, logging is a problem
  • [DMAS-66398] - Additional delete buttons appear after saving on a dive page
  • [DMAS-66414] - misleading message during Oceans-next deployment
  • [DMAS-66439] - UI test suite failed with "Error forwarding the new session Empty pool of VM for setup Capabilities"
  • [DMAS-66514] - Latest Preview searches are not being created on .ruv/.tuv file acquisition by the CODAR FTP task
  • [DMAS-66519] - EventSerializerShallowTest fails randomly on unrelated feature branches
  • [DMAS-66531] - Data Search - files should be continuous in time when download includes multiple files
  • [DMAS-66534] - Latest Preview search generation is creating duplicate searches
  • [DMAS-66535] - Unicode characters entered in the UI are incorrectly encoded in QA and production
  • [DMAS-66536] - Driver for Sea-Bird Microcat SBE37SIP on wally stops collecting data periodically
  • [DMAS-66538] - Latest Preview search generation is creating searches with erroneous dates
  • [DMAS-66553] - Database post-refresh scripts can't be run in psql because of non-standard comments
  • [DMAS-66561] - Make the Dashboard and Widget embed URLs anonymous
  • [DMAS-66563] - Device autocomplete showing all devices not just those for specified category
  • [DMAS-66566] - Investigate QA crash from Sep 1 1:22 UTC
  • [DMAS-66567] - EventDetectionService failing in QA
  • [DMAS-66568] - Geospatial Map does not display Community Fishers Annotations
  • [DMAS-66589] - DMAS Search Failed Notification: 02-Sep-2021 22:48:50 UTC, AML-6 LGR A60015, Aligned and Depth-Binned Profile Data (On-Demand), SearchHdrId 9666758, UserId 3162
  • [DMAS-66595] - There are two sets of zoom in./out buttons in ST Map widget
  • [DMAS-66598] - Taxonomy sync function are not working in QA
  • [DMAS-66599] - TaxonomyMatrixManager logs NPE trying to publish cache reload messages
  • [DMAS-66604] - failed to create a new dive in QA
  • [DMAS-66611] - Adding a sensor calibration does not add a trigger task to the selected batch
  • [DMAS-66630] - Annotation List "Copy Link" option doesn't maintain it's value between page loads

User Story

  • [DMAS-33640] - As a user, I would like to allow annotations to be created and displayed in a foreign language
  • [DMAS-57784] - As a scientist, I would like data acquisition for the cabled sonardyne fetch instrumentation planned for Barkley Upper Slope 2021
  • [DMAS-64762] - As a hydrophone data steward, I would like to be able to update sensitivity vector device attributes by uploading a .m file
  • [DMAS-65457] - As a Data Specialist, I need the ability to create a sitedevicesubset and have it generate corrected cast data
  • [DMAS-66282] - As a CODAR/WERA user, I would like to see the latest data in Data Preview as close to live as possible -- matlab part
  • [DMAS-66459] - As a Data Specialist, I would like some sort of warning system to prevent me from deleting sitedevicesubsets as a result of user error

Task

  • [DMAS-46744] - Update the CAP signature to use RSA SHA 256
  • [DMAS-64470] - As logger admins, we would like manage dives for our own organization
  • [DMAS-64679] - Add select by location to the Configure Data Player dialogue
  • [DMAS-65384] - As a ST user, I would like to keep more ST configs after refresh the page.
  • [DMAS-65417] - Enable FILE_STATE_P flag in file names in DataProductUploadService and related tasks
  • [DMAS-66300] - As a data steward, I would like the PI and owner fields removed from the device table
  • [DMAS-66355] - please change one description line for Oceans-next deployment in Jenkins
  • [DMAS-66362] - As a release person, I would like to check pattern of fix version of ticket before code is merged
  • [DMAS-66366] - SeaTube V3 is forcing us to select a camera before many of the functionality will work
  • [DMAS-66388] - Allow a bigger version of the image shown in either the image or preview widgets to be displayed
  • [DMAS-66420] - Update the dateTo of the deviceAttribute with the dateFrom of the next one (in the matlab function)
  • [DMAS-66421] - As a Data Specialist, I would like the ability to query File Management or ReprocessConsole using a device id
  • [DMAS-66435] - Make an OSGi service whose properties let us control whether other services are started
  • [DMAS-66438] - Add search automation test cases for new device category + data product format combinations that aren't covered
  • [DMAS-66440] - Replace the deprecated JCenter Maven repository used by Oceans 2
  • [DMAS-66448] - Clean up minor coding issues found in DMAS-66444
  • [DMAS-66503] - Update hydrophone file compression job to accept .oct and LPF/HPF files
  • [DMAS-66504] - Update file archiving to better support near-live data access
  • [DMAS-66508] - RBRLogger3 driver - turn on streaming to serial durint driver initialization
  • [DMAS-66518] - Modify fileArchiverService to sort files by date, newest to oldest
  • [DMAS-66523] - "Data Preview Latest Generator" searches should use a new queue, not search or search.preview queue
  • [DMAS-66526] - update name and description for job 342 "wera-file-download"
  • [DMAS-66551] - Ensure all devices service calls made from a dashboard use api not apiproxy
  • [DMAS-66552] - Remove old Oceans Next stashes and UI Testing screenshots from Jenkins, to save space
  • [DMAS-66562] - Add consumer thread for search latest tasks + small date fix
  • [DMAS-66583] - Add logging to ExternallyDerivedSensorDataIngester to log when a NaN value is found within a dataline
  • [DMAS-66585] - Consider emty return for chat log service if the user doesn't have read permission
  • [DMAS-66597] - Add property to limit latest preview queue to 1 thread
  • [DMAS-66602] - Remove some sql scripts in 21.08.000 release

Design

  • [DMAS-58377] - Design a system to put near-live / latest data on Data Preview

Implementation

  • [DMAS-58392] - DAF Routing Component
  • [DMAS-64536] - Update the file clean up configuration to support latest data preview
  • [DMAS-64731] - Update code to use sy_token instead of dmasuser.token
  • [DMAS-64736] - Update backend to support application tokens
  • [DMAS-64737] - Backfill sy_token with tokens for existing dashboards and users without tokens
  • [DMAS-64738] - Generate a token when a dashboard is created
  • [DMAS-64739] - Add the token for the currently active dashboard to an external service call
  • [DMAS-64855] - Change common dataset generation logging messages to be debug
  • [DMAS-65495] - Add appropriate columns to taxonomy and taxon tables for vocabularies and vocabulary terms
  • [DMAS-66224] - Add Option to create Cast Data On SiteDeviceSubset Maintenance UI
  • [DMAS-66227] - Modify SiteDeviceSubset service to create cast file on siteDeviceSubset creation
  • [DMAS-66262] - Initial Parser for Cable Fetch devices
  • [DMAS-66283] - Create service for multi queue page
  • [DMAS-66297] - Oceans Next autodeployment should lock qa2.oceannetworks.ca, not qa.oceannetworks.ca
  • [DMAS-66315] - Add trx tables for tables related to taxonomy attributes
  • [DMAS-66356] - Write a script to plot the size of each cache over time
  • [DMAS-66371] - Add front end support for displaying chat logs in the Annotation List
  • [DMAS-66377] - Add feedback when failed token service call
  • [DMAS-66379] - add support for primary and non primary shorestations
  • [DMAS-66385] - Update the multiqueue service to send messages over the multiqueue topic
  • [DMAS-66400] - Database table(s) for chat logs
  • [DMAS-66405] - implementation: update sensitivity vector attributes by uploading a m file
  • [DMAS-66410] - DAL for chat logs
  • [DMAS-66413] - get ShorestationDafQueueCache to startup correctly
  • [DMAS-66415] - Remove VersionNumber column from Java Code
  • [DMAS-66416] - The DafProcessingService needs to start up an activator for each queue running the shorestation
  • [DMAS-66427] - Update backend to allow annotation deletion for system admins
  • [DMAS-66428] - Update frontend to use V3 deletion call
  • [DMAS-66444] - Remove calls to ServiceUtil in loops
  • [DMAS-66445] - Add a Taxon cache
  • [DMAS-66449] - Support deploying Oceans 2.0 through a proxy
  • [DMAS-66451] - Web service(s) for chat logs
  • [DMAS-66452] - if multi queue is enabled only the routing component should subscribe to the parser queue
  • [DMAS-66453] - Drop number of Data Search Threads down from 6 to 5 on qa tsks
  • [DMAS-66455] - Calculate device dependencies when moving between queues
  • [DMAS-66473] - Add Dashboards and Widgets urls to allowed anonymous paths
  • [DMAS-66476] - Create Service call that returns casts that will be deleted
  • [DMAS-66480] - Update Rayfin camera driver to add dateto to still image filenames
  • [DMAS-66496] - Improve the performance of querying the database for dive annotations
  • [DMAS-66497] - Remove the test sourceset from chatlog.api
  • [DMAS-66499] - add/support da_multiQueueMove table
  • [DMAS-66515] - Improve file archive queue wait for near-live matlab searches
  • [DMAS-66517] - Implement Alert box displaying SiteDeviceSubsets about to be deleted on save
  • [DMAS-66520] - Add iFileLocationConfig for new file archiver
  • [DMAS-66524] - Set device ID list as a parameter in the query ArchiveFileState.paged
  • [DMAS-66537] - Clean up Hibernate query statistics
  • [DMAS-66600] - Drop trigger "tx_taxonomy_trx"
  • [DMAS-66614] - Allow anonymous users in SeaTubeChatLogService

Test

  • [DMAS-66469] - Test latest preview generation - matlab part

Bug (ST)

  • [DMAS-66422] - ecarc1 logs errors on startup
  • [DMAS-66423] - Fix back end error when token invalid
  • [DMAS-66463] - Fix null pointer error in update method for tokens
  • [DMAS-66507] - Integration testing build is triggering stages of Oceans Next that should only be run in QA
  • [DMAS-66509] - SessionMonitoringCommand fails with an NPE if there are sessions without a user attribute
  • [DMAS-66545] - In QA, the annotation service return empty records.
  • [DMAS-66560] - DeviceConsole not loading in QA on release branch
  • [DMAS-66573] - typo in latest preview matlab code

Investigation

  • [DMAS-66446] - Investigate where operation 1 of SeaTubeV3AnnotationService is spending its time

August 16, 2021

Minor release: various fixes and upates

Tickets Released: Oceans 2.0: 21.07.003 (accessible to internal users only). Total: 32.

Expand

Bug

  • [DMAS-55035] - Driver machines are subscribing to too many queues
  • [DMAS-65339] - update sensorattribute values for qaqc test somehow change archivedflag value to 0.0 for the same sensor
  • [DMAS-66312] - QAQC Auto Test Details page does not display correct modification information
  • [DMAS-66319] - DMAS Search Failed Notification: 30-Jul-2021 17:30:04 UTC, Kongsberg Mesotech Rotary Sonar 1171 (1206086), Kongsberg Sweep Data Product, SearchHdrId 8974913, UserId 27378
  • [DMAS-66364] - Minimum values in State of Ocean CSV are the same as the Maximum
  • [DMAS-66383] - Correct failing data preview tests
  • [DMAS-66386] - Production web server is performing many sequential scans on annotationline_attribute during the Nautilus cruise
  • [DMAS-66434] - Some annotations not editable
  • [DMAS-66441] - DataCite DOIs not versioning correctly

User Story

  • [DMAS-51326] - As a CODAR/WERA user, I would like to see the latest data in Data Preview as close to live as possible -- java part
  • [DMAS-58259] - As ST admin, I would like to promote ST V3

Task

  • [DMAS-66337] - Update pressure sensor info and NaN the data for ASL echosounders
  • [DMAS-66409] - Add latest preview search creation functionality to WERA download task
  • [DMAS-66411] - Reduce ASL echosounder data product matlab memory use

Requirement

  • [DMAS-64130] - Create requirements for promoting from ST Pro to STV3

Implementation

  • [DMAS-64529] - Produce the latest preview products in matlab searches created by an acquisition task
  • [DMAS-66329] - Set the name of threads used by services & servlets
  • [DMAS-66336] - Add an OSGi command to allow us to see what sessions are being retained
  • [DMAS-66354] - Make initial Menu changes for SeaTube transition
  • [DMAS-66365] - Remove the close all/clear at the end of the matlab search function in RW mode
  • [DMAS-66387] - Add Regex file matching to the CODARDownload task
  • [DMAS-66389] - Database script to add regex to CODARDownloadTask
  • [DMAS-66396] - Create searchdtl for each latest search
  • [DMAS-66397] - Limit search creation to files from the last 24 hours
  • [DMAS-66401] - Only display image files in latest directory
  • [DMAS-66402] - Add Permalink and Data Search link
  • [DMAS-66419] - Set studyareaid to searchtreenodeid for created searches
  • [DMAS-66436] - Add latest search creation to the WERA ftp task
  • [DMAS-66437] - Database script to add latest search creation to WERA job

Bug (ST)

  • [DMAS-66470] - Links and view of latest preview products are not quite right
  • [DMAS-66471] - Searches created by CODAR download task do not run, aren't formed as expected
  • [DMAS-66479] - Searches created by CODAR download task should have dateto = datefrom

August 6, 2021

Minor release: annotation fix

Tickets Released: Oceans 2.0: 21.07.002 (accessible to internal users only). Total: 1.

Expand

Bug

  • [DMAS-66346] - After save the annotation, the resource type doesn't use the setting in the st config table.

August 5, 2021

Minor release: various issues

Tickets Released: Oceans 2.0: 21.07.001 (accessible to internal users only). Total: 11.

Expand

Bug

  • [DMAS-66241] - SiteDeviceSubsetMaintenance UI Uses 0 for default location metadata on UI
  • [DMAS-66280] - No dive marker displayed after loading Expedition Management page
  • [DMAS-66318] - Latest tab won't load images in newly created directories
  • [DMAS-66320] - QA: "CRUD for taxon" inconsistently appears on particular annotations
  • [DMAS-66342] - SeaTubeConfiguration page allows multiple saves during a creation
  • [DMAS-66345] - Error message when select a taxon in QA

Task

  • [DMAS-66313] - Need add a unique constrain in st_config table for ownertype, ownwer, category and name
  • [DMAS-66328] - Correct Resource Type not loading when using buttons based on Imported Taxonomies

Implementation

  • [DMAS-66339] - Change latest tab to use FTP and device category id

Bug (ST)

  • [DMAS-66306] - DriverSchedule UI - Fix some outlying issues
  • [DMAS-66333] - CODARDownloadTask has numberformatexception

July 30, 2021

Major release

Maintenance and Production Developer

  • Various bugs and fixes
  • QAQC related features and bug fixes
  • CODAR data preview (in progress)
  • WTA website
  • driver schedule UI page (in progress)

SeaTube

  • Annotation Link
  • Live mode improvement
  • Organization customized Resource Type configuration and selection
  • Auto-save improvement
  • Memory usage monitoring
  • 2nd QA server deployment
  • bug fixes

Dashboards

  • archivefile and scalardata service calls now use api instead of apiproxy and use the current user's token
  • backend support for new sy_token table

CIOOS

  • set the ISO 19115 XML maintenanceNote to include the most recent dataset change

Community Fishers

  • continuing work on testing Matlab as as service (no prod impact)
  • pipeline bug fixes and small improvements for re-post-processing

Data Products & Search Automation

  • Performance improvements and congestion in PROD
  • bug fixes
  • Search automation status graph, performance / completion time

Instruments

  • Sonardyne Cabled Fetch drivers complete
  • Initial parsers for cabled fetch complete
  • RBR Zero driver complete
  • Mclane RAS & Phytoplankton - Take sample button added to these driver types.
  • Multi-queue (in progress)

Tickets Released: Oceans 2.0: 21.07.000 (accessible to internal users only). Total: 94.

Expand

Bug

  • [DMAS-51309] - Search automation metrics report a different number (more) of comparison failures than what the report shows
  • [DMAS-58058] - Stopping task machines when reprocessing cancels running tasks
  • [DMAS-64146] - When UI tests are run manually through Jenkins on a feature branch, all tests are run regardless of the package selected by the user
  • [DMAS-64153] - The volume slider is difficult/impossible to adjust in SeaTube V3
  • [DMAS-64202] - Deployment sometimes fails to resolve the javax.ejb and javax.transaction APIs
  • [DMAS-64577] - Tests failing in SensorAttributesTest
  • [DMAS-64580] - Test failing in UserReplication
  • [DMAS-64609] - If a code deployment fails before equinox is stopped, then the verify operation reports success
  • [DMAS-64715] - Fix Metrics' 'Status' graph
  • [DMAS-64756] - DMAS Search Failed Notification: 17-Jun-2021 19:38:54 UTC, Nortek Aquadopp Profiler AQP2963 AQD5109, Nortek Time Series, SearchHdrId 8701887, UserId 27378
  • [DMAS-64785] - WAV data being returned as 16-bit
  • [DMAS-64786] - Data products 'By Location' not downloading using Data Search for cast data
  • [DMAS-64805] - Some data products are missing in Data Preview
  • [DMAS-65226] - Tests failing in CruiseManagement
  • [DMAS-65386] - Please investigate why casts are going to unassigned location for casts taken on 29-Jun-2021 with DI: 28000
  • [DMAS-65405] - Organization logo is not appearing in the Dive Details dialog
  • [DMAS-65412] - Reset ONC base map back to GMRT but have the CF map default to Open Street
  • [DMAS-65474] - DMAS Search Failed Notification: 15-Jul-2021 16:10:29 UTC, Turner Cyclops-7 Fluorometer (S/N 2103861), Aligned and Depth-Binned Profile Data (On-Demand), SearchHdrId 8877157, UserId 49940
  • [DMAS-65489] - Oceans Next builds sometimes freeze while running tests
  • [DMAS-65503] - Cast Ingestion Job 4 (Job 340 and Job 424) showing error
  • [DMAS-66237] - Sea Tube filter/search doesn't work for null value search
  • [DMAS-66245] - Taxonomy attribute value inconsistency between null and empty
  • [DMAS-66259] - Scrollbar for annotation list in SeaTubeV3 isn't working properly with mouse dragging
  • [DMAS-66269] - UI test daily suite sometimes fails with "WebDriverException: unknown error: cannot find Chrome binary"
  • [DMAS-66270] - Sharing an annotation incorrectly uses the timestamp parameter instead of time
  • [DMAS-66271] - Fix failing test in datapreview generation
  • [DMAS-66274] - Fix broken Pager bar on DeviceSearch
  • [DMAS-66277] - Expedition Management displays a 403 error when an anonymous user tries to view fixed cameras
  • [DMAS-66281] - Clicking an annotation during a live video does not seek to the time of the annotation
  • [DMAS-66285] - SeaTubeConfiguration page doesn't allow saving a second time unless the page is reloaded
  • [DMAS-66290] - SeaTubeConfigurationService requires login, but is called by SeaTubeV3 for non-logged-in users
  • [DMAS-66293] - Community fishers annotation display on geospatial map jitters around
  • [DMAS-66298] - Investigate sync issue for ST config values
  • [DMAS-66301] - Admins cant view some resources

User Story

  • [DMAS-51326] - As a CODAR/WERA user, I would like to see the latest data in Data Preview as close to live as possible -- java part

Task

  • [DMAS-58170] - Links to specific annotations needed in Annotation List and SeaTube Search
  • [DMAS-64177] - Seatube v3 video widget should not autoplay for Active dives to prevent timestamp mismatch
  • [DMAS-64741] - As a dive logger, I would like to be aware the Sea Tube mode while a dive is in progress
  • [DMAS-64746] - Test and support new GPU based task machine
  • [DMAS-64748] - uploading .pcf to Nortek Aquadopp Current Meter Attributes should create a new entry regardless if values change
  • [DMAS-64833] - provide a dml SQL script for system to sync archivefile table from data center to dive logger database in QA
  • [DMAS-65362] - Update deployment infrastructure to support differing number of threads in the pool per task machine
  • [DMAS-65379] - As a users, I would like to see support of multiple deviceids in qaqcreprocess job
  • [DMAS-65471] - create a dataproduct wiki page for dataproductid = 126
  • [DMAS-65496] - Improve performance of CODAR QC products
  • [DMAS-66238] - Recommit the live dive UI update
  • [DMAS-66264] - Null value (no selection) should be allowed for Taxonomy field in Annotation Entry widget
  • [DMAS-66287] - Hide the SeaTubeConfiguration page from anonymous users
  • [DMAS-66296] - Attributes need to be sorted when editing an existing annotation

Design

  • [DMAS-64793] - Create mockups for each autosaving management page with Save button changes

Implementation

  • [DMAS-13786] - develop UI for driverschedule changes
  • [DMAS-56629] - Log Oceans Next version hourly, if deployed
  • [DMAS-64116] - Support running against either QA or QA2 in Eclipse
  • [DMAS-64128] - Support deploying ONC Data Products to QA2
  • [DMAS-64193] - UI test implementation for Attribute Management
  • [DMAS-64478] - Add logic to check records generated and create XML
  • [DMAS-64508] - Update CODAR FTP Task to Trigger MATLAB
  • [DMAS-64509] - Write Database scripts for CODAR ftp job
  • [DMAS-64730] - create sy_token table & populate it with user tokens
  • [DMAS-64735] - Get current user's token when making an external service call
  • [DMAS-64791] - Create latest tab with latest generated images
  • [DMAS-64840] - Update public service calls made only from dashboards to use WebRequestWithToken
  • [DMAS-64848] - Try to add cancellable request method to WebRequestWithToken
  • [DMAS-64856] - Make the maintenanceNote in datasets autogenerate what part of the dataset has changed
  • [DMAS-64857] - Update automated UI tests for SiteDeviceSubsetMaintenance Page
  • [DMAS-65357] - Attempt to fix cancelSearch and filterSections tests
  • [DMAS-65361] - Create the public interface and a dummy implementation for a memory monitor
  • [DMAS-65364] - Implement a memory monitor that just counts the number of objects created
  • [DMAS-65367] - Instrument sources that read from Cassandra
  • [DMAS-65368] - Instrument sources that read from Postgres
  • [DMAS-65369] - Instrument MetricsServlet
  • [DMAS-65372] - Create SeaTube Configuration Page
  • [DMAS-65378] - Add base components and layout to SeaTube Configuration page
  • [DMAS-65387] - Create SeaTube configuration table(s)
  • [DMAS-65395] - Data access for SeaTube configurations
  • [DMAS-65398] - Add DAL layer for sy_token
  • [DMAS-65406] - Convert Hibernate wrapper classes to decorators
  • [DMAS-65454] - Support running against either QA or QA2 from Gradle
  • [DMAS-65476] - Figure out which field of DeviceActionForUI doesn't match
  • [DMAS-65488] - Support deploying Oceans Next to QA2
  • [DMAS-65576] - Write a Wowza module to parse & log timestamps from low-resolution live-streamed video metadata
  • [DMAS-66220] - Service to get organization info from a dive
  • [DMAS-66230] - Load the default Resource Type and Resource values from an organizations saved configuration
  • [DMAS-66232] - Return JSON in payload as JSON
  • [DMAS-66246] - Database: Use null attribute values instead of empty string
  • [DMAS-66247] - Back end: Adjust attribute value logic to favour null over empty string
  • [DMAS-66248] - Front end: Adjust attribute value logic to favour null over empty string
  • [DMAS-66251] - Increase the reporting threshold on threads that have already reported
  • [DMAS-66261] - Sort the loaded attributes in Manual Entry in alphabetical order
  • [DMAS-66268] - Add Seatube Configuration page to the nav menu under SeaTubeV3
  • [DMAS-66272] - Sort "User Directory" in the More menu

Bug (ST)

  • [DMAS-65497] - QA2 connects to the wrong LDAP server after running database post-refresh scripts
  • [DMAS-66256] - Correct CODARDownloadTask Imports
  • [DMAS-66291] - Correct UserFileService in qa

July 22, 2021

Minor release: various issues related to the upcoming maintenance expeditions (no downtime)

Tickets Released: Oceans 2.0: 21.06.004 (accessible to internal users only). Total: 3.

Expand

Bug

  • [DMAS-66236] - Millions of logs from Matlab on task machines in very short time

Implementation

  • [DMAS-66263] - Cabled Fetch driver - increase idle timeout trigger

Bug (ST)

  • [DMAS-66252] - RBRZero driver sends two valve calibration commands on startup

July 21, 2021

Minor release: various issues related to the upcoming maintenance expeditions

Tickets Released: Oceans 2.0: 21.06.003 (accessible to internal users only). Total: 15.

Expand

Bug

  • [DMAS-65620] - Fix SubCImagingCam driver to send correct commands from flashTime and flashDelay functions

User Story

  • [DMAS-58369] - As a data specialist, I would like modify a SiteDeviceSubsets's referenceLat and/or referenceLon and re-postprocess the data
  • [DMAS-58372] - As a data specialist, I would like modify a SiteDeviceSubsets's startDate and/or endDate and re-postprocess the data
  • [DMAS-64851] - As a Data Specialist, I would like an automated geofencing QAQC test
  • [DMAS-65458] - As a data specialist, I would like to be able to post-process a cast from the sitedevicesubset maintenance page WITHOUT making any changes to reference data

Task

  • [DMAS-64696] - Update McLane Phytoplankton Sampler driver to accommodate changes in adaptive sampling commands
  • [DMAS-65493] - After editing site device subsets, the reference depth should display the End depth, not the Start depth
  • [DMAS-66228] - sql to insert a sensorAttribute for QAQC attribute for PVCS test

Implementation

  • [DMAS-64828] - Remove autosave from Button Set Config
  • [DMAS-64853] - script to add a new formula
  • [DMAS-65461] - Trigger Re-Post-Processing Even If no reference data has been changed
  • [DMAS-65481] - Make './deploy_data_products --env' backwards-compatible with 21.06.000
  • [DMAS-66217] - Remove autosave from Attribute Management

Bug (ST)

  • [DMAS-65418] - re-post-processing code will not work with CTDs that do not have 'Not Derived' depth sensors
  • [DMAS-65447] - Fix bug with empty cast plots.

July 15, 2021

Minor release: bug fix for SeaTube Annotation export (no downtime)

Tickets Released: Oceans 2.0: 21.06.002 (accessible to internal users only). Total: 1.

Expand

Bug

  • [DMAS-65411] - DMAS Search Failed Notification: 13-Jul-2021 18:11:49 UTC, null, SeaTube Annotation Export, SearchHdrId 8858261, UserId 105730

July 13, 2021

Minor release: various issues related to the upcoming maintenance expeditions

Tickets Released: Oceans 2.0: 21.06.001 (accessible to internal users only). Total: 19.

Expand

Bug

  • [DMAS-64859] - dctsk04 - DMAS' log - Failed to send DataSyncMessage to MQ. Shutting down and writing to file instead

Task

  • [DMAS-64658] - As a dive logger, I would like ST validates the annotation date within the dive range
  • [DMAS-65382] - Remove unnecessary error snackbars, or update their messages to be more informative
  • [DMAS-65385] - As a NOAA ST user, I would like to keep my last selected taxonomy after an annotation is saved
  • [DMAS-65400] - Extend manual trigger of samples for McLane Phytoplankton Sampler (devicetype: 341)
  • [DMAS-65401] - TaskManagement page task table queries too many tasks

Implementation

  • [DMAS-64779] - Cast Data Ingestion should ingest empty versions of EDS files before versions with data and check for aligned and depth binned data between castdata files before merging them
  • [DMAS-64800] - Track the number of cached objects over time
  • [DMAS-64836] - Update service call and check service to prevent nulls
  • [DMAS-65097] - Modify Nortek Signature 55 driver to recover when device stops
  • [DMAS-65333] - Cabled Fetch driver - modifications for AZA
  • [DMAS-65355] - Re-post-process casts when their reference latitudes and/or longitudes are modified
  • [DMAS-65374] - Interpolate navigation data from cast file when reprocessing flag encounted
  • [DMAS-65391] - Handle varying number of values in sitedevicesubset comment

Bug (ST)

  • [DMAS-64588] - Pamguard PGDF files are not going into FTP on PROD
  • [DMAS-65375] - Only the old CTD scalardata is being deleted, not the piggybacks and tablet scalardata
  • [DMAS-65388] - Ingesting new casts creates duplicate sitedevicesubsets
  • [DMAS-65390] - Error injecting constructor, java.lang.NullPointerException when start driver of BPRZero in QA
  • [DMAS-65396] - IllegalArgumentException

July 6, 2021

Major release

Maintenance and Production Developer

  • Bug / Production Developer tickets
  • QAQCresult overlap
  • Expedition websites
  • Add end dates to driver-start annotations

Instruments

  • Multiple queues project (almost ready, not deployed)
  • Driver / parser bug fixes and support
  • New BPR driver
  • Nortek Signature 55 driver bug (in-progress)
  • PAMguard bug fixes

...

  • OSGi modularization: eventdetection in separate module, shorestation metrics  (in-progress)

Data Products

  • CODAR documentation and minor updates
  • Search automation improvements: test coverage at 100% with new metrics that include sensor level mappings, fix for reprocessing automation
  • Commission the first of a new generation of task machine - now online!

...

  • Initial new annotation search in limited release
  • Transition to public services instead of internal services: now using archivefiles service instead of internal service in audio widget
  • Application token design

CIOOS

  • Versioning of CIOOS datasets
  • Marine Gazetter vocabulary

Tickets Released: Oceans 2.0: 21.06.000 (accessible to internal users only). Total: 83.

Expand

Usability

  • [DMAS-57859] - In Seatube V3, save layout on refresh in current session

Bug

  • [DMAS-56771] - auto reprocess tool does not work anymore after new feature added in DMAS-53889
  • [DMAS-57951] - taxon name not visible for saved annotation entries sometimes
  • [DMAS-64154] - When an annotation's taxon is changed, both old and new attributes are displayed
  • [DMAS-64164] - ADV Re-renders images multiple times when switching device while another device is loading data
  • [DMAS-64258] - Test failing in CruiseManagement
  • [DMAS-64552] - SeaTubeVideoService logs parameter errors unnecessarily
  • [DMAS-64600] - Fix failing GroupsDataProductPermissionFilters tests
  • [DMAS-64614] - Fix multiple DeviceAndSensor failing tests
  • [DMAS-64657] - All QA hosts logged errors while loading the DafTest cache after deployment with release/21.05.000
  • [DMAS-64670] - DmasGroupManager calls ServiceUtil too often
  • [DMAS-64689] - Task machines running 21.05.000 can't deserialize EventDetectedContainer, sent in messages on the archiver topic from an archiver running on master
  • [DMAS-64710] - Failed to generate a DeviceService response: java.lang.NullPointerException
  • [DMAS-64714] - PA Shorestation logging ERRORs that it can't handle an ActiveMQ object - java.lang.ClassNotFoundException
  • [DMAS-64740] - Can't see Batch tasks in TaskManagement in Prod
  • [DMAS-64750] - NOAA EX2103 expedition and dives are using ONC logo.
  • [DMAS-64775] - "Error: Invalid Parameter: liveStream1DeviceId. Invalid Integer format" on saving a cruise in QA
  • [DMAS-64782] - update coverage to exclude untestable functional component packages
  • [DMAS-64825] - Cannot update any cruise on Expedition Maintenance page
  • [DMAS-64829] - Master Branch build failing
  • [DMAS-64845] - Webpack build failing
  • [DMAS-64849] - Class not found exceptions on shore station
  • [DMAS-64850] - Data messages dropped at shore station
  • [DMAS-65337] - Error reloading eventdefinition caches
  • [DMAS-65338] - Ocean Next release branch build failing due to DateUtils unit test failing
  • [DMAS-65341] - Fixing failing UI test in geospatial map

User Story

  • [DMAS-19427] - Provide Annotation End Date for Starting and Stopping Driver
  • [DMAS-64851] - As a Data Specialist, I would like an automated geofencing QAQC test

Task

  • [DMAS-58071] - batch reprocess group task seems to add files in reverse order to the queue instead of chronological
  • [DMAS-58097] - divelogger machines should not be showing in Reprocess Console
  • [DMAS-64147] - Upgrade gradle in the UI Testing repository to the latest stable version
  • [DMAS-64168] - Replace the deprecated JCenter Maven repository used by UI Testing
  • [DMAS-64438] - As an AIS user, I would like a filter in the data search
  • [DMAS-64510] - Add typescript files to test:( coverFile, lint, pretty-code)
  • [DMAS-64527] - Put the limit value into the hover message in the latest readings widget
  • [DMAS-64590] - Update post refresh script to remove whacky characters from attribution test cases
  • [DMAS-64652] - Remove DmasLoginServlet
  • [DMAS-64676] - update suggested list of hostname to include new machines in Oceans-next deployment
  • [DMAS-64693] - Create tests for objects serialized over mq
  • [DMAS-64716] - Change default values for WebParameter.getParameter methods to have the correct type
  • [DMAS-64717] - add deviceid in the nullpointerexception in getPortNumberFromSensor method
  • [DMAS-64718] - Extend manual trigger of samples for RAS Water Sampler (devicetype: 368)
  • [DMAS-64742] - Don't display "Default attributes removed for selected taxon" when a user change a taxon which doesn't have any attribute
  • [DMAS-64760] - Remove redundant serialization/deserialization from ExpeditionTreeService
  • [DMAS-64783] - Add an index to tm_task to improve performance of finding queued searches
  • [DMAS-64796] - Update QaDeviceTests for 21.06.000
  • [DMAS-64834] - Revert but keep the change for switch the live/historical video mode
  • [DMAS-64847] - Merge failed from 21.05.000 to master

Implementation

  • [DMAS-57153] - implement automated geofencing QAQC test
  • [DMAS-64092] - Create Annotations Search Table
  • [DMAS-64194] - Create Resource Type Filter component prototype
  • [DMAS-64201] - Add support for selecting page size
  • [DMAS-64220] - Create skeleton code for Annotation Entry
  • [DMAS-64411] - Implement annotation search using new filter component
  • [DMAS-64452] - Add Search functionality
  • [DMAS-64476] - Implement Database Changes
  • [DMAS-64477] - Create ORM code
  • [DMAS-64483] - Extract EventReactor into a separate osgi bundle
  • [DMAS-64492] - Update Java code for endDate on Device Annotations created in DeviceConsole
  • [DMAS-64493] - Update existing Device annotations to add EndDate in database
  • [DMAS-64511] - Make new Annotations Search page available in Oceans 2
  • [DMAS-64530] - extract ArchiveFileManager to a new osgi bundle
  • [DMAS-64531] - Move EventDetector and dependencies into ca.uvic.dmas.extension.eventdetection.api
  • [DMAS-64532] - create event detection impl bundle
  • [DMAS-64533] - Implement BPRZero driver
  • [DMAS-64655] - Driver for Cabled Fetch
  • [DMAS-64663] - RBRZero simulator
  • [DMAS-64664] - Add platform_name variable to index radial data in combiner netCDF to their origin
  • [DMAS-64680] - Add logic in SiteDeviceSubset Service to inject EDS and cast files to ncdata
  • [DMAS-64682] - Modify ExternallyDerivedSensorDataPostProcessor to allow ingestion of empty EDS files
  • [DMAS-64691] - Modify Audio Widget Service Calls to use External API
  • [DMAS-64692] - add driverschedule manager/service
  • [DMAS-64734] - Create a WebRequestWithToken (or similar)
  • [DMAS-64749] - Add re-postprocess option on SiteDeviceSubsetMaintenance UI
  • [DMAS-64755] - Pass back user token from UserDetailsService and add to window.DMAS.Config
  • [DMAS-64761] - Delete Overlapping casts and Check if cast is in new Geospatial Area
  • [DMAS-64801] - Set the referenceSiteDeviceSubsetId field for the SiteDeviceSubsets being deleted
  • [DMAS-64803] - batch reprocess group task reverse order correction
  • [DMAS-64853] - script to add a new formula

Bug (ST)

  • [DMAS-64703] - Resolve automatic merge conflicts
  • [DMAS-64753] - Incompatible argument type in AnnotationService
  • [DMAS-65336] - Cannot Save new SiteDeviceSubsets on SiteDeviceSubsetMaintenance page

Documentation

...

Tickets Released: Oceans 2.0: 21.05.005 (accessible to internal users only). Total: 4.

Expand

Task

  • [DMAS-64806] - Synchronize archive file objects to the divelogger jvm
  • [DMAS-64832] - Need a dml SQL script to sync archivelocationtype and archivelocation table from prod to dive logger database

Implementation

Bug (ST)

  • [DMAS-64721] - Select attribute filtering does not find selected values

...

Tickets Released: Oceans 2.0: 21.05.004 (accessible to internal users only). Total: 1.

Expand

Bug

  • [DMAS-64726] - Can't start driver for Pro-Oceanus CO2 on Queen of Alberni

...

Tickets Released: Oceans 2.0: 21.05.003 (accessible to internal users only). Total: 10.

Expand

Bug

  • [DMAS-64666] - Clicking on the "Click Image to Enlarge" link in preview just shows a spinner
  • [DMAS-64705] - NullPointerException when trying to view onc-internal user group
  • [DMAS-64707] - 2,800 + ERROR messages on eewshore1 per day - failure to connect

Task

  • [DMAS-57987] - Change DataProductDelivery service calls to AcousticDataViewerImage in Acoustic Data Viewer
  • [DMAS-64709] - DataProductPermissionService logging debug info at INFO level

Implementation

  • [DMAS-64459] - Back-end support for attribute value filtering
  • [DMAS-64640] - Basic Driver for ONC Profiling Winch
  • [DMAS-64700] - Rollback batch task reprocessing code in QA
  • [DMAS-64702] - Please, remove CODAR netCDF data product for radials from Data Search (temporarily)

Bug (ST)

  • [DMAS-64234] - Timestamps for PAMGUARD files not correct

...

Tickets Released: Oceans 2.0: 21.05.002 (accessible to internal users only). Total: 1.

Expand

Bug

  • [DMAS-64673] - sensorPeriodMap always empty in DataEnrichmentCacheModuleImpl

...

Tickets Released: Oceans 2.0: 21.05.001 (accessible to internal users only). Total: 5.

Expand

Bug

  • [DMAS-64368] - Shorestation ERROR logs without device IDs
  • [DMAS-64628] - Auto Save feature is not working in live mode
  • [DMAS-64654] - capture time stops working in live onship mode
  • [DMAS-64665] - Auto Save feature in live mode wtih onship layout creates annotations with the same timestamp

Implementation

  • [DMAS-64631] - Log more information during video export

June 2, 2021

Major release

Maintenance and Production Developer

  • Bug / Production Developer tickets, including QAQC bug fixes
  • Search tree and Data Search map loading performance improvements
  • DFO expedition page on ONC website
  • Data preview update to keep SOO plots indefinitely
  • Disable emails for data searches from anonymous users

Instruments

  • Multiple queues project (significant progress, not deployed)
  • Driver / parser bug fixes and support

...

  • OSGi modularization (in-progress)
  • Python version of EEW end user software

Data Products

  • State of Ocean data products: added a levelled pressure externally derived sensor, fix for CSV column headers
  • Search automation improvements: update metrics to consider sensor-level mappings, fix metrics discrepancy, add test cases

...

  • Updated resources service to support hierarchical structure
  • Base components for annotation filters and filter groups, specific filters, etc (in-progress)

CIOOS

  • Prevent inactive datasets from being ingested by CKAN
  • CODAR/complex data support and marine gazetter design (in-progress)

Tickets Released: Oceans 2.0: 21.05.000 (accessible to internal users only). Total: 82.

Expand

Bug

  • [DMAS-41962] - Logout redirect makes next login unsuccessful if not logged in yet
  • [DMAS-51309] - Search automation metrics report a different number (more) of comparison failures than what the report shows
  • [DMAS-54353] - Fix broken tests in checkPortStatus of SCUAcquisition
  • [DMAS-55504] - State of oceans climatology CSV product header / data order messed up
  • [DMAS-58153] - STRAW timeout issue causing some data to be logged as command responses
  • [DMAS-64103] - Fix failing UI tests in Geospatial Map
  • [DMAS-64180] - Playlist Sharing link does not work
  • [DMAS-64205] - Pro-Oceanus CO2-Pro CV pCO2 driver randomly leaves idle state
  • [DMAS-64289] - Fix failing ui tests on DeviceDetails because of bad xpaths
  • [DMAS-64293] - Fix failing FileManagement.checkFileArchiverService() failing (manual pass FM.TC.119)
  • [DMAS-64302] - "Add User defined Taxonomy" is visible to anonymous users
  • [DMAS-64335] - When a UI test suite finishes, an empty Chrome window with the URL "data;," is left open
  • [DMAS-64346] - Inactive ERDDAP dataset metadata should not be ingested to CKAN and CIOOS portals
  • [DMAS-64429] - PSF data (IS-stations) not plotting in Geospatial Map (May 11th)
  • [DMAS-64475] - fix failing tests in TaskDefinition
  • [DMAS-64486] - Data Preview Links covering State of Ocean plots
  • [DMAS-64539] - DMAS Search Failed Notification: 26-May-2021 19:25:44 UTC, AML CTD Plus X 50334, Aligned and Depth-Binned Profile Data (On-Demand), SearchHdrId 8677842, UserId 48660
  • [DMAS-64543] - NOAA Logger - Admin (df21) does not have write permission to Attribute Management Page
  • [DMAS-64547] - Add the DFO station and JVM to the database
  • [DMAS-64576] - Acoustic Data Viewer ADCP Toolbox Options onSubmit not working
  • [DMAS-64578] - qaeewshore1 fails to start on release branch
  • [DMAS-64579] - NoaaDeviceTests cannot log in
  • [DMAS-64584] - Fix Topology bug when device is disconnected before setup starts
  • [DMAS-64585] - dfo topices missed in mq.properties
  • [DMAS-64586] - cruiseId not being passed to DeviceAction Maintenance page
  • [DMAS-64587] - connection service is null for qadivelogger3.onc.uvic.ca
  • [DMAS-64589] - Buttons not inheriting taxon information in DEMO
  • [DMAS-64591] - QA Device Console doesn't show device uptime or last reading date
  • [DMAS-64594] - Device console quick plot doesnt load in QA
  • [DMAS-64601] - A running search cannot be cancelled from a Cart in prod or QA
  • [DMAS-64613] - Casts detected in QA but not PROD. Please investigate
  • [DMAS-64626] - df20 cannot make annotations on dive 234

User Story

  • [DMAS-53404] - As a data player user, I want to know where data is available for devices
  • [DMAS-58049] - As a DMAS request admin, I would like to categorize the requests

Task

  • [DMAS-46744] - Update the CAP signature to use RSA SHA 256
  • [DMAS-54048] - Add "pressure-leveled" derived sensor to State of the Oceans matlab file
  • [DMAS-57870] - Enable hovertext showing full label for Buttons
  • [DMAS-64250] - Update QaDeviceTests for 2021-04-30
  • [DMAS-64256] - Write Regression Tests for Data Availability Component in ADV
  • [DMAS-64259] - Write SQL for androidlog and annotation file FTP changes in DMAS-58045
  • [DMAS-64314] - Modify Data Preview search tree trimming to keep SOO plots in data preview indefinitely
  • [DMAS-64374] - Create Python version of the EEW end user software
  • [DMAS-64395] - remove eew bamfield devices from qa post refresh script
  • [DMAS-64419] - Clean up parsing of SystemProperty.Location
  • [DMAS-64434] - Add Missing Test Cases for Data Product Formats
  • [DMAS-64442] - Cast Preview Plots should fallback to searchresult with searchresultstatusid 4 if 2 cannot be found
  • [DMAS-64444] - Improve logging in the correlator
  • [DMAS-64496] - Update Search Automation metrics to include sensor mappings
  • [DMAS-64517] - Redirect STV2 to Expedition Management
  • [DMAS-64550] - Improve logging for outdated RDI file generation
  • [DMAS-64553] - Upgrade ChromeDriver to version 91

Implementation

  • [DMAS-57239] - Extract DeclarativeDevice into a separate osgi bundle
  • [DMAS-57744] - Split ca.uvic.dmas.core.calculation.jep.api into an API/Impl pair
  • [DMAS-64107] - Implement sending EEW notifications over activemq
  • [DMAS-64138] - merge mq management code into master
  • [DMAS-64203] - Update ResourceService to return hierarchically structured resource data
  • [DMAS-64204] - Implement Data Availability Component in DataPlayerForm
  • [DMAS-64207] - Create a Date Filter component
  • [DMAS-64216] - Create Source Filter for Annotation Search
  • [DMAS-64376] - Create DFO logger and logger admin groups using SQL
  • [DMAS-64377] - Support DFO organization in Expedition Maintenance
  • [DMAS-64378] - Allow DFO logger admins to have Read Write privilege for Attribute and Taxonomy pages
  • [DMAS-64379] - Allow DFO loggers and DFO logger admins to have RW privilege for Quick Button page
  • [DMAS-64380] - Create a separate tree node for DFO in Expedition Management page to hold all DFO expeditions
  • [DMAS-64381] - Support same permission / configuration with ONC for SeaTube annotation CRUD operations
  • [DMAS-64382] - Allow DFO logger admins to have Read Write privilege for Bathymetry page
  • [DMAS-64383] - Support DFO onship server ST related data synchronization
  • [DMAS-64396] - Set up DFO test users
  • [DMAS-64436] - Front end changes for dive deletion
  • [DMAS-64441] - Allow DFO logger admin to manage DFO loggers
  • [DMAS-64445] - Update front-end to handle DFO organization details
  • [DMAS-64472] - Extract references to logger and logger admin groups to an enum
  • [DMAS-64480] - Add a toString to DeviceActionForUI
  • [DMAS-64482] - refactor EventReactionFactory to get reactions as prototypes
  • [DMAS-64534] - BPRZero parser

Test

Bug (ST)

  • [DMAS-64186] - Data Search tests cause Out of Memory errors in Chrome
  • [DMAS-64198] - UI tests sometimes fail to log in
  • [DMAS-64233] - Unexpected response from TicketManagerService creates a snackbar with "{}"
  • [DMAS-64435] - Fix DiveListingService's delete method
  • [DMAS-64468] - Different page content for different user.
  • [DMAS-64469] - DFO loggs can't create annotations

...

Tickets Released: Oceans 2.0: 21.04.003 (accessible to internal users only). Total: 4.

Expand

Bug

  • [DMAS-64315] - Extremely slow loading times for Data Search and Plotting Utility preventing access
  • [DMAS-64499] - Site device tab in the Searchtree mainteanance page of Oceans 2.0 doesn't show any datefrom of sitedevices
  • [DMAS-64504] - device console is quite slow in prod with 21.04.002
  • [DMAS-64505] - Search Hydrophone Page isn't loading

...

Tickets Released: CF.3.2.5 (accessible to internal users only). Total: 17.

Expand

Bug

  • [DMAS-57748] - Community Fisher Tablet outputs future date in commandData
  • [DMAS-57840] - AML-6 Data not downloading - :error data not found"
  • [DMAS-64457] - GPS Date Comparison Dialog box inconsistent bolding of date in message
  • [DMAS-64460] - CF App Google Account Sign is not working

User Story

  • [DMAS-23434] - As a Pacific Salmon foundation person, I would like to have enhanced data security
  • [DMAS-57262] - As a Citizen Scientist, I would like to have a notification when the app is ready to be updated, and be able to view release notes

Task

  • [DMAS-57839] - AML-6 Powering Off - connections
  • [DMAS-58045] - Send Annotation files and Androidlog files to different directories In FTP server
  • [DMAS-64104] - As a Community Fishers user, I would like a tablet model of SM-T500 to be registered with the CF app
  • [DMAS-64109] - Please update the CF app so that it supports Android 10
  • [DMAS-64211] - CF App needs to mitigate users from sampling with incorrect tablet dates
  • [DMAS-64443] - Release Community Fisher App Version CF.3.2.6
  • [DMAS-64491] - Use Release Google API Keys in release APK for CF Android App

Implementation

  • [DMAS-57316] - Streamline process of uploading backed up data to Google Drive
  • [DMAS-57817] - Show notification if the app has an available update
  • [DMAS-57828] - Display Release Notes Inside of App
  • [DMAS-57872] - Update API Keys Using New ONC Dev Google account

...

Tickets Released: Oceans 2.0: 21.04.002 (accessible to internal users only). Total: 19.

Expand

Bug

  • [DMAS-58255] - Can't edit some annotations in SeaTubeV3
  • [DMAS-58256] - Some button sets in Annotation Entry dropdown correspond to wrong button set
  • [DMAS-64341] - Job #337 failing to generate DOIs for piggyback devices
  • [DMAS-64347] - Error adding data products to cart in Data Search by Location for piggybacks
  • [DMAS-64365] - Task management paging is broken, not showing all of the tasks
  • [DMAS-64387] - Add a spinner for the loading of the Search Tree
  • [DMAS-64388] - Anonymous searches creating failing search complete emails - disable emails for anonymous users
  • [DMAS-64417] - Shorestations failed to start in QA with release/21.04.000
  • [DMAS-64426] - DMAS Search Failed Notification: 12-May-2021 04:00:24 UTC, Conception Bay-Holyrood Bay Underwater Network, Nortek Daily Currents Plot, SearchHdrId 8580952, UserId 15356
  • [DMAS-64427] - Start Date displayed on Qaqc Auto Test Details page shows current date, not start date of test
  • [DMAS-64446] - Request Support link throws an error

Task

  • [DMAS-64298] - Please investigate why the scheduled job 340 (Cast Ingestion) is throwing up an error once it was enabled to run on schedule yesterday
  • [DMAS-64336] - Return searchresultstatusid 4 when providing matlab-generated products in the case of no data found

Requirement

  • [DMAS-64089] - Create requirements for no-video annotation user choices

Design

  • [DMAS-64090] - Design dialog for no-video annotation user options

Implementation

  • [DMAS-64389] - Reduce the data overhead in the searchtree by excluding non-searchable nodes/data
  • [DMAS-64394] - Reduce the data overhead in the searchtree by excluding unused metadata
  • [DMAS-64425] - Improve DeviceService Instruments by Category loading time by eliminating excess cache iteration
  • [DMAS-64440] - Improve ONCKmlService search tree loading time by eliminating excess cache iteration

...

Tickets Released: Oceans 2.0: 21.04.001 (accessible to internal users only). Total: 20.

Expand

Bug

  • [DMAS-64118] - Search Tree on Plotting Utility is verrry slow to load
  • [DMAS-64238] - miss or overlap qaqcresult for deviceid=1003 and qaqcid=1301 after qaqcreprocess
  • [DMAS-64254] - QaqcAutotestDetails endDate is 1970-01-01 in QA
  • [DMAS-64257] - Tests failing in UserReplication
  • [DMAS-64303] - DMAS Search Failed Notification: 05-May-2021 21:25:41 UTC, SeaBird 43 Oxygen (S/N 1807), Time Series Scalar Plot, SearchHdrId 8572042, UserId 94080
  • [DMAS-64324] - The timestamp line of multi sensors chart in ST stop working
  • [DMAS-64342] - SensorPlot in SeaTubeV3 keeps resetting the view of the graph when zooming / panning
  • [DMAS-64384] - ONSHORE1 failing to synchronize some annotations

User Story

  • [DMAS-64232] - As a Community Fisher user, I want cast data previews to respect data agreements.

Task

  • [DMAS-64240] - As a data steward, I would like to be able to see more than 5 cables in the pagination

Implementation

  • [DMAS-64093] - Implement Filter and FilterGroup components
  • [DMAS-64149] - Update the backend to accept issue categories
  • [DMAS-64150] - Add issue categories to the UI
  • [DMAS-64271] - Update UI tests
  • [DMAS-64283] - Add permissions check for cast operation in DataPreviewService
  • [DMAS-64323] - Do Not Display Error snackbar if DataPreviewService returns an error
  • [DMAS-64390] - Improve searchtree loading time by eliminating excess manager startup
  • [DMAS-64393] - Improve search tree filter loading time by eliminating excessive cache iteration

Bug (ST)

  • [DMAS-64269] - Ingester does not set creation and modification information with the identifier's
  • [DMAS-64340] - Ingester test sometimes fails on Jenkins

May 5, 2021

Major release

Maintenance and Production Developer

  • Email notification for Data Search
  • QAQC related tickets
  • Bug / Production Developer tickets
  • Migration of several pages/UI to modern REACT framework

Instruments

  • Multiple queues project (significant progress, not deployed)
  • PAMguard features: batching, external user access, improvement performance

...

  • Added a second protocol for EEW client and other improvements for modularization

Data Products

  • Nortek current plot ensemble averaging - fixes a number of recently detected issues with the plots
  • FLAC support in PAMguard pre-processor
  • CODAR improvements: mercator projection, plot limits and titles
  • CF support: multiple deployment bug, descriptive attributes, crossing midnight, re-arrange of cor file columns and labels
  • Search automation related improvements: fix out of memory errors for disjoint scalar data, very slow plotting for min/max plots, support for 2nd QA, exclusion list for devicecategories

...

  • External API improvements
  • TypeScript pilot project in REACT framework
  • Migrate and build a new & improved annotations search page in REACT (in-progress)
  • Automated UI test improvements/experiments with Cypress
  • Dashboards bug fixes

CIOOS

  • Greatly improve performance of ERDDAP Management
  • Synchronous service for Data Products (a one-call alternative to dataproductdelivery) (in-progress)
  • ERDDAP service as a source (in-progress)
  • Fix issues with French text

Tickets Released: Oceans 2.0: 21.04.000 (accessible to internal users only). Total: 124.

Expand

Bug

  • [DMAS-57594] - sort by feature in IP tab of Device Details page is broken
  • [DMAS-57614] - All Screenshot UI tests are Failing
  • [DMAS-57680] - ErddapManagement page is taking a long time to change datasets.xml
  • [DMAS-57735] - Certain regular expression verifications in web service tests can block the automation server from running new tests
  • [DMAS-57815] - Powerable Status = Never not working correctly in DeviceConsole
  • [DMAS-57820] - the sort feature under reprocess group in batches isn't actually sorting properly by status
  • [DMAS-57918] - Investigate possible inaccurate data rating on TEMPO-MINI causing search failures
  • [DMAS-58084] - fix automatic merge failure from release to master
  • [DMAS-58104] - UI tests haven't completed since March 10
  • [DMAS-58109] - ISO French Abstracts showing corrupt characters due to encoding errors
  • [DMAS-58113] - DMAS Search Failed Notification: 22-Mar-2021 19:27:01 UTC, JASCO M36-V35-100 Hydrophone E000029, Hydrophone Spectral Data, SearchHdrId 8273649, UserId 42732
  • [DMAS-58131] - As an engineer, I am struggling to use the new Device Search interface
  • [DMAS-58142] - Buggy save behaviour in Demo sometimes causing page to hang
  • [DMAS-58204] - In SeaTubeV3, annotations that aren't within a video file can be clicked, but clicking doesn't do anything except highlight the annotation
  • [DMAS-58211] - Test failing in CruiseManagement
  • [DMAS-58212] - Test failing in DiveManagement
  • [DMAS-58214] - UI Tests Failing in GeospatialMap
  • [DMAS-58220] - Fix failing SearchTreeMaintenance UI tests
  • [DMAS-58230] - Fix failing test in dataPreviewManagement
  • [DMAS-58267] - DataViewer UI Tests Failing
  • [DMAS-58274] - ADV Hydrophone Form Not Selecting Radio Button Before Images are loaded
  • [DMAS-58378] - Acoustic Data Viewer not Persisting Toolbox Options
  • [DMAS-58384] - When powering J10 on JB-18, DMAS sets the gf_breaker_limit to 0 and 0, causing it to fault
  • [DMAS-58397] - ADV ADCP Form reset handler not resetting Form Fields to defaults
  • [DMAS-64078] - Toolbox does not update between devices without being closed and reopened
  • [DMAS-64098] - Deleting an Item doesnt work from cables page
  • [DMAS-64110] - DMAS Search Failed Notification: 16-Apr-2021 15:54:31 UTC, null, SeaTube Annotation Export, SearchHdrId 8543030, UserId 44142
  • [DMAS-64120] - Fix electrical rating not displaying in the ui after updating
  • [DMAS-64132] - Fix failing tests in DeviceDetailsTest
  • [DMAS-64134] - why sourcesensorid is null after qaqcreprocess for DI 22777
  • [DMAS-64137] - Applied QAQC tab on sensor maintenance not displaying any values
  • [DMAS-64166] - DMAS - "User Directory" redirects to ftp.neptunecanada.ca, instead of ftp.oceannetworks.ca
  • [DMAS-64174] - Build failed when deploying to QA
  • [DMAS-64187] - Investigate sporadic search failures in QA search automation with high volume min/max data
  • [DMAS-64210] - Fix failing ui tests on sensor maintenance
  • [DMAS-64217] - Fix failing ui tests in SiteDeviceMaintenanceTest
  • [DMAS-64224] - Data Search for COR files By Location not working, even though these data are populating geospatial map
  • [DMAS-64241] - Fix failing UI tests in Plotting Utility
  • [DMAS-64243] - Error when generating multiple data products
  • [DMAS-64249] - Internal Users in QA are not able to create annotations
  • [DMAS-64253] - Bug in videoFileQAQC job caused by new code for 2nd QA
  • [DMAS-64255] - Test failing in SearchTreeMaintenance
  • [DMAS-64260] - Fix failing tests in generationAndDisplay
  • [DMAS-64288] - Can't add derived sensor definition if none exist

User Story

  • [DMAS-25060] - As a Nortek daily current plot user, I would like the plots to be resampled properly to prevent errors in data gaps, backscatter averaging and anti-aliasing
  • [DMAS-56819] - As a Data Specialist I would like the ability to modify the datefrom of a QAQC test attribute through the UI
  • [DMAS-57154] - As a Data Specialist, I would like an automated PVCS QAQC test
  • [DMAS-57343] - As a user from NOAA, I would like to easily report and keep track issues found in Ocean's 2.0
  • [DMAS-57761] - As a data specialist, I would like to Improve the maintainability of the correlator event expression
  • [DMAS-57819] - As a Data Search user, I would like an email notifying me when my searches are complete
  • [DMAS-57822] - Keep files in /ftp/pub folder 21 days, instead of 14 days
  • [DMAS-57970] - As a software developer i'd like the tabs on Sensor Maintenance to be updated to React

Task

  • [DMAS-45798] - Remove debugging code.
  • [DMAS-46372] - As a User Management User, add a obvious way to add/delete user groups
  • [DMAS-50167] - Formsections for hydrophones spectrograms and spectral MAT files
  • [DMAS-54948] - Add plot type to CODAR plot titles
  • [DMAS-57558] - Test and support the WAV to FLAC source file transition
  • [DMAS-58026] - Add ui test to check IP link on device console page
  • [DMAS-58059] - As a Data Steward, I would like the columns in Task Monitor to be sortable
  • [DMAS-58062] - Remove residual budget pages
  • [DMAS-58125] - provide details of algorithm used to give positional coordinates for SeaTube V3 annotations
  • [DMAS-58141] - Mockup Annotation Search
  • [DMAS-58157] - Reorganize oceans next menu so there are groups of items
  • [DMAS-58191] - Change date logic regarding cruises and topology entries
  • [DMAS-58199] - Define Filter component "interface"
  • [DMAS-58236] - Fix and update broken links on oceannetworks.ca to State of Ocean plots
  • [DMAS-58246] - Sort Cruise Name dropdown list alphabetically in DeviceAction Maintenance page
  • [DMAS-58251] - Why executing time is far behind of createddate of loading cache command in prod?
  • [DMAS-58254] - Create skeleton for annotations search page
  • [DMAS-58262] - Improve Automated Testing Documentation
  • [DMAS-58268] - Add Typescript to the Oceans-Next project
  • [DMAS-64083] - Add ui test to verify cruise dropdown is sorted correctly
  • [DMAS-64084] - Write UI tests for Cables page
  • [DMAS-64101] - Improve links under PNGs in Data Preview
  • [DMAS-64102] - Change CODAR plot projection to Mercator
  • [DMAS-64124] - Change Jenkinsfile to run jacoco coverage on onc-web
  • [DMAS-64126] - Change the default login/logout pages to not use the former CAS server
  • [DMAS-64140] - make ONCMatlab code in qa2 work
  • [DMAS-64142] - Change the data column names for lat and lon in the .cor data product
  • [DMAS-64145] - Change "Patrol name" to "Location" in the .cor file data product
  • [DMAS-64165] - Add an exclusion list of devicecategories to search automation metrics
  • [DMAS-64197] - Use the Search Tree Maintenance page object in Data Search tests
  • [DMAS-64209] - Update descriptions of CF pipeline device attributes to be ...descriptive

Requirement

  • [DMAS-58087] - Gather requirements
  • [DMAS-58247] - Create requirements for a video-focused predefined layout

Design

Implementation

  • [DMAS-57578] - Support FLAC as a source file for PAMguard
  • [DMAS-57950] - Add UI tests
  • [DMAS-57971] - Write tabs in react
  • [DMAS-57997] - Update UI to allow user to change date from
  • [DMAS-57998] - Update QaqcTestDetailService to accept datefrom
  • [DMAS-57999] - Update backend to use react version of tabs
  • [DMAS-58030] - Write sensor maintenance pages in react
  • [DMAS-58031] - Update backend for sensor maintenance pages
  • [DMAS-58164] - Implement Persistence handlers for the DafQueueServiceActivator
  • [DMAS-58168] - Update ui tests for sensor listing tabs and maintenance pages
  • [DMAS-58175] - Implement DAF Processing
  • [DMAS-58179] - script to insert qaqcformula and attributes
  • [DMAS-58180] - Add PVCS qaqc
  • [DMAS-58190] - Update taxonomy attribute management page to use FK violation information in error message
  • [DMAS-58226] - Update device action link on Cruise page
  • [DMAS-58237] - Clean up page model of SearchTreeMaintenance tests
  • [DMAS-58238] - Put updated search tree nodes directly in the cache without waiting for a full reload
  • [DMAS-58239] - Fix tests broken due to metadata changes
  • [DMAS-58240] - Update SearchTreeService access control to be based on AccessControlledWebService
  • [DMAS-58269] - Update oceans next code
  • [DMAS-58271] - Update UI tests for DeviceSearch
  • [DMAS-58272] - Update cables service create methods to return new id in payload
  • [DMAS-58282] - Write logic for Capstone annotation ingestion
  • [DMAS-64075] - Add/Update UI tests for Dashboard Management when Sharing RW permission
  • [DMAS-64087] - Code change for data search email notification
  • [DMAS-64097] - Write database scripts for email notification
  • [DMAS-64144] - Create service call to check other video resolutions given a timestamp
  • [DMAS-64170] - Implement automatic averaging for Nortek current plots
  • [DMAS-64172] - Update backend for Sensor Maintenance
  • [DMAS-64173] - Update oceans next code
  • [DMAS-64221] - Update documentation
  • [DMAS-64268] - Improvements on search complete email

Test

Bug (ST)

  • [DMAS-64135] - Complex Data Product Issues on Nortek 1 MHz Profiler at DDL
  • [DMAS-64158] - Potential infinite loops in Dashboards
  • [DMAS-64171] - Infinite recursive loop in DashboardDisplay when not logged in
  • [DMAS-64252] - handle the case of a single ensemble for Nortek plots

Documentation

  • [DMAS-58096] - Make sure the main page of documentation is up-to-date

...

Tickets Released: Oceans 2.0: 21.03.003,21.03.004 (accessible to internal users only). Total: 1,1.

Expand

Task

  • [DMAS-64212] - Please investigate why aren't casts being detected for pipeline PROD run: data from 23 Apr 2021
  • [DMAS-64219] - Please investigate why no corrected data were generated from Job 339 for detected Pacheedaht casts

...

Tickets Released: Oceans 2.0: 21.03.002 (accessible to internal users only). Total: 5.

Expand

Bug

  • [DMAS-58260] - Switching resolution in some SeaTube videos doesn't do anything
  • [DMAS-58278] - Can only change video resolution once, then Settings are not available
  • [DMAS-58394] - Share Dialog in dashboard table not sharing RW

Task

  • [DMAS-58028] - Attempt to generate or view the ERDDAP datasets.xml returns a maintenance page

Implementation

...

Tickets Released: Oceans 2.0: 21.03.001 (accessible to internal users only). Total: 19.

Expand

Bug

  • [DMAS-58241] - CODAR GIFs are bi-daily not daily as intended
  • [DMAS-58244] - Getting resource Id for devices that are currently deployed is failing.
  • [DMAS-58249] - In ST Multi sensor chart is using local time, we need UTC timestamp
  • [DMAS-58253] - Fix QaqcTestDetails so that values can be saved properly
  • [DMAS-58257] - DMAS Search Failed Notification: 08-Apr-2021 20:23:42 UTC, Inshore Profiling System-Profiling Instrument Package, Cast Scalar Multi-Profile Plot, SearchHdrId 8536199, UserId 22446
  • [DMAS-58263] - Fail to add DateTo information for existing IP
  • [DMAS-58273] - DMAS Search Failed Notification: 09-Apr-2021 16:46:17 UTC, AML CTD Plus X 50241, Aligned and Depth-Binned Profile Data (On-Demand), SearchHdrId 8536670, UserId 94330
  • [DMAS-58276] - Video files at the start of dives are not played in SeaTubeV3

User Story

  • [DMAS-58233] - As a DFO CODAR Data Preview user, I would like to load lower resolution gifs for faster load times
  • [DMAS-58245] - As a dive logger, I would like a ST layout to display larger video.

Task

  • [DMAS-58196] - Create locations for DMAS + ActiveMQ for new ferries
  • [DMAS-58242] - Add small GIFs for Data Preview to work with the new GIF player
  • [DMAS-58393] - As a Data Steward, I would like to stop the automatic generation of JIRA tickets for Unassigned and Bad casts

Design

  • [DMAS-58264] - Create design for a video-focused predefined layout

Implementation

  • [DMAS-58248] - Add new video-focused predefined layout into STV3
  • [DMAS-58252] - Front-end code change for gif player to use smaller sized gifs

Test

  • [DMAS-57976] - Add web service tests to cover resampling changes
  • [DMAS-58207] - Create regression test for Gif Player

Bug (ST)

  • [DMAS-58221] - Update styling and functionality following testing

April 7, 2021

Major release

Maintenance and Production Developer

  • Bug fixes including QAQC inheritance
  • ONC website support, including Wiring The Abyss updates for the maintenance expedition
  • Migration of several pages/UI to modern REACT framework: extension + item pages
  • State of Ocean/Environment/Climate plots now configurable
  • Animated GIF player and image tiling for Data Preview

Instruments

  • Minor modifications to straw drivers and parsers.
  • Fine tuning new compass feature on Kongsberg driver to work with data products.
  • Minor modification to ASL MUD driver, check and turn off verbose mode.
  • Cancel blocked processing on shore station: Systems can now cancel blocked processes on the shore station such as the parsing routine blocking. This applies to all processes after a message is dequeued and before it is queued to the archiver.
  • Minor improvement to logging at shore station.
  • New features for binary parsers. Used in ASL MUD. Binary parsers now work with variable length records and allow specifying sensor positions relative to the payload instead of the packet. Changes wrt to ASL Mud documented here Parsing Binary Data With Dynamic Packet Size, general documentation for declarative parsers updated: Declarative Data Parser Definition File Format (internal links)
  • Improved logging on shore station event detection routine.
  • Multiple queues project (in-progress)
  • Users can now create PAMguard batches through the task management screen, Batch section.

...

  • Correlator event expression simplification.  EEW event detection expression now uses a more generalized device selector expression.
  • Titan driver modified so build date can be parsed. This feature requires deployment to all titan locations, not sure of the priority for deployment.

Data Products

  • NEW CODAR netCDF products for Combiner + Radial stations
  • RDI fix for correlation screen option being less than onboard correlation screen
  • ASL mud improvements: .01a files to use DMAS time not device time, handle varied orientation, improve handling of non-standard data, improve logging
  • Search automated testing improvements (internal use only)
  • Bug fixes + support

...

  • No longer uses archived hydrophone images on initial load (to avoid old incompatible images)
  • Toolbox now programmatically gets dataproduct options for a given device
  • Fixed bug: plot times on ADCP current plot do not align with timeline in dataviewer
  • Initial changes in place for image caching (will work with Systems to activate in April)
  • Testing and operationalizing Matlab as a service (in-progress)

Community Fishers

  • Pipeline now triggered to run cast detections by raw data ingestion (not activated)
  • Data products to use search tree node name for station name instead of search tree node code
  • Geospatial Map returns most recently completed cast preview data products, not the most recent
  • Only generates Cast Preview Plots if older than three days or new cast is at SearchTreeNode
  • Fixed bug: automated creation of JIRA tickets by job #341
  • Androidlog files are no longer being archived
  • Pipeline now sends e-mail when a bad file is encountered

...

  • ONC SeaTube support
  • Oceans 2 Help Desk improvements
  • Sensor plot now uses the dashboard plotting widget with support for plotting multiple sensors at the same time
  • Bug fixes 

Dashboards

  • Fixed bug where it wasn't possible to select a run folder in a User Defined Task Widget
  • Can share a Dashboard to a user with Edit permissions
  • Correct title in Latest Readings Widget

...

Tickets Released: Oceans 2.0: 21.03.000 (accessible to internal users only). Total: 158.

Expand

Bug

  • [DMAS-50249] - Search automation falsely reports failure for AquaTec CSV data product
  • [DMAS-54242] - EEW Test Notification service logging error
  • [DMAS-56636] - failed export json format with image in QA
  • [DMAS-56757] - Search automation report shows data product .json expected files in the result.json column
  • [DMAS-57319] - CKAN record Temporal Extent End dates are inaccurate
  • [DMAS-57337] - jobid link on CameraControl page should be linked to taskmanagement page, not schedulerconsole
  • [DMAS-57340] - In some cases, QAQC reprocessing fixes incorrect QAQC flags for all sensors but Density and Sound Speed
  • [DMAS-57534] - How do we delete qaqcResult dateTo is beginning of next date in reprocess or qaqcreprocess?
  • [DMAS-57546] - qaqcreprocess does not handle "duplicate" qaqcresults correctly
  • [DMAS-57555] - question about how qaqcreprocess handle overlap for station level qaqc
  • [DMAS-57638] - User defined task widget doesn't show list of runs
  • [DMAS-57724] - Test automation is logging lots of vague NullPointerExceptions in GetWebServiceMetricsMVCResourceCommand
  • [DMAS-57734] - When running automation tests, the tool prints a number that is implied to be the number of pending tasks, but is actually the total of historical + pending tasks
  • [DMAS-57790] - need support for millisecond while request the video stream
  • [DMAS-57795] - Cache load of event definitions throwing null pointer
  • [DMAS-57800] - The automation tool fails to deploy and logs a hard-to-understand exception if it can't connect to qapgsql
  • [DMAS-57802] - Fix logging of configuration change ASL data products
  • [DMAS-57830] - Need update dateto of current ip when add a new ip for the same device
  • [DMAS-57833] - should not allow one ip active for mutliple devices
  • [DMAS-57868] - Changes to a Taxon cause its children to vanish from the taxonomy tree until the page is refreshed
  • [DMAS-57891] - Parser clogged with straw
  • [DMAS-57895] - Latest readings widget config title incorrect
  • [DMAS-57900] - Many DA Tests for device control failing seemingly due to hardcoded values
  • [DMAS-57942] - Data Search "Data Product Selection" tab is greyed out when it shouldn't be
  • [DMAS-57965] - When an anonymous user navigates to a page that doesn't exist, ServletUtil logs a NullPointerException
  • [DMAS-57979] - ADCP plot scrolling mechanism is not working
  • [DMAS-58015] - Button Sets no longer seem to work when using Autosave Feature in v3
  • [DMAS-58033] - All QA hosts log error "NoCacheConfigException: Cache ErddapSensorAttribute is not defined in ehcache.xml" on startup
  • [DMAS-58053] - QA: Error on Taxonomy page when clicking taxonomy root node
  • [DMAS-58068] - DMAS Search Failed Notification: 17-Mar-2021 08:52:19 UTC, Geosense Short Period Seismometer 118, Seismometer Data, SearchHdrId 8189321, UserId 42732
  • [DMAS-58075] - speed_over_ground QAQC test for Ferries are failing since Mar 12 00:00 UTC
  • [DMAS-58082] - Updating a taxon name doesn't work unless there is something in the "Common Names" field
  • [DMAS-58083] - Cannot delete an attribute in Attribute Management if it is a "Select" type containing options
  • [DMAS-58091] - When I open a SeaTube dive as an anonymous user, I see an error snackbar "Error: Network error"
  • [DMAS-58112] - Host with role TASK_USER_DEFINED logs an error while starting batch tasks during system startup
  • [DMAS-58116] - Fix AndroidUploadTest MQ URLs
  • [DMAS-58118] - CacheLoaderConfig.dependencies has misleading documentation
  • [DMAS-58122] - Site Device Subset CF005-3953 has no corresponding aligned and depth-binned data
  • [DMAS-58139] - Error in Thomson Detided product with multiple deployments
  • [DMAS-58152] - Video timestamp is not match the annotation timestamp
  • [DMAS-58153] - STRAW timeout issue causing some data to be logged as command responses
  • [DMAS-58163] - ST V2 manual entry is not working
  • [DMAS-58166] - Taxonomy Deletion is displaying an error message even though the delete was successful
  • [DMAS-58171] - Data Viewer Screenshot Comparisons Failing
  • [DMAS-58177] - VPS Base driver caused pa shorestation to stop parsing data
  • [DMAS-58215] - Some Sea Tube related objects are not synced in QA between servers
  • [DMAS-58219] - Quick button page becomes blank while selecting Attribute as button type in QA
  • [DMAS-58231] - Fixing failing UI tests in DataPreview.GenreationAndDisplay
  • [DMAS-58243] - Stop infinite render loop if resource id not found in dataplayer

User Story

  • [DMAS-46363] - As a Dev, I would like to move or rewrite cables (Extensions and Items) to Infrastructure Management
  • [DMAS-52090] - As a Data Preview operator, I would like to add or remove State of Ocean/Env plots from various locations
  • [DMAS-53931] - As a DFO CODAR Data Preview user, improve the viewing of animated GIFs, particularly monthly plots
  • [DMAS-57231] - As a software developer, I'd like the /DeviceSearch page updated to React
  • [DMAS-57620] - As a software developer, I'd like the /DeviceActions page updated to React
  • [DMAS-57838] - Upgrade CF pipeline to ONLY run cast detections once all of the raw data has been ingested
  • [DMAS-57926] - Different Save behavior for adding a taxon in Taxonomy page and adding an attribute in Attribute Management page
  • [DMAS-58086] - As a System Admin, I do not want to archive androidlog files
  • [DMAS-58222] - As a NOAA admin, I would like to show a deprecation warning message to ST V2 users

Task

  • [DMAS-47462] - Implement improvement and document ErddapManagementService
  • [DMAS-48295] - Update the titan accelerometer to parse the build date as a device attribute
  • [DMAS-48611] - Property "serializable" on the CacheLoaderConfig annotation is unclear
  • [DMAS-51849] - Expand number of characters for Expedition Name
  • [DMAS-56055] - Activate NGinx caching for Hydrophone/Acoustic Data Viewer
  • [DMAS-57307] - Support using the Seatube demo server as a backend for Oceans Next in development
  • [DMAS-57313] - Write UI tests for the Help & Support feature
  • [DMAS-57333] - Refactor dashboard widget config in UI Testing
  • [DMAS-57423] - Add missing test cases for Data Product Formats
  • [DMAS-57518] - Fix failing GeospatialMap Jenkins UI Test Results
  • [DMAS-57527] - Refactor DataProductDeliveryServiceHelper to no longer use the aws jar
  • [DMAS-57570] - Add an exclusion list of dataproductformatids to search automation metrics
  • [DMAS-57629] - Make ADCP and Aquadopp device data available to the AID Viewer
  • [DMAS-57775] - Handle varied orientation per transducer and other issues for ASL MUD prototype in echosouder data products
  • [DMAS-57787] - Support dynamic naming and placement of State of Ocean/Env/Climate plots for Data Preview
  • [DMAS-57803] - Replace ASL echosounder internal time in .01a data products with DMAS time
  • [DMAS-57848] - Programmatically get dataproduct options for a given device in data viewer
  • [DMAS-57876] - Possible code refactoring for qaqc results deletion scheduled job
  • [DMAS-57902] - Excessive Logging by Parsers
  • [DMAS-57905] - update "Mail default recipient" in dmas.log
  • [DMAS-57925] - Need Taxonomy Attribute Group information while select an attribute in the multi attribute quick button
  • [DMAS-57936] - Update Community Fishers data products to use search tree node name for station name instead of search tree node code
  • [DMAS-57956] - As a dive logger, I want to see the full text of a taxon in the Annotation Entry pane
  • [DMAS-57969] - Return Most Recently completed Cast Preview DataProducts, not the most recent
  • [DMAS-57974] - Web service and servlets shouldn't call ServiceUtil inside loops
  • [DMAS-57977] - Only generate Cast Preview Plots if older than three days or new cast is at SearchTreeNode
  • [DMAS-58002] - Alphabetize button sets in the Quick Entry dropdown list
  • [DMAS-58011] - Update the FTP directory link the in Oceans2 menu to point to the new "FTP" location
  • [DMAS-58022] - Do not use archived hydrophone images on initial load
  • [DMAS-58025] - Upgrade ChromeDriver to version 89
  • [DMAS-58042] - Update RDI products to reflect that correlation screening is not effective below instrument WC value
  • [DMAS-58043] - make DatePerformed column in deviceaction database table not nullable
  • [DMAS-58046] - Send e-mail If an error Occurs During AndroidLog FTP job
  • [DMAS-58081] - ADV Hydrophone Options - Only use one set of radio buttons for custom or default options
  • [DMAS-58102] - Delete the code behind the YUI-based Site Device Listing page
  • [DMAS-58114] - Update UI Tests for ADV Hydrophone Toolbox radio button change
  • [DMAS-58124] - Provide more useful FK violation information to the front-end
  • [DMAS-58126] - Update STRAW B driver start sequence
  • [DMAS-58128] - please make auto UI test running starting at 12 noon localtime
  • [DMAS-58138] - Repackage QAQC Auto Test UI test page objects
  • [DMAS-58193] - Add UI Tests for DataViewer that Test scrolling forwards and backwards
  • [DMAS-58201] - CF Processing code is applying medfilt1(x,25) incorrectly at the endpoints, causing an underestimation of signal values

Requirement

  • [DMAS-46366] - Clarify requirements for moving part of Budget module into IM
  • [DMAS-58156] - Add requirements for the new chart

Implementation

  • [DMAS-28469] - Driver for ASL Acoustic Scintillation Device
  • [DMAS-48078] - Add instrument report page in dmas menu with appropriate permission check
  • [DMAS-56854] - Date Format Readings in Pamguard File Process
  • [DMAS-57206] - Batch Monitoring Page - Modify Add Batch function
  • [DMAS-57590] - Add additional TaxonomyMatrixAttributeService JUnit tests
  • [DMAS-57601] - Add the page affiliation to the support request
  • [DMAS-57645] - Write new React page for Device Actions
  • [DMAS-57646] - update backend for Device Actions
  • [DMAS-57674] - Update UI tests for DeviceActions
  • [DMAS-57706] - Update backend code for Cables component
  • [DMAS-57708] - Update frontend code for Cables component
  • [DMAS-57753] - Implementation for Idea #1 Widget Tiling
  • [DMAS-57763] - add support for new correlator event expression
  • [DMAS-57764] - Code Change to SOO Plot Job to allow targeting search tree nodes
  • [DMAS-57799] - Write database scripts for extension listing and item tables
  • [DMAS-57801] - Implementation for GIF Player
  • [DMAS-57843] - Add file attachments to the issue collector
  • [DMAS-57847] - add event definition json field to the event maintenance page
  • [DMAS-57856] - Limit the logging for DataPrevewGenerator errors
  • [DMAS-57858] - Implement netCDF format for CODAR QC data product
  • [DMAS-57916] - Schedule Cast Detection Job From ReceiverMessageServiceActivator
  • [DMAS-57927] - Make cast detection job non-singleton
  • [DMAS-57943] - String SEARCH_METRIC_QUERY_COVERED in MetricsQueries.java is poorly named
  • [DMAS-57961] - Fix Potential Race Condition In CastDetectionJob
  • [DMAS-57962] - Code change to update jobid on CameraControl page
  • [DMAS-57984] - Front-end changes for taxonomy deletion
  • [DMAS-58013] - Replace the "help" icon in the Jira formatting link with the text "Formatting help"
  • [DMAS-58032] - Variable length binary parser unit test
  • [DMAS-58036] - Link to the support request form from the status 500 servlet (the Kaboooom) page
  • [DMAS-58038] - Add an Edit option when sharing a Dashboard
  • [DMAS-58040] - dateperformed for deviceaction should not allow null
  • [DMAS-58054] - update UI test to cover dateperformed cannot be null
  • [DMAS-58060] - update UI test for related change in this user story
  • [DMAS-58064] - Write Task That Sends e-mail when a bad file is encountered
  • [DMAS-58065] - Write SQL to update Androidlog file FTP job
  • [DMAS-58066] - Clean up Velocity context and global javascript config
  • [DMAS-58105] - Increase the timeout of the daily test suite
  • [DMAS-58111] - Override default LayoutService permissions to support edit on dashboard...
  • [DMAS-58115] - Add startup script to Matlab codebase
  • [DMAS-58120] - Create temporary directory in /ncdata/shared for androidlog files
  • [DMAS-58121] - Write SQL to add 'local.destination.folder.name' parameter to Androidlog FTP job
  • [DMAS-58130] - Update references to ExtensionManager by Topology pages to reference and use new CableExtensionManaager
  • [DMAS-58132] - Implement multi-sensor chart into SeaTube
  • [DMAS-58155] - Support disabling cruise synchronization through the server startup script
  • [DMAS-58194] - Create servlet for page
  • [DMAS-58202] - Map CODAR netCDF
  • [DMAS-58209] - Remove/de-activate CF Cast Detection Triggering Feature from Release
  • [DMAS-58224] - Add deprecation dialog on STV2 page load with link to Expedition Management

Test

  • [DMAS-57960] - Update Event Maintenance page UI test

Bug (ST)

  • [DMAS-57710] - Search failure emails reporting the wrong URL for QA/dev Jira
  • [DMAS-58095] - Fix unit tests failing in the release branch
  • [DMAS-58099] - Taxonomy deletion should be atomic
  • [DMAS-58107] - Code change to restrict access for non read write users
  • [DMAS-58195] - Add formatting check to data preview
  • [DMAS-58235] - CODAR QC DP file naming issues detected by search automation

Documentation

  • [DMAS-46365] - Update documentation for Extensions in IM Module

...

Tickets Released: Oceans 2.0: 21.02.003 (accessible to internal users only). Total: 22.

Expand

Bug

  • [DMAS-57675] - bug on device port editing interface for the in/out direction
  • [DMAS-57890] - Changing taxonomy should wipe out the selected taxon
  • [DMAS-57938] - Unable to Edit an annotation when it contains an attribute with "Select" values
  • [DMAS-57968] - Password field in Task Management not displaying values
  • [DMAS-57973] - Attempting to delete an "empty" taxon button freezes the page
  • [DMAS-57986] - TaxonButtonSetConfig page is mostly blank
  • [DMAS-57991] - IP link broken in DeviceConsole in QA/PROD
  • [DMAS-57994] - Button Set cloning isn't working
  • [DMAS-58012] - Error when closing annotations
  • [DMAS-58017] - tx_taxonomymatrixattribute_trx is empty
  • [DMAS-58029] - Job 341 Not Creating JIRA Tickets
  • [DMAS-58056] - QA: Attribute and group information blank

Task

  • [DMAS-57636] - Excluded matrix attribute displayed as local if not inherited
  • [DMAS-58004] - Set Resource Type and Resource to default after save an annotation
  • [DMAS-58023] - Validate a TTC when saving an annotation in the backend
  • [DMAS-58078] - Clean up extras in database from duplicate script run

Implementation

  • [DMAS-57206] - Batch Monitoring Page - Modify Add Batch function
  • [DMAS-57852] - Improve how TaxonomyAttributeLineService's get() method handles the operation parameter
  • [DMAS-57871] - Include the id in the response of the create method for TaxonomyAttributeService
  • [DMAS-57985] - Front-end changes for taxon button set deletion
  • [DMAS-58006] - Have TaxonomyAttributeService return groupId instead of groupName
  • [DMAS-58014] - Update Taxon Attribute Management page to use changed groupId parameter

...

Tickets Released: Oceans 2.0: 21.02.002 (accessible to internal users only). Total: 5.

Expand

User Story

  • [DMAS-20667] - As a scientist, I would like to have compass data acquired from Kongsberg Rotary sonars

Implementation

  • [DMAS-28469] - Driver for ASL Acoustic Scintillation Device
  • [DMAS-57981] - Implement additional binary parsing features in declarative parser.
  • [DMAS-57990] - Switch the heading tuple to magnetic heading
  • [DMAS-58005] - Modify ASL MUD driver to turn off verbose mode on driver start

...

Tickets Released: Oceans 2.0: 21.02.001 (accessible to internal users only). Total: 20.

Expand

Bug

  • [DMAS-57864] - In Taxonomy UI, selecting the root taxonomy causes screen to go blank
  • [DMAS-57866] - Equipment Requirements attribute not selectable
  • [DMAS-57924] - Special attributes are in the wrong places while using the quick button
  • [DMAS-57930] - The attribute detail widget should be empty if a new group is created.
  • [DMAS-57954] - Since deployment 2021-03-04, eewshore1 will not send metrics

Task

  • [DMAS-57342] - Parse the Kongsberg SMB headings tuple
  • [DMAS-57923] - Need more data type while create a taxonomy attribute.

Implementation

  • [DMAS-57939] - Update foreign keys
  • [DMAS-57940] - Back-end changes to support taxonomy delete functionality
  • [DMAS-57941] - Back-end changes to support taxon button set delete functionality
  • [DMAS-57978] - get SitePosition from database only when cacheloading

Bug (ST)

  • [DMAS-57634] - Editable inherited comment attribute always saves on focus loss
  • [DMAS-57947] - Logging in redirects to /domain/Apps/theme/colors.css instead of the home page
  • [DMAS-57949] - Can't create issues from the new issue collector when not logged in
  • [DMAS-57957] - Not getting good compass heading values in new SMB files

March 4, 2021

Major release

Maintenance and Production Developer

  • Bug fixes including QAQC reprocessing, QAQC inheritance
  • ONC website support
  • Migration of several pages/UI to modern REACT framework (DeviceAction, new page Cables) (on-going)
  • Several other small improvements/features (in-progress)

Instruments

  • Wally - driver modified to match devices telemetry change in motor logging
  • Rayfin - take picture function in seascript now available
  • Straw - new status commands added, refinements to parsing.
  • Pro Oceanus - Burst mode enhanced to be more reliable
  • Seabird CTD with O2 piggyback - Driver enhanced to handle piggyback problems better
  • RBR Concerto Tilt Meter - Additional start up setting
  • BPR - Driver now support binary mode
  • AIS Source bug resolved
  • New syntax in calibration formulas where sensors can be referenced by sensor code and device attributes can be referenced by attribute code, instead of by sensorid and attributeid
  • New screen for uploading PAMguard configuration files
  • PAMguard batches are automatically scheduled, system will limit the number of concurrent PAMguard tasks

...

  • jep refactored as a separate bundle. This is an optimization for EEW deployments and moves us closer to exposing the jep code publicly
  • Shore station - device being processed can be viewed through jconsole. Allows for quicker troubleshooting when the shore station is blocked
  • Improvements to PGD algorithm
  • Shore station threading and cache load issues

Data Products

  • Search automation improvements (in-progress)
  • Added ancillary data to RDI netCDF plus improvements
  • Kongsberg compass support
  • Support for ASL mud variant + overall AZFP improvements

...

  • Fixed misalignment between image and timeline
  • Add more instruments to selection dropdown
  • Testing Matlab as a service (in-progress)

Community Fishers

  • ALM-6 with AMLx formatting
  • Help button with wiki links in Geospatial Map
  • Now able to save data off tablet to Google drive
  • Geospatial Map now uses Open Street Map tiles as default
  • Updated data search to handle multiple casts for .COR file data product
  • Multiple minor changes to Android Tablet App

...

  • support adding multi attributes in a single quick button, Taxonomy Attribute Management page.
  • NOAA help desk rewrites in React and adding auto fill for names/email and organization information
  • Bug fixes

Dashboards

  • permissions:
    • don't allow display of dashboard using a URL if don't have permission
    • only allow access to Dashboards if logged in
    • only allow access to embed if logged in
  • only auto-refresh if tab is active, only refresh every 30s
  • fix issue with playing video play lists

...

Tickets Released: Oceans 2.0: 21.01.003(accessible to internal users only). Total: 17.

Expand

Bug

  • [DMAS-57683] - Currently selected button getting reset when being updated in TaxonButtonSetConfig
  • [DMAS-57699] - Cannot add device actions to 2 Lufft Met station devices, receiving error
  • [DMAS-57711] - Exception ocurred executing query FROM TaxonomyAttributeLineState ca.uvic.dmas.core.datastorage.DAOException: executeHQL: TaxonomyAttributeLineState
  • [DMAS-57712] - DMAS Search Failed Notification: 10-Feb-2021 11:15:08 UTC, Satlantic Downwelling Radiometer HOCR-ICSW (SN 301), Satlantic Radiometer Time Series, SearchHdrId 7878873, UserId 15223
  • [DMAS-57722] - Blank buttons are being added to the DB from the Taxon Button Set Config page
  • [DMAS-57729] - Taxonomy dropdown should be alphabetized
  • [DMAS-57750] - Handle unequal number of samples per sensor on AML6
  • [DMAS-57759] - Cast Ingestion Job Assigning SiteDeviceSubset to wrong SiteDevice

Task

  • [DMAS-56848] - Attribution should be given to data owners on geospatial map data products
  • [DMAS-57579] - Make Open Street map the default tile set for the CF Geospatial Map
  • [DMAS-57648] - Add or modify a job to move hydrophone FLAC files into the file archiver directory
  • [DMAS-57684] - JMX Bean to show current ddm being processed
  • [DMAS-57728] - Display and allow the user to click empty buttons in TaxonButtonSetConfigNew
  • [DMAS-57736] - Add a permanent directory for the hydrophone compression job and update its regex

Implementation

  • [DMAS-57662] - Database changes for new group table
  • [DMAS-57663] - Back-end changes for new group table

Bug (ST)

  • [DMAS-57717] - Manual entry's attribute toggle was not enabled upon TTC selection

...

Tickets Released: Oceans 2.0: 21.01.002 (accessible to internal users only). Total: 20.

Expand

Bug

  • [DMAS-51949] - Sea-Bird CTD O2 piggyback drivers often disconnect. Current issue at Baynes Sound
  • [DMAS-57625] - Cannot see formula in QAQC Auto Test Details page
  • [DMAS-57647] - QAQCEvaluatorTest failing in Jenkins
  • [DMAS-57667] - Taxon autocomplete displays error snackbar and does not load the taxon list in the new ButtonSetConfig
  • [DMAS-57673] - Quick taxon button doesn't trigger attributes even there are default attributes for that taxon
  • [DMAS-57677] - Button Set List isn't updating the ButtonSet data until a page refresh occurs

User Story

  • [DMAS-44282] - As an ONC Dive Logger I would like to add default (permanent) attributes to Taxons

Task

  • [DMAS-57633] - Add servlet for new TaxonButtonSetConfig page
  • [DMAS-57641] - Handle location searches with multiple casts and multiple devices better for Cor dataproduct
  • [DMAS-57670] - Convert ButtonSet to use the material ui ButtonGroup

Implementation

  • [DMAS-57406] - Taxon attribute database changes
  • [DMAS-57413] - Update front-end to support default attributes
  • [DMAS-57441] - Add taxonomy entries, change taxonomymatrix roots' parents to their taxonomy
  • [DMAS-57617] - Write script to update constraint on taxonbuttonsetline table
  • [DMAS-57635] - Update ManualEntry logic for newly-determined resource-related attribute values
  • [DMAS-57640] - Straw drivers - query various states periodically
  • [DMAS-57649] - Add values for Select datatype resource attributes to database

Bug (ST)

  • [DMAS-57639] - Deleting an ancestor matrix with an attributed descendant results in an orphan
  • [DMAS-57660] - Driver changes for Pro-Oceanus Pro-CV burst mode do not support driver-initiated re-zeroings
  • [DMAS-57664] - NPE when a taxonomy exists without a taxonomy matrix representation

...

Citizen Scientist Android version CF.3.2.5 for Community Fishers Project

Expand

Bug

  • [DMAS-57650] - No Tank Data from AML6 DI: 53240 (S/N A60009)

Task

  • [DMAS-57665] - Release Community Fisher App Version 3.2.5

...

Tickets Released: Oceans 2.0: 21.01.001 (accessible to internal users only). Total: 1.

Expand

Task

  • [DMAS-57615] - Modify driver to filter out redundant motor log values

February 1, 2021

Major release

Maintenance and Production Developer

  • Bug fixes including siteposition cache, live instrument testing
  • Migration of several pages/UI to modern REACT framework (QAQC AutoTest, DeviceListing) (on-going)
  • QAQC reprocessing tool

...

  • Driver/parser maintenance issues (STRAW, BPR)
  • Kongsberg imaging rotary sonar SMB postprocessor support for compass
  • PAMGuard Phase 2 (in-progress)
  • DAF multiqueue design
  • Modularization (OSGi-ification): support for customized builds (in-progress)

Data Products

  • Fixes for RDI ADCPs in high tilt deployments
  • FLAC as source for hydrophones
  • CODAR bug fix
  • Automated testing improvements

...

  • MATLAB as a service ready for testing, not deployed (in-progress)

Community Fishers

  • bug fixes for cast pipeline and geospatial maps
  • AML-6 Integration with Oceans 2.0 (new AMLX parser)
  • Implemented QAQC flags for EDS data

...

Tickets Released: Oceans 2.0: 21.01.000 (accessible to internal users only). Total: 100.

Expand

Bug

  • [DMAS-36280] - QAQC Auto Test Finder Page - Find button doesn't show no result found
  • [DMAS-56570] - Automatic cache reload requests are getting sent to too many JVMs
  • [DMAS-56578] - Correct failing ui test - AnnotationsTest
  • [DMAS-57058] - Oceans 2 menu bar doesn't display correctly when there is a plot widget
  • [DMAS-57070] - parser of devicetypeid 901 need be revisited
  • [DMAS-57090] - SitePosition cache issue caused pashore1 parsing messages slowly, falling behind
  • [DMAS-57104] - L22 vocabulary term metadata missing from CKAN ISO 19115 record
  • [DMAS-57213] - New widgets are hidden on fullscreen dashboard
  • [DMAS-57245] - Job 366 is pushing metadata for inactive ERDDAP datasets to CKAN server
  • [DMAS-57297] - Data availability different between audio config and selector
  • [DMAS-57362] - Unit tests are failing in Oceans 2 master branch
  • [DMAS-57376] - Previously duplicated sitedevicesubset found after DB refresh
  • [DMAS-57380] - Fix failing UI test in CloneDevice
  • [DMAS-57395] - Fix failing test in dataPreviewGeneration
  • [DMAS-57415] - The datacite abstract is adding unwanted French content to the end of the abtract
  • [DMAS-57418] - CKAN ISO 19115 records not downloading
  • [DMAS-57422] - DevicePort Maintenance page has an error when trying to get newly added port
  • [DMAS-57465] - Link from siteDevice page to ERDDAP record is broken
  • [DMAS-57472] - Error occurred trying to reprocess qaqc results on dateRange DateRange [Mon Jan 14 00:00:00 UTC 2019 to Tue Jan 15 00:00:00 UTC 2019] for deviceId506
  • [DMAS-57480] - memory leaking from qaqcreprocess job
  • [DMAS-57491] - DMAS Search Failed Notification: 19-Jan-2021 19:47:19 UTC, Hecate Strait-Hecate Strait CODAR System, CODAR Quality Controlled Surface Currents, SearchHdrId 7806433, UserId 48690
  • [DMAS-57524] - Latest readings showing invalid simple dates in Firefox
  • [DMAS-57531] - master branch of Oceans 2.0 build failed in qamon
  • [DMAS-57551] - Time lapse video not playing using continuous player
  • [DMAS-57560] - DMAS Search Failed Notification: 24-Jan-2021 12:30:27 UTC, Patricia Bay-Saanich Inlet VENUS Instrument Platform, Time Series Scalar Plot, SearchHdrId 7817881, UserId 40000
  • [DMAS-57581] - Failed to load SitePositionjava.lang.RuntimeException: Couldn't build site position cache
  • [DMAS-57583] - Data Availability no longer showing Video widget when device is selected
  • [DMAS-57584] - Fix Environment.js getStaticResourcePath() method's regex
  • [DMAS-57587] - Cast Correction Matlab Script Failing on AML-6 Data
  • [DMAS-57598] - Unable to edit batch tasks
  • [DMAS-57607] - Community Fishers CDOM sensor processing is outputting non median filtered data

User Story

  • [DMAS-23848] - As a scientist, I would like data acquisition for the ASL Acoustic Scintillation device
  • [DMAS-37130] - As a data steward, I would like the data team to have UI where they can delete qaqcresults
  • [DMAS-56396] - As a Citizen Scientist, I would like the Community Fishers app and data acquisition system extended to support the new AML-6 instrument
  • [DMAS-57233] - As a software developer, I'd like the /FileUpload page updated to React
  • [DMAS-57345] - As an RDI ADCP data user I would like the Cassandra data to default to no bin-mapping when the instrument tilt exceeds 20 degrees
  • [DMAS-57483] - Should updating JunctionBox Alarm settings for SCUv2 (Baynes) reset the ports?

Task

  • [DMAS-48748] - As a third party, I would like to be properly attributed in ERDDAP datasets
  • [DMAS-56661] - Fix Dataset Landing Pages Abstract hardcoding
  • [DMAS-56699] - Update auto UI test on calibration page for feature implemented in DMAS-56140
  • [DMAS-57113] - Update auto UI test on JB alram page for new feature added in DMAS-56971
  • [DMAS-57196] - Update UI tests for changes made to physical characteristic tab ui
  • [DMAS-57298] - When the data availability is shown is inconsistent between configs
  • [DMAS-57339] - Implement QAQC flags for CF Aligned and depth-binned sensor data
  • [DMAS-57360] - NRCAN BPR 21501 output changed to binary format -needs driver and parser development
  • [DMAS-57378] - Automate testing of dive CSV export
  • [DMAS-57394] - scripts to update password in QA and DEV affected by DMAS-56408
  • [DMAS-57409] - public wiki documentation is needed for dataproductid 183 introduced for Community Fishers androids
  • [DMAS-57410] - make minor fixes to forms for edit device details pages rewritten in react
  • [DMAS-57411] - Change quarantine column background color on Device Console page
  • [DMAS-57424] - Add label prop to data source and change chart widget config DS labels
  • [DMAS-57448] - Move TaxonButtonSetConfig into Oceans Next
  • [DMAS-57517] - Create Aligned and Depth Binned Navigation data even if insufficient raw data present to interpolate
  • [DMAS-57547] - add camera of devicetype 373 in the dropdown list of cameras in dmas menu
  • [DMAS-57549] - AMLx parser validator rejects 'rogue' data lines
  • [DMAS-57552] - Switch service used by Video widget when source is Device to archivefiles
  • [DMAS-57575] - Add new Qaqc Id for use with community fishers EDS data
  • [DMAS-57585] - change minimum port from 4 to 1 on JB viewer for mini JB devices
  • [DMAS-57596] - Fixing failing UI tests in DataPreview.GenreationAndDisplay
  • [DMAS-57604] - Remove Data Player from widgets menu

Requirement

  • [DMAS-57210] - Write requirement for one-letter search auto-completions on User Defined Taxonomies

Implementation

  • [DMAS-14611] - Kongsberg Driver - Add Support for Compass
  • [DMAS-17210] - In the FileUpload page allow more space to display the entire filename
  • [DMAS-30667] - As as File Upload user, make it clear that the page only accepts .an files
  • [DMAS-56804] - Add UI tests for Sandbox widget
  • [DMAS-56983] - Code Implementation for qaqcresult Deletion Job
  • [DMAS-57180] - Create SQL Scripts for QAQC Deletion Job
  • [DMAS-57353] - Write new React page for /FileUpload
  • [DMAS-57354] - Update backend for /FileUpload
  • [DMAS-57355] - extend declarative parser capabilities to converter type of output strings
  • [DMAS-57368] - Update UI Testing builds to fail on static analysis failure
  • [DMAS-57386] - dmas.log include raw data?
  • [DMAS-57407] - Add service, manager, assembler, and state for TaxonomyMatrixAttribute
  • [DMAS-57430] - Add number of output arguments parameter to Matlab post process jobs
  • [DMAS-57431] - Implement code change for background color of quarantine column on Device Console page
  • [DMAS-57433] - Create domain object that does not extend TreeNodeUI
  • [DMAS-57435] - Write new React page for /DeviceStatus
  • [DMAS-57438] - Ensure cypress component testing ready to use in oceans next
  • [DMAS-57460] - Update taxonomy matrix parent logic for new parent representation
  • [DMAS-57471] - Fix compiler warnings exposed in Java 11
  • [DMAS-57478] - Update backend to add ERDDAP_URL in NeptuneVelocityServlet so it's accessible by React
  • [DMAS-57479] - Update Environment.js to get the correct Erddap URL
  • [DMAS-57482] - Create a TaxonomyMatrixAttribute cache
  • [DMAS-57487] - Add groupname to TaxonomyAttribute classes
  • [DMAS-57521] - Modify RDI matlab code to accept higher tilts and improve plot for high currents
  • [DMAS-57522] - Modify RDI java complex parser to accept higher tilts
  • [DMAS-57537] - Add and update TaxonomyMatrixAttributeService logic
  • [DMAS-57548] - Add TaxonomyMatrixAttribute synchronization logic
  • [DMAS-57557] - Update ADCP plotting options
  • [DMAS-57568] - Upgrade geckodriver to 0.29.0 for UI testing
  • [DMAS-57597] - Update ID for QAQC Results Deletion Job

Bug (ST)

  • [DMAS-57364] - Fix unit test failures in seatube
  • [DMAS-57365] - Fix unit test failures in scalar data
  • [DMAS-57414] - Fix test failures in quarantine and calibration
  • [DMAS-57417] - Verification failed with "bad array subscript"
  • [DMAS-57532] - Chart Widget data availability 'box select' reversing start/end dates in Firefox
  • [DMAS-57580] - Lidar sdaq status issue
  • [DMAS-57591] - Cache update does not remove old object
  • [DMAS-57593] - Assigning a regular matrix attribute does not delete from descendants

Documentation

  • [DMAS-56984] - Documentation for qaqcresult Deletion Job

...

Citizen Scientist Android version CF.3.2.4 for Community Fishers Project

Expand

Bug

  • [DMAS-57467] - Unexpected AML-6 data causes 'View Data' to crash in app
  • [DMAS-57530] - As a user of the CF app, I would like the data download UI to timeout if there is an error

Task

  • [DMAS-57582] - Increase ActiveMQ Timeout in Community Fisher App
  • [DMAS-57595] - Release Community Fisher App Version CF.3.2.4

...

Citizen Scientist Android version CF.3.2.3 for Community Fishers Project

Expand

Bug

Task

...

Tickets Released: Oceans 2.0: 20.12.001 (accessible to internal users only). Total: 1.

Expand

Bug

  • [DMAS-57445] - The Pro-Oceanus on SCUv2 #8 has faulted (over current) and there have been no alerts.

...

Citizen Scientist Android version CF.3.2.2 for Community Fishers Project

Expand

Bug

  • [DMAS-57408] - Community Fisher App not downloading data off of instruments

Task

Implementation

  • [DMAS-56747] - Modify AML-6 Driver to use AMLx Format

January 7, 2021

Major release

Maintenance and Production Developer

  • Bug fixes
  • Sensor-level data ratings applied to CSV/JSON data products
  • Encrypted password deviceattribute in database and raw file
  • Migration of several pages/UI to modern REACT framework (more tabs on device details pages converted) (on-going)

...

  • project initiation, requirements gathering and planning (in-progress)
  • Modularization (OSGi-ification): support for customized builds (in-progress)

Instruments

  • Driver maintenance issues
  • Acoustic scintillations driver (in-progress)
  • Kongsberg imaging rotary sonar driver now queries for compass heading
  • Support for getting files from a device with low-latency (in-progress)

Data Products

  • Bug fixes, particularly issues around piggyback devices

...

  • MATLAB as a service (in-progress)
  • Small change to device selection component
  • Bioacoustic annotations (in-progress)

Community Fishers

  • bug fixes for cast pipeline and geospatial maps
  • Android app: improve reliability for bluetooth (app updates will now have their own releases)

...

Tickets Released: Oceans 2.0: 20.12.000 (accessible to internal users only). Total: 86.

Expand

Bug

  • [DMAS-56276] - The French support in CKAN doesn't seem to be working
  • [DMAS-56372] - password values for at least some devicetypes are showing in the log files
  • [DMAS-56545] - Tests failing in DeviceAttributes
  • [DMAS-56588] - Oceans 2.0 OSGi tests failed with unresolved bundles after "error in opening zip file"
  • [DMAS-56670] - fix bug in the algorithm used to get the publication year for DataCite metadata
  • [DMAS-56891] - Oceans 2 deployment fails with a cryptic error if /var/run/gemini.pid exists
  • [DMAS-57085] - Fix failing UI test in CloneDevice
  • [DMAS-57095] - CKAN ISO 19115 record missing data partner attributions
  • [DMAS-57097] - French Abstract missing from CKAN ISO 19115 record
  • [DMAS-57098] - Typo in CKAN ISO 19115 records
  • [DMAS-57123] - Fix failing UI tests in ExpeditionManagement
  • [DMAS-57124] - Fix failing UI tests in SeaTubeSearchTest
  • [DMAS-57171] - Dataplayer device does not clear after switching device category
  • [DMAS-57214] - Automatic merge failure in Oceans Next
  • [DMAS-57243] - DMAS Search Failed Notification: 10-Dec-2020 22:17:28 UTC, Nortek Aquadopp Profiler A3P9320 AQD14543, Nortek Time Series, SearchHdrId 6119519, UserId 27378
  • [DMAS-57272] - Fix failing test in geospatialMap
  • [DMAS-57280] - Fix issues with merge of release/20.11.000 into master
  • [DMAS-57305] - DMAS Search Failed Notification: 18-Dec-2020 04:32:35 UTC, Folger Passage-Folger Deep, Log File, SearchHdrId 6151449, UserId 2851
  • [DMAS-57314] - Text widget on dashboards allows text to go over its frame
  • [DMAS-57322] - UI test suite failed with "Error forwarding the new session Empty pool of VM for setup Capabilities" after crash
  • [DMAS-57325] - User defined tasks widget config missing a name attribute
  • [DMAS-57344] - Reset button not working for organizations in Broad Search
  • [DMAS-57356] - Catalina exceptions in CruiseVocabCacheLoader
  • [DMAS-57361] - Fix failing tests in DataPreviewManagement
  • [DMAS-57383] - Fix failing tests in GeospatialMap

User Story

  • [DMAS-34552] - As a user, I would like to Utilize Sensor-Level Data Ratings in CSV/JSON Data Products, Services and Apps
  • [DMAS-56968] - As a data steward, I would like a message to validate that the site device is being saved

Task

  • [DMAS-56187] - add selenium test for fullscreen dashboard
  • [DMAS-56408] - As a systemer, I would like to see database save values of device attribute "password" in some encrypted form
  • [DMAS-56473] - Add UI tests to Dashboards to test the edit functionality of the Data Source List
  • [DMAS-56829] - Update selenium scripts for code change on sensorcodename
  • [DMAS-56915] - As a data steward, I would like the drop-down list in the Add Task to Batch to be aphabetically listed
  • [DMAS-56970] - Update Device Action selenium tests
  • [DMAS-56981] - Improve unit test coverage on dashboard related tests
  • [DMAS-57003] - Make UI fixes and include RO field for Modify By and Modify Date on the Electrical Ratings Tab of DeviceListing
  • [DMAS-57055] - Fix errors in service calls for electrical rating service
  • [DMAS-57076] - Extract contents of data.tar without creating data subfolder
  • [DMAS-57117] - Update HoloSea code to use GainDecibels instead of Gain
  • [DMAS-57195] - Use different icon for Quarantine and Quick plot on DeviceConsole
  • [DMAS-57197] - Convert AnnotationSearchExecutionStrategy to an abstract class
  • [DMAS-57205] - Improve broad searching on organizations
  • [DMAS-57207] - Fix auto merge failure on 493836b715b
  • [DMAS-57209] - Please Transfer Dec-2-2020 and Dec-3-2020 T'Souke data to QA and reprocess
  • [DMAS-57265] - Investigate broad search performance improvements
  • [DMAS-57266] - As an outgoing Data Manager I would like senior members of the Data Team to have permission to close other people's annotations
  • [DMAS-57267] - Sort "Add Widget menu" on Dashboards alphabetically
  • [DMAS-57273] - Fix broken test in DeviceService test
  • [DMAS-57278] - Update UI tests in DataViewer
  • [DMAS-57302] - Add dropdown for organizations to Broad Search
  • [DMAS-57308] - Update JEP calibration formula needed to correct Rinko Oxygen calibration data from Pacific Salmon Foundation RBR/Rinko instrument sets
  • [DMAS-57315] - Refactor getpiggybackdevicesensor, to use piggyback flags in deviceport table
  • [DMAS-57318] - Remove character limit for searchtreenodename
  • [DMAS-57320] - ERROR on ZapParser
  • [DMAS-57346] - Add Dashboards to menu

Design

  • [DMAS-57256] - CSV data product header and content

Implementation

  • [DMAS-55271] - Implementation of sensor level DataRating in Java gap filling
  • [DMAS-56993] - Update backend for Procurement tab
  • [DMAS-56994] - Write new React Page for Procurement tab
  • [DMAS-56995] - Update selenium scripts for Procurement
  • [DMAS-57011] - Add ui testing to check for info bars when site device being saved or deleted
  • [DMAS-57040] - Update backend for nameplate tab
  • [DMAS-57041] - Write new react page for Nameplate tab
  • [DMAS-57048] - Write new React page for Nameplate maintenance
  • [DMAS-57049] - update backend for Nameplate Maintenance
  • [DMAS-57119] - Update ui tests for Nameplate tab
  • [DMAS-57139] - Update backend for IP tab
  • [DMAS-57140] - Write new react page for IP tab
  • [DMAS-57141] - Update UI tests for IP tab
  • [DMAS-57146] - extract DmasServiceManagerImpl to its own bundle
  • [DMAS-57147] - Write new React page for Ip maintenance
  • [DMAS-57148] - Update backend for Ip maintenance
  • [DMAS-57158] - create a version of the DmasServiceManager to be used by the correlator
  • [DMAS-57181] - Add Still Camera Methods to CameraSystemDevice
  • [DMAS-57191] - Code Change for Alphabetizing Add Task to Batch Dropdown
  • [DMAS-57212] - Refactor frontend to allow one-character taxon autocompletes for user-defined taxonomies
  • [DMAS-57222] - Refactor button set config to also use one-character autocompletes
  • [DMAS-57251] - Create a new role "CORRELATOR" for EEW correlators
  • [DMAS-57264] - Convert jep-2.4.0.jar to an OSGi bundle, if possible
  • [DMAS-57281] - Allow instance to be configured for each host separately
  • [DMAS-57299] - Update front end for changes made to service after removing UI class
  • [DMAS-57311] - Add support menu & wiki links to the geospatial map
  • [DMAS-57326] - Code change for new Quarantine icon
  • [DMAS-57393] - script to provide new passwords in prod

Bug (ST)

Documentation

  • [DMAS-57271] - Update internal documentation for CSV/JSON products for sensor level data ratings

...

Citizen Scientist Android version CF.3.2.1 for Community Fishers Project

Expand

User Story

  • [DMAS-23436] - As a Pacific Salmon Foundation person, I would like feedback on numbers of casts on tablet
  • [DMAS-37530] - As a citizen scientist, I would like to have the User Manual in citizen scientist app updated

Task

  • [DMAS-57382] - Release New Community Fisher App Version (3.2.1)

Implementation

  • [DMAS-57268] - Display number of files uploaded after files have been uploaded to Oceans 2.0, and add a progress bar
  • [DMAS-57269] - Display Files in descending order (for date) in 'View Data'
  • [DMAS-57294] - Update 'Help' Documentation in App

...