You are viewing an old version of this page. View the current version.

Compare with Current View Page History

« Previous Version 890 Next »

This page contains the current year's release notes and new features, primarily for Oceans 2.0 / DMAS, as well as any applications created/maintained by the ONC software engineering group, including mobile Apps and desktop/PC applications. In progress project status may be presented as well.

Previous years:

The information below is written in plain language as much as possible. Detailed release notes are available on internal confluence pages (requires login).

July 6, 2021

Major release (feature list in-progress)

Tickets Released: Oceans 2.0: 21.06.000 (accessible to internal users only). Total: 83.

Usability

  • [DMAS-57859] - In Seatube V3, save layout on refresh in current session

Bug

  • [DMAS-56771] - auto reprocess tool does not work anymore after new feature added in DMAS-53889
  • [DMAS-57951] - taxon name not visible for saved annotation entries sometimes
  • [DMAS-64154] - When an annotation's taxon is changed, both old and new attributes are displayed
  • [DMAS-64164] - ADV Re-renders images multiple times when switching device while another device is loading data
  • [DMAS-64258] - Test failing in CruiseManagement
  • [DMAS-64552] - SeaTubeVideoService logs parameter errors unnecessarily
  • [DMAS-64600] - Fix failing GroupsDataProductPermissionFilters tests
  • [DMAS-64614] - Fix multiple DeviceAndSensor failing tests
  • [DMAS-64657] - All QA hosts logged errors while loading the DafTest cache after deployment with release/21.05.000
  • [DMAS-64670] - DmasGroupManager calls ServiceUtil too often
  • [DMAS-64689] - Task machines running 21.05.000 can't deserialize EventDetectedContainer, sent in messages on the archiver topic from an archiver running on master
  • [DMAS-64710] - Failed to generate a DeviceService response: java.lang.NullPointerException
  • [DMAS-64714] - PA Shorestation logging ERRORs that it can't handle an ActiveMQ object - java.lang.ClassNotFoundException
  • [DMAS-64740] - Can't see Batch tasks in TaskManagement in Prod
  • [DMAS-64750] - NOAA EX2103 expedition and dives are using ONC logo.
  • [DMAS-64775] - "Error: Invalid Parameter: liveStream1DeviceId. Invalid Integer format" on saving a cruise in QA
  • [DMAS-64782] - update coverage to exclude untestable functional component packages
  • [DMAS-64825] - Cannot update any cruise on Expedition Maintenance page
  • [DMAS-64829] - Master Branch build failing
  • [DMAS-64845] - Webpack build failing
  • [DMAS-64849] - Class not found exceptions on shore station
  • [DMAS-64850] - Data messages dropped at shore station
  • [DMAS-65337] - Error reloading eventdefinition caches
  • [DMAS-65338] - Ocean Next release branch build failing due to DateUtils unit test failing
  • [DMAS-65341] - Fixing failing UI test in geospatial map

User Story

  • [DMAS-19427] - Provide Annotation End Date for Starting and Stopping Driver
  • [DMAS-64851] - As a Data Specialist, I would like an automated geofencing QAQC test

Task

  • [DMAS-58071] - batch reprocess group task seems to add files in reverse order to the queue instead of chronological
  • [DMAS-58097] - divelogger machines should not be showing in Reprocess Console
  • [DMAS-64147] - Upgrade gradle in the UI Testing repository to the latest stable version
  • [DMAS-64168] - Replace the deprecated JCenter Maven repository used by UI Testing
  • [DMAS-64438] - As an AIS user, I would like a filter in the data search
  • [DMAS-64510] - Add typescript files to test:( coverFile, lint, pretty-code)
  • [DMAS-64527] - Put the limit value into the hover message in the latest readings widget
  • [DMAS-64590] - Update post refresh script to remove whacky characters from attribution test cases
  • [DMAS-64652] - Remove DmasLoginServlet
  • [DMAS-64676] - update suggested list of hostname to include new machines in Oceans-next deployment
  • [DMAS-64693] - Create tests for objects serialized over mq
  • [DMAS-64716] - Change default values for WebParameter.getParameter methods to have the correct type
  • [DMAS-64717] - add deviceid in the nullpointerexception in getPortNumberFromSensor method
  • [DMAS-64718] - Extend manual trigger of samples for RAS Water Sampler (devicetype: 368)
  • [DMAS-64742] - Don't display "Default attributes removed for selected taxon" when a user change a taxon which doesn't have any attribute
  • [DMAS-64760] - Remove redundant serialization/deserialization from ExpeditionTreeService
  • [DMAS-64783] - Add an index to tm_task to improve performance of finding queued searches
  • [DMAS-64796] - Update QaDeviceTests for 21.06.000
  • [DMAS-64834] - Revert but keep the change for switch the live/historical video mode
  • [DMAS-64847] - Merge failed from 21.05.000 to master

Implementation

  • [DMAS-57153] - implement automated geofencing QAQC test
  • [DMAS-64092] - Create Annotations Search Table
  • [DMAS-64194] - Create Resource Type Filter component prototype
  • [DMAS-64201] - Add support for selecting page size
  • [DMAS-64220] - Create skeleton code for Annotation Entry
  • [DMAS-64411] - Implement annotation search using new filter component
  • [DMAS-64452] - Add Search functionality
  • [DMAS-64476] - Implement Database Changes
  • [DMAS-64477] - Create ORM code
  • [DMAS-64483] - Extract EventReactor into a separate osgi bundle
  • [DMAS-64492] - Update Java code for endDate on Device Annotations created in DeviceConsole
  • [DMAS-64493] - Update existing Device annotations to add EndDate in database
  • [DMAS-64511] - Make new Annotations Search page available in Oceans 2
  • [DMAS-64530] - extract ArchiveFileManager to a new osgi bundle
  • [DMAS-64531] - Move EventDetector and dependencies into ca.uvic.dmas.extension.eventdetection.api
  • [DMAS-64532] - create event detection impl bundle
  • [DMAS-64533] - Implement BPRZero driver
  • [DMAS-64655] - Driver for Cabled Fetch
  • [DMAS-64663] - RBRZero simulator
  • [DMAS-64664] - Add platform_name variable to index radial data in combiner netCDF to their origin
  • [DMAS-64680] - Add logic in SiteDeviceSubset Service to inject EDS and cast files to ncdata
  • [DMAS-64682] - Modify ExternallyDerivedSensorDataPostProcessor to allow ingestion of empty EDS files
  • [DMAS-64691] - Modify Audio Widget Service Calls to use External API
  • [DMAS-64692] - add driverschedule manager/service
  • [DMAS-64734] - Create a WebRequestWithToken (or similar)
  • [DMAS-64749] - Add re-postprocess option on SiteDeviceSubsetMaintenance UI
  • [DMAS-64755] - Pass back user token from UserDetailsService and add to window.DMAS.Config
  • [DMAS-64761] - Delete Overlapping casts and Check if cast is in new Geospatial Area
  • [DMAS-64801] - Set the referenceSiteDeviceSubsetId field for the SiteDeviceSubsets being deleted
  • [DMAS-64803] - batch reprocess group task reverse order correction
  • [DMAS-64853] - script to add a new formula

Bug (ST)

  • [DMAS-64703] - Resolve automatic merge conflicts
  • [DMAS-64753] - Incompatible argument type in AnnotationService
  • [DMAS-65336] - Cannot Save new SiteDeviceSubsets on SiteDeviceSubsetMaintenance page

Documentation

June 29, 2021

Minor release: SeaTube updates and fixes

Tickets Released: Oceans 2.0: 21.05.005 (accessible to internal users only). Total: 4.

Task

  • [DMAS-64806] - Synchronize archive file objects to the divelogger jvm
  • [DMAS-64832] - Need a dml SQL script to sync archivelocationtype and archivelocation table from prod to dive logger database

Implementation

Bug (ST)

  • [DMAS-64721] - Select attribute filtering does not find selected values

June 25, 2021

Minor release: CO2 driver fix (no downtime)

Tickets Released: Oceans 2.0: 21.05.004 (accessible to internal users only). Total: 1.

Bug

  • [DMAS-64726] - Can't start driver for Pro-Oceanus CO2 on Queen of Alberni

June 14, 2021

Minor release: new drivers and bug fixes

Tickets Released: Oceans 2.0: 21.05.003 (accessible to internal users only). Total: 10.

Bug

  • [DMAS-64666] - Clicking on the "Click Image to Enlarge" link in preview just shows a spinner
  • [DMAS-64705] - NullPointerException when trying to view onc-internal user group
  • [DMAS-64707] - 2,800 + ERROR messages on eewshore1 per day - failure to connect

Task

  • [DMAS-57987] - Change DataProductDelivery service calls to AcousticDataViewerImage in Acoustic Data Viewer
  • [DMAS-64709] - DataProductPermissionService logging debug info at INFO level

Implementation

  • [DMAS-64459] - Back-end support for attribute value filtering
  • [DMAS-64640] - Basic Driver for ONC Profiling Winch
  • [DMAS-64700] - Rollback batch task reprocessing code in QA
  • [DMAS-64702] - Please, remove CODAR netCDF data product for radials from Data Search (temporarily)

Bug (ST)

  • [DMAS-64234] - Timestamps for PAMGUARD files not correct

June 9, 2021

Minor release: derived sensor cache bug (shorestation and task only - no downtime)

Tickets Released: Oceans 2.0: 21.05.002 (accessible to internal users only). Total: 1.

Bug

  • [DMAS-64673] - sensorPeriodMap always empty in DataEnrichmentCacheModuleImpl

June 8, 2021

Minor release: SeaTube auto-save bug fixes and improved logging

Tickets Released: Oceans 2.0: 21.05.001 (accessible to internal users only). Total: 5.

Bug

  • [DMAS-64368] - Shorestation ERROR logs without device IDs
  • [DMAS-64628] - Auto Save feature is not working in live mode
  • [DMAS-64654] - capture time stops working in live onship mode
  • [DMAS-64665] - Auto Save feature in live mode wtih onship layout creates annotations with the same timestamp

Implementation

  • [DMAS-64631] - Log more information during video export

June 2, 2021

Major release

Maintenance and Production Developer

  • Bug / Production Developer tickets, including QAQC bug fixes
  • Search tree and Data Search map loading performance improvements
  • DFO expedition page on ONC website
  • Data preview update to keep SOO plots indefinitely
  • Disable emails for data searches from anonymous users

Instruments

  • Multiple queues project (significant progress, not deployed)
  • Driver / parser bug fixes and support

Earthquake Early Warning

  • OSGi modularization (in-progress)
  • Python version of EEW end user software

Data Products

  • State of Ocean data products: added a levelled pressure externally derived sensor, fix for CSV column headers
  • Search automation improvements: update metrics to consider sensor-level mappings, fix metrics discrepancy, add test cases

Data Player

  • Bug fixes

Community Fishers Phase 2

  • See CF app version CF.3.2.6
  • Bug fixes + support

SeaTubeV3

  • DFO expedition support
  • NOAA Capstone annotation ingestion (in-progress)
  • ONC Sea Tube search by attribute values
  • Bug fixes

Annotations & Geospatial Search

  • Updated resources service to support hierarchical structure
  • Base components for annotation filters and filter groups, specific filters, etc (in-progress)

CIOOS

  • Prevent inactive datasets from being ingested by CKAN
  • CODAR/complex data support and marine gazetter design (in-progress)

Tickets Released: Oceans 2.0: 21.05.000 (accessible to internal users only). Total: 82.

Bug

  • [DMAS-41962] - Logout redirect makes next login unsuccessful if not logged in yet
  • [DMAS-51309] - Search automation metrics report a different number (more) of comparison failures than what the report shows
  • [DMAS-54353] - Fix broken tests in checkPortStatus of SCUAcquisition
  • [DMAS-55504] - State of oceans climatology CSV product header / data order messed up
  • [DMAS-58153] - STRAW timeout issue causing some data to be logged as command responses
  • [DMAS-64103] - Fix failing UI tests in Geospatial Map
  • [DMAS-64180] - Playlist Sharing link does not work
  • [DMAS-64205] - Pro-Oceanus CO2-Pro CV pCO2 driver randomly leaves idle state
  • [DMAS-64289] - Fix failing ui tests on DeviceDetails because of bad xpaths
  • [DMAS-64293] - Fix failing FileManagement.checkFileArchiverService() failing (manual pass FM.TC.119)
  • [DMAS-64302] - "Add User defined Taxonomy" is visible to anonymous users
  • [DMAS-64335] - When a UI test suite finishes, an empty Chrome window with the URL "data;," is left open
  • [DMAS-64346] - Inactive ERDDAP dataset metadata should not be ingested to CKAN and CIOOS portals
  • [DMAS-64429] - PSF data (IS-stations) not plotting in Geospatial Map (May 11th)
  • [DMAS-64475] - fix failing tests in TaskDefinition
  • [DMAS-64486] - Data Preview Links covering State of Ocean plots
  • [DMAS-64539] - DMAS Search Failed Notification: 26-May-2021 19:25:44 UTC, AML CTD Plus X 50334, Aligned and Depth-Binned Profile Data (On-Demand), SearchHdrId 8677842, UserId 48660
  • [DMAS-64543] - NOAA Logger - Admin (df21) does not have write permission to Attribute Management Page
  • [DMAS-64547] - Add the DFO station and JVM to the database
  • [DMAS-64576] - Acoustic Data Viewer ADCP Toolbox Options onSubmit not working
  • [DMAS-64578] - qaeewshore1 fails to start on release branch
  • [DMAS-64579] - NoaaDeviceTests cannot log in
  • [DMAS-64584] - Fix Topology bug when device is disconnected before setup starts
  • [DMAS-64585] - dfo topices missed in mq.properties
  • [DMAS-64586] - cruiseId not being passed to DeviceAction Maintenance page
  • [DMAS-64587] - connection service is null for qadivelogger3.onc.uvic.ca
  • [DMAS-64589] - Buttons not inheriting taxon information in DEMO
  • [DMAS-64591] - QA Device Console doesn't show device uptime or last reading date
  • [DMAS-64594] - Device console quick plot doesnt load in QA
  • [DMAS-64601] - A running search cannot be cancelled from a Cart in prod or QA
  • [DMAS-64613] - Casts detected in QA but not PROD. Please investigate
  • [DMAS-64626] - df20 cannot make annotations on dive 234

User Story

  • [DMAS-53404] - As a data player user, I want to know where data is available for devices
  • [DMAS-58049] - As a DMAS request admin, I would like to categorize the requests

Task

  • [DMAS-46744] - Update the CAP signature to use RSA SHA 256
  • [DMAS-54048] - Add "pressure-leveled" derived sensor to State of the Oceans matlab file
  • [DMAS-57870] - Enable hovertext showing full label for Buttons
  • [DMAS-64250] - Update QaDeviceTests for 2021-04-30
  • [DMAS-64256] - Write Regression Tests for Data Availability Component in ADV
  • [DMAS-64259] - Write SQL for androidlog and annotation file FTP changes in DMAS-58045
  • [DMAS-64314] - Modify Data Preview search tree trimming to keep SOO plots in data preview indefinitely
  • [DMAS-64374] - Create Python version of the EEW end user software
  • [DMAS-64395] - remove eew bamfield devices from qa post refresh script
  • [DMAS-64419] - Clean up parsing of SystemProperty.Location
  • [DMAS-64434] - Add Missing Test Cases for Data Product Formats
  • [DMAS-64442] - Cast Preview Plots should fallback to searchresult with searchresultstatusid 4 if 2 cannot be found
  • [DMAS-64444] - Improve logging in the correlator
  • [DMAS-64496] - Update Search Automation metrics to include sensor mappings
  • [DMAS-64517] - Redirect STV2 to Expedition Management
  • [DMAS-64550] - Improve logging for outdated RDI file generation
  • [DMAS-64553] - Upgrade ChromeDriver to version 91

Implementation

  • [DMAS-57239] - Extract DeclarativeDevice into a separate osgi bundle
  • [DMAS-57744] - Split ca.uvic.dmas.core.calculation.jep.api into an API/Impl pair
  • [DMAS-64107] - Implement sending EEW notifications over activemq
  • [DMAS-64138] - merge mq management code into master
  • [DMAS-64203] - Update ResourceService to return hierarchically structured resource data
  • [DMAS-64204] - Implement Data Availability Component in DataPlayerForm
  • [DMAS-64207] - Create a Date Filter component
  • [DMAS-64216] - Create Source Filter for Annotation Search
  • [DMAS-64376] - Create DFO logger and logger admin groups using SQL
  • [DMAS-64377] - Support DFO organization in Expedition Maintenance
  • [DMAS-64378] - Allow DFO logger admins to have Read Write privilege for Attribute and Taxonomy pages
  • [DMAS-64379] - Allow DFO loggers and DFO logger admins to have RW privilege for Quick Button page
  • [DMAS-64380] - Create a separate tree node for DFO in Expedition Management page to hold all DFO expeditions
  • [DMAS-64381] - Support same permission / configuration with ONC for SeaTube annotation CRUD operations
  • [DMAS-64382] - Allow DFO logger admins to have Read Write privilege for Bathymetry page
  • [DMAS-64383] - Support DFO onship server ST related data synchronization
  • [DMAS-64396] - Set up DFO test users
  • [DMAS-64436] - Front end changes for dive deletion
  • [DMAS-64441] - Allow DFO logger admin to manage DFO loggers
  • [DMAS-64445] - Update front-end to handle DFO organization details
  • [DMAS-64472] - Extract references to logger and logger admin groups to an enum
  • [DMAS-64480] - Add a toString to DeviceActionForUI
  • [DMAS-64482] - refactor EventReactionFactory to get reactions as prototypes
  • [DMAS-64534] - BPRZero parser

Test

Bug (ST)

  • [DMAS-64186] - Data Search tests cause Out of Memory errors in Chrome
  • [DMAS-64198] - UI tests sometimes fail to log in
  • [DMAS-64233] - Unexpected response from TicketManagerService creates a snackbar with "{}"
  • [DMAS-64435] - Fix DiveListingService's delete method
  • [DMAS-64468] - Different page content for different user.
  • [DMAS-64469] - DFO loggs can't create annotations

May 25, 2021

Minor release: search tree maintenance and device console bug fixes

Tickets Released: Oceans 2.0: 21.04.003 (accessible to internal users only). Total: 4.

Bug

  • [DMAS-64315] - Extremely slow loading times for Data Search and Plotting Utility preventing access
  • [DMAS-64499] - Site device tab in the Searchtree mainteanance page of Oceans 2.0 doesn't show any datefrom of sitedevices
  • [DMAS-64504] - device console is quite slow in prod with 21.04.002
  • [DMAS-64505] - Search Hydrophone Page isn't loading

May 20, 2021

Citizen Scientist Android version CF.3.2.5 for Community Fishers Project

Improved backup to Google Drive, support for Android 10 and new tablets, improved date and GPS handling, release note viewing and update notifications, bug fixes

Tickets Released: CF.3.2.5 (accessible to internal users only). Total: 17.

Bug

  • [DMAS-57748] - Community Fisher Tablet outputs future date in commandData
  • [DMAS-57840] - AML-6 Data not downloading - :error data not found"
  • [DMAS-64457] - GPS Date Comparison Dialog box inconsistent bolding of date in message
  • [DMAS-64460] - CF App Google Account Sign is not working

User Story

  • [DMAS-23434] - As a Pacific Salmon foundation person, I would like to have enhanced data security
  • [DMAS-57262] - As a Citizen Scientist, I would like to have a notification when the app is ready to be updated, and be able to view release notes

Task

  • [DMAS-57839] - AML-6 Powering Off - connections
  • [DMAS-58045] - Send Annotation files and Androidlog files to different directories In FTP server
  • [DMAS-64104] - As a Community Fishers user, I would like a tablet model of SM-T500 to be registered with the CF app
  • [DMAS-64109] - Please update the CF app so that it supports Android 10
  • [DMAS-64211] - CF App needs to mitigate users from sampling with incorrect tablet dates
  • [DMAS-64443] - Release Community Fisher App Version CF.3.2.6
  • [DMAS-64491] - Use Release Google API Keys in release APK for CF Android App

Implementation

  • [DMAS-57316] - Streamline process of uploading backed up data to Google Drive
  • [DMAS-57817] - Show notification if the app has an available update
  • [DMAS-57828] - Display Release Notes Inside of App
  • [DMAS-57872] - Update API Keys Using New ONC Dev Google account


May 19, 2021

Minor release: further performance improvements for search trees, add loading indicators, bug fixes for task management, SeaTube, Community Fishers

Tickets Released: Oceans 2.0: 21.04.002 (accessible to internal users only). Total: 19.

Bug

  • [DMAS-58255] - Can't edit some annotations in SeaTubeV3
  • [DMAS-58256] - Some button sets in Annotation Entry dropdown correspond to wrong button set
  • [DMAS-64341] - Job #337 failing to generate DOIs for piggyback devices
  • [DMAS-64347] - Error adding data products to cart in Data Search by Location for piggybacks
  • [DMAS-64365] - Task management paging is broken, not showing all of the tasks
  • [DMAS-64387] - Add a spinner for the loading of the Search Tree
  • [DMAS-64388] - Anonymous searches creating failing search complete emails - disable emails for anonymous users
  • [DMAS-64417] - Shorestations failed to start in QA with release/21.04.000
  • [DMAS-64426] - DMAS Search Failed Notification: 12-May-2021 04:00:24 UTC, Conception Bay-Holyrood Bay Underwater Network, Nortek Daily Currents Plot, SearchHdrId 8580952, UserId 15356
  • [DMAS-64427] - Start Date displayed on Qaqc Auto Test Details page shows current date, not start date of test
  • [DMAS-64446] - Request Support link throws an error

Task

  • [DMAS-64298] - Please investigate why the scheduled job 340 (Cast Ingestion) is throwing up an error once it was enabled to run on schedule yesterday
  • [DMAS-64336] - Return searchresultstatusid 4 when providing matlab-generated products in the case of no data found

Requirement

  • [DMAS-64089] - Create requirements for no-video annotation user choices

Design

  • [DMAS-64090] - Design dialog for no-video annotation user options

Implementation

  • [DMAS-64389] - Reduce the data overhead in the searchtree by excluding non-searchable nodes/data
  • [DMAS-64394] - Reduce the data overhead in the searchtree by excluding unused metadata
  • [DMAS-64425] - Improve DeviceService Instruments by Category loading time by eliminating excess cache iteration
  • [DMAS-64440] - Improve ONCKmlService search tree loading time by eliminating excess cache iteration

May 11, 2021

Minor release: performance improvements for search trees (Data Search and Plotting Utility), instrument search failures, permissions fix for geospatial map and more

Tickets Released: Oceans 2.0: 21.04.001 (accessible to internal users only). Total: 20.

Bug

  • [DMAS-64118] - Search Tree on Plotting Utility is verrry slow to load
  • [DMAS-64238] - miss or overlap qaqcresult for deviceid=1003 and qaqcid=1301 after qaqcreprocess
  • [DMAS-64254] - QaqcAutotestDetails endDate is 1970-01-01 in QA
  • [DMAS-64257] - Tests failing in UserReplication
  • [DMAS-64303] - DMAS Search Failed Notification: 05-May-2021 21:25:41 UTC, SeaBird 43 Oxygen (S/N 1807), Time Series Scalar Plot, SearchHdrId 8572042, UserId 94080
  • [DMAS-64324] - The timestamp line of multi sensors chart in ST stop working
  • [DMAS-64342] - SensorPlot in SeaTubeV3 keeps resetting the view of the graph when zooming / panning
  • [DMAS-64384] - ONSHORE1 failing to synchronize some annotations

User Story

  • [DMAS-64232] - As a Community Fisher user, I want cast data previews to respect data agreements.

Task

  • [DMAS-64240] - As a data steward, I would like to be able to see more than 5 cables in the pagination

Implementation

  • [DMAS-64093] - Implement Filter and FilterGroup components
  • [DMAS-64149] - Update the backend to accept issue categories
  • [DMAS-64150] - Add issue categories to the UI
  • [DMAS-64271] - Update UI tests
  • [DMAS-64283] - Add permissions check for cast operation in DataPreviewService
  • [DMAS-64323] - Do Not Display Error snackbar if DataPreviewService returns an error
  • [DMAS-64390] - Improve searchtree loading time by eliminating excess manager startup
  • [DMAS-64393] - Improve search tree filter loading time by eliminating excessive cache iteration

Bug (ST)

  • [DMAS-64269] - Ingester does not set creation and modification information with the identifier's
  • [DMAS-64340] - Ingester test sometimes fails on Jenkins

May 5, 2021

Major release

Maintenance and Production Developer

  • Email notification for Data Search
  • QAQC related tickets
  • Bug / Production Developer tickets
  • Migration of several pages/UI to modern REACT framework

Instruments

  • Multiple queues project (significant progress, not deployed)
  • PAMguard features: batching, external user access, improvement performance

Earthquake Early Warning

  • Added a second protocol for EEW client and other improvements for modularization

Data Products

  • Nortek current plot ensemble averaging - fixes a number of recently detected issues with the plots
  • FLAC support in PAMguard pre-processor
  • CODAR improvements: mercator projection, plot limits and titles
  • CF support: multiple deployment bug, descriptive attributes, crossing midnight, re-arrange of cor file columns and labels
  • Search automation related improvements: fix out of memory errors for disjoint scalar data, very slow plotting for min/max plots, support for 2nd QA, exclusion list for devicecategories

Data Player

  • Changes to persist Toolbox Options between mods
  • Changes to update Toolbox Options after device change
  • Caching (in-progress)
  • Testing and operationalizing Matlab as a service (in-progress)

Community Fishers (Now in Phase 2)

  • Clock issues in Android tablets
  • Remove auto-generation of tickets for bad or unassigned casts
  • Allow map polygons be id-able for testing
  • Tweek cast endpoints in cast detection MATLAB code
  • Data restrictions (in-progress)
  • Bug fixes + support

SeaTubeV3

  • Oceans 2.0 / SeaTube Help Desk improvements
  • Capstone annotation ingestion
  • Video play choice dialog for missing video
  • Bug fixes 

API & Annotations & Dashboards

  • External API improvements
  • TypeScript pilot project in REACT framework
  • Migrate and build a new & improved annotations search page in REACT (in-progress)
  • Automated UI test improvements/experiments with Cypress
  • Dashboards bug fixes

CIOOS

  • Greatly improve performance of ERDDAP Management
  • Synchronous service for Data Products (a one-call alternative to dataproductdelivery) (in-progress)
  • ERDDAP service as a source (in-progress)
  • Fix issues with French text

Tickets Released: Oceans 2.0: 21.04.000 (accessible to internal users only). Total: 124.

Bug

  • [DMAS-57594] - sort by feature in IP tab of Device Details page is broken
  • [DMAS-57614] - All Screenshot UI tests are Failing
  • [DMAS-57680] - ErddapManagement page is taking a long time to change datasets.xml
  • [DMAS-57735] - Certain regular expression verifications in web service tests can block the automation server from running new tests
  • [DMAS-57815] - Powerable Status = Never not working correctly in DeviceConsole
  • [DMAS-57820] - the sort feature under reprocess group in batches isn't actually sorting properly by status
  • [DMAS-57918] - Investigate possible inaccurate data rating on TEMPO-MINI causing search failures
  • [DMAS-58084] - fix automatic merge failure from release to master
  • [DMAS-58104] - UI tests haven't completed since March 10
  • [DMAS-58109] - ISO French Abstracts showing corrupt characters due to encoding errors
  • [DMAS-58113] - DMAS Search Failed Notification: 22-Mar-2021 19:27:01 UTC, JASCO M36-V35-100 Hydrophone E000029, Hydrophone Spectral Data, SearchHdrId 8273649, UserId 42732
  • [DMAS-58131] - As an engineer, I am struggling to use the new Device Search interface
  • [DMAS-58142] - Buggy save behaviour in Demo sometimes causing page to hang
  • [DMAS-58204] - In SeaTubeV3, annotations that aren't within a video file can be clicked, but clicking doesn't do anything except highlight the annotation
  • [DMAS-58211] - Test failing in CruiseManagement
  • [DMAS-58212] - Test failing in DiveManagement
  • [DMAS-58214] - UI Tests Failing in GeospatialMap
  • [DMAS-58220] - Fix failing SearchTreeMaintenance UI tests
  • [DMAS-58230] - Fix failing test in dataPreviewManagement
  • [DMAS-58267] - DataViewer UI Tests Failing
  • [DMAS-58274] - ADV Hydrophone Form Not Selecting Radio Button Before Images are loaded
  • [DMAS-58378] - Acoustic Data Viewer not Persisting Toolbox Options
  • [DMAS-58384] - When powering J10 on JB-18, DMAS sets the gf_breaker_limit to 0 and 0, causing it to fault
  • [DMAS-58397] - ADV ADCP Form reset handler not resetting Form Fields to defaults
  • [DMAS-64078] - Toolbox does not update between devices without being closed and reopened
  • [DMAS-64098] - Deleting an Item doesnt work from cables page
  • [DMAS-64110] - DMAS Search Failed Notification: 16-Apr-2021 15:54:31 UTC, null, SeaTube Annotation Export, SearchHdrId 8543030, UserId 44142
  • [DMAS-64120] - Fix electrical rating not displaying in the ui after updating
  • [DMAS-64132] - Fix failing tests in DeviceDetailsTest
  • [DMAS-64134] - why sourcesensorid is null after qaqcreprocess for DI 22777
  • [DMAS-64137] - Applied QAQC tab on sensor maintenance not displaying any values
  • [DMAS-64166] - DMAS - "User Directory" redirects to ftp.neptunecanada.ca, instead of ftp.oceannetworks.ca
  • [DMAS-64174] - Build failed when deploying to QA
  • [DMAS-64187] - Investigate sporadic search failures in QA search automation with high volume min/max data
  • [DMAS-64210] - Fix failing ui tests on sensor maintenance
  • [DMAS-64217] - Fix failing ui tests in SiteDeviceMaintenanceTest
  • [DMAS-64224] - Data Search for COR files By Location not working, even though these data are populating geospatial map
  • [DMAS-64241] - Fix failing UI tests in Plotting Utility
  • [DMAS-64243] - Error when generating multiple data products
  • [DMAS-64249] - Internal Users in QA are not able to create annotations
  • [DMAS-64253] - Bug in videoFileQAQC job caused by new code for 2nd QA
  • [DMAS-64255] - Test failing in SearchTreeMaintenance
  • [DMAS-64260] - Fix failing tests in generationAndDisplay
  • [DMAS-64288] - Can't add derived sensor definition if none exist

User Story

  • [DMAS-25060] - As a Nortek daily current plot user, I would like the plots to be resampled properly to prevent errors in data gaps, backscatter averaging and anti-aliasing
  • [DMAS-56819] - As a Data Specialist I would like the ability to modify the datefrom of a QAQC test attribute through the UI
  • [DMAS-57154] - As a Data Specialist, I would like an automated PVCS QAQC test
  • [DMAS-57343] - As a user from NOAA, I would like to easily report and keep track issues found in Ocean's 2.0
  • [DMAS-57761] - As a data specialist, I would like to Improve the maintainability of the correlator event expression
  • [DMAS-57819] - As a Data Search user, I would like an email notifying me when my searches are complete
  • [DMAS-57822] - Keep files in /ftp/pub folder 21 days, instead of 14 days
  • [DMAS-57970] - As a software developer i'd like the tabs on Sensor Maintenance to be updated to React

Task

  • [DMAS-45798] - Remove debugging code.
  • [DMAS-46372] - As a User Management User, add a obvious way to add/delete user groups
  • [DMAS-50167] - Formsections for hydrophones spectrograms and spectral MAT files
  • [DMAS-54948] - Add plot type to CODAR plot titles
  • [DMAS-57558] - Test and support the WAV to FLAC source file transition
  • [DMAS-58026] - Add ui test to check IP link on device console page
  • [DMAS-58059] - As a Data Steward, I would like the columns in Task Monitor to be sortable
  • [DMAS-58062] - Remove residual budget pages
  • [DMAS-58125] - provide details of algorithm used to give positional coordinates for SeaTube V3 annotations
  • [DMAS-58141] - Mockup Annotation Search
  • [DMAS-58157] - Reorganize oceans next menu so there are groups of items
  • [DMAS-58191] - Change date logic regarding cruises and topology entries
  • [DMAS-58199] - Define Filter component "interface"
  • [DMAS-58236] - Fix and update broken links on oceannetworks.ca to State of Ocean plots
  • [DMAS-58246] - Sort Cruise Name dropdown list alphabetically in DeviceAction Maintenance page
  • [DMAS-58251] - Why executing time is far behind of createddate of loading cache command in prod?
  • [DMAS-58254] - Create skeleton for annotations search page
  • [DMAS-58262] - Improve Automated Testing Documentation
  • [DMAS-58268] - Add Typescript to the Oceans-Next project
  • [DMAS-64083] - Add ui test to verify cruise dropdown is sorted correctly
  • [DMAS-64084] - Write UI tests for Cables page
  • [DMAS-64101] - Improve links under PNGs in Data Preview
  • [DMAS-64102] - Change CODAR plot projection to Mercator
  • [DMAS-64124] - Change Jenkinsfile to run jacoco coverage on onc-web
  • [DMAS-64126] - Change the default login/logout pages to not use the former CAS server
  • [DMAS-64140] - make ONCMatlab code in qa2 work
  • [DMAS-64142] - Change the data column names for lat and lon in the .cor data product
  • [DMAS-64145] - Change "Patrol name" to "Location" in the .cor file data product
  • [DMAS-64165] - Add an exclusion list of devicecategories to search automation metrics
  • [DMAS-64197] - Use the Search Tree Maintenance page object in Data Search tests
  • [DMAS-64209] - Update descriptions of CF pipeline device attributes to be ...descriptive

Requirement

  • [DMAS-58087] - Gather requirements
  • [DMAS-58247] - Create requirements for a video-focused predefined layout

Design

Implementation

  • [DMAS-57578] - Support FLAC as a source file for PAMguard
  • [DMAS-57950] - Add UI tests
  • [DMAS-57971] - Write tabs in react
  • [DMAS-57997] - Update UI to allow user to change date from
  • [DMAS-57998] - Update QaqcTestDetailService to accept datefrom
  • [DMAS-57999] - Update backend to use react version of tabs
  • [DMAS-58030] - Write sensor maintenance pages in react
  • [DMAS-58031] - Update backend for sensor maintenance pages
  • [DMAS-58164] - Implement Persistence handlers for the DafQueueServiceActivator
  • [DMAS-58168] - Update ui tests for sensor listing tabs and maintenance pages
  • [DMAS-58175] - Implement DAF Processing
  • [DMAS-58179] - script to insert qaqcformula and attributes
  • [DMAS-58180] - Add PVCS qaqc
  • [DMAS-58190] - Update taxonomy attribute management page to use FK violation information in error message
  • [DMAS-58226] - Update device action link on Cruise page
  • [DMAS-58237] - Clean up page model of SearchTreeMaintenance tests
  • [DMAS-58238] - Put updated search tree nodes directly in the cache without waiting for a full reload
  • [DMAS-58239] - Fix tests broken due to metadata changes
  • [DMAS-58240] - Update SearchTreeService access control to be based on AccessControlledWebService
  • [DMAS-58269] - Update oceans next code
  • [DMAS-58271] - Update UI tests for DeviceSearch
  • [DMAS-58272] - Update cables service create methods to return new id in payload
  • [DMAS-58282] - Write logic for Capstone annotation ingestion
  • [DMAS-64075] - Add/Update UI tests for Dashboard Management when Sharing RW permission
  • [DMAS-64087] - Code change for data search email notification
  • [DMAS-64097] - Write database scripts for email notification
  • [DMAS-64144] - Create service call to check other video resolutions given a timestamp
  • [DMAS-64170] - Implement automatic averaging for Nortek current plots
  • [DMAS-64172] - Update backend for Sensor Maintenance
  • [DMAS-64173] - Update oceans next code
  • [DMAS-64221] - Update documentation
  • [DMAS-64268] - Improvements on search complete email

Test

Bug (ST)

  • [DMAS-64135] - Complex Data Product Issues on Nortek 1 MHz Profiler at DDL
  • [DMAS-64158] - Potential infinite loops in Dashboards
  • [DMAS-64171] - Infinite recursive loop in DashboardDisplay when not logged in
  • [DMAS-64252] - handle the case of a single ensemble for Nortek plots

Documentation

  • [DMAS-58096] - Make sure the main page of documentation is up-to-date

April 28,29, 2021

Minor release: MATLAB fixes for Community Fishers (no downtime)

Tickets Released: Oceans 2.0: 21.03.003,21.03.004 (accessible to internal users only). Total: 1,1.

Task

  • [DMAS-64212] - Please investigate why aren't casts being detected for pipeline PROD run: data from 23 Apr 2021
  • [DMAS-64219] - Please investigate why no corrected data were generated from Job 339 for detected Pacheedaht casts

April 21, 2021

Minor release: ERDDAP datasets fix, SeaTube video resolution, dashboard and PAMguard fixes

Tickets Released: Oceans 2.0: 21.03.002 (accessible to internal users only). Total: 5.

Bug

  • [DMAS-58260] - Switching resolution in some SeaTube videos doesn't do anything
  • [DMAS-58278] - Can only change video resolution once, then Settings are not available
  • [DMAS-58394] - Share Dialog in dashboard table not sharing RW

Task

  • [DMAS-58028] - Attempt to generate or view the ERDDAP datasets.xml returns a maintenance page

Implementation

April 14, 2021

Minor release: various fixes and features including: Data Preview GIF player improvement, SeaTubeV3 layout, Community Fishers fixes

Tickets Released: Oceans 2.0: 21.03.001 (accessible to internal users only). Total: 19.

Bug

  • [DMAS-58241] - CODAR GIFs are bi-daily not daily as intended
  • [DMAS-58244] - Getting resource Id for devices that are currently deployed is failing.
  • [DMAS-58249] - In ST Multi sensor chart is using local time, we need UTC timestamp
  • [DMAS-58253] - Fix QaqcTestDetails so that values can be saved properly
  • [DMAS-58257] - DMAS Search Failed Notification: 08-Apr-2021 20:23:42 UTC, Inshore Profiling System-Profiling Instrument Package, Cast Scalar Multi-Profile Plot, SearchHdrId 8536199, UserId 22446
  • [DMAS-58263] - Fail to add DateTo information for existing IP
  • [DMAS-58273] - DMAS Search Failed Notification: 09-Apr-2021 16:46:17 UTC, AML CTD Plus X 50241, Aligned and Depth-Binned Profile Data (On-Demand), SearchHdrId 8536670, UserId 94330
  • [DMAS-58276] - Video files at the start of dives are not played in SeaTubeV3

User Story

  • [DMAS-58233] - As a DFO CODAR Data Preview user, I would like to load lower resolution gifs for faster load times
  • [DMAS-58245] - As a dive logger, I would like a ST layout to display larger video.

Task

  • [DMAS-58196] - Create locations for DMAS + ActiveMQ for new ferries
  • [DMAS-58242] - Add small GIFs for Data Preview to work with the new GIF player
  • [DMAS-58393] - As a Data Steward, I would like to stop the automatic generation of JIRA tickets for Unassigned and Bad casts

Design

  • [DMAS-58264] - Create design for a video-focused predefined layout

Implementation

  • [DMAS-58248] - Add new video-focused predefined layout into STV3
  • [DMAS-58252] - Front-end code change for gif player to use smaller sized gifs

Test

  • [DMAS-57976] - Add web service tests to cover resampling changes
  • [DMAS-58207] - Create regression test for Gif Player

Bug (ST)

  • [DMAS-58221] - Update styling and functionality following testing

April 7, 2021

Major release

Maintenance and Production Developer

  • Bug fixes including QAQC inheritance
  • ONC website support, including Wiring The Abyss updates for the maintenance expedition
  • Migration of several pages/UI to modern REACT framework: extension + item pages
  • State of Ocean/Environment/Climate plots now configurable
  • Animated GIF player and image tiling for Data Preview

Instruments

  • Minor modifications to straw drivers and parsers.
  • Fine tuning new compass feature on Kongsberg driver to work with data products.
  • Minor modification to ASL MUD driver, check and turn off verbose mode.
  • Cancel blocked processing on shore station: Systems can now cancel blocked processes on the shore station such as the parsing routine blocking. This applies to all processes after a message is dequeued and before it is queued to the archiver.
  • Minor improvement to logging at shore station.
  • New features for binary parsers. Used in ASL MUD. Binary parsers now work with variable length records and allow specifying sensor positions relative to the payload instead of the packet. Changes wrt to ASL Mud documented here Parsing Binary Data With Dynamic Packet Size, general documentation for declarative parsers updated: Declarative Data Parser Definition File Format (internal links)
  • Improved logging on shore station event detection routine.
  • Multiple queues project (in-progress)
  • Users can now create PAMguard batches through the task management screen, Batch section.

Earthquake Early Warning

  • Correlator event expression simplification.  EEW event detection expression now uses a more generalized device selector expression.
  • Titan driver modified so build date can be parsed. This feature requires deployment to all titan locations, not sure of the priority for deployment.

Data Products

  • NEW CODAR netCDF products for Combiner + Radial stations
  • RDI fix for correlation screen option being less than onboard correlation screen
  • ASL mud improvements: .01a files to use DMAS time not device time, handle varied orientation, improve handling of non-standard data, improve logging
  • Search automated testing improvements (internal use only)
  • Bug fixes + support

Data Player

  • No longer uses archived hydrophone images on initial load (to avoid old incompatible images)
  • Toolbox now programmatically gets dataproduct options for a given device
  • Fixed bug: plot times on ADCP current plot do not align with timeline in dataviewer
  • Initial changes in place for image caching (will work with Systems to activate in April)
  • Testing and operationalizing Matlab as a service (in-progress)

Community Fishers

  • Pipeline now triggered to run cast detections by raw data ingestion (not activated)
  • Data products to use search tree node name for station name instead of search tree node code
  • Geospatial Map returns most recently completed cast preview data products, not the most recent
  • Only generates Cast Preview Plots if older than three days or new cast is at SearchTreeNode
  • Fixed bug: automated creation of JIRA tickets by job #341
  • Androidlog files are no longer being archived
  • Pipeline now sends e-mail when a bad file is encountered

SeaTubeV3

  • ONC SeaTube support
  • Oceans 2 Help Desk improvements
  • Sensor plot now uses the dashboard plotting widget with support for plotting multiple sensors at the same time
  • Bug fixes 

Dashboards

  • Fixed bug where it wasn't possible to select a run folder in a User Defined Task Widget
  • Can share a Dashboard to a user with Edit permissions
  • Correct title in Latest Readings Widget

API & CIOOS

  • Fixed bug where an incorrect end date was put in a CKAN record
  • Return data set Id from the ErddapManagementService create operation

Tickets Released: Oceans 2.0: 21.03.000 (accessible to internal users only). Total: 158.

Bug

  • [DMAS-50249] - Search automation falsely reports failure for AquaTec CSV data product
  • [DMAS-54242] - EEW Test Notification service logging error
  • [DMAS-56636] - failed export json format with image in QA
  • [DMAS-56757] - Search automation report shows data product .json expected files in the result.json column
  • [DMAS-57319] - CKAN record Temporal Extent End dates are inaccurate
  • [DMAS-57337] - jobid link on CameraControl page should be linked to taskmanagement page, not schedulerconsole
  • [DMAS-57340] - In some cases, QAQC reprocessing fixes incorrect QAQC flags for all sensors but Density and Sound Speed
  • [DMAS-57534] - How do we delete qaqcResult dateTo is beginning of next date in reprocess or qaqcreprocess?
  • [DMAS-57546] - qaqcreprocess does not handle "duplicate" qaqcresults correctly
  • [DMAS-57555] - question about how qaqcreprocess handle overlap for station level qaqc
  • [DMAS-57638] - User defined task widget doesn't show list of runs
  • [DMAS-57724] - Test automation is logging lots of vague NullPointerExceptions in GetWebServiceMetricsMVCResourceCommand
  • [DMAS-57734] - When running automation tests, the tool prints a number that is implied to be the number of pending tasks, but is actually the total of historical + pending tasks
  • [DMAS-57790] - need support for millisecond while request the video stream
  • [DMAS-57795] - Cache load of event definitions throwing null pointer
  • [DMAS-57800] - The automation tool fails to deploy and logs a hard-to-understand exception if it can't connect to qapgsql
  • [DMAS-57802] - Fix logging of configuration change ASL data products
  • [DMAS-57830] - Need update dateto of current ip when add a new ip for the same device
  • [DMAS-57833] - should not allow one ip active for mutliple devices
  • [DMAS-57868] - Changes to a Taxon cause its children to vanish from the taxonomy tree until the page is refreshed
  • [DMAS-57891] - Parser clogged with straw
  • [DMAS-57895] - Latest readings widget config title incorrect
  • [DMAS-57900] - Many DA Tests for device control failing seemingly due to hardcoded values
  • [DMAS-57942] - Data Search "Data Product Selection" tab is greyed out when it shouldn't be
  • [DMAS-57965] - When an anonymous user navigates to a page that doesn't exist, ServletUtil logs a NullPointerException
  • [DMAS-57979] - ADCP plot scrolling mechanism is not working
  • [DMAS-58015] - Button Sets no longer seem to work when using Autosave Feature in v3
  • [DMAS-58033] - All QA hosts log error "NoCacheConfigException: Cache ErddapSensorAttribute is not defined in ehcache.xml" on startup
  • [DMAS-58053] - QA: Error on Taxonomy page when clicking taxonomy root node
  • [DMAS-58068] - DMAS Search Failed Notification: 17-Mar-2021 08:52:19 UTC, Geosense Short Period Seismometer 118, Seismometer Data, SearchHdrId 8189321, UserId 42732
  • [DMAS-58075] - speed_over_ground QAQC test for Ferries are failing since Mar 12 00:00 UTC
  • [DMAS-58082] - Updating a taxon name doesn't work unless there is something in the "Common Names" field
  • [DMAS-58083] - Cannot delete an attribute in Attribute Management if it is a "Select" type containing options
  • [DMAS-58091] - When I open a SeaTube dive as an anonymous user, I see an error snackbar "Error: Network error"
  • [DMAS-58112] - Host with role TASK_USER_DEFINED logs an error while starting batch tasks during system startup
  • [DMAS-58116] - Fix AndroidUploadTest MQ URLs
  • [DMAS-58118] - CacheLoaderConfig.dependencies has misleading documentation
  • [DMAS-58122] - Site Device Subset CF005-3953 has no corresponding aligned and depth-binned data
  • [DMAS-58139] - Error in Thomson Detided product with multiple deployments
  • [DMAS-58152] - Video timestamp is not match the annotation timestamp
  • [DMAS-58153] - STRAW timeout issue causing some data to be logged as command responses
  • [DMAS-58163] - ST V2 manual entry is not working
  • [DMAS-58166] - Taxonomy Deletion is displaying an error message even though the delete was successful
  • [DMAS-58171] - Data Viewer Screenshot Comparisons Failing
  • [DMAS-58177] - VPS Base driver caused pa shorestation to stop parsing data
  • [DMAS-58215] - Some Sea Tube related objects are not synced in QA between servers
  • [DMAS-58219] - Quick button page becomes blank while selecting Attribute as button type in QA
  • [DMAS-58231] - Fixing failing UI tests in DataPreview.GenreationAndDisplay
  • [DMAS-58243] - Stop infinite render loop if resource id not found in dataplayer

User Story

  • [DMAS-46363] - As a Dev, I would like to move or rewrite cables (Extensions and Items) to Infrastructure Management
  • [DMAS-52090] - As a Data Preview operator, I would like to add or remove State of Ocean/Env plots from various locations
  • [DMAS-53931] - As a DFO CODAR Data Preview user, improve the viewing of animated GIFs, particularly monthly plots
  • [DMAS-57231] - As a software developer, I'd like the /DeviceSearch page updated to React
  • [DMAS-57620] - As a software developer, I'd like the /DeviceActions page updated to React
  • [DMAS-57838] - Upgrade CF pipeline to ONLY run cast detections once all of the raw data has been ingested
  • [DMAS-57926] - Different Save behavior for adding a taxon in Taxonomy page and adding an attribute in Attribute Management page
  • [DMAS-58086] - As a System Admin, I do not want to archive androidlog files
  • [DMAS-58222] - As a NOAA admin, I would like to show a deprecation warning message to ST V2 users

Task

  • [DMAS-47462] - Implement improvement and document ErddapManagementService
  • [DMAS-48295] - Update the titan accelerometer to parse the build date as a device attribute
  • [DMAS-48611] - Property "serializable" on the CacheLoaderConfig annotation is unclear
  • [DMAS-51849] - Expand number of characters for Expedition Name
  • [DMAS-56055] - Activate NGinx caching for Hydrophone/Acoustic Data Viewer
  • [DMAS-57307] - Support using the Seatube demo server as a backend for Oceans Next in development
  • [DMAS-57313] - Write UI tests for the Help & Support feature
  • [DMAS-57333] - Refactor dashboard widget config in UI Testing
  • [DMAS-57423] - Add missing test cases for Data Product Formats
  • [DMAS-57518] - Fix failing GeospatialMap Jenkins UI Test Results
  • [DMAS-57527] - Refactor DataProductDeliveryServiceHelper to no longer use the aws jar
  • [DMAS-57570] - Add an exclusion list of dataproductformatids to search automation metrics
  • [DMAS-57629] - Make ADCP and Aquadopp device data available to the AID Viewer
  • [DMAS-57775] - Handle varied orientation per transducer and other issues for ASL MUD prototype in echosouder data products
  • [DMAS-57787] - Support dynamic naming and placement of State of Ocean/Env/Climate plots for Data Preview
  • [DMAS-57803] - Replace ASL echosounder internal time in .01a data products with DMAS time
  • [DMAS-57848] - Programmatically get dataproduct options for a given device in data viewer
  • [DMAS-57876] - Possible code refactoring for qaqc results deletion scheduled job
  • [DMAS-57902] - Excessive Logging by Parsers
  • [DMAS-57905] - update "Mail default recipient" in dmas.log
  • [DMAS-57925] - Need Taxonomy Attribute Group information while select an attribute in the multi attribute quick button
  • [DMAS-57936] - Update Community Fishers data products to use search tree node name for station name instead of search tree node code
  • [DMAS-57956] - As a dive logger, I want to see the full text of a taxon in the Annotation Entry pane
  • [DMAS-57969] - Return Most Recently completed Cast Preview DataProducts, not the most recent
  • [DMAS-57974] - Web service and servlets shouldn't call ServiceUtil inside loops
  • [DMAS-57977] - Only generate Cast Preview Plots if older than three days or new cast is at SearchTreeNode
  • [DMAS-58002] - Alphabetize button sets in the Quick Entry dropdown list
  • [DMAS-58011] - Update the FTP directory link the in Oceans2 menu to point to the new "FTP" location
  • [DMAS-58022] - Do not use archived hydrophone images on initial load
  • [DMAS-58025] - Upgrade ChromeDriver to version 89
  • [DMAS-58042] - Update RDI products to reflect that correlation screening is not effective below instrument WC value
  • [DMAS-58043] - make DatePerformed column in deviceaction database table not nullable
  • [DMAS-58046] - Send e-mail If an error Occurs During AndroidLog FTP job
  • [DMAS-58081] - ADV Hydrophone Options - Only use one set of radio buttons for custom or default options
  • [DMAS-58102] - Delete the code behind the YUI-based Site Device Listing page
  • [DMAS-58114] - Update UI Tests for ADV Hydrophone Toolbox radio button change
  • [DMAS-58124] - Provide more useful FK violation information to the front-end
  • [DMAS-58126] - Update STRAW B driver start sequence
  • [DMAS-58128] - please make auto UI test running starting at 12 noon localtime
  • [DMAS-58138] - Repackage QAQC Auto Test UI test page objects
  • [DMAS-58193] - Add UI Tests for DataViewer that Test scrolling forwards and backwards
  • [DMAS-58201] - CF Processing code is applying medfilt1(x,25) incorrectly at the endpoints, causing an underestimation of signal values

Requirement

  • [DMAS-46366] - Clarify requirements for moving part of Budget module into IM
  • [DMAS-58156] - Add requirements for the new chart

Implementation

  • [DMAS-28469] - Driver for ASL Acoustic Scintillation Device
  • [DMAS-48078] - Add instrument report page in dmas menu with appropriate permission check
  • [DMAS-56854] - Date Format Readings in Pamguard File Process
  • [DMAS-57206] - Batch Monitoring Page - Modify Add Batch function
  • [DMAS-57590] - Add additional TaxonomyMatrixAttributeService JUnit tests
  • [DMAS-57601] - Add the page affiliation to the support request
  • [DMAS-57645] - Write new React page for Device Actions
  • [DMAS-57646] - update backend for Device Actions
  • [DMAS-57674] - Update UI tests for DeviceActions
  • [DMAS-57706] - Update backend code for Cables component
  • [DMAS-57708] - Update frontend code for Cables component
  • [DMAS-57753] - Implementation for Idea #1 Widget Tiling
  • [DMAS-57763] - add support for new correlator event expression
  • [DMAS-57764] - Code Change to SOO Plot Job to allow targeting search tree nodes
  • [DMAS-57799] - Write database scripts for extension listing and item tables
  • [DMAS-57801] - Implementation for GIF Player
  • [DMAS-57843] - Add file attachments to the issue collector
  • [DMAS-57847] - add event definition json field to the event maintenance page
  • [DMAS-57856] - Limit the logging for DataPrevewGenerator errors
  • [DMAS-57858] - Implement netCDF format for CODAR QC data product
  • [DMAS-57916] - Schedule Cast Detection Job From ReceiverMessageServiceActivator
  • [DMAS-57927] - Make cast detection job non-singleton
  • [DMAS-57943] - String SEARCH_METRIC_QUERY_COVERED in MetricsQueries.java is poorly named
  • [DMAS-57961] - Fix Potential Race Condition In CastDetectionJob
  • [DMAS-57962] - Code change to update jobid on CameraControl page
  • [DMAS-57984] - Front-end changes for taxonomy deletion
  • [DMAS-58013] - Replace the "help" icon in the Jira formatting link with the text "Formatting help"
  • [DMAS-58032] - Variable length binary parser unit test
  • [DMAS-58036] - Link to the support request form from the status 500 servlet (the Kaboooom) page
  • [DMAS-58038] - Add an Edit option when sharing a Dashboard
  • [DMAS-58040] - dateperformed for deviceaction should not allow null
  • [DMAS-58054] - update UI test to cover dateperformed cannot be null
  • [DMAS-58060] - update UI test for related change in this user story
  • [DMAS-58064] - Write Task That Sends e-mail when a bad file is encountered
  • [DMAS-58065] - Write SQL to update Androidlog file FTP job
  • [DMAS-58066] - Clean up Velocity context and global javascript config
  • [DMAS-58105] - Increase the timeout of the daily test suite
  • [DMAS-58111] - Override default LayoutService permissions to support edit on dashboard...
  • [DMAS-58115] - Add startup script to Matlab codebase
  • [DMAS-58120] - Create temporary directory in /ncdata/shared for androidlog files
  • [DMAS-58121] - Write SQL to add 'local.destination.folder.name' parameter to Androidlog FTP job
  • [DMAS-58130] - Update references to ExtensionManager by Topology pages to reference and use new CableExtensionManaager
  • [DMAS-58132] - Implement multi-sensor chart into SeaTube
  • [DMAS-58155] - Support disabling cruise synchronization through the server startup script
  • [DMAS-58194] - Create servlet for page
  • [DMAS-58202] - Map CODAR netCDF
  • [DMAS-58209] - Remove/de-activate CF Cast Detection Triggering Feature from Release
  • [DMAS-58224] - Add deprecation dialog on STV2 page load with link to Expedition Management

Test

  • [DMAS-57960] - Update Event Maintenance page UI test

Bug (ST)

  • [DMAS-57710] - Search failure emails reporting the wrong URL for QA/dev Jira
  • [DMAS-58095] - Fix unit tests failing in the release branch
  • [DMAS-58099] - Taxonomy deletion should be atomic
  • [DMAS-58107] - Code change to restrict access for non read write users
  • [DMAS-58195] - Add formatting check to data preview
  • [DMAS-58235] - CODAR QC DP file naming issues detected by search automation

Documentation

  • [DMAS-46365] - Update documentation for Extensions in IM Module

March 26, 2021

Minor release: disable synchronization on demo.oceannetworks.ca

Tickets Released: Oceans 2.0: 21.02.007 (accessible to internal users only). Total: 1.

March 24, 2021

Minor release: bugfix for SeaTube taxon selection

Tickets Released: Oceans 2.0: 21.02.006 (accessible to internal users only). Total: 1.

March 19, 2021

Minor release: bugfix for SeaTube synchronization

Tickets Released: Oceans 2.0: 21.02.005 (accessible to internal users only). Total: 1.

March 18, 2021

Minor release: bugfix for SeaTube null value attributes in annotations

Tickets Released: Oceans 2.0: 21.02.004 (accessible to internal users only). Total: 1.

March 17, 2021

Minor release: SeaTube dive logging features for upcoming maintenance expedition

Tickets Released: Oceans 2.0: 21.02.003 (accessible to internal users only). Total: 22.

Bug

  • [DMAS-57675] - bug on device port editing interface for the in/out direction
  • [DMAS-57890] - Changing taxonomy should wipe out the selected taxon
  • [DMAS-57938] - Unable to Edit an annotation when it contains an attribute with "Select" values
  • [DMAS-57968] - Password field in Task Management not displaying values
  • [DMAS-57973] - Attempting to delete an "empty" taxon button freezes the page
  • [DMAS-57986] - TaxonButtonSetConfig page is mostly blank
  • [DMAS-57991] - IP link broken in DeviceConsole in QA/PROD
  • [DMAS-57994] - Button Set cloning isn't working
  • [DMAS-58012] - Error when closing annotations
  • [DMAS-58017] - tx_taxonomymatrixattribute_trx is empty
  • [DMAS-58029] - Job 341 Not Creating JIRA Tickets
  • [DMAS-58056] - QA: Attribute and group information blank

Task

  • [DMAS-57636] - Excluded matrix attribute displayed as local if not inherited
  • [DMAS-58004] - Set Resource Type and Resource to default after save an annotation
  • [DMAS-58023] - Validate a TTC when saving an annotation in the backend
  • [DMAS-58078] - Clean up extras in database from duplicate script run

Implementation

  • [DMAS-57206] - Batch Monitoring Page - Modify Add Batch function
  • [DMAS-57852] - Improve how TaxonomyAttributeLineService's get() method handles the operation parameter
  • [DMAS-57871] - Include the id in the response of the create method for TaxonomyAttributeService
  • [DMAS-57985] - Front-end changes for taxon button set deletion
  • [DMAS-58006] - Have TaxonomyAttributeService return groupId instead of groupName
  • [DMAS-58014] - Update Taxon Attribute Management page to use changed groupId parameter

March 15, 2021

Minor release: Driver and calibration features

Tickets Released: Oceans 2.0: 21.02.002 (accessible to internal users only). Total: 5.

User Story

  • [DMAS-20667] - As a scientist, I would like to have compass data acquired from Kongsberg Rotary sonars

Implementation

  • [DMAS-28469] - Driver for ASL Acoustic Scintillation Device
  • [DMAS-57981] - Implement additional binary parsing features in declarative parser.
  • [DMAS-57990] - Switch the heading tuple to magnetic heading
  • [DMAS-58005] - Modify ASL MUD driver to turn off verbose mode on driver start

March 10, 2021

Minor release: SeaTube features and various fixes

Tickets Released: Oceans 2.0: 21.02.001 (accessible to internal users only). Total: 20.

Bug

  • [DMAS-57864] - In Taxonomy UI, selecting the root taxonomy causes screen to go blank
  • [DMAS-57866] - Equipment Requirements attribute not selectable
  • [DMAS-57924] - Special attributes are in the wrong places while using the quick button
  • [DMAS-57930] - The attribute detail widget should be empty if a new group is created.
  • [DMAS-57954] - Since deployment 2021-03-04, eewshore1 will not send metrics

Task

  • [DMAS-57342] - Parse the Kongsberg SMB headings tuple
  • [DMAS-57923] - Need more data type while create a taxonomy attribute.

Implementation

  • [DMAS-57939] - Update foreign keys
  • [DMAS-57940] - Back-end changes to support taxonomy delete functionality
  • [DMAS-57941] - Back-end changes to support taxon button set delete functionality
  • [DMAS-57978] - get SitePosition from database only when cacheloading

Bug (ST)

  • [DMAS-57634] - Editable inherited comment attribute always saves on focus loss
  • [DMAS-57947] - Logging in redirects to /domain/Apps/theme/colors.css instead of the home page
  • [DMAS-57949] - Can't create issues from the new issue collector when not logged in
  • [DMAS-57957] - Not getting good compass heading values in new SMB files

March 4, 2021

Major release

Maintenance and Production Developer

  • Bug fixes including QAQC reprocessing, QAQC inheritance
  • ONC website support
  • Migration of several pages/UI to modern REACT framework (DeviceAction, new page Cables) (on-going)
  • Several other small improvements/features (in-progress)

Instruments

  • Wally - driver modified to match devices telemetry change in motor logging
  • Rayfin - take picture function in seascript now available
  • Straw - new status commands added, refinements to parsing.
  • Pro Oceanus - Burst mode enhanced to be more reliable
  • Seabird CTD with O2 piggyback - Driver enhanced to handle piggyback problems better
  • RBR Concerto Tilt Meter - Additional start up setting
  • BPR - Driver now support binary mode
  • AIS Source bug resolved
  • New syntax in calibration formulas where sensors can be referenced by sensor code and device attributes can be referenced by attribute code, instead of by sensorid and attributeid
  • New screen for uploading PAMguard configuration files
  • PAMguard batches are automatically scheduled, system will limit the number of concurrent PAMguard tasks

Earthquake Early Warning

  • jep refactored as a separate bundle. This is an optimization for EEW deployments and moves us closer to exposing the jep code publicly
  • Shore station - device being processed can be viewed through jconsole. Allows for quicker troubleshooting when the shore station is blocked
  • Improvements to PGD algorithm
  • Shore station threading and cache load issues

Data Products

  • Search automation improvements (in-progress)
  • Added ancillary data to RDI netCDF plus improvements
  • Kongsberg compass support
  • Support for ASL mud variant + overall AZFP improvements

Data Player

  • Fixed misalignment between image and timeline
  • Add more instruments to selection dropdown
  • Testing Matlab as a service (in-progress)

Community Fishers

  • ALM-6 with AMLx formatting
  • Help button with wiki links in Geospatial Map
  • Now able to save data off tablet to Google drive
  • Geospatial Map now uses Open Street Map tiles as default
  • Updated data search to handle multiple casts for .COR file data product
  • Multiple minor changes to Android Tablet App

SeaTubeV3

  • support adding multi attributes in a single quick button, Taxonomy Attribute Management page.
  • NOAA help desk rewrites in React and adding auto fill for names/email and organization information
  • Bug fixes

Dashboards

  • permissions:
    • don't allow display of dashboard using a URL if don't have permission
    • only allow access to Dashboards if logged in
    • only allow access to embed if logged in
  • only auto-refresh if tab is active, only refresh every 30s
  • fix issue with playing video play lists

API & CIOOS

  • adcpdata service - add getByLocation
  • scalardata service - check for resample period
  • archivefiles service - support download of compressed
  • CIOOS support: bug fixes, documentation, refactoring

Tickets Released: Oceans 2.0: 21.02.000 (accessible to internal users only). Total: 132.

Bug
[DMAS-32109] - Step 2 of data search providing incorrect link to IRIS.
[DMAS-38396] - Send Help Request from search results shows "undefined
[DMAS-46794] - DeviceActionForUI class has a misspelled variable (EnginneringListId)
[DMAS-48286] - Can't create a Device Action for Devices that aren't on the Observatory
[DMAS-56546] - Tests failing in UserReplication
[DMAS-57350] - QA hosts with DATACENTRE role become unresponsive after launching too many threads
[DMAS-57442] - sitedevices are not being saved
[DMAS-57533] - qaqcreprocess does not handle qaqc inheritance correctly
[DMAS-57610] - Fix failing UI tests in DataViewer
[DMAS-57619] - AML6 Cor dataproduct sometimes has turbidity column for cast in cor dataproduct
[DMAS-57631] - Prevent a dashboard from being viewed if the user has not been given permission
[DMAS-57644] - Using latest in Audio widget doesn't get the most recent file
[DMAS-57657] - CKAN data records link to DataSearch but the name suggests they link to ERDDAP
[DMAS-57671] - Permissions for data specialists editing device attributes not working
[DMAS-57672] - Error when starting a fitlet on the latest branch
[DMAS-57676] - update PGD and PD algorithms to use most recent displacement values
[DMAS-57697] - Some automatic cache reloads over JMS dont work
[DMAS-57725] - Search automation detected a change in header metadata for CSV products on the VPS - related to siteposition?
[DMAS-57727] - the device action table doesn't show all columns within the width of page if the comment is long and no scroll bar
[DMAS-57737] - BundleUtil Cannot Find DataEnrichmentCacheModule
[DMAS-57743] - AIS Source driver is not outputting anything
[DMAS-57760] - qaweb is unable to find sos.properties
[DMAS-57771] - Requests for dashboards 115 and 137 causing significant load on web server
[DMAS-57778] - Could not get french translation for device category description. Will not generate French abstract
[DMAS-57792] - Latest Readings Widget isn't using the correct sensor when using location source
[DMAS-57798] - Cast Scalar Profile Plot is unable to find cast location for device level searches
[DMAS-57811] - 404 error caused by references to qaqc in neptune_header_light.vm
[DMAS-57812] - Playlist data source in Video Widget does not select a playlist
[DMAS-57831] - Plot times on ADCP current plot do not align with timeline in dataviewer.
[DMAS-57834] - Error Running tests in onc-web
[DMAS-57836] - master branch of Oceans 2.0 build failed
[DMAS-57877] - I can't rename a customized taxon name
[DMAS-57880] - hydrophoneCalibration.txt file missing from FLAC search result
[DMAS-57881] - SystemConsole in QA with release/21.02.000 is broken
[DMAS-57885] - Unable to create new searches with DataSearch.
[DMAS-57886] - Bug causing DiveServlet not to load properly
[DMAS-57894] - Fix TypeError when adding a Properties by Location data product to cart
[DMAS-57898] - error saving ServiceLogState on qa web
[DMAS-57899] - clicking either of the root nodes on the tree in Taxonomy crashes page
[DMAS-57901] - Fix Create.instrumentsByCategory failure
[DMAS-57913] - Task reference name is unknown until finishing and cant cancel running task
[DMAS-57921] - Map is not loading in QA data search. Also, card pop out when selecting a device is not occurring.
[DMAS-57922] - Can't delete attribute and attribute group in Taxonomy Attribute management page
User Story
[DMAS-45728] - Passwords can be read using inspect element in Task Management
[DMAS-56773] - As a dev, I would like to see qaqc auto tests finder page rewritten in react
[DMAS-56775] - As a dev, I would like to see qaqc auto test details page rewritten in react
[DMAS-56889] - As a Data Search user, I would like to be able to cancel any running of my running or pending searches
[DMAS-57230] - As a software developer, I'd like the /DeviceStatus page updated to React
[DMAS-57379] - Cloning a device also clones the serial number of the sensors in the additional attributes tab
Task
[DMAS-52454] - Search Automation failing comparison on new .cor files: add to text comparator and skip 'ProcessingDate'
[DMAS-56007] - New driver attribute for Nanometrics titan (350) and tiltmeter (430) for controlling sample rate
[DMAS-57116] - Add DOI Attributes to ERDDAP records through dataset.xml
[DMAS-57400] - Update UI tests for /FileUpload
[DMAS-57449] - Make "Data Availability" title look the same as the other config titles
[DMAS-57456] - simplify PPP calibration formulas
[DMAS-57459] - Add UI component tests for the DataAvailabilityChart
[DMAS-57512] - Add ancillary data to RDI netCDF data product- correlation, error, percent good
[DMAS-57543] - Change DatasetAttributeService from using hard coded versions of the organization statement abstracts and move them to GlobalProperties
[DMAS-57630] - Only allow Embed Dashboard and Widget when user signed in
[DMAS-57698] - As a Task Management user, I would like the windows for the job parameters to be expandable
[DMAS-57738] - Update kalman filter to use the accelerometer's sample rate attribute
[DMAS-57739] - Correct code for creating default values of "Expected search failures" field in search automation configuration
[DMAS-57751] - change the default sorting of the Cruise Listing to be reverse datefrom chronologically
[DMAS-57766] - As ONC who doesn't have anonymous API access I want to ensure only logged in users can access Dashboards management and dashboard pages
[DMAS-57789] - Write FTP Job to Transfer androidlog files from FTP directory to ArchiverlowPriority
[DMAS-57844] - new item "System Status" on dmas menu
[DMAS-57849] - Change 'No Data' to 'No Records Found' for React Tables
Requirement
[DMAS-57223] - Gather requirements
[DMAS-57327] - Document general requirements for Java 9+ support
[DMAS-57402] - Document requirements
Design
[DMAS-57224] - Design the system for associating a set of bundles to a DMAS host
[DMAS-57477] - Design the new support request UI
[DMAS-57816] - Need a story book mock up
Implementation
[DMAS-28469] - Driver for ASL Acoustic Scintillation Device
[DMAS-43988] - Move the web layer to a new bundle
[DMAS-56280] - Add a new react page for user defined classifiers in PAMGuard
[DMAS-56860] - Write QAQC Finder front end in React
[DMAS-56914] - Update QAQC Finder back end for updating to React
[DMAS-57015] - Write QAQC Details front end in React
[DMAS-57016] - Update QAQC Details back end for updating to React
[DMAS-57024] - Automatic scheduling of Pamguard batch jobs
[DMAS-57100] - When a user cancels a search they should be linked to the data search help page
[DMAS-57240] - Extract JepCache into its own OSGi bundle
[DMAS-57258] - Update services for use with react page of DeviceListing
[DMAS-57259] - Write new React page for /DeviceListing
[DMAS-57310] - Create Help button in Geospatial Map
[DMAS-57347] - Do compass check in kongsberg rotary SCAN mode
[DMAS-57348] - Use the compass data in the SMB post-processor heading calculation
[DMAS-57403] - Use an alternate issue collector in Dev/QA
[DMAS-57436] - Update backend for /DeviceStatus
[DMAS-57439] - Support both Java 8 and 11 in UI tests
[DMAS-57447] - Add AvailabilityChart cypress test
[DMAS-57470] - Update ui tests for /DeviceStatus
[DMAS-57508] - Create an issue collector form
[DMAS-57510] - Update backend for DeviceSearch
[DMAS-57511] - Write new react page for DeviceSearch
[DMAS-57528] - Update selenium scripts for QAQC Details change to React
[DMAS-57535] - Add functionality to getByDevice
[DMAS-57536] - Add functionality to getByLocation
[DMAS-57544] - Creating database scripts
[DMAS-57572] - Update UI tests for DeviceSearch
[DMAS-57623] - Update TaxonButtonSetService to handle multiple attributes for a single button
[DMAS-57637] - Modify archiveFile service to accept compression parameter for accessing compressed files
[DMAS-57654] - Update new Taxon Button Set Config and Manual Entry pages to handle service call changes
[DMAS-57682] - Create page in the front end for Taxonomy Attribute Management
[DMAS-57688] - Add getByLocation method
[DMAS-57696] - Change DeviceCloner code to not clone sensorattribute values
[DMAS-57700] - Add unimplemented CRUD operations to TaxonomyAttributeService
[DMAS-57701] - Add method to get list of devices at a location with date ranges
[DMAS-57702] - Create a taxonomy attribute group service
[DMAS-57741] - Create a taxonomy attribute line service
[DMAS-57752] - implement react code
[DMAS-57755] - Increase Equinox's framework start level
[DMAS-57765] - Update ui tests
[DMAS-57773] - Add french and english organization statements for abstract to database
[DMAS-57774] - Change code to use config property organization statement in creating Dataset object
[DMAS-57794] - rollback java code to recover those two columns
[DMAS-57810] - Refactor camera take picture driver file transfer
[DMAS-57825] - Display all devices in the title and e-mail subject
[DMAS-57826] - code change to make Cruise Listing be reverse datefrom chronologically sorted by default
[DMAS-57854] - Update text following demo meeting
[DMAS-57912] - Add page to the SeaTube menu in the navigation
[DMAS-57914] - Add Attribute Management page to entry.jsx
[DMAS-57920] - Allow nullable attributes for ONC expedition loggers and data stewardship
Bug (ST)
[DMAS-57732] - Fix misspellings in the back end code
[DMAS-57733] - Fix misspellings in the React code
[DMAS-57740] - master branch with Revision: 0010036539 in Oceans 2.0 deploy failed in QA
[DMAS-57749] - No web pages are visible after qaweb2 finishes starting
[DMAS-57772] - Any logged-in user can access TaxonomyMatrixAttributeService's POST operations
[DMAS-57904] - Some OceanNext features are not working in QA
Documentation
[DMAS-57329] - Update development environment installation documentation

February 17, 2021

Minor release: FLAC file transfer support, SeaTube and Community Fishers improvements.

Tickets Released: Oceans 2.0: 21.01.003(accessible to internal users only). Total: 17.

Bug

  • [DMAS-57683] - Currently selected button getting reset when being updated in TaxonButtonSetConfig
  • [DMAS-57699] - Cannot add device actions to 2 Lufft Met station devices, receiving error
  • [DMAS-57711] - Exception ocurred executing query FROM TaxonomyAttributeLineState ca.uvic.dmas.core.datastorage.DAOException: executeHQL: TaxonomyAttributeLineState
  • [DMAS-57712] - DMAS Search Failed Notification: 10-Feb-2021 11:15:08 UTC, Satlantic Downwelling Radiometer HOCR-ICSW (SN 301), Satlantic Radiometer Time Series, SearchHdrId 7878873, UserId 15223
  • [DMAS-57722] - Blank buttons are being added to the DB from the Taxon Button Set Config page
  • [DMAS-57729] - Taxonomy dropdown should be alphabetized
  • [DMAS-57750] - Handle unequal number of samples per sensor on AML6
  • [DMAS-57759] - Cast Ingestion Job Assigning SiteDeviceSubset to wrong SiteDevice

Task

  • [DMAS-56848] - Attribution should be given to data owners on geospatial map data products
  • [DMAS-57579] - Make Open Street map the default tile set for the CF Geospatial Map
  • [DMAS-57648] - Add or modify a job to move hydrophone FLAC files into the file archiver directory
  • [DMAS-57684] - JMX Bean to show current ddm being processed
  • [DMAS-57728] - Display and allow the user to click empty buttons in TaxonButtonSetConfigNew
  • [DMAS-57736] - Add a permanent directory for the hydrophone compression job and update its regex

Implementation

  • [DMAS-57662] - Database changes for new group table
  • [DMAS-57663] - Back-end changes for new group table

Bug (ST)

  • [DMAS-57717] - Manual entry's attribute toggle was not enabled upon TTC selection

February 8, 2021

Minor release: SeaTube features

Tickets Released: Oceans 2.0: 21.01.002 (accessible to internal users only). Total: 20.

Bug

  • [DMAS-51949] - Sea-Bird CTD O2 piggyback drivers often disconnect. Current issue at Baynes Sound
  • [DMAS-57625] - Cannot see formula in QAQC Auto Test Details page
  • [DMAS-57647] - QAQCEvaluatorTest failing in Jenkins
  • [DMAS-57667] - Taxon autocomplete displays error snackbar and does not load the taxon list in the new ButtonSetConfig
  • [DMAS-57673] - Quick taxon button doesn't trigger attributes even there are default attributes for that taxon
  • [DMAS-57677] - Button Set List isn't updating the ButtonSet data until a page refresh occurs

User Story

  • [DMAS-44282] - As an ONC Dive Logger I would like to add default (permanent) attributes to Taxons

Task

  • [DMAS-57633] - Add servlet for new TaxonButtonSetConfig page
  • [DMAS-57641] - Handle location searches with multiple casts and multiple devices better for Cor dataproduct
  • [DMAS-57670] - Convert ButtonSet to use the material ui ButtonGroup

Implementation

  • [DMAS-57406] - Taxon attribute database changes
  • [DMAS-57413] - Update front-end to support default attributes
  • [DMAS-57441] - Add taxonomy entries, change taxonomymatrix roots' parents to their taxonomy
  • [DMAS-57617] - Write script to update constraint on taxonbuttonsetline table
  • [DMAS-57635] - Update ManualEntry logic for newly-determined resource-related attribute values
  • [DMAS-57640] - Straw drivers - query various states periodically
  • [DMAS-57649] - Add values for Select datatype resource attributes to database

Bug (ST)

  • [DMAS-57639] - Deleting an ancestor matrix with an attributed descendant results in an orphan
  • [DMAS-57660] - Driver changes for Pro-Oceanus Pro-CV burst mode do not support driver-initiated re-zeroings
  • [DMAS-57664] - NPE when a taxonomy exists without a taxonomy matrix representation

February 5 2021

Citizen Scientist Android version CF.3.2.5 for Community Fishers Project

Bug

  • [DMAS-57650] - No Tank Data from AML6 DI: 53240 (S/N A60009)

Task

  • [DMAS-57665] - Release Community Fisher App Version 3.2.5


February 2, 2021

Minor release: driver logging improvement

Tickets Released: Oceans 2.0: 21.01.001 (accessible to internal users only). Total: 1.

Task

  • [DMAS-57615] - Modify driver to filter out redundant motor log values

February 1, 2021

Major release

Maintenance and Production Developer

  • Bug fixes including siteposition cache, live instrument testing
  • Migration of several pages/UI to modern REACT framework (QAQC AutoTest, DeviceListing) (on-going)
  • QAQC reprocessing tool

Instruments & EEW

  • Driver/parser maintenance issues (STRAW, BPR)
  • Kongsberg imaging rotary sonar SMB postprocessor support for compass
  • PAMGuard Phase 2 (in-progress)
  • DAF multiqueue design
  • Modularization (OSGi-ification): support for customized builds (in-progress)

Data Products

  • Fixes for RDI ADCPs in high tilt deployments
  • FLAC as source for hydrophones
  • CODAR bug fix
  • Automated testing improvements

Data Player

  • MATLAB as a service ready for testing, not deployed (in-progress)

Community Fishers

  • bug fixes for cast pipeline and geospatial maps
  • AML-6 Integration with Oceans 2.0 (new AMLX parser)
  • Implemented QAQC flags for EDS data

SeaTubeV3

  • Attributes for taxonomy and taxons
  • Help desk

Dashboards, API & CIOOS

  • Fixing up Dashboard issues (Plotting Utility, Firefox, single file and time-lapse video)
  • API improvements (design phase, in-progress)
  • CIOOS support: bug fixes with the XML, ERDDAP work with combining DOIs and links to CKAN, data partner attributions

Tickets Released: Oceans 2.0: 21.01.000 (accessible to internal users only). Total: 100.

Bug

  • [DMAS-36280] - QAQC Auto Test Finder Page - Find button doesn't show no result found
  • [DMAS-56570] - Automatic cache reload requests are getting sent to too many JVMs
  • [DMAS-56578] - Correct failing ui test - AnnotationsTest
  • [DMAS-57058] - Oceans 2 menu bar doesn't display correctly when there is a plot widget
  • [DMAS-57070] - parser of devicetypeid 901 need be revisited
  • [DMAS-57090] - SitePosition cache issue caused pashore1 parsing messages slowly, falling behind
  • [DMAS-57104] - L22 vocabulary term metadata missing from CKAN ISO 19115 record
  • [DMAS-57213] - New widgets are hidden on fullscreen dashboard
  • [DMAS-57245] - Job 366 is pushing metadata for inactive ERDDAP datasets to CKAN server
  • [DMAS-57297] - Data availability different between audio config and selector
  • [DMAS-57362] - Unit tests are failing in Oceans 2 master branch
  • [DMAS-57376] - Previously duplicated sitedevicesubset found after DB refresh
  • [DMAS-57380] - Fix failing UI test in CloneDevice
  • [DMAS-57395] - Fix failing test in dataPreviewGeneration
  • [DMAS-57415] - The datacite abstract is adding unwanted French content to the end of the abtract
  • [DMAS-57418] - CKAN ISO 19115 records not downloading
  • [DMAS-57422] - DevicePort Maintenance page has an error when trying to get newly added port
  • [DMAS-57465] - Link from siteDevice page to ERDDAP record is broken
  • [DMAS-57472] - Error occurred trying to reprocess qaqc results on dateRange DateRange [Mon Jan 14 00:00:00 UTC 2019 to Tue Jan 15 00:00:00 UTC 2019] for deviceId506
  • [DMAS-57480] - memory leaking from qaqcreprocess job
  • [DMAS-57491] - DMAS Search Failed Notification: 19-Jan-2021 19:47:19 UTC, Hecate Strait-Hecate Strait CODAR System, CODAR Quality Controlled Surface Currents, SearchHdrId 7806433, UserId 48690
  • [DMAS-57524] - Latest readings showing invalid simple dates in Firefox
  • [DMAS-57531] - master branch of Oceans 2.0 build failed in qamon
  • [DMAS-57551] - Time lapse video not playing using continuous player
  • [DMAS-57560] - DMAS Search Failed Notification: 24-Jan-2021 12:30:27 UTC, Patricia Bay-Saanich Inlet VENUS Instrument Platform, Time Series Scalar Plot, SearchHdrId 7817881, UserId 40000
  • [DMAS-57581] - Failed to load SitePositionjava.lang.RuntimeException: Couldn't build site position cache
  • [DMAS-57583] - Data Availability no longer showing Video widget when device is selected
  • [DMAS-57584] - Fix Environment.js getStaticResourcePath() method's regex
  • [DMAS-57587] - Cast Correction Matlab Script Failing on AML-6 Data
  • [DMAS-57598] - Unable to edit batch tasks
  • [DMAS-57607] - Community Fishers CDOM sensor processing is outputting non median filtered data

User Story

  • [DMAS-23848] - As a scientist, I would like data acquisition for the ASL Acoustic Scintillation device
  • [DMAS-37130] - As a data steward, I would like the data team to have UI where they can delete qaqcresults
  • [DMAS-56396] - As a Citizen Scientist, I would like the Community Fishers app and data acquisition system extended to support the new AML-6 instrument
  • [DMAS-57233] - As a software developer, I'd like the /FileUpload page updated to React
  • [DMAS-57345] - As an RDI ADCP data user I would like the Cassandra data to default to no bin-mapping when the instrument tilt exceeds 20 degrees
  • [DMAS-57483] - Should updating JunctionBox Alarm settings for SCUv2 (Baynes) reset the ports?

Task

  • [DMAS-48748] - As a third party, I would like to be properly attributed in ERDDAP datasets
  • [DMAS-56661] - Fix Dataset Landing Pages Abstract hardcoding
  • [DMAS-56699] - Update auto UI test on calibration page for feature implemented in DMAS-56140
  • [DMAS-57113] - Update auto UI test on JB alram page for new feature added in DMAS-56971
  • [DMAS-57196] - Update UI tests for changes made to physical characteristic tab ui
  • [DMAS-57298] - When the data availability is shown is inconsistent between configs
  • [DMAS-57339] - Implement QAQC flags for CF Aligned and depth-binned sensor data
  • [DMAS-57360] - NRCAN BPR 21501 output changed to binary format -needs driver and parser development
  • [DMAS-57378] - Automate testing of dive CSV export
  • [DMAS-57394] - scripts to update password in QA and DEV affected by DMAS-56408
  • [DMAS-57409] - public wiki documentation is needed for dataproductid 183 introduced for Community Fishers androids
  • [DMAS-57410] - make minor fixes to forms for edit device details pages rewritten in react
  • [DMAS-57411] - Change quarantine column background color on Device Console page
  • [DMAS-57424] - Add label prop to data source and change chart widget config DS labels
  • [DMAS-57448] - Move TaxonButtonSetConfig into Oceans Next
  • [DMAS-57517] - Create Aligned and Depth Binned Navigation data even if insufficient raw data present to interpolate
  • [DMAS-57547] - add camera of devicetype 373 in the dropdown list of cameras in dmas menu
  • [DMAS-57549] - AMLx parser validator rejects 'rogue' data lines
  • [DMAS-57552] - Switch service used by Video widget when source is Device to archivefiles
  • [DMAS-57575] - Add new Qaqc Id for use with community fishers EDS data
  • [DMAS-57585] - change minimum port from 4 to 1 on JB viewer for mini JB devices
  • [DMAS-57596] - Fixing failing UI tests in DataPreview.GenreationAndDisplay
  • [DMAS-57604] - Remove Data Player from widgets menu

Requirement

  • [DMAS-57210] - Write requirement for one-letter search auto-completions on User Defined Taxonomies

Implementation

  • [DMAS-14611] - Kongsberg Driver - Add Support for Compass
  • [DMAS-17210] - In the FileUpload page allow more space to display the entire filename
  • [DMAS-30667] - As as File Upload user, make it clear that the page only accepts .an files
  • [DMAS-56804] - Add UI tests for Sandbox widget
  • [DMAS-56983] - Code Implementation for qaqcresult Deletion Job
  • [DMAS-57180] - Create SQL Scripts for QAQC Deletion Job
  • [DMAS-57353] - Write new React page for /FileUpload
  • [DMAS-57354] - Update backend for /FileUpload
  • [DMAS-57355] - extend declarative parser capabilities to converter type of output strings
  • [DMAS-57368] - Update UI Testing builds to fail on static analysis failure
  • [DMAS-57386] - dmas.log include raw data?
  • [DMAS-57407] - Add service, manager, assembler, and state for TaxonomyMatrixAttribute
  • [DMAS-57430] - Add number of output arguments parameter to Matlab post process jobs
  • [DMAS-57431] - Implement code change for background color of quarantine column on Device Console page
  • [DMAS-57433] - Create domain object that does not extend TreeNodeUI
  • [DMAS-57435] - Write new React page for /DeviceStatus
  • [DMAS-57438] - Ensure cypress component testing ready to use in oceans next
  • [DMAS-57460] - Update taxonomy matrix parent logic for new parent representation
  • [DMAS-57471] - Fix compiler warnings exposed in Java 11
  • [DMAS-57478] - Update backend to add ERDDAP_URL in NeptuneVelocityServlet so it's accessible by React
  • [DMAS-57479] - Update Environment.js to get the correct Erddap URL
  • [DMAS-57482] - Create a TaxonomyMatrixAttribute cache
  • [DMAS-57487] - Add groupname to TaxonomyAttribute classes
  • [DMAS-57521] - Modify RDI matlab code to accept higher tilts and improve plot for high currents
  • [DMAS-57522] - Modify RDI java complex parser to accept higher tilts
  • [DMAS-57537] - Add and update TaxonomyMatrixAttributeService logic
  • [DMAS-57548] - Add TaxonomyMatrixAttribute synchronization logic
  • [DMAS-57557] - Update ADCP plotting options
  • [DMAS-57568] - Upgrade geckodriver to 0.29.0 for UI testing
  • [DMAS-57597] - Update ID for QAQC Results Deletion Job

Bug (ST)

  • [DMAS-57364] - Fix unit test failures in seatube
  • [DMAS-57365] - Fix unit test failures in scalar data
  • [DMAS-57414] - Fix test failures in quarantine and calibration
  • [DMAS-57417] - Verification failed with "bad array subscript"
  • [DMAS-57532] - Chart Widget data availability 'box select' reversing start/end dates in Firefox
  • [DMAS-57580] - Lidar sdaq status issue
  • [DMAS-57591] - Cache update does not remove old object
  • [DMAS-57593] - Assigning a regular matrix attribute does not delete from descendants

Documentation

  • [DMAS-56984] - Documentation for qaqcresult Deletion Job

January 29, 2021

Citizen Scientist Android version CF.3.2.4 for Community Fishers Project

Bug

  • [DMAS-57467] - Unexpected AML-6 data causes 'View Data' to crash in app
  • [DMAS-57530] - As a user of the CF app, I would like the data download UI to timeout if there is an error

Task

  • [DMAS-57582] - Increase ActiveMQ Timeout in Community Fisher App
  • [DMAS-57595] - Release Community Fisher App Version CF.3.2.4

January 20, 2021

Citizen Scientist Android version CF.3.2.3 for Community Fishers Project

Bug

Task

January 19, 2020

Minor release: Pro-Oceanus driver bug fix

Tickets Released: Oceans 2.0: 20.12.001 (accessible to internal users only). Total: 1.

Bug

  • [DMAS-57445] - The Pro-Oceanus on SCUv2 #8 has faulted (over current) and there have been no alerts.

January 15, 2021

Citizen Scientist Android version CF.3.2.2 for Community Fishers Project

Bug

  • [DMAS-57408] - Community Fisher App not downloading data off of instruments

Task

Implementation

  • [DMAS-56747] - Modify AML-6 Driver to use AMLx Format

January 7, 2021

Major release

Maintenance and Production Developer

  • Bug fixes
  • Sensor-level data ratings applied to CSV/JSON data products
  • Encrypted password deviceattribute in database and raw file
  • Migration of several pages/UI to modern REACT framework (more tabs on device details pages converted) (on-going)

Earthquake Early Warning (EEW) Commissioning:

  • project initiation, requirements gathering and planning (in-progress)
  • Modularization (OSGi-ification): support for customized builds (in-progress)

Instruments

  • Driver maintenance issues
  • Acoustic scintillations driver (in-progress)
  • Kongsberg imaging rotary sonar driver now queries for compass heading
  • Support for getting files from a device with low-latency (in-progress)

Data Products

  • Bug fixes, particularly issues around piggyback devices

Data Player

  • MATLAB as a service (in-progress)
  • Small change to device selection component
  • Bioacoustic annotations (in-progress)

Community Fishers

  • bug fixes for cast pipeline and geospatial maps
  • Android app: improve reliability for bluetooth (app updates will now have their own releases)

SeaTubeV3

  • Broad search now supporting organizations
  • One character autocomplete for taxons in user-defined taxonomies

Dashboards - CANARIE

  • Project completion: most features release in December minor releases
  • Dashboards in More menu in Oceans 2.0
  • Can unzip products from User Defined tasks

API & CIOOS

  • API project initiation
  • CIOOS API support

Tickets Released: Oceans 2.0: 20.12.000 (accessible to internal users only). Total: 86.

Bug

  • [DMAS-56276] - The French support in CKAN doesn't seem to be working
  • [DMAS-56372] - password values for at least some devicetypes are showing in the log files
  • [DMAS-56545] - Tests failing in DeviceAttributes
  • [DMAS-56588] - Oceans 2.0 OSGi tests failed with unresolved bundles after "error in opening zip file"
  • [DMAS-56670] - fix bug in the algorithm used to get the publication year for DataCite metadata
  • [DMAS-56891] - Oceans 2 deployment fails with a cryptic error if /var/run/gemini.pid exists
  • [DMAS-57085] - Fix failing UI test in CloneDevice
  • [DMAS-57095] - CKAN ISO 19115 record missing data partner attributions
  • [DMAS-57097] - French Abstract missing from CKAN ISO 19115 record
  • [DMAS-57098] - Typo in CKAN ISO 19115 records
  • [DMAS-57123] - Fix failing UI tests in ExpeditionManagement
  • [DMAS-57124] - Fix failing UI tests in SeaTubeSearchTest
  • [DMAS-57171] - Dataplayer device does not clear after switching device category
  • [DMAS-57214] - Automatic merge failure in Oceans Next
  • [DMAS-57243] - DMAS Search Failed Notification: 10-Dec-2020 22:17:28 UTC, Nortek Aquadopp Profiler A3P9320 AQD14543, Nortek Time Series, SearchHdrId 6119519, UserId 27378
  • [DMAS-57272] - Fix failing test in geospatialMap
  • [DMAS-57280] - Fix issues with merge of release/20.11.000 into master
  • [DMAS-57305] - DMAS Search Failed Notification: 18-Dec-2020 04:32:35 UTC, Folger Passage-Folger Deep, Log File, SearchHdrId 6151449, UserId 2851
  • [DMAS-57314] - Text widget on dashboards allows text to go over its frame
  • [DMAS-57322] - UI test suite failed with "Error forwarding the new session Empty pool of VM for setup Capabilities" after crash
  • [DMAS-57325] - User defined tasks widget config missing a name attribute
  • [DMAS-57344] - Reset button not working for organizations in Broad Search
  • [DMAS-57356] - Catalina exceptions in CruiseVocabCacheLoader
  • [DMAS-57361] - Fix failing tests in DataPreviewManagement
  • [DMAS-57383] - Fix failing tests in GeospatialMap

User Story

  • [DMAS-34552] - As a user, I would like to Utilize Sensor-Level Data Ratings in CSV/JSON Data Products, Services and Apps
  • [DMAS-56968] - As a data steward, I would like a message to validate that the site device is being saved

Task

  • [DMAS-56187] - add selenium test for fullscreen dashboard
  • [DMAS-56408] - As a systemer, I would like to see database save values of device attribute "password" in some encrypted form
  • [DMAS-56473] - Add UI tests to Dashboards to test the edit functionality of the Data Source List
  • [DMAS-56829] - Update selenium scripts for code change on sensorcodename
  • [DMAS-56915] - As a data steward, I would like the drop-down list in the Add Task to Batch to be aphabetically listed
  • [DMAS-56970] - Update Device Action selenium tests
  • [DMAS-56981] - Improve unit test coverage on dashboard related tests
  • [DMAS-57003] - Make UI fixes and include RO field for Modify By and Modify Date on the Electrical Ratings Tab of DeviceListing
  • [DMAS-57055] - Fix errors in service calls for electrical rating service
  • [DMAS-57076] - Extract contents of data.tar without creating data subfolder
  • [DMAS-57117] - Update HoloSea code to use GainDecibels instead of Gain
  • [DMAS-57195] - Use different icon for Quarantine and Quick plot on DeviceConsole
  • [DMAS-57197] - Convert AnnotationSearchExecutionStrategy to an abstract class
  • [DMAS-57205] - Improve broad searching on organizations
  • [DMAS-57207] - Fix auto merge failure on 493836b715b
  • [DMAS-57209] - Please Transfer Dec-2-2020 and Dec-3-2020 T'Souke data to QA and reprocess
  • [DMAS-57265] - Investigate broad search performance improvements
  • [DMAS-57266] - As an outgoing Data Manager I would like senior members of the Data Team to have permission to close other people's annotations
  • [DMAS-57267] - Sort "Add Widget menu" on Dashboards alphabetically
  • [DMAS-57273] - Fix broken test in DeviceService test
  • [DMAS-57278] - Update UI tests in DataViewer
  • [DMAS-57302] - Add dropdown for organizations to Broad Search
  • [DMAS-57308] - Update JEP calibration formula needed to correct Rinko Oxygen calibration data from Pacific Salmon Foundation RBR/Rinko instrument sets
  • [DMAS-57315] - Refactor getpiggybackdevicesensor, to use piggyback flags in deviceport table
  • [DMAS-57318] - Remove character limit for searchtreenodename
  • [DMAS-57320] - ERROR on ZapParser
  • [DMAS-57346] - Add Dashboards to menu

Design

  • [DMAS-57256] - CSV data product header and content

Implementation

  • [DMAS-55271] - Implementation of sensor level DataRating in Java gap filling
  • [DMAS-56993] - Update backend for Procurement tab
  • [DMAS-56994] - Write new React Page for Procurement tab
  • [DMAS-56995] - Update selenium scripts for Procurement
  • [DMAS-57011] - Add ui testing to check for info bars when site device being saved or deleted
  • [DMAS-57040] - Update backend for nameplate tab
  • [DMAS-57041] - Write new react page for Nameplate tab
  • [DMAS-57048] - Write new React page for Nameplate maintenance
  • [DMAS-57049] - update backend for Nameplate Maintenance
  • [DMAS-57119] - Update ui tests for Nameplate tab
  • [DMAS-57139] - Update backend for IP tab
  • [DMAS-57140] - Write new react page for IP tab
  • [DMAS-57141] - Update UI tests for IP tab
  • [DMAS-57146] - extract DmasServiceManagerImpl to its own bundle
  • [DMAS-57147] - Write new React page for Ip maintenance
  • [DMAS-57148] - Update backend for Ip maintenance
  • [DMAS-57158] - create a version of the DmasServiceManager to be used by the correlator
  • [DMAS-57181] - Add Still Camera Methods to CameraSystemDevice
  • [DMAS-57191] - Code Change for Alphabetizing Add Task to Batch Dropdown
  • [DMAS-57212] - Refactor frontend to allow one-character taxon autocompletes for user-defined taxonomies
  • [DMAS-57222] - Refactor button set config to also use one-character autocompletes
  • [DMAS-57251] - Create a new role "CORRELATOR" for EEW correlators
  • [DMAS-57264] - Convert jep-2.4.0.jar to an OSGi bundle, if possible
  • [DMAS-57281] - Allow instance to be configured for each host separately
  • [DMAS-57299] - Update front end for changes made to service after removing UI class
  • [DMAS-57311] - Add support menu & wiki links to the geospatial map
  • [DMAS-57326] - Code change for new Quarantine icon
  • [DMAS-57393] - script to provide new passwords in prod

Bug (ST)

Documentation

  • [DMAS-57271] - Update internal documentation for CSV/JSON products for sensor level data ratings

January 6, 2021

Citizen Scientist Android version CF.3.2.1 for Community Fishers Project

User Story

  • [DMAS-23436] - As a Pacific Salmon Foundation person, I would like feedback on numbers of casts on tablet
  • [DMAS-37530] - As a citizen scientist, I would like to have the User Manual in citizen scientist app updated

Task

  • [DMAS-57382] - Release New Community Fisher App Version (3.2.1)

Implementation

  • [DMAS-57268] - Display number of files uploaded after files have been uploaded to Oceans 2.0, and add a progress bar
  • [DMAS-57269] - Display Files in descending order (for date) in 'View Data'
  • [DMAS-57294] - Update 'Help' Documentation in App
  • No labels