Skip to end of metadata
Go to start of metadata

This page contains the current year's release notes and new features, primarily for Oceans 2.0 / DMAS, as well as any applications created/maintained by the ONC software engineering group, including mobile Apps and desktop/PC applications. In progress project status may be presented as well.

Previous years:

The information below is written in plain language as much as possible. Detailed release notes are available on internal confluence pages (requires login).

October 9, 2020

Release for HydroCal, version HC.20.09.000 (HydroCal Change List)

  • Fixed bugs: fixed issues when switching modes, improved stability for HF digital hydrophones, improved sync pulse detection, improved ability to run multiple calibrations in a row, fixed crash on startup when no internet, handle reverse polarity data, improved default settings and more.
  • New user interface for configuring source drive amplitude by frequency, includes plot, edit, add, delete, export to and load from file
  • Support for comments in settings ini file
  • Improved main user interface metadata and sensitivity tables interactions and sizing, particularly for small screens
  • Testing and documentation improvements, file-naming improvements

October 7, 2020

Minor release: Rayfin Camera driver, bug fixes: QAQC archiving, PAMguard, site UI, cast plot.

Tickets Released: Oceans 2.0: 20.09.001 (accessible to internal users only). Total: 5.

 Click here to expand...

Bug

  • [DMAS-56561] - PAMGuard job generating a lot of ERRORs
  • [DMAS-56590] - cast profile plot has repeated cast type in filename
  • [DMAS-56596] - Archiver error in prod with 20.09.000

Implementation

  • [DMAS-55714] - Driver for Rayfin camera system
  • [DMAS-56625] - Implement UI suggestions made to improve site tab

October 6, 2020

Major release

Maintenance and Production Developer

  • Bug fixes
  • CANARIE service performance improvements
  • QAQC improvements (in-progress): reprocess QAQC only, exclude some tests from inheritence, result overlap fix
  • Migration of several pages/UI to modern REACT framework (device details pages)

Instruments

  • PAMguard (automated acoustic detection of marine mammals) fixes and phase 2b (user configuration - in-progress). New classifier integrated.
  • Driver development in support of Fall maintenance expedition:
    • STRAW-b drivers and integration
    • Holyrood drivers
    • Wally

Data Player

  • bug fixes
  • annotations on the viewer (in-progress)
  • initial work on MATLAB as a service (in-progress)

Community Fishers

  • bug fixes for cast pipeline
  • support of new instruments in pipeline and app, edge cases

SeaTubeV3 - CANARIE & NOAA & ONC

  • CANARIE SeaTube project complete, on-time and on-scope
  • Performance improvement for fixed location cameras (in-progress)
  • Annotation search handles JSON, annotation export improvements
  • Bug fixes

Internal Process and Testing Improvements

  • Deploy individual branches for UI testing
  • Migrate SQL scripts to git/BitBucket + process improvement

Web Services / API

  • Requirement gathering

Dashboards - CANARIE

  • Usability improvements to UI and widgets - make everything work better
  • Plotting Utility alternative using Plot.ly (in-progress)

CIOOS Pacific / ERDDAP

  • Email notification issues in ERDDAP
  • Open-sourcing / artifact support (in-progress)

Tickets Released: Oceans 2.0: 20.09.000 (accessible to internal users only). Total: 138.

 Click here to expand...

Bug

  • [DMAS-51494] - Device Workflow Admin - Inaccessible elements in Set Process list.
  • [DMAS-54295] - QA (and now PROD) erddap keeps producing errors
  • [DMAS-54372] - Fix broken tests in setup of DataSetLandingPage
  • [DMAS-55738] - Investigate gaps occurring every ~2.5h in external pH (dynamic salinity) sensors
  • [DMAS-55776] - Investigate slow hydrophone jobs in PROD
  • [DMAS-56031] - 105 error sometimes when removing attributions displayed on UI on the attribution management Section of Network Console page
  • [DMAS-56216] - DMAS Search Failed Notification: 27-Aug-2020 01:37:53 UTC, Barkley Canyon-Barkley Node, Hydrophone Spectral Data, SearchHdrId 5653434, UserId 47020
  • [DMAS-56226] - fix FileManagement broken tests
  • [DMAS-56228] - fix TranslationFileService.verifyHeaders()
  • [DMAS-56230] - Fix failing tests in DataSearch
  • [DMAS-56262] - Fix latest data reading widget null handling
  • [DMAS-56292] - Fix failing tests in PlottingUtility
  • [DMAS-56299] - Fix failing test in website.general.General
  • [DMAS-56327] - Audio Widget fails to load data when using the Device Selector
  • [DMAS-56335] - Fullscreen icon doesn't show on a new dashboard
  • [DMAS-56339] - Scrollbar showing in full screen when it shouldn't
  • [DMAS-56347] - Fix failing tests in geospatialMap
  • [DMAS-56365] - Data product 56 is plotting with dots and dashes instead of dots for aligned and depth binned data
  • [DMAS-56369] - Incorrect flagging of pressure data from Community Fishers test cast
  • [DMAS-56370] - Fix failing test in FileManagement
  • [DMAS-56373] - ST V3 can't play videos in ONC 2019-09 expedition
  • [DMAS-56411] - DataCite Dataset 'Date Created' not populating correctly
  • [DMAS-56412] - Audio widget title not editable
  • [DMAS-56430] - DafTestWaitTest sometimes fails on master
  • [DMAS-56433] - TaskMessagePollerTest sometimes fails in CI
  • [DMAS-56444] - Interactive Plot Widget Config has the title "Configure Audio Player Widget"
  • [DMAS-56447] - FIx broken UI tests in systemMonitoring.SystemConsole
  • [DMAS-56449] - DMAS Search Failed Notification: 23-Sep-2020 16:55:50 UTC, Victoria Harbour-CF0132 (GVHA1), Cast Scalar Profile Plot and Data, SearchHdrId 5772178, UserId 94330
  • [DMAS-56458] - Data products of the two piggyback sensors of Sea-Bird SeaCAT SBE19plus V2 7792 is not populated into the piggyback unit data search pages ( by instrument category)
  • [DMAS-56470] - Fix missing parameter on SiteDevice page
  • [DMAS-56489] - issue when merge database script
  • [DMAS-56495] - DMAS Search Failed Notification: 29-Sep-2020 18:10:58 UTC, Barkley Canyon-Barkley Canyon Mid-West, RDI ADCP Time Series, SearchHdrId 5783558, UserId 92670
  • [DMAS-56498] - DMAS Search Failed Notification: 29-Sep-2020 21:03:47 UTC, Strait of Georgia-CF0031, Aligned and Depth-Binned Profile Data (On-Demand), SearchHdrId 5783654, UserId 15356
  • [DMAS-56501] - DMAS Search Failed Notification: 30-Sep-2020 16:30:14 UTC, Ocean Sonics icListen HF Hydrophone 6016, Spectrogram For Hydrophone Viewer, SearchHdrId 5784568, UserId 2420
  • [DMAS-56516] - DMAS Search Failed Notification: 30-Sep-2020 21:41:13 UTC, XSlate D10 Tablet (S/N SY6560DR00042), Aligned and Depth-Binned Profile Data (On-Demand), SearchHdrId 5785053, UserId 94330
  • [DMAS-56519] - Fix failing test in DataViewer
  • [DMAS-56528] - UI Testing CI only runs compileTestJava when running spotbugs etc.
  • [DMAS-56540] - Handle MetaData length greater than 1 in cor dataproduct
  • [DMAS-56543] - Device listing site tab has incorrect link to site page
  • [DMAS-56544] - Fix failing UI tests in PlottingUtility
  • [DMAS-56549] - Fix automation test failures for Cast Scalar Profile Plot and Data
  • [DMAS-56556] - GeographicInformation addDevice fails
  • [DMAS-56563] - Increase time used to compare dataviewer searches for daily or five min spectrograms
  • [DMAS-56565] - Fix timezone issues with plot requests in Dataviewer
  • [DMAS-56568] - if archived spectrograms do not exist for default options and dataproduct delivery calls were made, call download method of dataproductdelivery
  • [DMAS-56595] - Oceans Next deployments fail with "MissingPropertyException: No such property: commit"

User Story

  • [DMAS-50180] - As a data steward, I would like data ratings to be listed by datefrom rather than modifieddate
  • [DMAS-50757] - As a developer, I want to run UI tests against a local instance of Oceans 2.0 so that I can test my own work.
  • [DMAS-52164] - As a deployment engineer, I want to print the repo/version of a deployment so that I can easily format notification emails
  • [DMAS-55154] - As a system operator, I would like to edit and back-date device attributes
  • [DMAS-56251] - As a software developer, I'd like the site tab of DeviceListing updated to React
  • [DMAS-56324] - As a user, I would like to increase availability of Canarie services

Task

  • [DMAS-49822] - Add Automation Tests for WidgetService and WidgetTypeService
  • [DMAS-49979] - As a data steward, I would like a history table in the database for devicecharacteristic
  • [DMAS-55140] - update web service tests DOIDatasetService download metadata, which was updated in DMAS-51134
  • [DMAS-56012] - Refactor the code used in the QaqcCache load
  • [DMAS-56039] - fix taskdefinitiondetail of dataproductupload-batch job in QA
  • [DMAS-56204] - Change plot dropdown to an autocomplete in the Plotting Utility widget
  • [DMAS-56210] - update doc and auto UI test scripts based on modification about topology view in DMAS-56194
  • [DMAS-56263] - Upgrade Chromedriver to version 85
  • [DMAS-56269] - Acoustic Dataviewer information snackbar occludes error snackbar
  • [DMAS-56273] - When using the Tree filter open the tree to the node of first matching instance
  • [DMAS-56282] - Investigate truncated hydrophone .wav files resulting from SYS-13550
  • [DMAS-56336] - Filter list of devices in autocomplete in video widget
  • [DMAS-56362] - The Latest Readings Widget shouldn't have the date range option on the location selector
  • [DMAS-56384] - Remove .project files from old database branches
  • [DMAS-56392] - Write Regression and UI Tests for Light GeospatialMap
  • [DMAS-56462] - Improve logging and error handling in videoFileQAQC postprocessor
  • [DMAS-56492] - Replace deprecated jenkins plugins
  • [DMAS-56550] - Update data acquisition automated tests

Requirement

  • [DMAS-55210] - Adjust requirements for Erddap Management page to not have to not add title and summary for new datasets
  • [DMAS-56103] - Document autodeployment requirements

Design

  • [DMAS-55211] - Adjust design for Erddap Management page to not have to not add title and summary for new datasets
  • [DMAS-56104] - Document autodeployment design
  • [DMAS-56467] - Front end design

Implementation

  • [DMAS-49262] - Implement selector
  • [DMAS-54070] - Create selenium tests for SensorListing changes
  • [DMAS-54743] - Add selenium test to confirm task is added under triggers
  • [DMAS-54851] - Add web service automation tests
  • [DMAS-55694] - Make a build that allows a developer to select a branch of each project to be deployed
  • [DMAS-55756] - Create parser for AML-1 RT
  • [DMAS-56000] - Add plotly and minimal TimeSeriesChart
  • [DMAS-56048] - Create backend call to export still images for dives
  • [DMAS-56134] - Make it easier to switch the default environment
  • [DMAS-56135] - Have SystemConsole select the appropriate environment when sending system commands
  • [DMAS-56136] - Make any test that runs a task fail if there are no task machines running
  • [DMAS-56137] - Have GraylogUtil check /tmp/dmas.log if running against localhost
  • [DMAS-56138] - Have SFTPHandler use localhost when running against localhost
  • [DMAS-56156] - Implement full screen
  • [DMAS-56175] - Create basic widget files
  • [DMAS-56181] - Support getting a reference to any set of hosts in an environment-independent way
  • [DMAS-56200] - Check privilege in SystemStatusService
  • [DMAS-56237] - Create hover text for data date
  • [DMAS-56242] - Connect to dev databases when running in dev
  • [DMAS-56253] - Update Site Tab to use React
  • [DMAS-56254] - Deploy the selected branch of ONC Data Products on request
  • [DMAS-56255] - Trigger a build of the selected branch of Oceans Next on request
  • [DMAS-56256] - Deploy Oceans Next when a build is triggered by this project
  • [DMAS-56260] - Run UI tests when a build is triggered by this project
  • [DMAS-56271] - Connect to a local JMX service in dev
  • [DMAS-56272] - Run local simulators in dev
  • [DMAS-56275] - Implement front-end wrapper for scalardata service
  • [DMAS-56284] - Modify SeaTube Search to be centered initially, then shifted based on action
  • [DMAS-56289] - Send messages over local JMS in dev
  • [DMAS-56296] - Create backend call that returns all common resolutions available between dives
  • [DMAS-56330] - Update selenium scripts for the Site Tab
  • [DMAS-56331] - Include the date in dmas.log in dev
  • [DMAS-56356] - Add ability to edit data source list items
  • [DMAS-56378] - Implement Chart Widget Config
  • [DMAS-56382] - Add script to add chart widget type to sy_widgettype
  • [DMAS-56383] - Add Chart Widget structure with config and the start of the display
  • [DMAS-56397] - Add logging if sensor needed for derivation is not found
  • [DMAS-56403] - Remove autogenerated title and abstract from ERDDAP Management
  • [DMAS-56410] - Support selecting properties (sensors) from the data source selector
  • [DMAS-56415] - Fix any ERRORS currently logged during startup in QA
  • [DMAS-56418] - Clean up leftover explicit references to QA hosts
  • [DMAS-56432] - Log the version of Oceans Next to the console whenever it's deployed
  • [DMAS-56436] - add cache for how many times the canarie services have been called
  • [DMAS-56440] - Implement SeaTube Annotation JSON export backend
  • [DMAS-56441] - Implement SeaTube Annotation JSON export frontend
  • [DMAS-56445] - Refactor backend call to use date parameters for single dives only
  • [DMAS-56446] - Remove Documentation links for devices on DataSearch and SeaTube
  • [DMAS-56460] - Allow dateFrom on historical device attributes to be editable for users with RW access
  • [DMAS-56476] - Update Automated UI Tests
  • [DMAS-56477] - Update DeviceService to return the sensorTypeCode and sensorCodeName in the tree return

Test

  • [DMAS-55521] - Update ERDDAPManagement ui tests
  • [DMAS-55997] - Write UI tests for new latest reading configuration dialog

Bug (ST)

  • [DMAS-56179] - Host names aren't being correctly joined
  • [DMAS-56290] - Fix CKAN Dataset french translations
  • [DMAS-56291] - Fix ISO 19115 translations
  • [DMAS-56351] - All build stages are skipped when running a parameterized build on the master branch
  • [DMAS-56371] - Lock step inappropriately occupies a heavy-weight executor
  • [DMAS-56407] - Sandbox Tasks are not generating correct output
  • [DMAS-56455] - Fix bad links caused by addition of /dmas path
  • [DMAS-56469] - Make frontend changes to match the new milliseconds in the returned dataFiles

Investigation

  • [DMAS-56354] - Find the average prod response times for canarie services

Documentation

  • [DMAS-54794] - Describe how to find this text in the QA deployment process
  • [DMAS-55073] - Identify the web services that are a priority to secure

September 30, 2020

Minor release: improvement for PAMguard task

Tickets Released: Oceans 2.0: 20.08.005 (accessible to internal users only). Total: 1.

 Click here to expand...

Bug (ST)

  • [DMAS-56478] - Performance validation in running Pamguard tasks (QA & PROD)

September 25, 2020

Minor release: bug fixes for community fishers pipeline and data products, Wally and STRAW-B driver improvements.

Tickets Released: Oceans 2.0: 20.08.004 (accessible to internal users only). Total: 7.

 Click here to expand...

Bug

  • [DMAS-56332] - java.lang.Exception: Cannot find piggyBack Device for SBE19Plus V2
  • [DMAS-56398] - DMAS Search Failed Notification: 17-Sep-2020 21:51:12 UTC, Victoria Harbour-CF0134 (GVHA3), Time Series Scalar Data, SearchHdrId 5759720, UserId 48660
  • [DMAS-56451] - DMAS Search Failed Notification: 23-Sep-2020 17:04:04 UTC, Victoria Harbour-CF0132 (GVHA1), Aligned and Depth-Binned Profile Data (On-Demand), SearchHdrId 5772188, UserId 94330

Task

  • [DMAS-56439] - Add logging to cast detection to determine if cast was rejected due to length or period parameters

Implementation

September 22, 2020

Minor release: new drivers and changes in support of the maintenance expedition: STRAW-B, Wally. Community fisher improvements, task management improvements, other bug fixes.

Tickets Released: Oceans 2.0: 20.08.003 (accessible to internal users only). Total: 29.

 Click here to expand...

Bug

  • [DMAS-56155] - after adding a sitedevice to a searchtreenode it disappears unless I reload cache on the web machine
  • [DMAS-56222] - Video and Audio widgets with "latest" location data should only get one file from the archive
  • [DMAS-56306] - CF Geospatial Map annotation text is cutoff
  • [DMAS-56352] - Scalar data issue with multiple deployment periods
  • [DMAS-56359] - GeospatialMap Light not Rendering in QA
  • [DMAS-56360] - DMAS Search Failed Notification: 15-Sep-2020 00:10:19 UTC, Victoria Harbour-CF0136 (GVHA5), Cast Scalar Profile Plot and Data, SearchHdrId 5726419, UserId 94330
  • [DMAS-56400] - DMAS Search Failed Notification: 17-Sep-2020 22:48:26 UTC, Juan de Fuca Strait-CF0060, Aligned and Depth-Binned Profile Data (On-Demand), SearchHdrId 5760016, UserId 94330
  • [DMAS-56401] - COR file generation isn't always including lat/long data (even when data is present)
  • [DMAS-56416] - "Station Name:" row in COR file header is left blank
  • [DMAS-56417] - Fix offset/blanking in Kongsberg rotary plots

Task

  • [DMAS-56108] - Display of batch tasks is very slow
  • [DMAS-56177] - Investigate moving the CF Geospatial Map into a stand alone page
  • [DMAS-56249] - Clarify fix for "Host key verification failed" error on deploying Oceans Next
  • [DMAS-56268] - Use the Search Tree Node Name values on the Geospatial Map pins
  • [DMAS-56300] - Do not render EEW Layer on GeospatialMap if user is not at least an internal user
  • [DMAS-56391] - automatically publish cache reload from jvm device cache

Implementation

  • [DMAS-49263] - Update Latest Readings widget config to use new selector
  • [DMAS-55532] - Straw - Standard Module Driver
  • [DMAS-55533] - Straw - PMT Spectrometer Driver
  • [DMAS-55534] - Straw - Mini Spectrometer Driver
  • [DMAS-55592] - Straw - Muon Tracker Driver
  • [DMAS-55593] - Straw - LIDAR Driver
  • [DMAS-55595] - Straw - ftp jobs
  • [DMAS-56109] - Add an index to tm_task to improve performance
  • [DMAS-56293] - implement parser for Wally's Crawler PCI-160 Interface Container
  • [DMAS-56328] - Implement motorlog command in wally driver
  • [DMAS-56341] - add dateFrom index to service log table

Bug (ST)

September 15, 2020

Minor release: bug fixes for community fishers pipeline and data products (MATLAB only, no downtime).

Tickets Released: Oceans 2.0: 20.08.002 (accessible to internal users only). Total: 2.

 Click here to expand...

Bug

  • [DMAS-56333] - DMAS Search Failed Notification: 11-Sep-2020 18:25:06 UTC, Turner Cyclops-7 Fluorometer (S/N 900185), Aligned and Depth-Binned Profile Data (On-Demand), SearchHdrId 5705928, UserId 94330
  • [DMAS-56334] - Index out of bounds error for castdatacorrection

September 3, 2020

Minor release: bug fixes for hydrophone compression task, cast profile data product, EEW.

Tickets Released: Oceans 2.0: 20.08.001 (accessible to internal users only). Total: 6.

 Click here to expand...

Bug

  • [DMAS-56209] - File archiving error - CRC mismatch on some gzipped hydrophone files generated from "Compression task for hydrophone wav files" job
  • [DMAS-56264] - Handle when single datapoint on castscalarmultiprofile plot when surrounded by NaNs
  • [DMAS-56265] - EEW Heartbeat service ignoring configuration setting
  • [DMAS-56267] - IP display not correct in IP tab of device detail page in prod

Task

  • [DMAS-56250] - Define more ONSHIP roles so we can have more than 2 diveloggers active
  • [DMAS-56278] - Add output directory parameter to the hydrohpone file compression job

August 31, 2020

Major release

Maintenance and Production Developer

  • Bug fixes
  • Leftovers in device ownership / association
  • Data Search / API fixes: limit anonymous users' requests for time range, improve file clean up
  • Website for Fall ONC expedition season
  • Coastguard AIS driver update
  • Support multiple on-ship machines
  • Documentation of several external APIs

Instruments

  • PAMguard (automated acoustic detection of marine mammals) phase 2a - begin processing data in PROD.
  • Driver development in support of Fall maintenance expedition:
    • STRAW-b drivers and integration
    • Holyrood drivers
    • Wally

Data Products

  • Bug fixes and performance investigation

Data Player

  • refinement to toolbox options
  • annotations on the viewer (in-progress)
  • initial work on MATLAB as a service (in-progress)

Community Fishers

  • bug fixes for cast pipeline
  • initial version of showing annotations on geospatial map

SeaTubeV3 - CANARIE & NOAA & ONC

  • Performance improvement for fixed location cameras (in-progress)
  • Fixed interval still image export
  • Broad annotation search across dives, organizations, and more
  • Embed timestamps in NOAA video 
  • Bug fixes

Internal Process and Testing Improvements

  • UI test improvements
  • Automated branch deploy and test
  • Migrate SQL scripts to GIT/BitBucket + process improvement (in-progress)

Web Services / API

  • UI tests
  • Improvements for archivefiles service

Dashboards - CANARIE

  • Audio / Video location selectors
  • Plotting widget (in-progress)
  • App bar, including full-screen
  • Autocomplete support

CIOOS Pacific / ERDDAP

  • Translation problems fixed
  • ERDDAP management fixes
  • Open-sourcing / artifact support (in-progress)

Tickets Released: Oceans 2.0: 20.08.000 (accessible to internal users only). Total: 146.

 Click here to expand...

Bug

  • [DMAS-50898] - archivefiles:getFile returns "Invalid parameter value" if file not found
  • [DMAS-50945] - Clicking on Show/Hide resets the page to the top
  • [DMAS-51266] - Coastguard AIS Network Aggregator driver stops after 2147483470 readings reached
  • [DMAS-51961] - DMAS Search Failed Notification: 21-Oct-2019 21:24:15 UTC, null, SeaTube Annotation Export, SearchHdrId 3324037, UserId 90370
  • [DMAS-54086] - Rawdataservice incorrectly reports bad data when disconnected from AD
  • [DMAS-55418] - Fix broken test in RecurringSearches
  • [DMAS-55548] - Fix broken test JunctionboxControlAndMonitor.triggerAlarm
  • [DMAS-55565] - new sitedevice maintenance page has issues that need to get fixed quickly
  • [DMAS-55578] - Fix broken tests in DataViewer
  • [DMAS-55701] - Fix annotation deletion tests
  • [DMAS-55919] - Custom Hydrophone limits are not being applied to images
  • [DMAS-55920] - why is sitedevice listing not in chronological order
  • [DMAS-55938] - fix tests in DeviceControl
  • [DMAS-55946] - Potential infinite loops in SCUAcquisition UI test
  • [DMAS-55953] - HY Toolbox does not automatically select custom radio option after first input
  • [DMAS-55989] - React pages in Oceans 2 do not render sometimes
  • [DMAS-55992] - Error in getting ArchiveFile on Baynes sound Driver machine
  • [DMAS-55994] - Fix broken test in DeviceDetailsTest.checkSiteTab
  • [DMAS-55996] - Fix broken tests in DataSearch
  • [DMAS-56006] - Fix broken tests in DashboardManagement
  • [DMAS-56010] - Fix broken test in usermanagement.groups/GroupsDataProductPermissionFilters
  • [DMAS-56020] - Entering null or '0' value in the Toolbox TextFields returns image with default limits
  • [DMAS-56038] - new parserdefinitions dont show up in the UI after cache reload
  • [DMAS-56050] - Dives not playing in SeaTube
  • [DMAS-56070] - Hydrophone data in the dataplayer producing artifact in corner of image
  • [DMAS-56073] - DataViewer images are overlapping when scrolling to new data
  • [DMAS-56077] - Dashboard Widgets are not displaying their "more" 3-dot icon
  • [DMAS-56080] - V3 Search links to Invalid resourceTypeId when play button is pushed in query results
  • [DMAS-56087] - Fix broken tests in Dataviewer
  • [DMAS-56097] - Junction box alarm settings gives undefined error for all jbs for RO access
  • [DMAS-56100] - Fix broken tests in geospatial map
  • [DMAS-56105] - Fix cancelRunningTask in TaskControlTest
  • [DMAS-56128] - CODARs - Lots of missing files since Aug 9th at 7:00
  • [DMAS-56132] - Fix broken test in PlottingUtility
  • [DMAS-56133] - Fix failing tests in DataViewer
  • [DMAS-56161] - Repeated requests to seatube/videos for search tree nodes have duplicate mediaFiles
  • [DMAS-56164] - Time series PDF plots have a mysterious -1 in their filenames when appended
  • [DMAS-56173] - SiteDevice Cache loads very slowly on JVMs with the SHORESTATION role
  • [DMAS-56194] - topology is not displaying properly in topologyview or deviceconsole
  • [DMAS-56196] - Data Citation/DOI Generation Error for SiteDeviceID 1205934
  • [DMAS-56213] - Seems that the video file request to wowza is missing the page
  • [DMAS-56219] - fix broken test in AccessRestrictions
  • [DMAS-56220] - Fix failing tests in PlottingUtility
  • [DMAS-56221] - Fix broken tests in FileManagement
  • [DMAS-56224] - DeviceConsoleService very slow on first request
  • [DMAS-56225] - Appended PDFs in reverse order
  • [DMAS-56227] - Fix bug in empty plots for datapreview generation
  • [DMAS-56229] - JSON serialized cache error on QA ferry machine
  • [DMAS-56231] - Fix failing tests in geospatial map
  • [DMAS-56232] - Fix broken tests in DeviceControl (pageLayout and checkQuarantine)
  • [DMAS-56244] - device search is broken for device without owner

User Story

  • [DMAS-49903] - As a dashboard owner I want to select data for either the audio or video widgets without knowing device Id
  • [DMAS-50384] - As an API archivefiles user, I'd like to be able to filter file lists by extension
  • [DMAS-52244] - As a CIOOS stakeholder, I would like ISO 19115 metadata records that meet the initial version of the CIOOS profile (minus cast data)
  • [DMAS-53545] - As a data steward, I would like to have dataset title and abstract for ERDDAP be automated and consistent with ISO/DataCite metadata
  • [DMAS-53557] - The data portal should display the annotations of environmental data recorded in the field that correspond to each cast
  • [DMAS-53888] - As a system user, I would like the file-cleanup job to not delete files in a search/job folder until after the search/job is complete
  • [DMAS-55064] - As a software developer, I would like to speed up UI tests, so that we can test more branches in one night.
  • [DMAS-55729] - As ONC I want to prevent any logged in user from having RW access to dashboards as a temporary way to prevent publishing of dashboards
  • [DMAS-55761] - As a system operator, limit anonymous searches to a maximum time range to reduce their ability to clog our system

Task

  • [DMAS-49402] - Oceans 2.0 API dataProductDelivery request estimated values don't follow documentation
  • [DMAS-49723] - As a web service API user I would like to include deviceCategoryCode in the payload of the "devices" web service
  • [DMAS-49724] - As a web service API user I would like to include deviceCategoryCode in the payload of the "deployments" web service
  • [DMAS-53693] - As a data steward, I would like to update the Device and Sensor Listing labels for searchable flags
  • [DMAS-54419] - Fix broken test in loginUser of DeviceAndSensor
  • [DMAS-54950] - As a data steward, I would like the ability to sort on number of attributions in the Network Console>Data agreements attributions tab
  • [DMAS-55556] - Investigate and fix potential issue on device clone caused by new resource role system (DMAS-52447)
  • [DMAS-55609] - Look further into handling OBIS tests for fixed cameras
  • [DMAS-55627] - SeaTube Dive Reference Position Population Job causing lots of ERRORs
  • [DMAS-55645] - As a data steward, I would like the declarative parser version history sorted in reverse time order
  • [DMAS-55863] - Create ui tests for fixed location cameras
  • [DMAS-55892] - Add "modifyby" and "modifydate" columns to cfstandardname table to keep track of CF version updates.
  • [DMAS-55906] - File Upload tool is uploading incorrect and incomplete descriptions for French translations.
  • [DMAS-55909] - Make the whole page scrollable not just the inner frame
  • [DMAS-55914] - update calibration details for Satlantic Radiometers (DI 12106 and DI 12107)
  • [DMAS-55954] - Make more VideoPlayer UI tests
  • [DMAS-55970] - Connect to Cassandra at the start of the UI test suite
  • [DMAS-55998] - Add comment explaining required parsing order in getseismometerDP
  • [DMAS-56045] - Rename util files to utils
  • [DMAS-56056] - Remove redundant ytickformat() from plotscalarmultisensor
  • [DMAS-56072] - Device Listing "Resource Role" tab should get oceans-next resources from its manifest
  • [DMAS-56088] - Update UI tests after removal of the device and sensor venus search fields
  • [DMAS-56142] - Add emailing to cast data correction
  • [DMAS-56186] - Make some enhancements to DeviceAutocomplete
  • [DMAS-56191] - Update PAMguard MATLAB preparation job to keep integer formats in output wav file
  • [DMAS-56238] - Provide a configurable option for task types permissions

Design

  • [DMAS-49234] - Design selector for devices + locations
  • [DMAS-49266] - Design audio data selector (maybe generalize to device cat (type) + location)
  • [DMAS-55260] - Design selector for Scalar Data
  • [DMAS-55669] - Create Storybook entry for scalar data widget config
  • [DMAS-55986] - Design interface for TimeSeriesChart
  • [DMAS-56085] - Create a mockup for how the Dashboard Tool bar would look

Implementation

  • [DMAS-49235] - Implement data source selector with Video widget
  • [DMAS-49269] - Implement audio selector
  • [DMAS-53776] - Use the POM in ca.uvic.onc.test.ui.test.extension.seatube.seatubeV2.TaxonButtonSet
  • [DMAS-53777] - Use the POM in ca.uvic.onc.test.ui.test.extension.dataproduct.metadataReportGeneration.DataAvailabilityPlot
  • [DMAS-53778] - Use the POM in ca.uvic.onc.test.ui.test.extension.dataacquisition.junctionBoxControl.JunctionBoxControlAndMonitoring
  • [DMAS-53796] - use the POM in ca.uvic.onc.test.ui.test.extension.warn.eew.EEW
  • [DMAS-53818] - Use the POM in ca.uvic.onc.test.ui.test.core.infrastructure.jiraServiceDesk.JiraHelpDesk
  • [DMAS-54296] - Include the author/message of the commit being deployed
  • [DMAS-54882] - create or update UI tests for ResourceRoleTab in DeviceDetails Test
  • [DMAS-55253] - Pro Oceanus driver - stop sampling when driver is idled
  • [DMAS-55255] - Sea-Bird CTD - stop sampling when driver is idled
  • [DMAS-55300] - Remove title/summary from ERDDAPManagement
  • [DMAS-55459] - Implement a high-fidelity mockup of the data source selector
  • [DMAS-55514] - Implement custom limit check in the Hydrophone toolbox
  • [DMAS-55589] - add selenium test for deprecating DOI
  • [DMAS-55618] - Update name of Scalar Data Values widget to Latest Readings widget
  • [DMAS-55672] - Configure UI tests to run in multiple threads in parallel
  • [DMAS-55752] - Update Dashboard UI tests
  • [DMAS-55859] - add test for Make Dashboard Public / Private
  • [DMAS-55873] - refactor SiteDeviceMaintenance tests
  • [DMAS-55894] - Integrate new config window into scalar data widget
  • [DMAS-55905] - Connect the Data Source Selector and Data Source List components together
  • [DMAS-56001] - Print host names on deploying Oceans 2
  • [DMAS-56015] - Look into batch page slowness
  • [DMAS-56018] - Add Cast Annotation operation to AnnotationService
  • [DMAS-56032] - If an anonymous user tries to create a search over more than 90 days display an error telling them to login
  • [DMAS-56042] - Refactor the AnnotationList component into a configurable Widget
  • [DMAS-56049] - make user search files available until 14 days after search completion
  • [DMAS-56057] - Improve task running performance for Pamguard Jobs
  • [DMAS-56063] - Add a confirmation/explanation prompt to Quarantine
  • [DMAS-56071] - Display Annotations for each cast on geospatial map
  • [DMAS-56098] - Implement dashboards AppBar
  • [DMAS-56110] - Display progress while child tasks are loading
  • [DMAS-56111] - Improve DAO methods for getting children of a task
  • [DMAS-56113] - Write UI Tests for annotations list on geospatial map
  • [DMAS-56116] - Add support for missing periods to scalardata service
  • [DMAS-56188] - sort data ratings on device listing by date from
  • [DMAS-56193] - Fix merge to master for "All Tasks" PR

Test

  • [DMAS-55488] - Add webservice automation test for deviceCategoryCode in devices api service
  • [DMAS-55492] - update web service automation tests
  • [DMAS-56008] - update web service tests for api/archivefile
  • [DMAS-56234] - add selenium test to check the data rating tab is ordered by datefrom

Bug (ST)

  • [DMAS-56069] - Deploying an old version reports the wrong branch name
  • [DMAS-56192] - Make frontend changes to match the service call fix
  • [DMAS-56241] - Fix issue where ErddapManagementEdit still validates on title/summary

Investigation

  • [DMAS-55910] - Investigate limiting anonymous user search time range

Documentation

  • [DMAS-54433] - document CKAN Metadata upload job in wiki
  • [DMAS-55367] - write new or update requirements and test plans on confluence pages
  • [DMAS-55489] - update external documentation to include deviceCategoryCode field
  • [DMAS-55493] - update external wiki documentation
  • [DMAS-55560] - Update external documentation with the include children parameter
  • [DMAS-55602] - update ScalarData external api documentation to include the new parameters
  • [DMAS-55604] - update archive file service external documenation with dataProductCode and fileExtension parameters
  • [DMAS-55904] - Update scalarData external documention for multiple propertyCodes

August 25, 2020

Minor release: bug fixes for hydrophone compression task, task management and SeaTube

Tickets Released: Oceans 2.0: 20.07.005 (accessible to internal users only). Total: 7.

 Click here to expand...

Bug

  • [DMAS-56051] - Time on V3 playlist is NaNaNaNaNa
  • [DMAS-56158] - Compression task for hydrophone wav files (234) not handling errors correctly
  • [DMAS-56167] - Unable to add new device action
  • [DMAS-56169] - datamap information are missed in task definition tab on task management page
  • [DMAS-56174] - Data Stewardship Group Cannot modify TaskManagement Job Parameters
  • [DMAS-56183] - After save a task definition, the highlight job in the tree changes to other job

Implementation

  • [DMAS-56170] - Fix error with scheduled tasks not displaying in "All tasks"

August 24, 2020

Release for HydroCal, version HC.20.08.000 (HydroCal Change List)

  • Fixed bugs: support package was being excluded from build, improved pathing and build environment
  • Software version check now only tries to check once a day
  • Updated all drivers, support packages and software to the latest MATLAB R2019a update

August 20, 2020

Minor release: bug fixes for drivers, Community Fishers, SeaTube, PAMguard and more.

Tickets Released: Oceans 2.0: 20.07.003 (accessible to internal users only). Total: 22.

 Click here to expand...

Bug

  • [DMAS-55738] - Investigate gaps occurring every ~2.5h in external pH (dynamic salinity) sensors
  • [DMAS-55990] - Fix bug in uniqueness constraint in Resource Role Tab on the Device Listing Page
  • [DMAS-55999] - Video Quality options are not working
  • [DMAS-56041] - Topology view page won't display correctly
  • [DMAS-56053] - Fix failure to get instruments by category
  • [DMAS-56066] - Oceans-Next unit tests are failing with "Error: Material-UI: the ExpansionPanel component was renamed to Accordion to use a more common naming convention."
  • [DMAS-56067] - Fix device clone breaking because of missing devicecode
  • [DMAS-56074] - Data Search and Plotting Utility "Instruments by Category" trees don't load
  • [DMAS-56107] - DMAS Search Failed Notification: 17-Aug-2020 20:42:30 UTC, null, Cast Scalar Multi-Profile Plot, SearchHdrId 5597589, UserId 15356
  • [DMAS-56118] - Fix bug in cast data correction post process job
  • [DMAS-56119] - Downcasts not appearing under location in datasearch or plotting util
  • [DMAS-56139] - why ownerid and principalinvestigatorid in device_hist database table are not null, but nullable in device table
  • [DMAS-56145] - Don't use points on castscalarmultiprofile plot if more than one datapoint
  • [DMAS-56146] - Device Tree Breaks until Caches are in sync after running CastIngestionJob

Task

  • [DMAS-51027] - Handle LayoutService share errors
  • [DMAS-55933] - SeaTubeV3 landing page returning 400 error
  • [DMAS-56127] - Use a large marker if only one datapoint for cast scalar profile plot
  • [DMAS-56149] - WET Labs ECO FLNTURTD driver changes for device with no memory card

Implementation

  • [DMAS-55254] - Sebird SeaFET driver - stop sampling when idle
  • [DMAS-55641] - Driver for AML Micro X
  • [DMAS-55658] - Remove owner and PI from Device object
  • [DMAS-55737] - Task Management - automatically add defaults when adding new pamguard job.

August 14, 2020

Minor release: Update for Community Fishers, improve seismometer data products to handle non-standard data, bug fixes. (MATLAB only, no downtime)

Tickets Released: Oceans 2.0: 20.07.002 (accessible to internal users only). Total: 5.

 Click here to expand...

Bug

  • [DMAS-55995] - Hydrophone colour limit options for the dataviewer are getting swapped in Matlab
  • [DMAS-56028] - DMAS Search Failed Notification: 10-Aug-2020 11:07:50 UTC, Main Endeavour Field-Seismometer, Seismometer Data, SearchHdrId 5587691, UserId 48400
  • [DMAS-56092] - Multi-sensor plot showing extraneous exponential label

Task

  • [DMAS-55930] - extend CF processing pipeline to support CDOM
  • [DMAS-56086] - Update cor dataproduct for CDOM

August 10, 2020

Minor release: Update for Community Fishers. (MATLAB only, no downtime)

Tickets Released: Oceans 2.0: 20.07.001 (accessible to internal users only). Total: 1.

 Click here to expand...

Task

  • [DMAS-56002] - Update dataproduct code to use the new device attributes

August 5, 2020

Major release

Maintenance and Production Developer

  • Bug fixes
  • Updates / fixes for roles in device ownership / association
  • External web service improvements (complete, moving out of maintenance to a new project)
  • Fix for Seismometer display / Earthquake dashboard on ONC website
  • DAF testing / prep for maintenance cruises

Instruments

  • Data acquisition prioritization / multi-queues (starting)
  • CVAUI conference website (4th Workshop on Computer Vision for Analysis of Underwater Imagery) now hosted on a local instance of a new content management system and conference organizing website (complete)
  • PAMguard (automated acoustic detection of marine mammals) phase 1 ready: available as a user-defined task (phase 2+ on-going)
  • Driver development:
    • STRAW-b drivers and integration (starting)
    • Holyrood drivers (in-progress)
    • Wally

Data Products

  • Bug fixes and performance investigation

Complex Data Player

  • Caching images (in-progress)
  • Dashboard integration
  • Improvements to missing/restricted data

Community Fishers

  • bug fixes & phase 1 finish up tasks
  • improved handling of missing data

SeaTubeV3 - CANARIE & NOAA & ONC

  • Performance improvement for fixed location cameras (in-progress)
  • OBIS count addition for existing annotations
  • Bug fixes

Internal Process and Testing Improvements

  • Automated UI test cases additions and improvements (in-progress)
  • Structural UI testing improvements: Running UI test suite on feature branches, multi-threading, autodeployment
  • Dependent Pull Requests now supported

Web Services / API

  • Starting / continuing from maintenance work
  • Recent improvements include adding resampling and multiple property codes to the scalar data service, include children parameter to device service, added dataProductCode and fileExtension parameters to archivefiles service and more!

Dashboards - CANARIE

  • Now necessary to have Dashboards RW access to create/update a dashboard
  • Can add a Complex Data widget to a dashboard 
  • When Plotting utility widget Legend menu item selected it sometimes moves the page to the top
  • Selector base components (not available to user yet)
  • Device auto-complete
  • Scalar data plotting widget (in-progress)

MINTED - CANARIE

  • Added ability to hide batch tasks
  • Improve task management testing
  • siteDevice metadata change task now added under triggers group

CIOOS Pacific / ERDDAP

  • FIX: upload translations missing descriptions
  • FIX: ISO19115 service sometimes throwing 500 errors
  • FIX: About 50% of the time the ERDDAP Management page wasn't loading

Tickets Released: Oceans 2.0: 20.07.000 (accessible to internal users only). Total: 132.

 Click here to expand...

Bug

  • [DMAS-54420] - Fix broken test in sitedevicemaintenanceV2.SiteDeviceMaintenanceTest.checkErddapDatasets
  • [DMAS-54446] - Fix broken tests in DataViewer module
  • [DMAS-54952] - adjusting map cause search tree items to disappear in Data Search
  • [DMAS-55214] - Fix broken test in navigation.NavigationBarAdminUser
  • [DMAS-55217] - Fix broken tests in uploadValidQAQCDateToInPast and uploadValidQAQCDateToInFuture in dataqaqc.manualTest
  • [DMAS-55230] - Fix broken test in datadownload.publicWebServices/PublicWebServices/checkScheduledJob
  • [DMAS-55302] - Fix broken test in website.homePage/HomePage/checkDataAcquisitionAcceptableStatus
  • [DMAS-55303] - Fix broken test in website.general/General/checkMinasPassageQA
  • [DMAS-55408] - fix broken test in FileManagement/checkAnnotationFileUpload
  • [DMAS-55409] - It takes 5 seconds to load Fixed Location Camera tree. Please try to cut it down to 2 seconds
  • [DMAS-55484] - the sitedevice offset heading is not applied by kongsberg-postprocess-job
  • [DMAS-55529] - Remove inner vertical scroll bar
  • [DMAS-55596] - Automation tool doesn't notify if someone enters an invalid hostname
  • [DMAS-55610] - Automation tool throws NullPointerExceptions running some tests on api/datasetMetadata
  • [DMAS-55611] - fix name in dashboard dialog
  • [DMAS-55636] - Fix StaleElementReferenceException causing DeviceControl.dataMonitoringTab() test to fail
  • [DMAS-55637] - Fix broken tests in ExploreDMASTest
  • [DMAS-55646] - RO SiteDevice only show site Id, should show name
  • [DMAS-55662] - Fix broken test in messaging
  • [DMAS-55664] - Dataset landing page not loading data when given a querypid
  • [DMAS-55681] - Data Player Widget within dashboards not displaying data.
  • [DMAS-55718] - Deployment to qalr3 failed with com.liferay.portal.kernel.upgrade.UpgradeException
  • [DMAS-55722] - unable to update or delete nameplate for device ID 50540
  • [DMAS-55727] - Hydrophone toolbox limit options and textfields are reset when closed
  • [DMAS-55755] - Dataplayer Reset button resets to previously selected options instead of defaults
  • [DMAS-55764] - Duplicated sitedevices in searchtreemaintenance page when running community fishers pipeline
  • [DMAS-55768] - QA datacentre returns status 500 when trying to load any page after running a UI test suite
  • [DMAS-55771] - DMAS Search Failed Notification: 16-Jul-2020 20:49:08 UTC, Axis P1375 Camera SN ACCC8ED935C9, Time Series Scalar Data, SearchHdrId 5347314, UserId 96640
  • [DMAS-55775] - ERROR messge about BATCH tasks in driver JVM
  • [DMAS-55781] - It takes too long to load annotation list
  • [DMAS-55789] - Uncaught exceptions thrown in web service tests aren't reported to the UI
  • [DMAS-55790] - Running web service parameter nodes logs the warning "No verifications for Node ID..."
  • [DMAS-55792] - Web service parameter nodes run in the wrong order
  • [DMAS-55802] - Failed UI tests aren't being retried
  • [DMAS-55833] - No logging from matlabfilepostprocessors after recent switch to -batch mode
  • [DMAS-55841] - Non-leaf nodes in automated testing always have the message "The test has been created and is waiting to be run"
  • [DMAS-55843] - Errors in Oceans Next CSS files aren't caught on feature branch CI builds
  • [DMAS-55844] - Correct CSS import that was not changed to new structure
  • [DMAS-55846] - DMAS Search Failed Notification: 22-Jul-2020 17:39:57 UTC, Strait of Georgia-CF0031, Aligned and Depth-Binned Profile Data (On-Demand), SearchHdrId 5398982, UserId 15356
  • [DMAS-55852] - modify date is hard coded for sitedevice readonly
  • [DMAS-55862] - Duplicate task definitions showing up on TaskManagement page
  • [DMAS-55868] - ISO19115Service is throwing 500 errors sometimes
  • [DMAS-55875] - Fix failing UI tests in DataViewer
  • [DMAS-55878] - Put cast detection file into manifest file even if no casts are detected.
  • [DMAS-55896] - Do not parse invalid casts
  • [DMAS-55900] - Using Toolbox options does not remove old files
  • [DMAS-55913] - Geolocations populating incorrectly in DataCite metadata
  • [DMAS-55931] - fix broken test filemanagement/checkfilearchiverservice
  • [DMAS-55935] - Site Position cache cannot be loaded from serialized file
  • [DMAS-55936] - Post process tasks are not exiting on error
  • [DMAS-55939] - Missed refactoring query in hydrophonepostprocesswavtoflac
  • [DMAS-55941] - QA device console page is broken with release/20.07.000
  • [DMAS-55942] - When running web service tests, the result page isn't displayed until all tests are finished running
  • [DMAS-55943] - Fix broken test in datapreview generationAndDisplay
  • [DMAS-55945] - All user Group doesnt load on the UserManagement page
  • [DMAS-55947] - Large number of sig figs on ADCP scalar time series plots
  • [DMAS-55964] - DMAS Search Failed Notification: 04-Aug-2020 16:39:36 UTC, Main Endeavour Field-Seismometer, Seismometer Data, SearchHdrId 5541467, UserId 48400
  • [DMAS-55972] - DMAS Search Failed Notification: 04-Aug-2020 19:27:56 UTC, Prince Rupert CODAR System-Ridley Island (VRID), CODAR Quality Controlled Surface Currents, SearchHdrId 5541865, UserId 42732
  • [DMAS-55984] - Fix broken test deviceSynchronization.DeviceSynchronization.pagePermission

User Story

  • [DMAS-48420] - As a data specialist, I would like to have resampling capabilities in the scalardata service
  • [DMAS-48857] - As an API user, I would like the scalardata service to obtain multiple propertyCodes in one request
  • [DMAS-54852] - As an API user, I would like the includeChildren option on the devices service
  • [DMAS-55689] - As a user, I would like to see improvements or bug fixes on resource roles of device

Task

  • [DMAS-39349] - Remove unused servlet MetaInfo
  • [DMAS-52659] - As a SeaTube user, I would like to have a help link on each widget so that I can easily learn how to use them
  • [DMAS-55278] - Retroactively integrate V2 annotations into OBIS
  • [DMAS-55505] - improve unit tests/coverage for TaskManagement
  • [DMAS-55584] - Update UI test for allowAny dpo
  • [DMAS-55587] - Display a "No Data" image when no data found
  • [DMAS-55588] - Display images requested for the DataViewer as they are returned
  • [DMAS-55616] - Add props to Dataplayer components for Selenium tests
  • [DMAS-55660] - Wrap Dashboards with the DenseThemeProvider
  • [DMAS-55667] - Move ExploreDMASTest to under test.ui.test so it runs overnight
  • [DMAS-55702] - Update hydrophone post-process to support new icListen SC type hydrophones for Holyrood
  • [DMAS-55732] - Create UI tests for the Hydrophone Toolbox limit options
  • [DMAS-55742] - Display images requested for the DataViewer as they are returned while scrolling
  • [DMAS-55743] - Replace splash images with returned images as they are received.
  • [DMAS-55774] - Fix ui-testing compiler warnings
  • [DMAS-55786] - please change start time of auto UI test to 12 noon local time
  • [DMAS-55835] - Site Device page displays empty list if no datasets found
  • [DMAS-55849] - Create UI test for DataViewer to test half no data and half with data
  • [DMAS-55856] - Create "blank" CF cast plot when pipeline detects missing data
  • [DMAS-55857] - Create "missing data" CF .COR file when the pipeline detects missing data
  • [DMAS-55865] - Investigate recent search backlogs and preview search slowness in PROD
  • [DMAS-55867] - Disable UI tests that create Site Device 9192537
  • [DMAS-55891] - Refactor matlab hydrophone wav to flac and LTSA jobs to use new task system
  • [DMAS-55911] - Display ExpeditionManagement's trees at the same time
  • [DMAS-55967] - enable auto UI testing run in weekend

Requirement

Design

  • [DMAS-55433] - Create Design for hide Groups checkbox
  • [DMAS-55721] - Create design for resampling in the scalar data API

Implementation

  • [DMAS-54244] - Use the POM better in ca.uvic.onc.test.ui.page.core.taskManagement
  • [DMAS-54976] - Refactor selenium test components for managing batch tasks
  • [DMAS-55008] - Consolidate existing access control features
  • [DMAS-55158] - Add Selenium test to check Batch through sitedevicemaintenance page
  • [DMAS-55473] - Update TaskHistoryBatchService so batch tasks can be filtered
  • [DMAS-55540] - Implement a high fidelity mockup of configuring something with a data source
  • [DMAS-55558] - Add support for include children parameter in the /api/devices service
  • [DMAS-55561] - Create component to List and add data sources
  • [DMAS-55582] - Design a device selector based on device id or device name
  • [DMAS-55601] - Implement scalar data resampling in the ScalarDataWebService
  • [DMAS-55603] - update the api/archivefiles service with dataProductCode and fileExtension parameters
  • [DMAS-55650] - edit service to get site details
  • [DMAS-55661] - update selenium test to check input of more info table
  • [DMAS-55674] - frontend redirect to devicelisting from sitedevicemaintenance
  • [DMAS-55685] - Resource role table should not have a constraint preventing simultaneous resource role types for a device
  • [DMAS-55690] - Change datefrom from timestamp to date in im_deviceresourcerole table
  • [DMAS-55691] - Implement on UI a warning if there is uniqueness constraint for dateFrom for a device ownership is not met
  • [DMAS-55692] - Check for datefrom conflict in service code when a new resource role is being added
  • [DMAS-55696] - Resource role table should not sort Edit icons
  • [DMAS-55715] - Change date format to remove time from datefrom on the resource role table
  • [DMAS-55717] - Add refresh button to resource role table
  • [DMAS-55720] - Don't run the upgrade on already-upgraded nodes
  • [DMAS-55730] - Change dashboards logged in user permissions to RO
  • [DMAS-55741] - Add ability to delete resource roles to the resource role tab
  • [DMAS-55746] - Hide Add Dashboard button if user does not have RW access
  • [DMAS-55747] - Add access control to LayoutService
  • [DMAS-55763] - support a comma seperated list of property codes in the ScalarData service
  • [DMAS-55766] - Use the POM in ca.uvic.onc.test.ui.test.core.infrastructure.deviceAndSensor.DeviceDetailsTest
  • [DMAS-55769] - update selenium test to hover over options menu
  • [DMAS-55770] - Find a library for displaying dates as relative times
  • [DMAS-55837] - publish cache updates when a Site or SiteDevice is changed
  • [DMAS-55845] - Add icons to latest reading widget display table
  • [DMAS-55860] - publish a cache reload message when caches used by external web services are changed

Test

  • [DMAS-55751] - Update LayoutService web-service tests

Bug (ST)

  • [DMAS-55622] - fix broken test in CloneDevice
  • [DMAS-55686] - Resource role table should refresh when role is modified but doesn't
  • [DMAS-55687] - Resource role table should return an error if a user id exists but doesn't
  • [DMAS-55724] - Fix issue where ERDDAP gives data errors on load sometimes
  • [DMAS-55850] - Resource Role 'Date From' not updating in UI

Documentation

  • [DMAS-55723] - Update "How-to: code a web service"
  • [DMAS-55838] - Add documentation for existing tests

July 28, 2020

Minor release: .cor file data product bug fixes. (MATLAB only, no downtime)

Tickets Released: Oceans 2.0: 20.06.00420.06.005 (accessible to internal users only). Total: 1,1.

 Click here to expand...

Bug

  • [DMAS-55884] - DMAS Search Failed Notification: 24-Jul-2020 18:42:27 UTC, AML CTD Plus X 50222, Aligned and Depth-Binned Profile Data (On-Demand), SearchHdrId 5431410, UserId 97890
  • [DMAS-55902] - Cor dataproduct is not naming files correctly

July 27, 2020

Minor release: bug fix for MATLAB postprocess jobs, logging for SeaTube cache.

Tickets Released: Oceans 2.0: 20.06.003 (accessible to internal users only). Total: 2.

 Click here to expand...

Bug

  • [DMAS-55889] - Errors in Hydrophone Postprocess job

Task

  • [DMAS-55804] - Please use the maximum frequency logger to log the warning message while loading ST cache

July 21, 2020

Minor release: Numerous bug fixes and minor features in preparation for several demonstrations: SeaTube, Community Fishers, PAMGuard, etc.

Tickets Released: Oceans 2.0: 20.06.002 (accessible to internal users only). Total: 22.

 Click here to expand...

Bug

  • [DMAS-55579] - DMAS Task logs have changed, task monitoring now broken
  • [DMAS-55630] - Fix broken test in FileManagement/checkFileCleanup
  • [DMAS-55709] - Device service return not correct in both qa and prod
  • [DMAS-55713] - Please change the device service parameter call to use deviceCategoryIds instead of deviceCategoryId
  • [DMAS-55726] - Stuck Cast Data Correction Job in QA
  • [DMAS-55733] - Update Matlab search commands to use -batch instead of -r as startup option.
  • [DMAS-55735] - Restore the Anonymous user account
  • [DMAS-55765] - Remove extra quotes from matlab postprocess jobs
  • [DMAS-55772] - Metadata point of contact is null for all datasets in PROD
  • [DMAS-55779] - Fix annotation export so that annotations with no comments are included
  • [DMAS-55780] - The seek bar is broken for dive video. The video didn't play where I clicked
  • [DMAS-55782] - ST main page goes to blank when I click an annotation in the annotation list
  • [DMAS-55787] - dataProductDelivery request methods without a filter cause http 500

Task

  • [DMAS-55555] - Investigate why there are trees in V3 but not V1
  • [DMAS-55606] - Please add backend support for exporting annotations in case of fixed location camera
  • [DMAS-55666] - Add two buttons for first video clip and last video clip
  • [DMAS-55739] - Please change the frontend code for video files to speed up the video widget

Implementation

  • [DMAS-55112] - Implement allowAny for the Hydrophone Toolbox color limits
  • [DMAS-55634] - Setup pamguard app path in QA environment
  • [DMAS-55673] - backend redirect to devicelisting from sdm
  • [DMAS-55705] - add caching support for this service
  • [DMAS-55706] - change the output data structure if needed

July 14, 2020

Minor release: QAQC bug fix.

Tickets Released: Oceans 2.0: 20.06.001 (accessible to internal users only). Total: 1.

 Click here to expand...

Bug

  • [DMAS-55719] - autoQAQC test not applied to MMI buoy data

July 6, 2020

Major release (smaller than a normal major release as development time was only two weeks)

Instruments

  • Data acquisition bottleneck detection and quarantine: quarantine feature now active using non-durable queues, detection is ready but not active (project complete)
  • Data acquisition prioritization / multi-queues (starting)
  • CVAUI conference website (4th Workshop on Computer Vision for Analysis of Underwater Imagery), ready to move to new system (in-progress)
  • Kugluktuk AIS/Siitech integration (in-progress)
  • PAMguard (automated acoustic detection of marine mammals) (in-progress)
  • STRAW-b drivers and integration (starting)
  • Holyrood drivers (in-progress)
  • Acoustic Scintillation driver (starting)
  • Citizen Scientist (Community Fishers) data acquisition Android app: fixes for GPS issues, parser/driver improvements, data destination (in-progress)

Data Products

  • PAMguard pre-processor (complete)
  • CODAR radial data availability and netCDF product (in-progress)

Complex Data Player

  • Caching images (in-progress)
  • Make use of new user input options in viewer (in-progress)
  • Bug fixes

Maintenance and Production Developer

  • Bug fixes
  • Updates / fixes for multiple owner/organization per device
  • Internal web service permission / security improvements (complete)
  • External web service improvements (in-progress)
  • Deprecate old pages (Device Sync, Status Console, System Console, Schedule Console)
  • Device clone now includes L22 device device vocabularies
  • Automated UI testing (in-progress)
  • DAF testing / prep for maintenance cruises

Community Fishers

  • Pipeline improvements: configurable by device-time triplets for active processing and re-post-processing, update depth calibration formula for better GPS integration, email on cast detection
  • GeoSpatial Map improved display of restricted data products and locations
  • siteDeviceSubset editing

SeaTubeV3 - CANARIE & NOAA & ONC

  • Annotations for fixed location cameras
  • Performance improvement for fixed location cameras (in-progress)
  • Annotation entry updates, including OBIS count addition for existing annotations

Dashboards - CANARIE

  • Design and start of implementation of Selectors (a location based way of selecting data)
  • Better autocomplete
  • Fixed issue with menu display when plotting utility widget used

MINTED - CANARIE

  • Added ability to hide batch tasks
  • Improve task management testing
  • siteDevice metadata change task now added under triggers group

CIOOS / ERDDAP

  • Phase 2 initiation, open source contributions are being planned
  • bug fixes

Tickets Released: Oceans 2.0: 20.06.000 (accessible to internal users only). Total: 105.

 Click here to expand...

Bug

  • [DMAS-48341] - getEarthquakeDetectionStatus for external web service status get 500 internal server error
  • [DMAS-49530] - As CF app user I would like the app to retry getting the data automatically if the first transfer is unsuccessful
  • [DMAS-53914] - Metadata XML report for State of Ocean/Env searches randomly picks sensors to report on
  • [DMAS-54360] - Fix broken tests in createNewDashboard of DashboardManagement
  • [DMAS-54373] - Fix broken tests in triggerAlarm of JunctionBoxControlAndMonitoring
  • [DMAS-54949] - Fix save error and non-editable input box in adding a new sea script
  • [DMAS-55166] - Oceans 2 menu bar not showing properly in Dashboards
  • [DMAS-55198] - Removing a task from an Open group changes group status to Cancelled
  • [DMAS-55235] - Fix broken test in dashboards/DashboardSharing/deleteAdvancedPermission
  • [DMAS-55239] - Fix broken tests in usermanagement.replication/UserReplication
  • [DMAS-55305] - Fix broken test in geospatialMap.GeospatialMap.filterCasts
  • [DMAS-55313] - Fix broken tests in datapreview.generationAndDisplay
  • [DMAS-55383] - fix broken test in TaskDefinitionTest, test delete parameter
  • [DMAS-55461] - SearchTreeMaintenance can't find dt-arrow-up.png
  • [DMAS-55496] - Oceans 2 pages log 404 error loading taskManagementBatchService.js in dev
  • [DMAS-55515] - UI test suite fails with "TestNGException: SystemConsole.reloadCache() depends on nonexistent method cacheManagementTest"
  • [DMAS-55518] - Fix broken test in deviceAndSensor checkSiteTab
  • [DMAS-55537] - The information of hover over tooltip for video is not correct. But the zoom seek bar works.
  • [DMAS-55546] - Fix broken test in DeviceAndSensorTest setup
  • [DMAS-55564] - update site device page title
  • [DMAS-55566] - CastIngestionJob unit tests failing on Oceans 2.0 master branch
  • [DMAS-55573] - Getting dataset could not be updated error when attempting to deprecate
  • [DMAS-55579] - DMAS Task logs have changed, task monitoring now broken
  • [DMAS-55581] - Missing DOI data throwing exceptions again
  • [DMAS-55585] - MetaDataException thrown from DatasetManager incorrectly from null French abstracts
  • [DMAS-55599] - Task RunOncePerDay is not being respected anymore
  • [DMAS-55605] - cannot update site in sitedevice editor
  • [DMAS-55607] - The zoom seek bar is not lined-up with build-in seek bar.
  • [DMAS-55628] - Fix broken test in DeviceAttributesTest
  • [DMAS-55629] - Fix broken test in Hydrophone
  • [DMAS-55642] - Fix broken test in PU, autoUI fails on plotPointDetails
  • [DMAS-55643] - When the Task Management Batch merged in with Task Management the More info on tasks changed
  • [DMAS-55647] - adding a resource role gives error.
  • [DMAS-55648] - VocabularyTermResource doesnt load in dev and QA
  • [DMAS-55654] - Fix broken UI test in Taxonomy

User Story

  • [DMAS-14705] - connecting/disconnecting a device to topology should not necessarily add a new sitedevice entry
  • [DMAS-33478] - As an observatory administrator, I want access to internal web services to be restricted so that a malicious user can't bypass page access control (framework support)
  • [DMAS-43256] - As a developer I want to remove the Scheduler Console after it's functionality has been replaced
  • [DMAS-52447] - As a Data Steward, I would like the owner field of the device to allow us to have a datefrom and more than one assigned owner over time
  • [DMAS-53564] - As a user, I would like to remove old status console and old system console from dmas menu
  • [DMAS-53579] - As a data user I want a service that returns citation text for a DOI in a webservice so I can automate my data processing
  • [DMAS-54231] - As an Oceans 2.0 Web Services user I would like to scope the effort required for the public/external Web Services Improvements Sprint
  • [DMAS-54510] - Add dataproduct name to the Query Details on dataset landing page
  • [DMAS-54551] - Remove completed transactions from batch
  • [DMAS-54576] - landing pages need to be able to support tombstone datasets
  • [DMAS-54587] - View the children of a task
  • [DMAS-54820] - As a Community Fisher user, I do not want Cast Detection triggered by file_state C
  • [DMAS-54847] - DFO would like ONC to detect SRKWs using PAMGUARD's whistle and moan detector
  • [DMAS-54928] - data acquisition and camera control support for the new ONC lights
  • [DMAS-55197] - As a dev, I would like to remove old Device Sync page

Task

  • [DMAS-53293] - Add driver commands to HoloSea driver set GAIN and STROBE
  • [DMAS-54097] - add/update related tests for Device Sync in web service test automation
  • [DMAS-54917] - Add batchable RDI task definition
  • [DMAS-55028] - Reprocessing via batch should use all the machines selected in ReprocessConsoleBatch
  • [DMAS-55167] - Each siteDeviceSubset on the SearchTreeMaintenance page should have a link to its entry on the SiteDeviceSubsetMaintenance page
  • [DMAS-55175] - make task information tests more reliable
  • [DMAS-55298] - Make it easier to skip loading non-essential caches in DEV
  • [DMAS-55379] - Update UI testing for changes to device cloning including L22 device vocabularies.
  • [DMAS-55438] - Fix various SeaTube ui tests
  • [DMAS-55456] - Please re-visit selenium script for topology
  • [DMAS-55511] - Please implement backend support to get private annotations for the logged in users for annotation service
  • [DMAS-55512] - Please add backend support for ONC dive loggers input public annotations for fixed location cameras. Other users can only enter private annotations
  • [DMAS-55530] - allowAny text box on datasearch should give warning message when left empty.
  • [DMAS-55549] - Create a normalization function for PAMguard postprocessor
  • [DMAS-55552] - Write UI Test for link on subset tab in SearchTreeMaintenance
  • [DMAS-55568] - Remove reference to the task tables in SearchHdrState.hbm.xml
  • [DMAS-55572] - Quarantine feature - remove use of durable topics
  • [DMAS-55577] - Please add frontend support in Manual Entry widget for ONC dive loggers input public annotations for fixed location cameras. Other users can only enter private annotations
  • [DMAS-55608] - Please change Previous Day and Next Day button to Previous clip and Next clip since some location the duration between each clip is not 24 hours

Design

  • [DMAS-55178] - Create UI design for SeaTube Search to support fixed location cameras

Implementation

  • [DMAS-53169] - Update dataset manager based on updated metadata profile
  • [DMAS-53337] - Metrics Monitoring Process
  • [DMAS-53450] - Add table QuarantineClassifier
  • [DMAS-53477] - Implementation of quarantine features in device console page.
  • [DMAS-53642] - Implement archive component for quarantine changes
  • [DMAS-54183] - Use JSON fields in table qa_metricsummary
  • [DMAS-54314] - Populate quarantine widgets metrics table
  • [DMAS-54926] - Update CKAN API to use ISO19115XMLDatasetAssembler
  • [DMAS-55119] - Finish implementation of device quarantine filter button
  • [DMAS-55124] - Split web service test tree nodes into separate service/user nodes
  • [DMAS-55125] - Automatically create several likely user nodes when adding a new web service test
  • [DMAS-55321] - ssh base driver for straw drivers
  • [DMAS-55360] - Cast Detection Override options should be triplets (deviceId, dateFrom, dateTo) due to requirement change
  • [DMAS-55386] - Do not create a new site device when a device is connected to/disconnected from a topology if flag is selected
  • [DMAS-55389] - Update UI testing for changes to Topology View
  • [DMAS-55396] - Remove the old system console from the java code
  • [DMAS-55454] - Send an email when casts are detected to email addresses in job parameters
  • [DMAS-55462] - remove old Device Sync page - BE
  • [DMAS-55464] - remove status console - BE
  • [DMAS-55465] - remove status console - AT
  • [DMAS-55487] - implement support for deviceCategoryCode in the payload of the device api
  • [DMAS-55491] - implement support for deviceCategoryCode in the payload of the deployment api
  • [DMAS-55500] - Create a flag on Topology View to select if a new site will be selected for a device added or removed from topology
  • [DMAS-55553] - Modify web service call dataProductDelivery to accept new parameter and enable caching
  • [DMAS-55644] - Troubleshoot ONC Lights Device

Test

  • [DMAS-55397] - update selenium tests to use the new system console
  • [DMAS-55463] - remove old Device Sync page - AT
  • [DMAS-55590] - update doidataset web service tests for UPDATE

Bug (ST)

  • [DMAS-54474] - Drag toolbox away from screenshot comparison in DataViewer UI tests
  • [DMAS-55526] - Uncaught (in promise) TypeError: Cannot read property 'dpRunId' of undefined
  • [DMAS-55528] - Odd scribbles above the first image bar.
  • [DMAS-55567] - Align spectrograms from R2019a Matlab
  • [DMAS-55569] - Spectrograms are not requested on the 5 min mark for on the fly generation.
  • [DMAS-55570] - Spectrograms are not displayed in the correct order when generated on the fly

Documentation

June 30, 2020

Minor release: bug fix for MINTED/DOI and a fix for task parameters that were missed in the task batch migration.

Tickets Released: Oceans 2.0: 20.05.004 (accessible to internal users only). Total: 3.

 Click here to expand...

User Story

  • [DMAS-51134] - As a Oceans 2 data user I want to download metadata for a DOI

Task

  • [DMAS-55562] - Provide clarity on recent switch to tm_task tables

Implementation

  • [DMAS-55140] - update web service tests DOIDatasetService download metadata 

June 25, 2020

Minor release: bug fixes for Imagenex driver, annotations, task/job and Data Search unable to add to cart issue.

Tickets Released: Oceans 2.0: 20.05.003 (accessible to internal users only). Total: 7.

 Click here to expand...

Bug

  • [DMAS-16006] - Imagenex Sonar Driver doesn't stop
  • [DMAS-55509] - No one can edit public annotations except the creator for fixed location cameras
  • [DMAS-55523] - Many scheduled tasks failing - NullPointerException
  • [DMAS-55554] - Investigate why there are video files in V1 but not V3 for tree node 413 in prod
  • [DMAS-55557] - Data Search add to cart option does not work
  • [DMAS-55579] - DMAS Task logs have changed, task monitoring now broken

Task

  • [DMAS-55550] - Please add some indication (No Data ?) in the Annotation List widget when there is no annotation for a given dive or search tree node.

June 24, 2020

Minor release: React webserver hot fix only (no down time) for siteDevice and fixed location video UI bugs and improvements.

Tickets Released: Oceans 2.0: 20.05.002 (accessible to internal users only). Total: 4.

 Click here to expand...

Bug

  • [DMAS-55450] - Fix sitedevice form to submit batch
  • [DMAS-55535] - I got an empty page when there is no video file for a fixed location camera tree node. 
  • [DMAS-55536] - The resource drop down always call searchTreeNodeId=29

Task

  • [DMAS-55388] - Enable next/previous day buttons for fixed location videos

June 23, 2020

Minor release: task, job and Data Search bug fixes.

Tickets Released: Oceans 2.0: 20.05.001 (accessible to internal users only). Total: 14.

 Click here to expand...

Bug

  • [DMAS-55428] - Inconsistent behavior in ST Search page
  • [DMAS-55506] - Resource Dropdown not loading resources on fixed camera videos
  • [DMAS-55510] - Annotation service returns annotations for devices which are not in the tree node
  • [DMAS-55519] - DeviceService operation 28's parameter "deviceCategoryId" should be plural
  • [DMAS-55523] - Many scheduled tasks failing - NullPointerException
  • [DMAS-55524] - Cannot add any CODAR data products or data products with no option to cart in Data Search
  • [DMAS-55525] - Since the June 22nd 2020 release, my Data Search cart is full of old searches
  • [DMAS-55527] - Paging in Task Managment is broken
  • [DMAS-55536] - The resource drop down always call searchTreeNodeId=29
  • [DMAS-55544] - Error in task 499 - need to update historical dataproduct upload tasks to use correct task type

Implementation

  • [DMAS-54396] - Add inputex field for radio buttons with associated text input.
  • [DMAS-55392] - Modify table and config window to have an RO mode
  • [DMAS-55471] - Create transaction table
  • [DMAS-55485] - Update UI labels and fields

June 22, 2020

Major release with many new features and substantial changes (record number of tickets included).

Instruments

  • Data acquisition bottleneck detection and reaction: implementation of automated quarantine of problematic / late data (complete, not active)
  • CVAUI conference website (4th Workshop on Computer Vision for Analysis of Underwater Imagery) (in-progress)
  • AIS/Siitech integration (in-progress)
  • PAMguard (automated acoustic detection of marine mammals) (in-progress)
  • STRAW-b drivers and integration (starting)
  • Citizen Scientist (Community Fishers) data acquisition Android app (several improvements released, in-progress)

Data Products

  • Configurable CODAR plot limits
  • MATLAB version update to R2019a - this affects all data products, changes throughout the code base to support the new software

Complex Data Player

  • caching images (in-progress)
  • Make use of new user input options in viewer (in-progress)

Maintenance and Production Developer

  • Maintain / support for ONC website
  • Bug fixes
  • Multiple owner/organization per device
  • Internal web service permission / security improvements (in-progress)
  • Sensor-level data ratings for sensors applied to products and services (in-progress)
  • Automated UI testing (in-progress)
  • DAF testing / prep for June cruise (in-progress)

Community Fishers / EMSA

  • Improve pipeline: move away from file_state trigger
  • Community Fishers support, support of new instrumentation (in-progress)

SeaTubeV3 - CANARIE & NOAA & ONC

  • Fixed location cameras in search tree and map with detailed information (deployed, not activated)
  • Annotation entry updates
  • Video zoom bar for large files
  • Support for video files without proper dateTo

Dashboards - CANARIE

  • Restarted, requirements, design, widget communication (in-progress)

MINTED - CANARIE

  • Switch to new task data model and system to support batching tasks
  • New siteDevice page
  • "Tombstone" or effectively delete DOI
  • API for DOI landing page
  • Small changes to complete project

CIOOS / ERDDAP

  • XML dataset improvements (change names to match title)
  • ERDDAP for other data types (in-progress)
  • ROR (research organization registry) support

Tickets Released: Oceans 2.0: 20.05.000 (accessible to internal users only). Total: 304.

 Click here to expand...

Bug

  • [DMAS-53715] - Fix broken test in AnnotationManagement
  • [DMAS-53784] - Fix broken tests in DeviceActionMaintenanceTests
  • [DMAS-53890] - Clear button on reprocess console does not work as expected for a little long list of queued jobs
  • [DMAS-54349] - fix broken tests in testGroupPermissions of Groups
  • [DMAS-54355] - Fix broken tests in appearance of Simulator
  • [DMAS-54430] - Fix broken test in seatubeV3.DiveDetailsTest.contentONC
  • [DMAS-54445] - Fix broken test in uiElements and levels of DigitalFishers
  • [DMAS-54455] - AnnotationService is missiong location data output
  • [DMAS-54580] - QA datacentre returns status 500 when trying to load any page
  • [DMAS-54787] - Hide password input in task parameters on TaskManagementBatch add batch task form
  • [DMAS-54792] - DeviceListing, SensorListing: Batch dropdown is not always visible
  • [DMAS-54900] - TaskManagementBatch: First characters remain in Add Batch dialog
  • [DMAS-54913] - Reprocess tasks don't show up in Reprocess Console
  • [DMAS-54934] - fix broken tests in topology
  • [DMAS-54936] - CloneDevice Test fails depending on order tests are ran
  • [DMAS-54938] - New system console displays an empty set of parentheses in the "Version" column
  • [DMAS-54942] - fix DeviceControl tests 301-800 for april regression
  • [DMAS-54951] - Fix broken tests in SCUAcquisition Port Settings
  • [DMAS-54982] - ADCP toolbox colormap option not functional
  • [DMAS-54995] - DMAS Search Failed Notification: 07-May-2020 16:23:33 UTC, null, Video Export, SearchHdrId 5093030, UserId 49970
  • [DMAS-54997] - User reporting inconsistent downsampling in CSV data products
  • [DMAS-55010] - Parameters in Add Task to Batch are not sorted and should be
  • [DMAS-55011] - Custom fields for sandbox tasks are not showing and need to be
  • [DMAS-55035] - Driver machines are subscribing to too many queues
  • [DMAS-55041] - Fix broken tests in Hydrophone
  • [DMAS-55043] - Fix broken tests in GeospatialMap
  • [DMAS-55044] - "null" title and abstract for DOI
  • [DMAS-55048] - Fix broken test NewSystemConsole.pagePermission
  • [DMAS-55052] - Fix broken test Messaging.checkDeviceId24196
  • [DMAS-55055] - UI test suite failed
  • [DMAS-55067] - DMAS Search Failed Notification: 14-May-2020 12:30:16 UTC, Barkley Canyon-Barkley Canyon Mid-East, Time Series Scalar Plot, SearchHdrId 5098187, UserId 40000
  • [DMAS-55075] - Fix failing UI test in Plotting Utility
  • [DMAS-55082] - File Archive Job errors when running in the new task framework
  • [DMAS-55087] - The task machines in QA cannot be Quiesced
  • [DMAS-55089] - Fix automatic merge Failure
  • [DMAS-55105] - "Fix" broken UI tests on Users
  • [DMAS-55109] - Batch table not populating correctly
  • [DMAS-55133] - The SiteDeviceMaintenance page does not display the deviceId
  • [DMAS-55144] - UI test suite failed with "NoSuchWindowException: no such window: target window already closed"
  • [DMAS-55147] - Cannot access device details of Pro-Oceanus device in QA environment.
  • [DMAS-55161] - Baynes sound driver JVM is getting commands meant for Digby's AGO lights
  • [DMAS-55162] - Fix sorting on dashboard name in Dashboards table
  • [DMAS-55174] - DatasetLandingPage crashes when loading a second DOI sometimes
  • [DMAS-55199] - DMAS Search Failed Notification: 29-May-2020 17:59:05 UTC, Strait of Georgia-CF0031, Cast Scalar Multi-Profile Plot, SearchHdrId 5176581, UserId 15356
  • [DMAS-55200] - DMAS Search Failed Notification: 29-May-2020 17:59:05 UTC, Strait of Georgia-CF0031, Aligned and Depth-Binned Profile Data (On-Demand), SearchHdrId 5176581, UserId 15356
  • [DMAS-55201] - New site device page failing
  • [DMAS-55218] - Fix broken tests in AttributionManagement of dataproduct.attribution
  • [DMAS-55225] - Fix broken test in DataAvailabilityPlot of dataproduct.metadataReportGeneration
  • [DMAS-55227] - Fix broken tests in DataPreviewManagement of datapreview.management
  • [DMAS-55228] - Fix broken tests in DataPreviewAnnotation of datapreview.annotation
  • [DMAS-55229] - Fix broken test in datadownload.recurringSearches/RecurringSearches
  • [DMAS-55237] - Fix broken tests in usermanagement.users/Users
  • [DMAS-55238] - Fix broken test in dataacquisition.cameraControl/CameraControl/testWatcherPermission
  • [DMAS-55240] - Fix broken test in usermanagement.groups/Groups/checkResourceNames
  • [DMAS-55246] - Fix broken tests in searchTreeMaintenance/PrimarySensorTest
  • [DMAS-55248] - Fix broken test in geographicInformation/GeographicInformation/addDevice
  • [DMAS-55249] - Fix broken test in deviceAttributes/DeviceAttributesTest/changeAttributeComment
  • [DMAS-55250] - Fix broken test in deviceAndSensor/DeviceDetailsTest/checkSiteTab
  • [DMAS-55251] - Fix broken tests in checkDeviceListing and checkBatchDropdown of deviceAndSensor/DeviceAndSensorTest
  • [DMAS-55252] - Fix broken test in annotationmanagement/AnnotationManagement/checkAnnotationList
  • [DMAS-55261] - Unable to run Reprocess Group task
  • [DMAS-55263] - Update DataProductUploadService task type to be under triggers
  • [DMAS-55283] - qadcdrv1 gets ClassNotFoundException every 5 seconds
  • [DMAS-55285] - Registration page is in 'Edit Mode' for new users
  • [DMAS-55286] - fix broken test in FileManagement/checkArchiveFileAnnotations
  • [DMAS-55287] - fix broken tests in DataSearch
  • [DMAS-55288] - DeviceService operation 28's results are incorrect
  • [DMAS-55289] - Update and fix broken tests in several web services (listed in description)
  • [DMAS-55301] - Data Player's ADCP plots are misaligned
  • [DMAS-55306] - Fix broken test in geospatialMap/GeospatialMap/downloadPlot
  • [DMAS-55307] - Fix broken test in geospatialMap/GeospatialMap/downloadLastestCastTxt
  • [DMAS-55308] - Fix broken test in geospatialMap/GeospatialMap/downloadCor
  • [DMAS-55309] - Fix broken test in geospatialMap/GeospatialMap/checkBasicPopupFunctionality
  • [DMAS-55317] - Fix broken test in filemanagement/FileManagement/changeFileState
  • [DMAS-55366] - Exception thrown when running archive file annotations
  • [DMAS-55394] - Get exception when finding DOI provenance
  • [DMAS-55402] - Fix Playlist Management to use new resource type URLs for STV3
  • [DMAS-55407] - Dive detail is not working in Expedition Management Page
  • [DMAS-55410] - Users have to login to see the Fixed Location Camera tree. Please let anonymous users access the information as well.
  • [DMAS-55411] - The description in Fixed Location tree node is using HTML format. Please use plain text.
  • [DMAS-55413] - The help tooltip is missing for the video seek bar.
  • [DMAS-55414] - qasobcshore1 cannot initialize TaskServiceManager
  • [DMAS-55415] - Fix broken test in RealTimeObservations
  • [DMAS-55419] - Task query for getting last date of run isn't working
  • [DMAS-55420] - Fix failing tests in GenerationAndDisplay
  • [DMAS-55422] - Copy permalink is broken
  • [DMAS-55424] - Fix failing tests in PlottingUtility
  • [DMAS-55426] - fix broken test in Explore
  • [DMAS-55429] - ST serach page has error where url contains cruiseIds
  • [DMAS-55436] - Fix scroll broken on DeviceListing page
  • [DMAS-55440] - SeaTubeV3 annotation filter fails with certain search tree node IDs
  • [DMAS-55443] - UI test suite failed with "Error forwarding the new session Empty pool of VM for setup Capabilities"
  • [DMAS-55444] - qaqoakbay cannot initialize TaskServiceManager
  • [DMAS-55445] - Device clone failed for device 20002 and led to a 500 error
  • [DMAS-55446] - Fix broken test searchTreeMaintenance.SearchTreeMaintenance.checkSearchTreeMaintenancePageAsAdmin
  • [DMAS-55450] - Fix sitedevice form to submit batch
  • [DMAS-55467] - Investigate Data Preview Generation errors due to outdated cache
  • [DMAS-55468] - Please fix a few layout issues for ST FixedSearchTreeNode
  • [DMAS-55486] - Permalink from video player contains an unnecessary & before resourceTypeId
  • [DMAS-55495] - Fix permalinks to work for fixed cameras
  • [DMAS-55503] - SeaTubeV3AnnotationService may filter by date too late

User Story

  • [DMAS-42103] - As a scientific programmer, refactor onc-data-products code to work in latest version (R2019a) of MATLAB
  • [DMAS-52003] - As a ST user, I would like to have a way to choose video segments for a given timestamp
  • [DMAS-53868] - Run batch tasks
  • [DMAS-54074] - View batches
  • [DMAS-54090] - As a dev, I would like to see test automation capture change did in DMAS-54049
  • [DMAS-54574] - Ignore sitedevices where the site is related to Community Fishers
  • [DMAS-54773] - as a tester i want to improve the page object model of the AnnotationManagement UI tests
  • [DMAS-54825] - Fix broken tests in SeaScriptManagement
  • [DMAS-55025] - Display batch reason in batch list
  • [DMAS-55036] - Add batchable flag to Task Definition UI

Task

  • [DMAS-47809] - Add more test cases for GET methods of DiveListingService
  • [DMAS-53486] - As a data steward, I would like the L22 controlled vocabulary mapping included in the device cloning
  • [DMAS-53628] - CODAR quality controlled plots: allow the velocity scale upper limit to be tuneable
  • [DMAS-54148] - add an option to set the file_state of files to 'E' in File Management
  • [DMAS-54176] - Modify TaxonButtonSetService to remove unnecessary information
  • [DMAS-54247] - Add test cases in search automation for Cast Scalar Multi-profile plots with data
  • [DMAS-54269] - v3 exports should include ALL sensors, not just displayed values
  • [DMAS-54293] - Feedback on State of the Ocean Climatology Plots
  • [DMAS-54417] - Fix broken test in DataSearch.primarySensorSearch
  • [DMAS-54421] - Fix broken test in testErrorMessage and getQueryContents of DatasetLandingPageTest
  • [DMAS-54481] - Add selenium test for TaskManagement(Batch) parameter deletion
  • [DMAS-54547] - Enable CANARIE registry service
  • [DMAS-54806] - Update landing page selenium tests to check for RORId links
  • [DMAS-54816] - Hide the Generate DOI button on the Site Device Maintenance page until we figure out what to do with it
  • [DMAS-54843] - Add web service tests for DOIDatasetService
  • [DMAS-54883] - As an engineer and science user I would like modifications to the Buoy Profiling System driver
  • [DMAS-54914] - Any user action that results in a change with the batch shouldn't require a refresh
  • [DMAS-54954] - CODAR plot lat/lon limits too small for JR and RR stations
  • [DMAS-55005] - Complete migration to new task framework
  • [DMAS-55014] - Update DOIRegistrationBatchJob so it includes all functionality from DOIRegistrationJob
  • [DMAS-55015] - Replace second Task Id column with Task Definition Id
  • [DMAS-55023] - Display long reason in DOI history without making the user scroll the table horizontally
  • [DMAS-55024] - Allow the batch reason to be edited in any state
  • [DMAS-55030] - unable to use DataProductUploadService within batch 480
  • [DMAS-55046] - Change required date format in reprocess group so that time isn't required
  • [DMAS-55054] - Only show the status filters applicable to batches
  • [DMAS-55058] - Add parent task type to task type table
  • [DMAS-55084] - Update TaskManagement selenium tests to no longer reference TaskManagementBatch
  • [DMAS-55094] - Rename "Data Change" task type to "Metadata Change"
  • [DMAS-55142] - Dataset creators need to be listed alphabetically in the citation text
  • [DMAS-55163] - Change format of date time used in Dashboards table
  • [DMAS-55173] - Upgrade Chromedriver to version 83
  • [DMAS-55184] - Download file from ISO19115 service instead of showing XML in browser
  • [DMAS-55207] - Allow unauthenticated users to access ISO19115 service
  • [DMAS-55244] - Allow flac overwrites and edge case in hydrophone calibration
  • [DMAS-55393] - Update QaDeviceTests
  • [DMAS-55412] - Add ST Search button on all the Fixed Location tree nodes and on the Node Detail panel as well.
  • [DMAS-55430] - Modify seatube/search/user-option service to return a list of creators and modifiers
  • [DMAS-55439] - Change seekbar to be more precise
  • [DMAS-55451] - Disable the Export button if the user is not logged in
  • [DMAS-55452] - Create Search Tree Node Resource Select
  • [DMAS-55460] - Add configuration flag to enable/disable quarantine feature.

Requirement

  • [DMAS-54907] - Gather requirements for access control
  • [DMAS-55069] - Document requirements for testing

Design

  • [DMAS-54525] - Design of device owners (UI part)
  • [DMAS-54908] - Create design for access control
  • [DMAS-54964] - Design DOI Dataset API Service
  • [DMAS-55000] - Design landing page tombstone implementation - BE
  • [DMAS-55070] - Create test design
  • [DMAS-55071] - Create mockup for batchable flag on Task Definition
  • [DMAS-55130] - Design Service for removing tasks
  • [DMAS-55138] - Design RO version of SiteDeviceMaintenance page

Implementation

  • [DMAS-52544] - Fix plot differences between 2014a and 2019a
  • [DMAS-53247] - Device quarantine bitbucket placeholder
  • [DMAS-53596] - Add web service automation tests for citationText
  • [DMAS-53636] - Validate XML against schema
  • [DMAS-53643] - Implement UI messages for quarantining
  • [DMAS-53677] - Refactor dataset object to use enums to match types defined in ISO19115
  • [DMAS-53689] - Write Selenium tests for DV.TC.104 - DV.TC.105
  • [DMAS-53760] - Investigate Zoom in Seekbar
  • [DMAS-53791] - Use the POM in ca.uvic.onc.test.ui.test.extension.geospatialMap.GeospatialMap
  • [DMAS-53833] - use the POM in ca.uvic.onc.test.ui.test.extension.dataacquisition.seascriptManagement.SeaScriptManagement
  • [DMAS-53900] - Add backend logic for adding fixed camera locations to SeaTubeV3's expedition landing page
  • [DMAS-53937] - remove ScheduledConsole from dmas menu
  • [DMAS-53976] - Add selenium tests run
  • [DMAS-54069] - Modify DeviceListing selenium tests for batching
  • [DMAS-54091] - Add new tests in usermanagementservice to use RO user in test cases
  • [DMAS-54126] - implement back-end changes for dataset service
  • [DMAS-54143] - Refactor V3 video panel to play video for fixed cameras
  • [DMAS-54396] - Add inputex field for radio buttons with associated text input.
  • [DMAS-54476] - Implement DataSearchURL link opening another tab and have an external link icon
  • [DMAS-54522] - Create DeviceResourceRole classes to support multiple owners of device
  • [DMAS-54523] - Create or modify database tables
  • [DMAS-54524] - Add new tab to device details
  • [DMAS-54585] - add selenium tests for batchable tasks
  • [DMAS-54591] - Create new classes and assembler to create ISO 19115 Metadata
  • [DMAS-54759] - Implement removing a data change task from a batch - UI
  • [DMAS-54760] - Implement removing a data change task from a batch - BE
  • [DMAS-54761] - Add selenium tests for removing a trx from batch
  • [DMAS-54774] - Make sure that tests that search for annotations all use AnnotationSearchForm
  • [DMAS-54775] - Get rid of any overly-specific methods of AnnotationSearchPage
  • [DMAS-54776] - use TaskManagementPage for methods who use task page in annotationSearchPage
  • [DMAS-54777] - AnnotationSearchPage that return WebElements should return objects
  • [DMAS-54813] - Update landing page selenium tests for device listing link
  • [DMAS-54824] - Update landing page selenium tests for new DOI history columns
  • [DMAS-54841] - Add indication and links for doi datasets
  • [DMAS-54857] - DeviceCacheLoader should implement EhcacheLoader, not DomainCacheLoader
  • [DMAS-54858] - Remove ExplicitLockingCache
  • [DMAS-54875] - Create backend call to retrieve details for a fixed camera search tree node
  • [DMAS-54892] - Remove EhcacheLoader.setBundle and .setCacheClass
  • [DMAS-54901] - Update UI tests for datasearch to test new allowAny option.
  • [DMAS-54902] - Implement allowAny on dataProductDelivery
  • [DMAS-54904] - Modify matlab dataViewerSpectrogram to support allowAny options
  • [DMAS-54919] - Refactor V3 details panel for search tree nodes
  • [DMAS-54920] - add excludeLocations to task definition detail
  • [DMAS-54921] - exclude location in doi minting backend
  • [DMAS-54969] - Update DOIDatasetService to return the data product id when a query PID is requested
  • [DMAS-54970] - Link the data product name to the data product documentation on the external wiki
  • [DMAS-54971] - Create indication for ERDDAP datasets
  • [DMAS-54972] - Implementation of sensor level DataRating in Java 70% rule
  • [DMAS-54977] - Add ui tests for test cases DV.TC.106 and DV.TC.113
  • [DMAS-54979] - Remove/deprecate unused authentication misfeatures
  • [DMAS-54992] - Refactor search tree node video call to use SeaTubeResourceHelper for a given search tree node
  • [DMAS-54994] - Add a test to the Dataset Landing Page to test the hyperlink on the Data Product Name
  • [DMAS-54999] - Remove unused privilege code
  • [DMAS-55001] - Implement changes to make the search an actions bar
  • [DMAS-55002] - Create UI configuration window
  • [DMAS-55003] - Add new table on new owner history tab
  • [DMAS-55004] - Add service calls to front end
  • [DMAS-55009] - Add additional logging to snapshot generation
  • [DMAS-55018] - Convert cache loaders in API bundles to services
  • [DMAS-55019] - Create a special case in CacheLoader for DomainCacheLoader
  • [DMAS-55020] - 2019a va 2014a plotting differences: device level time series scalar - spacing and bullets in titles
  • [DMAS-55021] - 2019a va 2014a plotting differences: sensor level time series scalar: spacing, sizes, fonts
  • [DMAS-55022] - Implement the ability to tombstone a DOI from the landing page
  • [DMAS-55047] - Implement web service access control
  • [DMAS-55050] - update selenium tests for deviceListing and dataSearch page links opening in a new tab.
  • [DMAS-55060] - change host name to reason in batch table
  • [DMAS-55061] - update selenium BatchTest table components
  • [DMAS-55072] - add batchable flag for task definition
  • [DMAS-55090] - Create basic device history table on UI according to design
  • [DMAS-55091] - Implement job for Tombstoning DOI
  • [DMAS-55099] - update selenium tests for DatasetLandingPage
  • [DMAS-55102] - Extract ui-testing's TestConfig.User to its own file, so that the automation tool can display a link to that file as a list of recommended users.
  • [DMAS-55103] - Implement the front end code to display the fixed location camera tree and add actions to related tree node
  • [DMAS-55104] - Implement the Fixed Location Camera detail panel and map markers
  • [DMAS-55108] - Add "Add Role" button to device history table
  • [DMAS-55110] - Display batch drop-down on Site Device Maintenance page
  • [DMAS-55111] - Update site device service so transaction is saved to batch as a trigger
  • [DMAS-55118] - update parent task status when a task is removed from a batch
  • [DMAS-55122] - Create tests for checking that datasetlanding page links open in a new tab
  • [DMAS-55123] - Cache logged-in users in web service tests
  • [DMAS-55127] - Pass batchId from drop down to back-end
  • [DMAS-55128] - Add link to DLP for downloading metadata
  • [DMAS-55129] - Add necessary components to web services for metadata download
  • [DMAS-55137] - Remove links to old siteDevice page and replace with links to SiteDeviceMaintenance
  • [DMAS-55139] - Implement RO version of SiteDeviceMaintenance page
  • [DMAS-55141] - update selenium tests for metadata download links
  • [DMAS-55150] - Add ability to get DOI datasets by siteDeviceId from DOIDatasetService
  • [DMAS-55152] - Remove automation tool "Use CAS Login" parameter
  • [DMAS-55170] - QAQC flags don't agree in one test case in R2019a migration
  • [DMAS-55181] - Resolve merge conflicts from release to master
  • [DMAS-55187] - Increase UI test logging verbosity to list all tests executed
  • [DMAS-55212] - Change Erddap XML to use generated title and abstract
  • [DMAS-55257] - create backend support for searching annotations by a given multiple search tree nodes
  • [DMAS-55264] - Out of position title on cast plot
  • [DMAS-55265] - Processing comment escaped escape symbol in Hydrophone Spect MAT file
  • [DMAS-55268] - allow free run command to be sent over seascript
  • [DMAS-55269] - set @WC command frequency using a device attribute
  • [DMAS-55272] - insert owner and PI to new table
  • [DMAS-55293] - $ symbols in ice buoy time series plot label
  • [DMAS-55294] - Repeated x-axis labels in Ice Buoy Profile plots in R2019a
  • [DMAS-55295] - Investigate small differences in seismometer plots in R2019a vs R2014a
  • [DMAS-55312] - Update R2019a SPD plot axes position, title, axes and comment font sizes to match R2014a
  • [DMAS-55323] - Differences in Imagenex and Kongsberg Rotary plots for R2019a migration
  • [DMAS-55336] - Spatial scalar plot longitude tick labels are displaced up in R2019a
  • [DMAS-55339] - Rendering difference in ASL echogram plots
  • [DMAS-55356] - Remove CasUtils from automation tool
  • [DMAS-55359] - 3D Ice Buoy plots y axis label location is off plot in some cases
  • [DMAS-55390] - BHT plot missing data in R2019a
  • [DMAS-55391] - Add anonymous read privilege to authentication service
  • [DMAS-55400] - Gridded Profile plot comment is too long
  • [DMAS-55401] - Create a predefined layout for fixed cameras in SeaTubeV3
  • [DMAS-55421] - Postprocess jobs that create plots don't have LATEX interpreter switched on
  • [DMAS-55431] - QAQC markers in time series scalar plots are too small
  • [DMAS-55432] - Populate and add functionality for a fixed camera's Annotation List
  • [DMAS-55442] - R2019a fixes for SOO climate & anomaly plots
  • [DMAS-55472] - Add modifyby and modifyDate to the sevice for DeviceResourceRole
  • [DMAS-55475] - Remove owner and PI from Device UI
  • [DMAS-55479] - ARIS plots need $ symbols fixed
  • [DMAS-55494] - Fix UI testing - Remove owner and PI from Device UI

Test

  • [DMAS-52520] - Verify and support MATLAB 2019a migration via search automation
  • [DMAS-55134] - Update selenium tests that referenced old site device page
  • [DMAS-55172] - Performance / reliability testing of MATLAB R2019a: Data Preview & SOO generation + postprocess jobs
  • [DMAS-55206] - Remove SchedulerConsole selenium test

Bug (ST)

  • [DMAS-54404] - Toolbox options are reset when closed and reopened
  • [DMAS-54414] - Fix broken test in GeospatialMap.checkFilterInputValidation
  • [DMAS-54796] - Update geospatial UI tests
  • [DMAS-54963] - Deployment success notification failed: "Needed a single revision"
  • [DMAS-54996] - Data search tree has an extra CTD branch above the Down Cast branch
  • [DMAS-55085] - Address tests being killed by suite timeout
  • [DMAS-55209] - DataPreviewCastGeneratorJob generating searches with duplicate search_dtls
  • [DMAS-55215] - Fix broken tests in geospatialMap.GeospatialMap
  • [DMAS-55216] - Fix broken tests in dataviewer.DataViewer
  • [DMAS-55226] - Fix broken tests in GenerationAndDisplay of datapreview.generationAndDisplay
  • [DMAS-55245] - Fix broken tests in searchTreeMaintenance/SiteDeviceSubsetTest
  • [DMAS-55262] - Any user can call UserManagementService successfully (in QA)
  • [DMAS-55292] - Spectrogram For Hydrophone Viewer colour scale changed in R2019a
  • [DMAS-55399] - Community fisher searches created through Geospatial map lack search_dtls for some casts
  • [DMAS-55417] - VideoFileQAQC job failing due to missing software
  • [DMAS-55498] - CF geospatial map "more" plots not found after being generated (PROD & QA)

Investigation

  • [DMAS-54566] - Create pseudo code for how dataproduct options are handled in dataProductDelivery
  • [DMAS-54981] - Prototype web service access control
  • [DMAS-55114] - Investigate work needed to deprecate old siteDevice page

June 6, 2020

Minor release: CF parser issue.

Tickets Released: Oceans 2.0: 20.04.003 (accessible to internal users only). Total: 1.

 Click here to expand...

Bug

June 2, 2020

Minor release: parser issues.

Tickets Released: Oceans 2.0: 20.04.002 (accessible to internal users only). Total: 3.

 Click here to expand...

Bug

  • [DMAS-55040] - parsed values for P-sensor temperature don't differ in value
  • [DMAS-55186] - Parsed values for BPR Pressure
  • [DMAS-55208] - Solve a conflict in a pull request for parsed values for P-sensor temperature

May 27, 2020

Minor release: driver bug fix.

Tickets Released: Oceans 2.0: 20.04.001 (accessible to internal users only). Total: 14.

 Click here to expand...

Bug

  • [DMAS-54947] - QAQC flag inheritance does not work immediately after devices connected
  • [DMAS-55157] - the All Users group produces an Error in User Management

Task

  • [DMAS-55062] - too many INFO log level from driverservice for DI 14001

Implementation

  • [DMAS-54849] - The GeospatialMap should display contact information if a data product access restriction occurs
  • [DMAS-54956] - Refactor Cast Detection Job to look at ScalarData
  • [DMAS-54988] - Write SQL for New Job Parameters
  • [DMAS-54998] - Refactor CastDataIngestionJob so that it does not delete ScalarData for the whole day
  • [DMAS-55101] - Implement ONC Lights driver
  • [DMAS-55116] - Display Data Access Restriction Error Message on Cast Card in Geospatial Map
  • [DMAS-55155] - Parser for ONC light driver
  • [DMAS-55156] - Simulator for ONC light driver
  • [DMAS-55164] - Delete Code that sets Community Fisher archive files to state C

Bug (ST)

  • [DMAS-54425] - Delete Sensor Codes Parameter from Cast Data Preview Generation Job (Job 347)
  • [DMAS-55179] - Intermediate incomplete daily castdata file not being deleted

May 6, 2020

Major release.

Instruments

  • Data acquisition bottleneck detection and reaction: implementation of automated quarantine of problematic / late data (near completion)
  • CVAUI conference website (4th Workshop on Computer Vision for Analysis of Underwater Imagery)
  • AIS integration (in-progress)
  • PAMguard (starting)
  • STRAW-b drivers and integration (starting)

Data Products

  • Add CODAR data availability MAT files for combiner / totals devices
  • Improve CODAR data availability plots for long time range
  • Icon for FLAC files in Data Search
  • Backlog FLAC file converter with comparison check
  • Added capability for user input for data product options, instead of a predefined set

Complex Data Player

  • caching images (in-progress)
  • Make use of new user input options in viewer (in-progress)

Maintenance and Production Developer

  • Support for ONC website
  • Bug fixes
  • New device synchronization page
  • Multiple owner/organization per device (in-progress)
  • Sensor-level data ratings for sensors applied to products and services (in-progress)
  • Distributed cache (in-progress, now paused)
  • Feature deployments (in-progress, now paused)
  • Automated UI testing (in-progress)
  • DAF testing / prep for June cruise (in-progress)

Community Fishers / EMSA

  • Geospatial map: display information on data restrictions (in-progress)
  • Improve pipeline: move away from file_state trigger (in-progress)

SeaTubeV3 - CANARIE & NOAA & ONC

  • Annotation improvement
  • Improve seek bar for longer videos
  • Improve integration of components
  • Migrate all features from V1&V2 to V3: fixed cameras in-particular (in-progress, almost done)

Dashboards - CANARIE

  • Restarting

MINTED - CANARIE

  • Finish up, support final demo (effort level > 100%)

  • DOI unique identifiers for data sets now available, including versioning and change tracking, plus landing page to display this information
  • New task and batch processing system facilitates this versioning (in-progress)

CIOOS / ERDDAP

  • Minor improvements for ERDDAP / CKAN infrastructure
  • ISO metadata reports available via service, plus improvements to the report (in-progress)

Tickets Released: Oceans 2.0: 20.04.000 (accessible to internal users only). Total: 107.

 Click here to expand...

Bug

  • [DMAS-52876] - Fix broken tests in GeospatialMap
  • [DMAS-53716] - Fix broken test in FileManagement
  • [DMAS-53749] - Fix broken tests in seatubeV3.MapTest
  • [DMAS-53752] - Fix broken tests in sitedevicemaintenanceV2.SiteDeviceSubset
  • [DMAS-54236] - Data player timeline not updating when scrolling during file generation
  • [DMAS-54278] - DMAS Search Failed Notification: 27-Mar-2020 00:31:37 UTC, null, Video Export, SearchHdrId 5055140, UserId 80340
  • [DMAS-54331] - Notification reaction unit tests failing in master
  • [DMAS-54347] - Fix broken tests in MiniDmas
  • [DMAS-54351] - Fix broken tests in inlineEditingObservations and addDive of DiveManagement
  • [DMAS-54356] - Fix broken tests in SystemCommandUtilTest
  • [DMAS-54357] - Fix broken tests in treeClicking of DataSearch
  • [DMAS-54369] - Fix broken tests in addDeviceAttributeLabel of DeviceAttributes
  • [DMAS-54372] - Fix broken tests in setup of DataSetLandingPage
  • [DMAS-54376] - Fix broken tests in downloadCor, downloadLastestCastTxt, downloadPlot and FilterVisibility of GeospatialMap
  • [DMAS-54385] - New button sets not displayed in V3
  • [DMAS-54469] - Fixing automatic merge failure
  • [DMAS-54472] - Videos with different scales/aspect ratios/resolutions cannot be concatenated cleanly
  • [DMAS-54529] - Fix failing SiteDeviceMaintenance tests
  • [DMAS-54552] - Fix automatic merge failure for DMAS-54489
  • [DMAS-54568] - Data Player does not load Hydrophone spectrograms after applying options in oceans next
  • [DMAS-54747] - UI test suite failed with "Error forwarding the new session Empty pool of VM for setup Capabilities"
  • [DMAS-54805] - UI testing master branch static analysis warnings
  • [DMAS-54814] - Dev: React portions of pages are blank in Oceans 2 mode
  • [DMAS-54864] - Graylog is returning non-JSON responses to UI tests
  • [DMAS-54878] - Builds on Jenkins Agent 02 fail with FileSystemException: No space left on device
  • [DMAS-54884] - dataproduct-upload task encounters IllegalBlockSizeException when run as batch task
  • [DMAS-54887] - The DOI job output has a null transactionId
  • [DMAS-54889] - Landing page spacing not working
  • [DMAS-54894] - DOI minting failed: siteDeviceId 1200433
  • [DMAS-54903] - Fix and re-enable unit tests in seaTubeSearchResultsTable
  • [DMAS-54905] - DMAS-54838 didn't get merged to master properly
  • [DMAS-54906] - Calibration service not including batchId in payload
  • [DMAS-54911] - Data Player hanging when downloading images
  • [DMAS-54922] - When positional information cant be found during DOI generation it isnt logged
  • [DMAS-54923] - Content-Type header of SensorAttributesConfigTabService is not set
  • [DMAS-54935] - SimulatorUtil can consider devices without a status to not be stopped
  • [DMAS-54937] - Unable to display DOI on landing page
  • [DMAS-54944] - Add a new automatic UI test for Seascript Management - DA.TC.1218
  • [DMAS-54945] - QA: No raw data from some devices on SOBC
  • [DMAS-54947] - QAQC flag inheritance does not work immediately after devices connected
  • [DMAS-54953] - Parser Definition is not passing batch correctly to DeviceParserDefinitionService
  • [DMAS-54959] - Too many INFO log messages in dmas.log for DataEnrichmentCacheModule
  • [DMAS-54968] - Chip selects on SeaTube Search have CSS height issues

User Story

  • [DMAS-38888] - As a deployment engineer I want to identify ways to make hosts' domain caches aware of each other, so that I don't have to wait for caches to load on startup
  • [DMAS-52444] - As ONC gets funding from CANARIE, I want to register MINTED services in a CANARIE registry
  • [DMAS-52766] - As a Oceans 2 data user I want to see information on the changes to the data represented by the DOI

Task

  • [DMAS-53293] - Add driver commands to HoloSea driver set GAIN and STROBE
  • [DMAS-54346] - Standardize requests for dataproducts from the dataviewer
  • [DMAS-54558] - Support bndtools 5.0
  • [DMAS-54577] - Update global properties for Cassandra Hosts
  • [DMAS-54763] - Loading bar for community fishers dataproducts on geospatial map does not resolve when data restricted
  • [DMAS-54768] - Include class name in UI test failure screenshots
  • [DMAS-54781] - DOI Groups and Triggers should not be directly runnable
  • [DMAS-54783] - Upgrade chromedriver to version 81
  • [DMAS-54815] - Add UI test for dataproduct icons within datasearch
  • [DMAS-54848] - Check on (and adjust if needed) spectrogram generation for high sample rate icListen HF hydrophone
  • [DMAS-54866] - Show batch after it is created
  • [DMAS-54868] - Fix Expedition Management failing UI test
  • [DMAS-54909] - Only create DOI task on datachange if a DOI already exists for the sitedevice
  • [DMAS-54916] - Update datasearch UI test now that QA is on master.
  • [DMAS-54957] - please modify log level from INFO to DEBUG for line 502 of DiveManager

Design

  • [DMAS-54860] - Update CM design to separate CacheManager lifecycle from cache-loading

Implementation

  • [DMAS-53771] - Use the POM is ca.uvic.onc.test.ui.test.extension.dataacquisition.deviceControl.DeviceControl
  • [DMAS-53774] - Use the POM in ca.uvic.onc.test.ui.test.core.infrastructure.agreementManagement.AgreementManagement
  • [DMAS-53775] - Use the POM better in ca.uvic.onc.test.ui.test.core.annotationmanagement.AnnotationManagement
  • [DMAS-53781] - Use the POM in ca.uvic.onc.test.ui.test.extension.eventDetection.eventMaintenance.EventDetection
  • [DMAS-53801] - Use the POM better in ca.uvic.onc.test.ui.test.extension.seatube.expeditionManagement.ExpeditionManagement
  • [DMAS-53837] - Change loading sequence of generated images
  • [DMAS-53886] - Add web service automation tests
  • [DMAS-53939] - Create an organization details panel
  • [DMAS-54083] - Update tests for creating a DOI on site device maintenance page
  • [DMAS-54179] - Print the version when building/deploying Oceans 2
  • [DMAS-54180] - Print the version when deploying ONC data products
  • [DMAS-54181] - Print the version when deploying Oceans Next
  • [DMAS-54199] - Create UI test for test case DV.TC.110
  • [DMAS-54281] - Create FLAC backlog post processing job to generate FLAC from WAV files
  • [DMAS-54341] - DataAvailability Bar for Cast DataSearch Location Searches should accurately display cast data
  • [DMAS-54453] - Add an icon for flac files in Data Search
  • [DMAS-54470] - Enable longer time range products for CODAR availability and QC MAT products
  • [DMAS-54471] - Add data availability information to QC MAT files
  • [DMAS-54542] - Create Java post process job for FLAC back generation
  • [DMAS-54660] - display DOI provenance information on the front end
  • [DMAS-54786] - Create UI tests for the new details panels
  • [DMAS-54791] - Add runnable flag to tasktypes and batch groups
  • [DMAS-54793] - Hide run button from non-runnable tasktypes and groups
  • [DMAS-54802] - Add file comparator to Wav to Flac matlab job
  • [DMAS-54811] - Add device listing link to dataset service
  • [DMAS-54812] - Add device listing link to landing page
  • [DMAS-54817] - add logic to decide if a task can added to a batch
  • [DMAS-54818] - When a task is queued it should update all of its parents status to running
  • [DMAS-54850] - Return provenance information of all versions of a DOI in DOIDatasetService
  • [DMAS-54855] - Don't use EhcacheProvider both for maintaining the CacheManager and for loading caches
  • [DMAS-54872] - Task Information back end implementation
  • [DMAS-54873] - Task Information front end implementation
  • [DMAS-54896] - Create a node details panel
  • [DMAS-54898] - Exract database-connection methods of CacheLoader to a separate class
  • [DMAS-54924] - When automatically creating DOI tasks for a batch after a data change default to using the taskDefinition parameters
  • [DMAS-54930] - Dont allow a task to be cancelled if any of its children have finished
  • [DMAS-54958] - Log the ID of the device that causes NPEs in DeviceManager

Test

  • [DMAS-54304] - Add search automation test cases for FLAC data products
  • [DMAS-54452] - update unit tests checking if geolocation is null

Bug (ST)

  • [DMAS-53369] - Fix Broken Tests in Plotting Utility
  • [DMAS-54329] - Community fisher location search is returning data from other locations.
  • [DMAS-54780] - Content-Type Header not set in DeviceSyncService
  • [DMAS-54891] - QA deployment failed
  • [DMAS-54897] - Version notification failed in deployment
  • [DMAS-54941] - Fix broken tests in SensorAttributes

April 30, 2020

Minor release: driver bug fix.

Tickets Released: Oceans 2.0: 20.03.010 (accessible to internal users only). Total: 1.

 Click here to expand...

Bug

April 29, 2020

Minor release: bug fixes for MINTED project and device listing.

Tickets Released: Oceans 2.0: 20.03.009 (accessible to internal users only). Total: 3.

 Click here to expand...

Bug

  • [DMAS-54845] - DeviceListing file is returning error 404
  • [DMAS-54890] - none of the workflows are showing up in Device Listing since the release today

Task

April 28, 2020

Minor release: features and bug fixes for the MINTED project.

Tickets Released: Oceans 2.0: 20.03.008 (accessible to internal users only). Total: 43.

 Release Notes from JIRA for version 20.03.008...

Bug

  • [DMAS-54500] - fix job 337 outputs - if a doi is not produced the status should be error and messaging should make sense
  • [DMAS-54513] - Searchtreenode descriptions are sometimes missing in the DataCite description (abstract)
  • [DMAS-54752] - Error when updating DOI's through the SiteDeviceMaintenance page
  • [DMAS-54764] - Batchable tasks are not runnable
  • [DMAS-54778] - TaskHistoryBatchService.getChildTasks not called with proper parameters in frontend
  • [DMAS-54808] - Abstract not being generated with a search tree node description for Site Device 1205747
  • [DMAS-54838] - Fix issue where deviceId isn't being populated when a siteDevice is loaded by id
  • [DMAS-54867] - Fix failing test in master

User Story

  • [DMAS-52764] - As a Oceans 2 data user I want to see the processes used to update the data represented by the DOI
  • [DMAS-53527] - Create a batch
  • [DMAS-53615] - Update DOIs to reflect changes in a batch
  • [DMAS-53868] - Run batch tasks
  • [DMAS-54403] - Add dataproduct-upload to batch

Task

  • [DMAS-54512] - improve display of data product options for Query Details in dataset landing page when no options exist
  • [DMAS-54590] - dataset landing page - make the organization names linked to their ROR
  • [DMAS-54675] - use consistent number of decimal places for geo-extent metadata in DataCite and landing page
  • [DMAS-54757] - Update task machine caches when search tree changes
  • [DMAS-54865] - Change batch default to None in device and sensor screens
  • [DMAS-54876] - Remove the "Child Tasks" heading
  • [DMAS-54877] - Display the task parameters in alphabetical order

Requirement

  • [DMAS-54147] - Updates for FM supporting UI for uploading French translations
  • [DMAS-54870] - Task Information Requirements

Design

Implementation

  • [DMAS-53168] - Create a task that uploads CKAN datasets if there is a corresponding dataset in the Erddap dataset table
  • [DMAS-53962] - Add selenium tests edit
  • [DMAS-53981] - Add selenium tests cancel
  • [DMAS-54064] - Add batching ability to Device attributes tab
  • [DMAS-54065] - Add batching ability to parser definition tab
  • [DMAS-54361] - Write database script to add CKAN Metadata Upload Job to task management
  • [DMAS-54520] - Implement expandable table rows to show child tasks in task groups
  • [DMAS-54582] - add logic to the DOIDatasetService for getting the provenance of a DOI Dataset
  • [DMAS-54661] - Implement onlyMetadata parameter for DOI Registration Job
  • [DMAS-54669] - Implement adding dataproduct-upload to a batch
  • [DMAS-54785] - Allow the user to edit child tasks
  • [DMAS-54798] - add logic to decide if a batch sub task can be queued
  • [DMAS-54804] - Change default filters for child tasks and batch tasks to show all statuses initially
  • [DMAS-54819] - Handle cancellation of hierarchical tasks

Test

  • [DMAS-54563] - update UI tests with new expected citation text

Bug (ST)

  • [DMAS-53951] - New task trx tables do not track operation date
  • [DMAS-54767] - device attribute service does not associate a batchId correctly on change

Documentation

April 21, 2020

Minor release: bug fixes and features for the MINTED project, including updates for the new batch task system.

Tickets Released: Oceans 2.0: 20.03.007 (accessible to internal users only). Total: 26.

 Release Notes from JIRA for version 20.03.007...

Bug

  • [DMAS-54475] - TypedManager exceptions being thrown in device listing page
  • [DMAS-54479] - TaskDefinitionBatch page does not delete parameters when a parameter's name is deleted
  • [DMAS-54556] - Fix automatic merge Failure
  • [DMAS-54593] - there is an issue with the way we are including ROR ids in the DataCite XML
  • [DMAS-54595] - DMAS Search Failed Notification: 19-Apr-2020 00:35:39 UTC, British Columbia Ferries-Tsawwassen - Duke Point Ferry Route, Time Distance Variable Scalar Plot, SearchHdrId 5076407, UserId 15356
  • [DMAS-54662] - Batch dropdown doesn't have an option for users not to add a change to a batch
  • [DMAS-54674] - Cannot create DOI for sitedevice 1190700
  • [DMAS-54676] - fix spelling of DataCite on landing page
  • [DMAS-54677] - Ferry, Buoy, and Navigation data is showing in DataCite abstract as 'fixed' location

User Story

  • [DMAS-53870] - Add batch support to selected tasks
  • [DMAS-53882] - add link to end user wiki documentation for data citations to the landing pages

Task

  • [DMAS-53123] - Change SiteDeviceMaintenance to use query parameters instead of path parameters
  • [DMAS-54483] - when running job 337, the modifyby in pi_doidataset table should be the person who ran the job
  • [DMAS-54588] - Remove leading and trailing whitespace in input parameters (was - job 337 is minting DOIs to TEST even when PROD is selected since the last release with version 20.03.005)
  • [DMAS-54663] - Update the highlighting color of tables in Oceans Next
  • [DMAS-54745] - Make TaskManagementBatch React page scrollable

Implementation

  • [DMAS-54066] - Add batching ability to sensor addtions
  • [DMAS-54067] - Add batching ability to sensor attribute
  • [DMAS-54068] - Add batching ability to sensor calibration changes
  • [DMAS-54193] - Implementation for device batch screen changes
  • [DMAS-54227] - Selenium Test Create batch
  • [DMAS-54326] - Update SensorAttributeService to use batches when updating attributes
  • [DMAS-54364] - Hook up add batch tasks to call the web service
  • [DMAS-54670] - Add support to service to get all children for a task

April 19, 2020

Minor release: bug fixes and features for the MINTED project.

Tickets Released: Oceans 2.0: 20.03.006 (accessible to internal users only). Total: 21. 

 Release Notes from JIRA for 20.03.006...

Bug

  • [DMAS-53738] - Fix broken tests in ExpeditionManagement
  • [DMAS-54380] - Fix broken tests in DataViewer
  • [DMAS-54489] - the title for RDI ADCPs should not have 'ancillary data' when populating title in DataCite or dataset DOI metadata
  • [DMAS-54496] - unable to create dataset DOI for DRDC CTD test case
  • [DMAS-54509] - correction to the citation text for accessed date
  • [DMAS-54511] - The data product options are not appearing correctly for a specific data search
  • [DMAS-54516] - Job 337 hangs on 'Running' status for some entire-devicetype minting jobs
  • [DMAS-54531] - Data Citation Text Service not working for Query PIDs
  • [DMAS-54565] - DOI's with mobile depth and fixed lat/lon have incorrect geolocations
  • [DMAS-54570] - when running job 337 for the second time on a sitedevice, TWO new DataCite entries are made
  • [DMAS-54571] - snackbar has undefined batch name after adding a batch
  • [DMAS-54593] - there is an issue with the way we are including ROR ids in the DataCite XML

Task

  • [DMAS-54486] - dataset DOI produced for Thermosalinograph on ferry has undefined, undefined for the lat/long
  • [DMAS-54490] - There was no dataset doi generated by a 'completed' job 337 for ROV navigation dataset
  • [DMAS-54589] - Remove ROR from citation text
  • [DMAS-54667] - Update task types in prod

Requirement

  • [DMAS-54094] - Record requirements for MINTED CANARIE service

Implementation

  • [DMAS-54220] - frontend associate manual doi generation with a batch
  • [DMAS-54321] - Update DeviceAttributeService to use batches when updating attributes
  • [DMAS-54381] - Fix and enable the disabled UI tests
  • [DMAS-54546] - update selenium tests for Properties being changed to Variables on DatasetLandingPage

April 16, 2020

Minor release: changes for MINTED project: fixes for minting DOIs, batch system; UI testing fixes, monthly Data Preview fixes, permission fix for task management, and more.

Tickets Released: Oceans 2.0: 20.03.005 (accessible to internal users only). Total: 40. 

 Release Notes from JIRA for 20.03.005...

Bug

  • [DMAS-51341] - Site device site drop down is much too slow
  • [DMAS-53750] - Fix broken tests in seatubeV3.VideoPlayerTest
  • [DMAS-53755] - Fix broken tests in website.general.General
  • [DMAS-53862] - Users with RW access to Task Management can not run the jobs on Task Management page
  • [DMAS-54348] - Fix broken tests in reloadCache of NewSystemConsole
  • [DMAS-54435] - DOI Generation task throws a null pointer exception for mobile site devices
  • [DMAS-54458] - Extra Hydrophone calibration file provided
  • [DMAS-54462] - The current DOI isn't highlighted in history
  • [DMAS-54465] - DMAS Search Failed Notification: 09-Apr-2020 04:30:05 UTC, ODP 1364A-Hydrophone High Frequency 2.8 mab, Hydrophone Spectral Data, SearchHdrId 5067600, UserId 15356
  • [DMAS-54488] - Error minting DOI for DeviceID: 30399
  • [DMAS-54491] - Looks like the token is still required in the citationText service
  • [DMAS-54495] - Invalid bounding box generated for ferry device
  • [DMAS-54497] - update the automated abstract to use lower case for fixed/mobile/profiling
  • [DMAS-54498] - the instrument measurement footprint is not being used for the geoextent in DataCite metadata
  • [DMAS-54501] - DeviceTypeID 55 doesn't work in TaskManagementTEST
  • [DMAS-54530] - Error messages from DataSetManager on task machines
  • [DMAS-54533] - edit batch dialog renders when after details update in add batch dialog

Task

  • [DMAS-54186] - Upgrade CacheSensorDuration code to work with latitude sensors
  • [DMAS-54343] - Modify theme
  • [DMAS-54459] - Add hydrophone calibration txt files to FLAC searches
  • [DMAS-54473] - Hydrophone Data Preview improvements
  • [DMAS-54484] - There was no DOI created for a device with mobile lat/long/depth
  • [DMAS-54499] - unable to create a dataset DOI for Aanderaa Oxygen Optode
  • [DMAS-54508] - improve query details section with 'Properties' in the DataSet Landing Page

Implementation

  • [DMAS-51974] - Implement current DeviceSync page with react
  • [DMAS-53706] - Refactor ErddapXMLService to have displayOnly option for generating datasets for one site device
  • [DMAS-54124] - Write jest and enzyme unit tests
  • [DMAS-54178] - Extract certain style components from deviceSyncTable into groupable table
  • [DMAS-54221] - backend associate manual doi generation with a batch
  • [DMAS-54240] - Update batch & batch tasks UI to use TaskHistoryBatchService to get data
  • [DMAS-54268] - Hook batch creation dialog into the web service
  • [DMAS-54285] - Add hover & selections to BatchList table
  • [DMAS-54299] - Update CalibrationServlet to use batches when updating calibrations
  • [DMAS-54306] - Implement front-end UI for editing an existing batch
  • [DMAS-54310] - Add an update operation to TMTaskService for updating the details of a batch
  • [DMAS-54320] - Add new batch tables to TaskManagement
  • [DMAS-54323] - Change edit mode and add data to service call
  • [DMAS-54332] - Update DeviceParserDefinitionService to use batches when updating parsers
  • [DMAS-54382] - Add ability to run tasks to UI
  • [DMAS-54402] - add logic to the doiRegistrationBatchJob to use the task output field
  • [DMAS-54407] - update DOI Generation job to update its output with transactions of modified DOI's
  • [DMAS-54434] - If a host can't be found in the table, print what hosts are found
  • [DMAS-54480] - Get batchable tasks from web service

Test

Bug (ST)

  • [DMAS-54275] - Batch Task List displays TaskTypeId instead of TaskType

April 11, 2020

Minor release: changes for MINTED project

Tickets Released: Oceans 2.0: 20.03.004 (accessible to internal users only). Total: 5. 

 Release Notes from JIRA for 20.03.004...

Bug

  • [DMAS-54397] - User Defined jobs dont display in the task tree on the TaskManagementBatch page
  • [DMAS-54427] - Publication year not using correct dates
  • [DMAS-54485] - TWO datacite entries were created with the official DataCite registry for ONE dataset

User Story

  • [DMAS-54342] - Only display DOIs with the same prefix in history

Implementation

  • [DMAS-54409] - Update logic to return DOI history to restrict to those with the same prefix

April 10, 2020

Minor release: bug fixes for MINTED project

Tickets Released: Oceans 2.0: 20.03.003 (accessible to internal users only). Total: 2. 

 Release Notes from JIRA for 20.03.003...

Bug

  • [DMAS-54460] - DOI dataset using UUID which is different from doidataset in pi_doidataset
  • [DMAS-54463] - The link we send to datacite is still pointing to the home page instead of the landing page

April 8, 2020

Feature release for Oceans 2.0: primarily for the MINTED project, plus various fixes and other features.

Data Products

  • CODAR data availability data products are available for Combiner/Total stations (Radial stations coming soon)
  • Monthly complex Data Preview for CODAR currents, availability and hydrophone LTSAs and SPD are now available
  • FLAC audio data products now available for all hydrophones, plus post-processors will generate and archive for fast retrieval
  • Bug fixes: hydrophone LTSA collation, ASL AWCP complex parser and zero-sized products

Automated Testing and Continuous Deployment

  • Bug fixes (many) to improve automated test results

Maintenance and Production Developer

  • Bug fixes: device synchronization

Community Fishers

  • Bug fixes

MINTED - CANARIE

  • Tasks to support both single and bulk minting of DOIs to Datacite
  • Initial framework for a new task batch system which gives structure to data changes that provides provenance for data version changes (no yet activated, more to come)

CIOOS / ERDDAP

  • ISO metadata reports available via service (not yet public)
  • Added French titles to ERDDAP/CKAN datasets

Tickets Released: Oceans 2.0: 20.03.002 (accessible to internal users only). Total: 116.

 Release Notes from JIRA for 20.03.002...

Bug

  • [DMAS-52876] - Fix broken tests in GeospatialMap
  • [DMAS-53723] - Fix broken test in Groups
  • [DMAS-53733] - Fix broken tests in DigitalFishers
  • [DMAS-53735] - Fix broken tests in Hydrophone
  • [DMAS-53787] - fix broken test in seatubeV3.SensorReadingsTest
  • [DMAS-53788] - Fix broken tests in sitedevicemaintenanceV2.SiteDeviceMaintenance
  • [DMAS-53814] - Fix broken test in DashboardSharing
  • [DMAS-53878] - Fix broken tests in DashboardDisplay
  • [DMAS-54159] - DOIDatasetService does not create an array when there is only one date in the xml
  • [DMAS-54202] - Monthly Complex Data Preview Generator creates some searches based on daily dpf specs
  • [DMAS-54229] - Unhandled rejections in Oceans-Next Services
  • [DMAS-54235] - Cannot generate a DOI from SiteDeviceMaintenance
  • [DMAS-54237] - SiteDeviceService returning successfully when Site Device not saved
  • [DMAS-54249] - Add trx table for tm_task and add modify by and modify date columns
  • [DMAS-54250] - ASL binary .01a files are zero size in search automation test case
  • [DMAS-54259] - resolve jettybase
  • [DMAS-54270] - Fix merge conflict from release/20.03.000 to master for DMAS-53637
  • [DMAS-54274] - Hydrophone spectral data products with FFT/wav source option 'MIX' seems to return both
  • [DMAS-54282] - Jenkins isn't archiving UI test failure screenshots
  • [DMAS-54294] - Data Search not delivering Community Fishers Data correctly
  • [DMAS-54297] - Community fisher location searches for cast scalar multi profile plots are producing incorrect titles.
  • [DMAS-54316] - Two sets of ticks facing outward on Echosounder plot
  • [DMAS-54319] - Fix static analysis warning in DataSourcePage
  • [DMAS-54327] - DMAS Search Failed Notification: 31-Mar-2020 18:36:00 UTC, Northeast Pacific Ocean-Endeavour, Cast Scalar Profile Plot and Data, SearchHdrId 5058637, UserId 88930
  • [DMAS-54328] - DMAS Search Failed Notification: 31-Mar-2020 18:36:30 UTC, Northeast Pacific Ocean-Endeavour, Cast Scalar Profile Plot and Data, SearchHdrId 5058638, UserId 88930
  • [DMAS-54334] - Jenkins is not working
  • [DMAS-54336] - Community fisher location searches have empty parameter string in search table
  • [DMAS-54340] - Fix sy_translation trigger audit function to insert into correct table
  • [DMAS-54344] - Fix broken test for DatasetLandingPageTest for error message
  • [DMAS-54352] - Fix broken tests in testOperatorPermission, testWatcherPermssion and cameraControlInitialLoading of CameraControl
  • [DMAS-54359] - Fix broken tests in checkTranslationFileUpload of FileManagement
  • [DMAS-54368] - DMAS Search Failed Notification: 02-Apr-2020 04:58:28 UTC, CODAR SeaSonde 16MHz (SN 2016480) VROC, CODAR Quality Controlled Surface Currents, SearchHdrId 5060024, UserId 43686
  • [DMAS-54374] - Fix broken tests in setup of ManualTest
  • [DMAS-54432] - Fix datasetLandingPage to not require a fundingReference.

User Story

  • [DMAS-51184] - As a third party data provider I want my organization ROR to be included in citation text
  • [DMAS-51303] - Manually create a new DOI for an existing dataset
  • [DMAS-52322] - As an Oceans 2 data user I want mobile datasets to have DOIs so I can reference them
  • [DMAS-52468] - As an Oceans 2 data user I want to view the options used for a query so I can know more about the data in the query
  • [DMAS-53286] - As a data steward, I would like to associate repostprocessing with a batch to assist in provenance
  • [DMAS-53474] - As a third party data provider I want my ROR associated with DOI metadata
  • [DMAS-53495] - As a dataset user I want to see the dataset publisher and funders to learn more about the data
  • [DMAS-53518] - Update the task data model
  • [DMAS-53533] - As a data steward I want to generate a new DOI for changes in batch so DOI is accurate
  • [DMAS-53534] - associate a batch when uploading files
  • [DMAS-53869] - Execute batch on task machine
  • [DMAS-54054] - Execute Reprocess Group task
  • [DMAS-54188] - Run a batched re-postprocessing task

Task

  • [DMAS-53126] - Change DOIMetadataSearch page to DatasetLandingPage
  • [DMAS-53912] - Separate UI notification for generating dataproducts from retrieving images.
  • [DMAS-54255] - Update error snackbars and parameters for DOIDatasetService
  • [DMAS-54286] - Get rid of the DataSearch UI test's failure listener
  • [DMAS-54289] - Lazily initialize CachedDomainManager.cacheWrapper
  • [DMAS-54302] - run all selenium tests every night
  • [DMAS-54324] - Fail early if a test tries to load a page that doesn't exist
  • [DMAS-54343] - Modify theme
  • [DMAS-54362] - The DOI registration job runs too slowly

Requirement

  • [DMAS-54248] - Document requirements for test resolution/browser size

Design

Implementation

  • [DMAS-53471] - Implement CODAR data availability plots (totals only)
  • [DMAS-53574] - update paths in selenium tests and fix broken tests SiteDeviceMaintenance
  • [DMAS-53578] - implement front-end to display publisher and funding reference
  • [DMAS-53599] - refactor unscheduled job messaging to use new tasks
  • [DMAS-53602] - refactor existing jobs to use tm_task output instead of taskhistorydetail
  • [DMAS-53604] - populate the tm_task and tm_taskdetail with data from taskhistory and taskhistorydetail
  • [DMAS-53609] - refactor code that cancels tasks
  • [DMAS-53635] - refactor ReprocessingFrameworkService and ReprocessingSession to use the new task framework
  • [DMAS-53637] - Update ISO19115 XML and CKAN Datasets with French title and abstract
  • [DMAS-53661] - Implement a service for generating ISO 19115 XML files
  • [DMAS-53779] - Use the POM in ca.uvic.onc.test.ui.test.extension.parser.reprocess.Reprocess
  • [DMAS-53780] - Use the POM in ca.uvic.onc.test.ui.test.extension.datadownload.dataSearch.DataSearch
  • [DMAS-53858] - View batch task detail
  • [DMAS-53865] - Edit a batch task
  • [DMAS-53866] - Remove a batch task
  • [DMAS-53871] - Implement CODAR data availability plots (SQL)
  • [DMAS-53884] - Add database entries for service
  • [DMAS-53899] - Make changes to existing task management ui
  • [DMAS-53916] - add selenium tests to check for Funding Reference and Publisher
  • [DMAS-53921] - add link to documentation for landing page frontend
  • [DMAS-53924] - Add Create Batch Dialog to the Batch UI
  • [DMAS-53927] - Add TaskHistory, task, and TaskDetail queries to the new tm_task manager
  • [DMAS-53935] - Add support for minting to prod or test in the DOI generation task
  • [DMAS-53936] - Update DOI manual create screen to include prod/test
  • [DMAS-53949] - Add CODAR data availability plots to daily and monthly tabs in Data Preview
  • [DMAS-53961] - Implement add and edit of reprocess group tasks
  • [DMAS-53965] - Implement add and edit of re-postprocess tasks
  • [DMAS-53966] - Add selenium tests
  • [DMAS-53969] - Implement add and edit of file upload tasks
  • [DMAS-53971] - Add selenium tests
  • [DMAS-53975] - Implement Run batch
  • [DMAS-53980] - Implement Cancel batch
  • [DMAS-54057] - Implement execution of Reprocess "group" tasks
  • [DMAS-54060] - Implement batch execution
  • [DMAS-54062] - write selenium test for CRUD of data-rating at sensor level
  • [DMAS-54082] - View batches implementation
  • [DMAS-54106] - Add new page into dmas menu of Oceans 2.0
  • [DMAS-54118] - Add config properties to store test and prod settings
  • [DMAS-54119] - Update minting code to use config properties
  • [DMAS-54194] - add code for running batch sub tasks
  • [DMAS-54205] - Implement web service to get tasks
  • [DMAS-54209] - Service to create batch and create task and add it to a batch
  • [DMAS-54215] - Service to get Batchable task definitions
  • [DMAS-54240] - Update batch & batch tasks UI to use TaskHistoryBatchService to get data
  • [DMAS-54251] - Implement running re-postprocess batch tasks
  • [DMAS-54258] - allow the DOI Registration job to work in the new task framework using a list of siteDeviceIds
  • [DMAS-54264] - Add Flac generation to matlab hydrophone code.
  • [DMAS-54265] - Update selenium tests for landing page to test About link
  • [DMAS-54272] - Render a confirmation dialog when cancelling a batch or task
  • [DMAS-54280] - Add FLAC file generation to hydrophone post process job
  • [DMAS-54288] - frontend service to create batch/task
  • [DMAS-54290] - Support Trigger and DOI groups for batches
  • [DMAS-54335] - Implement new trx tables for parser definitions and calibrations

Bug (ST)

  • [DMAS-53364] - Fix broken tests in DeviceAttributes
  • [DMAS-53932] - job runnerId is not getting set for user defined jobs
  • [DMAS-54275] - Batch Task List displays TaskTypeId instead of TaskType
  • [DMAS-54287] - DeviceSyncService is failing to update existing synchronizations
  • [DMAS-54291] - Getting batches requires a runnerId to not be null


March 26, 2020

Major+ release for Oceans 2.0.
February and partial March releases combined, primarily due to maintenance expedition.

Instruments

  • Data acquisition bottleneck detection and reaction: implementation of automated quarantine of problematic / late data (in-progress)
  • McLane Sampler driver
  • AIS integration (in-progress)
  • WERA data product FTP
  • Sandbox improvements: various, including ability to cancel tasks

Data Products

  • State of Ocean / Environment Climatology and Anomaly Plots now available in Data Preview
  • Improved ASL .01a binary file integration with EchoView
  • CODAR data availability data products (in-progress)
  • Monthly complex Data Preview for CODAR currents, availability and hydrophone LTSAs (in-progress)
  • Flip all tick marks in complex plots out for better integration with Data Player
  • Bug fixes (CODAR, error messaging, seismometers, COR files, etc)

Complex Data Player

  • Improved option menu for ADCP and hydrophones
  • Data player now integrated in to Oceans 2.0
  • Implementation in-progress: infrastructure, bug fixes, speed improvements, etc

Automated Testing and Continuous Deployment

  • Significant improvements to all UI automated testing (coverage, tools, reliability, results)
  • Continuous deployment: process improvements
  • Automated DAF testing improvements
  • Distributed cache (in-progress)
  • Automated release notes (investigation)

Maintenance and Production Developer

  • Completed ability to add data ratings for sensors (products and services do not use them yet)
  • Scalardata webservice performance improvements
  • Task and user management bug fixes for permissions and security
  • Various other bug fixes (rawdata service, etc)

Community Fishers

  • Integration with Data Search and Plotting Utility for cast-delineated data
  • Bug fixes (depth sensor derivation, etc), testing and support for training

SeaTubeV3 - CANARIE & NOAA & ONC

  • Added ability to play video clips by clicking on annotations
  • Migrate all features from V1&V2 to V3: fixed cameras in-particular (in-progress, almost done)
  • Bug fixes

Dashboards - CANARIE

  • on hold for staffing

MINTED - CANARIE

  • Citation text for subsets includes QueryPID, now included on landing page

  • Batch system and re-postprocessing tool (this is only partly a MINTED feature): implementation (in-progress)

CIOOS / ERDDAP

  • Datasets infrastructure for ERDDAP and CKAN
  • Ability to import translations using the File Upload tool
  • ISO metadata reports available via service (soon)

Tickets Released: Oceans 2.0: 20.03.000 (accessible to internal users only). Total: 315.

 Release notes from JIRA for 20.03.000

Usability

  • [DMAS-52142] - Button sets cannot be deleted
  • [DMAS-52647] - All users should be able to delete their own annotations in V3
  • [DMAS-53909] - Resolution difference for image export methods in V2 and V3

Bug

  • [DMAS-51928] - Play list download video doesnt match what is played before downloading
  • [DMAS-52715] - Fix broken tests in website.homePage.HomePage (OW.TC.1132 and OW.TC.1131)
  • [DMAS-52877] - Fix broken test in ManualTest
  • [DMAS-52994] - scalardata webservice performance issues and errors
  • [DMAS-53317] - Device Console error when sorting by instrument type
  • [DMAS-53340] - url-loader's default fallback file-loader produces the wrong URLs
  • [DMAS-53357] - In Regression Testing "release/20.01.000" PR Test - Data Preview Management (1-200) automated tests are failing.
  • [DMAS-53373] - Fix Broken Tests in DashboardSharing
  • [DMAS-53376] - HY Test - Chrome download bar causing failing tests when taking spectrogram screenshots
  • [DMAS-53385] - Fix "invalid prop" errors in seatubeV3
  • [DMAS-53386] - Refactor the setState call out of render() in annotationList
  • [DMAS-53394] - DOIMetadataSearch requires a user to be logged in to access
  • [DMAS-53468] - Search Failure for community fishers when bad sitedevicesubset entries encountered
  • [DMAS-53502] - Environment.getDmasUrl() is returning undefined in QA DataPlayer
  • [DMAS-53555] - Search failure in QA for .flac files
  • [DMAS-53566] - not able to run auto live DAF test in QA
  • [DMAS-53571] - Live DAF testing causes NullPointerExceptions in DeviceConsoleService
  • [DMAS-53585] - Fix broken test in SeaScriptManagement
  • [DMAS-53621] - TaxonButtonSetService throwing a 500 error
  • [DMAS-53622] - Fix broken text case UM.TC.74
  • [DMAS-53634] - Search failues for spectrogram for hydrophone viewer
  • [DMAS-53717] - Fix broken test in AgreementManagement
  • [DMAS-53719] - Fix broken test in DOIMetadataSearchTest
  • [DMAS-53720] - Fix broken tests in SiteDeviceSubsetTest
  • [DMAS-53722] - Fix broken test in TaskControl
  • [DMAS-53724] - Fix broken test in CruiseManagement
  • [DMAS-53725] - Fix broken test in RealTimeObservations
  • [DMAS-53726] - Fix broken test in DashboardManagement
  • [DMAS-53728] - Fix broken tests in DeviceControl
  • [DMAS-53731] - Fix broken tests in DataPreviewManagement
  • [DMAS-53732] - Fix broken tests in DataAvailabilityPlot
  • [DMAS-53734] - Fix broken tests in EventDetection
  • [DMAS-53736] - Fix broken tests in Reprocess
  • [DMAS-53737] - Fix broken tests in plottingutility.Create
  • [DMAS-53739] - Fix broken tests in SeaTubeSearchTest
  • [DMAS-53740] - Fix broken tests in SeatubeProMap
  • [DMAS-53741] - Fix broken tests in SeaTubeProVideo
  • [DMAS-53742] - Fix broken tests in seatubeV2.Basics
  • [DMAS-53743] - Fix broken tests in seatubeV2.SeaTubeMap
  • [DMAS-53744] - Fix broken tests in TaxonButtonSet
  • [DMAS-53745] - Fix broken tests in AnnotationSaveAndKeepTimeTest
  • [DMAS-53746] - Fix broken tests in seatubeV3.AnnotationsTest
  • [DMAS-53747] - Fix broken tests in DiveDetailsTest
  • [DMAS-53751] - Fix broken tests in Simulator
  • [DMAS-53753] - Fix broken tests in warn.eew.EEW
  • [DMAS-53754] - Fix broken tests in NavigationBarAdminUser
  • [DMAS-53765] - Fix broken tests in SystemMonitoring
  • [DMAS-53766] - Fix broken tests in DiveManagement
  • [DMAS-53770] - scalardata webservice Bad status code 500
  • [DMAS-53783] - Hydrophones are unavailable through both the Search Hydrophone page and Data Search
  • [DMAS-53793] - React Pages In Oceans 2 do not render sometimes
  • [DMAS-53799] - Updating SiteDeviceSubset on SiteDeviceSubsetMaintenance does not return to SiteDeviceMaintenance
  • [DMAS-53813] - Fix broken test in JiraHelpDesk
  • [DMAS-53816] - NullPointerException for PSF Patrol 09 File Upload - 23418 Event
  • [DMAS-53827] - Users with R/O access to Task Management can cancel tasks
  • [DMAS-53830] - Fix broken test in seatubeV3.TooltipTest
  • [DMAS-53835] - Side bar scales don't change with the generated images
  • [DMAS-53847] - Data viewer is not loading spectrograms after clicking apply on toolbox.
  • [DMAS-53853] - Fix broken tests in DeviceDetails
  • [DMAS-53862] - Users with RW access to Task Mangement can not run the jobs on Task Management page
  • [DMAS-53880] - CF Job 338 does not respect the dateFrom & dateTo parameters
  • [DMAS-53889] - reprocess jobs are created twice in prod ?
  • [DMAS-53911] - Tests with @Ignore are being run anyway
  • [DMAS-53915] - Broken image on initial Cast card
  • [DMAS-53926] - Fix 50ish new UI test failures
  • [DMAS-53928] - Centre red line shifts when opening three dot menu
  • [DMAS-53938] - DOIDatasetService not supported error
  • [DMAS-53940] - fix errors in master from TESTDOIDATASET's name changing
  • [DMAS-53942] - DMAS Search Failed Notification: 05-Mar-2020 22:39:46 UTC, Bullseye-Hydrophone High Frequency, Hydrophone Spectral Data, SearchHdrId 4805909, UserId 2851
  • [DMAS-53945] - Fix broken tests in UserReplication
  • [DMAS-53953] - Fix broken tests in AccessRestrictions
  • [DMAS-53955] - Fix broken tests in SearchTreeMaintenance
  • [DMAS-53957] - Fix broken tests in PublicWebServices
  • [DMAS-53958] - Fix broken tests in GenerationAndDisplay
  • [DMAS-53972] - onc-core bundle fails to deploy
  • [DMAS-53993] - DMAS Search Failed Notification: 09-Mar-2020 19:04:53 UTC, Geosense Short Period Seismometer 116, Seismometer Data, SearchHdrId 4834806, UserId 2851
  • [DMAS-53999] - TaskManagementPage clicks on wrong section of job
  • [DMAS-54045] - UI test suite is still running after 15 hours
  • [DMAS-54071] - DMAS Search Failed Notification: 10-Mar-2020 21:46:13 UTC, Vancouver Island-China Creek, Log File, SearchHdrId 4869459, UserId 4143
  • [DMAS-54088] - SiteDeviceSubsetMaintenance and SiteDeviceMaintenance page not rendering in Ocean' s 2.0
  • [DMAS-54114] - Daily spectrograms are not currently working with data player
  • [DMAS-54158] - Minter creates unbalanced tags for <fundingReferences> and unbalanced tags for geoLocationBox
  • [DMAS-54161] - Toolbox Reset Buttons do not work in DMAS
  • [DMAS-54191] - All UI tests failed in Jenkins last night
  • [DMAS-54208] - Fix broken test in erddap
  • [DMAS-54216] - QA datacentre shows "error while scheduling a job" on startup for all scheduled jobs
  • [DMAS-54219] - TaskManagementBatch page doesnt load in QA
  • [DMAS-54230] - Fix broken tests in Messaging
  • [DMAS-54238] - fix DatasetLandingPage title in Oceans 2.0
  • [DMAS-54245] - Fix broken tests in GeographicInformation
  • [DMAS-54246] - DataPlayer default DeviceCategory not displaying
  • [DMAS-54257] - DMAS QA search failed for COR data product
  • [DMAS-54260] - Test description reference dated test cases in JiraHelpDesk
  • [DMAS-54271] - DMAS Search Failed Notification: 22-Feb-2020 06:43:49 UTC, Patricia Bay-Saanich Inlet VENUS Instrument Platform, Hydrophone Spectral Data, SearchHdrId 4759855, UserId 42732

User Story

  • [DMAS-29344] - As a data user, I would like to have the ability to associate multiple data ratings for a device where sensors sample at different rates
  • [DMAS-49127] - As a scientist, I would like companion data products to the State of the Ocean showing climatology
  • [DMAS-50624] - As a user, I want changes to the test configuration
  • [DMAS-51130] - As a oceans 2 data user I want links to download a subset from the dataset identified by a DOI
  • [DMAS-51132] - As a oceans 2 data user I want to see citation text corresponding to my Query PID on the Landing Page
  • [DMAS-51183] - As a researcher I want citation text for a dataset subset to include a Query PID
  • [DMAS-52228] - As a user I would like to play clips directly from the annotation search screen
  • [DMAS-53267] - Replicate the Data Search option for the ADCP1MHZ (23470) in the Data Player Toolbox
  • [DMAS-53274] - Integrate (Dev Playground) Data Player into Oceans 2.0
  • [DMAS-53314] - Implement and/or Update testing for effected DMAS components
  • [DMAS-53441] - Fix minor issues with Hydrophone/Aquadopp Data Player
  • [DMAS-53645] - As a software developer, I want to get an email when UI tests fail, so I don't need to remember to check
  • [DMAS-53970] - As a test engineer, I want to compare images of page elements so that I can test things that can't be examined in code
  • [DMAS-54210] - As a senior developer, I want to be able to see which UI test failures were caused by real issues, not flaky tests, so I know whether to assign devs to fix them

Task

  • [DMAS-33743] - update DA test to include instrument permission related test case
  • [DMAS-47525] - Add more test cases for getCurrentPhase() method of ProcessService
  • [DMAS-47633] - Add test cases for GET method of OrganizationService
  • [DMAS-47678] - add test cases for GET method of EventDefinitionService
  • [DMAS-49047] - McLane RAS Water Sampler - Finalize Driver
  • [DMAS-50710] - Write selenium tests for data cite metadata on Landing Page
  • [DMAS-51336] - Write selenium script for new system console
  • [DMAS-53013] - Make resolution etc. available to UiTestPage
  • [DMAS-53025] - devcoop3 - New Developer Project, designed and assigned by Mac.
  • [DMAS-53097] - Implement a deviceTypeIds filter for the DOI registration job
  • [DMAS-53130] - Load oceans-next JS from DMAS.Config.OCEANS_NEXT_PATH, not DMAS.Config.BASE_URL
  • [DMAS-53231] - Allow QA deployment of oceans-next to be skipped
  • [DMAS-53266] - Use less vertical whitespace in the live daf test history table
  • [DMAS-53395] - As a DFO CODAR user I would like to see Monthly Data Preview Plots
  • [DMAS-53400] - Extract wait loops in live DAF testing to their own service
  • [DMAS-53435] - update hint information for list of hosts during Oceans-next deployment in Jenkins
  • [DMAS-53458] - Update testng, gradle, and checkstyle for ui-testing
  • [DMAS-53479] - Test ONC website status icons in production
  • [DMAS-53565] - Change Datacite Metadata to use the Dataset class
  • [DMAS-53629] - Check if 'Owner' link works for Anonymous users (IM.TC.303)
  • [DMAS-53654] - Refactor user replication ui test to better follow Page Object Model
  • [DMAS-53665] - Create ER Diagram for data products and data product options
  • [DMAS-53696] - It's hard to figure out what user the users in TestConfig.User correspond to
  • [DMAS-53703] - Print less output in UI testing failure reports
  • [DMAS-53711] - Revert temporary chip select fix to have the same layout as previously
  • [DMAS-53759] - Change annotations with taxons to show entire taxonomy name instead of taxonomy code
  • [DMAS-53762] - UI testing's checkstyle configuration should forbid unused variables
  • [DMAS-53789] - Include user names in TestConfig.User
  • [DMAS-53804] - Disable SeaTube V1 and V2 tests
  • [DMAS-53822] - Investigate issues with new imagenex .881a files from DAF testing
  • [DMAS-53838] - When generating new images don't go modal - stay interactive
  • [DMAS-53843] - Toolbox text not vertically balanced when open
  • [DMAS-53844] - Toolboxes need a RESET button
  • [DMAS-53856] - Add units to colourlimit options (dB)
  • [DMAS-53859] - Flip tick marks outside of plot on ADCP daily current plots
  • [DMAS-53864] - Add More info to failure message in ScreenShotUtil for Screenshot size difference
  • [DMAS-53872] - CODAR clean data products - modify some functions to better handle the qaqc flag 9
  • [DMAS-53891] - Disable the download bar when running tests
  • [DMAS-53941] - As a Hydrophone user, I would like weekly LTSAs and SPDs plots in the month tab in Data Preview
  • [DMAS-53950] - Schedule UI tests to run every night of the week
  • [DMAS-53988] - Add more checkstyle rules to ui-testing
  • [DMAS-53991] - update selenium script for reprocess console to capture change in DMAS-53889
  • [DMAS-54092] - When first triggering shifting or pushing new Plots, Display the "Starting graphics processor" message.
  • [DMAS-54093] - Disable troublesome UI tests
  • [DMAS-54113] - Adjust data player holders for ADCP plots to remove black line between different images
  • [DMAS-54152] - The display in the searchtree for cast subset entries should be Down Cast instead of DOWN_CAST
  • [DMAS-54153] - data cannot be plotted in Plotting Utility or downloaded from Data Search under Community Fisher stations for Down Casts
  • [DMAS-54157] - Add better user privilege check to DOIDatasetService
  • [DMAS-54170] - Reduce MATLAB info messaging by suppressing warning backtrace
  • [DMAS-54182] - Improve ASL manufacturer's format integration with EchoView
  • [DMAS-54252] - Write UI tests for "Mini Dmas"
  • [DMAS-54256] - Go back to using old DOI algorithm for the ID

Requirement

  • [DMAS-49443] - Reqs Design Investigation for State of Ocean Climatology plots
  • [DMAS-53497] - Add requirements for the dataset landing page
  • [DMAS-53531] - Record requirements for creating a batch
  • [DMAS-53592] - Elicit and record requirements for citation text service
  • [DMAS-53646] - Document UI test notifications requirements
  • [DMAS-53863] - Gather requirements
  • [DMAS-53929] - update dataset landing page requirements
  • [DMAS-53977] - Document screenshotting requirements
  • [DMAS-54047] - Document requirements for nightly runs
  • [DMAS-54061] - update requirements for minting doi to certain datacite environment
  • [DMAS-54075] - Record requirements for viewing a batch
  • [DMAS-54102] - Record requirements for batch update

Design

  • [DMAS-52859] - Design for database Datasets
  • [DMAS-53647] - Design email notifications
  • [DMAS-53648] - Database design for supporting French translations
  • [DMAS-53898] - Update landing page mockups to include Documentation link
  • [DMAS-53934] - Update mockup for manual create of DOI from site device to include choosing between test and prod
  • [DMAS-54136] - Design how service will be used without a token

Implementation

  • [DMAS-50597] - Add the ability to rerun failed tests
  • [DMAS-50622] - Add a devicetype ID column
  • [DMAS-50625] - Populate the IP address on entering the device ID
  • [DMAS-51037] - Ensure "expected" plots exist before validating them with ScreenshotUtil
  • [DMAS-51493] - Implementation for SOO Climatology plots
  • [DMAS-52353] - DeviceSyncService to handle save and update, return user name
  • [DMAS-52953] - Generate an ISO Metadata XML file
  • [DMAS-53143] - Modify to notify user of unavailable data and prevent additional service calls
  • [DMAS-53178] - Implement front-end changes to support displaying Query PID details on the Landing Page
  • [DMAS-53182] - Implement back-end changes for query details to be implemented
  • [DMAS-53185] - Implement Selenium Tests for Dataset and Query PID Landing Page
  • [DMAS-53219] - Extract services used in live DAF test configuration to their own files
  • [DMAS-53240] - Refactor TestHistoryTable to use the atomic model
  • [DMAS-53241] - Refactor TestHistoryTable to use media queries instead of window resize events
  • [DMAS-53244] - Add tables for metrics summary storage
  • [DMAS-53271] - Implement back-end changes for generating a citation with a query pid
  • [DMAS-53272] - Implement front-end changes for generating a citation with a query pid
  • [DMAS-53273] - Have the Toolbox header change with the Device Category selection
  • [DMAS-53306] - Add query citation to selenium test
  • [DMAS-53315] - Update testing module for the main menu more changes
  • [DMAS-53316] - Implement Data Player Search Options for Nortek ADCP's
  • [DMAS-53322] - Implement front-end for DOI Generation to Site Device Maintenance
  • [DMAS-53323] - Implement back-end for DOI Generation
  • [DMAS-53326] - Add DOI Generation to Site Device Maintenance Selenium Tests
  • [DMAS-53335] - Change field label for ROR ID in Network Console to "Organization ROR ID"
  • [DMAS-53336] - Implement onSubmit function for ADCP Toolbox
  • [DMAS-53349] - Change text in GeoSpatial Map layer selection to “Community Fishers”
  • [DMAS-53409] - Update CKAN API calls to upload files
  • [DMAS-53413] - Have toolbox expanded when first opened from the main menu (⋮)
  • [DMAS-53436] - Integrate (Dev Playground) Data Player into the "dashboard"
  • [DMAS-53437] - Add Data Player to Ocean's 2.0 (Backend)
  • [DMAS-53442] - Tweek Hydrophone layout not to clip any images
  • [DMAS-53444] - Implement back-end changes for generating a url to the data search page based on a DOI.
  • [DMAS-53452] - Implement metrics topic service
  • [DMAS-53455] - Implement front-end changes for generating a URL to the data search page on the DOI landing page.
  • [DMAS-53473] - add a selenium test for the data search link with the dataset landing page tests
  • [DMAS-53478] - Keep practical salinity in the SOO/E file products
  • [DMAS-53494] - Refactor details panels to be more modular
  • [DMAS-53498] - Add a table to landing page with all doi versions
  • [DMAS-53499] - Update minting job to include ROR and fundingReference
  • [DMAS-53520] - add domain objects for new task tables
  • [DMAS-53521] - Create sql script for new task tables
  • [DMAS-53522] - Create sql script for new task transaction tables
  • [DMAS-53525] - Add selenium test to ensure that the landing page does not require a login.
  • [DMAS-53528] - Integrate basic data viewer options into plothydrophonespectrogram (colourmap, and colourmap limits)
  • [DMAS-53549] - Refactor reprocessing to use new task framework
  • [DMAS-53553] - Add support to return all the DOI versions for a specified DOI
  • [DMAS-53556] - Send a notification email when UI tests fail overnight
  • [DMAS-53559] - Apply 70% rule and fix extra vertical lines in Anomaly plot
  • [DMAS-53563] - Auto display config dialogue on first load
  • [DMAS-53572] - update site device maintenance routing paths in frontend
  • [DMAS-53573] - update sdm paths in backend
  • [DMAS-53575] - dataset landing page frontend
  • [DMAS-53576] - dataset landing page backend
  • [DMAS-53577] - dataset landing page ui test
  • [DMAS-53590] - Populate new task tables with current data
  • [DMAS-53595] - Implement citationText public service
  • [DMAS-53600] - refactor job processing done after dequeueing from the scheduler topic
  • [DMAS-53601] - refactor search to use new task tables
  • [DMAS-53605] - update taskmanagement UI
  • [DMAS-53613] - Move climate plots to a new job that runs daily averages from source data
  • [DMAS-53620] - Implement onSubmit for Hydrophone Options in DataPlayer
  • [DMAS-53637] - Update ISO19115 XML and CKAN Datasets with French title and abstract
  • [DMAS-53653] - Concatenating data from two source wav files without missing samples
  • [DMAS-53655] - Implement button changes following the selected design
  • [DMAS-53664] - refactor JobService API
  • [DMAS-53673] - Create web service for uploading translation files
  • [DMAS-53674] - Create dal layer for I18N
  • [DMAS-53675] - Change Date Time Picker To Be The Same as SeaTube
  • [DMAS-53676] - Implement back-end changes to add mobile datasets to DOI minting
  • [DMAS-53678] - Write Selenium tests for test cases DV.TC.101 - DV.TC.103, DV.TC.108/109, DV.TC.111,112
  • [DMAS-53686] - Update DB with support for hierarchical tasks
  • [DMAS-53690] - Create database scripts for I18N
  • [DMAS-53697] - Dynamically Get Default ADCP and Hydrophone Options in DataPlayer.jsx
  • [DMAS-53699] - Add In Props To DataPlayer Components So They Are Easy To Find With Selenium
  • [DMAS-53701] - As a developer I would like to support the json postgresql data type in hibernate to allow for more flexible storage of JSON
  • [DMAS-53710] - Refactor code for sending tasks from the web machine to the task machine
  • [DMAS-53756] - Implement back-end changes needed to parse search parameters
  • [DMAS-53795] - Modify Task job 340. Cast Data (4) Ingestion Postprocess to stop archiving the .castdata files
  • [DMAS-53803] - Add input and output columns to tm_task
  • [DMAS-53817] - Implement front-end changes to display data product options on the landing page
  • [DMAS-53820] - Update landing page selenium tests to include data product options
  • [DMAS-53831] - Implement Changes
  • [DMAS-53834] - UiTest.login will retry forever
  • [DMAS-53839] - Tiny tweeks for state of ocean climate plots
  • [DMAS-53840] - refactor jobservice activator and generic job to use TM_Task
  • [DMAS-53845] - refactor TaskService to receive TM_Task's
  • [DMAS-53855] - Add support JSON in HSQL for unit testing
  • [DMAS-53857] - View batch tasks
  • [DMAS-53874] - Add missing validation to service
  • [DMAS-53881] - Refactor Seatube and Expedition to use new withSnackBars
  • [DMAS-53885] - Add registry service
  • [DMAS-53892] - Modify FileUpload screen to accept a translation file
  • [DMAS-53903] - remove all remaining references to taskhistory and task and replace them with tm_task
  • [DMAS-53948] - Add React & oceans-next code to TaskManagement front end
  • [DMAS-53949] - Add CODAR data availability plots to daily and monthly tabs in Data Preview
  • [DMAS-53992] - Add tests for the DOI History table
  • [DMAS-54046] - Add a timeout to the nightly test run
  • [DMAS-54076] - Add project structure to our react codebase
  • [DMAS-54095] - Update selenium script to capture any UI change did in DMAS-54049
  • [DMAS-54106] - Add new page into dmas menu of Oceans 2.0
  • [DMAS-54137] - Change service to not require a token
  • [DMAS-54160] - Update relevant selenium tests
  • [DMAS-54164] - hist table in database
  • [DMAS-54165] - Revert all commits made in this user story
  • [DMAS-54198] - implement link from site device page to SDM
  • [DMAS-54218] - Make it easier to run the whole test suite manually
  • [DMAS-54228] - Disable more flaky UI tests
  • [DMAS-54263] - Revert changes to layout at small window sizes

Test

  • [DMAS-52111] - Test Plan for SOOC plots
  • [DMAS-53902] - Add webservice tests for TaskDefinitionService and delete tests for jobService

Bug (ST)

  • [DMAS-37856] - fix bug so that datefrom on sensor data rating allows the same time for different sensors and as the device data rating
  • [DMAS-50498] - Please do not use "Wetlabs FLNTU serial" deviceport for ECO Triplet BBFL2 devices in topology of automated live DAF test
  • [DMAS-53331] - The device name displayed in a test configuration is sometimes incorrect
  • [DMAS-53381] - Fix broken tests in DashboardManagement
  • [DMAS-53414] - Edit Hydrophone Toolbox [ZOOMXY] option
  • [DMAS-53416] - Use proper formatting when displaying a citation on the DOI Landing Page
  • [DMAS-53547] - Fix data player to display ADCP/Aquadopp device data
  • [DMAS-53560] - Toolbox is not consistent in its width
  • [DMAS-53632] - Fix failing tests in dataProductDelivery
  • [DMAS-53650] - Fix shrunken leaflet popup for single cast search tree nodes
  • [DMAS-53707] - ADCP Plots keep trying to load more files
  • [DMAS-53861] - Link to PNG/PDF below the new climate/anomaly plots in Data Preview are incorrect
  • [DMAS-53923] - Task management job tree is blank. Other areas of QA may be affected as well.
  • [DMAS-53990] - I can't run tests manually on Jenkins
  • [DMAS-53995] - NullPointerException in TaskDefinitionService.updateTaskType
  • [DMAS-54073] - TaskDefinitionDetailAssembler does not handle passwords as the DataMapAssembler did
  • [DMAS-54128] - Task Management's Task Id for the schedule is undefined when no task is selected
  • [DMAS-54129] - TaskDefinitionService does not send responses for some methods
  • [DMAS-54239] - Nightly test run failed because one test depends on a disabled method
  • [DMAS-54253] - The canarie registry service currently requires login - it shouldn't

Investigation

  • [DMAS-53910] - Please investigate this issue and attatch some downloaded image on this ticket

Documentation

  • [DMAS-52122] - Documentation for State of Ocean Climatology plots
  • [DMAS-53570] - Add new tests for new options



February 27, 2020

Release for HydroCal, version 20.02.000 (HydroCal Change List)

  • Prevent the ini file settings from being overwritten, particularly when users have modified them
  • Add automatic downsampling of external digital hydrophone wav file data to prevent out of memory errors and improve performance
  • Improve sync tone detection and reliability for external digital hydrophones
  • Added a check for software updates
  • Updated run-time library to MATLAB R2019a


February 3, 2020

Major release for Oceans 2.0.

Instruments

  • Data acquisition bottleneck detection and reaction: design and start of implementation for a system of automated quarantine of problematic / late data
  • Sandbox improvements: improvements to support user's code, more usability and reliability issues
  • Improvements the Community Fishers / Citizen Scientist data acquisition Android App: support for training and testing with bug fixes/adjustments

Community Fishers

  • Integration with Data Search (in-progress)
  • Bug fixes, testing and support for training
  • Improvements to cast detection metadata handling (latitude, longitude, depth)

Complex Data Player

  • Adding options for ADCP display
  • Hydrophone and ADCP display and infrastructure in-progress

Automated Testing and Continuous Deployment

  • Automated UI testing: continuing work on test cases and reliability
  • Continuous deployment: process improvements
  • Bug fixes and features to support testing and deployment of on ship systems
  • Improvements to live DAF testing
  • Automated release notes (investigation)

Data Products

  • State of Ocean / Environment Climatology and Anomaly Plots (implementation complete, todo: testing and linking)
  • Added options for ADCP current plots
  • SIMBA ice buoy data products improved for multiple deployments
  • Bug fixes

Maintenance and Production Developer

  • Added new community pages on ONC website
  • System console final? improvements
  • Various other bug fixes and small projects

SeaTubeV3 - CANARIE & NOAA & ONC

  • Delete functionality for annotations and playlists
  • Improved search function
  • Bug fixes

Dashboards - CANARIE

  • on hold for staffing

MINTED - CANARIE

  • Added much more content to landing page, including data set and subset queryPID (these are DOI modifiers used to instances of datasets)

  • Add the RORID unique identifier for contributing Research Organization (Registry IDentifiers)
  • Batch system (this is only partly a MINTED feature): design, including a potential update to the core task model
  • SiteDeviceSubsets maintenance UI improved

CIOOS / ERDDAP

  • Upgrading datasets infrastructure for erddap ckan, making it more presentable (in-progress)

Tickets Released: Oceans 2.0: 20.01.000 (accessible to internal users only). Total: 108.

 Release notes from JIRA for 20.01.000

Bug

  • [DMAS-50296] - not able to configure JVM with automated live DAF test tool
  • [DMAS-51989] - ToggleItemsMenu - Invalid prop layouts[0].permission of type string
  • [DMAS-52256] - dataProductDelivery return for invalid or missing parameters situation have been changed ?
  • [DMAS-52258] - deploy_onc can't be downgraded below 19.10.000
  • [DMAS-52582] - Expedition management map doesn't clear markers
  • [DMAS-52639] - Panels with multi-line action bars can overflow
  • [DMAS-52730] - Some annotation list rows are overflowing vertically
  • [DMAS-52788] - V2 and V3 filtered export not returning environmental info
  • [DMAS-52789] - Failed to load Calibration Cache java.lang.Exception: Sensor 4259 has an unexpected number of SiteDevices (2)
  • [DMAS-52801] - Cannot search annotation creators when not logged in (on expedition management page)
  • [DMAS-52947] - ONC matlab searches getting stuck in PROD - primarily Data Preview
  • [DMAS-52950] - Removing one of multiple cruises, then re-adding it re-adds its dives.
  • [DMAS-52951] - Removing an attribute filter internally, but not visibly, removes other attribute filters
  • [DMAS-52998] - DMAS Search Failed Notification: 23-Dec-2019 15:03:02 UTC, Cambridge Bay-Safe Passage Buoy, Ice Buoy Time Series Profile Plots, SearchHdrId 4215419, UserId 42732
  • [DMAS-53048] - Fix Dashboards not rendering properly
  • [DMAS-53049] - PR Test - Data Preview Generation and Display (201 - 600)couple of automated tests cannot be found in ui-testing repo
  • [DMAS-53074] - UTCDateTimePickerNew does not accept keyboard inputs correctly
  • [DMAS-53111] - QAQC flags in CSV data product are incorrect
  • [DMAS-53135] - ping ip failed but dmas.log shows connected in auto live DAF test
  • [DMAS-53147] - JUnit tests in Oceans 2 sometimes run forever (or close to it) in Jenkins
  • [DMAS-53179] - Handle time-alignment errors in RDI ensemble averaging
  • [DMAS-53199] - mis-match tags in ASL raw XML configuration file
  • [DMAS-53218] - Annotation creator/modifier options don't clear when the dive/cruise are cleared
  • [DMAS-53221] - Clicking on the Taxon Button Sets parent node on the tree crashes the page
  • [DMAS-53230] - Fix type assigned by ErddapDatasetService
  • [DMAS-53245] - ClassNotFoundException on org.nfunk.jep.ParseException when running jettyDataCentre
  • [DMAS-53263] - Search failure in QA - error in shrinkwhitecolourmap
  • [DMAS-53287] - Search failures in QA - ice buoy plots
  • [DMAS-53303] - NOAA and iFremer Logos fail to load in PROD
  • [DMAS-53308] - Error during Hibernate initialization -- QA with master branch
  • [DMAS-53321] - qaonshore1 unable to load oceans-next
  • [DMAS-53332] - Fix ismemberwithtolerance usage in gethydrophoneDP
  • [DMAS-53334] - Bundle exception when running OSGi
  • [DMAS-53355] - Cannot Add SiteDeviceSubsets on SearchTreeMaintenance Page
  • [DMAS-53358] - PR Test - Data Preview Generation and Display (201 - 600) data changes effecting test results
  • [DMAS-53361] - Community fisher search failures when generating cor file
  • [DMAS-53363] - Missing down arrow on Ocean 2.0 main menu drop downs
  • [DMAS-53383] - Plotting Utility Properties by Location Displaying Incorrectly
  • [DMAS-53388] - Fix Datapreview annotation selenium test
  • [DMAS-53401] - Add image filenames to build.gradle file

User Story

  • [DMAS-48813] - As a ADCP scientist, I want more choices on the scale limits on ADCP velocity plots
  • [DMAS-50627] - As an engineer, I want the names and comments of several test steps to be improved
  • [DMAS-51289] - As a system member, I would like to combine existing Status Console and System Console into one new System Console
  • [DMAS-52975] - As a deployment engineer, I want Oceans 2 and Oceans-Next to be compiled on a server that has access to the NOAA diveloggers, so that I don't have to move artifacts manually

Task

  • [DMAS-51704] - SeaTube Search to a separate full page
  • [DMAS-52623] - As a data steward, I would like a new field in the searchtreenode table to support dataset titles and abstracts
  • [DMAS-52934] - implement new jep formulas to calibrate Rinko temperature and saturation from voltage for Community Fishers with AML Plus parent
  • [DMAS-53071] - Allow double quotes to be used in the description field on the DeviceAction Maintenance page
  • [DMAS-53095] - Change SiteDeviceMaintenance page so that adding a Site Device Subset happens in the same page
  • [DMAS-53102] - Remove gradle builder from the onc root project
  • [DMAS-53103] - Refactor the Network Console UI test to demo a better way of using the page object model
  • [DMAS-53164] - Clean up oddities and unnecessary complications in DAL development new developers ran into in their projects
  • [DMAS-53190] - Improve Routing on the Dataset Landing Page so that the url reflects the DOI currently being viewed
  • [DMAS-53192] - Make "Remove All From List" button on Tab Actions of File Management page a little big
  • [DMAS-53194] - update selenium script to use new qa onshore machine
  • [DMAS-53211] - add test cases for web service SeaTubeDetailService
  • [DMAS-53212] - Add test cases for web service SeaTubeSensorDataService
  • [DMAS-53213] - Add test cases for web service SeaTubeMapService
  • [DMAS-53214] - Add test cases for web service SeaTubePermissionsService
  • [DMAS-53215] - Add test cases for PlaylistTreeService
  • [DMAS-53216] - Add test cases for web service ExpeditionTreeService
  • [DMAS-53220] - Add a button to jump from the Annotation List to a fully-featured search page
  • [DMAS-53264] - Update castdetectionpostprocess to handle sparse positional data.
  • [DMAS-53309] - Write automated test for parent node selection on Taxon Button Set Config page
  • [DMAS-53359] - Reduce no sample period warnings in matlab code
  • [DMAS-53368] - 2020-01 Regression: Update Selenium DA Test

Requirement

  • [DMAS-53117] - Discuss and update requirements and direction with Systems

Design

Implementation

  • [DMAS-50311] - Make Onc-Next's System Console table's columns resizable
  • [DMAS-50628] - Rename "checking for data rating"
  • [DMAS-50629] - Rename "checking for powerable status"
  • [DMAS-50630] - Rename "checking device atttributes"
  • [DMAS-50631] - Rename "validating nameplate serial number"
  • [DMAS-50632] - "gathering data" step should include the driver status in its comment
  • [DMAS-50634] - Summary data validation step's comment should say whether it checked summaries, or only summary requests
  • [DMAS-52246] - "Refresh" button on new System Console
  • [DMAS-52359] - Create a java wrapper to do CRUD operations on Datasets, Resources & Organizations
  • [DMAS-52370] - Create matlab scheduled post processing job to generate images for one device.
  • [DMAS-52768] - Update config page to allow deletion of Taxon Button Sets
  • [DMAS-52805] - Create service calls for deleting a button set and getting user delete permissions
  • [DMAS-52919] - Configure Oceans-Next to support optionally deploying a release branch to a divelogger
  • [DMAS-52926] - Implement additional colour options for ADCP daily current plots.
  • [DMAS-52927] - Add CKAN Dataset & Manager
  • [DMAS-53134] - Tweak the layout of the Landing Page to better reflect the design
  • [DMAS-53145] - Add data product download progress bar in the cast popup on geospatial map
  • [DMAS-53149] - Write EX Selenium Tests for ERRDAP
  • [DMAS-53150] - Write EX Selenium Tests for Oceans 2.0
  • [DMAS-53153] - Dataset title generation
  • [DMAS-53154] - Implement the front-end changes required to search on a Query PID
  • [DMAS-53160] - Adding ROR ID to webpage and data structures
  • [DMAS-53162] - Implement back-end changes for retrieving a DOI based on a query pid
  • [DMAS-53165] - Dataset abstract generation
  • [DMAS-53170] - Make small quality of life adjustments
  • [DMAS-53173] - Remove 'More' button from cast popup when there are no casts to display
  • [DMAS-53184] - Make pins clickable
  • [DMAS-53191] - Setup simulators for metrics data collection
  • [DMAS-53202] - Further implement design+req for citation text
  • [DMAS-53217] - Implement front-end for citation text on DOIMetadataSearch
  • [DMAS-53283] - Update UI to Material Standards
  • [DMAS-53289] - Update velocity and colourmap options for ADCP daily current plots
  • [DMAS-53302] - Add Data Player to Ocean's 2.0 (Front end)
  • [DMAS-53341] - Add play buttons to the SeaTubeV3 search results

Bug (ST)

  • [DMAS-52741] - Error loading Data Search: Sort by Location
  • [DMAS-52878] - Fix broken test in searchTreeMaintenance
  • [DMAS-52881] - Fix broken tests in UserManagement
  • [DMAS-53156] - System Command drop-down menu not sorted
  • [DMAS-53311] - Daily and Weekly LTSAs are no longer working
  • [DMAS-53369] - Fix Broken Tests in Plotting Utility


January 9, 2020

Major release for Oceans 2.0. The holiday break usually means fewer features are developed. 

Instruments

  • AIS parsing: design (in-progress)

  • Data acquisition bottleneck detection and reaction: investigation, design (in-progress)
  • Sandbox improvements: improvements to support user's code, more usability and reliability issues
  • Improvements the Community Fishers / Citizen Scientist data acquisition Android App: reconnect/retry data transfer, fix some bluetooth/wifi issues

Community Fishers

  • Integration with Data Search (in-progress)
  • Refactor plot generation
  • Bug fixes and testing

Automated Testing

  • Automated task testing framework implementation

  • Automated UI testing: expanded coverage, test improvements, structural changes for maintainability
  • Continuous deployment: separate front and back-end compilation for faster builds

Data Products

  • New data product for ASL echosounders: manufacturer's raw binary .01A files (these are compatible with EchoView and other 3rd party software)
  • Prevent jitter in CODAR GIFs
  • World Magnetic Model update
  • Bug fixes in these areas:
    • SIMBA ice buoy
    • Kongsberg Rotary SONAR (thanks to Chris de Moustier),
    • stuck searches
    • RDI ensemble/average time out of order when accessing live data

Maintenance and Production Developer

  • Auto refresh in Plotting Utility is now available in saved plots
  • Manual QAQC job handles overlaps
  • World Magnetic Model update
  • Security improvements
  • System console improvements: dequeue/queisce function and status now displayed, UI improvements, including search and refresh
  • Various other bug fixes and small projects

SeaTubeV3 - CANARIE & NOAA & ONC

  • Upgrade Material-UI to V4 (enables new features to be developed)
  • Video player re-implementation, making it useable for both dashboards and SeaTube
  • Improvements to Digital Fishers main page and management pages
  • SeaTubeV3 and annotations available on-ship without internet or if Oceans2.0 is down
  • SeaTubeV3 theme improvements
  • Bug fixes

Dashboards - CANARIE

  • Users can now see all dashboards shared with them

MINTED - CANARIE

  • UI for sitedevicesubsets
  • Requirements and design for versioning data and metadata improvements, including updating DOIs (in-progress)
  • DOIs for fixed deployments

CIOOS / ERDDAP

  • Ongoing

Tickets Released: Oceans 2.0: 19.12.000 (accessible to internal users only). Total: 191.

 Release notes from JIRA for 19.12.000

Usability

  • [DMAS-52133] - Filters are not applied using the enter key.
  • [DMAS-52650] - The cursor should change to indicate that you can click on annotations within the list
  • [DMAS-52656] - Have ‘Capture Time’ displayed by default

Bug

  • [DMAS-42917] - Ice buoy data products aren't working properly
  • [DMAS-46711] - Multiple ADCP Intensity Plots in PDFormat are scrambled in time
  • [DMAS-47016] - VPS_PLATFORM_CONTROLLER driver not parsing device data messages correctly
  • [DMAS-47917] - Time jumps in RDI ADCP ensemble average MAT file products
  • [DMAS-50764] - Ping IP or configure IP failed in automated Live DAF test, but no issue for DAF test manually
  • [DMAS-51319] - Investigate discrepancies in Kongsberg Rotary code reported by Chris de Moustier
  • [DMAS-51921] - Advanced sharing allows duplicate emails to be entered, deleting removes both
  • [DMAS-51932] - TypeError: onChange is not a function in Digital Fishers date pickers
  • [DMAS-52039] - UTCDateTimePicker behaves weird when manually entering dates and times
  • [DMAS-52455] - Cannot run npm start after upgrade to material-ui v4
  • [DMAS-52677] - After Changing a dashboard from public to private or vice versa the spinner doesn't change back to the Add Dashboard button
  • [DMAS-52727] - manual entry > quick entry's "Select a button set" dropdown doesn't resize based on width
  • [DMAS-52755] - Download txt file for most recent cast doesn't display error message
  • [DMAS-52791] - DMAS Search Failed Notification: 02-Dec-2019 03:57:23 UTC, Upper Slope-Delta Dynamics Laboratory, Imagenex Rotary Sonar Data, SearchHdrId 3718673, UserId 2819
  • [DMAS-52792] - Fix sensor panel UI tests
  • [DMAS-52824] - Update community fishers matlab after Data Preview Generation Refactored
  • [DMAS-52829] - Wrong cast data plot displaying in data preview
  • [DMAS-52834] - Wrong search type given in data preview .cor file query
  • [DMAS-52846] - Oceans 2.0 browser cache invalidation is broken in production
  • [DMAS-52858] - Community fisher Cast Scalar Multi Profile Plot is not producing the same plot when called from device vs location search
  • [DMAS-52860] - SOO/E job getting null dateFrom
  • [DMAS-52864] - DMAS Search Failed Notification: 12-Dec-2019 12:00:15 UTC, Clayoquot Slope-Bullseye, Time Series Scalar Plot, SearchHdrId 4021696, UserId 40000
  • [DMAS-52874] - MultipleChipSelect chips cannot be deleted using the X icon
  • [DMAS-52884] - SOO/E job generates duplicate search_dtl on Clayoquot Bullseye
  • [DMAS-52897] - Small Bug in Cor file generation
  • [DMAS-52907] - Automated live DAF test "Pinging IP" output is formatted oddly
  • [DMAS-52928] - Java MATLAB runners do not capture the first logging line from MATLAB
  • [DMAS-52968] - Some tests that depend on ServletUtil fail intermittently in Jenkins
  • [DMAS-52969] - DMAS Search Failed Notification: 19-Dec-2019 07:00:04 UTC, Barkley Canyon-MidEast, RDI Daily Current Plot, SearchHdrId 4196391, UserId 15356
  • [DMAS-52974] - Annotation filter does not open in annotation list
  • [DMAS-52977] - Striping on tables being applied to all tables, instead of just "StripedTable"
  • [DMAS-52995] - Video player current duration doesn't match with current UTC timestamp after 5 minutes
  • [DMAS-52996] - Search failures and changes in QA automation related to mobilePositionData
  • [DMAS-53005] - failed to deploy master branch of Oceans 2.0 to QA
  • [DMAS-53015] - SeaTubeUtilsTest is failing in Jenkins on Oceans 2 master
  • [DMAS-53016] - WERA ftp job failing
  • [DMAS-53028] - Kongsberg Search Failures in QA
  • [DMAS-53046] - Changing video quality doesn't properly display, and can lock the menu
  • [DMAS-53058] - Investigate changes to water column data products noted in Jan 7 2020 search automation
  • [DMAS-53059] - DeviceListing page does not display any devices
  • [DMAS-53062] - Investigate, then fix (and report actual bugs in) failing SeaTubeV3 UI tests
  • [DMAS-53077] - Water column product using same colour for different data.
  • [DMAS-53079] - erddapXML page gives a 404 error
  • [DMAS-53082] - map of infrastructure ONC home page (under “The Internet Connected Ocean” section) is gone?
  • [DMAS-53084] - deployment failed for latest version of master and release/19.12.000 in Oceans-Next
  • [DMAS-53093] - ErddapManagement datasets sometimes cannot be added
  • [DMAS-53110] - The wrong revision of oceans-next is running in QA
  • [DMAS-53129] - Oceans-Next pages don't render in QA Oceans 2.0
  • [DMAS-53136] - withAnnotationEntry() in LayoutsAndPermissionsTest.java can't delete annotation

Epic

  • [DMAS-52291] - CANARIE MINTED / Datasets / Dataset Definition

User Story

  • [DMAS-42960] - As an ASL echosounder user, I would like an ASL raw file data product
  • [DMAS-47724] - View Dashboards Shared With Me
  • [DMAS-51206] - As a data steward I want a UI to create and update a SiteDeviceSubset (with geospatial area) so I don't need to enter via sql
  • [DMAS-51288] - As a data steward I want to have DOIs for all devices at fixed sites so more data has unique identification
  • [DMAS-51861] - As a developer, I want to move the automation test tree UI from Liferay to the dev playground so that more people will be qualified to work on it
  • [DMAS-52324] - As a Digital Fisher, I would like improvements to the Digital Fishers Page
  • [DMAS-52327] - As a Digital Fisher Admin, I would like improvements to the Campaign Management Page
  • [DMAS-52335] - As a user of pages related to SeaTube I would like the theme to be similar to SeaTube
  • [DMAS-52478] - As a Software Developer, I want a Video Component that works for SeaTube and Dashboards
  • [DMAS-52698] - As a NOAA dive logger, I want to be able to access SeaTubeV3 from the ship without Internet access, so I don't experience interruptions while making annotations
  • [DMAS-52699] - As a NOAA onshore dive logger, I want to be able to record annotations without being interrupted by datacentre deployments
  • [DMAS-52955] - As a dev, I would like to improve manualqaqcresult job to elimate any overlap issue
  • [DMAS-52983] - As a User, I would like to add auto refresh as a parameter to saved plot data in Plotting Utility
  • [DMAS-53021] - As a software developer, I want to be able to compile backend and frontend changes independently of each other, so I don't need to wait as long for local builds

Task

  • [DMAS-46676] - Deployments include unused node_modules folders
  • [DMAS-48568] - Update State of the Ocean Plot for Saanich Inlet VIP after March-2019 cruise
  • [DMAS-50088] - Compare outputs from RDI java complex derivation to matlab and winADCP processing
  • [DMAS-50614] - As a Cyber-Security auditor, I want the IP addresses of devices made non-visible for non-ONC users
  • [DMAS-51566] - Update State of the Ocean Plot Searches after completion of 2019 Expedition Season
  • [DMAS-51594] - On the TaxonButtonSetConfig page only allow button sets to be marked active once they have a button assigned
  • [DMAS-52263] - Add ui tests for annotation list option behaviour
  • [DMAS-52590] - Please use the attached icon to replace our current ROV image in ST map (the blue dot)
  • [DMAS-52592] - Investigate Data Player image request code
  • [DMAS-52700] - Setup SOO/E plot generation job in PROD and check results
  • [DMAS-52718] - Create UI test for DashboardManagement page
  • [DMAS-52759] - Create UI test for Dashboard display
  • [DMAS-52761] - UI test for populating annotation search
  • [DMAS-52774] - dataProductDelivery download method response message contains HTML
  • [DMAS-52803] - Intermittent unit test failure in BaseDriverTest
  • [DMAS-52804] - Make more informative error messages for geospatial map failures
  • [DMAS-52839] - Add dpo parameters to searches and display plot in geospatial map
  • [DMAS-52866] - Refactor Community Fishers MATLAB code
  • [DMAS-52896] - Clean up Oceans-next testing console.errors/.warnings
  • [DMAS-52900] - Improve reporting in live DAF testing when some sensors have no data
  • [DMAS-52946] - Allow a user to specify some UI tests to be run through Jenkins
  • [DMAS-52992] - Update .gitignore file in ONC Data Products to ignore autosave files on linux
  • [DMAS-53001] - Method documentation in DeclinationUtil.java state the wrong units for altitude
  • [DMAS-53008] - Prevent jitter in CODAR GIF plots for VJOR/BONI/SAND
  • [DMAS-53014] - add DOI landing page to oceans 2.0
  • [DMAS-53038] - Move the QaDeviceTests.java test file to proper location
  • [DMAS-53039] - Implement Regression Test HY.TC.251
  • [DMAS-53069] - Hide Delete and Change State buttons on File Management page
  • [DMAS-53138] - Enable change file_state feature on File Management page

Requirement

  • [DMAS-52239] - Investigate file format specific requirements for ASL raw format
  • [DMAS-52350] - Gather & write requirements for Oceans 2.0 integration
  • [DMAS-53022] - Document requirements

Design

Implementation

  • [DMAS-50717] - Create the material toolbox component
  • [DMAS-51340] - Display some kind of feedback when a command is sent
  • [DMAS-51393] - Add handlers for SiteDeviceSubsetTable
  • [DMAS-51491] - Make/Adapt new map component to use in geospatial area
  • [DMAS-51492] - Display/Handle new map component in the SiteDeviceSubset popup
  • [DMAS-51562] - Add quiesce/resume status console functionality to new system console
  • [DMAS-51718] - Finalize layout for Site Device Entry screen
  • [DMAS-51719] - Add Button that Links to ERRDAP Management Page
  • [DMAS-52014] - Refactor Edit SiteDeviceSubset Popover as its own Page
  • [DMAS-52043] - Add site device page to the dmas environment
  • [DMAS-52334] - Remove form section id field from campaign entry
  • [DMAS-52340] - Improve the design of the Statistics page
  • [DMAS-52343] - Review button considerations for Edit Taxon and Taxonomy screens
  • [DMAS-52382] - Figure out how validation should work in Digital Fishers Campaign Management
  • [DMAS-52390] - "DELETE" button should always be on Site Device Screen (disable it when not used)
  • [DMAS-52406] - Re-Write Grouping bar message to be more helpful
  • [DMAS-52407] - make sure checkboxes should be maintained after command sent
  • [DMAS-52408] - Organizing issue for Filter buttons
  • [DMAS-52417] - Implement ASL raw data product - search code
  • [DMAS-52419] - Implement ASL raw data product - mappings
  • [DMAS-52453] - Refactor java search creation to match device level data search for cast scalar multi profile plot
  • [DMAS-52461] - Update Landing Page to show new values from Datacite XML
  • [DMAS-52528] - Add ADCP device type to Device Category dropdown
  • [DMAS-52529] - Add ADCP device list to Device dropdown
  • [DMAS-52534] - Implement Java code to call hydrophonepostprocessjobdailyweeklyltsa on a schedule
  • [DMAS-52617] - Implement a reusable video menu
  • [DMAS-52627] - Create a component in Oceans Next to display the Test Tree
  • [DMAS-52726] - Configure Oceans-Next to build and deploy a WAB to the datacentre
  • [DMAS-52739] - Implement a component that stitches playlist files into a continuous video
  • [DMAS-52748] - Modify permissions service to return self-delete privilege
  • [DMAS-52750] - Modify frontend to display delete icon for NOAA user's own annotations
  • [DMAS-52779] - Implement a DiveVideo component
  • [DMAS-52797] - Download and cache React
  • [DMAS-52817] - Add a return message to the erddapXML service
  • [DMAS-52823] - Only deploy to the demo server from the master branch
  • [DMAS-52826] - Implement UTCAddons and DiveVideoTemplate
  • [DMAS-52831] - Refactor search request validation for cast data products
  • [DMAS-52841] - Display pretty values in table
  • [DMAS-52847] - Use the new video player in seatube
  • [DMAS-52852] - Improve manualQaqcResult job
  • [DMAS-52882] - Implement recording
  • [DMAS-52885] - Update Task Detail page to only show the last 5 image key messages
  • [DMAS-52887] - implementation for auto-refresh of saved plots
  • [DMAS-52890] - Configure Oceans-Next to get the Oceans 2 hostname from the DMAS global variable
  • [DMAS-52910] - Implement video snapshots
  • [DMAS-52914] - Add new field to database
  • [DMAS-52915] - Implement flag in backend
  • [DMAS-52916] - Add new flag to UI
  • [DMAS-52917] - Configure Gemini to delay before scanning deploy/
  • [DMAS-52918] - Configure Oceans 2 to use a locally-deployed instance of Oceans-Next
  • [DMAS-52920] - Add siteDeviceSubsetPage to DMAS
  • [DMAS-52921] - Implement the video share button
  • [DMAS-52924] - Deal with add new button without a siteDeviceId
  • [DMAS-52929] - Use the new video player in playlist management
  • [DMAS-52935] - Add the tutorial video back to SeaTube
  • [DMAS-52936] - Implement live videos in SeaTube and VideoPlayer
  • [DMAS-52940] - Modify Cast Data (5) Preview Generation Job to ignore Data Preview tree constraints
  • [DMAS-52961] - Modify Data Search to correctly display CF Cast Data nodes in the tree
  • [DMAS-52966] - Extract Oceans 2 front-end code to its own OSGi bundle
  • [DMAS-52973] - Move all items from sub-table to main row
  • [DMAS-53031] - Update the PlottingUtility dashboard widget to use the new static path
  • [DMAS-53098] - Update IM Selenium testing for database reference flag

Test Plan

  • [DMAS-52395] - Add automation searches for ASL raw product

Bug (ST)

  • [DMAS-49530] - As CF app user I would like the app to retry getting the data automatically if the first transfer is unsuccessful
  • [DMAS-52217] - The Digital Fishers Campaign Maintenance Statistics page does not fully meet the requirements described by DF.RQ.311
  • [DMAS-52599] - Fix creators and contributors metadata
  • [DMAS-52625] - ErddapManagementTable doesn't appear in localhost or qa env.
  • [DMAS-52640] - Fix broken tests in seatubeV3
  • [DMAS-52747] - Searches created in datapreview generation job are missing entries in search table
  • [DMAS-52778] - Change SiteDeviceSubsetService to return GenerationType and SiteDeviceSubsetType Ids
  • [DMAS-52799] - Fix JS file name in build.gradle
  • [DMAS-52807] - SystemConsole grouping/sorting colours are inconsistent with row color
  • [DMAS-52871] - Fix broken test in NetworkConsole
  • [DMAS-52879] - Fix broken tests in Hydrophone
  • [DMAS-52925] - Fix error when sharing with group
  • [DMAS-52952] - Fix ErddapManagementEdit Page
  • [DMAS-52993] - Video causes SeaTube to crash in Oceans 2
  • [DMAS-52997] - 'Calibrated' dropped from ASL plots filename
  • [DMAS-53002] - dashboard.onc.uvic.ca makes all fetch requests against localhost
  • [DMAS-53012] - Oceans-Next master build failure: ./build-bundle.sh not found
  • [DMAS-53035] - QA does not load properly
  • [DMAS-53044] - Fix broken tests in PlottingUtility
  • [DMAS-53050] - Fix broken tests in HomePage
  • [DMAS-53070] - Remove JupyterHub menu item from main menu
  • [DMAS-53075] - Graylog Util gets connection refused when trying to call the Graylog API
  • [DMAS-53076] - fix broken test in Digital Fishers
  • [DMAS-53139] - Change all occurrences of TXT to .COR

Investigation

  • [DMAS-52891] - Can I redeploy a WAB without restarting Equinox?
  • [DMAS-52901] - Can I redeploy Oceans 2 while the Oceans-Next WAB is deployed?
  • [DMAS-52902] - Can I force oceans-next-bundle.js to not be cached, without nginx in front of it?

Documentation