Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

This page contains the current year's release notes and new features, primarily for Oceans 23.0 / DMAS, as well as any applications created/maintained by the ONC software engineering development group, including mobile Apps and desktop/PC applications. In progress project status may be presented as well.

Previous years:

Children Display

The information below is written in plain language as much as possible. Detailed release notes are available on internal confluence pages (requires login).

April 21, 2020

Minor release: bug fixes and features for the MINTED project, including updates for the new batch task system.

Tickets Released: Oceans 2.0: 20.03.007 (accessible to internal users only). Total: 26.

Expand

Bug

  • [DMAS-54475] - TypedManager exceptions being thrown in device listing page
  • [DMAS-54479] - TaskDefinitionBatch page does not delete parameters when a parameter's name is deleted
  • [DMAS-54556] - Fix automatic merge Failure
  • [DMAS-54593] - there is an issue with the way we are including ROR ids in the DataCite XML
  • [DMAS-54595] - DMAS Search Failed Notification: 19-Apr-2020 00:35:39 UTC, British Columbia Ferries-Tsawwassen - Duke Point Ferry Route, Time Distance Variable Scalar Plot, SearchHdrId 5076407, UserId 15356
  • [DMAS-54662] - Batch dropdown doesn't have an option for users not to add a change to a batch
  • [DMAS-54674] - Cannot create DOI for sitedevice 1190700
  • [DMAS-54676] - fix spelling of DataCite on landing page
  • [DMAS-54677] - Ferry, Buoy, and Navigation data is showing in DataCite abstract as 'fixed' location

User Story

  • [DMAS-53870] - Add batch support to selected tasks
  • [DMAS-53882] - add link to end user wiki documentation for data citations to the landing pages

Task

  • [DMAS-53123] - Change SiteDeviceMaintenance to use query parameters instead of path parameters
  • [DMAS-54483] - when running job 337, the modifyby in pi_doidataset table should be the person who ran the job
  • [DMAS-54588] - Remove leading and trailing whitespace in input parameters (was - job 337 is minting DOIs to TEST even when PROD is selected since the last release with version 20.03.005)
  • [DMAS-54663] - Update the highlighting color of tables in Oceans Next
  • [DMAS-54745] - Make TaskManagementBatch React page scrollable

Implementation

  • [DMAS-54066] - Add batching ability to sensor addtions
  • [DMAS-54067] - Add batching ability to sensor attribute
  • [DMAS-54068] - Add batching ability to sensor calibration changes
  • [DMAS-54193] - Implementation for device batch screen changes
  • [DMAS-54227] - Selenium Test Create batch
  • [DMAS-54326] - Update SensorAttributeService to use batches when updating attributes
  • [DMAS-54364] - Hook up add batch tasks to call the web service
  • [DMAS-54670] - Add support to service to get all children for a task

April 19, 2020

Minor release: bug fixes and features for the MINTED project.

Tickets Released: Oceans 2.0: 20.03.006 (accessible to internal users only). Total: 21. 

Expand
titleRelease Notes from JIRA for 20.03.006...

Bug

  • [DMAS-53738] - Fix broken tests in ExpeditionManagement
  • [DMAS-54380] - Fix broken tests in DataViewer
  • [DMAS-54489] - the title for RDI ADCPs should not have 'ancillary data' when populating title in DataCite or dataset DOI metadata
  • [DMAS-54496] - unable to create dataset DOI for DRDC CTD test case
  • [DMAS-54509] - correction to the citation text for accessed date
  • [DMAS-54511] - The data product options are not appearing correctly for a specific data search
  • [DMAS-54516] - Job 337 hangs on 'Running' status for some entire-devicetype minting jobs
  • [DMAS-54531] - Data Citation Text Service not working for Query PIDs
  • [DMAS-54565] - DOI's with mobile depth and fixed lat/lon have incorrect geolocations
  • [DMAS-54570] - when running job 337 for the second time on a sitedevice, TWO new DataCite entries are made
  • [DMAS-54571] - snackbar has undefined batch name after adding a batch
  • [DMAS-54593] - there is an issue with the way we are including ROR ids in the DataCite XML

Task

  • [DMAS-54486] - dataset DOI produced for Thermosalinograph on ferry has undefined, undefined for the lat/long
  • [DMAS-54490] - There was no dataset doi generated by a 'completed' job 337 for ROV navigation dataset
  • [DMAS-54589] - Remove ROR from citation text
  • [DMAS-54667] - Update task types in prod

Requirement

  • [DMAS-54094] - Record requirements for MINTED CANARIE service

Implementation

  • [DMAS-54220] - frontend associate manual doi generation with a batch
  • [DMAS-54321] - Update DeviceAttributeService to use batches when updating attributes
  • [DMAS-54381] - Fix and enable the disabled UI tests
  • [DMAS-54546] - update selenium tests for Properties being changed to Variables on DatasetLandingPage

April 16, 2020

Minor release: changes for MINTED project: fixes for minting DOIs, batch system; UI testing fixes, monthly Data Preview fixes, permission fix for task management, and more.

Tickets Released: Oceans 2.0: 20.03.005 (accessible to internal users only). Total: 40. 

Expand
titleRelease Notes from JIRA for 20.03.005...

Bug

  • [DMAS-51341] - Site device site drop down is much too slow
  • [DMAS-53750] - Fix broken tests in seatubeV3.VideoPlayerTest
  • [DMAS-53755] - Fix broken tests in website.general.General
  • [DMAS-53862] - Users with RW access to Task Management can not run the jobs on Task Management page
  • [DMAS-54348] - Fix broken tests in reloadCache of NewSystemConsole
  • [DMAS-54435] - DOI Generation task throws a null pointer exception for mobile site devices
  • [DMAS-54458] - Extra Hydrophone calibration file provided
  • [DMAS-54462] - The current DOI isn't highlighted in history
  • [DMAS-54465] - DMAS Search Failed Notification: 09-Apr-2020 04:30:05 UTC, ODP 1364A-Hydrophone High Frequency 2.8 mab, Hydrophone Spectral Data, SearchHdrId 5067600, UserId 15356
  • [DMAS-54488] - Error minting DOI for DeviceID: 30399
  • [DMAS-54491] - Looks like the token is still required in the citationText service
  • [DMAS-54495] - Invalid bounding box generated for ferry device
  • [DMAS-54497] - update the automated abstract to use lower case for fixed/mobile/profiling
  • [DMAS-54498] - the instrument measurement footprint is not being used for the geoextent in DataCite metadata
  • [DMAS-54501] - DeviceTypeID 55 doesn't work in TaskManagementTEST
  • [DMAS-54530] - Error messages from DataSetManager on task machines
  • [DMAS-54533] - edit batch dialog renders when after details update in add batch dialog

Task

  • [DMAS-54186] - Upgrade CacheSensorDuration code to work with latitude sensors
  • [DMAS-54343] - Modify theme
  • [DMAS-54459] - Add hydrophone calibration txt files to FLAC searches
  • [DMAS-54473] - Hydrophone Data Preview improvements
  • [DMAS-54484] - There was no DOI created for a device with mobile lat/long/depth
  • [DMAS-54499] - unable to create a dataset DOI for Aanderaa Oxygen Optode
  • [DMAS-54508] - improve query details section with 'Properties' in the DataSet Landing Page

Implementation

  • [DMAS-51974] - Implement current DeviceSync page with react
  • [DMAS-53706] - Refactor ErddapXMLService to have displayOnly option for generating datasets for one site device
  • [DMAS-54124] - Write jest and enzyme unit tests
  • [DMAS-54178] - Extract certain style components from deviceSyncTable into groupable table
  • [DMAS-54221] - backend associate manual doi generation with a batch
  • [DMAS-54240] - Update batch & batch tasks UI to use TaskHistoryBatchService to get data
  • [DMAS-54268] - Hook batch creation dialog into the web service
  • [DMAS-54285] - Add hover & selections to BatchList table
  • [DMAS-54299] - Update CalibrationServlet to use batches when updating calibrations
  • [DMAS-54306] - Implement front-end UI for editing an existing batch
  • [DMAS-54310] - Add an update operation to TMTaskService for updating the details of a batch
  • [DMAS-54320] - Add new batch tables to TaskManagement
  • [DMAS-54323] - Change edit mode and add data to service call
  • [DMAS-54332] - Update DeviceParserDefinitionService to use batches when updating parsers
  • [DMAS-54382] - Add ability to run tasks to UI
  • [DMAS-54402] - add logic to the doiRegistrationBatchJob to use the task output field
  • [DMAS-54407] - update DOI Generation job to update its output with transactions of modified DOI's
  • [DMAS-54434] - If a host can't be found in the table, print what hosts are found
  • [DMAS-54480] - Get batchable tasks from web service

Test

Bug (ST)

  • [DMAS-54275] - Batch Task List displays TaskTypeId instead of TaskType

April 11, 2020

Minor release: changes for MINTED project

Tickets Released: Oceans 2.0: 20.03.004 (accessible to internal users only). Total: 5. 

Expand
titleRelease Notes from JIRA for 20.03.004...

Bug

  • [DMAS-54397] - User Defined jobs dont display in the task tree on the TaskManagementBatch page
  • [DMAS-54427] - Publication year not using correct dates
  • [DMAS-54485] - TWO datacite entries were created with the official DataCite registry for ONE dataset

User Story

  • [DMAS-54342] - Only display DOIs with the same prefix in history

Implementation

  • [DMAS-54409] - Update logic to return DOI history to restrict to those with the same prefix

April 10, 2020

Minor release: bug fixes for MINTED project

Tickets Released: Oceans 2.0: 20.03.003 (accessible to internal users only). Total: 2. 

Expand
titleRelease Notes from JIRA for 20.03.003...

Bug

  • [DMAS-54460] - DOI dataset using UUID which is different from doidataset in pi_doidataset
  • [DMAS-54463] - The link we send to datacite is still pointing to the home page instead of the landing page

...

April 8, 2020

Feature release for Oceans 2.0: primarily for the MINTED project, plus various fixes and other features.

Data Products

  • CODAR data availability data products are available for Combiner/Total stations (Radial stations coming soon)
  • Monthly complex Data Preview for CODAR currents, availability and hydrophone LTSAs and SPD are now available
  • FLAC audio data products now available for all hydrophones, plus post-processors will generate and archive for fast retrieval
  • Bug fixes: hydrophone LTSA collation, ASL AWCP complex parser and zero-sized products

Automated Testing and Continuous Deployment

  • Bug fixes (many) to improve automated test results

Maintenance and Production Developer

  • Bug fixes: device synchronization

Community Fishers

  • Bug fixes

MINTED - CANARIE

  • Tasks to support both single and bulk minting of DOIs to Datacite
  • Initial framework for a new task batch system which gives structure to data changes that provides provenance for data version changes (no yet activated, more to come)

CIOOS / ERDDAP

  • ISO metadata reports available via service (not yet public)
  • Added French titles to ERDDAP/CKAN datasets

Tickets Released: Oceans 2.0: 20.03.002 (accessible to internal users only). Total: 116.

Expand
titleRelease Notes from JIRA for 20.03.002...

Bug

  • [DMAS-52876] - Fix broken tests in GeospatialMap
  • [DMAS-53723] - Fix broken test in Groups
  • [DMAS-53733] - Fix broken tests in DigitalFishers
  • [DMAS-53735] - Fix broken tests in Hydrophone
  • [DMAS-53787] - fix broken test in seatubeV3.SensorReadingsTest
  • [DMAS-53788] - Fix broken tests in sitedevicemaintenanceV2.SiteDeviceMaintenance
  • [DMAS-53814] - Fix broken test in DashboardSharing
  • [DMAS-53878] - Fix broken tests in DashboardDisplay
  • [DMAS-54159] - DOIDatasetService does not create an array when there is only one date in the xml
  • [DMAS-54202] - Monthly Complex Data Preview Generator creates some searches based on daily dpf specs
  • [DMAS-54229] - Unhandled rejections in Oceans-Next Services
  • [DMAS-54235] - Cannot generate a DOI from SiteDeviceMaintenance
  • [DMAS-54237] - SiteDeviceService returning successfully when Site Device not saved
  • [DMAS-54249] - Add trx table for tm_task and add modify by and modify date columns
  • [DMAS-54250] - ASL binary .01a files are zero size in search automation test case
  • [DMAS-54259] - resolve jettybase
  • [DMAS-54270] - Fix merge conflict from release/20.03.000 to master for DMAS-53637
  • [DMAS-54274] - Hydrophone spectral data products with FFT/wav source option 'MIX' seems to return both
  • [DMAS-54282] - Jenkins isn't archiving UI test failure screenshots
  • [DMAS-54294] - Data Search not delivering Community Fishers Data correctly
  • [DMAS-54297] - Community fisher location searches for cast scalar multi profile plots are producing incorrect titles.
  • [DMAS-54316] - Two sets of ticks facing outward on Echosounder plot
  • [DMAS-54319] - Fix static analysis warning in DataSourcePage
  • [DMAS-54327] - DMAS Search Failed Notification: 31-Mar-2020 18:36:00 UTC, Northeast Pacific Ocean-Endeavour, Cast Scalar Profile Plot and Data, SearchHdrId 5058637, UserId 88930
  • [DMAS-54328] - DMAS Search Failed Notification: 31-Mar-2020 18:36:30 UTC, Northeast Pacific Ocean-Endeavour, Cast Scalar Profile Plot and Data, SearchHdrId 5058638, UserId 88930
  • [DMAS-54334] - Jenkins is not working
  • [DMAS-54336] - Community fisher location searches have empty parameter string in search table
  • [DMAS-54340] - Fix sy_translation trigger audit function to insert into correct table
  • [DMAS-54344] - Fix broken test for DatasetLandingPageTest for error message
  • [DMAS-54352] - Fix broken tests in testOperatorPermission, testWatcherPermssion and cameraControlInitialLoading of CameraControl
  • [DMAS-54359] - Fix broken tests in checkTranslationFileUpload of FileManagement
  • [DMAS-54368] - DMAS Search Failed Notification: 02-Apr-2020 04:58:28 UTC, CODAR SeaSonde 16MHz (SN 2016480) VROC, CODAR Quality Controlled Surface Currents, SearchHdrId 5060024, UserId 43686
  • [DMAS-54374] - Fix broken tests in setup of ManualTest
  • [DMAS-54432] - Fix datasetLandingPage to not require a fundingReference.

User Story

  • [DMAS-51184] - As a third party data provider I want my organization ROR to be included in citation text
  • [DMAS-51303] - Manually create a new DOI for an existing dataset
  • [DMAS-52322] - As an Oceans 2 data user I want mobile datasets to have DOIs so I can reference them
  • [DMAS-52468] - As an Oceans 2 data user I want to view the options used for a query so I can know more about the data in the query
  • [DMAS-53286] - As a data steward, I would like to associate repostprocessing with a batch to assist in provenance
  • [DMAS-53474] - As a third party data provider I want my ROR associated with DOI metadata
  • [DMAS-53495] - As a dataset user I want to see the dataset publisher and funders to learn more about the data
  • [DMAS-53518] - Update the task data model
  • [DMAS-53533] - As a data steward I want to generate a new DOI for changes in batch so DOI is accurate
  • [DMAS-53534] - associate a batch when uploading files
  • [DMAS-53869] - Execute batch on task machine
  • [DMAS-54054] - Execute Reprocess Group task
  • [DMAS-54188] - Run a batched re-postprocessing task

Task

  • [DMAS-53126] - Change DOIMetadataSearch page to DatasetLandingPage
  • [DMAS-53912] - Separate UI notification for generating dataproducts from retrieving images.
  • [DMAS-54255] - Update error snackbars and parameters for DOIDatasetService
  • [DMAS-54286] - Get rid of the DataSearch UI test's failure listener
  • [DMAS-54289] - Lazily initialize CachedDomainManager.cacheWrapper
  • [DMAS-54302] - run all selenium tests every night
  • [DMAS-54324] - Fail early if a test tries to load a page that doesn't exist
  • [DMAS-54343] - Modify theme
  • [DMAS-54362] - The DOI registration job runs too slowly

Requirement

  • [DMAS-54248] - Document requirements for test resolution/browser size

Design

Implementation

  • [DMAS-53471] - Implement CODAR data availability plots (totals only)
  • [DMAS-53574] - update paths in selenium tests and fix broken tests SiteDeviceMaintenance
  • [DMAS-53578] - implement front-end to display publisher and funding reference
  • [DMAS-53599] - refactor unscheduled job messaging to use new tasks
  • [DMAS-53602] - refactor existing jobs to use tm_task output instead of taskhistorydetail
  • [DMAS-53604] - populate the tm_task and tm_taskdetail with data from taskhistory and taskhistorydetail
  • [DMAS-53609] - refactor code that cancels tasks
  • [DMAS-53635] - refactor ReprocessingFrameworkService and ReprocessingSession to use the new task framework
  • [DMAS-53637] - Update ISO19115 XML and CKAN Datasets with French title and abstract
  • [DMAS-53661] - Implement a service for generating ISO 19115 XML files
  • [DMAS-53779] - Use the POM in ca.uvic.onc.test.ui.test.extension.parser.reprocess.Reprocess
  • [DMAS-53780] - Use the POM in ca.uvic.onc.test.ui.test.extension.datadownload.dataSearch.DataSearch
  • [DMAS-53858] - View batch task detail
  • [DMAS-53865] - Edit a batch task
  • [DMAS-53866] - Remove a batch task
  • [DMAS-53871] - Implement CODAR data availability plots (SQL)
  • [DMAS-53884] - Add database entries for service
  • [DMAS-53899] - Make changes to existing task management ui
  • [DMAS-53916] - add selenium tests to check for Funding Reference and Publisher
  • [DMAS-53921] - add link to documentation for landing page frontend
  • [DMAS-53924] - Add Create Batch Dialog to the Batch UI
  • [DMAS-53927] - Add TaskHistory, task, and TaskDetail queries to the new tm_task manager
  • [DMAS-53935] - Add support for minting to prod or test in the DOI generation task
  • [DMAS-53936] - Update DOI manual create screen to include prod/test
  • [DMAS-53949] - Add CODAR data availability plots to daily and monthly tabs in Data Preview
  • [DMAS-53961] - Implement add and edit of reprocess group tasks
  • [DMAS-53965] - Implement add and edit of re-postprocess tasks
  • [DMAS-53966] - Add selenium tests
  • [DMAS-53969] - Implement add and edit of file upload tasks
  • [DMAS-53971] - Add selenium tests
  • [DMAS-53975] - Implement Run batch
  • [DMAS-53980] - Implement Cancel batch
  • [DMAS-54057] - Implement execution of Reprocess "group" tasks
  • [DMAS-54060] - Implement batch execution
  • [DMAS-54062] - write selenium test for CRUD of data-rating at sensor level
  • [DMAS-54082] - View batches implementation
  • [DMAS-54106] - Add new page into dmas menu of Oceans 2.0
  • [DMAS-54118] - Add config properties to store test and prod settings
  • [DMAS-54119] - Update minting code to use config properties
  • [DMAS-54194] - add code for running batch sub tasks
  • [DMAS-54205] - Implement web service to get tasks
  • [DMAS-54209] - Service to create batch and create task and add it to a batch
  • [DMAS-54215] - Service to get Batchable task definitions
  • [DMAS-54240] - Update batch & batch tasks UI to use TaskHistoryBatchService to get data
  • [DMAS-54251] - Implement running re-postprocess batch tasks
  • [DMAS-54258] - allow the DOI Registration job to work in the new task framework using a list of siteDeviceIds
  • [DMAS-54264] - Add Flac generation to matlab hydrophone code.
  • [DMAS-54265] - Update selenium tests for landing page to test About link
  • [DMAS-54272] - Render a confirmation dialog when cancelling a batch or task
  • [DMAS-54280] - Add FLAC file generation to hydrophone post process job
  • [DMAS-54288] - frontend service to create batch/task
  • [DMAS-54290] - Support Trigger and DOI groups for batches
  • [DMAS-54335] - Implement new trx tables for parser definitions and calibrations

Bug (ST)

  • [DMAS-53364] - Fix broken tests in DeviceAttributes
  • [DMAS-53932] - job runnerId is not getting set for user defined jobs
  • [DMAS-54275] - Batch Task List displays TaskTypeId instead of TaskType
  • [DMAS-54287] - DeviceSyncService is failing to update existing synchronizations
  • [DMAS-54291] - Getting batches requires a runnerId to not be null

...

March 26, 2020

Major+ release for Oceans 2.0.
February and partial March releases combined, primarily due to maintenance expedition.

Instruments

  • Data acquisition bottleneck detection and reaction: implementation of automated quarantine of problematic / late data (in-progress)
  • McLane Sampler driver
  • AIS integration (in-progress)
  • WERA data product FTP
  • Sandbox improvements: various, including ability to cancel tasks

Data Products

  • State of Ocean / Environment Climatology and Anomaly Plots now available in Data Preview
  • Improved ASL .01a binary file integration with EchoView
  • CODAR data availability data products (in-progress)
  • Monthly complex Data Preview for CODAR currents, availability and hydrophone LTSAs (in-progress)
  • Flip all tick marks in complex plots out for better integration with Data Player
  • Bug fixes (CODAR, error messaging, seismometers, COR files, etc)

Complex Data Player

  • Improved option menu for ADCP and hydrophones
  • Data player now integrated in to Oceans 2.0
  • Implementation in-progress: infrastructure, bug fixes, speed improvements, etc

Automated Testing and Continuous Deployment

  • Significant improvements to all UI automated testing (coverage, tools, reliability, results)
  • Continuous deployment: process improvements
  • Automated DAF testing improvements
  • Distributed cache (in-progress)
  • Automated release notes (investigation)

Maintenance and Production Developer

  • Completed ability to add data ratings for sensors (products and services do not use them yet)
  • Scalardata webservice performance improvements
  • Task and user management bug fixes for permissions and security
  • Various other bug fixes (rawdata service, etc)

Community Fishers

  • Integration with Data Search and Plotting Utility for cast-delineated data
  • Bug fixes (depth sensor derivation, etc), testing and support for training

SeaTubeV3 - CANARIE & NOAA & ONC

  • Added ability to play video clips by clicking on annotations
  • Migrate all features from V1&V2 to V3: fixed cameras in-particular (in-progress, almost done)
  • Bug fixes

Dashboards - CANARIE

  • on hold for staffing

MINTED - CANARIE

  • Citation text for subsets includes QueryPID, now included on landing page

  • Batch system and re-postprocessing tool (this is only partly a MINTED feature): implementation (in-progress)

CIOOS / ERDDAP

  • Datasets infrastructure for ERDDAP and CKAN
  • Ability to import translations using the File Upload tool
  • ISO metadata reports available via service (soon)

Tickets Released: Oceans 2.0: 20.03.000 (accessible to internal users only). Total: 315.

Expand
titleRelease notes from JIRA for 20.03.000

Usability

  • [DMAS-52142] - Button sets cannot be deleted
  • [DMAS-52647] - All users should be able to delete their own annotations in V3
  • [DMAS-53909] - Resolution difference for image export methods in V2 and V3

Bug

  • [DMAS-51928] - Play list download video doesnt match what is played before downloading
  • [DMAS-52715] - Fix broken tests in website.homePage.HomePage (OW.TC.1132 and OW.TC.1131)
  • [DMAS-52877] - Fix broken test in ManualTest
  • [DMAS-52994] - scalardata webservice performance issues and errors
  • [DMAS-53317] - Device Console error when sorting by instrument type
  • [DMAS-53340] - url-loader's default fallback file-loader produces the wrong URLs
  • [DMAS-53357] - In Regression Testing "release/20.01.000" PR Test - Data Preview Management (1-200) automated tests are failing.
  • [DMAS-53373] - Fix Broken Tests in DashboardSharing
  • [DMAS-53376] - HY Test - Chrome download bar causing failing tests when taking spectrogram screenshots
  • [DMAS-53385] - Fix "invalid prop" errors in seatubeV3
  • [DMAS-53386] - Refactor the setState call out of render() in annotationList
  • [DMAS-53394] - DOIMetadataSearch requires a user to be logged in to access
  • [DMAS-53468] - Search Failure for community fishers when bad sitedevicesubset entries encountered
  • [DMAS-53502] - Environment.getDmasUrl() is returning undefined in QA DataPlayer
  • [DMAS-53555] - Search failure in QA for .flac files
  • [DMAS-53566] - not able to run auto live DAF test in QA
  • [DMAS-53571] - Live DAF testing causes NullPointerExceptions in DeviceConsoleService
  • [DMAS-53585] - Fix broken test in SeaScriptManagement
  • [DMAS-53621] - TaxonButtonSetService throwing a 500 error
  • [DMAS-53622] - Fix broken text case UM.TC.74
  • [DMAS-53634] - Search failues for spectrogram for hydrophone viewer
  • [DMAS-53717] - Fix broken test in AgreementManagement
  • [DMAS-53719] - Fix broken test in DOIMetadataSearchTest
  • [DMAS-53720] - Fix broken tests in SiteDeviceSubsetTest
  • [DMAS-53722] - Fix broken test in TaskControl
  • [DMAS-53724] - Fix broken test in CruiseManagement
  • [DMAS-53725] - Fix broken test in RealTimeObservations
  • [DMAS-53726] - Fix broken test in DashboardManagement
  • [DMAS-53728] - Fix broken tests in DeviceControl
  • [DMAS-53731] - Fix broken tests in DataPreviewManagement
  • [DMAS-53732] - Fix broken tests in DataAvailabilityPlot
  • [DMAS-53734] - Fix broken tests in EventDetection
  • [DMAS-53736] - Fix broken tests in Reprocess
  • [DMAS-53737] - Fix broken tests in plottingutility.Create
  • [DMAS-53739] - Fix broken tests in SeaTubeSearchTest
  • [DMAS-53740] - Fix broken tests in SeatubeProMap
  • [DMAS-53741] - Fix broken tests in SeaTubeProVideo
  • [DMAS-53742] - Fix broken tests in seatubeV2.Basics
  • [DMAS-53743] - Fix broken tests in seatubeV2.SeaTubeMap
  • [DMAS-53744] - Fix broken tests in TaxonButtonSet
  • [DMAS-53745] - Fix broken tests in AnnotationSaveAndKeepTimeTest
  • [DMAS-53746] - Fix broken tests in seatubeV3.AnnotationsTest
  • [DMAS-53747] - Fix broken tests in DiveDetailsTest
  • [DMAS-53751] - Fix broken tests in Simulator
  • [DMAS-53753] - Fix broken tests in warn.eew.EEW
  • [DMAS-53754] - Fix broken tests in NavigationBarAdminUser
  • [DMAS-53765] - Fix broken tests in SystemMonitoring
  • [DMAS-53766] - Fix broken tests in DiveManagement
  • [DMAS-53770] - scalardata webservice Bad status code 500
  • [DMAS-53783] - Hydrophones are unavailable through both the Search Hydrophone page and Data Search
  • [DMAS-53793] - React Pages In Oceans 2 do not render sometimes
  • [DMAS-53799] - Updating SiteDeviceSubset on SiteDeviceSubsetMaintenance does not return to SiteDeviceMaintenance
  • [DMAS-53813] - Fix broken test in JiraHelpDesk
  • [DMAS-53816] - NullPointerException for PSF Patrol 09 File Upload - 23418 Event
  • [DMAS-53827] - Users with R/O access to Task Management can cancel tasks
  • [DMAS-53830] - Fix broken test in seatubeV3.TooltipTest
  • [DMAS-53835] - Side bar scales don't change with the generated images
  • [DMAS-53847] - Data viewer is not loading spectrograms after clicking apply on toolbox.
  • [DMAS-53853] - Fix broken tests in DeviceDetails
  • [DMAS-53862] - Users with RW access to Task Mangement can not run the jobs on Task Management page
  • [DMAS-53880] - CF Job 338 does not respect the dateFrom & dateTo parameters
  • [DMAS-53889] - reprocess jobs are created twice in prod ?
  • [DMAS-53911] - Tests with @Ignore are being run anyway
  • [DMAS-53915] - Broken image on initial Cast card
  • [DMAS-53926] - Fix 50ish new UI test failures
  • [DMAS-53928] - Centre red line shifts when opening three dot menu
  • [DMAS-53938] - DOIDatasetService not supported error
  • [DMAS-53940] - fix errors in master from TESTDOIDATASET's name changing
  • [DMAS-53942] - DMAS Search Failed Notification: 05-Mar-2020 22:39:46 UTC, Bullseye-Hydrophone High Frequency, Hydrophone Spectral Data, SearchHdrId 4805909, UserId 2851
  • [DMAS-53945] - Fix broken tests in UserReplication
  • [DMAS-53953] - Fix broken tests in AccessRestrictions
  • [DMAS-53955] - Fix broken tests in SearchTreeMaintenance
  • [DMAS-53957] - Fix broken tests in PublicWebServices
  • [DMAS-53958] - Fix broken tests in GenerationAndDisplay
  • [DMAS-53972] - onc-core bundle fails to deploy
  • [DMAS-53993] - DMAS Search Failed Notification: 09-Mar-2020 19:04:53 UTC, Geosense Short Period Seismometer 116, Seismometer Data, SearchHdrId 4834806, UserId 2851
  • [DMAS-53999] - TaskManagementPage clicks on wrong section of job
  • [DMAS-54045] - UI test suite is still running after 15 hours
  • [DMAS-54071] - DMAS Search Failed Notification: 10-Mar-2020 21:46:13 UTC, Vancouver Island-China Creek, Log File, SearchHdrId 4869459, UserId 4143
  • [DMAS-54088] - SiteDeviceSubsetMaintenance and SiteDeviceMaintenance page not rendering in Ocean' s 2.0
  • [DMAS-54114] - Daily spectrograms are not currently working with data player
  • [DMAS-54158] - Minter creates unbalanced tags for <fundingReferences> and unbalanced tags for geoLocationBox
  • [DMAS-54161] - Toolbox Reset Buttons do not work in DMAS
  • [DMAS-54191] - All UI tests failed in Jenkins last night
  • [DMAS-54208] - Fix broken test in erddap
  • [DMAS-54216] - QA datacentre shows "error while scheduling a job" on startup for all scheduled jobs
  • [DMAS-54219] - TaskManagementBatch page doesnt load in QA
  • [DMAS-54230] - Fix broken tests in Messaging
  • [DMAS-54238] - fix DatasetLandingPage title in Oceans 2.0
  • [DMAS-54245] - Fix broken tests in GeographicInformation
  • [DMAS-54246] - DataPlayer default DeviceCategory not displaying
  • [DMAS-54257] - DMAS QA search failed for COR data product
  • [DMAS-54260] - Test description reference dated test cases in JiraHelpDesk
  • [DMAS-54271] - DMAS Search Failed Notification: 22-Feb-2020 06:43:49 UTC, Patricia Bay-Saanich Inlet VENUS Instrument Platform, Hydrophone Spectral Data, SearchHdrId 4759855, UserId 42732

User Story

  • [DMAS-29344] - As a data user, I would like to have the ability to associate multiple data ratings for a device where sensors sample at different rates
  • [DMAS-49127] - As a scientist, I would like companion data products to the State of the Ocean showing climatology
  • [DMAS-50624] - As a user, I want changes to the test configuration
  • [DMAS-51130] - As a oceans 2 data user I want links to download a subset from the dataset identified by a DOI
  • [DMAS-51132] - As a oceans 2 data user I want to see citation text corresponding to my Query PID on the Landing Page
  • [DMAS-51183] - As a researcher I want citation text for a dataset subset to include a Query PID
  • [DMAS-52228] - As a user I would like to play clips directly from the annotation search screen
  • [DMAS-53267] - Replicate the Data Search option for the ADCP1MHZ (23470) in the Data Player Toolbox
  • [DMAS-53274] - Integrate (Dev Playground) Data Player into Oceans 2.0
  • [DMAS-53314] - Implement and/or Update testing for effected DMAS components
  • [DMAS-53441] - Fix minor issues with Hydrophone/Aquadopp Data Player
  • [DMAS-53645] - As a software developer, I want to get an email when UI tests fail, so I don't need to remember to check
  • [DMAS-53970] - As a test engineer, I want to compare images of page elements so that I can test things that can't be examined in code
  • [DMAS-54210] - As a senior developer, I want to be able to see which UI test failures were caused by real issues, not flaky tests, so I know whether to assign devs to fix them

Task

  • [DMAS-33743] - update DA test to include instrument permission related test case
  • [DMAS-47525] - Add more test cases for getCurrentPhase() method of ProcessService
  • [DMAS-47633] - Add test cases for GET method of OrganizationService
  • [DMAS-47678] - add test cases for GET method of EventDefinitionService
  • [DMAS-49047] - McLane RAS Water Sampler - Finalize Driver
  • [DMAS-50710] - Write selenium tests for data cite metadata on Landing Page
  • [DMAS-51336] - Write selenium script for new system console
  • [DMAS-53013] - Make resolution etc. available to UiTestPage
  • [DMAS-53025] - devcoop3 - New Developer Project, designed and assigned by Mac.
  • [DMAS-53097] - Implement a deviceTypeIds filter for the DOI registration job
  • [DMAS-53130] - Load oceans-next JS from DMAS.Config.OCEANS_NEXT_PATH, not DMAS.Config.BASE_URL
  • [DMAS-53231] - Allow QA deployment of oceans-next to be skipped
  • [DMAS-53266] - Use less vertical whitespace in the live daf test history table
  • [DMAS-53395] - As a DFO CODAR user I would like to see Monthly Data Preview Plots
  • [DMAS-53400] - Extract wait loops in live DAF testing to their own service
  • [DMAS-53435] - update hint information for list of hosts during Oceans-next deployment in Jenkins
  • [DMAS-53458] - Update testng, gradle, and checkstyle for ui-testing
  • [DMAS-53479] - Test ONC website status icons in production
  • [DMAS-53565] - Change Datacite Metadata to use the Dataset class
  • [DMAS-53629] - Check if 'Owner' link works for Anonymous users (IM.TC.303)
  • [DMAS-53654] - Refactor user replication ui test to better follow Page Object Model
  • [DMAS-53665] - Create ER Diagram for data products and data product options
  • [DMAS-53696] - It's hard to figure out what user the users in TestConfig.User correspond to
  • [DMAS-53703] - Print less output in UI testing failure reports
  • [DMAS-53711] - Revert temporary chip select fix to have the same layout as previously
  • [DMAS-53759] - Change annotations with taxons to show entire taxonomy name instead of taxonomy code
  • [DMAS-53762] - UI testing's checkstyle configuration should forbid unused variables
  • [DMAS-53789] - Include user names in TestConfig.User
  • [DMAS-53804] - Disable SeaTube V1 and V2 tests
  • [DMAS-53822] - Investigate issues with new imagenex .881a files from DAF testing
  • [DMAS-53838] - When generating new images don't go modal - stay interactive
  • [DMAS-53843] - Toolbox text not vertically balanced when open
  • [DMAS-53844] - Toolboxes need a RESET button
  • [DMAS-53856] - Add units to colourlimit options (dB)
  • [DMAS-53859] - Flip tick marks outside of plot on ADCP daily current plots
  • [DMAS-53864] - Add More info to failure message in ScreenShotUtil for Screenshot size difference
  • [DMAS-53872] - CODAR clean data products - modify some functions to better handle the qaqc flag 9
  • [DMAS-53891] - Disable the download bar when running tests
  • [DMAS-53941] - As a Hydrophone user, I would like weekly LTSAs and SPDs plots in the month tab in Data Preview
  • [DMAS-53950] - Schedule UI tests to run every night of the week
  • [DMAS-53988] - Add more checkstyle rules to ui-testing
  • [DMAS-53991] - update selenium script for reprocess console to capture change in DMAS-53889
  • [DMAS-54092] - When first triggering shifting or pushing new Plots, Display the "Starting graphics processor" message.
  • [DMAS-54093] - Disable troublesome UI tests
  • [DMAS-54113] - Adjust data player holders for ADCP plots to remove black line between different images
  • [DMAS-54152] - The display in the searchtree for cast subset entries should be Down Cast instead of DOWN_CAST
  • [DMAS-54153] - data cannot be plotted in Plotting Utility or downloaded from Data Search under Community Fisher stations for Down Casts
  • [DMAS-54157] - Add better user privilege check to DOIDatasetService
  • [DMAS-54170] - Reduce MATLAB info messaging by suppressing warning backtrace
  • [DMAS-54182] - Improve ASL manufacturer's format integration with EchoView
  • [DMAS-54252] - Write UI tests for "Mini Dmas"
  • [DMAS-54256] - Go back to using old DOI algorithm for the ID

Requirement

  • [DMAS-49443] - Reqs Design Investigation for State of Ocean Climatology plots
  • [DMAS-53497] - Add requirements for the dataset landing page
  • [DMAS-53531] - Record requirements for creating a batch
  • [DMAS-53592] - Elicit and record requirements for citation text service
  • [DMAS-53646] - Document UI test notifications requirements
  • [DMAS-53863] - Gather requirements
  • [DMAS-53929] - update dataset landing page requirements
  • [DMAS-53977] - Document screenshotting requirements
  • [DMAS-54047] - Document requirements for nightly runs
  • [DMAS-54061] - update requirements for minting doi to certain datacite environment
  • [DMAS-54075] - Record requirements for viewing a batch
  • [DMAS-54102] - Record requirements for batch update

Design

  • [DMAS-52859] - Design for database Datasets
  • [DMAS-53647] - Design email notifications
  • [DMAS-53648] - Database design for supporting French translations
  • [DMAS-53898] - Update landing page mockups to include Documentation link
  • [DMAS-53934] - Update mockup for manual create of DOI from site device to include choosing between test and prod
  • [DMAS-54136] - Design how service will be used without a token

Implementation

  • [DMAS-50597] - Add the ability to rerun failed tests
  • [DMAS-50622] - Add a devicetype ID column
  • [DMAS-50625] - Populate the IP address on entering the device ID
  • [DMAS-51037] - Ensure "expected" plots exist before validating them with ScreenshotUtil
  • [DMAS-51493] - Implementation for SOO Climatology plots
  • [DMAS-52353] - DeviceSyncService to handle save and update, return user name
  • [DMAS-52953] - Generate an ISO Metadata XML file
  • [DMAS-53143] - Modify to notify user of unavailable data and prevent additional service calls
  • [DMAS-53178] - Implement front-end changes to support displaying Query PID details on the Landing Page
  • [DMAS-53182] - Implement back-end changes for query details to be implemented
  • [DMAS-53185] - Implement Selenium Tests for Dataset and Query PID Landing Page
  • [DMAS-53219] - Extract services used in live DAF test configuration to their own files
  • [DMAS-53240] - Refactor TestHistoryTable to use the atomic model
  • [DMAS-53241] - Refactor TestHistoryTable to use media queries instead of window resize events
  • [DMAS-53244] - Add tables for metrics summary storage
  • [DMAS-53271] - Implement back-end changes for generating a citation with a query pid
  • [DMAS-53272] - Implement front-end changes for generating a citation with a query pid
  • [DMAS-53273] - Have the Toolbox header change with the Device Category selection
  • [DMAS-53306] - Add query citation to selenium test
  • [DMAS-53315] - Update testing module for the main menu more changes
  • [DMAS-53316] - Implement Data Player Search Options for Nortek ADCP's
  • [DMAS-53322] - Implement front-end for DOI Generation to Site Device Maintenance
  • [DMAS-53323] - Implement back-end for DOI Generation
  • [DMAS-53326] - Add DOI Generation to Site Device Maintenance Selenium Tests
  • [DMAS-53335] - Change field label for ROR ID in Network Console to "Organization ROR ID"
  • [DMAS-53336] - Implement onSubmit function for ADCP Toolbox
  • [DMAS-53349] - Change text in GeoSpatial Map layer selection to “Community Fishers”
  • [DMAS-53409] - Update CKAN API calls to upload files
  • [DMAS-53413] - Have toolbox expanded when first opened from the main menu (⋮)
  • [DMAS-53436] - Integrate (Dev Playground) Data Player into the "dashboard"
  • [DMAS-53437] - Add Data Player to Ocean's 2.0 (Backend)
  • [DMAS-53442] - Tweek Hydrophone layout not to clip any images
  • [DMAS-53444] - Implement back-end changes for generating a url to the data search page based on a DOI.
  • [DMAS-53452] - Implement metrics topic service
  • [DMAS-53455] - Implement front-end changes for generating a URL to the data search page on the DOI landing page.
  • [DMAS-53473] - add a selenium test for the data search link with the dataset landing page tests
  • [DMAS-53478] - Keep practical salinity in the SOO/E file products
  • [DMAS-53494] - Refactor details panels to be more modular
  • [DMAS-53498] - Add a table to landing page with all doi versions
  • [DMAS-53499] - Update minting job to include ROR and fundingReference
  • [DMAS-53520] - add domain objects for new task tables
  • [DMAS-53521] - Create sql script for new task tables
  • [DMAS-53522] - Create sql script for new task transaction tables
  • [DMAS-53525] - Add selenium test to ensure that the landing page does not require a login.
  • [DMAS-53528] - Integrate basic data viewer options into plothydrophonespectrogram (colourmap, and colourmap limits)
  • [DMAS-53549] - Refactor reprocessing to use new task framework
  • [DMAS-53553] - Add support to return all the DOI versions for a specified DOI
  • [DMAS-53556] - Send a notification email when UI tests fail overnight
  • [DMAS-53559] - Apply 70% rule and fix extra vertical lines in Anomaly plot
  • [DMAS-53563] - Auto display config dialogue on first load
  • [DMAS-53572] - update site device maintenance routing paths in frontend
  • [DMAS-53573] - update sdm paths in backend
  • [DMAS-53575] - dataset landing page frontend
  • [DMAS-53576] - dataset landing page backend
  • [DMAS-53577] - dataset landing page ui test
  • [DMAS-53590] - Populate new task tables with current data
  • [DMAS-53595] - Implement citationText public service
  • [DMAS-53600] - refactor job processing done after dequeueing from the scheduler topic
  • [DMAS-53601] - refactor search to use new task tables
  • [DMAS-53605] - update taskmanagement UI
  • [DMAS-53613] - Move climate plots to a new job that runs daily averages from source data
  • [DMAS-53620] - Implement onSubmit for Hydrophone Options in DataPlayer
  • [DMAS-53637] - Update ISO19115 XML and CKAN Datasets with French title and abstract
  • [DMAS-53653] - Concatenating data from two source wav files without missing samples
  • [DMAS-53655] - Implement button changes following the selected design
  • [DMAS-53664] - refactor JobService API
  • [DMAS-53673] - Create web service for uploading translation files
  • [DMAS-53674] - Create dal layer for I18N
  • [DMAS-53675] - Change Date Time Picker To Be The Same as SeaTube
  • [DMAS-53676] - Implement back-end changes to add mobile datasets to DOI minting
  • [DMAS-53678] - Write Selenium tests for test cases DV.TC.101 - DV.TC.103, DV.TC.108/109, DV.TC.111,112
  • [DMAS-53686] - Update DB with support for hierarchical tasks
  • [DMAS-53690] - Create database scripts for I18N
  • [DMAS-53697] - Dynamically Get Default ADCP and Hydrophone Options in DataPlayer.jsx
  • [DMAS-53699] - Add In Props To DataPlayer Components So They Are Easy To Find With Selenium
  • [DMAS-53701] - As a developer I would like to support the json postgresql data type in hibernate to allow for more flexible storage of JSON
  • [DMAS-53710] - Refactor code for sending tasks from the web machine to the task machine
  • [DMAS-53756] - Implement back-end changes needed to parse search parameters
  • [DMAS-53795] - Modify Task job 340. Cast Data (4) Ingestion Postprocess to stop archiving the .castdata files
  • [DMAS-53803] - Add input and output columns to tm_task
  • [DMAS-53817] - Implement front-end changes to display data product options on the landing page
  • [DMAS-53820] - Update landing page selenium tests to include data product options
  • [DMAS-53831] - Implement Changes
  • [DMAS-53834] - UiTest.login will retry forever
  • [DMAS-53839] - Tiny tweeks for state of ocean climate plots
  • [DMAS-53840] - refactor jobservice activator and generic job to use TM_Task
  • [DMAS-53845] - refactor TaskService to receive TM_Task's
  • [DMAS-53855] - Add support JSON in HSQL for unit testing
  • [DMAS-53857] - View batch tasks
  • [DMAS-53874] - Add missing validation to service
  • [DMAS-53881] - Refactor Seatube and Expedition to use new withSnackBars
  • [DMAS-53885] - Add registry service
  • [DMAS-53892] - Modify FileUpload screen to accept a translation file
  • [DMAS-53903] - remove all remaining references to taskhistory and task and replace them with tm_task
  • [DMAS-53948] - Add React & oceans-next code to TaskManagement front end
  • [DMAS-53949] - Add CODAR data availability plots to daily and monthly tabs in Data Preview
  • [DMAS-53992] - Add tests for the DOI History table
  • [DMAS-54046] - Add a timeout to the nightly test run
  • [DMAS-54076] - Add project structure to our react codebase
  • [DMAS-54095] - Update selenium script to capture any UI change did in DMAS-54049
  • [DMAS-54106] - Add new page into dmas menu of Oceans 2.0
  • [DMAS-54137] - Change service to not require a token
  • [DMAS-54160] - Update relevant selenium tests
  • [DMAS-54164] - hist table in database
  • [DMAS-54165] - Revert all commits made in this user story
  • [DMAS-54198] - implement link from site device page to SDM
  • [DMAS-54218] - Make it easier to run the whole test suite manually
  • [DMAS-54228] - Disable more flaky UI tests
  • [DMAS-54263] - Revert changes to layout at small window sizes

Test

  • [DMAS-52111] - Test Plan for SOOC plots
  • [DMAS-53902] - Add webservice tests for TaskDefinitionService and delete tests for jobService

Bug (ST)

  • [DMAS-37856] - fix bug so that datefrom on sensor data rating allows the same time for different sensors and as the device data rating
  • [DMAS-50498] - Please do not use "Wetlabs FLNTU serial" deviceport for ECO Triplet BBFL2 devices in topology of automated live DAF test
  • [DMAS-53331] - The device name displayed in a test configuration is sometimes incorrect
  • [DMAS-53381] - Fix broken tests in DashboardManagement
  • [DMAS-53414] - Edit Hydrophone Toolbox [ZOOMXY] option
  • [DMAS-53416] - Use proper formatting when displaying a citation on the DOI Landing Page
  • [DMAS-53547] - Fix data player to display ADCP/Aquadopp device data
  • [DMAS-53560] - Toolbox is not consistent in its width
  • [DMAS-53632] - Fix failing tests in dataProductDelivery
  • [DMAS-53650] - Fix shrunken leaflet popup for single cast search tree nodes
  • [DMAS-53707] - ADCP Plots keep trying to load more files
  • [DMAS-53861] - Link to PNG/PDF below the new climate/anomaly plots in Data Preview are incorrect
  • [DMAS-53923] - Task management job tree is blank. Other areas of QA may be affected as well.
  • [DMAS-53990] - I can't run tests manually on Jenkins
  • [DMAS-53995] - NullPointerException in TaskDefinitionService.updateTaskType
  • [DMAS-54073] - TaskDefinitionDetailAssembler does not handle passwords as the DataMapAssembler did
  • [DMAS-54128] - Task Management's Task Id for the schedule is undefined when no task is selected
  • [DMAS-54129] - TaskDefinitionService does not send responses for some methods
  • [DMAS-54239] - Nightly test run failed because one test depends on a disabled method
  • [DMAS-54253] - The canarie registry service currently requires login - it shouldn't

Investigation

  • [DMAS-53910] - Please investigate this issue and attatch some downloaded image on this ticket

Documentation

  • [DMAS-52122] - Documentation for State of Ocean Climatology plots
  • [DMAS-53570] - Add new tests for new options

...

February 27, 2020

Release for HydroCal, version 20.02.000 (HydroCal Change List)

  • Prevent the ini file settings from being overwritten, particularly when users have modified them
  • Add automatic downsampling of external digital hydrophone wav file data to prevent out of memory errors and improve performance
  • Improve sync tone detection and reliability for external digital hydrophones
  • Added a check for software updates
  • Updated run-time library to MATLAB R2019a

...

February 3, 2020

Major release for Oceans 2.0.

Instruments

  • Data acquisition bottleneck detection and reaction: design and start of implementation for a system of automated quarantine of problematic / late data
  • Sandbox improvements: improvements to support user's code, more usability and reliability issues
  • Improvements the Community Fishers / Citizen Scientist data acquisition Android App: support for training and testing with bug fixes/adjustments

Community Fishers

  • Integration with Data Search (in-progress)
  • Bug fixes, testing and support for training
  • Improvements to cast detection metadata handling (latitude, longitude, depth)

Complex Data Player

  • Adding options for ADCP display
  • Hydrophone and ADCP display and infrastructure in-progress

Automated Testing and Continuous Deployment

  • Automated UI testing: continuing work on test cases and reliability
  • Continuous deployment: process improvements
  • Bug fixes and features to support testing and deployment of on ship systems
  • Improvements to live DAF testing
  • Automated release notes (investigation)

Data Products

  • State of Ocean / Environment Climatology and Anomaly Plots (implementation complete, todo: testing and linking)
  • Added options for ADCP current plots
  • SIMBA ice buoy data products improved for multiple deployments
  • Bug fixes

Maintenance and Production Developer

  • Added new community pages on ONC website
  • System console final? improvements
  • Various other bug fixes and small projects

SeaTubeV3 - CANARIE & NOAA & ONC

  • Delete functionality for annotations and playlists
  • Improved search function
  • Bug fixes

Dashboards - CANARIE

  • on hold for staffing

MINTED - CANARIE

  • Added much more content to landing page, including data set and subset queryPID (these are DOI modifiers used to instances of datasets)

  • Add the RORID unique identifier for contributing Research Organization (Registry IDentifiers)
  • Batch system (this is only partly a MINTED feature): design, including a potential update to the core task model
  • SiteDeviceSubsets maintenance UI improved

CIOOS / ERDDAP

  • Upgrading datasets infrastructure for erddap ckan, making it more presentable (in-progress)

Tickets Released: Oceans 2.0: 20.01.000 (accessible to internal users only). Total: 108.

Expand
titleRelease notes from JIRA for 20.01.000

Bug

  • [DMAS-50296] - not able to configure JVM with automated live DAF test tool
  • [DMAS-51989] - ToggleItemsMenu - Invalid prop layouts[0].permission of type string
  • [DMAS-52256] - dataProductDelivery return for invalid or missing parameters situation have been changed ?
  • [DMAS-52258] - deploy_onc can't be downgraded below 19.10.000
  • [DMAS-52582] - Expedition management map doesn't clear markers
  • [DMAS-52639] - Panels with multi-line action bars can overflow
  • [DMAS-52730] - Some annotation list rows are overflowing vertically
  • [DMAS-52788] - V2 and V3 filtered export not returning environmental info
  • [DMAS-52789] - Failed to load Calibration Cache java.lang.Exception: Sensor 4259 has an unexpected number of SiteDevices (2)
  • [DMAS-52801] - Cannot search annotation creators when not logged in (on expedition management page)
  • [DMAS-52947] - ONC matlab searches getting stuck in PROD - primarily Data Preview
  • [DMAS-52950] - Removing one of multiple cruises, then re-adding it re-adds its dives.
  • [DMAS-52951] - Removing an attribute filter internally, but not visibly, removes other attribute filters
  • [DMAS-52998] - DMAS Search Failed Notification: 23-Dec-2019 15:03:02 UTC, Cambridge Bay-Safe Passage Buoy, Ice Buoy Time Series Profile Plots, SearchHdrId 4215419, UserId 42732
  • [DMAS-53048] - Fix Dashboards not rendering properly
  • [DMAS-53049] - PR Test - Data Preview Generation and Display (201 - 600)couple of automated tests cannot be found in ui-testing repo
  • [DMAS-53074] - UTCDateTimePickerNew does not accept keyboard inputs correctly
  • [DMAS-53111] - QAQC flags in CSV data product are incorrect
  • [DMAS-53135] - ping ip failed but dmas.log shows connected in auto live DAF test
  • [DMAS-53147] - JUnit tests in Oceans 2 sometimes run forever (or close to it) in Jenkins
  • [DMAS-53179] - Handle time-alignment errors in RDI ensemble averaging
  • [DMAS-53199] - mis-match tags in ASL raw XML configuration file
  • [DMAS-53218] - Annotation creator/modifier options don't clear when the dive/cruise are cleared
  • [DMAS-53221] - Clicking on the Taxon Button Sets parent node on the tree crashes the page
  • [DMAS-53230] - Fix type assigned by ErddapDatasetService
  • [DMAS-53245] - ClassNotFoundException on org.nfunk.jep.ParseException when running jettyDataCentre
  • [DMAS-53263] - Search failure in QA - error in shrinkwhitecolourmap
  • [DMAS-53287] - Search failures in QA - ice buoy plots
  • [DMAS-53303] - NOAA and iFremer Logos fail to load in PROD
  • [DMAS-53308] - Error during Hibernate initialization -- QA with master branch
  • [DMAS-53321] - qaonshore1 unable to load oceans-next
  • [DMAS-53332] - Fix ismemberwithtolerance usage in gethydrophoneDP
  • [DMAS-53334] - Bundle exception when running OSGi
  • [DMAS-53355] - Cannot Add SiteDeviceSubsets on SearchTreeMaintenance Page
  • [DMAS-53358] - PR Test - Data Preview Generation and Display (201 - 600) data changes effecting test results
  • [DMAS-53361] - Community fisher search failures when generating cor file
  • [DMAS-53363] - Missing down arrow on Ocean 2.0 main menu drop downs
  • [DMAS-53383] - Plotting Utility Properties by Location Displaying Incorrectly
  • [DMAS-53388] - Fix Datapreview annotation selenium test
  • [DMAS-53401] - Add image filenames to build.gradle file

User Story

  • [DMAS-48813] - As a ADCP scientist, I want more choices on the scale limits on ADCP velocity plots
  • [DMAS-50627] - As an engineer, I want the names and comments of several test steps to be improved
  • [DMAS-51289] - As a system member, I would like to combine existing Status Console and System Console into one new System Console
  • [DMAS-52975] - As a deployment engineer, I want Oceans 2 and Oceans-Next to be compiled on a server that has access to the NOAA diveloggers, so that I don't have to move artifacts manually

Task

  • [DMAS-51704] - SeaTube Search to a separate full page
  • [DMAS-52623] - As a data steward, I would like a new field in the searchtreenode table to support dataset titles and abstracts
  • [DMAS-52934] - implement new jep formulas to calibrate Rinko temperature and saturation from voltage for Community Fishers with AML Plus parent
  • [DMAS-53071] - Allow double quotes to be used in the description field on the DeviceAction Maintenance page
  • [DMAS-53095] - Change SiteDeviceMaintenance page so that adding a Site Device Subset happens in the same page
  • [DMAS-53102] - Remove gradle builder from the onc root project
  • [DMAS-53103] - Refactor the Network Console UI test to demo a better way of using the page object model
  • [DMAS-53164] - Clean up oddities and unnecessary complications in DAL development new developers ran into in their projects
  • [DMAS-53190] - Improve Routing on the Dataset Landing Page so that the url reflects the DOI currently being viewed
  • [DMAS-53192] - Make "Remove All From List" button on Tab Actions of File Management page a little big
  • [DMAS-53194] - update selenium script to use new qa onshore machine
  • [DMAS-53211] - add test cases for web service SeaTubeDetailService
  • [DMAS-53212] - Add test cases for web service SeaTubeSensorDataService
  • [DMAS-53213] - Add test cases for web service SeaTubeMapService
  • [DMAS-53214] - Add test cases for web service SeaTubePermissionsService
  • [DMAS-53215] - Add test cases for PlaylistTreeService
  • [DMAS-53216] - Add test cases for web service ExpeditionTreeService
  • [DMAS-53220] - Add a button to jump from the Annotation List to a fully-featured search page
  • [DMAS-53264] - Update castdetectionpostprocess to handle sparse positional data.
  • [DMAS-53309] - Write automated test for parent node selection on Taxon Button Set Config page
  • [DMAS-53359] - Reduce no sample period warnings in matlab code
  • [DMAS-53368] - 2020-01 Regression: Update Selenium DA Test

Requirement

  • [DMAS-53117] - Discuss and update requirements and direction with Systems

Design

Implementation

  • [DMAS-50311] - Make Onc-Next's System Console table's columns resizable
  • [DMAS-50628] - Rename "checking for data rating"
  • [DMAS-50629] - Rename "checking for powerable status"
  • [DMAS-50630] - Rename "checking device atttributes"
  • [DMAS-50631] - Rename "validating nameplate serial number"
  • [DMAS-50632] - "gathering data" step should include the driver status in its comment
  • [DMAS-50634] - Summary data validation step's comment should say whether it checked summaries, or only summary requests
  • [DMAS-52246] - "Refresh" button on new System Console
  • [DMAS-52359] - Create a java wrapper to do CRUD operations on Datasets, Resources & Organizations
  • [DMAS-52370] - Create matlab scheduled post processing job to generate images for one device.
  • [DMAS-52768] - Update config page to allow deletion of Taxon Button Sets
  • [DMAS-52805] - Create service calls for deleting a button set and getting user delete permissions
  • [DMAS-52919] - Configure Oceans-Next to support optionally deploying a release branch to a divelogger
  • [DMAS-52926] - Implement additional colour options for ADCP daily current plots.
  • [DMAS-52927] - Add CKAN Dataset & Manager
  • [DMAS-53134] - Tweak the layout of the Landing Page to better reflect the design
  • [DMAS-53145] - Add data product download progress bar in the cast popup on geospatial map
  • [DMAS-53149] - Write EX Selenium Tests for ERRDAP
  • [DMAS-53150] - Write EX Selenium Tests for Oceans 2.0
  • [DMAS-53153] - Dataset title generation
  • [DMAS-53154] - Implement the front-end changes required to search on a Query PID
  • [DMAS-53160] - Adding ROR ID to webpage and data structures
  • [DMAS-53162] - Implement back-end changes for retrieving a DOI based on a query pid
  • [DMAS-53165] - Dataset abstract generation
  • [DMAS-53170] - Make small quality of life adjustments
  • [DMAS-53173] - Remove 'More' button from cast popup when there are no casts to display
  • [DMAS-53184] - Make pins clickable
  • [DMAS-53191] - Setup simulators for metrics data collection
  • [DMAS-53202] - Further implement design+req for citation text
  • [DMAS-53217] - Implement front-end for citation text on DOIMetadataSearch
  • [DMAS-53283] - Update UI to Material Standards
  • [DMAS-53289] - Update velocity and colourmap options for ADCP daily current plots
  • [DMAS-53302] - Add Data Player to Ocean's 2.0 (Front end)
  • [DMAS-53341] - Add play buttons to the SeaTubeV3 search results

Bug (ST)

  • [DMAS-52741] - Error loading Data Search: Sort by Location
  • [DMAS-52878] - Fix broken test in searchTreeMaintenance
  • [DMAS-52881] - Fix broken tests in UserManagement
  • [DMAS-53156] - System Command drop-down menu not sorted
  • [DMAS-53311] - Daily and Weekly LTSAs are no longer working
  • [DMAS-53369] - Fix Broken Tests in Plotting Utility

...

January 9, 2020

Major release for Oceans 2.0. The holiday break usually means fewer features are developed. 

Instruments

  • AIS parsing: design (in-progress)

  • Data acquisition bottleneck detection and reaction: investigation, design (in-progress)
  • Sandbox improvements: improvements to support user's code, more usability and reliability issues
  • Improvements the Community Fishers / Citizen Scientist data acquisition Android App: reconnect/retry data transfer, fix some bluetooth/wifi issues

Community Fishers

  • Integration with Data Search (in-progress)
  • Refactor plot generation
  • Bug fixes and testing

Automated Testing

  • Automated task testing framework implementation

  • Automated UI testing: expanded coverage, test improvements, structural changes for maintainability
  • Continuous deployment: separate front and back-end compilation for faster builds

Data Products

  • New data product for ASL echosounders: manufacturer's raw binary .01A files (these are compatible with EchoView and other 3rd party software)
  • Prevent jitter in CODAR GIFs
  • World Magnetic Model update
  • Bug fixes in these areas:
    • SIMBA ice buoy
    • Kongsberg Rotary SONAR (thanks to Chris de Moustier),
    • stuck searches
    • RDI ensemble/average time out of order when accessing live data

Maintenance and Production Developer

  • Auto refresh in Plotting Utility is now available in saved plots
  • Manual QAQC job handles overlaps
  • World Magnetic Model update
  • Security improvements
  • System console improvements: dequeue/queisce function and status now displayed, UI improvements, including search and refresh
  • Various other bug fixes and small projects

SeaTubeV3 - CANARIE & NOAA & ONC

  • Upgrade Material-UI to V4 (enables new features to be developed)
  • Video player re-implementation, making it useable for both dashboards and SeaTube
  • Improvements to Digital Fishers main page and management pages
  • SeaTubeV3 and annotations available on-ship without internet or if Oceans2.0 is down
  • SeaTubeV3 theme improvements
  • Bug fixes

Dashboards - CANARIE

  • Users can now see all dashboards shared with them

MINTED - CANARIE

  • UI for sitedevicesubsets
  • Requirements and design for versioning data and metadata improvements, including updating DOIs (in-progress)
  • DOIs for fixed deployments

CIOOS / ERDDAP

  • Ongoing

Tickets Released: Oceans 2.0: 19.12.000 (accessible to internal users only). Total: 191.

...

titleRelease notes from JIRA for 19.12.000

Usability

  • [DMAS-52133] - Filters are not applied using the enter key.
  • [DMAS-52650] - The cursor should change to indicate that you can click on annotations within the list
  • [DMAS-52656] - Have ‘Capture Time’ displayed by default

Bug

  • [DMAS-42917] - Ice buoy data products aren't working properly
  • [DMAS-46711] - Multiple ADCP Intensity Plots in PDFormat are scrambled in time
  • [DMAS-47016] - VPS_PLATFORM_CONTROLLER driver not parsing device data messages correctly
  • [DMAS-47917] - Time jumps in RDI ADCP ensemble average MAT file products
  • [DMAS-50764] - Ping IP or configure IP failed in automated Live DAF test, but no issue for DAF test manually
  • [DMAS-51319] - Investigate discrepancies in Kongsberg Rotary code reported by Chris de Moustier
  • [DMAS-51921] - Advanced sharing allows duplicate emails to be entered, deleting removes both
  • [DMAS-51932] - TypeError: onChange is not a function in Digital Fishers date pickers
  • [DMAS-52039] - UTCDateTimePicker behaves weird when manually entering dates and times
  • [DMAS-52455] - Cannot run npm start after upgrade to material-ui v4
  • [DMAS-52677] - After Changing a dashboard from public to private or vice versa the spinner doesn't change back to the Add Dashboard button
  • [DMAS-52727] - manual entry > quick entry's "Select a button set" dropdown doesn't resize based on width
  • [DMAS-52755] - Download txt file for most recent cast doesn't display error message
  • [DMAS-52791] - DMAS Search Failed Notification: 02-Dec-2019 03:57:23 UTC, Upper Slope-Delta Dynamics Laboratory, Imagenex Rotary Sonar Data, SearchHdrId 3718673, UserId 2819
  • [DMAS-52792] - Fix sensor panel UI tests
  • [DMAS-52824] - Update community fishers matlab after Data Preview Generation Refactored
  • [DMAS-52829] - Wrong cast data plot displaying in data preview
  • [DMAS-52834] - Wrong search type given in data preview .cor file query
  • [DMAS-52846] - Oceans 2.0 browser cache invalidation is broken in production
  • [DMAS-52858] - Community fisher Cast Scalar Multi Profile Plot is not producing the same plot when called from device vs location search
  • [DMAS-52860] - SOO/E job getting null dateFrom
  • [DMAS-52864] - DMAS Search Failed Notification: 12-Dec-2019 12:00:15 UTC, Clayoquot Slope-Bullseye, Time Series Scalar Plot, SearchHdrId 4021696, UserId 40000
  • [DMAS-52874] - MultipleChipSelect chips cannot be deleted using the X icon
  • [DMAS-52884] - SOO/E job generates duplicate search_dtl on Clayoquot Bullseye
  • [DMAS-52897] - Small Bug in Cor file generation
  • [DMAS-52907] - Automated live DAF test "Pinging IP" output is formatted oddly
  • [DMAS-52928] - Java MATLAB runners do not capture the first logging line from MATLAB
  • [DMAS-52968] - Some tests that depend on ServletUtil fail intermittently in Jenkins
  • [DMAS-52969] - DMAS Search Failed Notification: 19-Dec-2019 07:00:04 UTC, Barkley Canyon-MidEast, RDI Daily Current Plot, SearchHdrId 4196391, UserId 15356
  • [DMAS-52974] - Annotation filter does not open in annotation list
  • [DMAS-52977] - Striping on tables being applied to all tables, instead of just "StripedTable"
  • [DMAS-52995] - Video player current duration doesn't match with current UTC timestamp after 5 minutes
  • [DMAS-52996] - Search failures and changes in QA automation related to mobilePositionData
  • [DMAS-53005] - failed to deploy master branch of Oceans 2.0 to QA
  • [DMAS-53015] - SeaTubeUtilsTest is failing in Jenkins on Oceans 2 master
  • [DMAS-53016] - WERA ftp job failing
  • [DMAS-53028] - Kongsberg Search Failures in QA
  • [DMAS-53046] - Changing video quality doesn't properly display, and can lock the menu
  • [DMAS-53058] - Investigate changes to water column data products noted in Jan 7 2020 search automation
  • [DMAS-53059] - DeviceListing page does not display any devices
  • [DMAS-53062] - Investigate, then fix (and report actual bugs in) failing SeaTubeV3 UI tests
  • [DMAS-53077] - Water column product using same colour for different data.
  • [DMAS-53079] - erddapXML page gives a 404 error
  • [DMAS-53082] - map of infrastructure ONC home page (under “The Internet Connected Ocean” section) is gone?
  • [DMAS-53084] - deployment failed for latest version of master and release/19.12.000 in Oceans-Next
  • [DMAS-53093] - ErddapManagement datasets sometimes cannot be added
  • [DMAS-53110] - The wrong revision of oceans-next is running in QA
  • [DMAS-53129] - Oceans-Next pages don't render in QA Oceans 2.0
  • [DMAS-53136] - withAnnotationEntry() in LayoutsAndPermissionsTest.java can't delete annotation

Epic

  • [DMAS-52291] - CANARIE MINTED / Datasets / Dataset Definition

User Story

  • [DMAS-42960] - As an ASL echosounder user, I would like an ASL raw file data product
  • [DMAS-47724] - View Dashboards Shared With Me
  • [DMAS-51206] - As a data steward I want a UI to create and update a SiteDeviceSubset (with geospatial area) so I don't need to enter via sql
  • [DMAS-51288] - As a data steward I want to have DOIs for all devices at fixed sites so more data has unique identification
  • [DMAS-51861] - As a developer, I want to move the automation test tree UI from Liferay to the dev playground so that more people will be qualified to work on it
  • [DMAS-52324] - As a Digital Fisher, I would like improvements to the Digital Fishers Page
  • [DMAS-52327] - As a Digital Fisher Admin, I would like improvements to the Campaign Management Page
  • [DMAS-52335] - As a user of pages related to SeaTube I would like the theme to be similar to SeaTube
  • [DMAS-52478] - As a Software Developer, I want a Video Component that works for SeaTube and Dashboards
  • [DMAS-52698] - As a NOAA dive logger, I want to be able to access SeaTubeV3 from the ship without Internet access, so I don't experience interruptions while making annotations
  • [DMAS-52699] - As a NOAA onshore dive logger, I want to be able to record annotations without being interrupted by datacentre deployments
  • [DMAS-52955] - As a dev, I would like to improve manualqaqcresult job to elimate any overlap issue
  • [DMAS-52983] - As a User, I would like to add auto refresh as a parameter to saved plot data in Plotting Utility
  • [DMAS-53021] - As a software developer, I want to be able to compile backend and frontend changes independently of each other, so I don't need to wait as long for local builds

Task

  • [DMAS-46676] - Deployments include unused node_modules folders
  • [DMAS-48568] - Update State of the Ocean Plot for Saanich Inlet VIP after March-2019 cruise
  • [DMAS-50088] - Compare outputs from RDI java complex derivation to matlab and winADCP processing
  • [DMAS-50614] - As a Cyber-Security auditor, I want the IP addresses of devices made non-visible for non-ONC users
  • [DMAS-51566] - Update State of the Ocean Plot Searches after completion of 2019 Expedition Season
  • [DMAS-51594] - On the TaxonButtonSetConfig page only allow button sets to be marked active once they have a button assigned
  • [DMAS-52263] - Add ui tests for annotation list option behaviour
  • [DMAS-52590] - Please use the attached icon to replace our current ROV image in ST map (the blue dot)
  • [DMAS-52592] - Investigate Data Player image request code
  • [DMAS-52700] - Setup SOO/E plot generation job in PROD and check results
  • [DMAS-52718] - Create UI test for DashboardManagement page
  • [DMAS-52759] - Create UI test for Dashboard display
  • [DMAS-52761] - UI test for populating annotation search
  • [DMAS-52774] - dataProductDelivery download method response message contains HTML
  • [DMAS-52803] - Intermittent unit test failure in BaseDriverTest
  • [DMAS-52804] - Make more informative error messages for geospatial map failures
  • [DMAS-52839] - Add dpo parameters to searches and display plot in geospatial map
  • [DMAS-52866] - Refactor Community Fishers MATLAB code
  • [DMAS-52896] - Clean up Oceans-next testing console.errors/.warnings
  • [DMAS-52900] - Improve reporting in live DAF testing when some sensors have no data
  • [DMAS-52946] - Allow a user to specify some UI tests to be run through Jenkins
  • [DMAS-52992] - Update .gitignore file in ONC Data Products to ignore autosave files on linux
  • [DMAS-53001] - Method documentation in DeclinationUtil.java state the wrong units for altitude
  • [DMAS-53008] - Prevent jitter in CODAR GIF plots for VJOR/BONI/SAND
  • [DMAS-53014] - add DOI landing page to oceans 2.0
  • [DMAS-53038] - Move the QaDeviceTests.java test file to proper location
  • [DMAS-53039] - Implement Regression Test HY.TC.251
  • [DMAS-53069] - Hide Delete and Change State buttons on File Management page
  • [DMAS-53138] - Enable change file_state feature on File Management page

Requirement

  • [DMAS-52239] - Investigate file format specific requirements for ASL raw format
  • [DMAS-52350] - Gather & write requirements for Oceans 2.0 integration
  • [DMAS-53022] - Document requirements

Design

Implementation

  • [DMAS-50717] - Create the material toolbox component
  • [DMAS-51340] - Display some kind of feedback when a command is sent
  • [DMAS-51393] - Add handlers for SiteDeviceSubsetTable
  • [DMAS-51491] - Make/Adapt new map component to use in geospatial area
  • [DMAS-51492] - Display/Handle new map component in the SiteDeviceSubset popup
  • [DMAS-51562] - Add quiesce/resume status console functionality to new system console
  • [DMAS-51718] - Finalize layout for Site Device Entry screen
  • [DMAS-51719] - Add Button that Links to ERRDAP Management Page
  • [DMAS-52014] - Refactor Edit SiteDeviceSubset Popover as its own Page
  • [DMAS-52043] - Add site device page to the dmas environment
  • [DMAS-52334] - Remove form section id field from campaign entry
  • [DMAS-52340] - Improve the design of the Statistics page
  • [DMAS-52343] - Review button considerations for Edit Taxon and Taxonomy screens
  • [DMAS-52382] - Figure out how validation should work in Digital Fishers Campaign Management
  • [DMAS-52390] - "DELETE" button should always be on Site Device Screen (disable it when not used)
  • [DMAS-52406] - Re-Write Grouping bar message to be more helpful
  • [DMAS-52407] - make sure checkboxes should be maintained after command sent
  • [DMAS-52408] - Organizing issue for Filter buttons
  • [DMAS-52417] - Implement ASL raw data product - search code
  • [DMAS-52419] - Implement ASL raw data product - mappings
  • [DMAS-52453] - Refactor java search creation to match device level data search for cast scalar multi profile plot
  • [DMAS-52461] - Update Landing Page to show new values from Datacite XML
  • [DMAS-52528] - Add ADCP device type to Device Category dropdown
  • [DMAS-52529] - Add ADCP device list to Device dropdown
  • [DMAS-52534] - Implement Java code to call hydrophonepostprocessjobdailyweeklyltsa on a schedule
  • [DMAS-52617] - Implement a reusable video menu
  • [DMAS-52627] - Create a component in Oceans Next to display the Test Tree
  • [DMAS-52726] - Configure Oceans-Next to build and deploy a WAB to the datacentre
  • [DMAS-52739] - Implement a component that stitches playlist files into a continuous video
  • [DMAS-52748] - Modify permissions service to return self-delete privilege
  • [DMAS-52750] - Modify frontend to display delete icon for NOAA user's own annotations
  • [DMAS-52779] - Implement a DiveVideo component
  • [DMAS-52797] - Download and cache React
  • [DMAS-52817] - Add a return message to the erddapXML service
  • [DMAS-52823] - Only deploy to the demo server from the master branch
  • [DMAS-52826] - Implement UTCAddons and DiveVideoTemplate
  • [DMAS-52831] - Refactor search request validation for cast data products
  • [DMAS-52841] - Display pretty values in table
  • [DMAS-52847] - Use the new video player in seatube
  • [DMAS-52852] - Improve manualQaqcResult job
  • [DMAS-52882] - Implement recording
  • [DMAS-52885] - Update Task Detail page to only show the last 5 image key messages
  • [DMAS-52887] - implementation for auto-refresh of saved plots
  • [DMAS-52890] - Configure Oceans-Next to get the Oceans 2 hostname from the DMAS global variable
  • [DMAS-52910] - Implement video snapshots
  • [DMAS-52914] - Add new field to database
  • [DMAS-52915] - Implement flag in backend
  • [DMAS-52916] - Add new flag to UI
  • [DMAS-52917] - Configure Gemini to delay before scanning deploy/
  • [DMAS-52918] - Configure Oceans 2 to use a locally-deployed instance of Oceans-Next
  • [DMAS-52920] - Add siteDeviceSubsetPage to DMAS
  • [DMAS-52921] - Implement the video share button
  • [DMAS-52924] - Deal with add new button without a siteDeviceId
  • [DMAS-52929] - Use the new video player in playlist management
  • [DMAS-52935] - Add the tutorial video back to SeaTube
  • [DMAS-52936] - Implement live videos in SeaTube and VideoPlayer
  • [DMAS-52940] - Modify Cast Data (5) Preview Generation Job to ignore Data Preview tree constraints
  • [DMAS-52961] - Modify Data Search to correctly display CF Cast Data nodes in the tree
  • [DMAS-52966] - Extract Oceans 2 front-end code to its own OSGi bundle
  • [DMAS-52973] - Move all items from sub-table to main row
  • [DMAS-53031] - Update the PlottingUtility dashboard widget to use the new static path
  • [DMAS-53098] - Update IM Selenium testing for database reference flag

Test Plan

  • [DMAS-52395] - Add automation searches for ASL raw product

Bug (ST)

  • [DMAS-49530] - As CF app user I would like the app to retry getting the data automatically if the first transfer is unsuccessful
  • [DMAS-52217] - The Digital Fishers Campaign Maintenance Statistics page does not fully meet the requirements described by DF.RQ.311
  • [DMAS-52599] - Fix creators and contributors metadata
  • [DMAS-52625] - ErddapManagementTable doesn't appear in localhost or qa env.
  • [DMAS-52640] - Fix broken tests in seatubeV3
  • [DMAS-52747] - Searches created in datapreview generation job are missing entries in search table
  • [DMAS-52778] - Change SiteDeviceSubsetService to return GenerationType and SiteDeviceSubsetType Ids
  • [DMAS-52799] - Fix JS file name in build.gradle
  • [DMAS-52807] - SystemConsole grouping/sorting colours are inconsistent with row color
  • [DMAS-52871] - Fix broken test in NetworkConsole
  • [DMAS-52879] - Fix broken tests in Hydrophone
  • [DMAS-52925] - Fix error when sharing with group
  • [DMAS-52952] - Fix ErddapManagementEdit Page
  • [DMAS-52993] - Video causes SeaTube to crash in Oceans 2
  • [DMAS-52997] - 'Calibrated' dropped from ASL plots filename
  • [DMAS-53002] - dashboard.onc.uvic.ca makes all fetch requests against localhost
  • [DMAS-53012] - Oceans-Next master build failure: ./build-bundle.sh not found
  • [DMAS-53035] - QA does not load properly
  • [DMAS-53044] - Fix broken tests in PlottingUtility
  • [DMAS-53050] - Fix broken tests in HomePage
  • [DMAS-53070] - Remove JupyterHub menu item from main menu
  • [DMAS-53075] - Graylog Util gets connection refused when trying to call the Graylog API
  • [DMAS-53076] - fix broken test in Digital Fishers
  • [DMAS-53139] - Change all occurrences of TXT to .COR

Investigation

  • [DMAS-52891] - Can I redeploy a WAB without restarting Equinox?
  • [DMAS-52901] - Can I redeploy Oceans 2 while the Oceans-Next WAB is deployed?
  • [DMAS-52902] - Can I force oceans-next-bundle.js to not be cached, without nginx in front of it?

Documentation

...

"Major" releases include all completed items at that time (monthly), while "minor" releases are updates to the previous major release with bug fixes and specific features. Detailed release notes are available on internal confluence pages (internal users only).

Expand
titleClick here to see previous years new features / release notes...

Children Display

March 5, 2023

Major release

Maintenance

New Features or Improvements

  • Add Modified By and Modified Date on Device Workflow Admin page
  • Database improvements: improve a number of constraints on field lengths, remove a few deprecated tables, update a few _hist tables to _trx tables for better auditing.
  • Remove deprecated code: CANARIE Registry, adcpdata API
  • Quarter-scalar-data-generation-cassandra limit number of records to be processed each time
  • Update date format for QAQC reprocess and QAQC deletion jobs
  • Change property value from sensortypename to sensortypecode in Data Search URL

Bug Fixes

  • CSV/JSON data products header should report metadata file name with .xml not .pdf
  • User Management: "Select All" doesn't select all data products
  • Plotting Utility: Quarter scalar data includes data outside of deployment when it should not
  • Updates and bug fixes in automated testing

Community Fishers

  • Feature of the month! See: https://community.oceannetworks.ca/posts/oceans-30-software-updates-for-february
    → Added button to download all cast from a station
  • Reworked selected download check boxes on Cast Selection pop-up
  • Added support for Rinko-FT devices in the Community Fishers Pipeline and Data Products
  • Initial implementation backend & webservice to get CommunityFishersDevicePackage info
    • added xChange sensor information
    • added last verification date, last calibration date per device
    • moved CommunityFishersDevicePackage to device bundle

Community Fishers - APP

  • The Community Fishers App version CF.3.2.10 has been released with a summary found here: https://jira.oceannetworks.ca/projects/DMAS/versions/13379
  • Or alternatively, a brief rundown:
    • automated tracking of android tablet version
    • removed auto update notification
    • added new help menus/manuals
    • integrated Wi-Fi and Bluetooth connection more closely with Android
    • fixed loading from archived log/ctd data creating an unclose-able menu
    • various performance improvements under the hood

Acoustic Instruments Data Viewer

  • added a reference URL to custom taxons (front-end)
  • Fixed: Data Search for all available data doesn't return all the data (high-priority bug)

Data Products

  • Two very minor bug fixes and automated testing improvements.

Infrastructure

  • Restricted/testing environments only allow a subset of users to log in (secondary security to VPN/firewalls)
  • Remove abandoned "Camera Shut Down" application and "Complex Data Viewer" (v1 & v2) pages
  • Abort a deployment & shut down if Oceans 3 tries & fails to connect to its database
  • Modernize code behind Taxonomy Management page

Dashboards

  • Data Source Selector Widget now shows sources in a table
  • Location Selector now uses public API/locations service (much faster)
  • Fix: Audio player now goes to the correct location to play FLAC files
  • Fix: Data Player Widget can now be used anonymously 

CIOOS Pacific

  • Add tab to Agreements to edit and view local context labels

ExperiMINTED

  • Remove incorrect ERROR logging in the DOI registration job (378)
  • Link available from Data Search page to go to Search History page 
  • When running a batch an email can be sent under various conditions

Earthquake Early Warning, API and Tasks

  • Now continually sending acceleration data to IRIS on some high bandwidth land sites
  • Add message to API when requesting restricted data
  • Improved response descriptions on the open API page
  • Add better messaging when a default value is used on dataProductDelivery API
  • Wrap text on browser telnet console page
  • Simplify logic for running tasks and don't send tasks over the scheduler topic

SeaTube

  • Finished most phase 1 features in supporting 10+ on-ship servers
  • In-progress: DateTimePicker for MUI 5 updates, annotation ingestion parser, refactoring DiveLog to use the same framework as the DeckLog
  • Minor improvements and bug fixes

Instruments

  • Subc MK5/6 driver zoom function updated
    • Device does not report current zoom location.  Driver now generates the current zoom location by counting the number of zooms in from the maximum zoom out.
    • Add new sensor attributes for the total number of zoom positions and largest zoom step size, accounting for differences in model years.
  • In-progress: Camera Interface Board driver

Tickets Released: Oceans 3.0: 24.02.000 (accessible to internal users only). Total: 168. Automated Testing: AT.24.02.000 total: 8.

Expand

Bug

  • [DMAS-32067] - Large amount of text in some fields prevents account from being created and gives an unhelpful error message
  • [DMAS-67313] - Since 2021-12-01, The datasync queues are receiving thousands of messages
  • [DMAS-74241] - Save button is displayed on some pages for anonymous users
  • [DMAS-75460] - CSV/JSON products metadata file name in header should say .xml not .pdf
  • [DMAS-78229] - Data Search for all available data doesn't return all the data
  • [DMAS-78337] - Task DOI-Registration-job-deviceTypes (378) is failing every run
  • [DMAS-78715] - Pamguard configuration file uploader not working
  • [DMAS-78902] - Pamguard sub-tasks status not updated with parent batch
  • [DMAS-78958] - Disable the save button in the AddCollectionDialog on playlist discovery when fields are not filled in
  • [DMAS-78962] - Add missing task type entry for pamguard batch
  • [DMAS-79058] - In playlist playback page, the play speed control will go back to normal speed after a clip is done even the display is the same
  • [DMAS-79112] - Playlists with missing clips display the text "clip-thumbnail" as the clip thumbnail
  • [DMAS-79124] - Search failure in state of ocean plot in QA for negative values
  • [DMAS-79165] - Enable strict null checking for Task Management
  • [DMAS-79172] - Community Fisher pipeline error when editing end time
  • [DMAS-79197] - dmas-ldap-export.sh writes comments to ldif export
  • [DMAS-79212] - User Management: "Select All" doesn't select all data products
  • [DMAS-79217] - Error loading some older earthquake detail pages
  • [DMAS-79220] - The Running Tide Camera zoom is not responding to sea script
  • [DMAS-79228] - organizationagreementdevice has null deviceid
  • [DMAS-79252] - Audio Player not playing FLAC file
  • [DMAS-79265] - A taxon or taxonomy with no children displays as having a child in the tree widget
  • [DMAS-79267] - Fix the spelling of the Synchronizer Management page URL
  • [DMAS-79279] - Data Player Widget fails to make service calls to fetch spectrogram data
  • [DMAS-79286] - The thumbnail image is not display well for fixed location camera in playlist
  • [DMAS-79289] - Error initializing archive file manager in QA
  • [DMAS-79296] - OrganizationService not working
  • [DMAS-79299] - Quarter scalar data includes data outside of deployment when it should not
  • [DMAS-79304] - In QA calibration formulas cannot be saved anymore since the "Save" button was removed
  • [DMAS-79306] - Unable to see deployments if there is a deployment with a null dateTo value
  • [DMAS-79312] - ArchiveFileManager getByDevice results in NPE
  • [DMAS-79313] - Can's sync anything in QA
  • [DMAS-79326] - Changing a taxon's common name fails with an org.hibernate.SessionException: Session is closed
  • [DMAS-79389] - Data Player Widget makes repeated webservice calls when accessed anonymously
  • [DMAS-79394] - Applied QAQC tab on device details page does not work as expected in QA
  • [DMAS-79395] - Fix misuse of getmatlabjobdatabytaskid function in castdatacorrectionpostprocessjob
  • [DMAS-79409] - UVic task machines must not listen to the datasync queue
  • [DMAS-79419] - Fix QA bug of Save Button not appearing on some pages
  • [DMAS-79426] - fix archive file api not filtering restriction warning messages correctly in QA
  • [DMAS-79435] - Race condition in Expedition Management landing page
  • [DMAS-79441] - Unable to save or edit an annotation
  • [DMAS-79443] - Can't sync message in QA due to ClassNotFoundException
  • [DMAS-79447] - NullPointerException when saving synchronzer deployment with null dateTo
  • [DMAS-79449] - API /scalardata/device returns incorrect actualSamples when rowLimit is set
  • [DMAS-79451] - Quarter scalar job never terminates in QA
  • [DMAS-79456] - Updating a synchronizer deployment doesn't update modifyby or modifydate
  • [DMAS-79457] - Synchronizer management page crashes when toggling Start Now while editing a deployment
  • [DMAS-79473] - Erroneous ISO19115 xml metadata for Camera System in QA search automation
  • [DMAS-79474] - QA machines fail to *restart* due to ClassNotFoundException
  • [DMAS-79482] - Issue for Save button on SiteDeviceSubsetMaintenance
  • [DMAS-79489] - hostname not set correctly when task queued for not uvic shorestation in QA
  • [DMAS-79498] - .gz files don't appear in Data Search .zip download
  • [DMAS-79515] - Cannot cancel a running task

User Story

  • [DMAS-76402] - As a system admin, I want to manage which datasync queues receive messages so that I don't have to do too much manual clean up
  • [DMAS-77348] - Link to Search History Page from Data Search to improve accessibility of page
  • [DMAS-77692] - As a Community Fishers users, I want to download all casts from one station on Community Fishers Map without having to go to Data Search
  • [DMAS-77978] - As a batch management user I would like to have batch tasks automatically run in sequence
  • [DMAS-78339] - As a dev, I would like to see consistent date format on UI pages
  • [DMAS-78482] - As a system admin, I want to see whether synchronizers are deployed so I know which message queues need to be managed
  • [DMAS-78483] - As a system admin, I want to create synchronizer deployments so I don't need to manage their queues myself
  • [DMAS-78484] - As a system admin, I want to edit synchronizer deployments so I can end deployments
  • [DMAS-78575] - As an API user, I'd like better messaging when I hit restricted data
  • [DMAS-78797] - As a user, I would like to see Modified Date and Modified By info on Device Workflow Admin page
  • [DMAS-79057] - Ensure all ST-related synchronized tables use ModGenerator
  • [DMAS-79224] - Clean up activation and bundling of DataSyncServiceActivator
  • [DMAS-79429] - Define Storybook usage and standards

Task

  • [DMAS-35284] - Quarter-scalar-generation: limit number of records to be processed each time
  • [DMAS-67742] - Change property value from sensortype name to sensortype code on url of data search
  • [DMAS-73214] - Deprecate CANARIE registry endpoints and supporting code
  • [DMAS-74080] - Remove DataProductFormatAttribution table
  • [DMAS-77454] - change cruiselivestream_hist_seq to cruiselivestream_trx_seq
  • [DMAS-77899] - Convert organizationagreement varchar columns to text to allow any length
  • [DMAS-77990] - Prototype a script to export a subset of users from one LDAP instance to another
  • [DMAS-78603] - Add unit tests for getmatlabgetjobdatabytaskid
  • [DMAS-78975] - Clean up unused and uneeded parts of NeptuneVelocityServlet
  • [DMAS-79094] - Support parsing path params in DmasRestService
  • [DMAS-79144] - Update Required Date Format in QAQC Results Deletion and Reprocess Jobs
  • [DMAS-79149] - Delete unused CSD application
  • [DMAS-79191] - Move task email sending into a single place
  • [DMAS-79194] - Clarify what networking tools a user needs to run npm run deploy:oceans3
  • [DMAS-79208] - OpenAPI - update description fields for all the different services
  • [DMAS-79210] - Simplify renovate build process
  • [DMAS-79215] - organizationagreement has hist and trx tables
  • [DMAS-79221] - Remove deprecated adcpdata service
  • [DMAS-79232] - Support using TypedBaseDAO.saveOrUpdateList on types with non-zero unsaved PK values
  • [DMAS-79254] - Update label id for dropdowns on the DeviceActions page for testing purpose
  • [DMAS-79270] - Support Rinko-FT devices in the Community Fishers Pipeline and Data Products
  • [DMAS-79278] - If Hibernate fails to connect to the DB during a deployment with --watch, shut down affected servers so they don't spam the logs
  • [DMAS-79301] - Remove the abandoned ComplexDataViewer page
  • [DMAS-79308] - Support hiding some columns from the table of deployed synchronizers on the Synchronizer Management page
  • [DMAS-79309] - simplify logic for when a task can be ran and bypass scheduler topic
  • [DMAS-79348] - Update recurring search user info to align with current use
  • [DMAS-79352] - Add the Synchronizer Management app to Ocean3 menu
  • [DMAS-79357] - Remove the ChartContainer react component
  • [DMAS-79368] - wrap text on telnet console page
  • [DMAS-79397] - Update earthquake catalog page with correct detection area lat lon
  • [DMAS-79398] - Set user permissions for the Synchronizer Management page
  • [DMAS-79400] - Add synchronizer id to the synchronizer deployment UI
  • [DMAS-79420] - Update directory where EEW mseed files get downloaded to

Implementation

  • [DMAS-76355] - Generate IDs for synchronizable objects using a server's synchronizerId
  • [DMAS-76898] - Write skeleton code for device details GeneralTabPage
  • [DMAS-78159] - Write the Cypress skeleton code for the GeneralTabForm component
  • [DMAS-78270] - Replace the original Taxonomy page with the new one
  • [DMAS-78320] - Save changes to taxons and taxonomies
  • [DMAS-78327] - Get a list of active & future synchronizer deployments from the backend
  • [DMAS-78328] - Display a table of active and upcoming synchronizer deployments
  • [DMAS-78329] - Extend the create dialog to support editing a synchronizer deployment
  • [DMAS-78331] - Save a new synchronizer deployment in the backend
  • [DMAS-78332] - Save new synchronizer deployments on clicking Save in the create dialog
  • [DMAS-78333] - Add a Create Deployment button to the synchronizer management page's table widget
  • [DMAS-78340] - update date format for modified date or modify date on Actions, DeviceType, DeviceCategory, Organizations pages
  • [DMAS-78342] - update date format for modify date or modfied date on Device Sync and DataPreviewManagement pages
  • [DMAS-78344] - update date format for modified date or modify date on qaqc auto test finder and auto test details pages
  • [DMAS-78437] - Display a form on clicking the Create Deployment button
  • [DMAS-78438] - Add validation to the Create Deployment dialog
  • [DMAS-78485] - Update a synchronizer deployment in the backend
  • [DMAS-78486] - Update an existing deployment on clicking Save in the edit dialog
  • [DMAS-78637] - Implement users receiving optional emails when batch pauses or completes - ONC
  • [DMAS-78638] - Clean up the paths of the new taxonomy page in Oceans Next
  • [DMAS-78794] - Update "Playlist Created" snackbar to link to the playlist
  • [DMAS-78813] - Extract QAQC persistence code to OSGi bundles
  • [DMAS-78865] - Re-implement Buttons.jsx Save
  • [DMAS-78894] - Create tab for network console for local context project and service for getting project id
  • [DMAS-78895] - Create front end based off design for displaying local context project
  • [DMAS-78906] - Create a table view for displaying data sources
  • [DMAS-78948] - Return an error when TaxonomyMatrixAttributeService can't update or delete a taxon
  • [DMAS-78964] - Add a reference URL to custom taxons (frontend)
  • [DMAS-78978] - Return an IResourceName from NeptuneVelocityServlet.getResourceId
  • [DMAS-78983] - Have synchronizers connect to all synchronizers' datasync queues for publication
  • [DMAS-78987] - Create a management service for the synchronizer management UI
  • [DMAS-79004] - Convert Create*, Add* Buttons to use new format
  • [DMAS-79034] - Use locations/tree public service to get tree
  • [DMAS-79071] - add Modified Date and Modified By to Process
  • [DMAS-79072] - Update mapping files to use ModGenerator
  • [DMAS-79073] - Remove now-unused sequences and defaults using them
  • [DMAS-79074] - Implement users receiving optional emails when batch pauses or completes - Oceans Next
  • [DMAS-79079] - populate data product availability tables for live data when archive file entries are created
  • [DMAS-79083] - Return a list of synchronizers from the backend when /internal/synchronizer is called
  • [DMAS-79093] - Update useSnackbars hook to accept and use the `actions` prop
  • [DMAS-79098] - Create synchronizers for task servers and rename existing prod synchronizers to match hostnames
  • [DMAS-79147] - Support a messageType field distinct from the messageClass
  • [DMAS-79179] - Write the skeleton code for GeneralTabPanel
  • [DMAS-79180] - Write skeleton code for GeneralTabForm
  • [DMAS-79184] - Hook up the buttons in GeneralTabForm so they work
  • [DMAS-79229] - Create a service call to return all MQ locations
  • [DMAS-79243] - Create a new DiveLogDashboard component
  • [DMAS-79250] - add Modified Date and Modified By to Phase
  • [DMAS-79263] - Rebundle DataSyncServiceActivator
  • [DMAS-79264] - Clean up DataSyncServiceActivator activation
  • [DMAS-79266] - add Modified Date and Modified By to Task Editor
  • [DMAS-79271] - Rebundle enums in IFileLocationConfig
  • [DMAS-79272] - Remove dependency of extension.synchronization.api on core.usermanagement.api
  • [DMAS-79288] - Return Files from FileLocation
  • [DMAS-79300] - Implement skeleton webservice to get device package info
  • [DMAS-79319] - Implement ability to get all Community Fishers Device Packages
  • [DMAS-79325] - Move CommunityFishersDevicePackage to device bundle
  • [DMAS-79401] - Create wrapper on Community Fishers device packages with extra info for info page
  • [DMAS-79408] - Create an API for annotation converters
  • [DMAS-79428] - add message when a default value is used in the data search api
  • [DMAS-79431] - Create styleguide for buttons
  • [DMAS-79434] - Configure backend to allow for CORS preflight OPTIONS call and PATCH permissions
  • [DMAS-79436] - Replace logging jars with pax-logging-api
  • [DMAS-79439] - add modify info to deviceprocessgroup table
  • [DMAS-79448] - Add last verification date, last calibration date per device

Test

  • [DMAS-78302] - Update UI tests to work with the new taxonomy page

Bug (ST)

  • [DMAS-79303] - Response from /internal/synchronizers/deployments is missing a deployment's organization & user
  • [DMAS-79311] - RDI ADCP Wave devices are getting a datasets.xml section for Codar device types

Requirement

  • [DMAS-78518] - Gather requirements for Community and device package UI

February 15, 2023

Minor release for CF AML-6 CTD parser and logging issue.

Tickets Released: Oceans 3.0: 24.01.002 (accessible to internal users only). Total: 2.

February 12, 2023

Major release, covering December thru January.

Maintenance

New Features or Improvements

  • Standardized data format for Modified By and Modified Date Oceans 3.0 pages
  • Python API library documentation update
  • Update web services to add Modified By and Modified Date for device workflow admin page
  • Allow to close enlarged images on Search Hydrophone Data page
  • Add new data source filter "Restrict data source selection to map-view" on Data Search page. Off by default to prevent tree-trimming.
  • Add another order by (modifydate desc) for deviceattributes or sensorattributes on Device Details display
  • Draggable dialog box on Device Category page
  • Allow colons in the field label of fornfield entries
  • Remove groundfault alarm setting for mini JunctionBox with 400 volt ports
  • Lots of new or updated or fixed automated tests

Bug Fixes

  • Fix ticket creation which was broken by Jira upgrade

Internal projects

  • Java 17 upgrade project is officially complete
  • Various small deployment improvements: better logging, reduce errors, improve validator warnings
  • Support refactoring ship-shore-synchronizing managers into OSGi-services mid-season
  • Drop support for IE9

Dashboards (in support of Acoustic Data Viewer)

  • DEV/QA only data selector widget beta

CIOOS

  • Use correct version of DOI link now that CKAN supports it
  • Local Contexts - in progress - support association of Local Contexts project ID with Organization Agreement, display labels associated with project
  • Fixed issue with CKAN harvest jobs not finishing

ExperiMINTED/Task Management

  • Remove pagination for Batch Tasks - all top-level batch tasks now show on one page to make sequencing simpler
  • Batches now support auto-run 
  • We now support a pipeline job which will run the specified set of jobs sequentially
  • Bug fix: running DOI registration jobs metadataOnly updates DataCite correctly again 

EEW

  • Fixed a bug where site detections could show up multiple times if they didn't have a p-wave or s-wave attached on the earthquake detail page.

API

  • Removed userId parameter from ScalarDataAPIService (not the public API service) to improve security.
  • Support default data product options in the data product delivery service. Also ignore any incorrect options a user provides. Response contains the corrected URL.
  • Remove scalar data get by station API
  • Have user input persist on the OpenAPI  page if they enter it while logged out and then log in to try their query.
  • Add deviceCode filter to the OpenAPI  deployment service page. The API already supported it but it wasnt listed on the OpenAPI page.
  • Improve performance of the get location and get location tree services
  • Update all public API services to support an appToken (for dashboards)
  • Update the citation response from delivery API services to include fields for the DOI, landing page link, and query pid in addition to the citation string.
  • Added filters to the location tree service so it has all the same ones as the get location service.

Data Products

  • Bug fixes: Nortek data for rest of day is missing after a configuration change (in some cases), slow/stuck RDI reading with gappy data
  • Better plot titles for supporting global data
  • ERDDAPnetCDFpostProcessor ready: added features for automatic dataset switch over as we populate, handling of re-postprocessing, chunking for reliability, filters by device and time for live and re-postprocessing, edge cases

SeaTube

  • Finished Playlist update project phase 1
  • In-progress: supporting 10+ onship servers
  • Some minor improvements
  • A few bugs fixed

Community Fishers

  • Fixed multiple lasso tool bugs
  • Fixed CF duration limit accidentally applied to all siteDeviceSubset types
  • Fixed CF App Wi-Fi Regression Test patch for CF.3.2.10
  • Added DeviceTypeAttribute to track android SDK version for devicetype 267
  • Dropped the ErddapDatasetAttribute and ErddapDatasetAttribute_hist table
  • Converted CFOverlay to a functional typescript component
  • Refactored Cast Selection popup out of CFOverlay
  • Added mapId to the context so it isn't passed around everywhere
  • Fixed lasso tool on CF map contains undefined reference to assignedCastData
  • Added I18n to cut down on code maintenance for Buttons in React

Tickets Released: Oceans 3.0: 24.01.000, 24.01.001 (accessible to internal users only). Total: 254. Automated Testing: AT.24.01.000 total: 44.

Expand

Bug

  • [DMAS-78840] - The mat-format data products for the AZFP Echosounder (55036) at DDL have unexpected units in the profileData
  • [DMAS-79231] - Tasks that cannot be executed due to singleton constraint result in a NPE
  • [DMAS-74752] - Order device attributes by datefrom desc, modifydate desc on device details/additional attributes page
  • [DMAS-77991] - Description collapse text displays for all playlists in Firefox
  • [DMAS-78330] - Synchronization managers can't be referenced
  • [DMAS-78418] - I can't modify or delete button sets I create
  • [DMAS-78592] - Data Search filter misbehaves when changing between tree types with active filters
  • [DMAS-78594] - Links to DOI Dataset Landing Pages broken for all CKANs
  • [DMAS-78621] - Can't set Junction Box alarm values for BPS miniJB028
  • [DMAS-78699] - Fix tests failing due to update of esri-leaflet to v3.0.12
  • [DMAS-78721] - Lassoing irregular shapes causes duplicate cast lasso items
  • [DMAS-78738] - Titles in matlab plots don't know about South
  • [DMAS-78753] - Fix VideoTest.testShareVideo
  • [DMAS-78762] - Data access restriction doesn't work in ST dive log
  • [DMAS-78763] - Unnecessary error messages while reordering my video clips
  • [DMAS-78769] - Playlist Playback page crashes when a playlist has no clips
  • [DMAS-78771] - SeaTube Chat Log widget's minimum height depends on the window height
  • [DMAS-78782] - CastPopup occasionally fails tests when ran locally.
  • [DMAS-78783] - Downloading clips from a playlist while not logged in displays an error "Network error"
  • [DMAS-78795] - main branch of Oceans Next not building on Windows
  • [DMAS-78805] - Position and show/hide issues on the video control bar of Playlist Playback page.
  • [DMAS-78822] - Bathymetry page is failed to load.
  • [DMAS-78835] - Metadata change task and DOI registration task are assigned 0 sequence numbers
  • [DMAS-78845] - SiteDevice Subset upcast/downcast changes have globally affected all subset types
  • [DMAS-78857] - Deployments sometimes fail with `tail: invalid number of lines '+Binary'`
  • [DMAS-78873] - Fix failing storybook build
  • [DMAS-78885] - Oceans Next isn't reporting jest test results
  • [DMAS-78888] - Oceans 3 fails to restart in QA2
  • [DMAS-78912] - Some pages don't load from the start:oceans3 script
  • [DMAS-78917] - There are expeditions/dives missing in on-shore dive logger
  • [DMAS-78931] - CKAN of dataset record is not available even though devices have been added through ERDDAP, CKAN jobs
  • [DMAS-78946] - Bug in the parser for Nortek Aquadopp Profiler 2MHz, specifically at Folger Pinnacle on 2024-Jan-06
  • [DMAS-78955] - lasso button is being duplicated on the geospatial page
  • [DMAS-78963] - Error when editing existing playlists
  • [DMAS-78968] - Adding a collection does not close the "Create Collection" dialog
  • [DMAS-78985] - lasso tool on CF map contains undefined reference to assignedCastData
  • [DMAS-78994] - Fix failing test case in TaxonomyDetailWidget.cy.tsx
  • [DMAS-79003] - Null Pointer Exception When Logging in on Dev
  • [DMAS-79027] - Clip deletion failing due to missing playlistHdrId
  • [DMAS-79032] - Investigate QAQC Reprocess (job ID 359) failure for taskId 36661223
  • [DMAS-79045] - Geospatial map lasso tool removes selected casts when performing new lasso
  • [DMAS-79049] - Device Workflow Admin Phase Filter not showing up in QA
  • [DMAS-79065] - Selecting casts with lasso after choosing 'Select all casts' doesn't revert button to 'select all casts'
  • [DMAS-79084] - In QA, I can't update the datatype of a taxonomy attribute, or add options to it
  • [DMAS-79090] - Device Workflow Admin Process Filter not showing up in QA
  • [DMAS-79092] - DOI title mismatch between datacite and ONC database
  • [DMAS-79106] - Accessing ComplexDataPlayer as an anonymous user will crash the browser
  • [DMAS-79109] - Device Workflow Admin page can not add/delete phase
  • [DMAS-79110] - Pressure data for RDI ADCP 150 kHz (SN 8580) for SOG East is incorrect in MAT and RDI data prdocuts
  • [DMAS-79121] - Cannot generate dataProducts for historical casts at a station via the Community Fishers Map
  • [DMAS-79125] - Error occurring in Batch Management when deselecting a batch
  • [DMAS-79134] - Earthquake Detail Page site detection table is showing duplicate sites
  • [DMAS-79142] - error when trying an open api query when logged out
  • [DMAS-79146] - Applying filters or enabling drifter/cf sampling stations on QA DataSearch causes device tree to reload collapsed
  • [DMAS-79170] - modifyDate and modifyBy is null for a new Process, Phase or phasephasetask
  • [DMAS-79200] - imagenex-837-postprocess-job generate *.837 files with zero filesize in qa with release/24.01.000
  • [DMAS-79207] - The XML configuration files for the AZFP Echosounder (55036) at DDL are incorrect after 2023-11-24 22:06
  • [DMAS-79219] - piggyback device connect multiple ports to different port of parent device in topology is broken

Epic

  • [DMAS-74103] - As a software developer, I want to upgrade our tools to use Java 17 so that we can make use of the latest features and ongoing support

User Story

  • [DMAS-73635] - As a ST developer, I would like to support more than 10 onship servers
  • [DMAS-75300] - As a software developer, I want to upgrade dev dependencies to match the versions used in the new Equinox
  • [DMAS-77737] - As a software developer, I would like more constraints on database updates and deletes in the QA and DEV databases
  • [DMAS-78371] - As a software developer, I want synchronizer database tables to use a module prefix
  • [DMAS-78447] - As a dev, I would like to have modifydate and modifyby coumns and trx table for device workflow related database tables
  • [DMAS-78474] - As a user, I would like to see consistent names for fields Modified Date and Modified By
  • [DMAS-78481] - As a software developer, I want a synchronizer management skeleton page for me to build on
  • [DMAS-78494] - As a scientist using SeaTube, I want to be able to lock a playlist against editing so that links from published papers can't be broken
  • [DMAS-78552] - As a software developer, I want to drop support for testing old branches with Java 8 in order to simplify maintenance and test processes
  • [DMAS-78684] - As a ST user, I want to be able to create, edit, and delete playlist group from the group panel
  • [DMAS-78708] - As a SeaTube user, I want video snapshots to use a more appropriate quality
  • [DMAS-78933] - Add stories for map buttons, menus, sizeables sliders
  • [DMAS-78939] - Add storybooks for steppers

Task

  • [DMAS-37728] - remove navdata configproperties in database
  • [DMAS-46729] - Jan Schluter would like a "restrict to visible area" tickbox instead of automatic filtering in data search
  • [DMAS-47205] - ServerManagementService appears to be inactive
  • [DMAS-67409] - As a data partner, I would like to see ScalarDataAPIService validate its user's identity so that data access restrictions can be enforced
  • [DMAS-73306] - As a user, I would like to see an alert when future dates are used in QAQC Results Deletion Job
  • [DMAS-74927] - As an app developer, it would be useful to have quick access to the android version of a tablet used in CF
  • [DMAS-75613] - As a dev, I would like to see dialog box on device category dragable
  • [DMAS-76872] - Always proxy through qamon/ncdeploy when deploying from Jenkins
  • [DMAS-76942] - Add job.failed.email.recipients job parameter for QAQC reprocessing job
  • [DMAS-76961] - Make each of the data product options in the Dataset Landing Page for query PID options table links to the wiki
  • [DMAS-77026] - Improve email content for the support request
  • [DMAS-77818] - Print any errors thrown when installing OSGi bundles in QA/prod
  • [DMAS-77950] - Remove the page header bar on the playlist playback page
  • [DMAS-78013] - Lazily load Playlist apps when running Oceans Next in playground mode
  • [DMAS-78301] - Replace loading spinners on Thumbnails with a Skeleton component
  • [DMAS-78338] - Populate the synchronizer database tables
  • [DMAS-78356] - Adjust styling in PlaylistList to add space between thumbnail and text
  • [DMAS-78357] - Redirect the SeaTubeV3 Playlist playback route to the new Playlist Playback page
  • [DMAS-78411] - Make DataSyncServiceActivator agnostic to whether a synchronizable manager is an OSGi service or not
  • [DMAS-78528] - Refactor AsyncAutocomplete to use cancellable service calls and create storybook
  • [DMAS-78585] - Design where playlist lock/unlock buttons and icons will go, how it will affect the playback page
  • [DMAS-78639] - Allow colons in the field label of formfield entries.
  • [DMAS-78692] - Search Hydrophone Data page does not allow to close zoomed images
  • [DMAS-78711] - As a user, I would like to see consistent display for Modified By on dmas UI pages
  • [DMAS-78732] - Update the playlist discovery page's Modified column if a playlist's clips are modified
  • [DMAS-78739] - Update Dockerfile to use Node v20
  • [DMAS-78796] - As a dev, I would like to include modifyby and modifydate in the web services for device workflows
  • [DMAS-78804] - Inconsistent date formats in notification emails
  • [DMAS-78824] - Add story with docs for AvailabilityChart
  • [DMAS-78827] - Add stories for Filters and DragScroll
  • [DMAS-78837] - scalardata get by station failing to return data
  • [DMAS-78842] - The Jenkins storybook build should email the senior developers on failure
  • [DMAS-78846] - Switch configuration to avoid needing to import React in every single file
  • [DMAS-78853] - Unassigned casts inside station perimeter
  • [DMAS-78854] - On the openapi page if a user fills out a service query while not logged in the form should keep the values after login
  • [DMAS-78880] - OpenApi deployment page is missing the deviceCode filter
  • [DMAS-78886] - Configure logging for OSGi tests
  • [DMAS-78887] - Equinox validation should fail with a better message if gemini.service exists but /usr/local/gemini doesn't
  • [DMAS-78908] - improve the performance of the get location tree public api call
  • [DMAS-78909] - Update code coverage reports for Oceans Next
  • [DMAS-78910] - Update code coverage reports for Oceans 3
  • [DMAS-78913] - need able to deploy oceans-next code to qadivelogger4.onc.uvic.ca through Jenkins
  • [DMAS-78925] - Run DigitalFishers UI tests in Renovate builds
  • [DMAS-78940] - Add appToken support to external services not supporting it yet
  • [DMAS-78943] - Implement TaxonAsyncAutocomplete into Dive and Deck Log
  • [DMAS-78959] - Add new field auto-requeue to tm_tasktype
  • [DMAS-78960] - Update openAPI page and documentation for resample periods
  • [DMAS-78979] - CKAN harvester won't stop
  • [DMAS-78989] - Don't attempt to use Matlab if matlab as a service is turned off (Dev)
  • [DMAS-79006] - Remove pagination for the first level of batch tasks
  • [DMAS-79017] - Improve task original date query
  • [DMAS-79021] - Update dependency react-virtualized-auto-sizer to v1.0.21
  • [DMAS-79031] - Remove sequenceNumber from DAO objects
  • [DMAS-79060] - Sort the AppMenu in Oceans Next
  • [DMAS-79089] - Remove the current playlist from the list of Copy To Playlist options on Playlist Playback page
  • [DMAS-79091] - Update tests for the ModifiedBy value on UI page
  • [DMAS-79105] - update post refresh scripts with new task type column
  • [DMAS-79201] - As a data steward, I would like the sensortype description field to be longer, to make state-type sensor values clearer
  • [DMAS-79234] - Add logging to JMSExceptionHandler and GenericJMSConnection
  • [DMAS-79257] - Correct checkstyle issues in GenericJMSConnection

Implementation

  • [DMAS-77504] - Implement Data Source Selection Widget
  • [DMAS-77738] - Add where clause constraint to all database table updates and deletes
  • [DMAS-77993] - Convert CFOverlay to a functional typescript component
  • [DMAS-78032] - Make FormFieldService available anonymously
  • [DMAS-78218] - Drop JDK options from Integration Testing build scripts
  • [DMAS-78259] - Refactor Cast Selection Poppup out of CFOverlay
  • [DMAS-78288] - Display read-only metadata when selecting a taxonomy or taxon
  • [DMAS-78291] - Display a form with taxons' default attributes
  • [DMAS-78293] - Delete a taxon or taxonomy when clicking Delete Taxonomy or Delete Taxon
  • [DMAS-78294] - Add a taxonomy when clicking Add User Defined Taxonomy
  • [DMAS-78296] - Add a taxon when clicking Add Taxon
  • [DMAS-78321] - Autosave changes to default attributes
  • [DMAS-78325] - Make a servlet for the synchronizer management UI
  • [DMAS-78326] - Make a React page for synchronizer management
  • [DMAS-78372] - Create new prefixed synchronizer tables
  • [DMAS-78373] - Update hibernate mapping files to use prefixed synchronizer tables
  • [DMAS-78374] - Remove unprefixed synchronizer database tables
  • [DMAS-78436] - Make a base web service supporting multi-verb REST services
  • [DMAS-78448] - Add modifydate and modifyby columns in phase, phasephasetask, phasetype, process, processgroup, processphase and processtype tables
  • [DMAS-78449] - creat trx for phase, phasephasetask, phasetask, phasetype, process, processgroup, processphase and processtype database tables
  • [DMAS-78466] - Drop ErddapDatasetAttribute table
  • [DMAS-78495] - Add a lock button to the playlist details header bar on the playback page
  • [DMAS-78496] - Add columns "locked" and "lockreason" to playlist_hdr
  • [DMAS-78497] - Add persistence and web service code for "locked" and "lockreason"
  • [DMAS-78498] - Lock a playlist when a user confirms their click on the lock button
  • [DMAS-78499] - When a playlist is locked, display an unlock button in the playlist details header instead of a lock button
  • [DMAS-78500] - If a playlist is locked, display it as read-only on playlist discovery
  • [DMAS-78501] - If a playlist is locked, display it as read-only on playlist playback
  • [DMAS-78502] - If a playlist is locked, reject edits to it in web services
  • [DMAS-78545] - Drop support for deploying Oceans Next to Gemini
  • [DMAS-78547] - Update Modified Date/Modified By field names for React pages created by other groups
  • [DMAS-78566] - Add UI indicator and controls for automatic batch task execution
  • [DMAS-78568] - Implement batch task auto-queueing
  • [DMAS-78583] - Disable locked playlists in selection dropdowns for adding clips in Oceans Next
  • [DMAS-78598] - Update dataproduct discovery service to show default values, request service to use default values, and open api page to display defaults in description text
  • [DMAS-78626] - Add a reference URL to custom taxons (backend)
  • [DMAS-78664] - Add a method to PlaylistService to update a group name
  • [DMAS-78665] - Create a new Expedition Admin - ONC group
  • [DMAS-78671] - Update ExpeditionOrganization.java to use the new group
  • [DMAS-78674] - Update SeaTube.jsx to use the new group
  • [DMAS-78675] - Create a Dialog for creating a playlist group
  • [DMAS-78676] - Create a dialog for editing a playlist group name
  • [DMAS-78678] - Create a dialog for deleting a playlist group
  • [DMAS-78679] - Disable the add group button if there aren't any ungrouped playlists
  • [DMAS-78713] - Add translations with a button base component
  • [DMAS-78716] - Enable authentication when running UI tests in QA2
  • [DMAS-78722] - Implement date chunking when searching for days to create NetCDF files in ErddapNetCdfPostProcessor
  • [DMAS-78723] - When generating NetCDF for Erddap always produce a NetCDF file even when sourceFile does not have sufficient data
  • [DMAS-78724] - Implement filtering options for ErddapNetCDFPostProcessor
  • [DMAS-78774] - update column names to Modified Date and Modified By on Network Console page
  • [DMAS-78793] - Refactor Create/Update Playlist buttons in SeaTube Search to be disabled/have loading indicators
  • [DMAS-78806] - Hide locked playlists in selection dropdowns for adding clips in SeaTube Pro
  • [DMAS-78811] - Extract StudyArea persistence code to OSGi bundles
  • [DMAS-78812] - Extract data acquisition metrics to OSGi bundles
  • [DMAS-78818] - Check if a taxon's originTaxonomy is editable in the default attributes form
  • [DMAS-78820] - Add mapId to the context so it isn't passed around everywhere
  • [DMAS-78823] - Update Modified Date/Modified By field names for Device Details, Site Device and Dive page
  • [DMAS-78825] - Add a Properties table for imported taxonomies and their taxons
  • [DMAS-78828] - Replace Jetty with Tomcat in dev
  • [DMAS-78829] - Run dev on the root context path
  • [DMAS-78830] - Remove the distinction between dev and prod bndrun files
  • [DMAS-78833] - Update VideoSnapshotService to use the appropriate quality source for snapshots
  • [DMAS-78834] - Set the video quality to use for playlist thumbnails
  • [DMAS-78841] - Remove several unused dependencies
  • [DMAS-78847] - Derive the location of Oceans Next automatically
  • [DMAS-78849] - Only allow open tasks to swap sequence numbers
  • [DMAS-78851] - have the running status chip on task management be green
  • [DMAS-78852] - Change "Group" to "Collection" for current playlist group components
  • [DMAS-78856] - Set the video quality to use for dive log snapshots
  • [DMAS-78864] - Extract labels from Buttons.jsx and organize them into translations.json (en)
  • [DMAS-78871] - Default the locking service code to use the previous lock values if none are passed
  • [DMAS-78875] - Implement basic task pipelines
  • [DMAS-78889] - Remove unnecessary notes about .ssh/known_hosts in Oceans Next deployment Jenkinsfile
  • [DMAS-78892] - Add projectid column to organizationagreement table
  • [DMAS-78893] - Create dal layer for organization agreement local context project id column
  • [DMAS-78896] - Increase mod count
  • [DMAS-78907] - Refactor TaxonForm.tsx into different components for editing and adding
  • [DMAS-78911] - Update global.baseurl in dev
  • [DMAS-78915] - Update Modified Date/Modified By field names for Expedition Maintenance, Sensor Maintenance - Additional Attributes Tab, SeaScript Editor
  • [DMAS-78924] - Deprecate the old Button.jsx file and add a warning comment to the top of Buttons.jsx
  • [DMAS-78935] - Refactor GenericSystemCommandActivator as an OSGi whiteboard
  • [DMAS-78944] - Convert High and MediumEmphasisSubmitButton to use new format
  • [DMAS-78945] - Convert DeleteButtonRed to new format
  • [DMAS-78954] - Convert ImageUploadButton, ChooseFileButton, MediumEmphasisChooseFileButton to new format
  • [DMAS-78965] - Convert Generic*, FloatRight* Buttons to use new format
  • [DMAS-78973] - add default values for modifyby and modifydate in device workflow related tables
  • [DMAS-78976] - General cleanup of unused features of NeptuneVelocityServlet
  • [DMAS-78984] - Make use of taskOutput in ErddapNetCdfPostProcessor
  • [DMAS-78993] - Compare creation date of NetCDF file to source file during job run
  • [DMAS-79009] - Create batchable task that deletes files from Erddap NetCdf file store - SQL
  • [DMAS-79010] - Create batchable task that deletes files from Erddap NetCdf file store - Java
  • [DMAS-79016] - Refactor the ToolbarButtons used in Buttons.jsx
  • [DMAS-79018] - Update public api citation response
  • [DMAS-79019] - Improve batch task pagination
  • [DMAS-79020] - Handle source archivefiles that span multiple days
  • [DMAS-79037] - remove sequencenumber from ONC DAO objects
  • [DMAS-79039] - Create RDI ADCP Cassandra to NetCdf changeover job - Java
  • [DMAS-79040] - Create RDI ADCP Cassandra to NetCdf changeover job - SQL
  • [DMAS-79046] - Add DeviceTypeAttribute to track android SDK version for devicetype 267
  • [DMAS-79050] - Implement API location tree filters
  • [DMAS-79051] - Add column to tasktype
  • [DMAS-79055] - Add ADCP Wave device type to ERDDAP RDI ADCP NetCDF Generation Job
  • [DMAS-79061] - add Modified Date and Modified By to Process Group
  • [DMAS-79068] - Batch Task pagination service changes
  • [DMAS-79069] - Use new /netcdf_data volume to store NetCdf files for use with Erddap
  • [DMAS-79077] - Use a timeout when generating NetCdf files for Erddap
  • [DMAS-79080] - Allow multiple blacklist/whitelist dateranges to be specified for one device
  • [DMAS-79199] - Sometimes NetCdf files can be generated each time the job runs when they should not be

Test

  • [DMAS-76365] - Update the synchronizing test plan to properly document where messages should be sent
  • [DMAS-78918] - Need test group-user synchronization for the new group in QA

Bug (ST)

  • [DMAS-78622] - Deleting a taxon doesn't work if it has been imported
  • [DMAS-78870] - Add padding that Button.jsx adds to reduce visual changes when refactoring
  • [DMAS-78966] - Support an argument on the --jdk option for Oceans 3 deployments
  • [DMAS-78992] - Error colored buttons don't style correctly when disabled
  • [DMAS-79012] - Fix Batch Task Pagination ONC
  • [DMAS-79013] - Fix Batch Task Pagination Oceans next
  • [DMAS-79076] - Investigate NetCdf generation getting stuck/slow in Matlab
  • [DMAS-79195] - phasetask_trx table phasetaskreferences nullable

Investigation

  • [DMAS-38792] - Investigate why SensorReadingCache entries expire after 60s

Documentation

  • [DMAS-78525] - Update external wiki documentation with new scalar data service parameter

Requirement

  • [DMAS-78801] - Create requirements for Local Context-Data Agreement association

Design

  • [DMAS-78936] - Document the design for the stages leading to being able to use generic command messages on the system console

January 16, 2023

Minor release to fix bugs in SubC camera control and scalarData service, plus update connection pool limits.

Tickets Released: Oceans 3.0: 23.11.003 (accessible to internal users only). Total: 3.

January 10, 2023

Minor release to update acoustic scintillation driver (no downtime)

Tickets Released: Oceans 3.0: 23.11.002 (accessible to internal users only). Total: 1.