Versions Compared

Old Version 856

changes.mady.by.user Ben Biffard

Saved on

compared with

New Version 857

changes.mady.by.user Ben Biffard

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

May 6, 2020

Major release.

...

titleFeature notes: TODO -not ready until dev meeting on Thursday...

Instruments

  • Data acquisition bottleneck detection and reaction: implementation of automated quarantine of problematic / late data (

...

  • near completion)
  • CVAUI conference website (4th Workshop on Computer Vision for Analysis of Underwater Imagery)

...

  • AIS integration (in-progress)

...

  • PAMguard (starting)
  • STRAW-b drivers and integration (starting)

...

Data Products

  • Add CODAR data availability MAT files for combiner / totals devices
  • Improve CODAR data availability plots for long time range
  • Icon for FLAC files in Data Search
  • Backlog FLAC file converter with comparison check
  • Added capability for user input for data product options, instead of a predefined set

Complex Data Player

  • Improved option menu for ADCP and hydrophones
  • Data player now integrated in to Oceans 2.0
  • Implementation in-progress: infrastructure, bug fixes, speed improvements, etc

Automated Testing and Continuous Deployment

  • Significant improvements to all UI automated testing (coverage, tools, reliability, results)
  • Continuous deployment: process improvements
  • Automated DAF testing improvements
  • Distributed cache (in-progress)
  • Automated release notes (investigation)

Maintenance and Production Developer

  • Completed ability to add data ratings for sensors (products and services do not use them yet)
  • Scalardata webservice performance improvements
  • Task and user management bug fixes for permissions and security
  • Various other bug fixes (rawdata service, etc)

Community Fishers

  • caching images (in-progress)
  • Make use of new user input options in viewer (in-progress)

Maintenance and Production Developer

  • Support for ONC website
  • Bug fixes
  • New device synchronization page
  • Multiple owner/organization per device (in-progress)
  • Sensor-level data ratings for sensors applied to products and services (in-progress)
  • Distributed cache (in-progress, now paused)
  • Feature deployments (in-progress, now paused)
  • Automated UI testing (in-progress)
  • DAF testing / prep for June cruise (in-progress)

Community Fishers / EMSA

  • Geospatial map: display information on data restrictions (in-progress)
  • Improve pipeline: move away from file_state trigger (in-progress)

...

SeaTubeV3 - CANARIE & NOAA & ONC

...

  • Annotation improvement
  • Improve seek bar for longer videos
  • Improve integration of components

...

  • Migrate all features from V1&V2 to V3: fixed cameras in-particular (in-progress, almost done)

...

Dashboards - CANARIE

...

  • Restarting

MINTED - CANARIE

...

Citation text for subsets includes QueryPID, now included on landing page

  • Finish up, support final demo (effort level > 100%)

  • DOI unique identifiers for data sets now available, including versioning and change tracking, plus landing page to display this information
  • New task and batch processing system facilitates this versioning

...

  • (in-progress)

CIOOS / ERDDAP

...

  • Minor improvements for ERDDAP

...

  • / CKAN

...

  • infrastructure
  • ISO metadata reports available via service

...

  • , plus improvements to the report (in-progress)

Tickets Released: Oceans 2.0: 20.04.000 (accessible to internal users only). Total: 107.

Expand

Bug

  • [DMAS-52876] - Fix broken tests in GeospatialMap
  • [DMAS-53716] - Fix broken test in FileManagement
  • [DMAS-53749] - Fix broken tests in seatubeV3.MapTest
  • [DMAS-53752] - Fix broken tests in sitedevicemaintenanceV2.SiteDeviceSubset
  • [DMAS-54236] - Data player timeline not updating when scrolling during file generation
  • [DMAS-54278] - DMAS Search Failed Notification: 27-Mar-2020 00:31:37 UTC, null, Video Export, SearchHdrId 5055140, UserId 80340
  • [DMAS-54331] - Notification reaction unit tests failing in master
  • [DMAS-54347] - Fix broken tests in MiniDmas
  • [DMAS-54351] - Fix broken tests in inlineEditingObservations and addDive of DiveManagement
  • [DMAS-54356] - Fix broken tests in SystemCommandUtilTest
  • [DMAS-54357] - Fix broken tests in treeClicking of DataSearch
  • [DMAS-54369] - Fix broken tests in addDeviceAttributeLabel of DeviceAttributes
  • [DMAS-54372] - Fix broken tests in setup of DataSetLandingPage
  • [DMAS-54376] - Fix broken tests in downloadCor, downloadLastestCastTxt, downloadPlot and FilterVisibility of GeospatialMap
  • [DMAS-54385] - New button sets not displayed in V3
  • [DMAS-54469] - Fixing automatic merge failure
  • [DMAS-54472] - Videos with different scales/aspect ratios/resolutions cannot be concatenated cleanly
  • [DMAS-54529] - Fix failing SiteDeviceMaintenance tests
  • [DMAS-54552] - Fix automatic merge failure for DMAS-54489
  • [DMAS-54568] - Data Player does not load Hydrophone spectrograms after applying options in oceans next
  • [DMAS-54747] - UI test suite failed with "Error forwarding the new session Empty pool of VM for setup Capabilities"
  • [DMAS-54805] - UI testing master branch static analysis warnings
  • [DMAS-54814] - Dev: React portions of pages are blank in Oceans 2 mode
  • [DMAS-54864] - Graylog is returning non-JSON responses to UI tests
  • [DMAS-54878] - Builds on Jenkins Agent 02 fail with FileSystemException: No space left on device
  • [DMAS-54884] - dataproduct-upload task encounters IllegalBlockSizeException when run as batch task
  • [DMAS-54887] - The DOI job output has a null transactionId
  • [DMAS-54889] - Landing page spacing not working
  • [DMAS-54894] - DOI minting failed: siteDeviceId 1200433
  • [DMAS-54903] - Fix and re-enable unit tests in seaTubeSearchResultsTable
  • [DMAS-54905] - DMAS-54838 didn't get merged to master properly
  • [DMAS-54906] - Calibration service not including batchId in payload
  • [DMAS-54911] - Data Player hanging when downloading images
  • [DMAS-54922] - When positional information cant be found during DOI generation it isnt logged
  • [DMAS-54923] - Content-Type header of SensorAttributesConfigTabService is not set
  • [DMAS-54935] - SimulatorUtil can consider devices without a status to not be stopped
  • [DMAS-54937] - Unable to display DOI on landing page
  • [DMAS-54944] - Add a new automatic UI test for Seascript Management - DA.TC.1218
  • [DMAS-54945] - QA: No raw data from some devices on SOBC
  • [DMAS-54947] - QAQC flag inheritance does not work immediately after devices connected
  • [DMAS-54953] - Parser Definition is not passing batch correctly to DeviceParserDefinitionService
  • [DMAS-54959] - Too many INFO log messages in dmas.log for DataEnrichmentCacheModule
  • [DMAS-54968] - Chip selects on SeaTube Search have CSS height issues

User Story

  • [DMAS-38888] - As a deployment engineer I want to identify ways to make hosts' domain caches aware of each other, so that I don't have to wait for caches to load on startup
  • [DMAS-52444] - As ONC gets funding from CANARIE, I want to register MINTED services in a CANARIE registry
  • [DMAS-52766] - As a Oceans 2 data user I want to see information on the changes to the data represented by the DOI

Task

  • [DMAS-53293] - Add driver commands to HoloSea driver set GAIN and STROBE
  • [DMAS-54346] - Standardize requests for dataproducts from the dataviewer
  • [DMAS-54558] - Support bndtools 5.0
  • [DMAS-54577] - Update global properties for Cassandra Hosts
  • [DMAS-54763] - Loading bar for community fishers dataproducts on geospatial map does not resolve when data restricted
  • [DMAS-54768] - Include class name in UI test failure screenshots
  • [DMAS-54781] - DOI Groups and Triggers should not be directly runnable
  • [DMAS-54783] - Upgrade chromedriver to version 81
  • [DMAS-54815] - Add UI test for dataproduct icons within datasearch
  • [DMAS-54848] - Check on (and adjust if needed) spectrogram generation for high sample rate icListen HF hydrophone
  • [DMAS-54866] - Show batch after it is created
  • [DMAS-54868] - Fix Expedition Management failing UI test
  • [DMAS-54909] - Only create DOI task on datachange if a DOI already exists for the sitedevice
  • [DMAS-54916] - Update datasearch UI test now that QA is on master.
  • [DMAS-54957] - please modify log level from INFO to DEBUG for line 502 of DiveManager

Design

  • [DMAS-54860] - Update CM design to separate CacheManager lifecycle from cache-loading

Implementation

  • [DMAS-53771] - Use the POM is ca.uvic.onc.test.ui.test.extension.dataacquisition.deviceControl.DeviceControl
  • [DMAS-53774] - Use the POM in ca.uvic.onc.test.ui.test.core.infrastructure.agreementManagement.AgreementManagement
  • [DMAS-53775] - Use the POM better in ca.uvic.onc.test.ui.test.core.annotationmanagement.AnnotationManagement
  • [DMAS-53781] - Use the POM in ca.uvic.onc.test.ui.test.extension.eventDetection.eventMaintenance.EventDetection
  • [DMAS-53801] - Use the POM better in ca.uvic.onc.test.ui.test.extension.seatube.expeditionManagement.ExpeditionManagement
  • [DMAS-53837] - Change loading sequence of generated images
  • [DMAS-53886] - Add web service automation tests
  • [DMAS-53939] - Create an organization details panel
  • [DMAS-54083] - Update tests for creating a DOI on site device maintenance page
  • [DMAS-54179] - Print the version when building/deploying Oceans 2
  • [DMAS-54180] - Print the version when deploying ONC data products
  • [DMAS-54181] - Print the version when deploying Oceans Next
  • [DMAS-54199] - Create UI test for test case DV.TC.110
  • [DMAS-54281] - Create FLAC backlog post processing job to generate FLAC from WAV files
  • [DMAS-54341] - DataAvailability Bar for Cast DataSearch Location Searches should accurately display cast data
  • [DMAS-54453] - Add an icon for flac files in Data Search
  • [DMAS-54470] - Enable longer time range products for CODAR availability and QC MAT products
  • [DMAS-54471] - Add data availability information to QC MAT files
  • [DMAS-54542] - Create Java post process job for FLAC back generation
  • [DMAS-54660] - display DOI provenance information on the front end
  • [DMAS-54786] - Create UI tests for the new details panels
  • [DMAS-54791] - Add runnable flag to tasktypes and batch groups
  • [DMAS-54793] - Hide run button from non-runnable tasktypes and groups
  • [DMAS-54802] - Add file comparator to Wav to Flac matlab job
  • [DMAS-54811] - Add device listing link to dataset service
  • [DMAS-54812] - Add device listing link to landing page
  • [DMAS-54817] - add logic to decide if a task can added to a batch
  • [DMAS-54818] - When a task is queued it should update all of its parents status to running
  • [DMAS-54850] - Return provenance information of all versions of a DOI in DOIDatasetService
  • [DMAS-54855] - Don't use EhcacheProvider both for maintaining the CacheManager and for loading caches
  • [DMAS-54872] - Task Information back end implementation
  • [DMAS-54873] - Task Information front end implementation
  • [DMAS-54896] - Create a node details panel
  • [DMAS-54898] - Exract database-connection methods of CacheLoader to a separate class
  • [DMAS-54924] - When automatically creating DOI tasks for a batch after a data change default to using the taskDefinition parameters
  • [DMAS-54930] - Dont allow a task to be cancelled if any of its children have finished
  • [DMAS-54958] - Log the ID of the device that causes NPEs in DeviceManager

Test

  • [DMAS-54304] - Add search automation test cases for FLAC data products
  • [DMAS-54452] - update unit tests checking if geolocation is null

Bug (ST)

  • [DMAS-53369] - Fix Broken Tests in Plotting Utility
  • [DMAS-54329] - Community fisher location search is returning data from other locations.
  • [DMAS-54780] - Content-Type Header not set in DeviceSyncService
  • [DMAS-54891] - QA deployment failed
  • [DMAS-54897] - Version notification failed in deployment
  • [DMAS-54941] - Fix broken tests in SensorAttributes

April 30, 2020

Minor release: driver bug fix.

Tickets Released: Oceans 2.0: 20.03.010 (accessible to internal users only). Total: 1.

Expand

Bug

April 29, 2020

Minor release: bug fixes for MINTED project and device listing.

...

  • CODAR data availability data products are available for Combiner/Total stations (Radial stations coming soon)
  • Monthly complex Data Preview for CODAR currents, availability and hydrophone LTSAs and SPD are now available
  • FLAC audio data products now available for all hydrophones, plus post-processors will generate and archive for fast retrieval
  • Bug fixes: hydrophone LTSA collation, ASL AWCP complex parser and zero-sized products

Automated Testing and Continuous Deployment

  • Bug fixes (many) to improve automated test results

...

  • Bug fixes: device synchronization

Community Fishers

  • Bug fixes

MINTED - CANARIE

...

  • Improved option menu for ADCP and hydrophones
  • Data player now integrated in to Oceans 2.0
  • Implementation in-progress: infrastructure, bug fixes, speed improvements, etc

Automated Testing and Continuous Deployment

  • Significant improvements to all UI automated testing (coverage, tools, reliability, results)
  • Continuous deployment: process improvements
  • Automated DAF testing improvements
  • Distributed cache (in-progress)
  • Automated release notes (investigation)

...

  • Completed ability to add data ratings for sensors (products and services do not use them yet)
  • Scalardata webservice performance improvements
  • Task and user management bug fixes for permissions and security
  • Various other bug fixes (rawdata service, etc)

Community Fishers

  • Integration with Data Search and Plotting Utility for cast-delineated data
  • Bug fixes (depth sensor derivation, etc), testing and support for training

...

  • Data acquisition bottleneck detection and reaction: design and start of implementation for a system of automated quarantine of problematic / late data
  • Sandbox improvements: improvements to support user's code, more usability and reliability issues
  • Improvements the Community Fishers / Citizen Scientist data acquisition Android App: support for training and testing with bug fixes/adjustments

Community Fishers

  • Integration with Data Search (in-progress)
  • Bug fixes, testing and support for training
  • Improvements to cast detection metadata handling (latitude, longitude, depth)

...

  • Adding options for ADCP display
  • Hydrophone and ADCP display and infrastructure in-progress

Automated Testing and Continuous Deployment

  • Automated UI testing: continuing work on test cases and reliability
  • Continuous deployment: process improvements
  • Bug fixes and features to support testing and deployment of on ship systems
  • Improvements to live DAF testing
  • Automated release notes (investigation)

...

  • AIS parsing: design (in-progress)

  • Data acquisition bottleneck detection and reaction: investigation, design (in-progress)
  • Sandbox improvements: improvements to support user's code, more usability and reliability issues
  • Improvements the Community Fishers / Citizen Scientist data acquisition Android App: reconnect/retry data transfer, fix some bluetooth/wifi issues

Community Fishers

  • Integration with Data Search (in-progress)
  • Refactor plot generation
  • Bug fixes and testing

...