Versions Compared

Old Version 828

changes.mady.by.user Ben Biffard

Saved on

compared with

New Version 829

changes.mady.by.user Ben Biffard

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

The information below is written in plain language as much as possible. Detailed release notes are available on internal confluence pages (requires login).

Anchor
20190305
20190305

March 5, 2019

Major release.

Instruments

  • Declarative parsers: mitigating test cases, adding documentation

  • Community Fishers Android app: working on USB driver
  • Community Fishers data products and portal project: data model design, workflow design
  • STRAW (test neutrino detection project) virtual machine integration and driver
  • Driver and parser fixes in support of upcoming field maintenance: mini-junction box and more
  • Bug fixes for parsers found by improved reprocessing automated testing

Web Presence

  • Data Search "V2" released: Geospatial search and Data Search UI improvements final user testing, improvements
  • Two conference sites, including a new simpler submission system

Automated Testing

  • Improvements for reprocessing/data acquisition framework (DAF) automated testing

  • Progress on automating manual DAF testing

Maintenance

  • Various bug fixes
  • Progress on improving archiving time
  • Progress on metrics and event detection/reaction

Data Products

  • State of Ocean product updates
  • Various bug fixes

Earthquake Early Warning

  • Data from PNSN (Pacific NorthWest Seismic Network) is on online and contributing
  • Documentation

SeaTubeV3 - CANARIE

  • Design for mobile and desktop SeaTube

Dashboards - CANARIE

  • Mock-ups to stakeholders
  • Building widget components

MINTED - CANARIE

  • Requisition DOI's for siteDevices

Tickets Released: Oceans 2.0: https://jira.oceannetworks.ca/projects/DMAS/versions/11764 (accessible to internal users only). Total: 54.

Anchor
20190207
20190207

February 7, 2019

Major release.

Instruments

  • Declarative parsers nearly done, mitigating test cases, adding documentation

  • Updates to Community Fishers Android app (bug fixes), working on RBR driver and parser
  • Community Fishers data products and portal project: requirements complete, working on design

Web Presence

  • Geospatial search and Data Search UI improvements final round of testing
  • Conference websites

Automated Testing

  • Improvements Data Search automation system

  • Data Search automation coverage increased to > 90%, project complete.
  • Progress on reprocessing automated testing, automated data acquisition framework testing

Maintenance

  • Good progress (10 tickets): improvements to back-end, particularly sites cache
  • Progress on event monitoring and metrics for data acquisition framework

Data Products

  • State of Ocean data products updated to include pressure data and have consistent gap filling
  • SIDSSE Underwater Ultraviolet Raman Spectrometer (UURS) data products released

Earthquake Early Warning

  • Integration of PNSN (Pacific NorthWest Seismic Network) data ready to switch on

SeaTubeV3 - CANARIE

  • Requirements complete, designs in progress
  • Building page components

Dashboards - CANARIE

  • Progress on new front-end technologies and tools (liferay)
  • Requirements and mock-ups with user feedback

MINTED - CANARIE

  • Investigation and requirements (no features)
  • Workflows investigated

Tickets Released: Oceans 2.0: https://jira.oceannetworks.ca/projects/DMAS/versions/11764 (accessible to internal users only). Total: 134.

Anchor
20190108
20190108

January 8,

...

2019

Major release. Smaller than usual due to holiday break.

Instruments

  • Moved more parsers from java into declarative parsers, added more unit tests.

  • Updates to sensor load system that handles variations within devicetypes for the declarative parsers.
  • Adding declarative parsers to Community Fishers App
  • Community Fishers fata data products and portal project initiation

...

  • Geospatial search and Data Search UI improvements (not yet publicly available)

Automated Testing

  • Improvements Data Search automation system

  • Added test cases to Data Search automation (increased coverage metric from 40% to 58%, remaining cases are simple file products and scalar data products (tested elsewhere))

Automated Testing

  • Add more metrics to Graphana, add configurations and work on reactions

Maintenance

  • Various bug fixes, including but not limited to:
  • Cache improvements
  • Add more data acquisition metrics to Grafana, add configurations and work on reactions

Data Products

  • HydroCal software updated with new metadata fields (serial numbers), handling biased wav data, saturation detection, calibration m-file metadata improved, calibration m-files now produced by default.

Earthquake Early Warning

  • Progress on integration of PNSN (Pacific NorthWest Seismic Network) data

SeaTubeV3 - CANARIE

  • Investigation of new technologies and requirements (no features)
  • Building page components

Dashboards - CANARIE

  • Investigation of new technologies and requirements (no features)

MINTED - CANARIE

  • Investigation and requirements (no features)

...

Major release. Released a major revision for the Community Fishers App.

Instruments

  • Moved more parsers from java into declarative parsers: 26 more, all but 5 remaining.

  • Added modify by to parser history

  • Released the Community Fishers App to support community-based CTD casts. Major functionality added to support AML CTDs. Additional features to more easily manage and swap devices, online updates, add bluetooth support, improved wifi support, added manual GPS entry.

...

  • Various bug fixes, including but not limited to: 
  • Allow sensorCategoryCode to be case insensitive
  • Improved cache loading times for ferries
  • Task management parameter modification

Data Products

  • State of Ocean data products are gap filled, handle cases where deployments occur within a resample time period
  • State of Ocean plot maintenance for VENUS cruise
  • Added option to plot both PLAN0 and PLAN1 data for Nortek Signature ADCPs, added both plots to Data Preview
  • Added option for a correlation screen for Nortek Signature ADCPs
  • Added a fail over for matlab webservice calls
  • Added chunking in matlab QAQC result retrieve to prevent running out of memory
  • Allow ice buoy data products to access all sensors
  • Fixed bugs: water column data products, ADCP edge case of one record, handle inconsistent creation and deployment bad dates

Earthquake Early Warning

  • Made deployments faster
  • Used October 22 earthquake events as test cases and made associated improvements

SeaTubeV3 - CANARIE

  • Investigation, various bug fixes, requirements and planning (no features)
  • Map scale in SeaTube
  • Export annotations by dive

Dashboards - CANARIE

  • Investigation and requirements: user interviews (no features)

MINTED - CANARIE

  • Project start up (no features)

...

November 5, 2018

Major release.

Instruments

  • Moved more parsers from java into declarative parsers: 38 devicetypes

  • Continuing progress on the Community Fishers App to support community-based CTD casts.

  • Added ability to view previous parser versions

...

  • Various bug fixes, including but not limited to:
  • Added modification history to ERDDAP dataset maintenance
  • Added sensorCategoryCode to scalardata service so that users can access a specific sensor's data more easily
  • Improved display of drifters in Data Search map, improved performance, fixed icon sizes

Data Products

  • Live Raw Data / Log files now available through Data Search
  • SIMBA / ice buoy plots to plot by sensor number by default, with new option to plot by sensor elevation
  • Added feedback to users when they're plotting too much data in ferry plots

Earthquake Early Warning

  • Data acquisition support for RBR tilt meters
  • Updated CAP message to meet standard
  • CAP messages available via ftp server

SeaTubeV3 - CANARIE

  • Investigation, various bug fixes, requirements and planning
  • Added sorting by organization to SeaTube search tree.
  • Added hover over to provide more information

Dashboards - CANARIE

  • Investigation, requirements and planning (no features)

...

Major release, branched as normal on September 30th, deployment delayed due to inshore maintenance expedition.

Instruments

  • Moved more parsers from java into declarative parsers.

  • Improved declarative parser UI, including history. Parsers can now be easily updated in real-time from the device details pages.

  • Good progress on the Community Fishers App to support community-based CTD casts.

...

  • Various bug fixes, including but not limited to: jwPlayer license fix, google maps API fix.
  • Completed switch to https. Can now add features like JIRA service desk. 
  • Rinko parser update in real-time.
  • Improved Data Search display of drifters and improved loading time.

Data Products

  • HydroCal software delivered to client on September 5th.
  • HydroCal bug fixes and client acceptance feedback fixes (still included in the first release). 
  • State of Ocean plot maintenance

Earthquake Early Warning

  • Testing, bug fixes, support for field deployments. Correlator/associator deployed live. 
  • Automated testing improvements

SeaTubeV3 - CANARIE

  • Investigation, various bug fixes, requirements and planning (no features)

Dashboards - CANARIE

  • Investigation, requirements and planning (no features)

...

September 4, 2018

Major release. 

Instruments

  • Created two new parsers and drivers for both Pro-Oceanus Gas Tension device and SBE 39 device for Queen of Alberni.

  • Moved parser definitions into the database and added a parser definition tab to device listings page for viewing and editing parser definitions from the UI.

  • Updated the Watchman500 and Folger Pinnacle mini-jb parsers to support recent changes.

  • Fixed a bug with SubC cameras and their laser not working correctly; other bug fixes.

...

  • Various bug fixes.
  • Separate Data Preview searches into a new queue for better control and higher priority for user searches.
  • Removed filedownloadservice and several SOAP services.

Data Products

Earthquake Early Warning

  • Completed additions to the associator / correlator event detection, such as using maximum peak displacement for magnitude estimates.
  • Improvements to Kalman Filter.
  • Work on the iPhone App - new protocol

...

August 8, 2018

Major release. 

Instruments

  • Archive Gascoyne Bay data directly for improved performance
  • New commands added to SeaScript (device command language) to clear and flush device memory and gather statistics
  • Bug fixes

...

  • Various bug fixes.
  • New user interface for data attributions
  • Improve data attributions to remove the citation fields and simplify

Data Products

  • Improvements to daily spectrograms
  • Progress on HydroCal, stand-alone software for ONC's hydrophone calibration system
  • Bug fixes

Earthquake Early Warning

  • Added client software test message sending on a schedule
  • Added the backup datacenter that will receive all data and be able to replace the primary in few seconds or less if the primary fails.
  • Fixes to automated tests

...

Major release. First release using GIT.

Instruments

  • Updated Data Search page to support multiple map providers.
  • Finished and tested drivers and parsers for the four devices related to the SIDSSE project.
  • Finished and tested drivers and parsers for both POCAM’s, SDOM’s, and Mini Junction Boxes  for the STRAW project.
  • Further updates to parsers for Wally devices.
  • Added photo download support for SubC cameras.
  • Finished and tested drivers & parsers for DBoxes.
  • Updates to Loki driver and parser.

...

  • Various bug fixes.
  • Fixed bug in the CORK parser.
  • Rolled out first iteration of Data Search clustering for Drifter icons.

Data Products

  • Fixed a bug that affected some cases of RDI ADCP bin-mapping, causing an error in values when compared to winADCP of about 0.3% overall on average.
  • Re-write of seismometer data products to handle new seismometer metadata and configurations.
  • New daily collated spectrograms for hydrophones. These new plots were also added to Data Preview.
  • Additional bug fixes.

Earthquake Early Warning

  • Added functionality for EEW machines to reload and update the caches over activeMQ. 
  • Added a web service to allow beta testers to generate CAP messages and verify that their software correctly receives and reacts to a cap message.
  • Driver and parser for RBR tiltmeters.

...

June 6, 2018

Major release.

Instruments

  • DAF testing, driver and parser development and support for upcoming cruises, in particular, support for new devices for the STRAW project and new installations at Endeavour

...

Maintenance

  • Various bug fixes

Data Products

Earthquake Early Warning

  • Improvements to correlator queue

...

Major release, several new features and official releases.

Instruments

  • Drivers for POCAM Camera, Mk. 5 + 6 (STRAW project)
  • Updated Camera Controls
  • BPR wakes more reliably
  • PVCS (ferry value control system) and QAQC changes (quality assurance quality control flagging)

...

  • Various bug fixes
  • Instrument report page (for data stewardship team, but could be made accessible)

Data Products

Earthquake Early Warning

  • Progress on epicentre and magnitude 'correlator', notification and message routing architecture
  • Added a new calibration feature: external device triggering
  • Can now send a serialized cache over ActiveMQ to remote stations (allows easier deployments and updates to remote stations)

...

Larger-than-normal release in preparation for several official releases and demonstrations of significant projects in the next month or so.

Instruments

  • Parsing data from two additional Placentia Bay Buoys for Memorial University

...

  • Various bug fixes
  • SeaTube, Digital Fishers and the live Cameras pages now support html5 playback - this is a big improvement for mobile devices and browsers like Chrome.
  • Frame grab improvements in SeaTube, including not having to log in. 

Data Products

  • Drifter data products: new track plot data products are available to support DFO drifters. Formats include PNG/PDF, and animated GIF and a Google Earth KML file.

Earthquake Early Warning

  • Progress on epicentre and magnitude 'correlator', notification and message routing architecture
  • Updates to calculated values for magnitude estimation for the updated 'correlator' event detection
  • Completion of the routing slip infrastructure. The routing slip allows data processing on shorestations to be dynamic and go to go across multiple machines. In the case of EEW it allows us to send data from one shorestation to a second central shorestation for event detection.

...

Normal release. Ramping up towards completing several large projects.

Instruments

  • Parsing data for the Red Island Shoal Buoy at Memorial University
  • DFO Drifter jobs implemented (transfer, archiving, parsing data, plus cloning to generate new drifter devices)
  • DFO Drifter parser and QAQC

...

  • Data Preview now uses https for embedded images (plots)
  • State of Oceans / Environment plots will now always have yearly ticks
  • Water column data products in final review and automated testing phase

Earthquake Early Warning

  • Progress on epicentre and magnitude 'correlater', notification and message routing architecture
  • Automated testing improvements, reliability

...

Normal release, now using the fix version feature in JIRA (all released tickets will now be linked below).

Instruments

  • Support ASCII for CORK devices

  • Add BPR data import as a scheduled job

  • Data acquisition for Memorial University Buoys and DFO drifters (in progress)

  • Filtering out bad data (QAQC) for some ferry instruments when vessel is in port and/or pump flow is reduced

...

  • Improvements to data access restrictions and attribution
  • Links added to State of Oceans / Environment plots in Data Preview: users can get the data and file behind these plots
  • fileSize reporting for API
  • Water column data product preparation (PropertyCode now appears in MAT files, more features to come)

Earthquake Early Warning

  • Progress on EEW heartbeats, notification architecture, iPhone app
  • Automated testing improvements, reliability

...

This was a smaller-than-normal release, due to the holiday break.

Instruments

  • Underwater Listening Station (ULS) parser for V2 AMAR hydrophones

  • Improvements to the Pump Control and Valve System (PVCS) for the ferries

  • Filtering out bad data (QAQC) for some ferry instruments when vessel is in port and/or pump flow is reduced

...

  • Improvements to data access restrictions (applies to both API and front-end apps like Data Search)
  • Updates and bug fixes for State of Ocean plots
  • Bug fixes for seismometer, video QAQC (corrects for time index mis-match ..finally!), ODV with many deployments
  • Bug fixed by adding a new feature for spectrograms: an audio data only option

Earthquake Early Warning

  • Reduced the size/bandwidth of remote station data traffic
  • Improved reliability and maintainability of remote stations
  • Improve infrastructure to better support notifications (in progress)

...