You are viewing an old version of this page. View the current version.

Compare with Current View Page History

« Previous Version 370 Next »

  • Release Notes

Detailed release notes are available on internal wiki.

Release notes summaries on this page:

2011 Release Notes

2010 Release Notes

Unknown macro: {add-page}

2010


12 September 2013

Improvements:

  • The problem with not being able to switch networks or select other sub menus with Internet Explorer 10 has been resolved.
  • Device Workflow now supports multiple versions of Processes and Phases.
  • Added additional data product types for Kistler accelerometer.
  • Changes made to the database to support data from mobile devices such as from instruments located on ferries and the BPS (Buoy Profile System).
  • Plotting Utility:
    • Added titles above functional areas to make it easier to use. Eg. "Refresh Plot(s)", "Time Range History", etc.
    • When you first open the Plotting Utility page, a graphic will now appear with basic instructions on how to use this tool.
    • Added a "Hints" link above each plot which will open a pop-up with suggestions on how to use some of the less obvious features.
    • Added more information in the legend, including type of plot (min/max, line, etc), and whether the data had to be downsampled or not in order to fit into the plot area. Also added links to Device Details and documentation (similar to Data Search).
  • Data Search:
    • Added automatic resampling to Min/Max plots. Ie. in addition to a choice of fixed resample rates (when there is too much data plot all of it), you can now choose "automatic" which will attempt to pick the optimum resample rate.
    • There is now potentially a different QA/QC flag for the minimum and maximum values of Min/Max plots. 

22 August 2013

Known Issues:

If you are using Internet Explorer 10 and you switch to another network (eg. you go from NEPTUNE to Arctic), you may have difficulty switching back to NEPTUNE again. We are working on a fix. In the meantime you have two options:

  • click where the list of networks SHOULD be. Even though the list does not appear, it's still functional.
  • Use Internet Explorer 9, Firefox, or Chrome.

Improvements:

  •  Data Products in Data Search:
    • Several improvements to the way Min/Max time series scalar plots are displayed, including adding a Min/Max+Avg option, and an option to allow the system to automatically down-sample the data by the most appropriate amount.
    • All barometric pressure sensor values will now be displayed in hPa units.
    • New data products (and drivers) for new instruments being installed soon in Cambridge Bay (Arctic). The instruments will include:
      • an AIS receiver (Automatic Identification System for tracking ship movements), 
      • A VEMCO receiver for tracking tagged fish
      • A Vaisala barometer
      • A new Lufft meteorological station
      • A hydrophone
  • Plotting Utility:
    • Added an "All Available" date range, similar to Data Search. This is now the default date range when a sensor is first selected.
    • Moved the legend under the plots to allow room for more details, including links to Data Search, Device Details, and documentation on that instrument.
    • Sensors that do not have any data to contribute to the plot with the currently selected date range will no longer be listed.
    • When zooming in, you can now select the Y axis range as well as the X axis range. You can return to auto-scaling the Y axis by double-clicking on the plot.
    • The vertical size of the plot (not the Y axis range but the actual height of the plot on the screen) is adjustable. Just select the drag bar that appears below each plot and drag it up or down. Note that if you save the plot, it will always be saved at the default height.
    • "Staircase" has been added to the plot properties option list.
    • When sensors from different instruments are used in the same plot, the sensors and their data values are now listed in the Plotted Values table in chronological order. For example if sensor A's data is plotted for the first month, then that sensor is swapped for sensor B and data for sensor B is plotted for the second month, sensor A's data will always be listed before sensor B's data in the Plotted Values table (it used to be random).
  • Device Workflow - it is now possible to assign more than one type of process to the same device. In Device Details in the Workflow tab there is now a dropdown list that lets you select the process you want to see the details for.
  • A parser was written for the SCIMPI borehole measurement instrument.
  • RAS water sampler driver was changed  to accommodate new plumbing.

25 July 2013

Known Issues:

If you are using Internet Explorer 10, in some cases you will not be able to expand the list of locations or instruments in Data Search or in Plotting Utility. If you are having this problem you can fix it as follows:

  • Click on the gear wheel at the top right of your browser.
  • Select Internet Options
  • Select the Advanced tab
  • Near the top of the list under Accelerated graphic, check the box "Use software rendering instead of GPU rendering"
  • Restart your computer
  • Here is a Microsoft article that describes this problem: http://support.microsoft.com/kb/2528233

Improvements:

  • Data Search:
    • Added 10 and 15 minute average options.
    • All combinations of raw/clean and NaN/no-NaN are now supported for the CSV and MAT data products. "Clean" means data deemed by the QA/QC tests to be not valid will be removed from the data product and will either be missing or replaced by NaNs (Not a Number).
    • The Data Search Help page has been modified to describe how to use the new data product options feature.
    • The metadata report that comes with most data products now states which options you chose (NaN, clean or raw, resampling), in the Lineage section 
  • Plotting Utility
    • Plotted Values popup:
      • Added a disclaimer about the data, plus a link to the same device in Data Search where you can obtain the scientific data.
      • Added a row to identify the fields in the table (Time, Min, Max, Avg, etc)
      • Removed the list of possible averaging time periods and replaced it with either "Down-Sampled Data" or "All Data (not down-sampled)", depending on whether the date range was small enough to display all data points without averaging.
      • When the display type is "MinMax" (but not if it's MinMax+Avg), the table also shows the difference between the min and max values for each point.
    • Also added a link to Data Search beside the legend and in the legend.
    • If the plot includes data from more than one instrument at different times, each instrument will be plotted in a different colour. This can only happen if you sort by location.
    • In recent releases Plotting Utility was only plotting data if at least 70% of the samples in each averaging bin passed quality control. Starting with this release Plotting Utility will again show all data regardless of quality control. In the future this feature will return along with the ability to set the threshold yourself.
    • When creating a new plot where there is no data, instead of nothing appearing, you will now see an X and Y axis. This should make it more clear that things are working correctly but you have selected a date range where there is no data.
    • Improved the way the Y axis is auto-scaled so it's re-evaluated every time the date range changes.
  •  Added the ability to sort by date and time in the Dive Listing and Dive Log tables.
  • Added a zoom function for the Tempo-mini camera at Endeavour.

4 July 2013

Improvements:

  • Data Search – a new data product options selection form appears when you select a data product. 
    • Make the sections you want, then Add to Cart. If you want more than one item in your cart before you process them, it is not necessary to press Add to Cart one at a time, just at the very end. 
    • If you have more than one item checked, the options form applies to the check box highlighted in green.
    • The data product options are different for different types of data products. For instance PNG plots has different options than CSV.
    • "CSV NaN" option has been removed because now you can select CSV and then select "NaN" in the options form.
    • "QA/QC" (data quality) has now been enabled in some of the data products. These data products allow you to choose between "clean" and "raw". 
      • "Clean" means data that is deemed to be bad according to the QA/QC tests will be removed from the data product. It will either be removed entirely or replaced by NaNs (Not a Number) according to your selection. 
      • "Raw" means all data will be reported; if the QA/QC tests believe it's bad or suspect data, an appropriate flag number will be put beside that record. In the case of plots, coloured flags will be put beside the bad data (one flag for each group of bad data, not one flag per data point) and the suspect data points will be red or yellow.
    • For MAT and CSV, all data will be "raw" at this time, except for averaged data, which is always "clean". Raw and clean options will be enabled in a future release.
    • The "clean/raw" option is available for all the Data Search plots (PNG, PDF, staircase, profile, etc).
    • For more details see the link at the top of the appropriate data product checkbox. Eg. Time Series Scalar Data or Time Series Scalar Plot
  • Plotting Utility:
    • The High/Low display option has been renamed "MinMax".
    • A new "MinMax+Avg" option has been added. This is now the default for all new plots (but not for saved plots). As usual, the display type can be changed using the Plot Properties feature.
  • LISST driver changed to support bioblock.
  • RBR Virtuoso parser change.
  • Improved ADCP driver when slaved to Biosonics devices.
  • Newer mechanism for ZAP/ADCP driver synchronization.
  • Junction box labels replace breaker #s in JB View, JB Alarms, Quickplots, and Plotting Utility.
  • A serial number attribute was created for sensors.
  • JB View has been removed from the global menu (must access from Device Console).
  • The Device Console diagram is network agnostic. Ie. it doesn't care whether the devices are in the NEPTUNE, VENUS, or Arctic observatories.
  • The devices in the Device Console / Junction Box tab are now ordered by junction box number.
  • Added a WAV file data product for the Ocean Sonics icListen LF hydrophone.
  • Enabled data products for the Sony Outreach camera at Folger Pinnacle.
  • Better support for data products for devices that do not produce data on a regular basis, such as camera pan and tilt controls and lights.
  • Added "EC -Speed of Sound" as a device attribute for RDI ADCPs.
  • Added additional configuration commands to the ADCP driver.
  • Added a driver for the RBR Global BPR.
  • Added additional features to SWEP - Sensor Web Enablement Platform.


18 June 2013 (minor release)

ONC Improvements:

  • Implemented the initial stages of SWEP - Sensor Web Enablement Platform. This will eventually allow users to query scalar data following the Sensor Web Enablement family of standards promoted by the Open Geospatial Consortium. The initial step was to develop the Sensor Observation Service (SOS). This release is only to verify standard compliance.

NEPTUNE Improvements:

  • In Device Console, in the Junction Box tab, the J numbers now map correctly to breaker numbers.
  • For the Tempo Mini instrument at Endeavour, the configuration was updated to handle the new lights.
  • Added a lights driver for the Sony camera at Folger Pinnacle.
  • Added extra configuration commands to the RDI ADCP driver.
  • Added "EC - Speed of Sound" device attribute to RDI ADCPs.
  • Wrote a parser for RBR BPRs.

6 June 2013

NEPTUNE Improvements:

  • The Cancel button has been removed from the Reprocess Console.
  • Barkley Canyon MidEast POD3 has been renamed Barkley Canyon MidWest POD3. MidWest POD4 has been renamed to MidEast POD4.
  • Changed the QA/QC (data quality) threshold for averaged data from 80% to 70%. Ie. if less than 70% of the records for a given averaging "bin" (one minute, one hour, or one day) passed quality control, none of the data in that bin would be used.
  • Improved how VPS (Vertical Profile System) "cast" data products are computed in order to use resources more efficiently.
  • Added the ability to search and download certain information for the new Sony camera at Folger Pinnacle using Data Search, such as MP4 video, log file, and plots showing when the pan and tilt controls and the lights have been operated.
  • Added QA/QC (data quality) flags to the following Data Search data products:
    • plots for the Bore Hole temperature probes
    • CSV data product for the VPS
    • plots for the A.G.O temperature probes
    • scalar profile plots for instruments on the VPS

16 May 2013

NEPTUNE Improvements:

  • Added QA/QC (data quality) to more of the data products, such as VPS casts, and adding QA/QC flags to data search plots.  
  • Added a "count" column to CSV and MAT data products to show how many "good" samples were available for each of the resample bins, based on quality control ("QA/QC") tests.
  • Metadata report now matches data products in terms of dates data are available (contents and filename).
  • Added thirtysecond-engineering-summary scheduled job
  • Modified Kongsberg sonar driver to support master/slave mode.
  • Added pan and tilt support for new cameras being deployed soon.
  • Whenever a calibration formula is created, changed, or deleted, added a warning that the data must be reprocessed for the changes to take effect.
  • Now allow a calibration formula to to be updated as long as it has a different starting date (DateFrom) from all other formulas for that sensor. Also allow a formula to be deleted.
  • The new Sample Size field in Device Details can now be edited. This field will eventually be used to better handle instruments that send data in bursts rather than evenly spaced data, such as some of the sonars.
  • Device Console now shows all instruments from all networks at the same time without needing to change networks.
  • Some back-end work done to support QA/QC (quality control) in data products. You will soon (in a future release) be able to select whether you want your data products to contain raw or cleaned data based on quality control information.
  • Plotting Utility now leaves gaps in line plots where there is no data. Previously the gaps had been bridged with a straight line.
  • Added support for dive videos taken by Ocean Explorer ROV.

VENUS or ONC Improvements:

  • Added support for Kistler accelerometer
  • MacArtney Winch - added Command and Control Functionality. 
  • BPS (Buoy Profile System) - Added MacArtney Winch to Driver Schedule.
  • Wrote AML CTD driver and parser
  • Wrote new driver for daisy-chain Imagenex devices.
  • Wrote driver and parser for Honeywell HMR-3300 orientation sensor.
  • Wrote driver and parser for Omegabus thermistor chain.
  • Added WAV and PNG data product options for the IC Listen hydrophone
  • Added monthly scatter plots for ferry data.

18 April 2013

NEPTUNE Improvements:

  • Implemented "QAQC" in scalar data products. Data will start to be analyzed for invalid values and flagged. It will take some time before all instrument data is being analyzed, but the infrastructure is now in place to support it.
  • Data can be analyzed "manually" (by hand) or automatically by software.
  • Automatic tests include (not an exhaustive list) out of range tests, spike tests, high gradient tests, and stuck value tests.
  • Scalar data products (CSV, MAT, PNG, PDF) now show a QAQC flag for each record. CSV and MAT list the flag value, ranging from 0 to 9.PNG and PDF plots highlight potentially invalid data with yellow or red colours, and with a yellow or red flag in the center of each group of flagged data.
  • Flag values: 0 means no analysis has been done, 1 means good data, 2 - probably good, 3 - use with caution, 4 - bad data, 7 - averaged data, 8 - interpolated value, 9 - data gap. See here for more details: http://venus.uvic.ca/2011/05/qaqc-for-venus-scalar-data/&nbsp
  • In a later release the user will have the ability to select "clean" or "raw" data in their data products. For now all non-resampled data is "raw", meaning that invalid data is still present but is flagged. All resampled data is "clean", meaning that invalid data has been removed; for the CSV NaN option it will be replaced with "NaN" (not a number); for the other options it will be removed entirely.
  • In the case of averaged data, if less than 80% of the expected data values for a given averaging point are not present (either due to data gaps or failing a QAQC test), that averaged point is treated as a failed QAQC data point.
  • Data Search - "sort by Instrument" now has an additional choice level. Besides selecting an instrument you now also have to select where that instrument was deployed. Note that "MTC" means Marine Technology Center, our on-shore testing labs (which in some cases have data). The data availability graph will only show data obtained from the selected deployed site. Regardless of the data range you select, the data products will only contain data from your selected site. If you want to see data from a given site regardless of which instrument was deployed, use "sort by Location".
  • Plotting Utility - has the same "sort by Instrument" changes mentioned above.
  • Data Search - the "min/max" resampling option has been temporarily removed. It will return in a future release but only for certain data products.
  • Improvements were made to the internal "Device Workflow" tool.
  • Modified SensorDataService, DeviceAttributeService
  • Added more information in search failure e-mails if an Instrument search.
  • Improved the performance of Data Search for generating matlab scalar data products by up to 3X.
  • Modified the Nortek data products to detect velocity-phase wrapping.
  • In CSV files that reference data from more than one instrument (such as on the VPS), it is made more clear which sensors are external to the main instrument.

VENUS Improvements:

  • Added TEOS calculated variables to data products.
  • Added 1, 10, 15, and 60 minute averaging options to data products.

21 March 2013\\\\">21 March 2013

General Improvements:\\">General Improvements:

  • Live camera videos linked to the NEPTUNE Canada web site can now be played on an iPad, iPhone, and BlackBerry Playbook.The same is true for the DMAS (Oceans 2.0) "Cameras" pages. This will be enhanced in future to also support SeaTube and Digital Fishers.

NEPTUNE Improvements:\\\\\\">NEPTUNE Improvements:


  • Plotting Utility legend and plot image details now also specify the location of the instrument being plotted. A title is now automatically generated as well, with the same information (you can always edit it using Plot Settings).
  • In Plotting Utility, when averaging is required in order to reduce the number of displayed points (which happens in most cases), the timestamps are now located at the center of the time bins.
  • In Data Search where "average" type resampling is selected, the timestamps are now located in the center of each time bin.
  • When doing Data Searches where the metadata reports are automatically generated, the processing time to produce the report has been significantly reduced, which also means that you will get your data products sooner. In most cases the metadata report should be ready less than one minute after the data product is ready.
  • "QAQC" has been partly implemented in order to automatically (or manually) check for incorrect data values, such as values that are out of the expected range of the instrument, or that have sudden spikes that could not have natural causes. So far the only data products that are affected are CSV and MAT Data Searches for Resampled data where the average is 1 hour or 1 day. Also affected are Plotting Utility plots where the data is averaged over 15 minute or longer periods (which can be confirmed by checking the Plotted Values table). In these cases, if one or more QAQC tests failed for one or more data samples, and if less than 80% of the samples needed to compute a single averaged point did not pass QAQC, then this point will not be used in the data product or the plot. Additional data products will use QAQC in future releases.
  • Internal users are now able to create "station" level QAQC tests.
  •  Improvements made to the experience a new user has in creating an Oceans 2.0 account, and existing users have in logging in, such as:
    • Making it more clear which fields are mandatory in order to create an account.
    • Making error messages larger and moving them to be directly above the registration form where they will be more obvious.
    • Retaining as much information as possible if you fail to register, so you only have to correct the cause of your problem (such as mismatched passwords).
    • Logging the cause of registration failures (such as mismatched passwords, invalid e-mail accounts, missing mandatory fields, etc) so that we can make further improvements if necessary.
  • Added a Workflow tool (internal users only) to help us track the workflow of new instruments from ordering to deployment and commissioning.
  • Added a hyperlink to the digitalfishers.net blog in the Digital Fishers campaign popup.
  • Data Search data products involving instruments where we have changed the rate at which they collect data have been improved. If you ask for a date range that spans a period where the sample rate ("Data Rating") changed, will now give a more accurate estimate of the number of samples expected. CSV and MAT data products will no longer create new files when the data rating changes, but will list all data ratings and the date and time these change in the file header.
  • Improved the processing time to produce a "time series scalar profile plot" data product for VPS ("Vertical Profile System") devices.
  • Added a feature for internal users to either allow QAQC results to be overwritten when doing reprocessing, or not.
  • Added drivers for AML Oceanographic CTDs

VENUS Improvements:\\">VENUS Improvements:

  • Added ASL AZFP driver
  • Added driver for Paroscientific Intelligent Digicourse pressure sensor.
  • Added support for upcoming deployment of BPS (Buoy Profiling System)
  • Added option to download oxygen sensor data in umol/L units.

Arctic Improvements:\\">Arctic Improvements:

  • Made improvements to the driver for the Cambridge Bay WETLabs Water Quality Meter



13 February 2013">13 February 2013

NEPTUNE Improvements:">NEPTUNE Improvements:

  • SeaTube - the Cruise and Location branches (on the left) now open automatically to the first level of the search tree. This should make it more clear how to select a video to be played.
  • Data Search - metadata reports are now automatically provided for non-scalar instruments (but still only available on the NEPTUNE network at this time).
  • Data Search - the dotted line on the map has now been labelled "Line P" to make it more obvious that this shows the locations (in general) of the Line P buoys. Clicking on the label brings up more details.
  • Data Search - Subsampling:
    • "Subsample Type" has been renamed "Resample Type"
    • Resample Type is now a hyperlink to a Wiki page that explains how the resampling is done.
    • The "Average" resample  type is now computed differently in some cases. For details see the Resampling Wiki page at Resampling
  • Data Search - the PNG and PDF plots now use a "heat map" method when the number of points is too large to be plotted. The heat map plot will show a distribution of points, with a darker colour where there is a higher concentration of points.
  • Data Search - now support one minute average resampling for A.G.O. temperature probe data.
  • Data Search - modified the CSV data products, when using resampling, to set the timestamps at the middle of the resample periods rather than the beginning.
  • Created an external "dataproduct" web service  to look up data products and data product formats.
    * Created the "stations" web service to look up station code and DeviceCategory.
  • Running tasks can now be cancelled (if necessary) using Task Monitor.

14 January 2013">14 January 2013

NEPTUNE Improvements:">NEPTUNE Improvements:

  • All SeaTube videos now play as soon as they are selected (previously you had to sometimes select a point further down in the dive log before the video would play).
  • SeaTube resolutions are now called Low, Medium, and High. (Low displays Satellite footage, Medium is appropriate for consumer broadband, and High requires high bandwidth connections)
  • Decimation sub-sample option was removed from Data Search until an anti-aliasing problem can be resolved.
  • Get a warning in SeaTube if flash player not installed, and a link to install it. Videos won't play without the flash player.
  • Added PDF versions of the "cast" plots for the VPS (vertical profiler system). 
  • Improved the appearance of some of the PNG plots in Data Search.
  • Added Stuck Value, Spike, and Gradient QAQC tests to prepare to implement QAQC analysis of NEPTUNE data soon. Also added an automatic e-mail feature (to NEPTUNE staff) if any QAQC test fails.


6 December 2012">6 December 2012

NEPTUNE Improvements: ">NEPTUNE Improvements: 

  •  Improved the way Plotting Utility averages data to reduce the number of data points when there are too many to plot. The data is now averaged in fixed time duration cells of 1,5,10,15,30 seconds, 1,5,10,15,30 minutes, or 1,6,12, or 24 hours, or 1 week, whichever is closest to the actual cell width. When averaging is performed, this is noted in the Plotted Values table and also in the information bubble in Plot Settings.
  • Plotting Utility now handles Location searches better, especially if multiple instruments have been deployed at the same location at different times.
  • Cancelling a running task in Data Search now stops the job from running.

VENUS Improvements:">VENUS Improvements:

  • Added drivers and parsers for MacArtney winch and RM Young meteorological station, to support the upcoming BPS (profiling system).
  • Added a BPS View page under More >> Infrastructure in order to display the readings from all sensors on the BPS at the same time. 

15 November 2012">15 November 2012

Arctic Network Improvements: ">Arctic Network Improvements: 

  • Added live cameras for Cambridge Bay.
  • Improved accuracy of ice thickness sensor calibration, as well as all weather station barometric pressure calibrations (pending reprocessing).

NEPTUNE Improvements:">NEPTUNE Improvements:

  • Added popup description panels for most instruments and locations on Data Search. 
  • Added PDF versions of time series scalar, time series scalar profile, AGO, BHT, COVIS, RDI and Nortek data products. The PDFs use vector graphics so they can be magnified without pixelization.
  • Improved appearance of all PNG data products by increasing the resolution to 300 DPI (letter-size paper) among other PNG improvements.
  • Applied human-perception based colour-maps to many data products. These colour-maps are also compatible with most forms of colour-blindness.
  • Changed the SMB file names for the Kongsberg sonar data product to indicate whether the file corresponds to a sweep or a scan.
  • New "Ocean Dynamics Falcon ROV camera" for showing diver video
  • In Annotation Search, the Modified Date column has been moved well away from the Start Date and End Date columns. This will help put focus on the dates corresponding to the data that were annotated, rather than the dates the annotation were made.
  • Renamed CSV files to include "NaN" in the filename if the NaN (Not a Number) version of the CSV data product was produced. This allows you to download both NaN and non-NaN to the same folder.

Other:">Other:

  • Deployed a new Digital Fishers campaign to map the seafloor geology at Endeavour (actually deployed before the software update, on November 5)

25 October 2012\\"> 25 October 2012

Arctic Network Improvements: ">Arctic Network Improvements: 

  • Made the ASL SWIPS ice profiler available for data searches and plots

NEPTUNE Improvements: ">NEPTUNE Improvements: 

  • Added 15 MIN AVG Matlab and netCDF data products for Nortek ADCPs.
  • Added ability to delete items from Completed Data Search carts.
  • Added ability to select several completed Data Search products and download together in a zip file including metadata.
  • Separated Imagenex .837 files into Scan and Sweep files.
  • Created first set of data products for 3D camera (raw.zip and bmp.zip ).
  • Added 3D camera post process job for generating bmp file.
  • Added Ice Profiler and data products for Cambridge Bay.
  • Added 6 new Sea-Bird SBE37SMP-ODO CTDs
  • Added Moxa driver and control page for Cambridge Bay.
  • Added driver for Pro-Oceanus Mini-Pro CO2
  • Added driver for Satlantic pH Sensor
  • Sea Tube can now display "satellite" quality videos (with text overlaid). Defaults to "low" resolution unless only satellite quality is available, in which case that is displayed instead. Satellite quality is lower than "low" quality.
  • Added admin page for new Coastbuster mobile phone application.
  • Added a dashed line to represent the ISDM Line P sensors on the Data Search map. 
  • New webservice to extract QAQC results by sensorID
  • Added "type of search" to e-mails for failed searches
  • New CSV data product for VPS (Vertical Profiler System) Casts
  • Can now use sensor values from other devices in calibration formulas.
  • Reference links for Plotting Utility will now automatically switch the receiving browser into the correct network if it isn't already. For example save a plot for the Arctic network and send its reference link to someone who usually uses Oceans 2.0 in the NEPTUNE network. When the link is pasted to the NEPTUNE browser's URL box, it will bring up the plot in the Arctic network. Note that all subsequent work in this browser will be in the Arctic network until you switch back to NEPTUNE using Tools >> Network Preference.
  • Improved e-mails that are automatically generated when searches failed. E-mail now states which sensors were selected in the search, and which ones failed. They will also make it clear whether it was a Location or an Instrument search.
  • Search failure e-mails are now sent regardless of the network used (NEPTUNE, Arctic, etc.).
  • The way subsampling can be selected in Data Search has been improved so that you can browse the subsample types without actually selecting one.
  • When selecting an instrument in Data Search using Sort by Instrument Type, all present and previous locations of that instrument are shown with pins on the map. The improvement was to colour the current location with a green pin.
  • In Data Search when sorting by Location, if you click on a yellow instrument node, the "tree" on the left that shows the locations and instruments will be expanded at the location corresponding to the node you selected.
  •  Added CTD, light sensor, Fluorometer, and oxygen sensor at Folger Pinnacle
  • Added Ocean Presence OceanCam colour video camera at Folger Pinnacle. Note that the video can be viewed during all daylight hours, although the lights are turned on each day from 0800 to 0845 and 1200 to 1245 Pacific Time (1500 to 1545 and 1700 to 1745 UTC). The videos for any previous period can be found in SeaTube under Locations >> Folger Passage.

VENUS Improvements: ">VENUS Improvements: 

  • Added metadata reports for VENUS images, video, and hydrophone recordings.
  • Oxygen data is now available in a choice of three units - micromole/L, micromole/kg, as well as the original ml/L

 02 October 2012"> 02 October 2012

NEPTUNE Improvements: ">NEPTUNE Improvements: 

  • Added metadata reports when data searches are made for audio and video data products.
  • Added a UI page under Sensor Maintenance (a child page under Device Details) where you can define the sensor calibration formula.
  • Task Monitor now shows the task history details.
  • In Data Search, the location of the pins showing where instruments have been deployed or are currently deployed is now more accurately placed. As well, the map centers more accurately when an instrument or a location is selected.
  • IT now has the ability to place a warning message on the screens of all users who are using Oceans 2.0. This may be used to warn of upcoming outages, etc.
  • SeaTube can now display "satellite" resolution in additional to low and high resolution, where available. This is usually the same as "low res" except that text is overlaid over the video indicating the exact time, position, heading, and depth. It gets updated every 5 seconds. In many cases the video will start playing as soon as the video is selected, as opposed to low and high res where you sometimes need to select a point further down in the dive log before you start to see video.
  • Scan mode was enabled for the Kongsberg and Imagenex sonars.
  • The Electrical Rating tab in Device Details now shows the "Power-on inrush current" value (may not be visible to all users yet).
  • More improvements added to the new Workflow tab added to Device Details in the last release.
  • Device documentation was added for Sea-Bird SBE 63 Dissolved Oxygen Sensor.
  • Device documentation was added for the arctic ice buoys.
  • Added support for a new Ocean Presence OceanCam camera that will be deployed at Folger later this month.
  • Improved the headings in the data availability plot linked to the metadata reports.
  • Changed the weather station rainfall rate units to mm/hr, wind speed units to km/hr, and barometric pressure to kPa, which are the standard meteorological units in Canada.
  • Added a new data product for profiling instruments, such as those on the VPS: Time Series Scalar Profile Plot.
  • Added instrument documentation for hydrophones 23112, 23113, and 1230.
  • Automatic annotations are now created when device drivers are started or stopped using Device Console.

Other Improvements:">Other Improvements:

  • A device driver was written to support the ice profiler instrument being deployed at Cambridge Bay, Nunavut.
  • The final pieces where put into place to support the new Cambridge Bay observatory, which is part of the Arctic network.

05 September 2012">05 September 2012

VENUS Improvements:">VENUS Improvements:

  • The SensorDataService web service has been improved to allow you to specify how many rows of data you want returned. The maximum is 100,000 rows per sensor.
  • Added MAT V7, raw text file, and CSV data formats for the Sequoia LISST-100x device.
  • Modified the SearchInfoService to indicate whether the device is a piggyback sensor or not.
  • Modified the type of data that is parsed into the hourlyScalarSample table, depending on the QAQCResult value.
  • CODAR data is now available from the Download Data / By Instrument page.

NEPTUNE Improvements:">NEPTUNE Improvements:

  • The videos taken during the May/June NEPTUNE maintenance cruise are now available in SeaTube in high definition format.
  • In order to make it more clear how to use the Data Search feature, the "carts" that you use to fill and process your data products have been renamed to "Open Cart", "Processing Cart", and "Completed Cart". This model should be more familiar to users.
  • We now allow driver JVM startup with no database connection. This will allow Cambridge Bay to continue to collect data even at times when the network connection to the servers at the University of Victoria is down.
  • A new "Workflow" tab was added on the Device Details page. This new feature will allow us to track the steps involved in adding a new instrument, from procurement through to commissioning. Only certain users have permission to edit the workflow.
  • In order to make it more clear for our users, the following buttons in Plotting Utility have been renamed:** "Update Plots" was changed to "Plot" since it also applies to the initial plots.** "New Session" was changed to "Clear All"** "Save Plots" was changed to "Save Plot(s)"
  • Added support for new instruments to be deployed in the September cruise, including Kongsberg rotary sonars, Ocean Sonics hydrophone, Nortek Aquadopp Profiler.

Other Improvements:">Other Improvements:

  •  A device driver was added for the new ASL Shallow Water Ice Profiler, which will soon be installed in Cambridge Bay, Nunavut, Canada.
  • Created data products for the soon-to-be-deployed Cambridge Bay observatory instruments, including WETLabs Water Quality Monitor, Davis Vantage weather station, and OceanCam camera.

02 August 2012">02 August 2012

VENUS Improvements:">VENUS Improvements:

  • Added support for RDI 300 kHz ADCP, serial 17955, to be deployed at Bottom Boundary Layer platform
  • Added driver for WetLabs FLNTUS 1042 for SoG Central
  • Changed calibration for SeaBird 63 0202
  • Added support for SeaBird 16+ CTD, serial 7128, to be deployed at Saanich Inlet
  • Changed calibration for Aanderaa Optode 1684 and 0579
  • Add new data products (animated GIF and AVI) for Imagenex devices.

NEPTUNE Improvements:">NEPTUNE Improvements:

  • The metadata report, which accompanies most scalar data search results, now has a link in the Data Quality section that will open a data completeness graph. This bar chart shows the number of data samples that were received in each 15 minute block as a percentage of the number that were expected. Drag-selecting allows you to zoom in on a selected date range.
  • The seismometer state of health data is now being archived.
  • FTP passwords are now encrypted
  • Some UI improvements were made in the Topology View page

Arctic Region Improvements:">Arctic Region Improvements:

  • Added a number of devices to the database to prepare for deployment of mini observatory at Cambridge Bay, including ASL Shallow Water Ice Profiler, and Nortek Aquadopp Current Meters and Curremt Profiler. These are not yet available in Data Search.



11 July 2012">11 July 2012

VENUS Improvements:">VENUS Improvements:

  • SeaKeeper Ferry data is now being transferred into the database.
  • Added additional data products to the Nortek Vectrino Current Meter 0463
  • Added device and sensor details for new SeaBird 69788 oxygen sensor.
  • Improved the PrimarySensor page, mainly for internal users.
  • Changed the calibration for Wetlabs FLNTU 060901 and 1325.
  • Added RDI ADCP 150 kHz 17457 as a slave to ASL ZAP 1008.
  • Added device and sensor details for Nortek Vector MicroSquid 4868.
  • Added enhancements to the SeaKeeper Ferry FTP processes.
  • Added improvements to Device Console to save an annotation when a driver is stopped or started.

NEPTUNE Improvements:">NEPTUNE Improvements:

  • If a data search fails for a reason other than no data for that date range, a ticket will be automatically generated in our Jira bug tracking database. This also applies in the Brentwood and Arctic networks.
  • Improved the frequency of processing progress reporting and the overall reliability of the data searches for scalar data. 
  • When you do a Data Search by Location, MATLAB data products no longer create separate files if a different instrument was deployed during the search period.
  • In the metadata report that accompanies data search data products, data gaps had previously been listed for every gap of greater than 15 minutes, regardless of the number of gaps or the sample period (data rating). Now the report will list only the ten largest gaps. A gap is now defined as expected data that is missing for at least one minute and at least 2 times the sample period or subsample period. So for a one second sample period the gap must exceed one minute. For a one hour sample period the gap must be at least two hours. In any case only the top 10 gaps will be reported in the metadata report (although the CSV NaN data product will show ALL gaps as NaN values).
  • A bar chart has been added to show the percentage of expected data available for a given search in 15 minute blocks; ie. to graphically show the data gaps. Only after it has been fully developed will we add a link to it from the metadata report.
  • Created a Wiki page to describe the contents of the metadata report (http://wiki.neptunecanada.ca/display/DP/Metadata).
  • Added more "VPS Cast" data products and improved existing data products for all instruments on the Vertical Profile System ("POGO"). An "up cast" is the entire period of time that the VPS is traveling towards the surface, and includes any time that it spends paused at a certain depth. It ends only when the VPS starts to go down. A "down cast" ends when the VPS is either docked at the sea floor or starts to go back up. Hysteresis has been applied so if the VPS temporarily changes direction (less than 20m cable length each time), these are not considered casts. If the date range you choose starts or ends in the middle of a cast, the data product will automatically include the entire cast.  The cast data products include .mat files, .png plots and device-specific non-scalar products such as the radiometer .raw files. The cast plots pressure (depth) versus sensor data rather sensor data versus time. Because some instruments contain many sensors, the cast data products, which are device level products, automatically use a fixed subset of interesting sensors; you cannot choose the sensors.
  • VPS cast plots are also available for Engineering data, such as cable length, cable tension, the amount of drift etc. - see the Adapter instrument.
  • VPS cast data products automatically include the pressure data from the CTD on the VPS as a reference for depth. If there are data gaps in the pressure, the cast data products will linearly interpolate the missing points up to 1.5 times the sensor sample rate.
  • Added a new feature called Task Monitor to the Tools menu. This feature lets you follow the progress of scheduled jobs, data searches, etc. It is mainly intended for NEPTUNE staff.
  • Junction boxes (JB) no longer appear in Data Search when you filter on Temperature.
  • RDI ADCP netcdf data products now include vertical velocity.
  • Added documentation for the Kongberg rotary sonar data products (http://wiki.neptunecanada.ca/display/DP/48).
  • Cleaned up the list of cameras in the Cameras menu.
  • The frequency of resetting the CO2 sensor on the VPS is now a variable that can be changed. It used to be fixed at 3 hours.
  • Recalibrated some of the sensors on Wally.
  • Fixed pan and tilt problems on new DragonFish camera at Barkley Upper Slope and started an automatic schedule for the lights.
  • Set up an automatic schedule for the plankton pump to take a sample every two weeks.

Other Improvements:">Other Improvements:

  • When you select the Brentwood College network in Data Search and sort by Location, the locations are now relevant for that network.
  • When you select the Arctic network in Data Search, the map now centers in the arctic region of Canada. A node appears at Peel Sound. When you sort by Location, the locations are now relevant for that network.
  • Data being received from ice buoys in Peel Sound (via e-mail) is now being transferred into the database as it arrives and may be seen using Plotting Utility. Two types of e-mail format are supported. 

20 June 2012">20 June 2012

VENUS Improvements:">VENUS Improvements:

  • Added the ability to upload meteorological, ocean, and navigation data from instruments located on British Columbia ferries into the VENUS database.
  • Developed a visualization tool for monitoring the ferry data.

Arctic Improvements:">Arctic Improvements:

  • Added infrastructure for the new Arctic network to allow data from ice buoys in Peel Sound, Nunavut (northern Canada) to be ingested into the NEPTUNE database. Data is sent via e-mail over satellite automatically.

NEPTUNE Improvements:">NEPTUNE Improvements:

  • Added an SMB data product for the Kongsberg rotary sonars (in Data Search).
  • Added a new data product for Radiometers on the VPS (vertical profiler system).
  • Improvements made to Task Monitor, which is now available on the Tools menu.
  • Added new DragonFish camera which has been deployed at Barkley Canyon.

24 May 2012">24 May 2012

GENERAL:">GENERAL:

  • Added new Arctic network. See Tools -> Network Preference. Note that not all web pages have fully implemented this new network yet.
  • Created a series of web pages for the public to monitor the upcoming maintenance cruise. See www.neptunecanada.ca. These pages are also compatible with the Apple (TM) iPad.

VENUS:">VENUS:

  • Added web pages for internal VENUS users to create and modify QA/QC tests.
  • Added support for new instruments collecting data from British Columbia ferries (ships).
  • Added web plots for Imagenex SONAR.
  • Added new instruments including SeaBird CTD 6938 and 6937, SeaBird 43 oxygen sensor, Alec Electronics Rinko-III 0085, Wetlabs FLNTUSB 2474, Nortek Aquadopp Current Profiler 5281, Aanderaa Optode 4175, Sequoia LISST 100X.
  • Added many devices for the Seakeeper Ferry platform.

NEPTUNE:">NEPTUNE:

  • Added new data product for VPS (Vertical Profile System) to display data throughout a "cast" - ie. one up-down deployment cycle.
  • Added new instruments including Naxys Ethernet Hydrophone 02345 (for VPS), Seapoint Fluorometer TMP1 and Panasonic Webcam WV-SC384 and Nortek Aquadopp Current Profiler AQD9917  (all for Wally the Crawler), Nikon D700 camera (for Endeavour), RDI ADCP 600 kHz (for Folger), Ocean Presence OceanCam TMP2

3 May 2012">3 May 2012

VENUS:">VENUS:

Improvements">Improvements
  • Improvements in the way VENUS data searches are done. Should result in better performance.
  • Warning now appears if you attempt to search for more than one hour of SciFish data at one time, due to the very long download time.
  • Added a PNG/PDF option for plotting some data collected from ferries.
  • Added PNG, PDF, and Matlab 7 data formats for vector data products.

NEPTUNE:">NEPTUNE:

Improvements">Improvements

There has been a lot of work done on the Data Search page:

  • Clearly marked three step workflow.
  • Sort by Location now takes care of the case where more than one similar instrument was deployed at that site over time. It will automatically list all relevant instruments and sensors, and the data search will stitch together the data from all relevant instruments in that time range. The new metadata report will list all instruments that were involved in the search and the date range that each was deployed.
  • Sort by Location now shows a simplified list of sites. All searches made when sorted by location will only show data collected at the selected site, even if the instrument was deployed at multiple sites within the search period.
  • Large map that shows all NEPTUNE nodes.  Clicking on a node gives information about what is interesting at that location.
  • When an instrument is selected, red pins appear on the map showing all locations where that instrument has been deployed. Hovering over the pin gives lat, long, and depth
  • A new step was added to allow you to add items to the "shopping cart", then review them before you run any of them.
  • Data product results are shown in a new tab rather than on the search page.
  • Details about each data product are more clearly displayed in tables.
  • Note that completed data products cannot be deleted from the table but will automatically disappear after one week.
  • Link beside each data product (Action column) allows user to send e-mail to NEPTUNE Canada requesting assistance for that particular search.
  • Links to FTP folder beside each data product have been removed, as has the Download button. Now only obvious way to download your results is by clicking on the download link. However the FTP folder is still available in the More menu for anyone who still wants to use it.
  • A metadata report is now automatically produced for most scalar sensor data products. Excluded at this time are the COVIS multi-beam sonar, and Davis weather station.
  • Added instructions beside the Data Availability chart to explain what the green bars mean, and how to zoom in and out.

Other improvements:

  • The BioSonics Echosounder now has a .dt4 data product.
  • Digital Fishers now displays a popup  at startup describing the current mission - ie. why the scientists selected the current set of videos to be analyzed and what they are asking the public to help them study. The mission statement can be reviewed at any time using the Current Mission "button". All annotations made will now contain the name of the mission (campaign) to help with sorting later.
  • In Digital Fishers, added "Trawl Marks" to the Objects choices at all levels to support the next campaign.
  • The Annotations Search page now displays the Campaign name (only applicable for Digital Fishers annotations) and allows you to specify the campaign in your search. 
  • On the Annotations Search page, when annotations are exported, the resulting CSV (Excel) file will separate the Digital Fishers sealife, objects, water, and seafloor comments into separate columns to help with analysis.
  • In Plotting Utility, Sort by Location now works the same way as the new Data Search. If more than one instrument was deployed at that location during the search period, all the data will be stitched together and all instruments will be listed in the legend and in the plot settings. You are able to change the colour or chart type to distinguish between different instruments if you wish but by default it will be plotted as a line of one colour.
  • In SeaTube, the Playlist button now changes colour when recording. Playlists now show the corresponding dive log from the original video, and you may make annotations on your playlist videos.
  • Improved video workflow so that ROPOS videos from maintenance cruises will require less post-cruise processing and will be available in SeaTube sooner. All dives videos will now be stored in 11 minute segments, although in SeaTube they will appear and will play as one continuous video.
  • For CSV (Excel) data product  files containing columns for multiple sensors, the sensors are now grouped by sensor type rather than sensor ID number.
  • Updated the CSV (Excel) data product to support Location searches where more than one instrument was deployed at that site within the search range.
  • All CSV data products now give you the option to select a "NaN" version of the CSV file (separate checkbox). This version will fill in all data gaps and insert interpolated clock times and NaN as the data value (Not a Number).

27 March 2012">27 March 2012

VENUS:">VENUS:

Improvements">Improvements
  • Changed the FiledownloadService to support JPG images for the DSC01 camera.
  • Modified the way task virtual machines are used so that VENUS and NEPTUNE searches can share all the task machines in a common pool. This should provide more even resource loading.

NEPTUNE:">NEPTUNE:

Improvements">Improvements
  • Added a "Playlist" feature in SeaTube. Click the + icon to mark the beginning of an interesting video. Click + again to mark the end. This video segment will be added to your playlist under a name you choose.
  • Added a new metadata data product that is automatically generated when you generate any other data product for a given device. This is a PDF that explains all the details of the data search, the location of the instrument at that time, how to cite the data, lists any gaps in the data, etc. It also includes a link to display any relevant data annotations. Only enabled for ADCPs with device IDs 12002 and 11206 at this time.
  • Added Digital Fishers to the main menu bar.
  • In Digital Fishers tutorials, added text to remind users to click on the buttons in the tutorials to see graphic illustrations for each annotation category.
  • In Digital Fishers, added a popup message at startup to announce the mission of the current data analysis campaign (only has a default message for now). Also added a button to recall this mission at any time.
  • In Digital Fishers, greatly improved the performance of loading the cards earned and status on startup.
  • In Annotation Search, greatly improved the performance of doing very large searches. Now the results are displayed in pages of fixed sizes and you can navigate between pages. You can also sort most columns by clicking on the column heading (the entire search results are sorted, not just the page currently being displayed).
  • Added support for Station searches where different instruments were deployed at that Station over the date range of the search. Only deployed internally at this time.
  • Added additional improvements to a new version of Data Search being developed, but which is only available internally at this time.
  • Plotting Utility now handles the case where different instruments were deployed at the same Station over the date range of the search. Each instrument portion is independently configurable (eg. colour, chart type, etc). This feature IS available to everyone.
  • Made more improvements to new Task Monitor page (only available internally at this time).

7 March 2012">7 March 2012

NEPTUNE:">NEPTUNE:

Improvements">Improvements
  • Added a video copyright notice on the Digital Fishers page.
  • Significantly improved performance when loading the Digital Fishers page (cards, My Status, Leader status)
  • Added button on the Device Details / Additional Attributes page for the Water Sampler to allow water samples to be taken on request. Button is only visible if you have permission to operate it.

5 March 2012">5 March 2012

VENUS:">VENUS:

Improvements">Improvements
  • Added a data parser for WetLabs FLNTU 2472, NTU 2472, and FLNTU 2473.
  • Added QAQC results for PIEZ-01 peizometer
  • Added WAV format files for IC Listen Hydrophone 203
  • Created new calibration formulas for SeaBird 6936 density and sigmat.

NEPTUNE:">NEPTUNE:

Improvements">Improvements
  • In Plotting Utility, added the ability to find data for a given location, regardless of whether different but similar instruments were deployed there at different times. This is called "Sort by Station". If you request a plot where this situation occurred and the time range is large enough to show data from different instruments, all corresponding instrument data will be displayed on the plot at the same time. The Legend and the Plot Settings will indicate all the applicable instruments. If you wish, you can independently change the plot settings for each instrument - for example you may wish to use a different plot colour for each one. For the time being, Sort by Location is still available but it will be placed by Sort by Station in a future release. This feature will also be added to Data Search in a future release.
  • Added DT4 data product to Data Search for Biosonics devices. Also added RDI data products and data products to support Imagenex devices.
  • Created a Davis Weather Station (device 13124) to prepare for eventually collecting data at Port Alberni.
  • Time to produce the Nortek data product in Data Search has been reduced to about 1/3 of it's former time.
  • Added documentation on the Wiki for new Biosonics data products.
  • Renamed "published" to "public" when referring to saved data searches, to make it consistent across all pages.
  • Significant improvements to Data Search have been added, but only on an orphaned page for now until all features are ready and tested. When the public Data Search page is ready, this will be noted in a future Release Notes section.
  • Plotting Utility plots can now be saved using names that contain accents and other special characters.
  • When selecting a date and time using Data Search and Plotting Utility, it is now more obvious that the time must be specified in UTC time. 
  • "837" type files are now available for Imagenex devices on Data Search


9 February 2012

VENUS:">VENUS:

Improvements">Improvements
  • Removed "Data does not exist before..." message on VENUS Data Download page because there will be data before Feb 28, 2008
  • Added QAQC pressure tests for VIP study areas 1, 8, and 12.
  • Added instrument level QAQC tests for the new Seabird SBECTD16p6935

NEPTUNE:">NEPTUNE:

Improvements">Improvements
  • Tar files now have an icon on Data Search page.
  • Added log files for Imagenex sonar devices to Data Search.
  • When annotations are created now in SeaTube, the DateTo will automatically be set equal to the DateFrom.
  • Personal annotations can now be seen in SeaTube in a separate tab from Dive Log annotations.
  • Screen shots can now be obtained from individual frames of a SeaTube video. Just click on the new icon beside the annotation icons at the top right of the video and 9 consecutive frames will appear. You can then right click on the one you want and save to a file.
  • The Registration (creating a new account) and Profile pages have been changed to present similar choices as the VENUS web site.
  • In the Registration and Profile pages you now are able to share specific attributes with others, while keeping the rest private.
  • In the Registration and Profile pages, the occupation choice "Policy Maker" has been removed.
  • In the Registration and Profile pages, the Discipline choice list has changed to make it similar to VENUS. Also, you are now able to select more than choice if you want to.
  • Videos taken by Wally the Crawler at Barkley Canyon Hydrate are now available in SeaTube under "Locations". Video is only recorded on days when the lights are turned on.
  • Contour plot data products have been added for the Nortek ADCPs that are on fixed position platforms.

 


  • No labels