New Features Release Notes

Release Notes

Detailed release notes are available on internal wiki.

Release notes summaries on this page:

4 July 2013

Improvements:

Data Search – a new data product options selection form appears when you select a data product.
- Make the sections you want, then Add to Cart. If you want more than one item in your cart before you process them, it is not necessary to press Add to Cart one at a time, just at the very end.
- If you have more than one item checked, the options form applies to the check box highlighted in green.
- The data product options are different for different types of data products. For instance PNG plots has different options than CSV.
- "CSV NaN" option has been removed because now you can select CSV and then select "NaN" in the options form.
- "QA/QC" (data quality) has now been enabled in some of the data products. These data products allow you to choose between "clean" and "raw".
  - "Clean" means data that is deemed to be bad according to the QA/QC tests will be removed from the data product. It will either be removed entirely or replaced by NaNs (Not a Number) according to your selection.
  - "Raw" means all data will be reported; if the QA/QC tests believe it's bad or suspect data, an appropriate flag number will be put beside that record. In the case of plots, coloured flags will be put beside the bad data (one flag for each group of bad data, not one flag per data point) and the suspect data points will be red.
- For MAT and CSV, all data will be "raw" at this time, except for averaged data, which is always "clean". Raw and clean options will be enabled in a future release.
- The "clean/raw" option is available for all the Data Search plots (PNG, PDF, staircase, profile, etc).

18 June 2013 (minor release)

ONC Improvements:

Implemented the initial stages of SWEP - Sensor Web Enablement Platform. This will eventually allow users to query scalar data following the Sensor Web Enablement family of standards promoted by the Open Geospatial Consortium. The initial step was to develop the Sensor Observation Service (SOS). This release is only to verify standard compliance.

NEPTUNE Improvements:

In Device Console, in the Junction Box tab, the J numbers now map correctly to breaker numbers.
For the Tempo Mini instrument at Endeavour, the configuration was updated to handle the new lights.
Added a lights driver for the Sony camera at Folger Pinnacle.
Added extra configuration commands to the RDI ADCP driver.
Added "EC - Speed of Sound" device attribute to RDI ADCPs.
Wrote a parser for RBR BPRs.

6 June 2013

NEPTUNE Improvements:

The Cancel button has been removed from the Reprocess Console.
Barkley Canyon MidEast POD3 has been renamed Barkley Canyon MidWest POD3. MidWest POD4 has been renamed to MidEast POD4.
Changed the QA/QC (data quality) threshold for averaged data from 80% to 70%. Ie. if less than 70% of the records for a given averaging "bin" (one minute, one hour, or one day) passed quality control, none of the data in that bin would be used.
Improved how VPS (Vertical Profile System) "cast" data products are computed in order to use resources more efficiently.
Added the ability to search and download certain information for the new Sony camera at Folger Pinnacle using Data Search, such as MP4 video, log file, and plots showing when the pan and tilt controls and the lights have been operated.
Added QA/QC (data quality) flags to the following Data Search data products:
- plots for the Bore Hole temperature probes
- CSV data product for the VPS
- plots for the A.G.O temperature probes
- scalar profile plots for instruments on the VPS

16 May 2013

NEPTUNE Improvements:

Added QA/QC (data quality) to more of the data products, such as VPS casts, and adding QA/QC flags to data search plots.
Added a "count" column to CSV and MAT data products to show how many "good" samples were available for each of the resample bins, based on quality control ("QA/QC") tests.
Metadata report now matches data products in terms of dates data are available (contents and filename).
Added thirtysecond-engineering-summary scheduled job
Modified Kongsberg sonar driver to support master/slave mode.
Added pan and tilt support for new cameras being deployed soon.
Whenever a calibration formula is created, changed, or deleted, added a warning that the data must be reprocessed for the changes to take effect.
Now allow a calibration formula to to be updated as long as it has a different starting date (DateFrom) from all other formulas for that sensor. Also allow a formula to be deleted.
The new Sample Size field in Device Details can now be edited. This field will eventually be used to better handle instruments that send data in bursts rather than evenly spaced data, such as some of the sonars.
Device Console now shows all instruments from all networks at the same time without needing to change networks.
Some back-end work done to support QA/QC (quality control) in data products. You will soon (in a future release) be able to select whether you want your data products to contain raw or cleaned data based on quality control information.
Plotting Utility now leaves gaps in line plots where there is no data. Previously the gaps had been bridged with a straight line.
Added support for dive videos taken by Ocean Explorer ROV.

VENUS or ONC Improvements:

Added support for Kistler accelerometer
MacArtney Winch - added Command and Control Functionality.
BPS (Buoy Profile System) - Added MacArtney Winch to Driver Schedule.
Wrote AML CTD driver and parser
Wrote new driver for daisy-chain Imagenex devices.
Wrote driver and parser for Honeywell HMR-3300 orientation sensor.
Wrote driver and parser for Omegabus thermistor chain.
Added WAV and PNG data product options for the IC Listen hydrophone
Added monthly scatter plots for ferry data.

18 April 2013

NEPTUNE Improvements:

Implemented "QAQC" in scalar data products. Data will start to be analyzed for invalid values and flagged. It will take some time before all instrument data is being analyzed, but the infrastructure is now in place to support it.
Data can be analyzed "manually" (by hand) or automatically by software.
Automatic tests include (not an exhaustive list) out of range tests, spike tests, high gradient tests, and stuck value tests.
Scalar data products (CSV, MAT, PNG, PDF) now show a QAQC flag for each record. CSV and MAT list the flag value, ranging from 0 to 9.PNG and PDF plots highlight potentially invalid data with yellow or red colours, and with a yellow or red flag in the center of each group of flagged data.
Flag values: 0 means no analysis has been done, 1 means good data, 2 - probably good, 3 - use with caution, 4 - bad data, 7 - averaged data, 8 - interpolated value, 9 - data gap. See here for more details: http://venus.uvic.ca/2011/05/qaqc-for-venus-scalar-data/&nbsp
In a later release the user will have the ability to select "clean" or "raw" data in their data products. For now all non-resampled data is "raw", meaning that invalid data is still present but is flagged. All resampled data is "clean", meaning that invalid data has been removed; for the CSV NaN option it will be replaced with "NaN" (not a number); for the other options it will be removed entirely.
In the case of averaged data, if less than 80% of the expected data values for a given averaging point are not present (either due to data gaps or failing a QAQC test), that averaged point is treated as a failed QAQC data point.
Data Search - "sort by Instrument" now has an additional choice level. Besides selecting an instrument you now also have to select where that instrument was deployed. Note that "MTC" means Marine Technology Center, our on-shore testing labs (which in some cases have data). The data availability graph will only show data obtained from the selected deployed site. Regardless of the data range you select, the data products will only contain data from your selected site. If you want to see data from a given site regardless of which instrument was deployed, use "sort by Location".
Plotting Utility - has the same "sort by Instrument" changes mentioned above.
Data Search - the "min/max" resampling option has been temporarily removed. It will return in a future release but only for certain data products.
Improvements were made to the internal "Device Workflow" tool.
Modified SensorDataService, DeviceAttributeService
Added more information in search failure e-mails if an Instrument search.
Improved the performance of Data Search for generating matlab scalar data products by up to 3X.
Modified the Nortek data products to detect velocity-phase wrapping.
In CSV files that reference data from more than one instrument (such as on the VPS), it is made more clear which sensors are external to the main instrument.

VENUS Improvements:

Added TEOS calculated variables to data products.
Added 1, 10, 15, and 60 minute averaging options to data products.

21 March 2013

General Improvements:

Live camera videos linked to the NEPTUNE Canada web site can now be played on an iPad, iPhone, and BlackBerry Playbook.The same is true for the DMAS (Oceans 2.0) "Cameras" pages. This will be enhanced in future to also support SeaTube and Digital Fishers.

NEPTUNE Improvements:

Plotting Utility legend and plot image details now also specify the location of the instrument being plotted. A title is now automatically generated as well, with the same information (you can always edit it using Plot Settings).
In Plotting Utility, when averaging is required in order to reduce the number of displayed points (which happens in most cases), the timestamps are now located at the center of the time bins.
In Data Search where "average" type resampling is selected, the timestamps are now located in the center of each time bin.
When doing Data Searches where the metadata reports are automatically generated, the processing time to produce the report has been significantly reduced, which also means that you will get your data products sooner. In most cases the metadata report should be ready less than one minute after the data product is ready.
"QAQC" has been partly implemented in order to automatically (or manually) check for incorrect data values, such as values that are out of the expected range of the instrument, or that have sudden spikes that could not have natural causes. So far the only data products that are affected are CSV and MAT Data Searches for Resampled data where the average is 1 hour or 1 day. Also affected are Plotting Utility plots where the data is averaged over 15 minute or longer periods (which can be confirmed by checking the Plotted Values table). In these cases, if one or more QAQC tests failed for one or more data samples, and if less than 80% of the samples needed to compute a single averaged point did not pass QAQC, then this point will not be used in the data product or the plot. Additional data products will use QAQC in future releases.
Internal users are now able to create "station" level QAQC tests.
Improvements made to the experience a new user has in creating an Oceans 2.0 account, and existing users have in logging in, such as:
- Making it more clear which fields are mandatory in order to create an account.
- Making error messages larger and moving them to be directly above the registration form where they will be more obvious.
- Retaining as much information as possible if you fail to register, so you only have to correct the cause of your problem (such as mismatched passwords).
- Logging the cause of registration failures (such as mismatched passwords, invalid e-mail accounts, missing mandatory fields, etc) so that we can make further improvements if necessary.
Added a Workflow tool (internal users only) to help us track the workflow of new instruments from ordering to deployment and commissioning.
Added a hyperlink to the digitalfishers.net blog in the Digital Fishers campaign popup.
Data Search data products involving instruments where we have changed the rate at which they collect data have been improved. If you ask for a date range that spans a period where the sample rate ("Data Rating") changed, will now give a more accurate estimate of the number of samples expected. CSV and MAT data products will no longer create new files when the data rating changes, but will list all data ratings and the date and time these change in the file header.
Improved the processing time to produce a "time series scalar profile plot" data product for VPS ("Vertical Profile System") devices.
Added a feature for internal users to either allow QAQC results to be overwritten when doing reprocessing, or not.
Added drivers for AML Oceanographic CTDs

VENUS Improvements:

Added ASL AZFP driver
Added driver for Paroscientific Intelligent Digicourse pressure sensor.
Added support for upcoming deployment of BPS (Buoy Profiling System)
Added option to download oxygen sensor data in umol/L units.

Arctic Improvements:

Made improvements to the driver for the Cambridge Bay WETLabs Water Quality Meter

13 February 2013

NEPTUNE Improvements:

SeaTube - the Cruise and Location branches (on the left) now open automatically to the first level of the search tree. This should make it more clear how to select a video to be played.
Data Search - metadata reports are now automatically provided for non-scalar instruments (but still only available on the NEPTUNE network at this time).
Data Search - the dotted line on the map has now been labelled "Line P" to make it more obvious that this shows the locations (in general) of the Line P buoys. Clicking on the label brings up more details.
Data Search - Subsampling:
- "Subsample Type" has been renamed "Resample Type"
- Resample Type is now a hyperlink to a Wiki page that explains how the resampling is done.
- The "Average" resample type is now computed differently in some cases. For details see the Resampling Wiki page at Resampling
Data Search - the PNG and PDF plots now use a "heat map" method when the number of points is too large to be plotted. The heat map plot will show a distribution of points, with a darker colour where there is a higher concentration of points.
Data Search - now support one minute average resampling for A.G.O. temperature probe data.
Data Search - modified the CSV data products, when using resampling, to set the timestamps at the middle of the resample periods rather than the beginning.
Created an external "dataproduct" web service to look up data products and data product formats.
* Created the "stations" web service to look up station code and DeviceCategory.
Running tasks can now be cancelled (if necessary) using Task Monitor.

14 January 2013

NEPTUNE Improvements:

All SeaTube videos now play as soon as they are selected (previously you had to sometimes select a point further down in the dive log before the video would play).
SeaTube resolutions are now called Low, Medium, and High. (Low displays Satellite footage, Medium is appropriate for consumer broadband, and High requires high bandwidth connections)
Decimation sub-sample option was removed from Data Search until an anti-aliasing problem can be resolved.
Get a warning in SeaTube if flash player not installed, and a link to install it. Videos won't play without the flash player.
Added PDF versions of the "cast" plots for the VPS (vertical profiler system).
Improved the appearance of some of the PNG plots in Data Search.
Added Stuck Value, Spike, and Gradient QAQC tests to prepare to implement QAQC analysis of NEPTUNE data soon. Also added an automatic e-mail feature (to NEPTUNE staff) if any QAQC test fails.

6 December 2012

NEPTUNE Improvements:

Improved the way Plotting Utility averages data to reduce the number of data points when there are too many to plot. The data is now averaged in fixed time duration cells of 1,5,10,15,30 seconds, 1,5,10,15,30 minutes, or 1,6,12, or 24 hours, or 1 week, whichever is closest to the actual cell width. When averaging is performed, this is noted in the Plotted Values table and also in the information bubble in Plot Settings.
Plotting Utility now handles Location searches better, especially if multiple instruments have been deployed at the same location at different times.
Cancelling a running task in Data Search now stops the job from running.

VENUS Improvements:

Added drivers and parsers for MacArtney winch and RM Young meteorological station, to support the upcoming BPS (profiling system).
Added a BPS View page under More >> Infrastructure in order to display the readings from all sensors on the BPS at the same time.

15 November 2012

Arctic Network Improvements:

Added live cameras for Cambridge Bay.
Improved accuracy of ice thickness sensor calibration, as well as all weather station barometric pressure calibrations (pending reprocessing).

NEPTUNE Improvements:

Added popup description panels for most instruments and locations on Data Search.
Added PDF versions of time series scalar, time series scalar profile, AGO, BHT, COVIS, RDI and Nortek data products. The PDFs use vector graphics so they can be magnified without pixelization.
Improved appearance of all PNG data products by increasing the resolution to 300 DPI (letter-size paper) among other PNG improvements.
Applied human-perception based colour-maps to many data products. These colour-maps are also compatible with most forms of colour-blindness.
Changed the SMB file names for the Kongsberg sonar data product to indicate whether the file corresponds to a sweep or a scan.
New "Ocean Dynamics Falcon ROV camera" for showing diver video
In Annotation Search, the Modified Date column has been moved well away from the Start Date and End Date columns. This will help put focus on the dates corresponding to the data that were annotated, rather than the dates the annotation were made.
Renamed CSV files to include "NaN" in the filename if the NaN (Not a Number) version of the CSV data product was produced. This allows you to download both NaN and non-NaN to the same folder.

Other:

Deployed a new Digital Fishers campaign to map the seafloor geology at Endeavour (actually deployed before the software update, on November 5)

25 October 2012

Arctic Network Improvements:

Made the ASL SWIPS ice profiler available for data searches and plots

NEPTUNE Improvements:

Added 15 MIN AVG Matlab and netCDF data products for Nortek ADCPs.
Added ability to delete items from Completed Data Search carts.
Added ability to select several completed Data Search products and download together in a zip file including metadata.
Separated Imagenex .837 files into Scan and Sweep files.
Created first set of data products for 3D camera (raw.zip and bmp.zip ).
Added 3D camera post process job for generating bmp file.
Added Ice Profiler and data products for Cambridge Bay.
Added 6 new Sea-Bird SBE37SMP-ODO CTDs
Added Moxa driver and control page for Cambridge Bay.
Added driver for Pro-Oceanus Mini-Pro CO2
Added driver for Satlantic pH Sensor
Sea Tube can now display "satellite" quality videos (with text overlaid). Defaults to "low" resolution unless only satellite quality is available, in which case that is displayed instead. Satellite quality is lower than "low" quality.
Added admin page for new Coastbuster mobile phone application.
Added a dashed line to represent the ISDM Line P sensors on the Data Search map.
New webservice to extract QAQC results by sensorID
Added "type of search" to e-mails for failed searches
New CSV data product for VPS (Vertical Profiler System) Casts
Can now use sensor values from other devices in calibration formulas.
Reference links for Plotting Utility will now automatically switch the receiving browser into the correct network if it isn't already. For example save a plot for the Arctic network and send its reference link to someone who usually uses Oceans 2.0 in the NEPTUNE network. When the link is pasted to the NEPTUNE browser's URL box, it will bring up the plot in the Arctic network. Note that all subsequent work in this browser will be in the Arctic network until you switch back to NEPTUNE using Tools >> Network Preference.
Improved e-mails that are automatically generated when searches failed. E-mail now states which sensors were selected in the search, and which ones failed. They will also make it clear whether it was a Location or an Instrument search.
Search failure e-mails are now sent regardless of the network used (NEPTUNE, Arctic, etc.).
The way subsampling can be selected in Data Search has been improved so that you can browse the subsample types without actually selecting one.
When selecting an instrument in Data Search using Sort by Instrument Type, all present and previous locations of that instrument are shown with pins on the map. The improvement was to colour the current location with a green pin.
In Data Search when sorting by Location, if you click on a yellow instrument node, the "tree" on the left that shows the locations and instruments will be expanded at the location corresponding to the node you selected.
Added CTD, light sensor, Fluorometer, and oxygen sensor at Folger Pinnacle
Added Ocean Presence OceanCam colour video camera at Folger Pinnacle. Note that the video can be viewed during all daylight hours, although the lights are turned on each day from 0800 to 0845 and 1200 to 1245 Pacific Time (1500 to 1545 and 1700 to 1745 UTC). The videos for any previous period can be found in SeaTube under Locations >> Folger Passage.

VENUS Improvements:

Added metadata reports for VENUS images, video, and hydrophone recordings.
Oxygen data is now available in a choice of three units - micromole/L, micromole/kg, as well as the original ml/L

02 October 2012

NEPTUNE Improvements:

Added metadata reports when data searches are made for audio and video data products.
Added a UI page under Sensor Maintenance (a child page under Device Details) where you can define the sensor calibration formula.
Task Monitor now shows the task history details.
In Data Search, the location of the pins showing where instruments have been deployed or are currently deployed is now more accurately placed. As well, the map centers more accurately when an instrument or a location is selected.
IT now has the ability to place a warning message on the screens of all users who are using Oceans 2.0. This may be used to warn of upcoming outages, etc.
SeaTube can now display "satellite" resolution in additional to low and high resolution, where available. This is usually the same as "low res" except that text is overlaid over the video indicating the exact time, position, heading, and depth. It gets updated every 5 seconds. In many cases the video will start playing as soon as the video is selected, as opposed to low and high res where you sometimes need to select a point further down in the dive log before you start to see video.
Scan mode was enabled for the Kongsberg and Imagenex sonars.
The Electrical Rating tab in Device Details now shows the "Power-on inrush current" value (may not be visible to all users yet).
More improvements added to the new Workflow tab added to Device Details in the last release.
Device documentation was added for Sea-Bird SBE 63 Dissolved Oxygen Sensor.
Device documentation was added for the arctic ice buoys.
Added support for a new Ocean Presence OceanCam camera that will be deployed at Folger later this month.
Improved the headings in the data availability plot linked to the metadata reports.
Changed the weather station rainfall rate units to mm/hr, wind speed units to km/hr, and barometric pressure to kPa, which are the standard meteorological units in Canada.
Added a new data product for profiling instruments, such as those on the VPS: Time Series Scalar Profile Plot.
Added instrument documentation for hydrophones 23112, 23113, and 1230.
Automatic annotations are now created when device drivers are started or stopped using Device Console.

Other Improvements:

A device driver was written to support the ice profiler instrument being deployed at Cambridge Bay, Nunavut.
The final pieces where put into place to support the new Cambridge Bay observatory, which is part of the Arctic network.

05 September 2012

VENUS Improvements:

The SensorDataService web service has been improved to allow you to specify how many rows of data you want returned. The maximum is 100,000 rows per sensor.
Added MAT V7, raw text file, and CSV data formats for the Sequoia LISST-100x device.
Modified the SearchInfoService to indicate whether the device is a piggyback sensor or not.
Modified the type of data that is parsed into the hourlyScalarSample table, depending on the QAQCResult value.
CODAR data is now available from the Download Data / By Instrument page.

NEPTUNE Improvements:

The videos taken during the May/June NEPTUNE maintenance cruise are now available in SeaTube in high definition format.
In order to make it more clear how to use the Data Search feature, the "carts" that you use to fill and process your data products have been renamed to "Open Cart", "Processing Cart", and "Completed Cart". This model should be more familiar to users.
We now allow driver JVM startup with no database connection. This will allow Cambridge Bay to continue to collect data even at times when the network connection to the servers at the University of Victoria is down.
A new "Workflow" tab was added on the Device Details page. This new feature will allow us to track the steps involved in adding a new instrument, from procurement through to commissioning. Only certain users have permission to edit the workflow.
In order to make it more clear for our users, the following buttons in Plotting Utility have been renamed:** "Update Plots" was changed to "Plot" since it also applies to the initial plots.** "New Session" was changed to "Clear All"** "Save Plots" was changed to "Save Plot(s)"
Added support for new instruments to be deployed in the September cruise, including Kongsberg rotary sonars, Ocean Sonics hydrophone, Nortek Aquadopp Profiler.

Other Improvements:

A device driver was added for the new ASL Shallow Water Ice Profiler, which will soon be installed in Cambridge Bay, Nunavut, Canada.
Created data products for the soon-to-be-deployed Cambridge Bay observatory instruments, including WETLabs Water Quality Monitor, Davis Vantage weather station, and OceanCam camera.

02 August 2012

VENUS Improvements:

Added support for RDI 300 kHz ADCP, serial 17955, to be deployed at Bottom Boundary Layer platform
Added driver for WetLabs FLNTUS 1042 for SoG Central
Changed calibration for SeaBird 63 0202
Added support for SeaBird 16+ CTD, serial 7128, to be deployed at Saanich Inlet
Changed calibration for Aanderaa Optode 1684 and 0579
Add new data products (animated GIF and AVI) for Imagenex devices.

NEPTUNE Improvements:

The metadata report, which accompanies most scalar data search results, now has a link in the Data Quality section that will open a data completeness graph. This bar chart shows the number of data samples that were received in each 15 minute block as a percentage of the number that were expected. Drag-selecting allows you to zoom in on a selected date range.
The seismometer state of health data is now being archived.
FTP passwords are now encrypted
Some UI improvements were made in the Topology View page

Arctic Region Improvements:

Added a number of devices to the database to prepare for deployment of mini observatory at Cambridge Bay, including ASL Shallow Water Ice Profiler, and Nortek Aquadopp Current Meters and Curremt Profiler. These are not yet available in Data Search.

11 July 2012

VENUS Improvements:

SeaKeeper Ferry data is now being transferred into the database.
Added additional data products to the Nortek Vectrino Current Meter 0463
Added device and sensor details for new SeaBird 69788 oxygen sensor.
Improved the PrimarySensor page, mainly for internal users.
Changed the calibration for Wetlabs FLNTU 060901 and 1325.
Added RDI ADCP 150 kHz 17457 as a slave to ASL ZAP 1008.
Added device and sensor details for Nortek Vector MicroSquid 4868.
Added enhancements to the SeaKeeper Ferry FTP processes.
Added improvements to Device Console to save an annotation when a driver is stopped or started.

NEPTUNE Improvements:

If a data search fails for a reason other than no data for that date range, a ticket will be automatically generated in our Jira bug tracking database. This also applies in the Brentwood and Arctic networks.
Improved the frequency of processing progress reporting and the overall reliability of the data searches for scalar data.
When you do a Data Search by Location, MATLAB data products no longer create separate files if a different instrument was deployed during the search period.
In the metadata report that accompanies data search data products, data gaps had previously been listed for every gap of greater than 15 minutes, regardless of the number of gaps or the sample period (data rating). Now the report will list only the ten largest gaps. A gap is now defined as expected data that is missing for at least one minute and at least 2 times the sample period or subsample period. So for a one second sample period the gap must exceed one minute. For a one hour sample period the gap must be at least two hours. In any case only the top 10 gaps will be reported in the metadata report (although the CSV NaN data product will show ALL gaps as NaN values).
A bar chart has been added to show the percentage of expected data available for a given search in 15 minute blocks; ie. to graphically show the data gaps. Only after it has been fully developed will we add a link to it from the metadata report.
Created a Wiki page to describe the contents of the metadata report (http://wiki.neptunecanada.ca/display/DP/Metadata).
Added more "VPS Cast" data products and improved existing data products for all instruments on the Vertical Profile System ("POGO"). An "up cast" is the entire period of time that the VPS is traveling towards the surface, and includes any time that it spends paused at a certain depth. It ends only when the VPS starts to go down. A "down cast" ends when the VPS is either docked at the sea floor or starts to go back up. Hysteresis has been applied so if the VPS temporarily changes direction (less than 20m cable length each time), these are not considered casts. If the date range you choose starts or ends in the middle of a cast, the data product will automatically include the entire cast. The cast data products include .mat files, .png plots and device-specific non-scalar products such as the radiometer .raw files. The cast plots pressure (depth) versus sensor data rather sensor data versus time. Because some instruments contain many sensors, the cast data products, which are device level products, automatically use a fixed subset of interesting sensors; you cannot choose the sensors.
VPS cast plots are also available for Engineering data, such as cable length, cable tension, the amount of drift etc. - see the Adapter instrument.
VPS cast data products automatically include the pressure data from the CTD on the VPS as a reference for depth. If there are data gaps in the pressure, the cast data products will linearly interpolate the missing points up to 1.5 times the sensor sample rate.
Added a new feature called Task Monitor to the Tools menu. This feature lets you follow the progress of scheduled jobs, data searches, etc. It is mainly intended for NEPTUNE staff.
Junction boxes (JB) no longer appear in Data Search when you filter on Temperature.
RDI ADCP netcdf data products now include vertical velocity.
Added documentation for the Kongberg rotary sonar data products (http://wiki.neptunecanada.ca/display/DP/48).
Cleaned up the list of cameras in the Cameras menu.
The frequency of resetting the CO2 sensor on the VPS is now a variable that can be changed. It used to be fixed at 3 hours.
Recalibrated some of the sensors on Wally.
Fixed pan and tilt problems on new DragonFish camera at Barkley Upper Slope and started an automatic schedule for the lights.
Set up an automatic schedule for the plankton pump to take a sample every two weeks.

Other Improvements:

When you select the Brentwood College network in Data Search and sort by Location, the locations are now relevant for that network.
When you select the Arctic network in Data Search, the map now centers in the arctic region of Canada. A node appears at Peel Sound. When you sort by Location, the locations are now relevant for that network.
Data being received from ice buoys in Peel Sound (via e-mail) is now being transferred into the database as it arrives and may be seen using Plotting Utility. Two types of e-mail format are supported.

20 June 2012

VENUS Improvements:

Added the ability to upload meteorological, ocean, and navigation data from instruments located on British Columbia ferries into the VENUS database.
Developed a visualization tool for monitoring the ferry data.

Arctic Improvements:

Added infrastructure for the new Arctic network to allow data from ice buoys in Peel Sound, Nunavut (northern Canada) to be ingested into the NEPTUNE database. Data is sent via e-mail over satellite automatically.

NEPTUNE Improvements:

Added an SMB data product for the Kongsberg rotary sonars (in Data Search).
Added a new data product for Radiometers on the VPS (vertical profiler system).
Improvements made to Task Monitor, which is now available on the Tools menu.
Added new DragonFish camera which has been deployed at Barkley Canyon.

24 May 2012

GENERAL:

Added new Arctic network. See Tools -> Network Preference. Note that not all web pages have fully implemented this new network yet.
Created a series of web pages for the public to monitor the upcoming maintenance cruise. See www.neptunecanada.ca. These pages are also compatible with the Apple (TM) iPad.

VENUS:

Added web pages for internal VENUS users to create and modify QA/QC tests.
Added support for new instruments collecting data from British Columbia ferries (ships).
Added web plots for Imagenex SONAR.
Added new instruments including SeaBird CTD 6938 and 6937, SeaBird 43 oxygen sensor, Alec Electronics Rinko-III 0085, Wetlabs FLNTUSB 2474, Nortek Aquadopp Current Profiler 5281, Aanderaa Optode 4175, Sequoia LISST 100X.
Added many devices for the Seakeeper Ferry platform.

NEPTUNE:

Added new data product for VPS (Vertical Profile System) to display data throughout a "cast" - ie. one up-down deployment cycle.
Added new instruments including Naxys Ethernet Hydrophone 02345 (for VPS), Seapoint Fluorometer TMP1 and Panasonic Webcam WV-SC384 and Nortek Aquadopp Current Profiler AQD9917 (all for Wally the Crawler), Nikon D700 camera (for Endeavour), RDI ADCP 600 kHz (for Folger), Ocean Presence OceanCam TMP2

3 May 2012

VENUS:

Improvements

Improvements in the way VENUS data searches are done. Should result in better performance.
Warning now appears if you attempt to search for more than one hour of SciFish data at one time, due to the very long download time.
Added a PNG/PDF option for plotting some data collected from ferries.
Added PNG, PDF, and Matlab 7 data formats for vector data products.

NEPTUNE:

Improvements

There has been a lot of work done on the Data Search page:

Clearly marked three step workflow.

Sort by Location now takes care of the case where more than one similar instrument was deployed at that site over time. It will automatically list all relevant instruments and sensors, and the data search will stitch together the data from all relevant instruments in that time range. The new metadata report will list all instruments that were involved in the search and the date range that each was deployed.

Sort by Location now shows a simplified list of sites. All searches made when sorted by location will only show data collected at the selected site, even if the instrument was deployed at multiple sites within the search period.

Large map that shows all NEPTUNE nodes. Clicking on a node gives information about what is interesting at that location.

When an instrument is selected, red pins appear on the map showing all locations where that instrument has been deployed. Hovering over the pin gives lat, long, and depth

A new step was added to allow you to add items to the "shopping cart", then review them before you run any of them.

Data product results are shown in a new tab rather than on the search page.

Details about each data product are more clearly displayed in tables.

Note that completed data products cannot be deleted from the table but will automatically disappear after one week.

Link beside each data product (Action column) allows user to send e-mail to NEPTUNE Canada requesting assistance for that particular search.

Links to FTP folder beside each data product have been removed, as has the Download button. Now only obvious way to download your results is by clicking on the download link. However the FTP folder is still available in the More menu for anyone who still wants to use it.

A metadata report is now automatically produced for most scalar sensor data products. Excluded at this time are the COVIS multi-beam sonar, and Davis weather station.

Added instructions beside the Data Availability chart to explain what the green bars mean, and how to zoom in and out.

Other improvements:

The BioSonics Echosounder now has a .dt4 data product.
Digital Fishers now displays a popup at startup describing the current mission - ie. why the scientists selected the current set of videos to be analyzed and what they are asking the public to help them study. The mission statement can be reviewed at any time using the Current Mission "button". All annotations made will now contain the name of the mission (campaign) to help with sorting later.
In Digital Fishers, added "Trawl Marks" to the Objects choices at all levels to support the next campaign.
The Annotations Search page now displays the Campaign name (only applicable for Digital Fishers annotations) and allows you to specify the campaign in your search.
On the Annotations Search page, when annotations are exported, the resulting CSV (Excel) file will separate the Digital Fishers sealife, objects, water, and seafloor comments into separate columns to help with analysis.
In Plotting Utility, Sort by Location now works the same way as the new Data Search. If more than one instrument was deployed at that location during the search period, all the data will be stitched together and all instruments will be listed in the legend and in the plot settings. You are able to change the colour or chart type to distinguish between different instruments if you wish but by default it will be plotted as a line of one colour.
In SeaTube, the Playlist button now changes colour when recording. Playlists now show the corresponding dive log from the original video, and you may make annotations on your playlist videos.
Improved video workflow so that ROPOS videos from maintenance cruises will require less post-cruise processing and will be available in SeaTube sooner. All dives videos will now be stored in 11 minute segments, although in SeaTube they will appear and will play as one continuous video.
For CSV (Excel) data product files containing columns for multiple sensors, the sensors are now grouped by sensor type rather than sensor ID number.
Updated the CSV (Excel) data product to support Location searches where more than one instrument was deployed at that site within the search range.
All CSV data products now give you the option to select a "NaN" version of the CSV file (separate checkbox). This version will fill in all data gaps and insert interpolated clock times and NaN as the data value (Not a Number).

27 March 2012

VENUS:

Improvements

Changed the FiledownloadService to support JPG images for the DSC01 camera.
Modified the way task virtual machines are used so that VENUS and NEPTUNE searches can share all the task machines in a common pool. This should provide more even resource loading.

NEPTUNE:

Improvements

Added a "Playlist" feature in SeaTube. Click the + icon to mark the beginning of an interesting video. Click + again to mark the end. This video segment will be added to your playlist under a name you choose.
Added a new metadata data product that is automatically generated when you generate any other data product for a given device. This is a PDF that explains all the details of the data search, the location of the instrument at that time, how to cite the data, lists any gaps in the data, etc. It also includes a link to display any relevant data annotations. Only enabled for ADCPs with device IDs 12002 and 11206 at this time.
Added Digital Fishers to the main menu bar.
In Digital Fishers tutorials, added text to remind users to click on the buttons in the tutorials to see graphic illustrations for each annotation category.
In Digital Fishers, added a popup message at startup to announce the mission of the current data analysis campaign (only has a default message for now). Also added a button to recall this mission at any time.
In Digital Fishers, greatly improved the performance of loading the cards earned and status on startup.
In Annotation Search, greatly improved the performance of doing very large searches. Now the results are displayed in pages of fixed sizes and you can navigate between pages. You can also sort most columns by clicking on the column heading (the entire search results are sorted, not just the page currently being displayed).
Added support for Station searches where different instruments were deployed at that Station over the date range of the search. Only deployed internally at this time.
Added additional improvements to a new version of Data Search being developed, but which is only available internally at this time.
Plotting Utility now handles the case where different instruments were deployed at the same Station over the date range of the search. Each instrument portion is independently configurable (eg. colour, chart type, etc). This feature IS available to everyone.
Made more improvements to new Task Monitor page (only available internally at this time).

7 March 2012

NEPTUNE:

Improvements

Added a video copyright notice on the Digital Fishers page.
Significantly improved performance when loading the Digital Fishers page (cards, My Status, Leader status)
Added button on the Device Details / Additional Attributes page for the Water Sampler to allow water samples to be taken on request. Button is only visible if you have permission to operate it.

5 March 2012

VENUS:

Improvements

Added a data parser for WetLabs FLNTU 2472, NTU 2472, and FLNTU 2473.
Added QAQC results for PIEZ-01 peizometer
Added WAV format files for IC Listen Hydrophone 203
Created new calibration formulas for SeaBird 6936 density and sigmat.

NEPTUNE:

Improvements

In Plotting Utility, added the ability to find data for a given location, regardless of whether different but similar instruments were deployed there at different times. This is called "Sort by Station". If you request a plot where this situation occurred and the time range is large enough to show data from different instruments, all corresponding instrument data will be displayed on the plot at the same time. The Legend and the Plot Settings will indicate all the applicable instruments. If you wish, you can independently change the plot settings for each instrument - for example you may wish to use a different plot colour for each one. For the time being, Sort by Location is still available but it will be placed by Sort by Station in a future release. This feature will also be added to Data Search in a future release.
Added DT4 data product to Data Search for Biosonics devices. Also added RDI data products and data products to support Imagenex devices.
Created a Davis Weather Station (device 13124) to prepare for eventually collecting data at Port Alberni.
Time to produce the Nortek data product in Data Search has been reduced to about 1/3 of it's former time.
Added documentation on the Wiki for new Biosonics data products.
Renamed "published" to "public" when referring to saved data searches, to make it consistent across all pages.
Significant improvements to Data Search have been added, but only on an orphaned page for now until all features are ready and tested. When the public Data Search page is ready, this will be noted in a future Release Notes section.
Plotting Utility plots can now be saved using names that contain accents and other special characters.
When selecting a date and time using Data Search and Plotting Utility, it is now more obvious that the time must be specified in UTC time.
"837" type files are now available for Imagenex devices on Data Search

9 February 2012

VENUS:

Improvements

Removed "Data does not exist before..." message on VENUS Data Download page because there will be data before Feb 28, 2008
Added QAQC pressure tests for VIP study areas 1, 8, and 12.
Added instrument level QAQC tests for the new Seabird SBECTD16p6935

NEPTUNE:

Improvements

Tar files now have an icon on Data Search page.
Added log files for Imagenex sonar devices to Data Search.
When annotations are created now in SeaTube, the DateTo will automatically be set equal to the DateFrom.
Personal annotations can now be seen in SeaTube in a separate tab from Dive Log annotations.
Screen shots can now be obtained from individual frames of a SeaTube video. Just click on the new icon beside the annotation icons at the top right of the video and 9 consecutive frames will appear. You can then right click on the one you want and save to a file.
The Registration (creating a new account) and Profile pages have been changed to present similar choices as the VENUS web site.
In the Registration and Profile pages you now are able to share specific attributes with others, while keeping the rest private.
In the Registration and Profile pages, the occupation choice "Policy Maker" has been removed.
In the Registration and Profile pages, the Discipline choice list has changed to make it similar to VENUS. Also, you are now able to select more than choice if you want to.
Videos taken by Wally the Crawler at Barkley Canyon Hydrate are now available in SeaTube under "Locations". Video is only recorded on days when the lights are turned on.
Contour plot data products have been added for the Nortek ADCPs that are on fixed position platforms.

20 December 2011

VENUS:

Improvements

CRU-578 - Changes to topology of RDIADCP 8580 and SeaBird 6935
CRU-576,574,562,558 - support for new WetLabs turbidity devices
CRU-572 - support for CMAP Cyclops 01 FTP process
CRU-570 - support for new ASLZAP1006 in Saanich Inlet deployed this month
CRU-567 - support for SeaBirds deployed this month
CRU-566 and 565 - support for XWING (SubAqua-Axis) HD webcam
CRU-564 and 563 - support for new Nortek Vector 4897
CRU-560 - support for new SIIM S30010
DMAS-7553,7530,7517 - support for new BlueFIN autonomous underwater vehicle
DMAS-7535 - support for WetLabs FLNTUBLU chlorophyll and turbidity instrument on BlueFIN AUV
DMAS-7534 - support for Alec Rinko-III 0019 temperature and oxygen sensor on BlueFIN AUV
DMAS-7532 - support for AML Smart X CTD on BlueFIN AUV
VENUS-1190 - created metadata products for ADCP download data and auto web plots.
VENUS-1180 subtasks - corrected time error in SOVI data (20July2009 to 8Oct2009)

NEPTUNE:

Improvements

DMASEX-258 - Upgraded Wowza video streaming license to support unlimited simultaneous streams from Amazon for Digital Fishers only
DMASEX-260 - Allow Digital Fishers video stream to be configured to be served locally or from Amazon
CRU-11 and 559 - Changes to how BPR calibrations are done based on temperature
DMAS-7645 - when cameras are turned off, only power down if device is marked "intermittent", meaning that it is allowed to be powered on and off.
DMAS-7465 - configured a "mini-DMAS" at the MTC lab for camera testing.
DMAS-6985 - now display log entries from the ship during dives in quasi-real time via Sea Tube.
DMAS-7570 - support for CODAR system (location and site tables).
DMAS-7574 - requests for data search involving a lot of data now give user option to be sent an e-mail when job is finished.
DMAS-7464 - allow hydrophone data to be processed in Workflow (some subtasks are incomplete)
DMAS-7593 - added CREATE, UPDATE, and VIEW functions to Workflow (some subtasks are incomplete)
DMASEX-248 - revised How To Play video in Digital Fishers
DMASEX-234 - minor graphics changes to Digital Fishers
DMASEX-191 - moved Digital Fishers videos to Amazon (cloud) and served from Wowza.
DMASEX-192 - allow only a user-defined time range of a full video to be viewed in Digital Fishers (instead of the full video).
DMASEX-188 - annotation search results now include the timestamp of when the annotation was made, and the user ID of who made the annotation.
DMASEX-184 - scroll bar added in Digital Fishers Video Management page
DMASEX-182 - Digital Fishers users can now return to any previous level they have already completed, but will not earn any more cards until they return to their highest level.
DMASEX-180 - changes to appearance of Digital Fishers "Play" icon so it won't be confused with "Next Clip" button.
DMASEX-179 - revised tutorial items and graphics for Digital Fishers.
DMASEX-168 - added link to where a Digital Fishers user can fill out a survey form.
DMASEX-237 - added menu item in Tools menu to access Digital Fishers Video Management page.
DMASEX-191 - Pushed Digital Fishers videos to Amazon, show when upload has completed, and prevent clips from that video from being played until video has finished uploading.
DMASEX-233 - changed the Centre for Global Studies logo in Digital Fishers
DMASEX-221 - Added links to Facebook, Google+ and Twitter on Digital Fishers
DMASEX-212 - you can now tell which Digital Fishers videos have had their time ranges editted in the Video Management page.
DMASEX-121 - BPR/CORK clock data is now available in Data Search.
REQS-415 - added videos for the following dives to Sea Tube: R1476,R1482 through R1486, R1488.
DMAS-7559 - modified our web pages on Twitter and YouTube to be more consistent with other ONC web pages.

23 November 2011

VENUS:

Improvements

DMAS-7323 - QC: full day file not valid
New Features
DMAS-7353 - Add a checkbox on the reprocess console for QAQC on VENUS network
DMAS-7354 - Add a qaqcresult column in the reprocess table
DMAS-7355 - Modify the reprocessing backend to support qaqc
VENUS-1176 - Alter VENUS scalar matlab code to return data products with multiple variables
VENUS-1177 - new MATLAB code and scripts to generate ADCP files for VENUS Data Plots page
VENUS-1162 - Create new Download Data interface to allow multiple variables to be selected for testing
Bugs
VENUS-1174 - ZAP Daily Average Plots are displaying data when there is a gap -

NEPTUNE:

Improvements

DMASEX-170 - SQL Script for Sediment Trap Schedule
DMASEX-171 - Start sediment trap driver with new schedule
DMASEX-175 - Change Schedule for Aanderaa Optode
DMASEX-178 - Create Schedule to turn off Chlorination on Nov 10
DMAS-6535 - dt4 data product for BioSonics echosounder
DMAS-6932 - Java CSV should handle data for devices on the Vertical Profiling System
DMAS-7141 - concurrency
DMAS-7193 - create database entries for biosonics data products in search
DMAS-7198 - Java CSV should handle subsampling for devices on VPS
DMAS-7200 - DT4 time tuple needs to be correct
DMAS-7201 - DT4 filenaming
DMAS-7202 - DT4 channel and configuration details
DMAS-7203 - DT4 ping number details
DMAS-7338 - Refactoring CameraController for Power On/Off and Driver Start/Stop
DMAS-7339 - Add a Diagonostic tab to camera UI
DMAS-7340 - Create CameraDiagnosticService
DMAS-7356 - Script for Water Sampler Sensors and Attributes
DMAS-7365 - Add "Commands Sent" info to Diagnostic panel
DMAS-7368 - Add a temporary message to the DataSearch page with links to third party zip software
DMAS-7391 - Once DMAS-7390 is compleated please make sensor 30 , 31, 32, 33 of Barionet 1 (device ID 1011) Neptune searchable
DMAS-7397 - create new dataproduct for mat and png files of COVIS
DMAS-7398 - In NEPTUNE Search, make new dataproductids 40 and 41 use ADFileService
DMAS-7414 - Make generated data available for download by ftp
DMAS-7424 - Generate 40x40 logos for VENUS and Brentwood College
DMAS-7426 - Compress dt4 files when putting into archive
DMAS-6711 - Remove shake effect from Input Dialog
DMAS-6825 - Phase 3 of Java CSV Project
DMAS-6998 - Network events - results are confusing if expression is changed
DMAS-7055 - Immediately display achievement cards.
DMAS-7079 - CSV Minor improvements
DMAS-7114 - Only display fields in a new Annotation that the user has RW privilege for
DMAS-7199 - Use camera's devicecode as media's file name
DMAS-7443 - Minor Improvements to Annotations Search

New Feature

DMAS-5978 - Finish driver for RAS Water sampler 16003
DMAS-6876 - Move Annotations menu item to Tools
DMAS-6879 - Minor improvements to Query Annotations
DMAS-7084 - new DC: data status should not be red for instruments without a data rating
DMAS-7140 - Add optional parameter to include topology related annotations to AnnotationServiceV3
DMAS-7144 - Add quick plot button to Annotation Panel
DMAS-7145 - Add parameter to AnnotationServiceV3 to query on Field values
DMAS-7147 - Notify users to existence of annotations for device in Data Search
DMAS-7148 - Add ability to Add/Query Annotations from Plotting Utility
DMAS-7227 - Brendwood Camera (13125) Streaming address
DMAS-7283 - A scheduler job to update all the clock sensor value using days format
DMAS-7310 - Testers need a way to switch between Java CSV and matlab CSV
DMAS-7388 - COVIS File Post Process Job
DMAS-5386 - Remove duplicate instances of old sprites
DMAS-5899 - MiniDmas color palette
DMAS-6534 - RDI ensemble averaged data product
DMAS-6536 - DFO clearance required view for export to arc
DMAS-6875 - Review Data Assessment Project Documentation
DMAS-7074 - Create a different map for each observatory on the NEPTUNE Search page
DMAS-7112 - RAS temperature probe should not be a piggyback device
DMAS-7151 - Modify service to store muliple searchids for one search_hdr_id
DMAS-7152 - Modify web service to return all searchids for a search_hdr_id
DMAS-7192 - Add Extension Id to Topology view
DMAS-7297 - Modify the EventArchiver & Shorestation with the new Data QAQC design
DMAS-7363 - version K for Chemini's iron conentration calculation
DMAS-7367 - Create record for test Axis camera at MTC
DMAS-7389 - modify COVIS matlab code from PIs to be integrated with DMAS java code
DMAS-7395 - make mat and png from Imaging and diffuse of COVIS neptunesearable
DMAS-7400 - Change COVIS data files in file archive service to status=P
DMAS-7405 - Modify DMAS header to match ONC styles
DMAS-7434 - Some improvement for COVIS Post Process Job
DMAS-7439 - Add decimals to % of search completed
DMAS-7462 - Update Privacy Disclaimers, legal notices links, terms of use links
DMAS-7470 - Additional parameter for running COVIS matlab script in Linux
Incident
DMAS-7027 - LOG NullPointerException in FtpDriver
DMAS-7190 - padrv2 too many open files - data gaps?
DMAS-7347 - Zipped files can't be opened in Mac OSX
DMAS-7366 - Script 100_ddl_add_constraints_qa_only_rev.sql failed in QA
DMAS-5759 - Observatory events: issues
DMAS-6629 - Corrupt zip files from video download
DMAS-6688 - Topology View UI is inconsistently creating sitedevice entries
DMAS-6729 - ArchiveManager:255 - Uncompressed file may be corrupted.
DMAS-6733 - Ehcache catalina warnings
DMAS-6759 - ClassCastException when updating CameraControl device attibute on ROS HD camera (11103)
DMAS-6767 - Context link disappears from Query Annotations
DMAS-6780 - networkevents not working (Production)
DMAS-6784 - need better handling of non-existant sampling period in scalar time series data products
DMAS-6828 - Entering terms in Annotation field truncates Annotation Content
DMAS-6866 - New device console uptime keeps increasing after stopped driver
DMAS-6886 - LOG The file .nfs0000000000cdc01d0000038d doesn't match the required naming pattern DEVICECODE_DATEFROM_DATETO.ext
DMAS-6905 - pacam1 - camera drivers errors
DMAS-6951 - csv break on site change and subsample period issue
DMAS-6994 - Network Events - creating new definition does not delete log
DMAS-7003 - Two of my event detection definitions produce null pointer errors in qaweb2 log and detect no events.
DMAS-7104 - The data assesment annotation are not saving " see attach for my case"
DMAS-7109 - LOG Seabird37SIPParser Seabird37SIPParser:123 - Expecting XML reading but received non XML from Seabird 37 SIP DeviceId : 22610.
DMAS-7113 - Annotation Panel displays strangely when clicking quickly on annotation IDs in Query Annotations page
DMAS-7130 - Camera control GUI not being reset to current settings when power camera on
DMAS-7146 - Subsampling error when t=12:00 on daily subsample end time
DMAS-7162 - Attribution line not centered
DMAS-7165 - Annotations Query: Resource Name field missing when displaying a Resource Type of Sensor Data
DMAS-7170 - Spelling mistake in level 1 Objects
DMAS-7179 - Duplicate annotations appearing in the Query Annotations data table
DMAS-7181 - Race condition in Search Cart manipulation
DMAS-7195 - Annotations Search buttons conflict with results table in IE8
DMAS-7197 - Tool tip for saved annotation queries gives wrong information if description is blank
DMAS-7221 - Displays invalid cameras when switch networks
DMAS-7233 - LOG AdFileProcessor: PostProcessException: File does not exist: IOS3HYDARR03_20111001T001303.000Z-audio-H1.mp3
DMAS-7251 - Java csv does not handle sensor with comma in the sensor name
DMAS-7257 - No ability to turn cameras on or off with presets
DMAS-7270 - Automated Observation schedule controls only the first preset, and messes up the focus
DMAS-7275 - LOG TaskService TaskService:117 - Failed to process a task with id: 492970 (AutomaticObservationJob)
DMAS-7307 - DevicePort for Tempo-Mini camera 2 is not displaying Protocol correctly
DMAS-7309 - readingunitofmeasure for sensorid 4302 should be 36 not 4
DMAS-7314 - LOG AdException: Unable to save DataFile2 into database
DMAS-7321 - LOG "java.io.EOFException: Unexpected end of ZLIB input stream" for RDI ADCP's data search (mat file format with a long time range in one search)
DMAS-7331 - Can't load any published plots with IE in latest release
DMAS-7337 - SensorDataService must be added to the SSO filter
DMAS-7346 - Ifremer Tempo-Mini Camera UI is locked
DMAS-7349 - The Plotting Utility shows issues : When selected I get invalid session error (ii) All my saved plots are no longer available, (iii) All Published plots no longer there
DMAS-7350 - Incorrect longitude and latitude returned from SensorDataService
DMAS-7351 - Correct compression values for COVIS archive files from 'gz ' to 'gz'
DMAS-7359 - Data search page shows "running ...." for completed failed data search
DMAS-7360 - Data Search failed for piggyback instrument
DMAS-7362 - Some camera controls disabled in IE8 for camera operator
DMAS-7364 - Data search error for RDI ADCP with Wave Packet data format on 20110914
DMAS-7369 - SensorDataService return extra value
DMAS-7371 - SOAP web services in QA are all broken
DMAS-7374 - SeaTube alerts error when clicking from Annotation 18055
DMAS-7380 - nullPointerException in SearchInfoService.getSearchInfosForHeader in QA when mulitple variables are selected
DMAS-7383 - status should be 5, not 3, in taskhistory for cancelled csv data search
DMAS-7387 - duplicate filename is generated for RDI ADCP with Wave Packet data format
DMAS-7393 - Barkley POD3 new Axis Camera not in Seatube
DMAS-7396 - Metadata files are not being linked properly when requesting multi-variable data products on VENUS QA download data page
DMAS-7399 - UTCDateField Calendar not setting date correctly on October 31st
DMAS-7402 - ADCP all time search failed Mat 7 and RDI
DMAS-7410 - Camera diagnostic panel - Driver status should be green when CONNECTED, not red
DMAS-7411 - Takes too long to turn cameras on and off. If can't improve, add a warning or progress indicator
DMAS-7418 - searches in queue have broken ftp links
DMAS-7423 - cleanupResults in SearchRunner.java seems not work as design
DMAS-7449 - Device Console; BPR's 21501 & 21502 do not display in Diagram tab because they are currently autonomous
DMAS-7453 - Search result summary displays in old theme
DMAS-7454 - Increase download speed of SearchResults
DMAS-7466 - Camera diagnostic panel consuming too much CPU
DMAS-7498 - Optode driver on Tempo-mini doesn't stop at scheduled time
DMAS-7503 - Incorrect response message and SearchResultStatusID for csv search with no data available
DMAS-7507 - Master/slave not working in branch 20111026
DMAS-7552 - Sitedevice table is wrong for wetlabs fluorometer 951
DMAS-7567 - Topology entry must be fixed for Wetlabs Fluormeter 951
DMAS-7582 - The new device console "JIRA Issues" listing shows a bug

Change Request

DMAS-7319 - Change times of cycles for Chemini
DMAS-7467 - Change Legal Notice & Terms of Use links on Registration & Login pages

19 October 2011

VENUS:

Improvements

Inserted manual QAQC records for autonomous SI VIP-14 data

New Features

Modified the ftp job for the Strait of Georgia AXIS 214 webcam (at SoG Central) to delete files from the archive folder on the host computer.
Added Irls logs from the July 2011 cruise for Sea Tube

NEPTUNE:

Improvements

Changed the cycle times for Chemini
Updated the Chemini iron concentration time calculation procedure
Updated the clock sensor date format to use Unix time with decimal fractions of a day to make it easier to plot
In the new Device Console - improved alarm display on the JB View page, added the ability to filter on data status, filter on JB status, add instrument name column, used colours in the JB status column to indicate whether it's powerable.
Modified the Plotting Utility to store saved plots using UTC time so that if a user flies to a different time zone, their saved plots will not change their appearance.

New Features

Added a cache for EngineeringScalarSample to SensorReadingCache
Created a SensorDataService web service to provide tsunami detection data to NOAA
FileArchiverService will now archive a file that is already compressed (eg. tar.gz)
Added log files as a data product for the McLane water sampler
Added netcdf data product for Nortek Profilers
Added an icon in Data Search for the Tempo-mini camera
Added support for laser control on the Axis camera
New User Management page allows you to see all the groups a user is a member of, and shows which groups have access to which resources

Other Networks:

Improvements

Improved the driver for the Davis Weather Station at Brentwood College

New Features

Added a Control Interface page for Brentwood College relay control
Added a web page for the Ocean Presence camera

22 September 2011

VENUS:

Improvements

StateOfOcean matlab code supports new QAQC flag for average values
new calibration coefficients for Alec Rinko 0014
manual entry of QAQC results for SoVI sensors
SoVI voltage calibration info & parser modifications
piggyback devices and topology info for SeaBird TSG3103 (ID 22796)

NEPTUNE:

Improvements

Digital Fishers: enhancements to UI for upcoming Marine Biodiversity conference (Aberdeen)
New Device Console: enable breaker on/off
Data products for Brentwood College Ocean Camera
New wiki for Brentwood College help & instrument pages
Data products for Axis camera (device type 158)
Correct serial numbers & calibrations for Endeavour SPS BPR's
Configuration changes for Kongsberg Sonar, mooring RDI's for Sept cruise
New data products for Tempo-mini camera
New data products for Covis archived files

12 September 2011

VENUS:

Improvements

New Features

NEPTUNE:

Improvements

Improvements added to new User Management page
Performance improvements for archive file reports for administrators

New Features

New RDI ADCP for SE mooring
Driver created for Plankton Pump 11201
Driver created for new Axis camera P1347 for Barkley Canyon POD3
Button added to UI to control lasers on Axis camera
Made log files available for Data Search on Kongsberg rotary sonar units
Added a tool tip label on topology diagrams on the blue lines connecting elements
New short period seismometers with piggyback BPRs at Endeavour
Data products enabled for CHEMINI iron sensor
Added data assessment feature to annotations

Other Networks

New Features

Enabled data products for Davis weather station for Brentwood College network

23 August 2011

VENUS:

Improvements

New Features

Now provide choice of metadata file format and type for SSV2
Added Averaging Data choice to VENUS Download data page
Added 'MATLAB Version 7 mat file' data format for ADCPs
Added "NetCDF File" format to the VENUS data formats available for download

NEPTUNE:

Improvements

Added software version information to the Device Console, Device Control tab.
Added new Instrument Documentationi pages in the Wiki for many junction boxes.

New Features

Created devices for LBOX5 and LBOX6.
Created sensors in the database for Nortek Aquadopp Current Meter 2599, 2802, 2878,2882, 2334, 2795.
CSV data searches no longer result in multiple files unless critical metadata changes, such as the instrument being moved from one site to another during the period of the search.
Created a web service for the public web site to list the last few dive log entries on the LIVE CRUISE BROADCAST page.

03 August 2011

VENUS:

New Features

Stratogem ferry device and sensor data has been added to the database.
Wrote a parser to process the SoVI ferry data.

NEPTUNE:

Improvements

Removed the Start/Stop column from the Device Console and replaced it with "Start Selected" and "Stop Selected" buttons.
Improved the sensor names for piezometer 22627.
In Sea Tube videos, changed month number to month name.
Added device-level products in database for Chemini, Barix Barionets, and Tempo-mini
Added ability to search for junction box JB15 in Data Search and Plotting Utility

New Features

Added links from Annotation Query to Sea Tube for all fixed camera videos.
The User Preferences table in the database now includes the Network ID. This will become important for some DMAS features such as searches as we diversify into new networks such as Brentwood College.
Sea Tube can now show videos taken from fixed cameras.
Added Device ID to the Junction Box tab in Device Console.
The Network Console can now be selected via the Tools menu (called Network Configuration there)
Data products available from the Data Search page now contain the name and/or logo of the network the instrument belongs to.
New data product available for download for the CSEM instrument (controlled source electromagnetic array).

Other Networks

New Features

Changes made to the database to support new Brentwood College network

05 July 2011

VENUS:

Improvements

Fix VENUS ODV file issues
Deliver driver & parser for Nortek Vector (Device ID 22795)

NEPTUNE:

Improvements

Create driver for sediment trap ID 12005
Update metadata & calibrations for Franatech methane sensor ID 22787
New scalar data products for new instruments (1004,10604,22627,22787) see CRU-367
Updated 'how to play' video in Digital Fishers
UI improvements for Plotting Utility:
- Legend displays full size
- Reticle displays correct values as you pass over a chartline
- New Session and Clear Session buttons
- Saved plots are sorted alphabetically
- Improved calendar date-picker
- Right axis range is editable
- Reference link plots: make editable by choosing 'save'
SeaTube now supports benthic videos as well as dive videos
'Dive in Progress' indicator for dives in – well, you know...
JB-15 has modified parser to support new clock sensor
Deliver driver & parser for Nortek Vector (Device ID 22795);
17 other devices were tested in preparation for cruise (results are on http://wiki.neptunecanada.ca/display/installation/Summer+2011+(Thompson) ,
JB-15 was wet-tested for baseline engineering data

23 June 2011

VENUS:

Improvements

Added manual QAQC results to QAQCRESULT table for DCF-04 to 11

New Features

Added option to select level of QAQC when downloading VENUS data
Created metadata file for VENUS raw Aquadopp files.

NEPTUNE:

Improvements

Updated Andriod and iPhone graphics to support ONC branding.
Change to Range Report title in Device Console status report
Made Digital Fishers buttons and text larger
Modified the way simulators handled tape files so that several simulators can run at the same time.
Oceans 2.0 now supports the following browsers: Firefox 3, Firefox 4, Safari 4, Safari 5, Chrome, Internet Explorer 8, Internet Explorer 9.
Added missing Instrument Documentation in the Wiki for junction boxes.
If a camera is not powerable, it now shows up in the list but cannot be selected.
Adjusted to new data format for A.G.O. temperature probe
Changed Temp-mini Barionet driver to accomodate both piggyback and non-piggyback connections
Digital Fishers can now select videos from mini-Zeus camera (ID 22779) in addition to ROPOS and Crawler camera.
An Administrator can now switch between NEPTUNE, VENUS, and Brentwood College networks.
New User Management now opens details by selecting a group or user from the selection tree.
Exported annotation queries now includes Digital Fisher comments as well as choices.
In Digital Fishers, after leaving a comment you no longer have to click outside the comment box before you are allowed to save the annotation.
System Console no longer displays information that can be found on the Status Console.
The word "Beta" was removed from the Plotting Utility page as it is now a stable application.

New Features

Added exception handling to filedownload web service
Clicking on NEPTUNE logo in DMAS or in Confluence (Projects) takes you to the NEPTUNE home page.
Added time stamp sensor to Piezometer
Link added to Wiki login page to allow users to retrieve a lost password.
Links added on the Device Details pages to show documentation.

1 June 2011

VENUS:

Improvements

- 6 issues resolved (venus-1112 through 1116 plus 1072)

NEPTUNE:

Improvements

- Corrected issue with plot legends.
- Improved range report title in Device Console.
- Corrected issues with contents of Device Console instrument status report.
- Many improvements added to allow crowd-sourcing videos to be annotated with descriptions of what users see in 15 second clips, including tutorials for all levels and a basic "how to play" video and working Google map. For now this "Digital Fishers" feature is available only by typing the URL http://dmas.uvic.ca/DigitalFishersLanding
- Plotting Utility "auto refresh" function now updates time scale by the amount of the refresh interval (15 seconds to 1 hour), regardless of whether you select "Last XXX minutes" or a custom time range.
- Several improvements to the new User Management feature.
- Device Console status report now has correct date and time in Excel export.

New Features

- Added Brentwood College as a network choice (not fully implemented yet)

26 May 2011

VENUS:

Improvements

- Support multiple attributes for data QAQC service
- Region and location id saved to search table when searching VENUS Multimedia Archive
- Sybase-AD database migration (DMAS infrastructure upgrade)

New Features

NEPTUNE:

Improvements

- Several enhancements to instrument status report in New Device Console.
- Added new instrument (ROS lights).
- Improvements to the way users can add annotations.
- Plotting Utility now states that times are in UTC.
- VPS devices are filtered out of data searches.
- Data Search subsampling changed to a default rate of hourly.
- Annotation Query page now shows the source of the annotations.
- Data Search now gives feedback on certain types of searches (anything involving MATLAB), showing the progress.
- Some improvements to make user interface more consistent across pages.
- Added Device ID to the listing in Reprocessing Console.
- Electrical rating for devices now includes non-integers
- Neptune Search: map label clearly indicates "current location" of instrument

New Features

- Created a weekly search summary report.
- Warning message when select a time range greater than 90 days in Data Search (takes a long time to run).
- You can now cancel a data search that you have started.
- New feature added for crowd-sourcing videos to annotate them with descriptions of what users see in 15 second clips. For now this "Digital Fishers" feature is available only by typing the URL http://dmas.uvic.ca/DigitalFishersLanding
- Added Instrument Status pages in New Device Console.
- Data archiving database migrated from Sybase to Oracle.

9 May 2011

VENUS:

Improvements

- VENUS Matlab code for downloading data recognizes data QAQC return.
- VENUS WebPlots recognizes data QAQC return.
- New driver, parser for device 1050 Paroscientific Pressure
- Changes to hydrophone processes for May cruise

New Features

- FTP process for VENUS Digital Still Camera
- Page level permissions based on selected network. Eg. Data Search for VENUS will only show VENUS instruments. SeaTube for VENUS will only show VENUS dives.

NEPTUNE:

Improvements

- In the Data Search and Plotting Utility pages (and others), if a communications failure happens you will now get a warning message with instructions to reload the page (dmas-5995).
- In Plotting Utility, Y axis label is now rotated for easier reading.
- References to NEPTUNE and VENUS are changed from "observatory" to "network".
- Improvements to annotations and corrections to SeaTube dive video labels (dmas-5569).
- Improvements to CodeRunner helper functions and templates (dmas-5127).
- User-friendly messages when DataSearch fails due to database or dmas connectivity issues (dmas-5931).

New Features

- New device: Remote Ocean Systems cameras. Deviceid 12161, 12162, 12163, 12164.
- Plotting Utility now has local help.
- Customizable URLs for Data Search Project, Instrument Type, and Project items for different networks.
- Log alert when archiver writes data to file instead of to database.
- Added new sensor (4339) with dark correction for the PAR device.
- Page level permissions based on selected network. Eg. Data Search for NEPTUNE will only show NEPTUNE instruments.
- DMAS web telnet modified to work with CSEM Receiver 22003.
- Quick response messaging for the following device types. Instruments will still respond in the event of messaging backlog.
  - junction boxes
  - ROS Pan/Tilt (including B&W cameras)
  - Panasonic HD camera
  - CSEM receiver and transmitter
  - McClane Sediment trap

14 April 2011

VENUS:

Improvements

- MATLAB log written to screen (captured to Splunk)
- Correct calibration "datefrom" to reflect cancelled February cruise

New Features

NEPTUNE:

Improvements

- Scheduler now supported on multiple machines
- The engineering data (latest readings only) comes directly from the driver, bypassing the database.
- VPS viewer had changes to units of measurement.
- The BPR driver has minor modification so it responds correctly to the confirmation prompt.
- Instrument Status report enhancements.
- Annotations Query now supports Excel downloads.

New Features

- The Nortek ACMs and the RDI ADCP on the LBOx has the voltage data parsed for trouble shooting of the instruments. This request was made by the PIs from IOS.
- VPS Viewer with two tabs - Platform Controller and Instrument Package.
- Added function to WetLabs FLNTU driver to open and close the bio-wipe shutter at a configurable interval.
- Added manufacturer feedback on derived value calculation for Pro Oceanus 22773.
- Add "compromised" to sensor names and remove commissioning flag for WET Labs 20221.
- All pages and services should only display or work with instruments that were at some point part of the current network the user is browsing. Eg. VENUS, NEPTUNE, and Brentwood College.
- Added time-stamped annotations on all resources that have a user interface - eg. sensors.

28 March 2011

VENUS:

Improvements

- Fix State of the Ocean matlab code for Saanich Inlet VIP Oxygen

New Features

- Active-Streaming Format (ASF) data format for Multimedia Archive
- add raw Aquadopp, LISST and RDI ADCP data products to VENUS download page
- new subversion repository structure for VENUS code

NEPTUNE:

Improvements

- Camera control through Java Management Extensions (JMX) interface for SysAdmins
- Many Plotting Utility enhancements:
  - Cross-browser support (IE, Firefox, Safari, Chrome)
  - Share saved plot with reference URL;
  - Plot to PNG,
  - edit chart style & colours,
  - text panel clearly indicates if readings are averaged; "Coming soon" deleted
  - On-hover reticle displays devicename, sensorname, sensor reading and timestamp
  - On-hover legend displays full sensor name
  - Delete saved plot working
  - Highlight current data session
  - Pseudo-live mode (auto-refresh every 10 minutes)
- Device Console (new):
  - checkbox added to Jira tab to show/hide closed tickets (user can view current & past tickets on an instrument)
  - Support IE8
  - Diagram tab enhancements
  - 10x improvement in performance

New Features

- Vertical Profiler System (VPS) viewer (powerfeed, temperature, CPU status & motor sensors on VPS)
- New data products for VPS instruments (DMAS-5646)
- Improved archiver service: combine raw data, sensor reading, device attribute, event detected, and QAQC result in a single transaction, saved to XML on failed archive event. (DMAS-5777)
- Data Search displays data availability in different colour when site changes (green for current site, grey for past sites)
- [Device Console|http://dmas.uvic.ca/DC] (new): right-click on column headings to show/hide/rearrange and multisort. User preferences are saved to database
- Scheduled daily job to verify hourly & quarterly data
- Camera control :
  - "Sweep" for slow camera movement
  - Permissions and driver refactoring

2 March 2011

VENUS:

Improvements

- FTP process for Instrument Concepts Hydrophone
- FTP process for NRCan StarDot webcam
- Link files and store in galleryaccess
- Data format ASF for Axis webcam
- Alter webservices to return QAQC test result, information & values for VENUS searches

New Features

- Cruise preparation: new devices in database
- New driver: OSU Nortec Vector Boxer system
- New VENUS SIIM - S30008

NEPTUNE:

Improvements

- High resolution option in SeaTube
- Additional SeaTube enhancements
- Improved performance of camera control messaging
- Annotations 'edit annotation in context' improvements
- Refactoring of full page apps
- DMAS cache performance improvement
- Primary Sensor page load performance improvement
- VPS parser
- Coderunner improvement for published packages
- Coderunner 'synchronize to repository' menu
- Browser telnet now supports control characters
- Junction Box View improvements
- Convert NEPTUNE search "data availability" to widget (to be integrated with Plotting Utility)

New Features

- Improvements to new Device Console/Status Report beta
- Dataproduct for HD Inspector Camera
- Data products for Folger Pinnacle devices
- Binary RAW files for CSEM receiver
- MAT data product for ASL AWCP
- Digital Fishers beta
- Diagnostics Amplitude (Beam 1,2,3) for Nortek Aquadopp Current Meter ID 14003

3 February 2011

VENUS:

Improvements

- Data QAQC model, step 2
- QAQC observatory level test values (ref: VENUS-1021)

New Features

- Add VENUS logo to scalar auto, State of the Ocean plots
- Modify State of the Ocean metadata to clearly display spatial reference information

NEPTUNE:

Improvements

- Coderunner UI; right-clicking folder highlights
- Junction Box readings display immediately in datacentre (refactored messaging)
- Refactor group privilege to support multiple resource type
- Fine grain permissions for camera operation (also telnet & device attributes)
- Updated Endeavour map
- Move observatory configuration properties from Java file to database
- Coderunner metadata (name, description, version) on published packages
- DeviceSearch improvements
- updated dive log entries in SeaTube
- Device documentation published on NEPTUNE wiki
- Data Search displays all instruments by Location, Instrument type (currently connected visible in Topology)
- single WAV files now display appropriate icon
- Device Console ver 2 (collapsable treeview, show all tickets by JB/Device/JVM)

New Features

- Data Search: added IRIS link to Interoperability menu
- SeaTube displays icons for frame grabs & digital stills
- User annotations for Device Data and Dives (e.g., B& W cameras, dive metadata in addition to video annotations)
- Links to wiki instruments pages from Data Search
- Summary data for light usage on Pod cameras

Bug fixes

- 74 bug fixes

10 January 2011

VENUS:

- ADDED: StateOfOcean_webfiles.m: a new set of data products that highlight the annual variability of the VENUS time series

[edit]

NEPTUNE:

Improvements

- Device Console (beta) improves functionality, links devices to Jira tickets

- Device-level permissions for Camera operators, Telnet, Device Attributes

- Reprocessing moved from data centre machine to task machine (improves performance on large reprocessing jobs)

- Plots in Data Search for Seapoint Fluorometer 3125 (id 22664)

- INew caching library improves performance

New Features

- log files from Sediment Trap now available as data product

- Quality indicator for Seabirds 13101 , 13104 , 13105

- Annotations query for devices and dive videos in SeaTube

- Changed tile of RDI ADCP % Good plots from "Beam" to "Field"

30 November 2010

VENUS:

Improvements:

- HTML metadata now visible for midnight plots (data quality, spatial data organization, data citation info, etc.) (ref: VENUS-984)
- Gallery web service: update multimedia products with SSV2 search service

New Features:

- Import VENUS dive videos into AD and datafile

NEPTUNE:

Improvements:

- Plotting Utility time offset causes plots to 'disappear'
- login page updated to match new UI

New Features:

- crawler compass magnetic flux density sensors available on Data Search
- 1 minute subsampling added to Data Search
- data products for Nortek Acoustic Current Meters (ACM) (devicetype 57)
- microbial sensor data available on Data Search
- New device names for ROPOS HD video camera (ref: DMAS-5161, CRU-224)
- Thumbnail images added for 7 Devicetypes (ref: DMAS-4933)
- New data product for Nortek Aquadopp HR-profiler (device type 130) (ref: DMAS-4156)
- CodeRunner text editor improvements (ref: DMAS-5125)
- Data products for manuf format (Nortek ADCP)
- Status notification for long operations in Data Search, Daily Report
- Data products for M1000 temperature probe
- Sensor and parser for Satlantic Nitrate device id 22774

9 November 2010

Improvements

- Significant changes to User Interface of CodeRunner, also optimized web services.
- Disable old 'admin menu' landing pages. Menus are now populated based on user group permissions.
- Reverse Sort Dives in SeaTube. Menu sorts much faster, with most recent dives first.
- "Location" drop-down populates much faster in Plotting Utility, Data Search.
- CodeRunner now supports templates that are packages.

New Features

- New calibration values for BARS 15002 "calculated temperature" sensor.
- New sensors created for ACM (13053, 13054, 13055 and 13056) – VE, VMag, VN and Vup
- New data products for ROS pan and tilts on black and white cameras
- Parse and store ancillary sensor data for RDI ADCPS (device type 8 and 137) DMASEX-127
- Sensortypes on Nortek ACM now associated with data product
- Data products for M1000 temperature probe
- Sensors and parser for Satlantic Nitrate device 22774

Changes

- Unit Change for WETLabs Fluorometer (12116).

Page tree

New Features Release Notes

Release Notes

4 July 2013

Improvements:

18 June 2013 (minor release)

ONC Improvements:

NEPTUNE Improvements:

6 June 2013

NEPTUNE Improvements:

16 May 2013

NEPTUNE Improvements:

VENUS or ONC Improvements:

18 April 2013

NEPTUNE Improvements:

VENUS Improvements:

21 March 2013

General Improvements:

NEPTUNE Improvements:

VENUS Improvements:

Arctic Improvements:

13 February 2013

NEPTUNE Improvements:

14 January 2013

NEPTUNE Improvements:

6 December 2012

NEPTUNE Improvements:

VENUS Improvements:

15 November 2012

Arctic Network Improvements:

NEPTUNE Improvements:

Other:

25 October 2012

Arctic Network Improvements:

NEPTUNE Improvements:

VENUS Improvements:

02 October 2012

NEPTUNE Improvements:

Other Improvements:

05 September 2012

VENUS Improvements:

NEPTUNE Improvements:

Other Improvements:

02 August 2012

VENUS Improvements:

NEPTUNE Improvements:

Arctic Region Improvements:

11 July 2012

VENUS Improvements:

NEPTUNE Improvements:

Other Improvements:

20 June 2012

VENUS Improvements:

Arctic Improvements:

NEPTUNE Improvements:

24 May 2012

GENERAL:

VENUS:

NEPTUNE:

3 May 2012

VENUS:

Improvements

NEPTUNE:

Improvements

27 March 2012

VENUS:

Improvements

NEPTUNE:

Improvements

7 March 2012

NEPTUNE:

Improvements

5 March 2012

VENUS:

Improvements

NEPTUNE:

Improvements

9 February 2012

VENUS:

Improvements