Detailed release notes are available on internal wiki.
Release notes summaries on this page:
18 April 2013
NEPTUNE Improvements:
- Implemented "QAQC" in scalar data products. Data will start to be analyzed for invalid values and flagged. It will take some time before all instrument data is being analyzed, but the infrastructure is now in place to support it.** Data can be analyzed "manually" (by hand) or automatically by software.
- Automatic tests include (not an exhaustive list) out of range tests, spike tests, high gradient tests, and stuck value tests.
- Scalar data products (CSV, MAT, PNG, PDF) now show a QAQC flag for each record. CSV and MAT list the flag value, ranging from 0 to 9.PNG and PDF plots highlight potentially invalid data with yellow or red colours, and with a yellow or red flag in the center of each group of flagged data.
- In a later release the user will have the ability to select "clean" or "raw" data in their data products. For now all non-resampled data is "raw", meaning that invalid data is still present but is flagged. All resampled data is "clean", meaning that invalid data has been removed; for the CSV NaN option it will be replaced with "NaN" (not a number); for the other options it will be removed entirely.
- In the case of averaged data, if less than 80% of the expected data values for a given averaging point are not present (either due to data gaps or failing a QAQC test), that averaged point is treated as a failed QAQC data point.
21 March 2013
General Improvements:
- Live camera videos linked to the NEPTUNE Canada web site can now be played on an iPad, iPhone, and BlackBerry Playbook.The same is true for the DMAS (Oceans 2.0) "Cameras" pages. This will be enhanced in future to also support SeaTube and Digital Fishers.
NEPTUNE Improvements:
- Plotting Utility legend and plot image details now also specify the location of the instrument being plotted. A title is now automatically generated as well, with the same information (you can always edit it using Plot Settings).
- In Plotting Utility, when averaging is required in order to reduce the number of displayed points (which happens in most cases), the timestamps are now located at the center of the time bins.
- In Data Search where "average" type resampling is selected, the timestamps are now located in the center of each time bin.
- When doing Data Searches where the metadata reports are automatically generated, the processing time to produce the report has been significantly reduced, which also means that you will get your data products sooner. In most cases the metadata report should be ready less than one minute after the data product is ready.
- "QAQC" has been partly implemented in order to automatically (or manually) check for incorrect data values, such as values that are out of the expected range of the instrument, or that have sudden spikes that could not have natural causes. So far the only data products that are affected are CSV and MAT Data Searches for Resampled data where the average is 1 hour or 1 day. Also affected are Plotting Utility plots where the data is averaged over 15 minute or longer periods (which can be confirmed by checking the Plotted Values table). In these cases, if one or more QAQC tests failed for one or more data samples, and if less than 80% of the samples needed to compute a single averaged point did not pass QAQC, then this point will not be used in the data product or the plot. Additional data products will use QAQC in future releases.
- Internal users are now able to create "station" level QAQC tests.
- Improvements made to the experience a new user has in creating an Oceans 2.0 account, and existing users have in logging in, such as:
- Making it more clear which fields are mandatory in order to create an account.
- Making error messages larger and moving them to be directly above the registration form where they will be more obvious.
- Retaining as much information as possible if you fail to register, so you only have to correct the cause of your problem (such as mismatched passwords).
- Logging the cause of registration failures (such as mismatched passwords, invalid e-mail accounts, missing mandatory fields, etc) so that we can make further improvements if necessary.
- Added a Workflow tool (internal users only) to help us track the workflow of new instruments from ordering to deployment and commissioning.
- Added a hyperlink to the digitalfishers.net blog in the Digital Fishers campaign popup.
- Data Search data products involving instruments where we have changed the rate at which they collect data have been improved. If you ask for a date range that spans a period where the sample rate ("Data Rating") changed, will now give a more accurate estimate of the number of samples expected. CSV and MAT data products will no longer create new files when the data rating changes, but will list all data ratings and the date and time these change in the file header.
- Improved the processing time to produce a "time series scalar profile plot" data product for VPS ("Vertical Profile System") devices.
- Added a feature for internal users to either allow QAQC results to be overwritten when doing reprocessing, or not.
- Added drivers for AML Oceanographic CTDs
VENUS Improvements:
- Added ASL AZFP driver
- Added driver for Paroscientific Intelligent Digicourse pressure sensor.
- Added support for upcoming deployment of BPS (Buoy Profiling System)
- Added option to download oxygen sensor data in umol/L units.
Arctic Improvements:
- Made improvements to the driver for the Cambridge Bay WETLabs Water Quality Meter
13 February 2013
NEPTUNE Improvements:
- SeaTube - the Cruise and Location branches (on the left) now open automatically to the first level of the search tree. This should make it more clear how to select a video to be played.
- Data Search - metadata reports are now automatically provided for non-scalar instruments (but still only available on the NEPTUNE network at this time).
- Data Search - the dotted line on the map has now been labelled "Line P" to make it more obvious that this shows the locations (in general) of the Line P buoys. Clicking on the label brings up more details.
- Data Search - Subsampling:
- "Subsample Type" has been renamed "Resample Type"
- Resample Type is now a hyperlink to a Wiki page that explains how the resampling is done.
- The "Average" resample type is now computed differently in some cases. For details see the Resampling Wiki page at Resampling
- Data Search - the PNG and PDF plots now use a "heat map" method when the number of points is too large to be plotted. The heat map plot will show a distribution of points, with a darker colour where there is a higher concentration of points.
- Data Search - now support one minute average resampling for A.G.O. temperature probe data.
- Data Search - modified the CSV data products, when using resampling, to set the timestamps at the middle of the resample periods rather than the beginning.
- Created an external "dataproduct" web service to look up data products and data product formats.
* Created the "stations" web service to look up station code and DeviceCategory.
- Running tasks can now be cancelled (if necessary) using Task Monitor.
14 January 2013
NEPTUNE Improvements:
- All SeaTube videos now play as soon as they are selected (previously you had to sometimes select a point further down in the dive log before the video would play).
- SeaTube resolutions are now called Low, Medium, and High. (Low displays Satellite footage, Medium is appropriate for consumer broadband, and High requires high bandwidth connections)
- Decimation sub-sample option was removed from Data Search until an anti-aliasing problem can be resolved.
- Get a warning in SeaTube if flash player not installed, and a link to install it. Videos won't play without the flash player.
- Added PDF versions of the "cast" plots for the VPS (vertical profiler system).
- Improved the appearance of some of the PNG plots in Data Search.
- Added Stuck Value, Spike, and Gradient QAQC tests to prepare to implement QAQC analysis of NEPTUNE data soon. Also added an automatic e-mail feature (to NEPTUNE staff) if any QAQC test fails.
6 December 2012
NEPTUNE Improvements:
- Improved the way Plotting Utility averages data to reduce the number of data points when there are too many to plot. The data is now averaged in fixed time duration cells of 1,5,10,15,30 seconds, 1,5,10,15,30 minutes, or 1,6,12, or 24 hours, or 1 week, whichever is closest to the actual cell width. When averaging is performed, this is noted in the Plotted Values table and also in the information bubble in Plot Settings.
- Plotting Utility now handles Location searches better, especially if multiple instruments have been deployed at the same location at different times.
- Cancelling a running task in Data Search now stops the job from running.
VENUS Improvements:
- Added drivers and parsers for MacArtney winch and RM Young meteorological station, to support the upcoming BPS (profiling system).
- Added a BPS View page under More >> Infrastructure in order to display the readings from all sensors on the BPS at the same time.
15 November 2012
Arctic Network Improvements:
- Added live cameras for Cambridge Bay.
- Improved accuracy of ice thickness sensor calibration, as well as all weather station barometric pressure calibrations (pending reprocessing).
NEPTUNE Improvements:
- Added popup description panels for most instruments and locations on Data Search.
- Added PDF versions of time series scalar, time series scalar profile, AGO, BHT, COVIS, RDI and Nortek data products. The PDFs use vector graphics so they can be magnified without pixelization.
- Improved appearance of all PNG data products by increasing the resolution to 300 DPI (letter-size paper) among other PNG improvements.
- Applied human-perception based colour-maps to many data products. These colour-maps are also compatible with most forms of colour-blindness.
- Changed the SMB file names for the Kongsberg sonar data product to indicate whether the file corresponds to a sweep or a scan.
- New "Ocean Dynamics Falcon ROV camera" for showing diver video
- In Annotation Search, the Modified Date column has been moved well away from the Start Date and End Date columns. This will help put focus on the dates corresponding to the data that were annotated, rather than the dates the annotation were made.
- Renamed CSV files to include "NaN" in the filename if the NaN (Not a Number) version of the CSV data product was produced. This allows you to download both NaN and non-NaN to the same folder.
Other:
- Deployed a new Digital Fishers campaign to map the seafloor geology at Endeavour (actually deployed before the software update, on November 5)
25 October 2012
Arctic Network Improvements:
- Made the ASL SWIPS ice profiler available for data searches and plots
NEPTUNE Improvements:
- Added 15 MIN AVG Matlab and netCDF data products for Nortek ADCPs.
- Added ability to delete items from Completed Data Search carts.
- Added ability to select several completed Data Search products and download together in a zip file including metadata.
- Separated Imagenex .837 files into Scan and Sweep files.
- Created first set of data products for 3D camera (raw.zip and bmp.zip ).
- Added 3D camera post process job for generating bmp file.
- Added Ice Profiler and data products for Cambridge Bay.
- Added 6 new Sea-Bird SBE37SMP-ODO CTDs
- Added Moxa driver and control page for Cambridge Bay.
- Added driver for Pro-Oceanus Mini-Pro CO2
- Added driver for Satlantic pH Sensor
- Sea Tube can now display "satellite" quality videos (with text overlaid). Defaults to "low" resolution unless only satellite quality is available, in which case that is displayed instead. Satellite quality is lower than "low" quality.
- Added admin page for new Coastbuster mobile phone application.
- Added a dashed line to represent the ISDM Line P sensors on the Data Search map.
- New webservice to extract QAQC results by sensorID
- Added "type of search" to e-mails for failed searches
- New CSV data product for VPS (Vertical Profiler System) Casts
- Can now use sensor values from other devices in calibration formulas.
- Reference links for Plotting Utility will now automatically switch the receiving browser into the correct network if it isn't already. For example save a plot for the Arctic network and send its reference link to someone who usually uses Oceans 2.0 in the NEPTUNE network. When the link is pasted to the NEPTUNE browser's URL box, it will bring up the plot in the Arctic network. Note that all subsequent work in this browser will be in the Arctic network until you switch back to NEPTUNE using Tools >> Network Preference.
- Improved e-mails that are automatically generated when searches failed. E-mail now states which sensors were selected in the search, and which ones failed. They will also make it clear whether it was a Location or an Instrument search.
- Search failure e-mails are now sent regardless of the network used (NEPTUNE, Arctic, etc.).
- The way subsampling can be selected in Data Search has been improved so that you can browse the subsample types without actually selecting one.
- When selecting an instrument in Data Search using Sort by Instrument Type, all present and previous locations of that instrument are shown with pins on the map. The improvement was to colour the current location with a green pin.
- In Data Search when sorting by Location, if you click on a yellow instrument node, the "tree" on the left that shows the locations and instruments will be expanded at the location corresponding to the node you selected.
- Added CTD, light sensor, Fluorometer, and oxygen sensor at Folger Pinnacle
- Added Ocean Presence OceanCam colour video camera at Folger Pinnacle. Note that the video can be viewed during all daylight hours, although the lights are turned on each day from 0800 to 0845 and 1200 to 1245 Pacific Time (1500 to 1545 and 1700 to 1745 UTC). The videos for any previous period can be found in SeaTube under Locations >> Folger Passage.
VENUS Improvements:
- Added metadata reports for VENUS images, video, and hydrophone recordings.
- Oxygen data is now available in a choice of three units - micromole/L, micromole/kg, as well as the original ml/L
02 October 2012
NEPTUNE Improvements:
- Added metadata reports when data searches are made for audio and video data products.
- Added a UI page under Sensor Maintenance (a child page under Device Details) where you can define the sensor calibration formula.
- Task Monitor now shows the task history details.
- In Data Search, the location of the pins showing where instruments have been deployed or are currently deployed is now more accurately placed. As well, the map centers more accurately when an instrument or a location is selected.
- IT now has the ability to place a warning message on the screens of all users who are using Oceans 2.0. This may be used to warn of upcoming outages, etc.
- SeaTube can now display "satellite" resolution in additional to low and high resolution, where available. This is usually the same as "low res" except that text is overlaid over the video indicating the exact time, position, heading, and depth. It gets updated every 5 seconds. In many cases the video will start playing as soon as the video is selected, as opposed to low and high res where you sometimes need to select a point further down in the dive log before you start to see video.
- Scan mode was enabled for the Kongsberg and Imagenex sonars.
- The Electrical Rating tab in Device Details now shows the "Power-on inrush current" value (may not be visible to all users yet).
- More improvements added to the new Workflow tab added to Device Details in the last release.
- Device documentation was added for Sea-Bird SBE 63 Dissolved Oxygen Sensor.
- Device documentation was added for the arctic ice buoys.
- Added support for a new Ocean Presence OceanCam camera that will be deployed at Folger later this month.
- Improved the headings in the data availability plot linked to the metadata reports.
- Changed the weather station rainfall rate units to mm/hr, wind speed units to km/hr, and barometric pressure to kPa, which are the standard meteorological units in Canada.
- Added a new data product for profiling instruments, such as those on the VPS: Time Series Scalar Profile Plot.
- Added instrument documentation for hydrophones 23112, 23113, and 1230.
- Automatic annotations are now created when device drivers are started or stopped using Device Console.
Other Improvements:
- A device driver was written to support the ice profiler instrument being deployed at Cambridge Bay, Nunavut.
- The final pieces where put into place to support the new Cambridge Bay observatory, which is part of the Arctic network.
05 September 2012
VENUS Improvements:
- The SensorDataService web service has been improved to allow you to specify how many rows of data you want returned. The maximum is 100,000 rows per sensor.
- Added MAT V7, raw text file, and CSV data formats for the Sequoia LISST-100x device.
- Modified the SearchInfoService to indicate whether the device is a piggyback sensor or not.
- Modified the type of data that is parsed into the hourlyScalarSample table, depending on the QAQCResult value.
- CODAR data is now available from the Download Data / By Instrument page.
NEPTUNE Improvements:
- The videos taken during the May/June NEPTUNE maintenance cruise are now available in SeaTube in high definition format.
- In order to make it more clear how to use the Data Search feature, the "carts" that you use to fill and process your data products have been renamed to "Open Cart", "Processing Cart", and "Completed Cart". This model should be more familiar to users.
- We now allow driver JVM startup with no database connection. This will allow Cambridge Bay to continue to collect data even at times when the network connection to the servers at the University of Victoria is down.
- A new "Workflow" tab was added on the Device Details page. This new feature will allow us to track the steps involved in adding a new instrument, from procurement through to commissioning. Only certain users have permission to edit the workflow.
- In order to make it more clear for our users, the following buttons in Plotting Utility have been renamed:** "Update Plots" was changed to "Plot" since it also applies to the initial plots.** "New Session" was changed to "Clear All"** "Save Plots" was changed to "Save Plot(s)"
- Added support for new instruments to be deployed in the September cruise, including Kongsberg rotary sonars, Ocean Sonics hydrophone, Nortek Aquadopp Profiler.
Other Improvements:
- A device driver was added for the new ASL Shallow Water Ice Profiler, which will soon be installed in Cambridge Bay, Nunavut, Canada.
- Created data products for the soon-to-be-deployed Cambridge Bay observatory instruments, including WETLabs Water Quality Monitor, Davis Vantage weather station, and OceanCam camera.
02 August 2012
VENUS Improvements:
- Added support for RDI 300 kHz ADCP, serial 17955, to be deployed at Bottom Boundary Layer platform
- Added driver for WetLabs FLNTUS 1042 for SoG Central
- Changed calibration for SeaBird 63 0202
- Added support for SeaBird 16+ CTD, serial 7128, to be deployed at Saanich Inlet
- Changed calibration for Aanderaa Optode 1684 and 0579
- Add new data products (animated GIF and AVI) for Imagenex devices.
NEPTUNE Improvements:
- The metadata report, which accompanies most scalar data search results, now has a link in the Data Quality section that will open a data completeness graph. This bar chart shows the number of data samples that were received in each 15 minute block as a percentage of the number that were expected. Drag-selecting allows you to zoom in on a selected date range.
- The seismometer state of health data is now being archived.
- FTP passwords are now encrypted
- Some UI improvements were made in the Topology View page
Arctic Region Improvements:
- Added a number of devices to the database to prepare for deployment of mini observatory at Cambridge Bay, including ASL Shallow Water Ice Profiler, and Nortek Aquadopp Current Meters and Curremt Profiler. These are not yet available in Data Search.
11 July 2012
VENUS Improvements:
- SeaKeeper Ferry data is now being transferred into the database.
- Added additional data products to the Nortek Vectrino Current Meter 0463
- Added device and sensor details for new SeaBird 69788 oxygen sensor.
- Improved the PrimarySensor page, mainly for internal users.
- Changed the calibration for Wetlabs FLNTU 060901 and 1325.
- Added RDI ADCP 150 kHz 17457 as a slave to ASL ZAP 1008.
- Added device and sensor details for Nortek Vector MicroSquid 4868.
- Added enhancements to the SeaKeeper Ferry FTP processes.
- Added improvements to Device Console to save an annotation when a driver is stopped or started.
NEPTUNE Improvements:
- If a data search fails for a reason other than no data for that date range, a ticket will be automatically generated in our Jira bug tracking database. This also applies in the Brentwood and Arctic networks.
- Improved the frequency of processing progress reporting and the overall reliability of the data searches for scalar data.
- When you do a Data Search by Location, MATLAB data products no longer create separate files if a different instrument was deployed during the search period.
- In the metadata report that accompanies data search data products, data gaps had previously been listed for every gap of greater than 15 minutes, regardless of the number of gaps or the sample period (data rating). Now the report will list only the ten largest gaps. A gap is now defined as expected data that is missing for at least one minute and at least 2 times the sample period or subsample period. So for a one second sample period the gap must exceed one minute. For a one hour sample period the gap must be at least two hours. In any case only the top 10 gaps will be reported in the metadata report (although the CSV NaN data product will show ALL gaps as NaN values).
- A bar chart has been added to show the percentage of expected data available for a given search in 15 minute blocks; ie. to graphically show the data gaps. Only after it has been fully developed will we add a link to it from the metadata report.
- Created a Wiki page to describe the contents of the metadata report (http://wiki.neptunecanada.ca/display/DP/Metadata).
- Added more "VPS Cast" data products and improved existing data products for all instruments on the Vertical Profile System ("POGO"). An "up cast" is the entire period of time that the VPS is traveling towards the surface, and includes any time that it spends paused at a certain depth. It ends only when the VPS starts to go down. A "down cast" ends when the VPS is either docked at the sea floor or starts to go back up. Hysteresis has been applied so if the VPS temporarily changes direction (less than 20m cable length each time), these are not considered casts. If the date range you choose starts or ends in the middle of a cast, the data product will automatically include the entire cast. The cast data products include .mat files, .png plots and device-specific non-scalar products such as the radiometer .raw files. The cast plots pressure (depth) versus sensor data rather sensor data versus time. Because some instruments contain many sensors, the cast data products, which are device level products, automatically use a fixed subset of interesting sensors; you cannot choose the sensors.
- VPS cast plots are also available for Engineering data, such as cable length, cable tension, the amount of drift etc. - see the Adapter instrument.
- VPS cast data products automatically include the pressure data from the CTD on the VPS as a reference for depth. If there are data gaps in the pressure, the cast data products will linearly interpolate the missing points up to 1.5 times the sensor sample rate.
- Added a new feature called Task Monitor to the Tools menu. This feature lets you follow the progress of scheduled jobs, data searches, etc. It is mainly intended for NEPTUNE staff.
- Junction boxes (JB) no longer appear in Data Search when you filter on Temperature.
- RDI ADCP netcdf data products now include vertical velocity.
- Added documentation for the Kongberg rotary sonar data products (http://wiki.neptunecanada.ca/display/DP/48).
- Cleaned up the list of cameras in the Cameras menu.
- The frequency of resetting the CO2 sensor on the VPS is now a variable that can be changed. It used to be fixed at 3 hours.
- Recalibrated some of the sensors on Wally.
- Fixed pan and tilt problems on new DragonFish camera at Barkley Upper Slope and started an automatic schedule for the lights.
- Set up an automatic schedule for the plankton pump to take a sample every two weeks.
Other Improvements:
- When you select the Brentwood College network in Data Search and sort by Location, the locations are now relevant for that network.
- When you select the Arctic network in Data Search, the map now centers in the arctic region of Canada. A node appears at Peel Sound. When you sort by Location, the locations are now relevant for that network.
- Data being received from ice buoys in Peel Sound (via e-mail) is now being transferred into the database as it arrives and may be seen using Plotting Utility. Two types of e-mail format are supported.
20 June 2012
VENUS Improvements:
- Added the ability to upload meteorological, ocean, and navigation data from instruments located on British Columbia ferries into the VENUS database.
- Developed a visualization tool for monitoring the ferry data.
Arctic Improvements:
- Added infrastructure for the new Arctic network to allow data from ice buoys in Peel Sound, Nunavut (northern Canada) to be ingested into the NEPTUNE database. Data is sent via e-mail over satellite automatically.
NEPTUNE Improvements:
- Added an SMB data product for the Kongsberg rotary sonars (in Data Search).
- Added a new data product for Radiometers on the VPS (vertical profiler system).
- Improvements made to Task Monitor, which is now available on the Tools menu.
- Added new DragonFish camera which has been deployed at Barkley Canyon.
24 May 2012
GENERAL:
- Added new Arctic network. See Tools -> Network Preference. Note that not all web pages have fully implemented this new network yet.
- Created a series of web pages for the public to monitor the upcoming maintenance cruise. See www.neptunecanada.ca. These pages are also compatible with the Apple (TM) iPad.
VENUS:
- Added web pages for internal VENUS users to create and modify QA/QC tests.
- Added support for new instruments collecting data from British Columbia ferries (ships).
- Added web plots for Imagenex SONAR.
- Added new instruments including SeaBird CTD 6938 and 6937, SeaBird 43 oxygen sensor, Alec Electronics Rinko-III 0085, Wetlabs FLNTUSB 2474, Nortek Aquadopp Current Profiler 5281, Aanderaa Optode 4175, Sequoia LISST 100X.
- Added many devices for the Seakeeper Ferry platform.
NEPTUNE:
- Added new data product for VPS (Vertical Profile System) to display data throughout a "cast" - ie. one up-down deployment cycle.
- Added new instruments including Naxys Ethernet Hydrophone 02345 (for VPS), Seapoint Fluorometer TMP1 and Panasonic Webcam WV-SC384 and Nortek Aquadopp Current Profiler AQD9917 (all for Wally the Crawler), Nikon D700 camera (for Endeavour), RDI ADCP 600 kHz (for Folger), Ocean Presence OceanCam TMP2
3 May 2012
VENUS:
Improvements
- Improvements in the way VENUS data searches are done. Should result in better performance.
- Warning now appears if you attempt to search for more than one hour of SciFish data at one time, due to the very long download time.
- Added a PNG/PDF option for plotting some data collected from ferries.
- Added PNG, PDF, and Matlab 7 data formats for vector data products.
NEPTUNE:
Improvements
There has been a lot of work done on the Data Search page:
- Clearly marked three step workflow.
- Sort by Location now takes care of the case where more than one similar instrument was deployed at that site over time. It will automatically list all relevant instruments and sensors, and the data search will stitch together the data from all relevant instruments in that time range. The new metadata report will list all instruments that were involved in the search and the date range that each was deployed.
- Sort by Location now shows a simplified list of sites. All searches made when sorted by location will only show data collected at the selected site, even if the instrument was deployed at multiple sites within the search period.
- Large map that shows all NEPTUNE nodes. Clicking on a node gives information about what is interesting at that location.
- When an instrument is selected, red pins appear on the map showing all locations where that instrument has been deployed. Hovering over the pin gives lat, long, and depth
- A new step was added to allow you to add items to the "shopping cart", then review them before you run any of them.
- Data product results are shown in a new tab rather than on the search page.
- Details about each data product are more clearly displayed in tables.
- Note that completed data products cannot be deleted from the table but will automatically disappear after one week.
- Link beside each data product (Action column) allows user to send e-mail to NEPTUNE Canada requesting assistance for that particular search.
- Links to FTP folder beside each data product have been removed, as has the Download button. Now only obvious way to download your results is by clicking on the download link. However the FTP folder is still available in the More menu for anyone who still wants to use it.
- A metadata report is now automatically produced for most scalar sensor data products. Excluded at this time are the COVIS multi-beam sonar, and Davis weather station.
- Added instructions beside the Data Availability chart to explain what the green bars mean, and how to zoom in and out.
Other improvements:
- The BioSonics Echosounder now has a .dt4 data product.
- Digital Fishers now displays a popup at startup describing the current mission - ie. why the scientists selected the current set of videos to be analyzed and what they are asking the public to help them study. The mission statement can be reviewed at any time using the Current Mission "button". All annotations made will now contain the name of the mission (campaign) to help with sorting later.
- In Digital Fishers, added "Trawl Marks" to the Objects choices at all levels to support the next campaign.
- The Annotations Search page now displays the Campaign name (only applicable for Digital Fishers annotations) and allows you to specify the campaign in your search.
- On the Annotations Search page, when annotations are exported, the resulting CSV (Excel) file will separate the Digital Fishers sealife, objects, water, and seafloor comments into separate columns to help with analysis.
- In Plotting Utility, Sort by Location now works the same way as the new Data Search. If more than one instrument was deployed at that location during the search period, all the data will be stitched together and all instruments will be listed in the legend and in the plot settings. You are able to change the colour or chart type to distinguish between different instruments if you wish but by default it will be plotted as a line of one colour.
- In SeaTube, the Playlist button now changes colour when recording. Playlists now show the corresponding dive log from the original video, and you may make annotations on your playlist videos.
- Improved video workflow so that ROPOS videos from maintenance cruises will require less post-cruise processing and will be available in SeaTube sooner. All dives videos will now be stored in 11 minute segments, although in SeaTube they will appear and will play as one continuous video.
- For CSV (Excel) data product files containing columns for multiple sensors, the sensors are now grouped by sensor type rather than sensor ID number.
- Updated the CSV (Excel) data product to support Location searches where more than one instrument was deployed at that site within the search range.
- All CSV data products now give you the option to select a "NaN" version of the CSV file (separate checkbox). This version will fill in all data gaps and insert interpolated clock times and NaN as the data value (Not a Number).
27 March 2012
VENUS:
Improvements
- Changed the FiledownloadService to support JPG images for the DSC01 camera.
- Modified the way task virtual machines are used so that VENUS and NEPTUNE searches can share all the task machines in a common pool. This should provide more even resource loading.
NEPTUNE:
Improvements
- Added a "Playlist" feature in SeaTube. Click the + icon to mark the beginning of an interesting video. Click + again to mark the end. This video segment will be added to your playlist under a name you choose.
- Added a new metadata data product that is automatically generated when you generate any other data product for a given device. This is a PDF that explains all the details of the data search, the location of the instrument at that time, how to cite the data, lists any gaps in the data, etc. It also includes a link to display any relevant data annotations. Only enabled for ADCPs with device IDs 12002 and 11206 at this time.
- Added Digital Fishers to the main menu bar.
- In Digital Fishers tutorials, added text to remind users to click on the buttons in the tutorials to see graphic illustrations for each annotation category.
- In Digital Fishers, added a popup message at startup to announce the mission of the current data analysis campaign (only has a default message for now). Also added a button to recall this mission at any time.
- In Digital Fishers, greatly improved the performance of loading the cards earned and status on startup.
- In Annotation Search, greatly improved the performance of doing very large searches. Now the results are displayed in pages of fixed sizes and you can navigate between pages. You can also sort most columns by clicking on the column heading (the entire search results are sorted, not just the page currently being displayed).
- Added support for Station searches where different instruments were deployed at that Station over the date range of the search. Only deployed internally at this time.
- Added additional improvements to a new version of Data Search being developed, but which is only available internally at this time.
- Plotting Utility now handles the case where different instruments were deployed at the same Station over the date range of the search. Each instrument portion is independently configurable (eg. colour, chart type, etc). This feature IS available to everyone.
- Made more improvements to new Task Monitor page (only available internally at this time).
7 March 2012
NEPTUNE:
Improvements
- Added a video copyright notice on the Digital Fishers page.
- Significantly improved performance when loading the Digital Fishers page (cards, My Status, Leader status)
- Added button on the Device Details / Additional Attributes page for the Water Sampler to allow water samples to be taken on request. Button is only visible if you have permission to operate it.
5 March 2012
VENUS:
Improvements
- Added a data parser for WetLabs FLNTU 2472, NTU 2472, and FLNTU 2473.
- Added QAQC results for PIEZ-01 peizometer
- Added WAV format files for IC Listen Hydrophone 203
- Created new calibration formulas for SeaBird 6936 density and sigmat.
NEPTUNE:
Improvements
- In Plotting Utility, added the ability to find data for a given location, regardless of whether different but similar instruments were deployed there at different times. This is called "Sort by Station". If you request a plot where this situation occurred and the time range is large enough to show data from different instruments, all corresponding instrument data will be displayed on the plot at the same time. The Legend and the Plot Settings will indicate all the applicable instruments. If you wish, you can independently change the plot settings for each instrument - for example you may wish to use a different plot colour for each one. For the time being, Sort by Location is still available but it will be placed by Sort by Station in a future release. This feature will also be added to Data Search in a future release.
- Added DT4 data product to Data Search for Biosonics devices. Also added RDI data products and data products to support Imagenex devices.
- Created a Davis Weather Station (device 13124) to prepare for eventually collecting data at Port Alberni.
- Time to produce the Nortek data product in Data Search has been reduced to about 1/3 of it's former time.
- Added documentation on the Wiki for new Biosonics data products.
- Renamed "published" to "public" when referring to saved data searches, to make it consistent across all pages.
- Significant improvements to Data Search have been added, but only on an orphaned page for now until all features are ready and tested. When the public Data Search page is ready, this will be noted in a future Release Notes section.
- Plotting Utility plots can now be saved using names that contain accents and other special characters.
- When selecting a date and time using Data Search and Plotting Utility, it is now more obvious that the time must be specified in UTC time.
- "837" type files are now available for Imagenex devices on Data Search
9 February 2012
VENUS:
Improvements
- Removed "Data does not exist before..." message on VENUS Data Download page because there will be data before Feb 28, 2008
- Added QAQC pressure tests for VIP study areas 1, 8, and 12.
- Added instrument level QAQC tests for the new Seabird SBECTD16p6935
NEPTUNE:
Improvements
- Tar files now have an icon on Data Search page.
- Added log files for Imagenex sonar devices to Data Search.
- When annotations are created now in SeaTube, the DateTo will automatically be set equal to the DateFrom.
- Personal annotations can now be seen in SeaTube in a separate tab from Dive Log annotations.
- Screen shots can now be obtained from individual frames of a SeaTube video. Just click on the new icon beside the annotation icons at the top right of the video and 9 consecutive frames will appear. You can then right click on the one you want and save to a file.
- The Registration (creating a new account) and Profile pages have been changed to present similar choices as the VENUS web site.
- In the Registration and Profile pages you now are able to share specific attributes with others, while keeping the rest private.
- In the Registration and Profile pages, the occupation choice "Policy Maker" has been removed.
- In the Registration and Profile pages, the Discipline choice list has changed to make it similar to VENUS. Also, you are now able to select more than choice if you want to.
- Videos taken by Wally the Crawler at Barkley Canyon Hydrate are now available in SeaTube under "Locations". Video is only recorded on days when the lights are turned on.
- Contour plot data products have been added for the Nortek ADCPs that are on fixed position platforms.
20 December 2011
VENUS:
Improvements
- CRU-578 - Changes to topology of RDIADCP 8580 and SeaBird 6935
- CRU-576,574,562,558 - support for new WetLabs turbidity devices
- CRU-572 - support for CMAP Cyclops 01 FTP process
- CRU-570 - support for new ASLZAP1006 in Saanich Inlet deployed this month
- CRU-567 - support for SeaBirds deployed this month
- CRU-566 and 565 - support for XWING (SubAqua-Axis) HD webcam
- CRU-564 and 563 - support for new Nortek Vector 4897
- CRU-560 - support for new SIIM S30010
- DMAS-7553,7530,7517 - support for new BlueFIN autonomous underwater vehicle
- DMAS-7535 - support for WetLabs FLNTUBLU chlorophyll and turbidity instrument on BlueFIN AUV
- DMAS-7534 - support for Alec Rinko-III 0019 temperature and oxygen sensor on BlueFIN AUV
- DMAS-7532 - support for AML Smart X CTD on BlueFIN AUV
- VENUS-1190 - created metadata products for ADCP download data and auto web plots.
- VENUS-1180 subtasks - corrected time error in SOVI data (20July2009 to 8Oct2009)
NEPTUNE:
Improvements
- DMASEX-258 - Upgraded Wowza video streaming license to support unlimited simultaneous streams from Amazon for Digital Fishers only
- DMASEX-260 - Allow Digital Fishers video stream to be configured to be served locally or from Amazon
- CRU-11 and 559 - Changes to how BPR calibrations are done based on temperature
- DMAS-7645 - when cameras are turned off, only power down if device is marked "intermittent", meaning that it is allowed to be powered on and off.
- DMAS-7465 - configured a "mini-DMAS" at the MTC lab for camera testing.
- DMAS-6985 - now display log entries from the ship during dives in quasi-real time via Sea Tube.
- DMAS-7570 - support for CODAR system (location and site tables).
- DMAS-7574 - requests for data search involving a lot of data now give user option to be sent an e-mail when job is finished.
- DMAS-7464 - allow hydrophone data to be processed in Workflow (some subtasks are incomplete)
- DMAS-7593 - added CREATE, UPDATE, and VIEW functions to Workflow (some subtasks are incomplete)
- DMASEX-248 - revised How To Play video in Digital Fishers
- DMASEX-234 - minor graphics changes to Digital Fishers
- DMASEX-191 - moved Digital Fishers videos to Amazon (cloud) and served from Wowza.
- DMASEX-192 - allow only a user-defined time range of a full video to be viewed in Digital Fishers (instead of the full video).
- DMASEX-188 - annotation search results now include the timestamp of when the annotation was made, and the user ID of who made the annotation.
- DMASEX-184 - scroll bar added in Digital Fishers Video Management page
- DMASEX-182 - Digital Fishers users can now return to any previous level they have already completed, but will not earn any more cards until they return to their highest level.
- DMASEX-180 - changes to appearance of Digital Fishers "Play" icon so it won't be confused with "Next Clip" button.
- DMASEX-179 - revised tutorial items and graphics for Digital Fishers.
- DMASEX-168 - added link to where a Digital Fishers user can fill out a survey form.
- DMASEX-237 - added menu item in Tools menu to access Digital Fishers Video Management page.
- DMASEX-191 - Pushed Digital Fishers videos to Amazon, show when upload has completed, and prevent clips from that video from being played until video has finished uploading.
- DMASEX-233 - changed the Centre for Global Studies logo in Digital Fishers
- DMASEX-221 - Added links to Facebook, Google+ and Twitter on Digital Fishers
- DMASEX-212 - you can now tell which Digital Fishers videos have had their time ranges editted in the Video Management page.
- DMASEX-121 - BPR/CORK clock data is now available in Data Search.
- REQS-415 - added videos for the following dives to Sea Tube: R1476,R1482 through R1486, R1488.
- DMAS-7559 - modified our web pages on Twitter and YouTube to be more consistent with other ONC web pages.
23 November 2011
VENUS:
Improvements
- DMAS-7323 - QC: full day file not valid
New Features
- DMAS-7353 - Add a checkbox on the reprocess console for QAQC on VENUS network
- DMAS-7354 - Add a qaqcresult column in the reprocess table
- DMAS-7355 - Modify the reprocessing backend to support qaqc
- VENUS-1176 - Alter VENUS scalar matlab code to return data products with multiple variables
- VENUS-1177 - new MATLAB code and scripts to generate ADCP files for VENUS Data Plots page
- VENUS-1162 - Create new Download Data interface to allow multiple variables to be selected for testing
Bugs
- VENUS-1174 - ZAP Daily Average Plots are displaying data when there is a gap -
NEPTUNE:
Improvements
- DMASEX-170 - SQL Script for Sediment Trap Schedule
- DMASEX-171 - Start sediment trap driver with new schedule
- DMASEX-175 - Change Schedule for Aanderaa Optode
- DMASEX-178 - Create Schedule to turn off Chlorination on Nov 10
- DMAS-6535 - dt4 data product for BioSonics echosounder
- DMAS-6932 - Java CSV should handle data for devices on the Vertical Profiling System
- DMAS-7141 - concurrency
- DMAS-7193 - create database entries for biosonics data products in search
- DMAS-7198 - Java CSV should handle subsampling for devices on VPS
- DMAS-7200 - DT4 time tuple needs to be correct
- DMAS-7201 - DT4 filenaming
- DMAS-7202 - DT4 channel and configuration details
- DMAS-7203 - DT4 ping number details
- DMAS-7338 - Refactoring CameraController for Power On/Off and Driver Start/Stop
- DMAS-7339 - Add a Diagonostic tab to camera UI
- DMAS-7340 - Create CameraDiagnosticService
- DMAS-7356 - Script for Water Sampler Sensors and Attributes
- DMAS-7365 - Add "Commands Sent" info to Diagnostic panel
- DMAS-7368 - Add a temporary message to the DataSearch page with links to third party zip software
- DMAS-7391 - Once DMAS-7390 is compleated please make sensor 30 , 31, 32, 33 of Barionet 1 (device ID 1011) Neptune searchable
- DMAS-7397 - create new dataproduct for mat and png files of COVIS
- DMAS-7398 - In NEPTUNE Search, make new dataproductids 40 and 41 use ADFileService
- DMAS-7414 - Make generated data available for download by ftp
- DMAS-7424 - Generate 40x40 logos for VENUS and Brentwood College
- DMAS-7426 - Compress dt4 files when putting into archive
- DMAS-6711 - Remove shake effect from Input Dialog
- DMAS-6825 - Phase 3 of Java CSV Project
- DMAS-6998 - Network events - results are confusing if expression is changed
- DMAS-7055 - Immediately display achievement cards.
- DMAS-7079 - CSV Minor improvements
- DMAS-7114 - Only display fields in a new Annotation that the user has RW privilege for
- DMAS-7199 - Use camera's devicecode as media's file name
- DMAS-7443 - Minor Improvements to Annotations Search
New Feature
- DMAS-5978 - Finish driver for RAS Water sampler 16003
- DMAS-6876 - Move Annotations menu item to Tools
- DMAS-6879 - Minor improvements to Query Annotations
- DMAS-7084 - new DC: data status should not be red for instruments without a data rating
- DMAS-7140 - Add optional parameter to include topology related annotations to AnnotationServiceV3
- DMAS-7144 - Add quick plot button to Annotation Panel
- DMAS-7145 - Add parameter to AnnotationServiceV3 to query on Field values
- DMAS-7147 - Notify users to existence of annotations for device in Data Search
- DMAS-7148 - Add ability to Add/Query Annotations from Plotting Utility
- DMAS-7227 - Brendwood Camera (13125) Streaming address
- DMAS-7283 - A scheduler job to update all the clock sensor value using days format
- DMAS-7310 - Testers need a way to switch between Java CSV and matlab CSV
- DMAS-7388 - COVIS File Post Process Job
- DMAS-5386 - Remove duplicate instances of old sprites
- DMAS-5899 - MiniDmas color palette
- DMAS-6534 - RDI ensemble averaged data product
- DMAS-6536 - DFO clearance required view for export to arc
- DMAS-6875 - Review Data Assessment Project Documentation
- DMAS-7074 - Create a different map for each observatory on the NEPTUNE Search page
- DMAS-7112 - RAS temperature probe should not be a piggyback device
- DMAS-7151 - Modify service to store muliple searchids for one search_hdr_id
- DMAS-7152 - Modify web service to return all searchids for a search_hdr_id
- DMAS-7192 - Add Extension Id to Topology view
- DMAS-7297 - Modify the EventArchiver & Shorestation with the new Data QAQC design
- DMAS-7363 - version K for Chemini's iron conentration calculation
- DMAS-7367 - Create record for test Axis camera at MTC
- DMAS-7389 - modify COVIS matlab code from PIs to be integrated with DMAS java code
- DMAS-7395 - make mat and png from Imaging and diffuse of COVIS neptunesearable
- DMAS-7400 - Change COVIS data files in file archive service to status=P
- DMAS-7405 - Modify DMAS header to match ONC styles
- DMAS-7434 - Some improvement for COVIS Post Process Job
- DMAS-7439 - Add decimals to % of search completed
- DMAS-7462 - Update Privacy Disclaimers, legal notices links, terms of use links
- DMAS-7470 - Additional parameter for running COVIS matlab script in Linux
Incident
- DMAS-7027 - LOG NullPointerException in FtpDriver
- DMAS-7190 - padrv2 too many open files - data gaps?
- DMAS-7347 - Zipped files can't be opened in Mac OSX
- DMAS-7366 - Script 100_ddl_add_constraints_qa_only_rev.sql failed in QA
- DMAS-5759 - Observatory events: issues
- DMAS-6629 - Corrupt zip files from video download
- DMAS-6688 - Topology View UI is inconsistently creating sitedevice entries
- DMAS-6729 - ArchiveManager:255 - Uncompressed file may be corrupted.
- DMAS-6733 - Ehcache catalina warnings
- DMAS-6759 - ClassCastException when updating CameraControl device attibute on ROS HD camera (11103)
- DMAS-6767 - Context link disappears from Query Annotations
- DMAS-6780 - networkevents not working (Production)
- DMAS-6784 - need better handling of non-existant sampling period in scalar time series data products
- DMAS-6828 - Entering terms in Annotation field truncates Annotation Content
- DMAS-6866 - New device console uptime keeps increasing after stopped driver
- DMAS-6886 - LOG The file .nfs0000000000cdc01d0000038d doesn't match the required naming pattern DEVICECODE_DATEFROM_DATETO.ext
- DMAS-6905 - pacam1 - camera drivers errors
- DMAS-6951 - csv break on site change and subsample period issue
- DMAS-6994 - Network Events - creating new definition does not delete log
- DMAS-7003 - Two of my event detection definitions produce null pointer errors in qaweb2 log and detect no events.
- DMAS-7104 - The data assesment annotation are not saving " see attach for my case"
- DMAS-7109 - LOG Seabird37SIPParser Seabird37SIPParser:123 - Expecting XML reading but received non XML from Seabird 37 SIP DeviceId : 22610.
- DMAS-7113 - Annotation Panel displays strangely when clicking quickly on annotation IDs in Query Annotations page
- DMAS-7130 - Camera control GUI not being reset to current settings when power camera on
- DMAS-7146 - Subsampling error when t=12:00 on daily subsample end time
- DMAS-7162 - Attribution line not centered
- DMAS-7165 - Annotations Query: Resource Name field missing when displaying a Resource Type of Sensor Data
- DMAS-7170 - Spelling mistake in level 1 Objects
- DMAS-7179 - Duplicate annotations appearing in the Query Annotations data table
- DMAS-7181 - Race condition in Search Cart manipulation
- DMAS-7195 - Annotations Search buttons conflict with results table in IE8
- DMAS-7197 - Tool tip for saved annotation queries gives wrong information if description is blank
- DMAS-7221 - Displays invalid cameras when switch networks
- DMAS-7233 - LOG AdFileProcessor: PostProcessException: File does not exist: IOS3HYDARR03_20111001T001303.000Z-audio-H1.mp3
- DMAS-7251 - Java csv does not handle sensor with comma in the sensor name
- DMAS-7257 - No ability to turn cameras on or off with presets
- DMAS-7270 - Automated Observation schedule controls only the first preset, and messes up the focus
- DMAS-7275 - LOG TaskService TaskService:117 - Failed to process a task with id: 492970 (AutomaticObservationJob)
- DMAS-7307 - DevicePort for Tempo-Mini camera 2 is not displaying Protocol correctly
- DMAS-7309 - readingunitofmeasure for sensorid 4302 should be 36 not 4
- DMAS-7314 - LOG AdException: Unable to save DataFile2 into database
- DMAS-7321 - LOG "java.io.EOFException: Unexpected end of ZLIB input stream" for RDI ADCP's data search (mat file format with a long time range in one search)
- DMAS-7331 - Can't load any published plots with IE in latest release
- DMAS-7337 - SensorDataService must be added to the SSO filter
- DMAS-7346 - Ifremer Tempo-Mini Camera UI is locked
- DMAS-7349 - The Plotting Utility shows issues :
When selected I get invalid session error (ii) All my saved plots are no longer available, (iii) All Published plots no longer there
- DMAS-7350 - Incorrect longitude and latitude returned from SensorDataService
- DMAS-7351 - Correct compression values for COVIS archive files from 'gz ' to 'gz'
- DMAS-7359 - Data search page shows "running ...." for completed failed data search
- DMAS-7360 - Data Search failed for piggyback instrument
- DMAS-7362 - Some camera controls disabled in IE8 for camera operator
- DMAS-7364 - Data search error for RDI ADCP with Wave Packet data format on 20110914
- DMAS-7369 - SensorDataService return extra value
- DMAS-7371 - SOAP web services in QA are all broken
- DMAS-7374 - SeaTube alerts error when clicking from Annotation 18055
- DMAS-7380 - nullPointerException in SearchInfoService.getSearchInfosForHeader in QA when mulitple variables are selected
- DMAS-7383 - status should be 5, not 3, in taskhistory for cancelled csv data search
- DMAS-7387 - duplicate filename is generated for RDI ADCP with Wave Packet data format
- DMAS-7393 - Barkley POD3 new Axis Camera not in Seatube
- DMAS-7396 - Metadata files are not being linked properly when requesting multi-variable data products on VENUS QA download data page
- DMAS-7399 - UTCDateField Calendar not setting date correctly on October 31st
- DMAS-7402 - ADCP all time search failed Mat 7 and RDI
- DMAS-7410 - Camera diagnostic panel - Driver status should be green when CONNECTED, not red
- DMAS-7411 - Takes too long to turn cameras on and off. If can't improve, add a warning or progress indicator
- DMAS-7418 - searches in queue have broken ftp links
- DMAS-7423 - cleanupResults in SearchRunner.java seems not work as design
- DMAS-7449 - Device Console; BPR's 21501 & 21502 do not display in Diagram tab because they are currently autonomous
- DMAS-7453 - Search result summary displays in old theme
- DMAS-7454 - Increase download speed of SearchResults
- DMAS-7466 - Camera diagnostic panel consuming too much CPU
- DMAS-7498 - Optode driver on Tempo-mini doesn't stop at scheduled time
- DMAS-7503 - Incorrect response message and SearchResultStatusID for csv search with no data available
- DMAS-7507 - Master/slave not working in branch 20111026
- DMAS-7552 - Sitedevice table is wrong for wetlabs fluorometer 951
- DMAS-7567 - Topology entry must be fixed for Wetlabs Fluormeter 951
- DMAS-7582 - The new device console "JIRA Issues" listing shows a bug
Change Request
- DMAS-7319 - Change times of cycles for Chemini
- DMAS-7467 - Change Legal Notice & Terms of Use links on Registration & Login pages
19 October 2011
VENUS:
Improvements
- Inserted manual QAQC records for autonomous SI VIP-14 data
New Features
- Modified the ftp job for the Strait of Georgia AXIS 214 webcam (at SoG Central) to delete files from the archive folder on the host computer.
- Added Irls logs from the July 2011 cruise for Sea Tube
NEPTUNE:
Improvements
- Changed the cycle times for Chemini
- Updated the Chemini iron concentration time calculation procedure
- Updated the clock sensor date format to use Unix time with decimal fractions of a day to make it easier to plot
- In the new Device Console - improved alarm display on the JB View page, added the ability to filter on data status, filter on JB status, add instrument name column, used colours in the JB status column to indicate whether it's powerable.
- Modified the Plotting Utility to store saved plots using UTC time so that if a user flies to a different time zone, their saved plots will not change their appearance.
New Features
- Added a cache for EngineeringScalarSample to SensorReadingCache
- Created a SensorDataService web service to provide tsunami detection data to NOAA
- FileArchiverService will now archive a file that is already compressed (eg. tar.gz)
- Added log files as a data product for the McLane water sampler
- Added netcdf data product for Nortek Profilers
- Added an icon in Data Search for the Tempo-mini camera
- Added support for laser control on the Axis camera
- New User Management page allows you to see all the groups a user is a member of, and shows which groups have access to which resources
Other Networks:
Improvements
- Improved the driver for the Davis Weather Station at Brentwood College
New Features
- Added a Control Interface page for Brentwood College relay control
- Added a web page for the Ocean Presence camera
22 September 2011
VENUS:
Improvements
- StateOfOcean matlab code supports new QAQC flag for average values
- new calibration coefficients for Alec Rinko 0014
- manual entry of QAQC results for SoVI sensors
- SoVI voltage calibration info & parser modifications
- piggyback devices and topology info for SeaBird TSG3103 (ID 22796)
NEPTUNE:
Improvements
- Digital Fishers: enhancements to UI for upcoming Marine Biodiversity conference (Aberdeen)
- New Device Console: enable breaker on/off
- Data products for Brentwood College Ocean Camera
- New wiki for Brentwood College help & instrument pages
- Data products for Axis camera (device type 158)
- Correct serial numbers & calibrations for Endeavour SPS BPR's
- Configuration changes for Kongsberg Sonar, mooring RDI's for Sept cruise
- New data products for Tempo-mini camera
- New data products for Covis archived files
12 September 2011
VENUS:
Improvements
New Features
NEPTUNE:
Improvements
- Improvements added to new User Management page
- Performance improvements for archive file reports for administrators
New Features
- New RDI ADCP for SE mooring
- Driver created for Plankton Pump 11201
- Driver created for new Axis camera P1347 for Barkley Canyon POD3
- Button added to UI to control lasers on Axis camera
- Made log files available for Data Search on Kongsberg rotary sonar units
- Added a tool tip label on topology diagrams on the blue lines connecting elements
- New short period seismometers with piggyback BPRs at Endeavour
- Data products enabled for CHEMINI iron sensor
- Added data assessment feature to annotations
Other Networks
New Features
- Enabled data products for Davis weather station for Brentwood College network
23 August 2011
VENUS:
Improvements
New Features
- Now provide choice of metadata file format and type for SSV2
- Added Averaging Data choice to VENUS Download data page
- Added 'MATLAB Version 7 mat file' data format for ADCPs
- Added "NetCDF File" format to the VENUS data formats available for download
NEPTUNE:
Improvements
- Added software version information to the Device Console, Device Control tab.
- Added new Instrument Documentationi pages in the Wiki for many junction boxes.
New Features
- Created devices for LBOX5 and LBOX6.
- Created sensors in the database for Nortek Aquadopp Current Meter 2599, 2802, 2878,2882, 2334, 2795.
- CSV data searches no longer result in multiple files unless critical metadata changes, such as the instrument being moved from one site to another during the period of the search.
- Created a web service for the public web site to list the last few dive log entries on the LIVE CRUISE BROADCAST page.
03 August 2011
VENUS:
New Features
- Stratogem ferry device and sensor data has been added to the database.
- Wrote a parser to process the SoVI ferry data.
NEPTUNE:
Improvements
- Removed the Start/Stop column from the Device Console and replaced it with "Start Selected" and "Stop Selected" buttons.
- Improved the sensor names for piezometer 22627.
- In Sea Tube videos, changed month number to month name.
- Added device-level products in database for Chemini, Barix Barionets, and Tempo-mini
- Added ability to search for junction box JB15 in Data Search and Plotting Utility
New Features
- Added links from Annotation Query to Sea Tube for all fixed camera videos.
- The User Preferences table in the database now includes the Network ID. This will become important for some DMAS features such as searches as we diversify into new networks such as Brentwood College.
- Sea Tube can now show videos taken from fixed cameras.
- Added Device ID to the Junction Box tab in Device Console.
- The Network Console can now be selected via the Tools menu (called Network Configuration there)
- Data products available from the Data Search page now contain the name and/or logo of the network the instrument belongs to.
- New data product available for download for the CSEM instrument (controlled source electromagnetic array).
Other Networks
New Features
- Changes made to the database to support new Brentwood College network
05 July 2011
VENUS:
Improvements
- Fix VENUS ODV file issues
- Deliver driver & parser for Nortek Vector (Device ID 22795)
NEPTUNE:
Improvements
- Create driver for sediment trap ID 12005
- Update metadata & calibrations for Franatech methane sensor ID 22787
- New scalar data products for new instruments (1004,10604,22627,22787) see CRU-367
- Updated 'how to play' video in Digital Fishers
- UI improvements for Plotting Utility:
- Legend displays full size
- Reticle displays correct values as you pass over a chartline
- New Session and Clear Session buttons
- Saved plots are sorted alphabetically
- Improved calendar date-picker
- Right axis range is editable
- Reference link plots: make editable by choosing 'save'
- SeaTube now supports benthic videos as well as dive videos
- 'Dive in Progress' indicator for dives in – well, you know...
- JB-15 has modified parser to support new clock sensor
- Deliver driver & parser for Nortek Vector (Device ID 22795);
- 17 other devices were tested in preparation for cruise (results are on http://wiki.neptunecanada.ca/display/installation/Summer+2011+(Thompson) ,
- JB-15 was wet-tested for baseline engineering data
23 June 2011
VENUS:
Improvements
- Added manual QAQC results to QAQCRESULT table for DCF-04 to 11
New Features
- Added option to select level of QAQC when downloading VENUS data
- Created metadata file for VENUS raw Aquadopp files.
NEPTUNE:
Improvements
- Updated Andriod and iPhone graphics to support ONC branding.
- Change to Range Report title in Device Console status report
- Made Digital Fishers buttons and text larger
- Modified the way simulators handled tape files so that several simulators can run at the same time.
- Oceans 2.0 now supports the following browsers: Firefox 3, Firefox 4, Safari 4, Safari 5, Chrome, Internet Explorer 8, Internet Explorer 9.
- Added missing Instrument Documentation in the Wiki for junction boxes.
- If a camera is not powerable, it now shows up in the list but cannot be selected.
- Adjusted to new data format for A.G.O. temperature probe
- Changed Temp-mini Barionet driver to accomodate both piggyback and non-piggyback connections
- Digital Fishers can now select videos from mini-Zeus camera (ID 22779) in addition to ROPOS and Crawler camera.
- An Administrator can now switch between NEPTUNE, VENUS, and Brentwood College networks.
- New User Management now opens details by selecting a group or user from the selection tree.
- Exported annotation queries now includes Digital Fisher comments as well as choices.
- In Digital Fishers, after leaving a comment you no longer have to click outside the comment box before you are allowed to save the annotation.
- System Console no longer displays information that can be found on the Status Console.
- The word "Beta" was removed from the Plotting Utility page as it is now a stable application.
New Features
- Added exception handling to filedownload web service
- Clicking on NEPTUNE logo in DMAS or in Confluence (Projects) takes you to the NEPTUNE home page.
- Added time stamp sensor to Piezometer
- Link added to Wiki login page to allow users to retrieve a lost password.
- Links added on the Device Details pages to show documentation.
1 June 2011
VENUS:
Improvements
-
- 6 issues resolved (venus-1112 through 1116 plus 1072)
NEPTUNE:
Improvements
-
- Corrected issue with plot legends.
- Improved range report title in Device Console.
- Corrected issues with contents of Device Console instrument status report.
- Many improvements added to allow crowd-sourcing videos to be annotated with descriptions of what users see in 15 second clips, including tutorials for all levels and a basic "how to play" video and working Google map. For now this "Digital Fishers" feature is available only by typing the URL http://dmas.uvic.ca/DigitalFishersLanding
- Plotting Utility "auto refresh" function now updates time scale by the amount of the refresh interval (15 seconds to 1 hour), regardless of whether you select "Last XXX minutes" or a custom time range.
- Several improvements to the new User Management feature.
- Device Console status report now has correct date and time in Excel export.
New Features
-
- Added Brentwood College as a network choice (not fully implemented yet)
26 May 2011
VENUS:
Improvements
-
- Support multiple attributes for data QAQC service
- Region and location id saved to search table when searching VENUS Multimedia Archive
- Sybase-AD database migration (DMAS infrastructure upgrade)
New Features
NEPTUNE:
Improvements
-
- Several enhancements to instrument status report in New Device Console.
- Added new instrument (ROS lights).
- Improvements to the way users can add annotations.
- Plotting Utility now states that times are in UTC.
- VPS devices are filtered out of data searches.
- Data Search subsampling changed to a default rate of hourly.
- Annotation Query page now shows the source of the annotations.
- Data Search now gives feedback on certain types of searches (anything involving MATLAB), showing the progress.
- Some improvements to make user interface more consistent across pages.
- Added Device ID to the listing in Reprocessing Console.
- Electrical rating for devices now includes non-integers
- Neptune Search: map label clearly indicates "current location" of instrument
New Features
-
- Created a weekly search summary report.
- Warning message when select a time range greater than 90 days in Data Search (takes a long time to run).
- You can now cancel a data search that you have started.
- New feature added for crowd-sourcing videos to annotate them with descriptions of what users see in 15 second clips. For now this "Digital Fishers" feature is available only by typing the URL http://dmas.uvic.ca/DigitalFishersLanding
- Added Instrument Status pages in New Device Console.
- Data archiving database migrated from Sybase to Oracle.
9 May 2011
VENUS:
Improvements
-
- VENUS Matlab code for downloading data recognizes data QAQC return.
- VENUS WebPlots recognizes data QAQC return.
- New driver, parser for device 1050 Paroscientific Pressure
- Changes to hydrophone processes for May cruise
New Features
-
- FTP process for VENUS Digital Still Camera
- Page level permissions based on selected network. Eg. Data Search for VENUS will only show VENUS instruments. SeaTube for VENUS will only show VENUS dives.
NEPTUNE:
Improvements
-
- In the Data Search and Plotting Utility pages (and others), if a communications failure happens you will now get a warning message with instructions to reload the page (dmas-5995).
- In Plotting Utility, Y axis label is now rotated for easier reading.
- References to NEPTUNE and VENUS are changed from "observatory" to "network".
- Improvements to annotations and corrections to SeaTube dive video labels (dmas-5569).
- Improvements to CodeRunner helper functions and templates (dmas-5127).
- User-friendly messages when DataSearch fails due to database or dmas connectivity issues (dmas-5931).
New Features
-
- New device: Remote Ocean Systems cameras. Deviceid 12161, 12162, 12163, 12164.
- Plotting Utility now has local help.
- Customizable URLs for Data Search Project, Instrument Type, and Project items for different networks.
- Log alert when archiver writes data to file instead of to database.
- Added new sensor (4339) with dark correction for the PAR device.
- Page level permissions based on selected network. Eg. Data Search for NEPTUNE will only show NEPTUNE instruments.
- DMAS web telnet modified to work with CSEM Receiver 22003.
- Quick response messaging for the following device types. Instruments will still respond in the event of messaging backlog.
- junction boxes
- ROS Pan/Tilt (including B&W cameras)
- Panasonic HD camera
- CSEM receiver and transmitter
- McClane Sediment trap
14 April 2011
VENUS:
Improvements
-
- MATLAB log written to screen (captured to Splunk)
- Correct calibration "datefrom" to reflect cancelled February cruise
New Features
NEPTUNE:
Improvements
-
- Scheduler now supported on multiple machines
- The engineering data (latest readings only) comes directly from the driver, bypassing the database.
- VPS viewer had changes to units of measurement.
- The BPR driver has minor modification so it responds correctly to the confirmation prompt.
- Instrument Status report enhancements.
- Annotations Query now supports Excel downloads.
New Features
-
- The Nortek ACMs and the RDI ADCP on the LBOx has the voltage data parsed for trouble shooting of the instruments. This request was made by the PIs from IOS.
- VPS Viewer with two tabs - Platform Controller and Instrument Package.
- Added function to WetLabs FLNTU driver to open and close the bio-wipe shutter at a configurable interval.
- Added manufacturer feedback on derived value calculation for Pro Oceanus 22773.
- Add "compromised" to sensor names and remove commissioning flag for WET Labs 20221.
- All pages and services should only display or work with instruments that were at some point part of the current network the user is browsing. Eg. VENUS, NEPTUNE, and Brentwood College.
- Added time-stamped annotations on all resources that have a user interface - eg. sensors.
28 March 2011
VENUS:
Improvements
-
- Fix State of the Ocean matlab code for Saanich Inlet VIP Oxygen
New Features
-
- Active-Streaming Format (ASF) data format for Multimedia Archive
- add raw Aquadopp, LISST and RDI ADCP data products to VENUS download page
- new subversion repository structure for VENUS code
NEPTUNE:
Improvements
-
- Camera control through Java Management Extensions (JMX) interface for SysAdmins
- Many Plotting Utility enhancements:
- Cross-browser support (IE, Firefox, Safari, Chrome)
- Share saved plot with reference URL;
- Plot to PNG,
- edit chart style & colours,
- text panel clearly indicates if readings are averaged; "Coming soon" deleted
- On-hover reticle displays devicename, sensorname, sensor reading and timestamp
- On-hover legend displays full sensor name
- Delete saved plot working
- Highlight current data session
- Pseudo-live mode (auto-refresh every 10 minutes)
- Device Console (new):
- checkbox added to Jira tab to show/hide closed tickets (user can view current & past tickets on an instrument)
- Support IE8
- Diagram tab enhancements
- 10x improvement in performance
New Features
-
- Vertical Profiler System (VPS) viewer (powerfeed, temperature, CPU status & motor sensors on VPS)
- New data products for VPS instruments (DMAS-5646)
- Improved archiver service: combine raw data, sensor reading, device attribute, event detected, and QAQC result in a single transaction, saved to XML on failed archive event. (DMAS-5777)
- Data Search displays data availability in different colour when site changes (green for current site, grey for past sites)
- [Device Console|http://dmas.uvic.ca/DC] (new): right-click on column headings to show/hide/rearrange and multisort. User preferences are saved to database
- Scheduled daily job to verify hourly & quarterly data
- Camera control :
- "Sweep" for slow camera movement
- Permissions and driver refactoring
2 March 2011
VENUS:
Improvements
-
- FTP process for Instrument Concepts Hydrophone
- FTP process for NRCan StarDot webcam
- Link files and store in galleryaccess
- Data format ASF for Axis webcam
- Alter webservices to return QAQC test result, information & values for VENUS searches
New Features
-
- Cruise preparation: new devices in database
- New driver: OSU Nortec Vector Boxer system
- New VENUS SIIM - S30008
NEPTUNE:
Improvements
-
- High resolution option in SeaTube
- Additional SeaTube enhancements
- Improved performance of camera control messaging
- Annotations 'edit annotation in context' improvements
- Refactoring of full page apps
- DMAS cache performance improvement
- Primary Sensor page load performance improvement
- VPS parser
- Coderunner improvement for published packages
- Coderunner 'synchronize to repository' menu
- Browser telnet now supports control characters
- Junction Box View improvements
- Convert NEPTUNE search "data availability" to widget (to be integrated with Plotting Utility)
New Features
3 February 2011
VENUS:
Improvements
-
- Data QAQC model, step 2
- QAQC observatory level test values (ref: VENUS-1021)
New Features
-
- Add VENUS logo to scalar auto, State of the Ocean plots
- Modify State of the Ocean metadata to clearly display spatial reference information
NEPTUNE:
Improvements
-
- Coderunner UI; right-clicking folder highlights
- Junction Box readings display immediately in datacentre (refactored messaging)
- Refactor group privilege to support multiple resource type
- Fine grain permissions for camera operation (also telnet & device attributes)
- Updated Endeavour map
- Move observatory configuration properties from Java file to database
- Coderunner metadata (name, description, version) on published packages
- DeviceSearch improvements
- updated dive log entries in SeaTube
- Device documentation published on NEPTUNE wiki
- Data Search displays all instruments by Location, Instrument type (currently connected visible in Topology)
- single WAV files now display appropriate icon
- Device Console ver 2 (collapsable treeview, show all tickets by JB/Device/JVM)
New Features
-
- Data Search: added IRIS link to Interoperability menu
- SeaTube displays icons for frame grabs & digital stills
- User annotations for Device Data and Dives (e.g., B& W cameras, dive metadata in addition to video annotations)
- Links to wiki instruments pages from Data Search
- Summary data for light usage on Pod cameras
Bug fixes
10 January 2011
VENUS:
-
- ADDED: StateOfOcean_webfiles.m: a new set of data products that highlight the annual variability of the VENUS time series
\[[edit|http://wiki.neptune.uvic.ca/wiki/index.php?title=Branch_-_New_Feature_Release_Notes&action=edit§ion=4]\] |
NEPTUNE:
Improvements
-
- Device Console (beta) improves functionality, links devices to Jira tickets
-
- Device-level permissions for Camera operators, Telnet, Device Attributes
-
- Reprocessing moved from data centre machine to task machine (improves performance on large reprocessing jobs)
-
- INew caching library improves performance
New Features
-
- Annotations query for devices and dive videos in SeaTube
-
- Changed tile of RDI ADCP % Good plots from "Beam" to "Field"
30 November 2010
VENUS:
Improvements:
-
- HTML metadata now visible for midnight plots (data quality, spatial data organization, data citation info, etc.) (ref: VENUS-984)
- Gallery web service: update multimedia products with SSV2 search service
New Features:
-
- Import VENUS dive videos into AD and datafile
NEPTUNE:
Improvements:
-
- Plotting Utility time offset causes plots to 'disappear'
- login page updated to match new UI
New Features:
9 November 2010
Improvements
-
- Significant changes to User Interface of CodeRunner, also optimized web services.
- Disable old 'admin menu' landing pages. Menus are now populated based on user group permissions.
- Reverse Sort Dives in SeaTube. Menu sorts much faster, with most recent dives first.
- "Location" drop-down populates much faster in Plotting Utility, Data Search.
- CodeRunner now supports templates that are packages.
New Features
-
- New calibration values for BARS 15002 "calculated temperature" sensor.
- New sensors created for ACM (13053, 13054, 13055 and 13056) – VE, VMag, VN and Vup
- New data products for ROS pan and tilts on black and white cameras
- Parse and store ancillary sensor data for RDI ADCPS (device type 8 and 137) DMASEX-127
- Sensortypes on Nortek ACM now associated with data product
- Data products for M1000 temperature probe
- Sensors and parser for Satlantic Nitrate device 22774
Changes
-
- Unit Change for WETLabs Fluorometer (12116).