Cruisers Forum
 


Join CruisersForum Today

Reply
 
Thread Tools Search this Thread Rate Thread Display Modes
Old 12-10-2017, 07:46   #1
Registered User

Join Date: Oct 2017
Posts: 3
Climatology Plugin Data Sources

Hey all,

Sorry if this info is already somewhere in the forum, I couldn't find it after using the search bar for 20 minutes and also after going through the plugin page on the OpenCPN web page. I'm interested in knowing the data sources being used in the Climatology plug-in, specifically:

- Where is the data being pulled from to form the climatology, what climate services are being used?
- Is the data being pulled at a regular frequency, i.e daily, weekly, etc., or it requires a manual process

Anyone can help me answer these questions?

Thanks,
Waqas.
__________________

waqas.qazi is offline   Reply With Quote
Old 12-10-2017, 08:35   #2
Registered User
 
rgleason's Avatar

Join Date: Mar 2012
Location: Boston, MA
Boat: 1981 Bristol 32 Sloop
Posts: 13,530
Re: Climatology Plugin Data Sources

It is not found in the forum. Try the Manual for the Plugin, it is there.

By the way, would you mind explaining your interest?
__________________

rgleason is offline   Reply With Quote
Old 16-10-2017, 02:38   #3
Registered User

Join Date: Oct 2017
Posts: 3
Re: Climatology Plugin Data Sources

Thanks, I'm looking at the plug-in manual page, there is lot of info there, but unfortunately no clear description of data sources:

https://opencpn.org/wiki/dokuwiki/do...er:climatology

I'm working as part of a research group at Chalmers Univ., Sweden, and we are evaluating sailing weather+climate route optimisation services, and the OpenCPN climatology plugin tool looks really interesting! Wondering what kind of various / fixed data input sources this plugin pulls in data from to function?
waqas.qazi is offline   Reply With Quote
Old 16-10-2017, 10:35   #4
Registered User
 
rgleason's Avatar

Join Date: Mar 2012
Location: Boston, MA
Boat: 1981 Bristol 32 Sloop
Posts: 13,530
Re: Climatology Plugin Data Sources

Warning about use of Data

Quote:
Weather_routing is only as good as the data provided by the Grib plugin and the Climatology plugin.
  1. Climatology plugin: Depends on a separate set of files that must be downloaded, extracted and placed in the proper directory. Climatology data is generally averaged since the 1980's depending on data type and sources available (for example, Wind data is averaged 6 hr data since 1987). The entire source data set is over 180 gb, however after averaging and compression it becomes about 7mb. There are various macro factors which affect weather over a given season which should be considered, including El Nino, Gulf stream, etc. Climatology has averaged these effects.
  2. These planning tools may be helpful, but should be taken with a healthy “grain of salt” as any good sailor (who looks out to the horizon) should know. -Rick Gleason
Sean D'Epagnier is the programmer and I worked on this. I basically downloaded 130gb of data from a number of sources (a lot of it NOAA databases & other sources that were public opensource) for each parameter, spanning about 32 years of data. Sean was the mastermind, and would give me linux programs to compress the data. He manage to get the 130gb down to about 7mb which is used in Sean's plugin "Climatology".

If you would like, I might be able to find a more definitive list of our sources, but because this particular data landscape has changed over the years since doing it, some of the sources may have morphed, merged, changed or dropped.

The data is "static" because at the time this was done "real time" data was really quite unheard of.

Look at this thread

http://www.cruisersforum.com/forums/f134/climatology-database-search-104418-2.html#post1319396

and back at the beginning of this thread

Climatology

For some of the things we were considering.
rgleason is offline   Reply With Quote
Old 16-10-2017, 10:40   #5
Registered User
 
rgleason's Avatar

Join Date: Mar 2012
Location: Boston, MA
Boat: 1981 Bristol 32 Sloop
Posts: 13,530
Re: Climatology Plugin Data Sources

This post may be some help.
Climatology - Database Search

Also the bottom of this post

Climatology - Database Search
rgleason is offline   Reply With Quote
Old 16-10-2017, 10:47   #6
Registered User
 
rgleason's Avatar

Join Date: Mar 2012
Location: Boston, MA
Boat: 1981 Bristol 32 Sloop
Posts: 13,530
Re: Climatology Plugin Data Sources

If you know of good public sources for world wide

Shipping Routes & Heavy Shipping
Fog
Lightning
Piracy
Maritime Distress SART reporting
rgleason is offline   Reply With Quote
Old 16-10-2017, 13:35   #7
Registered User
 
boat_alexandra's Avatar

Join Date: Aug 2009
Location: charleston
Boat: bristol 27
Posts: 3,501
Re: Climatology Plugin Data Sources

If you click "config" from the climatology dialog and see the "about" tab the sources are listed.
boat_alexandra is offline   Reply With Quote
Old 17-10-2017, 06:46   #8
Registered User

Join Date: Oct 2017
Posts: 3
Re: Climatology Plugin Data Sources

Thanks all, this is great info for what I needed to know.
waqas.qazi is offline   Reply With Quote
Old 22-02-2018, 16:27   #9
Registered User

Join Date: Aug 2009
Location: Onboard, currently cruising the Solomon Islands, Western Pacific
Boat: St. Francis 44 Mk II (Catamaran)
Posts: 75
Send a message via Skype™ to SoggyPaws
Re: Climatology Plugin Data Sources

With the current warming trend in the world, it seems like weather patterns are changing pretty quickly.

It must have been a massive effort to put the Climatology database together (thank you very much!!), and I know how much the location of and access to the data has been changing...

Wondering if there is planned an attempt to update the data, especially the hurricane/cyclone/typhoon tracks. The Source Forge database was posted in 2015, so it probably only contains data up to around 2014??

Thanks for all you do, guys!!

Sherry
SoggyPaws is offline   Reply With Quote
Old 22-02-2018, 20:11   #10
Registered User
 
boat_alexandra's Avatar

Join Date: Aug 2009
Location: charleston
Boat: bristol 27
Posts: 3,501
Re: Climatology Plugin Data Sources

Yes, actually my plan to display changing patterns.

Maybe the easiest is a checkbox to use either the full 30 years, or only the last 10. 10 years is not long enough, so anomalies will exist.

Otherwise, what would you suggest the best way to highlight changing weather patterns?
boat_alexandra is offline   Reply With Quote
Old 28-04-2019, 06:37   #11
Registered User
 
LeaseOnLife's Avatar

Join Date: Apr 2008
Location: out cruising again, currently in Pacific - Mexico
Boat: Sailboat
Posts: 1,266
Re: Climatology Plugin Data Sources

From what I read above (soggypaws, thank you), currently the cyclone data are only up to 2014? I am on the E Pacific side of Central America and have looked at early season tracks on this side via:


https://www.nhc.noaa.gov/data/tracks...s-ep-2018a.png
https://www.nhc.noaa.gov/data/tracks...s-ep-2017a.png
https://www.nhc.noaa.gov/data/tracks...s-ep-2016a.png
https://www.nhc.noaa.gov/data/tracks...s-ep-2015a.png


This quick check seems to confirm, data from 2015 - 2018 are missing in climatology_pi. This is crucial, since hurricanes tracked earlier and closer to shore, vs the years before.



I am all for the having a select-able year-range to display cyclone tracks. But having the newer data included in the database is more important, since the cyclone do appear earlier.



I tried to follow the link for data sources (www.unisys.com) but there website is cumbersome to find anything from there.


Dirk
LeaseOnLife is offline   Reply With Quote
Old 29-04-2019, 09:13   #12
Registered User
 
boat_alexandra's Avatar

Join Date: Aug 2009
Location: charleston
Boat: bristol 27
Posts: 3,501
Re: Climatology Plugin Data Sources

Quote:
Originally Posted by LeaseOnLife View Post
From what I read above (soggypaws, thank you), currently the cyclone data are only up to 2014? I am on the E Pacific side of Central America and have looked at early season tracks on this side via:


https://www.nhc.noaa.gov/data/tracks...s-ep-2018a.png
https://www.nhc.noaa.gov/data/tracks...s-ep-2017a.png
https://www.nhc.noaa.gov/data/tracks...s-ep-2016a.png
https://www.nhc.noaa.gov/data/tracks...s-ep-2015a.png


This quick check seems to confirm, data from 2015 - 2018 are missing in climatology_pi. This is crucial, since hurricanes tracked earlier and closer to shore, vs the years before.
yes

Quote:
I am all for the having a select-able year-range to display cyclone tracks. But having the newer data included in the database is more important, since the cyclone do appear earlier.



I tried to follow the link for data sources (www.unisys.com) but there website is cumbersome to find anything from there.


Dirk

I don't know about a few years of missing cyclone data making a huge difference in the cyclone areas but it is nice and the weather trends are changing this fast, then the next few years will have even less predictable weather making climatology less useful



I have not the time to update it now but gladly accept pull requests to the climatology data repository on github.
boat_alexandra is offline   Reply With Quote
Old 30-04-2019, 05:56   #13
Registered User
 
rgleason's Avatar

Join Date: Mar 2012
Location: Boston, MA
Boat: 1981 Bristol 32 Sloop
Posts: 13,530
Re: Climatology Plugin Data Sources

I believe Sean made these tracks into a text file which was then processed to be compresed in a database form.
Is there an example of the format needed Sean?
rgleason is offline   Reply With Quote
Old 30-04-2019, 10:28   #14
Registered User
 
LeaseOnLife's Avatar

Join Date: Apr 2008
Location: out cruising again, currently in Pacific - Mexico
Boat: Sailboat
Posts: 1,266
Re: Climatology Plugin Data Sources

gencyclonedata.cpp currently points to
Code:
/*
weather.unisys.com has:
       tracks.epa   tracks.nio
       tracks.atl tracks.wpa  tracks.she 
       tracks.spa.dat -- is concatination of all the files in that folder
*/
But I have had no luck finding these files there. Is above still valid?
LeaseOnLife is offline   Reply With Quote
Old 30-04-2019, 10:31   #15
Registered User
 
LeaseOnLife's Avatar

Join Date: Apr 2008
Location: out cruising again, currently in Pacific - Mexico
Boat: Sailboat
Posts: 1,266
Re: Climatology Plugin Data Sources

plus, Climate-Data-Process.txt has a lot of text, but points to local shares on someones PC, not so helpful. It also says: Download the "cyclone-data.tar.bz2" file, but from where?
__________________

LeaseOnLife is offline   Reply With Quote
Reply

Tags
plug

Thread Tools Search this Thread
Search this Thread:

Advanced Search
Display Modes Rate This Thread
Rate This Thread:

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are Off
Pingbacks are Off
Refbacks are Off


Similar Threads
Thread Thread Starter Forum Replies Last Post
Climatology boat_alexandra OpenCPN 470 02-06-2019 23:34
NMEA Failover Data Sources Dockhead Marine Electronics 50 28-03-2014 08:04
Help connecting our NMEA data sources offgridcanuck Marine Electronics 1 29-01-2014 11:17
Question About Alternative Data Sources in N2K Dockhead Marine Electronics 1 27-08-2013 05:58
Favorite sources for historic data? thompsonisland Weather | Gear, Reports and Resources 3 03-11-2012 06:07

Advertise Here


Copyright 2002- Social Knowledge, LLC All Rights Reserved.

All times are GMT -7. The time now is 14:33.


Google+
Powered by vBulletin® Version 3.8.8 Beta 1
Copyright ©2000 - 2019, vBulletin Solutions, Inc.
Social Knowledge Networks
Powered by vBulletin® Version 3.8.8 Beta 1
Copyright ©2000 - 2019, vBulletin Solutions, Inc.
×

ShowCase vBulletin Plugins by Drive Thru Online, Inc.