Cruisers Forum
 


Reply
 
Thread Tools Search this Thread Rate Thread Display Modes
Old 14-06-2017, 21:47   #1
Registered User

Join Date: Jun 2017
Posts: 1
Automate the GRIB files retrieval

Hi All,

Currently using OpenCPN with the GRIB viewer, and using the email transaction to retrieve GRIB files.
Is there a way to just get OpenCPN download the GRIB files from a web service instead of manually sending an email then storing the attachement received?

Thank you
rodanger is offline   Reply With Quote
Old 15-06-2017, 03:53   #2
Registered User

Join Date: Oct 2014
Posts: 268
Re: Automate the GRIB files retrieval

I use ZyGrib to view and download gribs while I have Internet access. This is mentioned near the bottom of the Grib Plugin section of the OpenCPN Manual.

Quote:
More to know

ZyGrib is a free and open-source software (FOSS) dedicated grib viewer. Grib files can be downloaded by ZyGrib and then opened in OpenCPN.
Here is the link to ZyGrib.org:

zyGrib: grib file, weather data visualization

Paul
.Paul. is offline   Reply With Quote
Old 15-06-2017, 04:25   #3
cruiser

Join Date: Nov 2007
Location: Probably in an anchorage or a boatyard..
Boat: Ebbtide 33' steel cutter
Posts: 5,031
Re: Automate the GRIB files retrieval

Quote:
Originally Posted by rodanger View Post
Hi All,

Currently using OpenCPN with the GRIB viewer, and using the email transaction to retrieve GRIB files.
Is there a way to just get OpenCPN download the GRIB files from a web service instead of manually sending an email then storing the attachement received?

Thank you
Been thinking the same recently, but not getting very far. Looks like you can get gribs using command line scripts or curl but too complex for me so far, maybe a few late nights with buckets of coffee might get somewhere , another possibility might be using node-red to send and recieve the emails then save the attachment somewhere but again, first glance looks like the stock email node isn't great with attachments.
Anyone know more care to share? Would be nice always having the most recent grib saved automatically. Ta
conachair is offline   Reply With Quote
Old 15-06-2017, 04:57   #4
Registered User

Join Date: Jul 2010
Location: Kalamata, Greece
Boat: Amel Sharki
Posts: 2,145
Re: Automate the GRIB files retrieval

Quote:
Originally Posted by conachair View Post
Been thinking the same recently, but not getting very far. Looks like you can get gribs using command line scripts or curl but too complex for me so far, maybe a few late nights with buckets of coffee might get somewhere , another possibility might be using node-red to send and recieve the emails then save the attachment somewhere but again, first glance looks like the stock email node isn't great with attachments.
Anyone know more care to share? Would be nice always having the most recent grib saved automatically. Ta
Some functions of the grib plugin has been used from the sources of zyGrib which is opensource with source code available. But sadly not any function to get easily grib data. A server is needed to process the users requests and get the specified data from NOAA sending them to the requesting user done by php scripts. Reading the sources of zyGrib anyone can see how this works.

Gerhard
CarCode is online now   Reply With Quote
Old 15-06-2017, 05:48   #5
Marine Service Provider
 
bdbcat's Avatar

Join Date: Mar 2008
Posts: 6,178
Re: Automate the GRIB files retrieval

Folks...

Take a look at this:

GRIB Filter

and this:
Scripting grib_filter on NCEP's nomads server

Several GRIB models are available....

Essentially, you build a complex URL with many parameters, and submit a GET method call to the NOAA servers. Down comes the filtered GRIB.

Would be a nice addition to the GRIB Plugin...

Dave
bdbcat is offline   Reply With Quote
Old 15-06-2017, 06:58   #6
Registered User

Join Date: Aug 2009
Location: oriental
Boat: crowther trimaran 33
Posts: 3,698
Re: Automate the GRIB files retrieval

We cannot use the code in zygrib for this without permission from zygrib as it would use the server's bandwidth for opencpn use.

I think grabbing directly from noaa as mentioned should be implemented, but also possible is to host grib data from opencpn.org? Do we have the bandwidth to run a webapp for this?
seandepagnier is offline   Reply With Quote
Old 15-06-2017, 07:16   #7
Marine Service Provider
 
bdbcat's Avatar

Join Date: Mar 2008
Posts: 6,178
Re: Automate the GRIB files retrieval

Sean...

opencpn.org bandwidth: Of course, we don't know how much demand we would see from a grib server, so it would be hard to estimate. But surely it is worth prototyping, just to see....

If we need more bandwidth from our ISP, we could fund this by donations, I would think.

First GRIB model to consider, I think, would be NOAA RTOFS. NOAA discontinued the grib-filter support for this model, so there is no easy way to get reduced-area/reduced-value GRIBs from this model. It is all, or nothing. All is huge....

And then maybe the high-definition Euro models....

Dave
bdbcat is offline   Reply With Quote
Old 15-06-2017, 08:40   #8
Registered User
 
sailorF54's Avatar

Join Date: Dec 2009
Location: Perros-Guirec, France
Boat: Jeanneau Sunshine 36
Posts: 979
Re: Automate the GRIB files retrieval

Quote:
Originally Posted by bdbcat View Post
Sean...

[snip]

And then maybe the high-definition Euro models....

Dave
The 0.01° gribs from Meteo-France (AromeHD) are available in 'chunks' covering a large part of Western Europe here (courtesy of Olivier Bouyssou of Weather4D fame) (Grib1 format, wind and sea-level pressure, North Sea, Channel, France Atlantic, Lion Gulf, Corsica, Balearic Islands, 8 to 23 Mo, hourly for 2 days)
Index of /AromeHD
They are extracted from HUGE public downloads (in grib2 format, with a wealth of parameters at many altitude levels available from Meteo-France)
Answering a question of mine on a French Forum when first announced, Olivier mentioned that he did not fear being overwhelmed by download requests.
Attached Thumbnails
Click image for larger version

Name:	ScreenShot.JPG
Views:	88
Size:	199.2 KB
ID:	149953   Click image for larger version

Name:	ScreenShot 001.JPG
Views:	91
Size:	128.2 KB
ID:	149954  

Click image for larger version

Name:	ScreenShot 002.JPG
Views:	79
Size:	193.8 KB
ID:	149955   Click image for larger version

Name:	ScreenShot 003.JPG
Views:	94
Size:	122.4 KB
ID:	149956  

Click image for larger version

Name:	ScreenShot 004.JPG
Views:	91
Size:	151.7 KB
ID:	149957   Click image for larger version

Name:	ScreenShot 005.JPG
Views:	99
Size:	154.8 KB
ID:	149958  

Click image for larger version

Name:	ScreenShot 006.JPG
Views:	101
Size:	186.0 KB
ID:	149959  
sailorF54 is offline   Reply With Quote
Old 23-06-2017, 03:01   #9
Registered User
 
rgleason's Avatar

Join Date: Mar 2012
Location: Boston, MA
Boat: 1981 Bristol 32 Sloop
Posts: 14,431
Re: Automate the GRIB files retrieval

Yes. This would be ideal. I also think the download page would be popular.
rgleason is offline   Reply With Quote
Old 05-07-2017, 04:53   #10
Registered User
 
rgleason's Avatar

Join Date: Mar 2012
Location: Boston, MA
Boat: 1981 Bristol 32 Sloop
Posts: 14,431
Re: Automate the GRIB files retrieval

We shouldn't lose track of this for NCEP nomads. I have put in a request to to reenable the Gribs filter for rtofs and it was received positively, with a response that they would put it on the list for the next cycle and would try to do it.

The area where rtofs need improvement, I believe, is in the representation of near coastal tidal currents. There are significant commercial advantages in making these improvements, including assisting in hurricane surge predictions, neap (period of moderate tides after equinoxal) and excessive equinoxal tides, in a time when coastal assets are at risk. However logical this is, the agency is stressed to even provide the current assets and resources, is under funded and will not be able to provide improvements, without having greater support from the administration and congress.
rgleason is offline   Reply With Quote
Old 05-07-2017, 04:57   #11
Registered User
 
rgleason's Avatar

Join Date: Mar 2012
Location: Boston, MA
Boat: 1981 Bristol 32 Sloop
Posts: 14,431
Re: Automate the GRIB files retrieval

So yes, I think a website page that enables all sailors to utilize the present assets would be very helpful, and I would hope the community would pitch in and help get bdbcat's suggestion going in whatever way they can help. I will certainly try to help.
rgleason is offline   Reply With Quote
Reply

Tags
rib

Thread Tools Search this Thread
Search this Thread:

Advanced Search
Display Modes Rate This Thread
Rate This Thread:

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are Off
Pingbacks are Off
Refbacks are Off


Similar Threads
Thread Thread Starter Forum Replies Last Post
Predictwind´s .pwr files to .grb files? andreas.mehlin Navigation 0 16-02-2017 08:03
Can You Automate the Sailing Process? Ahangar General Sailing Forum 29 31-08-2012 08:47
Grib Files and Grib Fantasies maxingout General Sailing Forum 4 16-01-2010 15:54
grib files question Therapy Seamanship & Boat Handling 7 12-12-2007 05:52
Grib Files - Easy to use Source jemsea Marine Electronics 0 13-02-2007 10:49

Advertise Here


All times are GMT -7. The time now is 04:45.


Google+
Powered by vBulletin® Version 3.8.8 Beta 1
Copyright ©2000 - 2020, vBulletin Solutions, Inc.
Social Knowledge Networks
Powered by vBulletin® Version 3.8.8 Beta 1
Copyright ©2000 - 2020, vBulletin Solutions, Inc.

ShowCase vBulletin Plugins by Drive Thru Online, Inc.