Visit our Popular Forums

**Dockhead** · 05-07-2018, 02:29

We are using ice charts from the Danish Weather Service, here: East Greenland: DMI

You can download them in color or B&W, and the size of the files is very reasonable.

But the link is not fixed, such that you could order the download via SailDocs with the "send" webpage command. I guess we could get the main page and then parse the link out of it, and request that -- maybe not a big deal since we have the Iridium unlimited data plan.

Does anyone have a better way to do this?

I guess we could simply have the charts emailed to us by someone on land.

**Pete7** · 05-07-2018, 03:35

I wonder if they realise that folk are downloading over limited bandwidths and if they made the chart link a standard format by skipping the time and just go with the date it would make life a lot easier to guess the next chart. Shame it isn't a daily service, then it would be really easy.

How about sending them an e mail, after all a lot of folk near Greenland who needs these are gong to be on limited bandwidths.

Pete

Auspicious · 05-07-2018, 03:52

NOAA has Atlantic ice edge as a weather fax product. UK MET has ice accretion as a weather fax.

conachair · 05-07-2018, 03:59

I've just had a play around on https://www.pythonanywhere.com

Almost but not quite got it to send an email with the parsed b/w link addresses, works with python on the laptop, code if anyone is interested >

Code:

from bs4 import BeautifulSoup
import urllib.request as urllib2
import re
import smtplib
 
fromaddr = '****'
toaddrs  = '******' 
server = smtplib.SMTP("smtp.gmail.com:587")
server.starttls()
server.login('***gmail.com','******')
  
html_page = urllib2.urlopen("http://www.dmi.dk/en/hav/groenland-og-arktis/iskort/oestgroenland/")
soup = BeautifulSoup(html_page, 'html.parser')

msg = ''
for link in soup.findAll('a', attrs={'href': re.compile("^/uploads/tx_dmidatastore/webservice/W/B")}):
     print('http://www.dmi.dk' +link.get('href'))
    msg +='http://www.dmi.dk' + link.get('href') + '\n'
server.sendmail(fromaddr, toaddrs, msg)

results in >

Quote:

I should be able to get the authentication working on pythonanywhere and then if you like I could either auto email to you once a day or probably save the results as a webpage then you could get it with sailmail.

**Dockhead** · 05-07-2018, 04:22

Quote:

Originally Posted by conachair

I've just had a play around on https://www.pythonanywhere.com

Almost but not quite got it to send an email with the parsed b/w link addresses, works with python on the laptop, code if anyone is interested >

Code:

from bs4 import BeautifulSoup
import urllib.request as urllib2
import re
import smtplib
 
fromaddr = '****'
toaddrs  = '******' 
server = smtplib.SMTP("smtp.gmail.com:587")
server.starttls()
server.login('***gmail.com','******')
  
html_page = urllib2.urlopen("http://www.dmi.dk/en/hav/groenland-og-arktis/iskort/oestgroenland/")
soup = BeautifulSoup(html_page, 'html.parser')

msg = ''
for link in soup.findAll('a', attrs={'href': re.compile("^/uploads/tx_dmidatastore/webservice/W/B")}):
     print('http://www.dmi.dk' +link.get('href'))
    msg +='http://www.dmi.dk' + link.get('href') + '\n'
server.sendmail(fromaddr, toaddrs, msg)

results in >

I should be able to get the authentication working on pythonanywhere and then if you like I could either auto email to you once a day or probably save the results as a webpage then you could get it with sailmail.

That would be great!! Either of those variants would be great and would solve the problem. A bottle from me for that.

conachair · 05-07-2018, 04:40

Quote:

Originally Posted by Dockhead

That would be great!! Either of those variants would be great and would solve the problem. A bottle from me for that.

PMed a link, might even work

No bottle required, learning bit more python is reward enough

**Pete7** · 05-07-2018, 04:48

Alternatively this image is 329kb. However, the path looks like the old file is over written each day so the link will always be the same.

https://nsidc.org/greenland-today/im...daily_melt.png

**Dockhead** · 05-07-2018, 04:59

Quote:

Originally Posted by Pete7

Alternatively this image is 329kb. However, the path looks like the old file is over written each day so the link will always be the same.

https://nsidc.org/greenland-today/im...daily_melt.png

That's cool! But unfortunately not an ice chart which can be used for navigation, which looks like this:

chart3_East_201807032000_Colour.pdf

**Pete7** · 05-07-2018, 05:21

Ah yes. Those longitude lines get close quick don't they.

Pete

conachair · 05-07-2018, 05:30

That link looks like it will hopefully update the links once an hour forever, with a UTC timestamp at the top of the page.

conachair · 05-07-2018, 06:02

Quote:

Originally Posted by conachair

That link looks like it will hopefully update the links once an hour forever, with a UTC timestamp at the top of the page.

Was it black n white you wanted?

deblen · 05-07-2018, 06:04

https://seaice.uni-bremen.de/sea-ice-concentration/

**Dockhead** · 05-07-2018, 06:19

Quote:

Originally Posted by conachair

Was it black n white you wanted?

Yes, thank you.

inlogo · 05-07-2018, 06:34

Thanks for your question, it's difficult and have many answers

conachair · 08-07-2018, 07:03

Quote:

Originally Posted by Dockhead

Yes, thank you.

Bit more python fun and I have the charts downloaded into pythonanywhere with static filenames, might make it a little easier to download. these will get downloaded from the dmi site once an hour >
https://www.pythonanywhere.com/user/...ce/chart_0.pdf
etc from '.../chart_0' to '.../chart_9'

From a run just now - >

Quote: