Charts II: NGA - 2700 Charts

[r.fairman]

With re to leaseonlife trying to create a bsb file. Here is the contents of a bsb file that goes with a .kap chart of canadian waters BSB 3 not 4

!Copyright 1996, NDI. All Rights Reserved
CHT/NA=JUAN DE FUCA STRAIT TO/ A DIXON ENTRANCE,NU=3000
CHF/GENERAL
CED/SE=3000, RE= 300001, ED=04/16/97
VER/1.1
CHK/1,300001
CGD/UNKNOWN
ORG/Nautical Data International Inc., 1 Military Rd., P.O. Box 127, Station C S
t. John's, NF, A1C 5H5, on behalf of: Canadian Hydrographic Service, 615 Bo
oth St., Room 237, Ottawa, Ontario, K1A 0E6

K01/NA=JUAN DE FUCA STRAIT TO/ A DIXON ENTRANCE,NU=3000,TY=BASE,FN=300001.kap

[Surveyor]

Originally Posted by LeaseOnLife

added to my list.

16 of your missing files are here, so far no misses:
4shared folder - Region-9

I hope you grab them and upload them, right? Would be good if complete sets are kept somewhere else than just one server...

Thank you, yes I will grab them and upload.

[LeaseOnLife]

Region 6 upload is complete (minus the chart 61601, the ruby script fails on)

On to the next chapter. I grab Region "Miscellaneous", haven't seen anybody mention it, so I just grab all 99 charts. (Just who wants to sail to Antarctica...)

[LeaseOnLife]

.bsb file content to satisfy Fugawi and RayTech

Here is an early result of my trials:

!Copyright 1996, NDI. All Rights Reserved
    !Comment...
CHT/NA=VANCOUVER ISLAND JUAN DE FUCA STRAIT TO ,NU=3001
    !above line needed by RayTech but not by Fugawi
CHF/GENERAL
    !Fugawi and RayTech don't need CHF/    
CED/SE=3001, RE= 300101, ED=01/30/96
    !RayTech needs above string,  Fugawi does not    
VER/1.1
    !RayTech needs VER/  Fugawi does not
CHK/1,300101
    !Fugawi and RayTech don't need CHK/ (but maybe if the bsb catalog has more that one chart)    
CGD/UNKNOWN
    !Fugawi and RayTech don't need CGD/ 
ORG/Nautical Data International Inc., 1 Military Rd., P.O. Box 127, Station C S
    t. John's, NF, A1C 5H5, on behalf of: Canadian Hydrographic Service, 615 Bo
    oth St., Room 237, Ottawa, Ontario, K1A 0E6
    !Fugawi and RayTech don't need ORG/  
K01/NA=VANCOUVER ISLAND JUAN DE FUCA STRAIT TO ,NU=3001,TY=BASE,FN=300101.kap
    !above line needed by Fugawi

One .bsb file can describe more than one .kap, but that gets more complicated. If we create a .bsb file per .kap, the following lines, should satisfy both, Fugawi and Raytech:

CHT/NA=VANCOUVER ISLAND JUAN DE FUCA STRAIT TO ,NU=3001
CED/SE=3001, RE= 300101, ED=01/30/96
VER/1.1
K01/NA=VANCOUVER ISLAND JUAN DE FUCA STRAIT TO ,NU=3001,TY=BASE,FN=300101.kap

Anybody care to try and verify?

[Netsurfer]

Hello contributors ...

The upload works pretty well ..., there are about 200 chart images already uploaded.

I'd like to point once again to NGA Charts Status at OpenCPN.info (English)
and the appropriate sites for the different regions.

I manually update the infos as often as I move uploaded charts to their final position. So the sites are quite up-to-date.

One please: As we can only see charts are done when the complete file was uploaded please write a short comment on the respective site if you are already downloading and stitching any charts so that others can see that work is already in progress - thanks!

Keep on working ...

Gunther

[LeaseOnLife]

Gunther/Netsurfer

As I am doing the Region "Miscellaneous": The page for Miscellaneous pukes:

Warning:  Invalid argument supplied for foreach() in /var/www/web12/html/wp-content/themes/acquiamarina/nga-charts-status.php on line 31

Warning:  Invalid argument supplied for foreach() in /var/www/web12/html/wp-content/themes/acquiamarina/nga-charts-status.php on line 47

...comments added though!

[micheck]

First off --- THANK YOU ALL for your efforts -- it will help us all

Now, a question (from someone who understands only enough to be dangerous!) - with such a spread in sizes of the 'stitched jpg's (I've seen 5 to 65M) are they all being saved at Q95 or Q100?

Charles

[Netsurfer]

Originally Posted by LeaseOnLife

Gunther/Netsurfer

As I am doing the Region "Miscellaneous": The page for Miscellaneous pukes:

Warning:  Invalid argument supplied for foreach() in /var/www/web12/html/wp-content/themes/acquiamarina/nga-charts-status.php on line 31

Warning:  Invalid argument supplied for foreach() in /var/www/web12/html/wp-content/themes/acquiamarina/nga-charts-status.php on line 47

...comments added though!

Yes, wasn't ready with the misc region - now it should be OK.

Originally Posted by micheck

First off --- THANK YOU ALL for your efforts -- it will help us all

Now, a question (from someone who understands only enough to be dangerous!) - with such a spread in sizes of the 'stitched jpg's (I've seen 5 to 65M) are they all being saved at Q95 or Q100?

Yes, I was wondering too. Because I have charts of region 3 of about the same size like charts with about 20 MB and some even exceed the 200 MB.

I mean if there are a lot of only pure white tiles I can imagine that file size is much smaller ...!

Gunther

[cagney]

Originally Posted by nohal

Some info & scripts that could help make especially the scanned charts smaller and better looking:
ImageMagick • View topic - Noise Reduction
Fred's ImageMagick Scripts: DENOISE
Fred's ImageMagick Scripts: ISONOISE
Fred's ImageMagick Scripts: TEXTCLEANER

Pavel

Thanks Pavel. Denoise and Isonoise decrease the size with about 45 - 55%, without much lower quality.(for both jpgs and pngs)
A strait up and down conversion of the raw jpgs to png leads to almost 100% larger size though.
If I understand things right we now have to convert to png without any other processing of the jpgs, and then get them smaller........

micheck
At this stage we can only trust our down-loaders to stick to Q100.
There is certainly a wide spread in size, just looking at those I just have done,the vary from 18 to 127 mb.

Thomas

[bcn]

I had a range from 13.000 up to 135.000kB in the last pass at 100%.

Next the rest of the 53... range will be tackled

And we have another chart that the py script will not process:
53084


Hubert

[Surveyor]

I would like to switch to either the ruby script or Allan's perl script. When the py script fails, which it does often, it eats up alot of time waiting to be sure that it has in fact failed. I am using XP.

ALLAN'S PL SCRIPT:
I was able to fetch the tiles using cygwin. Moving all of the highest resolution tiles to one directory is easy enough. But running the stitch.pl script I could not figure out. Does it run on the cmd prompt or the perl window? What are the typical command inputs?

RUBY:
I had no luck with this. Can this be run on a windows platform? If so, how? I had read that in order to run the ruby script one would also need nokoiri. It appeared to me that the only way to get nokoiri was through a linux command.

CONCERNING LINUX:
I did have Ubuntu v10 installed but when we started all of this I attempted to upgrade to the latest version. The upgrade failed so I uninstalled and tried it again. Now all I get is unending errors during installation so I gave up. I would love to run with the big dogs on linux but that doesnt seem to be possible for the time being.

Thanks in advance for any help.

[Netsurfer]

Thomas

Originally Posted by cagney

A strait up and down conversion of the raw jpgs to png leads to almost 100% larger size though.

But only as long as you have a 24bit png file. As soon as you convert it to 8bit file size reduces dramatically. That's still an image with 256 colours and I guess this is still way enough as we have to come down to 128/127 colors at a maximum anyway.
So nothing really changed on the original image and much smaller ...

If I understand things right we now have to convert to png without any other processing of the jpgs, and then get them smaller........

We should check the number of used colors and reduce the 8bit png to that amount of colours.
This should already decrease file size enormously.

Gunther

[cagney]

Almost 200 posts in this thread in ~ 12 days. A lot of good info is drowning in this stream.... It's getting difficult for new people to get a handle on this.

What we need is a Wiki, to document what we are doing now and what's up next, and generally to keep the project together!

What do you guys think?

Thomas

[Netsurfer]

Originally Posted by cagney

What do you guys think?

Why would you like another wiki/ place to gather the worthy information?

I offer anybody of the known users here to grant them write access on opencpn.info.

Make one page for

• image conversion
• header creation
• kap creation
• whatsoever

There is a visual editor for those who are not familiar with HTML.
And it's powered by Wordpress.

If there is a need for you could also use PHP on a page (though you have to ask me to insert the code).

Gunther

[r.fairman]

RUBY and dezoom.rb both run very well on xp. dezoom.rb is hard coded to the nga site you just have to enter the chart number. It both downloads the tiles and stitches them You have to install nokogiri by issuing the command gem install nokogiri