Cruisers Forum
 


Join CruisersForum Today

Reply
 
Thread Tools Rating: Thread Rating: 3 votes, 5.00 average. Display Modes
Old 05-01-2012, 05:31   #1216
bcn
Registered User

Join Date: May 2011
Location: underway whenever possible
Boat: Rangeboat 39
Posts: 2,766
Re: Charts II: NGA - 2700 Charts

Notice to calibrators:

we are about half through the insets now.
Keep on going with the pace!

Hubert
__________________

__________________
bcn is offline   Reply With Quote
Old 07-01-2012, 03:52   #1217
bcn
Registered User

Join Date: May 2011
Location: underway whenever possible
Boat: Rangeboat 39
Posts: 2,766
Re: Charts II: NGA - 2700 Charts

We forecast to finish the "punching out inset" phase this weekend.

We will end up with aprox. 1750 chartlets and panels.

Pavel, would it be possible to run a check the charts for completeness of the datum infos? I've seen quite a lot of the composed charts that were incomplete.

Hubert
__________________

__________________
bcn is offline   Reply With Quote
Old 07-01-2012, 05:24   #1218
Registered User

Join Date: Feb 2010
Location: On the go. Not in Prague.
Posts: 4,019
Re: Charts II: NGA - 2700 Charts

Hubert...
Yes, I will definitely run such a check and also probably do some "normalization" to the datum names we invented during the base chart calibration before copying the data to the insets as the default values.

Pavel
__________________
nohal is online now   Reply With Quote
Old 07-01-2012, 09:16   #1219
Registered User

Join Date: Jan 2007
Location: Minneapolis
Boat: Irwin 37 CC
Posts: 660
Re: Charts II: NGA - 2700 Charts

We need to be careful, in the next phase, of insets on the same chart having different data. 25610 has one inset in fathoms and one in feet.
__________________
David Kester
Pegasus IV
wdkester is offline   Reply With Quote
Old 07-01-2012, 09:31   #1220
bcn
Registered User

Join Date: May 2011
Location: underway whenever possible
Boat: Rangeboat 39
Posts: 2,766
Re: Charts II: NGA - 2700 Charts

Absolutely right - especially in the case of old charts there are complete sets without datum - neither soundings nor projection. And a lot of single insets from groups that are without complete datum information.

Hubert
__________________
bcn is offline   Reply With Quote
Old 08-01-2012, 02:37   #1221
bcn
Registered User

Join Date: May 2011
Location: underway whenever possible
Boat: Rangeboat 39
Posts: 2,766
Re: Charts II: NGA - 2700 Charts

Just to report that we have finished the first phase for the insets, identifying all correctly (hopefully) with their corresponding rectangular border lines.

In total we have now 1698 insets processed that are waiting for the next steps - geo-referencing and exact outlining for quilting.

Not all of the insets will be usable but our estimate is that we might end up with about 4.000 charts and chartlets from the NGA collection when finished sometime away from today.

There are regions of course that already covered by other projects (and with an excellent quality) like New Zealand

Hubert
__________________
bcn is offline   Reply With Quote
Old 08-01-2012, 06:41   #1222
Registered User

Join Date: Feb 2011
Posts: 490
Re: Charts II: NGA - 2700 Charts

Excellent work bcn, I am very thankful for those of you that did it.
Best Regards.
P_Dub
__________________
P_Dub is offline   Reply With Quote
Old 10-01-2012, 17:30   #1223
Registered User
 
manimaul's Avatar

Join Date: Feb 2008
Location: Seattle, WA
Posts: 416
Re: Charts II: NGA - 2700 Charts

Quote:
Originally Posted by bcn View Post
Not all of the insets will be usable but our estimate is that we might end up with about 4.000 charts and chartlets from the NGA collection when finished sometime away from today.

There are regions of course that already covered by other projects (and with an excellent quality) like New Zealand

Hubert
After an r-sync with the server, I'm showing 2,514 .kap files. The status information on opencpn.info is a bit cryptic to me. Is there a simple status page somewhere? I'm also curious what kind of load the machine is under that is doing the processing.

And, how can we help going forward?

Will
__________________
Marine Navigation for Android:
http://mxmariner.com
manimaul is offline   Reply With Quote
Old 11-01-2012, 00:16   #1224
Registered User

Join Date: Feb 2010
Location: On the go. Not in Prague.
Posts: 4,019
Re: Charts II: NGA - 2700 Charts

Will...
You can find some stats at NGA Charts project stats or just pull the database from github and you have all the data daily to do whatever processing you want...
Complete processing of one chart takes up to ca. 5 minutes on a single Xeon X3440 with 8 gigs of RAM (depends on the size of the chart, the need for rotation and the load on the machine as the process is reniced to 19, so everything else has precedence)

The next step is to modify the calibration page to do the insets - The calibrators were as usually much faster doing their job than I can find the time to write the code It's probably not very realistic to ask for help with this page, but there are two tasks that need to be done and are separate that come to my mind:
1) Tooling to pull the updates from the NGA site - unfortunately it's not as easy as parsing the table on say Region 1 - North America NGA Nautical Charts - NGA as far as we've seen often just uploads new images to the subfolders of Index of /NGAViewer without changing the catalogs.
2) Release tooling - scripts to package the whole release, by region and prepare the .torrent files for them + the same for increment since the last complete release - of less interest for you

Anyway I will try to have the calibration page by the end of the week, but it really depends on the workload I will receive from my real work, which is especially in the last weeks totally unpredictable as the managers have obtained new toys drawing some graphs.

Pavel
__________________
nohal is online now   Reply With Quote
Old 11-01-2012, 03:06   #1225
bcn
Registered User

Join Date: May 2011
Location: underway whenever possible
Boat: Rangeboat 39
Posts: 2,766
Re: Charts II: NGA - 2700 Charts

Everybody should also be aware that the calibration process for the insets will most probably slower than for the main charts:
- only a part of the panels and charlets carry coordinates in their corners
- others have not even any grid on it
Means that referencing will be much more individual and manual and in not few cases most probably we will have to decide not to include those.

And we should remember too that in the case of the main charts only a minority has the special PLY's applied to remove legends and texts from the quilted areas.

With respect of packaging charts for "delivery" the ideal would be a mechanism to select (sub)regions. What about a wildcard scheme? 54xxx would give you the set 54000-54999 for instance.

Hubert
__________________
bcn is offline   Reply With Quote
Old 11-01-2012, 10:37   #1226
Registered User
 
manimaul's Avatar

Join Date: Feb 2008
Location: Seattle, WA
Posts: 416
Re: Charts II: NGA - 2700 Charts

Quote:
Originally Posted by nohal View Post
1) Tooling to pull the updates from the NGA site - unfortunately it's not as easy as parsing the table on say Region 1 - North America NGA Nautical Charts - NGA as far as we've seen often just uploads new images to the subfolders of Index of /NGAViewer without changing the catalogs.
Simple solution perhaps: The root directory listing has a modification date next to each chart directory. Parse the date string out to an epoch and cache. Also, It looks like all of the charts were updated in May and June of 2011. If this is going to be a regular thing, perhaps an update every July would work.

Will
__________________
Marine Navigation for Android:
http://mxmariner.com
manimaul is offline   Reply With Quote
Old 11-01-2012, 10:47   #1227
Registered User

Join Date: Feb 2010
Location: On the go. Not in Prague.
Posts: 4,019
Re: Charts II: NGA - 2700 Charts

Will...
Unfortunately we have to go even further - check the dates on the xml files in the respective directories. But my problem is not about not knowing what and how to do - it's more about when someone will have time to do it

Pavel
__________________
nohal is online now   Reply With Quote
Old 11-01-2012, 10:51   #1228
bcn
Registered User

Join Date: May 2011
Location: underway whenever possible
Boat: Rangeboat 39
Posts: 2,766
Re: Charts II: NGA - 2700 Charts

Applying for Google Summer of Code?
__________________
bcn is offline   Reply With Quote
Old 13-01-2012, 00:25   #1229
Registered User

Join Date: Jun 2010
Posts: 37
Re: Charts II: NGA - 2700 Charts

Pavel,
Are you aware that for at least some of the rotated charts, such as chart 24270, the inset shape was defined on the original chart rather than on the north-up chart!?
Zeev
__________________
z.stadler is offline   Reply With Quote
Old 13-01-2012, 00:57   #1230
Registered User

Join Date: Feb 2010
Location: On the go. Not in Prague.
Posts: 4,019
Re: Charts II: NGA - 2700 Charts

Zeev...
Yep, I am, on the list

Pavel
__________________

__________________
nohal is online now   Reply With Quote
Reply

Tags
charts

Thread Tools
Display Modes Rate This Thread
Rate This Thread:

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are Off
Pingbacks are Off
Refbacks are Off




Copyright 2002- Social Knowledge, LLC All Rights Reserved.

All times are GMT -7. The time now is 01:23.


Google+
Powered by vBulletin® Version 3.8.8 Beta 1
Copyright ©2000 - 2017, vBulletin Solutions, Inc.
Social Knowledge Networks
Powered by vBulletin® Version 3.8.8 Beta 1
Copyright ©2000 - 2017, vBulletin Solutions, Inc.

ShowCase vBulletin Plugins by Drive Thru Online, Inc.