Cruisers Forum
 


Join CruisersForum Today

Reply
 
Thread Tools Rate Thread Display Modes
Old 20-01-2015, 11:19   #61
Registered User
 
rgleason's Avatar

Join Date: Mar 2012
Location: Boston, MA
Boat: 1981 Bristol 32 Sloop
Posts: 8,989
Re: Chart Downloader/Updater Plugin

Additionally, there is one other thing that would save Users some time.

To be able to set the preferred main chart directory under Preferences when in Options > Plugin > Preferences. This would not be forgotten, and would get the user to the top of the Chart directory.
__________________

__________________
rgleason is offline   Reply With Quote
Old 20-01-2015, 15:44   #62
Registered User
 
transmitterdan's Avatar

Join Date: Oct 2011
Boat: Valiant 42
Posts: 3,897
Re: Chart Downloader/Updater Plugin

Pavel/SethDart,

I placed a bug report in github for this plugin. Please have a look as I have exhausted my ability to find the cause of the problem. It is not urgent as this issue only affects the ACE inland rivers charts.
__________________

__________________
transmitterdan is offline   Reply With Quote
Old 21-01-2015, 02:43   #63
Registered User

Join Date: Mar 2010
Location: Normandy, France
Boat: Flush Poker, 8.25m (Point Barre)
Posts: 335
Re: Chart Downloader/Updater Plugin

Quote:
Originally Posted by rgleason View Post
Now when I highlight that Catalog there are no chart selections that come up even though the Region02.xml does exist in that directory! Why doesn't the program read from the directory being pointed at?

It should also download to there as well I think.
It should do so! If you select any forder, both the catalog ($something.xml) and the charts should land there.
Can you check if you moved the catalog is in the "Region 02" folder?
If not, you can either move it manually or click "Update" for this catalog and it'll be downloaded at the right location.
__________________
SethDart is offline   Reply With Quote
Old 21-01-2015, 04:28   #64
Registered User
 
rgleason's Avatar

Join Date: Mar 2012
Location: Boston, MA
Boat: 1981 Bristol 32 Sloop
Posts: 8,989
Re: Chart Downloader/Updater Plugin

I have a big question this morning.
Should I have a dedicated "Charts" folder which contains only ACTIVE charts that are listed in the Chart Files Directory?
And should I move all charts that I am storing for future use to a "Charts-Inactive" directory?

The reasons I ask this are:
1. When I try to build the cache for Opengl the cache is built using ALL charts not just the charts in the Chart Files Directory list!
2. When in Chart Files or otherwise instigate an "Update" of the chart database, the action updates ALL charts, not just the charts in the Chart Files Directory list.

If I were to move the majority of those Chart Files that I will not use for a long time, (all Noaa Regions other than 02 & 03, and all the files I have for other parts of the world) to a new "Charts-Inactive" directory that is at the same level as "Charts" would this focus the scans on meaningful charts (ones that I have in the Chart Files Directory List and any others I have in that directory that I might activate in the near future)?
__________________
rgleason is offline   Reply With Quote
Old 21-01-2015, 04:30   #65
Registered User
 
rgleason's Avatar

Join Date: Mar 2012
Location: Boston, MA
Boat: 1981 Bristol 32 Sloop
Posts: 8,989
Re: Chart Downloader/Updater Plugin

Pavel,
To answer and confirm some of you questions, I think I need to send some pictures. Then you and SethDart can actually see what is happpening in windows. Words are a little difficult sometimes. The pics can perhaps become part of the wiki too.
__________________
rgleason is offline   Reply With Quote
Old 21-01-2015, 05:07   #66
Registered User
 
transmitterdan's Avatar

Join Date: Oct 2011
Boat: Valiant 42
Posts: 3,897
Re: Chart Downloader/Updater Plugin

Rick,

When rebuilding the chart cache O looks recursively in every directory listed in the charts folder list. If you "mistakenly" put a sub folder of another higher level folder that is also in the list then O will visit the sub folder twice. Example;

Say you list folders /home/Rick/Charts and /home/Rick/Charts/ENC and /home/Rick/Charts/ENC/region1 in the charts list. Then O will visit the last folder 3 times while rebuilding the database and the second folder twice. This can make for a really long rebuild time.

It only knows about folders (and all the sub folders) in that one list. it knows nothing about the downloaded charts until you manually add the folders to the chart folder list.
__________________
transmitterdan is offline   Reply With Quote
Old 21-01-2015, 05:13   #67
Registered User
 
rgleason's Avatar

Join Date: Mar 2012
Location: Boston, MA
Boat: 1981 Bristol 32 Sloop
Posts: 8,989
Re: Chart Downloader/Updater Plugin

Was testing "Update" of chart catalogs which seem to work with Charts stored in these subdirectories
RNC 02 Catalog | C:\..\Data-Dart/BSB_ROOT\..02 Region RNC .xml
RNC 02 Catalog | C:\..\Data-Dart/BSB_ROOT\02 Test\..02 Region RNC.xml
ENC 32 Catalog | C:\..\Data-Dart/BSB_ROOT\02 Test\32 Test\..32 Region ENC.xml

These are showing as backslash, is that correct? Yes, I guess so.
Obviously, I manually directed ENC 32 Catalog to the wrong directory.
Updating these catalogs seems to work.
Downloading selected charts the program crashed after several downloads.
I have attached my log which was updated, and there does not seem to be much in there. I am going to turn off all other plugins.

PS: When it crashed I had OpenGL on. I am turning it off.
Attached Files
File Type: doc opencpn-10-21-15.log.zip.doc (62.2 KB, 19 views)
__________________
rgleason is offline   Reply With Quote
Old 21-01-2015, 05:27   #68
Registered User
 
transmitterdan's Avatar

Join Date: Oct 2011
Boat: Valiant 42
Posts: 3,897
Re: Chart Downloader/Updater Plugin

Rick,

That structure of directories will cause large cache rebuild times. Try putting each different XML file in their own folder in the Data-Dart folder Then each folder will have it's own BSB_ROOT or ENC_ROOT as needed. Don't include C:\..\Data-Dart in the list of chart folders. Only list the individual folders O will get it right and the cache rebuild times will go way down.

Then you can create groups that include 1 or more of these folders but O will not visit them more than once during cache rebuild.

The backslash is a Windows thing. The forward slash is the same thing but for Linux.
__________________
transmitterdan is offline   Reply With Quote
Old 21-01-2015, 06:36   #69
Registered User
 
rgleason's Avatar

Join Date: Mar 2012
Location: Boston, MA
Boat: 1981 Bristol 32 Sloop
Posts: 8,989
Re: Chart Downloader/Updater Plugin

I have about 22 files to upload, showing the Windows process.
There are just a few comments I noticed:
1. It would be helpful if the Options Window maintained the Window settings for the
Chart Downloader page, I pulled the popup window wider and adjusted the columns so that I could see the full path. If those settings could be remembered it would be nice.
2. It would be helpful if the main path to the charts could be set under Preferences, it is never remembered. Note the blank destination path in several of these screenshots.
3. In this sequence I check previous Chart sources and Update them
4. Then I Add a New Chart Source and set destination paths "manually" by "Browse" starting back at "C:\" (because the destination path remains blank) and click through until I need a "New Folder" and to do that I right click and select "New Folder" and then type the new name, enter.
5. After the catalog screen is rewritten , I have to select/highlight the new catalog. It makes sense to highlight it automatically.
6. Then I can hit "Update" to populate the chart selections..
7. Then select some charts and hit "Download"

Question, does the new Chart Source Directory get added to the Chart Files directory list? No, not yet.

Under "Chart Files" tab. It would be nice to be able to highlight certain chart directories and then select ONLY those to be updated. Also If you were able to just highlight all the chart directories, you could direct O to just update only those charts you are currently using!
Attached Thumbnails
Click image for larger version

Name:	1-Update-Cat.png
Views:	63
Size:	211.4 KB
ID:	95825   Click image for larger version

Name:	2-Update-Cat.png
Views:	73
Size:	216.4 KB
ID:	95826  

Click image for larger version

Name:	3-Update-Cat.png
Views:	61
Size:	44.1 KB
ID:	95827   Click image for larger version

Name:	4-Update-Cat.png
Views:	76
Size:	118.6 KB
ID:	95828  

Click image for larger version

Name:	5-Update-Cat.png
Views:	83
Size:	206.8 KB
ID:	95829   Click image for larger version

Name:	6-Update-Cat.png
Views:	55
Size:	14.5 KB
ID:	95830  

Click image for larger version

Name:	7-Update-Cat.png
Views:	68
Size:	43.8 KB
ID:	95831   Click image for larger version

Name:	8-Update-Cat.png
Views:	68
Size:	165.3 KB
ID:	95832  

Click image for larger version

Name:	9-Update-Cat.png
Views:	75
Size:	168.0 KB
ID:	95833   Click image for larger version

Name:	10-Update-Cat.png
Views:	80
Size:	41.3 KB
ID:	95834  

Click image for larger version

Name:	11-Update-Cat.png
Views:	61
Size:	158.9 KB
ID:	95835  
__________________
rgleason is offline   Reply With Quote
Old 21-01-2015, 06:45   #70
Registered User
 
rgleason's Avatar

Join Date: Mar 2012
Location: Boston, MA
Boat: 1981 Bristol 32 Sloop
Posts: 8,989
Re: Chart Downloader/Updater Plugin

This is the next main Step, to
1. Add a new chart source manually,
2. Add an new destination subdirectory Browse to lowest folder,
3. Then with right click and rename, and set the destination path to that new directory.
4. Then to "Update" the new source to populate the catalog
5. To select charts from the catalog
5. Finally "Download" some new charts.
Here's the sequence.

PS: PLEASE NOTE THIS ENTIRE SEQUENCE WAS DONE WITH OPENGL OFF. And there were NO crashes. I believe having Opengl ON is a problem.
Attached Thumbnails
Click image for larger version

Name:	12-Add-New-Chart-Source.png
Views:	73
Size:	7.2 KB
ID:	95836   Click image for larger version

Name:	13-Add-New-Chart-Source.png
Views:	73
Size:	148.9 KB
ID:	95837  

Click image for larger version

Name:	14-Add-New-Chart-Source-Define-Path.png
Views:	77
Size:	142.7 KB
ID:	95838   Click image for larger version

Name:	15-Add-New-Chart-Source-Add-New-Folder.png
Views:	60
Size:	172.2 KB
ID:	95839  

Click image for larger version

Name:	16-Add-New-Chart-Source-New-Folder.png
Views:	69
Size:	16.5 KB
ID:	95840   Click image for larger version

Name:	17-New Folder Created.png
Views:	75
Size:	15.8 KB
ID:	95841  

Click image for larger version

Name:	18-New-Destination-Directory-Defined.png
Views:	75
Size:	10.7 KB
ID:	95842   Click image for larger version

Name:	19-Ready-Download-but-highlight-new-Catalog-first.png
Views:	76
Size:	80.4 KB
ID:	95843  

Click image for larger version

Name:	20-Downloading.png
Views:	74
Size:	35.9 KB
ID:	95844   Click image for larger version

Name:	21-Downloading.png
Views:	58
Size:	31.2 KB
ID:	95845  

Click image for larger version

Name:	22-After-Download.png
Views:	70
Size:	149.5 KB
ID:	95846  
__________________
rgleason is offline   Reply With Quote
Old 21-01-2015, 07:10   #71
Registered User
 
rgleason's Avatar

Join Date: Mar 2012
Location: Boston, MA
Boat: 1981 Bristol 32 Sloop
Posts: 8,989
Re: Chart Downloader/Updater Plugin

Dan wrote:
Quote:
Rick,
When rebuilding the chart cache O looks recursively in every directory listed in the charts folder list. If you "mistakenly" put a sub folder of another higher level folder that is also in the list then O will visit the sub folder twice. Example;

Say you list folders
/home/Rick/Charts and
/home/Rick/Charts/ENC and
/home/Rick/Charts/ENC/region1
in the charts list. Then O will visit the last folder 3 times while rebuilding the database and the second folder twice. This can make for a really long rebuild time.

It only knows about folders (and all the sub folders) in that one list.
--- it knows nothing about the downloaded charts until you manually add the folders to the chart folder list.
OK - Why does "Chart File" tab Rebuild Db and Scan also go through all charts when there is a directory list?

Should I move INACTIVE (not going to be used for a long time Charts) into a totally separate folder?

Also I keep saying it and nobody has addressed this, there is no way of pointing the downloader to a certain CHART directory and have it "Remember" it. It simply does not happen! - This is a real pain.

You said something that made me think that the plugiin will create its own sub-directories..... This does not happen! Have not ever seen it.
__________________
rgleason is offline   Reply With Quote
Old 21-01-2015, 07:21   #72
Registered User
 
rgleason's Avatar

Join Date: Mar 2012
Location: Boston, MA
Boat: 1981 Bristol 32 Sloop
Posts: 8,989
Re: Chart Downloader/Updater Plugin

Create new Directory Structure:
Data-Dart/Charts [active and near term charts]
Data-Dart/Charts/BSB_ROOT
Data-Dart/Charts/ENC_ROOT

Data-Dart/Charts-Inactive [long term storage]

Move my charts according to the above?
__________________
rgleason is offline   Reply With Quote
Old 21-01-2015, 07:22   #73
Registered User

Join Date: Feb 2010
Location: On the go. Not in Prague.
Posts: 3,989
Re: Chart Downloader/Updater Plugin

Quote:
Originally Posted by rgleason View Post
Dan wrote:


OK - Why does "Chart File" tab Rebuild Db and Scan also go through all charts when there is a directory list?

Should I move INACTIVE (not going to be used for a long time Charts) into a totally separate folder?

Also I keep saying it and nobody has addressed this, there is no way of pointing the downloader to a certain CHART directory and have it "Remember" it. It simply does not happen! - This is a real pain.

You said something that made me think that the plugiin will create its own sub-directories..... This does not happen! Have not ever seen it.
Rick...
"will" is a modal verb meaning future, it means it is not currently doing it. If unsure, check the respective issue on github, if it is still open, the thing is not implemented. If you feel there is something that is not going to be addressed by any of the existing issues, create one.
If you think that the way the core program is scanning the chart directories is broken (I really don't), create a task in flyspray for it and describe exactly what the problem is.

Thanks

Pavel
__________________
nohal is offline   Reply With Quote
Old 21-01-2015, 07:47   #74
Registered User
 
rgleason's Avatar

Join Date: Mar 2012
Location: Boston, MA
Boat: 1981 Bristol 32 Sloop
Posts: 8,989
Re: Chart Downloader/Updater Plugin

OK, hope the screen shots help with the communication problems I had last night.

So these are "will..." or "Future"
When adding a catalog, offer the user a meaningful default path, like "OCPNDATADIR/Charts/XXX"
"Currently the chart directory must exist, implement it's creation."

Like it. Thanks for teaching me about my native language.
__________________
rgleason is offline   Reply With Quote
Old 21-01-2015, 07:49   #75
Registered User
 
rgleason's Avatar

Join Date: Mar 2012
Location: Boston, MA
Boat: 1981 Bristol 32 Sloop
Posts: 8,989
Re: Chart Downloader/Updater Plugin

Now have found this new directory...
https://github.com/chartcatalogs/

Very interesting, we can contribute links. Wow.
__________________

__________________
rgleason is offline   Reply With Quote
Reply

Tags
charts

Thread Tools
Display Modes Rate This Thread
Rate This Thread:

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are Off
Pingbacks are Off
Refbacks are Off


Similar Threads
Thread Thread Starter Forum Replies Last Post
OpenCPN PlugIn Development bdbcat OpenCPN 78 29-07-2017 02:15
Plugin: DashBoard SethDart OpenCPN 470 24-08-2016 20:34
BSB 4 PlugIn bdbcat OpenCPN 93 20-02-2016 03:41
Logbook Plug-in SethDart OpenCPN 98 10-01-2013 11:47
Chartwork Plugin mario f OpenCPN 10 29-03-2012 19:21



Copyright 2002- Social Knowledge, LLC All Rights Reserved.

All times are GMT -7. The time now is 22:05.


Google+
Powered by vBulletin® Version 3.8.8 Beta 1
Copyright ©2000 - 2017, vBulletin Solutions, Inc.
Social Knowledge Networks
Powered by vBulletin® Version 3.8.8 Beta 1
Copyright ©2000 - 2017, vBulletin Solutions, Inc.

ShowCase vBulletin Plugins by Drive Thru Online, Inc.