Cruisers Forum
 


Join CruisersForum Today

Reply
 
Thread Tools Rate Thread Display Modes
Old 16-08-2011, 00:39   #1
Registered User

Join Date: Mar 2011
Boat: HallbergRassy 36
Posts: 21
Import GPX Tracks Crash

Hi
I find that trying to import .gpx files larger than about 1.5MB to Route Manager causes 2.5.0 to freeze. And the only way out seems to be uninstall/install.
Is this a known issue or is there a stated limit to file size?
__________________

__________________
Bluesipp is offline   Reply With Quote
Old 16-08-2011, 01:30   #2
Registered User

Join Date: Feb 2010
Location: On the go. Not in Prague.
Posts: 4,016
Re: Import GPX Tracks Crash

Bluesipp,
No limit set. I did my testing using files in 1MB range and they import instantly even on my slowest Atom machine.
Could I have a look at your GPX file? You can send it to me by mail, which is to be found on the Authors tab in OpenCPN's About box.

Thanks

Pavel
__________________

__________________
nohal is offline   Reply With Quote
Old 16-08-2011, 03:58   #3
Registered User

Join Date: Mar 2011
Boat: HallbergRassy 36
Posts: 21
Re: Import GPX Tracks Crash

Pavel - very many thanks, it's on its way
john
__________________
Bluesipp is offline   Reply With Quote
Old 16-08-2011, 05:16   #4
Registered User

Join Date: Mar 2011
Boat: HallbergRassy 36
Posts: 21
Re: Import GPX Tracks Crash

Pavel - again many thanks. Eventual solution awaited
John
__________________
Bluesipp is offline   Reply With Quote
Old 30-09-2011, 15:13   #5
Registered User

Join Date: Sep 2011
Posts: 8
Re: Import GPX Tracks Crash

I have similar problem. Track GPX's generated by PolarView load, Track GPX's from other sources 5 to 9MB lock up 2.5. Rather than getting into a discussion about GPX file formatting issues, it would be a lot simpler to be able to load csv track files. After all, who needs more than lat,lon fields? Think about it. a file with two comma delimited fields for each trackpoint. something easy to get out of almost any nav program.

I will work out the gpx formatting issues myself if i can be assured that there REALLY is no size limitation on imported track files.

Assuming someone knows for sure that there is no imported track.gpx file size limitation, then I have a gpx problem. Is there a sample (known to be good) big track gpx file that i might download to help me fix my formatting issue?

I ask because it looks like OpenCPN does a few things better than what I'm using now and I would migrate if i can get 10 years of tracks into opencpn.

sorry to be a bother, john
__________________
j ferguson is offline   Reply With Quote
Old 01-10-2011, 02:46   #6
Registered User

Join Date: Feb 2010
Posts: 619
Re: Import GPX Tracks Crash

I import successfully 13MB of tracks in a single file. The longest track is 22000 trackpoints. Takes some time, but no problem.

Out of 13MB, some 20% of text is GUIDs, what I think is not useful now, but I definitely need the timestamps, colors, mark symbols.

It is a bit of work, but it should be possible to split GPX into smaller chunks, if necessary, and it is easy to generate a GPX track from a list of (lat,lon) pairs. I use a simple Python script for this.

Piotr
__________________
PjotrC is offline   Reply With Quote
Old 01-10-2011, 05:14   #7
Senior Cruiser
 
sinbad7's Avatar

Cruisers Forum Supporter

Join Date: Sep 2003
Location: Ubatuba,SP,Brazil (Ex Norway)
Boat: (Ex) Alu. 60' yacht-"Eight Bells"
Posts: 2,717
Images: 57
Send a message via Skype™ to sinbad7
Re: Import GPX Tracks Crash

Unless I'm mistaken,you can Extend or Split tracks in OCPN.
GPSPrune is also a handy program for editing tracks.

I can also confirm that I have no problems importing .gpx files in the MB size.

Tore
__________________
"And all I ask is a tall ship and a star to steer her by."
sinbad7 is offline   Reply With Quote
Old 01-10-2011, 05:46   #8
Registered User

Join Date: Sep 2011
Posts: 8
Re: Import GPX Tracks Crash

Gentlemen,
I am happy to hear it is possible to bring in long track files. Now I can be certain that the problem is with the gpx formatting on my files. I am beginning to work with gpsprune and should have it under control in a day or two.

thank you for responding,

john
__________________
j ferguson is offline   Reply With Quote
Old 01-10-2011, 08:53   #9
Registered User

Join Date: Sep 2011
Posts: 8
Re: Import GPX Tracks Crash

Well it wasn't a crash or lock-up after all. OpenCPN takes an INCREDIBLE amount of time to load a 12 Mb track.gpx. It may have been 45 minutes. I don't know because we left the machine running while we were out provisioning.

I started by using gpsPrune to cut the file down to 1 mb, which loaded in a minute or two, then cut same large file down to 6 mb which took quite a while, then tried the whole thing.

I'm running ubuntu 10.10 on an HP G-40 with 2.7 gigs ram, 30 gigs available disk, Athlon !!, P340 dual core processor.

To my mind, there cannot possibly be any good reason why processing a 12 meg list should take anything like this much time.

this is not at all a good sign.
__________________
j ferguson is offline   Reply With Quote
Old 01-10-2011, 17:12   #10
Marine Service Provider
 
bdbcat's Avatar

Join Date: Mar 2008
Posts: 4,880
Re: Import GPX Tracks Crash

j

OK I guess we need to see your huge GPX file, and get some instrumentation on it. I wonder what's going on....I love mysteries....

Not possible to attach such a large file to this thread. Maybe a .zip of the file could be emailed to me directly? Or in a drop box of some kind....

Lets start with a 1 MB version. A minute seems just too long to look at, after all, only a million characters.

My address is in Authors tab

Thanks
Dave
__________________
bdbcat is offline   Reply With Quote
Old 01-10-2011, 17:21   #11
Registered User

Join Date: Sep 2011
Posts: 8
Re: Import GPX Tracks Crash

bear with me, Dave. I'm doing a fresh install of 32 bit ubuntu 10.10 v2.5, after removing all earlier stuff. I also have an XP installation on same machine and I'm testing this stuff on that as well. I'll be back with update late tomorrow - underway don't you know but have a lay day for weather.

john
__________________
j ferguson is offline   Reply With Quote
Old 03-10-2011, 21:59   #12
Marine Service Provider
 
bdbcat's Avatar

Join Date: Mar 2008
Posts: 4,880
Re: Import GPX Tracks Crash

Folks....

I've studied one of the large GPX files question.

Conclusion:
OpenCPN 2.5 does some things well, some not so well.

One thing we do not do well is this:

Single tracks of 1000 miles with trackpoints every 60 ft. (i.e. about 100,000 points in a single track) are not well supported by OpenCPN.
They work OK, but load too slowly to be usable.

It's a design decision driven by portability and conformance to industry standards. We store extended XML information for all trackpoints and waypoints in our navobj.xml files using a common format. The processing cost eventually becomes unreasonable for the resulting XML files when tracks of this size are imported.

If this is a general problem for enough users, then it may be posted as a FlySpray bug for further consideration in future versions.

Sorry, but there it is.

Thanks
Dave
__________________
bdbcat is offline   Reply With Quote
Old 04-10-2011, 09:47   #13
Registered User

Join Date: Sep 2011
Posts: 8
Re: Import GPX Tracks Crash

Dave,
I concede that these tracks sound bizarre. For the benefit of the guys who mostly sail offshore, i use these tracks to navigate the Intra Coastal WaterWay on the east coast of the US. The Waterway has a few tricky sections and the anchorages tend to be shallow. We run north in the spring to Maine and south to the Keys in the fall. We have favorite anchorages and like to reuse them. I use my present software to make a single trackfile for nothbound trip and another for southbound, for example. NB2008.trk and SB2008.trk. This way if we want to reuse an anchorage we used southbound in 2008, i load that track and can see how we got into the anchorage. I have 10 years of these tracks.

I don't think a lot of other people do this, so making it work in OpenCPN is probably a waste of time given the need to re-architect the code to make it practical.

Thanks for looking at it for me.

john ferguson m/v arcadian anchored Cedar Creek, NC
__________________
j ferguson is offline   Reply With Quote
Old 04-10-2011, 11:43   #14
Senior Cruiser
 
sinbad7's Avatar

Cruisers Forum Supporter

Join Date: Sep 2003
Location: Ubatuba,SP,Brazil (Ex Norway)
Boat: (Ex) Alu. 60' yacht-"Eight Bells"
Posts: 2,717
Images: 57
Send a message via Skype™ to sinbad7
Re: Import GPX Tracks Crash

j ferguson..

You can use the FREE RouteConverter to reduce the number of waypoints in your track.

http://www.routeconverter.de/wiki/track_to_route-en

Tore
__________________
"And all I ask is a tall ship and a star to steer her by."
sinbad7 is offline   Reply With Quote
Old 04-10-2011, 12:19   #15
Registered User

Join Date: Sep 2011
Posts: 8
Re: Import GPX Tracks Crash

Tore,
for the ICW, 60 foot intervals are useful. It might be that using time intervals instead of distance to create the tracks would make more sense because i would get higher resolution when going slower, but then the difference between 6 knots and 2 or 3 is not that great.

i have no problem with these large track files with the software i now use, which also runs on Linux. I have all 10 years of tracks available on a tab (twenty - most of which are more than 6 megs) and i can easily display 2 or 3 while recording the "current" track.

From discussions with other software developers, my use of tracks is not a high-demand feature.

OpenCPN was highly recommended by a friend whose opinion i respect, but he couldn't understand why i wanted these big tracks either. Ah well..

john
__________________

__________________
j ferguson is offline   Reply With Quote
Reply

Thread Tools
Display Modes Rate This Thread
Rate This Thread:

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are Off
Pingbacks are Off
Refbacks are Off


Similar Threads
Thread Thread Starter Forum Replies Last Post
Import Maxsea 10.3 Tracks into OpenCPN ? Fuss OpenCPN 4 08-08-2011 22:54



Copyright 2002- Social Knowledge, LLC All Rights Reserved.

All times are GMT -7. The time now is 15:32.


Google+
Powered by vBulletin® Version 3.8.8 Beta 1
Copyright ©2000 - 2017, vBulletin Solutions, Inc.
Social Knowledge Networks
Powered by vBulletin® Version 3.8.8 Beta 1
Copyright ©2000 - 2017, vBulletin Solutions, Inc.

ShowCase vBulletin Plugins by Drive Thru Online, Inc.