Cruisers Forum
 


Join CruisersForum Today

Reply
 
Thread Tools Search this Thread Rate Thread Display Modes
Old 21-05-2011, 14:52   #1
Registered User
 
Netsurfer's Avatar

Join Date: Jan 2010
Location: Cologne, Germany
Boat: Beneteau Oceanis 331
Posts: 557
Harmonic Files ...

Hi all!

Does anybody knows how to merge several different Harmonic files to one and then create the Harmonic.idx file?

Or can the .idx file be created from several different Harmonic files at once?

I read about the Tide2idx file in the Readme of WXTide32 but to be honest, I didn't understand much of it:
Quote:
Source files
~~~~~~~~~~~~
The file WXTidSrc##.7z has all the source code for the WXTide32 program. Three
files: Tide2idx.c, Tide2idx.ctl and tide2idx.bat form the station index builder
DOS console executable. For tide2idx.bat to work properly, the "subreg" path will
have to be changed to point to the Tide 2.4 subreg files.


Station indexing
~~~~~~~~~~~~~~~~
The Tide2IDX program generates a sortable station index from one or more
harmonic constituent and subordinate station files. I never was very good with
geography and as I HAVE NO INTEREST IN POLITICS, political boundary
assignments may seem arbitrary to some extent. So if you don't like the
region/country/state that your station appears in, try changing the
Tide2IDX.ctl file and make a new index. To generate a new index with
subordinate stations, you must download and unzip the Tide24 program mentioned
earlier. The files of interest are in the subdirectory "substa" and are all
called "subreg.xx" where "xx" is a region number. The "makeidx.bat" file
builds an index including all the "substa" files. You will have to change the
search path in makeidx.bat to point to those files for it to work properly.
The reason for asking is that there are several different Harmonic files out there (the one packaged with OpenCPN, the one from the french user (sorry, don't know his name), and several others available on the Web). But unfortunately they all cover different regions, some include also currents others don't - so I want them all in one Harmonic file (because there is no easy way to simply switch between different Harmonic files).

Thanks
Gunther
Attached Thumbnails
Click image for larger version

Name:	Harmonic file - worldwide.jpg
Views:	220
Size:	379.0 KB
ID:	27651  
__________________

__________________
Deutschsprachige Community- und Support-Website unter OpenCPN.de
Netsurfer is offline   Reply With Quote
Old 22-05-2011, 04:09   #2
Registered User
 
Gilletarom's Avatar

Join Date: Mar 2010
Location: France
Boat: 10.50 mètres
Posts: 2,648
Re: Harmonic Files ...

Hello Netsurfer,

In the package OpenCPN, for the US, the data are those of NOAA. Thus, their value is guaranteed. For other areas, we do not know.

In the files produced by other sailor (as French file) or have unknown sources, data quality is not guaranteed even if these files are made seriously. For example, the French file, the data differ slightly from the official data when compared with data from the official French (SHOM)

Make a single package at all, without distinction between the quality of the data might be problematic.

There should be many files that areas like the language file. The user may choose to view a particular area but it would be possible to display a message indicating the source of data and qualities.

Dave thinks for the amount of work it would take?

Best regards

Gilletarom.
__________________

Gilletarom is offline   Reply With Quote
Old 22-05-2011, 07:19   #3
Registered User
 
Netsurfer's Avatar

Join Date: Jan 2010
Location: Cologne, Germany
Boat: Beneteau Oceanis 331
Posts: 557
Re: Harmonic Files ...

Hi Gilletarom!

thanks for your reply. But my question was not related to OpenCPN. I just wanted to know how I could "merge" several different Harmonic files into one and how to create the Harmonic.idx file.

I also know about the problem of data accuracy ... .
So one should always cross-/ double-check the given data.

Thanks

Gunther
__________________
Deutschsprachige Community- und Support-Website unter OpenCPN.de
Netsurfer is offline   Reply With Quote
Old 22-05-2011, 07:41   #4
Registered User
 
HappySeagull's Avatar

Join Date: Dec 2010
Location: B.C.,Canada
Boat: 29'
Posts: 2,412
Re: Harmonic Files ...

Quote:
Originally Posted by Netsurfer View Post
Hi Gilletarom!

thanks for your reply. But my question was not related to OpenCPN. I just wanted to know how I could "merge" several different Harmonic files into one and how to create the Harmonic.idx file.

I also know about the problem of data accuracy ... .
So one should always cross-/ double-check the given data.

Thanks

Gunther
they(Harmonic idx) can be edited in a text editor. but the stations must refer to primary stations in the single HARMONIC file.
I haven't tried adding to HARMONIC but if you have Primaries to add on,why not just try it?(with a Hex editor?)
and create an entry to harmonic. idx to see if it works in the first instance?
I see per OP(and edited this post) that you want to generate the harmonic.idx so apologies if no help.

dontpost 'em if you break copyrights!
HappySeagull is offline   Reply With Quote
Old 22-05-2011, 10:41   #5
Registered User
 
HappySeagull's Avatar

Join Date: Dec 2010
Location: B.C.,Canada
Boat: 29'
Posts: 2,412
Re: Harmonic Files ...

...but I'm just at a simple level just as in...
Click image for larger version

Name:	currentedit.png
Views:	184
Size:	23.3 KB
ID:	27680

it's "good" that OpenCPN's are at a level I can comprehend,at least.There are so many db formats,but the ones hereabouts all seem to go back to the same (open)sources....?
HappySeagull is offline   Reply With Quote
Old 07-02-2018, 04:05   #6
Registered User

Join Date: Feb 2012
Location: Austria
Posts: 246
Re: Harmonic Files ...

Quote:
Originally Posted by Netsurfer View Post
Hi Gilletarom!

thanks for your reply. But my question was not related to OpenCPN. I just wanted to know how I could "merge" several different Harmonic files into one and how to create the Harmonic.idx file.

I also know about the problem of data accuracy ... .
So one should always cross-/ double-check the given data.

Thanks

Gunther
@Netsurfer : have you found somewhere a description of the structure of the harmonic file? would like to add just a few locations for the Med and Atlantic south.

Thanks for sharing
skipperearly is offline   Reply With Quote
Old 07-02-2018, 04:44   #7
Registered User

Join Date: Jul 2010
Location: Kalamata, Greece
Boat: Amel Sharki
Posts: 1,996
Re: Harmonic Files ...

Quote:
Originally Posted by skipperearly View Post
@Netsurfer : have you found somewhere a description of the structure of the harmonic file? would like to add just a few locations for the Med and Atlantic south.

Thanks for sharing
I guess Netsurfer is not reading here anymore.
However it is not so difficult to add some own data to the Harmonics.
First get the latest version, might be V10, and then add a line for the new location into the section of that country into the file HARMONIC.IDX. The data fields of the new line are explained somewhere in the file HARMONIC.IDX itself:
Code:
 # &Hmin Hmpy Hoff Lmin Lmpy Loff StaID (tzname) RefFileNum RefName
The # sign marks a line as comment only.

Gerhard
CarCode is online now   Reply With Quote
Old 07-02-2018, 10:34   #8
Registered User

Join Date: Feb 2011
Posts: 621
Re: Harmonic Files ...

Quote:
Originally Posted by Netsurfer View Post
Hi all!

Does anybody knows how to merge several different Harmonic files to one and then create the Harmonic.idx file?

Or can the .idx file be created from several different Harmonic files at once?

I read about the Tide2idx file in the Readme of WXTide32 but to be honest, I didn't understand much of it:


The reason for asking is that there are several different Harmonic files out there (the one packaged with OpenCPN, the one from the french user (sorry, don't know his name), and several others available on the Web). But unfortunately they all cover different regions, some include also currents others don't - so I want them all in one Harmonic file (because there is no easy way to simply switch between different Harmonic files).

Thanks
Gunther
Be carefull, many stations have fairly wrong predictions due to the facts that they are using either old and out of date data or even wrong time zone setting. Check with the country predictions and if not possible with SHOM and/or Easytide. It may not be perfect but better than nothing. As far as US is concern some of the Alaska are shown in lat 0 degree and long 0 degree.
This is another sad thing. I am presently working it all around but it is a fair amout of work to do, as these were done by many pleople in different country.
Furthermore , I had ask in the pass to keep the way that we could have in the program data folder various version of harmonic files but it did not retain my suggestion. So long.
Good luck.
P_Dub is offline   Reply With Quote
Old 07-02-2018, 11:50   #9
Registered User

Join Date: Dec 2005
Location: Helsingborg
Boat: Dufour 35
Posts: 3,585
Re: Harmonic Files ...

Quote:
Originally Posted by P_Dub View Post
Be carefull, many stations have fairly wrong predictions due to the facts that they are using either old and out of date data or even wrong time zone setting. Check with the country predictions and if not possible with SHOM and/or Easytide. It may not be perfect but better than nothing. As far as US is concern some of the Alaska are shown in lat 0 degree and long 0 degree.
This is another sad thing. I am presently working it all around but it is a fair amout of work to do, as these were done by many pleople in different country.
Furthermore , I had ask in the pass to keep the way that we could have in the program data folder various version of harmonic files but it did not retain my suggestion. So long.
Good luck.
Have a look at https://opencpn.org/wiki/dokuwiki/doku.php?id=opencpnpencpn_user_manual:toolbar_bu ttons:tides_and_currents#using_alternative_data_se ts

As you can see O supports the xtide format. Annual updated NOAA tidal files are available via xtides web site. For example here is the 2018 version ftp://ftp.flaterco.com/xtide/harmoni...1-free.tar.bz2

So if you have problems with OpenCPNs default US tides, which are getting old, why not use the latest from NOAA?

If you use Linux or MAC you should be able to compile the " tideEditor", and use it for adding new places , or change existing data. Source code is available from flaterco.com.

Quote:
Furthermore , I had ask in the pass to keep the way that we could have in the program data folder various version of harmonic files but it did not retain my suggestion.
You can use multiple tidal files in various locations. This has been the case for years... Just add data sets in Options->Charts->Tides&Currents->Add Dataset.

To solve the problem with access to current tidal information worldwide, I think that a commercial plugin, similar to oeSENC/O-charts, is the only way to do it.

Thomas
cagney is offline   Reply With Quote
Old 07-02-2018, 13:10   #10
Registered User

Join Date: Feb 2011
Posts: 621
Re: Harmonic Files ...

Thomas, do not get frustated with that. I have all the necessary program to do analyse the data myself and therefore can check one by one, any stations I want to. That is a long job, but I have time an I do it for myself. I have not much against some, but I am just advising to be carefull.
Best Regards.
P_Dub is offline   Reply With Quote
Old 08-02-2018, 00:34   #11
Registered User

Join Date: Jul 2010
Location: Kalamata, Greece
Boat: Amel Sharki
Posts: 1,996
Re: Harmonic Files ...

Quote:
Originally Posted by P_Dub View Post
Thomas, do not get frustated with that. I have all the necessary program to do analyse the data myself and therefore can check one by one, any stations I want to. That is a long job, but I have time an I do it for myself. I have not much against some, but I am just advising to be carefull.
Best Regards.
The only good analyse is to check the calculated data with the reality. I have done this for 6 years with a self defined dataset for a location in Harmonic and I am satiesfied with the result. Any other approach does not work.

Gerhard
CarCode is online now   Reply With Quote
Old 22-06-2019, 07:04   #12
Registered User
 
rgleason's Avatar

Join Date: Mar 2012
Location: Boston, MA
Boat: 1981 Bristol 32 Sloop
Posts: 13,529
Re: Harmonic Files ...

Harmonic.idx is here for Windows users
C:\Program Files (x86)\OpenCPN [5.0.0+20c9a05]\tcdata


Quote:
Harmonic.idx
----------------
# Basic line formats:
# Reference stations: T|C Reg:Co:St Lon Lat TimeZone Name
# Info lines: I Reg:Co:St 0 0 0:0 (blank) Information
# Subordinate sta'ns: t|c Reg:Co:St Lon Lat TimeZone Name
# Subordinate extra: &Hmin Hmpy Hoff Lmin Lmpy Loff StaID RefFileNum RefName

XREF #Start of abbreviation cross reference
REGION NAA N. America, Atlantic
REGION NAP N. America, Pacific
....


Harmonic harmonic file start - - - - - - - - -
TAsi:Jpn:: 129.95 32.75 9:0 Aba, Nagasaki, Japan
TAsi:Jpn:: 144.283 44.0167 9:0 Abasiri, Hokkaido, Japan
TNAA:US:SC: -80.0067 32.6767 -5:0 Abbapoola Creek entrance, Stono River, South Carolina
TAuA:Aus:: 148.0833 -19.8833 10:0 Abbot Point, Australia
TEur:Scot:: -2.0787 57.1441 0:0 Aberdeen, Scotland - READ flaterco.com/pol.html
TNAP:US:WA: -123.8533 46.9667 -8:0 Aberdeen, Washington
TNAP:US:WA: -123.85 46.967 -8:0 Aberdeen, Washington (3)
TNAA:Can:NovS: -65.8167 43.6667 -4:0 Abott Harbour, Nova Scotia
TCar:Bahm:: -73 22.3667 -5:0 Abrahams Bay, Mayaguana Island, Bahamas
TNAA:Can:NovS: -65.95 43.8333 -4:0 Abram River, Nova Scotia
TAsi:Jpn:: 131.417 31.5833 9:0 Aburatu, Miyazaki, Japan
TAsi:Jpn:: 139.617 35.15 9:0 Aburatubo, Kanagawa, Japan

....
The "Harmonic" file is a changelog.txt file.
P_dub perhaps you could help with the details in the harmonic section...? How that works.
rgleason is online now   Reply With Quote
Old 22-06-2019, 09:34   #13
Registered User

Join Date: Feb 2011
Posts: 621
Re: Harmonic Files ...

The harmonics data (value and angle) must be listed in the same orderly way as Number of constituents in the header of the harmonic file, that is:-
92
#
# Constituent speeds
# Format: identifier [whitespace] speed [CR]
# Speed is in degrees per solar hour.
# Identifier is just a name for the constituent. They are for
# readability only; XTide assumes that the constituents will be listed
# in the same order throughout this file.
J1 15.5854433
K1 15.0410686
K2 30.0821373
L2 29.5284789
M2 28.9841042
etc...

The harmonic.idx
# TROIS-RIVIERES_03360, Quebec, CANADA 46d20.1'N 72d32.6'W
# METERS
# CANADIAN DATA, TZ+5.0
# Data 20.8years(1995-2015)
# !units: meters
# !longitude: -72.5392
# !latitude: 46.3435
TROIS-RIVIERES, Quebec
-05:00 :America/Montreal
1.1580 meters
J1 0.0008 020.50
K1 0.0130 011.55
K2 0.0004 229.69
L2 0.0035 071.00
M2 0.1439 002.19
etc...
the header of each part must be included prior to listing the data.
It is a bit complicated for a non intiated, but easy to manage once you have learn.
Further more the Arguments and node factors in the harmonic file must be listed in the same order. In the xtide file it start in 1700 but it is not necessary to do so. I have cut it to 1970, Unix platform require 1970.

For the rest it require the Analysis program for the hourly or 15 min or else program. Also one can add data in the harmonic.idx using offset, but one must know which station the offset is using. Sometimes there are lot of differences with the actual recording as evething depend on the lenht of the observation period.
So, in order word, one must know how to use his jugement.

Best Regards.
P_Dub is offline   Reply With Quote
Old 22-06-2019, 18:02   #14
Registered User
 
rgleason's Avatar

Join Date: Mar 2012
Location: Boston, MA
Boat: 1981 Bristol 32 Sloop
Posts: 13,529
Re: Harmonic Files ...

P_dub, Thank you. Perhaps this valuable information should be the first posting on a new wiki page about tides and currents?
rgleason is online now   Reply With Quote
Old 23-06-2019, 09:04   #15
Registered User
 
HappySeagull's Avatar

Join Date: Dec 2010
Location: B.C.,Canada
Boat: 29'
Posts: 2,412
Re: Harmonic Files ...

Quote:
The "Harmonic" file is a changelog.txt file
It is not! Harmonic.idx relies upon the Harmonic (no extension) file....but yes, indeed it contains a changelog at the beginning.



P_dub, if you can post your improved files somewhere, lots of us will try them out.

Or, if you don't have anywhere due to size, maybe pm/email me or rgleason and we can put them somewhere.


Just as an idea, Opencpn is nowadays able to browse to and select from various tidal data files, so instead of using one file to cover the world, perhaps someday, it'd be best to cut these up into localities? and load them as required from folders.. They load faster and are easier to "play with" too.
__________________

HappySeagull is offline   Reply With Quote
Reply

Thread Tools Search this Thread
Search this Thread:

Advanced Search
Display Modes Rate This Thread
Rate This Thread:

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are Off
Pingbacks are Off
Refbacks are Off


Similar Threads
Thread Thread Starter Forum Replies Last Post
Upload .kmz Files Palarran Forum Tech Support & Site Help 3 23-02-2011 10:21
GRIB Files: Getting them and Reading them Tspringer Navigation 17 31-01-2011 01:00
Updated / Completed mo/po Files Netsurfer OpenCPN 1 27-05-2010 14:05
Looking for GPX Files for Testing Netsurfer OpenCPN 3 10-02-2010 03:18
Large Email files 2divers Marine Electronics 16 27-04-2006 05:38

Advertise Here


Copyright 2002- Social Knowledge, LLC All Rights Reserved.

All times are GMT -7. The time now is 08:17.


Google+
Powered by vBulletin® Version 3.8.8 Beta 1
Copyright ©2000 - 2019, vBulletin Solutions, Inc.
Social Knowledge Networks
Powered by vBulletin® Version 3.8.8 Beta 1
Copyright ©2000 - 2019, vBulletin Solutions, Inc.
×

ShowCase vBulletin Plugins by Drive Thru Online, Inc.