Cruisers Forum
 


Join CruisersForum Today

Reply
 
Thread Tools Search this Thread Rate Thread Display Modes
Old 10-02-2018, 11:36   #1
Registered User
 
rgleason's Avatar

Join Date: Mar 2012
Location: Boston, MA
Boat: 1981 Bristol 32 Sloop
Posts: 11,782
Continuous Integration

for Linux and Windows
Appveyor vs Travis CI

Learning----

https://www.reddit.com/r/learnprogra..._travisci_for/

So, writing tests for code is good, right? Tests validate that a program is correct.
But tests can fail. If we pick up somebody's pull request or make a quick fix somewhere, we might have broken our system. When you later go and check out the code, maybe you've just broken the system, but you won't find out unless you run the tests.
Continuous Integration is the idea of running all of the tests upon checkin and validating that the tests still pass. Some developers go a step farther and deploy their code immediately upon a successful integration test run. That's called continuous deployment.
Travi-CI is simply a website that provides free continuous integration. People like it because when you see the badge, you know that the code you're about to download is probably not currently broken, or at least not in a way that its tests can determine.

https://tomassetti.me/continous-inte...-and-appveyor/

https://www.slant.co/versus/627/2481...is_vs_appveyor

https://www.g2crowd.com/compare/appveyor-vs-travis-ci


https://www.software.ac.uk/blog/2016...vis-ci-windows

https://stackshare.io/stackups/appve...s-vs-travis-ci

https://www.hanselman.com/blog/AppVe...yToBehold.aspx
__________________

rgleason is offline   Reply With Quote
Old 11-02-2018, 15:38   #2
Registered User
 
rgleason's Avatar

Join Date: Mar 2012
Location: Boston, MA
Boat: 1981 Bristol 32 Sloop
Posts: 11,782
Re: Continuous Integration

Appveyor Docs
https://www.appveyor.com/docs/

Appveyor with Github
https://www.appveyor.com/docs/deploy...very-tag-build
__________________

rgleason is offline   Reply With Quote
Old 20-02-2018, 17:13   #3
Registered User
 
boat_alexandra's Avatar

Join Date: Aug 2009
Location: chesapeake bay
Boat: bristol 27
Posts: 3,376
Re: Continuous Integration

continuous integration is interesting but...

1) How to build for OSX?
2) How to build for all platforms like arm 32 and 64. and x86 32 and 64? Maybe travis cl can cross compile mingw binaries for windows as well.
3) Can windows build somehow not have to rebuild all of wxwidgets every time? Is there a way to cache this? It wastes a lot of cpu, takes long time for results, and wastes server bandwidth.
4) android?
boat_alexandra is offline   Reply With Quote
Old 20-02-2018, 17:29   #4
Registered User

Join Date: Feb 2010
Location: On the go. Not in Prague.
Posts: 4,639
Re: Continuous Integration

Quote:
Originally Posted by boat_alexandra View Post
continuous integration is interesting but...

1) How to build for OSX?
By finishing the travis configuration. Look at https://github.com/nohal/iacfleet_pi...er/.travis.yml for an example. Did not bother including it in my recent PRs as it will have to be updated for O5 and wx3.1.
Quote:
2) How to build for all platforms like arm 32 and 64. and x86 32 and 64? Maybe travis cl can cross compile mingw binaries for windows as well.
Travis sure can cross compile the mingw binaries for windows as well (What is the use case for them having the native builds? Other than generating confusion for the normal public who has absolutely no idea what the difference is.), for the rest we have PPAs on Launchpad, https://build.opensuse.org, Fedora build tools etc.
Quote:
3) Can windows build somehow not have to rebuild all of wxwidgets every time? Is there a way to cache this? It wastes a lot of cpu, takes long time for results, and wastes server bandwidth.
Yes, look at https://github.com/OpenCPN/OpenCPN/b...r/appveyor.yml for an example.
Quote:
4) android?
Android what? Build? Probably doable on Travis as everything else.
nohal is offline   Reply With Quote
Old 20-02-2018, 17:41   #5
Registered User
 
boat_alexandra's Avatar

Join Date: Aug 2009
Location: chesapeake bay
Boat: bristol 27
Posts: 3,376
Re: Continuous Integration

Quote:
Originally Posted by nohal View Post
By finishing the travis configuration. Look at https://github.com/nohal/iacfleet_pi...er/.travis.yml for an example. Did not bother including it in my recent PRs as it will have to be updated for O5 and wx3.1.
I will wait for this.
Quote:
Travis sure can cross compile the mingw binaries for windows as well (What is the use case for them having the native builds? Other than generating confusion for the normal public who
Compiling with a non-free compiler has the implication that the resulting program is technically not free, as we do not anymore know exactly what it might do. Maybe there are exactly zero users who care since they are after all, running windows.
Quote:
has absolutely no idea what the difference is.), for the rest we have PPAs on Launchpad, https://build.opensuse.org, Fedora build tools etc.
Are these built with the incremental builds or only for each release? Maybe there is not much reason to, as typically if one linux platform succeeds all of them will.
Quote:
Yes, look at https://github.com/OpenCPN/OpenCPN/b...r/appveyor.yml for an example.
Ok.
Quote:
Android what? Build? Probably doable on Travis as everything else.
[/quote]
Yes. I would like to build plugins for android automatically in this way, and generate the apk for download.
boat_alexandra is offline   Reply With Quote
Old 20-02-2018, 17:52   #6
Registered User

Join Date: Feb 2010
Location: On the go. Not in Prague.
Posts: 4,639
Re: Continuous Integration

Quote:
Originally Posted by boat_alexandra View Post
Compiling with a non-free compiler has the implication that the resulting program is technically not free, as we do not anymore know exactly what it might do. Maybe there are exactly zero users who care since they are after all, running windows.
There is also exactly zero people willing to do the publishing of two functionally identical products (multiplied by the number of plugins + the main package). If you wonder why, we may switch roles for the O5 release cycle...
Quote:
Are these built with the incremental builds or only for each release? Maybe there is not much reason to, as typically if one linux platform succeeds all of them will.
I do the builds just for the releases. So far problems were rare enough not to do anything else. Nothing can prevent you from creating your own PPA, setting up a hook in git and submitting the build for every commit. IMO a waste of effort and electricity though and if you ask me, invest that time into checking your stuff with Coverity and actually fixing it...
Quote:
Yes. I would like to build plugins for android automatically in this way, and generate the apk for download.
As I wrote, probably doable using Travis (And maybe Appveyor as well with likely more effort), but you will have to do it yourself.
nohal is offline   Reply With Quote
Old 21-02-2018, 05:46   #7
Registered User
 
rgleason's Avatar

Join Date: Mar 2012
Location: Boston, MA
Boat: 1981 Bristol 32 Sloop
Posts: 11,782
Re: Continuous Integration

After reading your discusssion, I have two questions.
1. Does completing a travis ci or appveyor build successfully involve your having to wait for processsing and involve personnal computer time on your machine?
2. I can understand Pavel's point about maintaining two windows systems that do the same thing Mingw and MSVC. I just wonder if Mingw would be easier from a programming point of view, because we know MSVC is very picky.

Could there be a background "experiment" with Continuous Integration appveyor for Opencpn + some critical plugins to see if it would be an easier system to use? It would not be on the downloads page and would not interfere with the release process until everyone agreed that it was a better choice, and then you might switch over at the same time there was a wxWidget upgrade because all PI much be redone then?

Why do Windoze Users get such terrible characterizations? We just want things to work

Should I have upgraded to MSVC++ 2017 + wxWidgets 3.11 by now?
I found
https://github.com/nohal/OpenCPN/wik...n-Windows---O5

https://github.com/nohal/OpenCPN/wik...-Windows-build

Then I found this
https://github.com/nohal/OpenCPN/wik...--11-migration

NOTE FOR RICK GLEASON:

REMOVE THE LINKS TO THIS AND SIMILAR PAGES FROM THE DOCUMENTATION, PLEASE!!!!!!!!

How long has this been there?

Pavel, how the devil am I going to know that you put that there? Also, as Dave says, Don't shout.

You have my email and can send me a brief note, I usually can respond fairly quickly.


When I remove these links will you please remove this note?

This is just like being in a family!
rgleason is offline   Reply With Quote
Old 21-02-2018, 05:59   #8
Registered User

Join Date: Feb 2010
Location: On the go. Not in Prague.
Posts: 4,639
Re: Continuous Integration

Quote:
Originally Posted by rgleason View Post
After reading your discusssion, I have two questions.
1. Does completing a travis ci or appveyor build successfully involve your having to wait for processsing and involve personnal computer time on your machine?
No, it has nothing to do with your machine.
Quote:
2. I can understand Pavel's point about maintaining two windows systems that do the same thing Mingw and MSVC. I just wonder if Mingw would be easier from a programming point of view, because we know MSVC is very picky.
No, mingw is not easier for a normal Windows developer.
Quote:
Should I have upgraded to MSVC++ 2017 + wxWidgets 3.11 by now?
No, you should not.
Quote:
Then I found this
https://github.com/nohal/OpenCPN/wik...-Windows-build

NOTE FOR RICK GLEASON:

REMOVE THE LINKS TO THIS AND SIMILAR PAGES FROM THE DOCUMENTATION, PLEASE!!!!!!!!

How long has this been there?
Exactly long enough for you to finally notice it.
Quote:
Pavel, how the devil am I going to know that you put that there? Also, as Dave says, Don't shout.
Exactly the same way I'm supposed to know you fill the official documentation with my unordered and mostly unusable personal notes from a work in progress.

Pavel
nohal is offline   Reply With Quote
Old 21-02-2018, 06:06   #9
Registered User
 
rgleason's Avatar

Join Date: Mar 2012
Location: Boston, MA
Boat: 1981 Bristol 32 Sloop
Posts: 11,782
Re: Continuous Integration

Removed
https://opencpn.org/wiki/dokuwiki/do...to_opencpn_482

Thanks
rgleason is offline   Reply With Quote
Old 21-02-2018, 11:40   #10
Registered User
 
zboss's Avatar

Join Date: Sep 2011
Location: On a boat
Boat: 1987 Cabo Rico 38 #117
Posts: 3,749
Re: Continuous Integration

You are getting continuous integration and test driven development mixed up. TDD is a common aspect of CI but lots of devshops does one or the other. Don't even bring in devtestops.

What is most commonly misunderstood about CI and devops is that they are some how the wild west when in fact they are highly coordinated activities. The most effective CI/CD system compress the release trains down into a single push and everyone is developing off the latest code.

Also, CI/CD rarely works efficiently in legacy applications because they were not architected to support modern integration patterns. So most companies are either faced with refactoring the system to support a new pattern or they develop a new app and migrate clients.

Quote:
Originally Posted by rgleason View Post
for Linux and Windows
Appveyor vs Travis CI

Learning----

https://www.reddit.com/r/learnprogra..._travisci_for/

So, writing tests for code is good, right? Tests validate that a program is correct.
But tests can fail. If we pick up somebody's pull request or make a quick fix somewhere, we might have broken our system. When you later go and check out the code, maybe you've just broken the system, but you won't find out unless you run the tests.
Continuous Integration is the idea of running all of the tests upon checkin and validating that the tests still pass. Some developers go a step farther and deploy their code immediately upon a successful integration test run. That's called continuous deployment.
Travi-CI is simply a website that provides free continuous integration. People like it because when you see the badge, you know that the code you're about to download is probably not currently broken, or at least not in a way that its tests can determine.

https://tomassetti.me/continous-inte...-and-appveyor/

https://www.slant.co/versus/627/2481...is_vs_appveyor

https://www.g2crowd.com/compare/appveyor-vs-travis-ci


https://www.software.ac.uk/blog/2016...vis-ci-windows

https://stackshare.io/stackups/appve...s-vs-travis-ci

https://www.hanselman.com/blog/AppVe...yToBehold.aspx
zboss is offline   Reply With Quote
Old 21-02-2018, 15:08   #11
Registered User
 
transmitterdan's Avatar

Join Date: Oct 2011
Boat: Valiant 42
Posts: 4,647
Re: Continuous Integration

O built with MSVC Community Edition is not restricted as far as I know. We cannot distribute the sources for the MSVC runtime but that doesnít mean that O isnít still free. I donít see this ever changing. Microsoft has fully embraced open source projects like O. They wonít go back on that I think.
transmitterdan is online now   Reply With Quote
Old 21-02-2018, 17:36   #12
Registered User
 
boat_alexandra's Avatar

Join Date: Aug 2009
Location: chesapeake bay
Boat: bristol 27
Posts: 3,376
Re: Continuous Integration

Quote:
2. I can understand Pavel's point about maintaining two windows systems that do the same thing Mingw and MSVC. I just wonder if Mingw would be easier from a programming point of view, because we know MSVC is very picky.
since mingw is gcc, it tends to compile existing code that compiles on gcc with fewer changes than what msvc requires. It's about half the effort to support compared to msvc.

I have found bugs after building with mingw, because it uses an alternate compiler to build windows specific code which makes the sources more robust. In the same way, msvc also occasionally helps. I have also build with llvm on linux and found issues.

More compilers and platform combinations gives better code quality.

Quote:
Originally Posted by nohal View Post
No, mingw is not easier for a normal Windows developer.
It is easier for me, and I don't know what is a normal windows developer. It appears you and dave both have little interest in using mingw which is fine. also don't really care since it's windoze anyway. Just annoying to have to implement msvc specifics in every single plugin, but I can live with it.

Quote:
Originally Posted by transmitterdan View Post
O built with MSVC Community Edition is not restricted as far as I know. We cannot distribute the sources for the MSVC runtime but that doesnít mean that O isnít still free. I donít see this ever changing. Microsoft has fully embraced open source projects like O. They wonít go back on that I think.
If we link with code that we do not have the source code to, then technically, our software is no longer free software, and this is also a violation of GPL. It does not matter static or dynamic linking is the same. It is for us to enforce this or not, and since we don't care it is "ok"

I met richard stallman in person and discussed this exact issue.

I do care that OpenCPN be free software, at least on free OS, but I don't care about non-free OS.
boat_alexandra is offline   Reply With Quote
Old 21-02-2018, 19:01   #13
Registered User
 
transmitterdan's Avatar

Join Date: Oct 2011
Boat: Valiant 42
Posts: 4,647
Re: Continuous Integration

Whether MAC or Windows no code can execute without linking to the underlying OS and BIOS. If Stallman wants to argue that no GPL license is valid on Windows or MAC he will be in a small minority. I think a strict read of the O GPL will tell you that there is no problem with the GPL license.
transmitterdan is online now   Reply With Quote
Old 21-02-2018, 19:12   #14
Registered User
 
boat_alexandra's Avatar

Join Date: Aug 2009
Location: chesapeake bay
Boat: bristol 27
Posts: 3,376
Re: Continuous Integration

Quote:
Originally Posted by transmitterdan View Post
Whether MAC or Windows no code can execute without linking to the underlying OS and BIOS. If Stallman wants to argue that no GPL license is valid on Windows or MAC he will be in a small minority. I think a strict read of the O GPL will tell you that there is no problem with the GPL license.
This is not the underlying OS or BIOS, but the MSVC runtime.

The same issue exists for non-free linux kernel modules such as closed source drivers. They are technically a violation of GPL, but the kernel developers allow it, so it's ok.

In any case, any software running on mac or windows cannot be considered safe, as the OS has unreasonable control over the user.
boat_alexandra is offline   Reply With Quote
Old 21-02-2018, 19:42   #15
Registered User

Join Date: Feb 2010
Location: On the go. Not in Prague.
Posts: 4,639
Re: Continuous Integration

Quote:
Originally Posted by boat_alexandra View Post
It is easier for me
Nobody prohibits you from using mingw and maintaining support for it, of course. There just so far does not appear to be anybody wanting to share this fun with you. But there is nothing wrong about that as far as I can say, we all have our choice.
Quote:
and I don't know what is a normal windows developer.
One using the Visual Studio toolchain he gets from Microsoft, the supplier of the OS.
There is also, due to the implementation of the toolchain, technically somewhat closer to what you use, group of normal macOS developers using Xcode and not even knowing it is just a GUI frontend to LLVM, LLDB and a couple of other open source tools.
__________________

nohal is offline   Reply With Quote
Reply

Thread Tools Search this Thread
Search this Thread:

Advanced Search
Display Modes Rate This Thread
Rate This Thread:

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are Off
Pingbacks are Off
Refbacks are Off


Similar Threads
Thread Thread Starter Forum Replies Last Post
Autopilot Integration Already Working in Latest OpenCPN ? s51ta OpenCPN 8 21-02-2011 15:15
Need Help with AIS / DSC / GPS / Chartplotter Integration JulieD Marine Electronics 19 21-11-2010 01:12
Sprint Overdrive WIFI GPS Integration with OpenCPN Cal40Pir8 OpenCPN 1 03-09-2010 11:18
Raymarine / Furuno N2K Integration Experiences? Pyxis156 Navigation 9 17-02-2010 14:50



Copyright 2002- Social Knowledge, LLC All Rights Reserved.

All times are GMT -7. The time now is 08:10.


Google+
Powered by vBulletin® Version 3.8.8 Beta 1
Copyright ©2000 - 2018, vBulletin Solutions, Inc.
Social Knowledge Networks
Powered by vBulletin® Version 3.8.8 Beta 1
Copyright ©2000 - 2018, vBulletin Solutions, Inc.

ShowCase vBulletin Plugins by Drive Thru Online, Inc.