Cruisers Forum
 


Join CruisersForum Today

Reply
 
Thread Tools Rate Thread Display Modes
Old 20-03-2017, 15:45   #1
Registered User

Join Date: Jun 2015
Location: Portland, OR
Posts: 106
BoatCrawler: A new way to search the sailboat market

I wasn't sure where to post this, but I have decided to post it here as itís the forum I frequent most and seems appropriate.

What is it?
BoatCrawler is a tool I made for myself to help me find a boat to sail around the world. I used BluewaterBoats.org, AtomVoyages.com, and this site extensively to find the right criteria for a bluewater boat.

The problem was, I had a very long list of boats that met my requirements, and it was a tedious task to check places like sailboatlistings.com and yachtworld.com for these boats, even on a weekly basis.

So I set out to automate my searches and create a dashboard of results. This way, I could wake up in the morning to a dashboard that displayed each and every example of "Boat X", "Boat Y", and "Boat Z", currently listed on sailboatlistings.com and yachtworld.com.

I found it useful, so I decided to clean it up and release it to a broader audience.

Where is it?
BoatCrawler (beta), and it can be found at:
http://www.boatcrawler.com/

You can create a new account, which will be automatically populated with sample data, or use a demo account for view-only purposes:

user: DemoUser
pass: DemoUser123

Note: with the demo account, you won't be able to make any changes to the queries, add queries, favorite boats, etc.

What do you mean "beta"?
Aside from myself, I've had very few other users test the app. As a result, you may encounter bugs or behavior that I am not aware of (you will).

If you do, please shoot me a pm or give me a comment here. Screenshots are helpful.

I also have concerns about server-load. The server has handled a modest set of queries for a small number of users, but I'm unsure of how this will scale.

Thus: I beg you to be patient while its in beta, and try not to judge me too harshly.

What are the limitations?
  1. The mobile version currently not ready (sorry!)
  2. It will only search YachtWorld and SailboatListings
  3. For server load concerns, you can't have more than 50 queries at a time.
  4. A single query cannot return more than 50 results, so be specific.
  5. Geo-locating is slow -- I'm exploring other options
  6. Queries only run once a day (unless they're new)
  7. I'm on shared-hosting, so please be patient!

Craigslist will not likely be added as a search website. It would be technically challenging as CL is location-specific. Additionally, Craigslist has a history of sueing people for page scraping.

Other sites could be added, the two I chose were the two I used most.

Again, I beg you for your patience. The purpose of the beta is to get feedback on why it sucks so much, and not to win any praise.

Happy crawling!
__________________

__________________
Ryban is offline   Reply With Quote
Old 20-03-2017, 16:05   #2
Jd1
Registered User

Join Date: Aug 2011
Location: Victoria, BC
Boat: Catalina 36 MKII
Posts: 999
Re: BoatCrawler: A new way to search the sailboat market

Great idea ! There, praise even though you didn't ask for any
I have not yet tried the product so can't offer feedback about suckiness ....
__________________

__________________
Jd1 is offline   Reply With Quote
Old 20-03-2017, 22:56   #3
Senior Cruiser

Cruisers Forum Supporter

Join Date: Jul 2005
Boat: Outbound 44
Posts: 4,038
Re: BoatCrawler: A new way to search the sailboat market

Can a demo user add and execute a query?
__________________
Paul L
http://svjeorgia.blogspot.com
Paul L is online now   Reply With Quote
Old 20-03-2017, 23:09   #4
Registered User

Join Date: Jun 2015
Location: Portland, OR
Posts: 106
Re: BoatCrawler: A new way to search the sailboat market

Quote:
Originally Posted by Paul L View Post
Can a demo user add and execute a query?
The DemoUser can't add or execute queries because it would muddle things up behind the scenes if multiple people were modifying the same set of data. However, the DemoUser's queries are executed regularly.

If you register and login though, you can do those things of course.
__________________
Ryban is offline   Reply With Quote
Old 20-03-2017, 23:24   #5
Registered User

Join Date: Jan 2016
Location: Phuket
Posts: 20
Re: BoatCrawler: A new way to search the sailboat market

Tried to sign up and that worked, but login wouldn't accept my password.

Reset password email worked, I have a new temp password via email, still says "Invalid login credentials" -

Great idea, love it. Hope it can let me log in.

Username I used was Getaway.

I've tried both firefox and chrome browsers.
__________________
Get-away is online now   Reply With Quote
Old 21-03-2017, 00:06   #6
Registered User

Join Date: Jun 2015
Location: Portland, OR
Posts: 106
Re: BoatCrawler: A new way to search the sailboat market

Quote:
Originally Posted by Get-away View Post
Tried to sign up and that worked, but login wouldn't accept my password.

Reset password email worked, I have a new temp password via email, still says "Invalid login credentials" -

Great idea, love it. Hope it can let me log in.

Username I used was Getaway.

I've tried both firefox and chrome browsers.
Very strange! I haven't been able to replicate this behavior but I'm looking into it.

Edit: I've looked over the logs and sent you an e-mail!
__________________
Ryban is offline   Reply With Quote
Old 21-03-2017, 00:43   #7
Registered User

Join Date: Jan 2016
Location: Phuket
Posts: 20
Re: BoatCrawler: A new way to search the sailboat market

Quote:
Originally Posted by Ryban View Post
Very strange! I haven't been able to replicate this behavior but I'm looking into it.

Edit: I've looked over the logs and sent you an e-mail!
Re-registered as you suggested in your email - all seems fine now - both Firefox and Chrome.

Used exactly the same credentials as before - just one of those thing I guess.

Cheers for the quick help.
__________________
Get-away is online now   Reply With Quote
Old 21-03-2017, 08:51   #8
Registered User
 
LeeV's Avatar

Join Date: Apr 2013
Location: Md
Boat: Corsair Marine 36 trimaran
Posts: 241
Re: BoatCrawler: A new way to search the sailboat market

I've tried registering over a dozen times, but it keeps erasing my passwords and even if I change the password to something else, it does the same - on my iPad, and my Dell, using I.E. or Chrome. Passwords all have cap, lower and number(S).

Great idea, though!
__________________
LeeV
Corsair Marine 36' Trimaran
"MOMENTUM"
LeeV is offline   Reply With Quote
Old 21-03-2017, 08:56   #9
Registered User
 
LeeV's Avatar

Join Date: Apr 2013
Location: Md
Boat: Corsair Marine 36 trimaran
Posts: 241
Re: BoatCrawler: A new way to search the sailboat market

...and then I recvd an email telling me I'm in!
__________________
LeeV
Corsair Marine 36' Trimaran
"MOMENTUM"
LeeV is offline   Reply With Quote
Old 21-03-2017, 09:02   #10
Registered User
 
AmericanVagrant's Avatar

Join Date: Apr 2015
Location: Long Beach, CA
Boat: Hallberg-Rassy 33
Posts: 217
Re: BoatCrawler: A new way to search the sailboat market

Cool program, I checked it out using the demo login. How often is the database refreshed? I noted that there are currently 12 active listings on SailboatListings and 4 on YachtWorld for the Albin Vega, but only 7 total appeared in your application.
__________________
Follow me around the world @ AmericanVagrant.com
AmericanVagrant is offline   Reply With Quote
Old 21-03-2017, 10:01   #11
Registered User

Join Date: Oct 2015
Location: Aspen USA
Boat: 10' surfboard
Posts: 144
Re: BoatCrawler: A new way to search the sailboat market

Is the crawler capeable of eliminating sailboatlisting results based on date of post?

That site seems to contain a lot of results that are many years old, this is undesireable.

sorting results by date of posting for yachtworld would be very useful also.

did you also make a game i could play, to fill all the extra time i will have now?
__________________
nematon785 is offline   Reply With Quote
Old 21-03-2017, 11:04   #12
Registered User
 
brendanwalls's Avatar

Join Date: Sep 2016
Location: Baltimore
Boat: Bristol, Corsair, 24
Posts: 7
Send a message via AIM to brendanwalls Send a message via MSN to brendanwalls Send a message via Yahoo to brendanwalls Send a message via Skype™ to brendanwalls
Re: BoatCrawler: A new way to search the sailboat market

It deletes the password as soon as you press register
__________________
brendanwalls is offline   Reply With Quote
Old 21-03-2017, 12:02   #13
Registered User
 
hafa's Avatar

Join Date: Jan 2017
Location: Northern Mariana Islands
Boat: Hunter Legend 40.5
Posts: 172
Re: BoatCrawler: A new way to search the sailboat market

A few suggestions:

  1. Make queries user-specific; we do not need to see other's queries.
  2. Make terms consistent; you use "Size" in the query, but "Length" in the results.
  3. In the Query, for Price, length and year, use drop downs or restrict to integers using regular expressions.
  4. Make it clear that the price, year, length and location buttons on the overall listing are for sorting.
  5. Differentiate the Yachtworld and SailboatListings buttons from the price, year, length and location buttons, as they filter, rather than sort.
  6. Rather than restrict overall results, paginate them.
  7. Remove the pulsing number on the query page. Very distracting.
__________________
hafa is online now   Reply With Quote
Old 21-03-2017, 12:44   #14
Registered User
 
DenverSailors's Avatar

Join Date: Jul 2015
Posts: 18
Re: BoatCrawler: A new way to search the sailboat market

Amazing concept and I'm excited to see it mature. I have the same issue Aruban did. Am I simply too eager to access?
__________________
DenverSailors is offline   Reply With Quote
Old 21-03-2017, 12:58   #15
Registered User
 
hafa's Avatar

Join Date: Jan 2017
Location: Northern Mariana Islands
Boat: Hunter Legend 40.5
Posts: 172
Re: BoatCrawler: A new way to search the sailboat market

Quote:
Originally Posted by DenverSailors View Post
Amazing concept and I'm excited to see it mature. I have the same issue Aruban did. Am I simply too eager to access?
Perhaps attempting to login before clicking the link in the validation email? The notification at the top of the page subsequent to registration is easy to miss and could be more complete in describing the process.
__________________

__________________
hafa is online now   Reply With Quote
Reply

Tags
arc, boat, sail, sailboat

Thread Tools
Display Modes Rate This Thread
Rate This Thread:

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are Off
Pingbacks are Off
Refbacks are Off


Similar Threads
Thread Thread Starter Forum Replies Last Post
Is there a way to search subscribed threads only? Paul L Forum Tech Support & Site Help 5 26-04-2016 21:39
Buyer's Market or Seller's Market ? rourkeh Dollars & Cents 31 11-10-2010 10:52
What Is the Best Way to Search ? exterra Forum Tech Support & Site Help 4 19-09-2010 14:11
Buyer's Market: Sailboat Sales Plunge sandy daugherty Dollars & Cents 10 02-07-2009 10:47
A new way to market a boat fastcat435 Cruising News & Events 1 16-01-2009 03:54


Our Communities

Our communities encompass many different hobbies and interests, but each one is built on friendly, intelligent membership.

» More about our Communities

Automotive Communities

Our Automotive communities encompass many different makes and models. From U.S. domestics to European Saloons.

» More about our Automotive Communities

Marine Communities

Our Marine websites focus on Cruising and Sailing Vessels, including forums and the largest cruising Wiki project on the web today.

» More about our Marine Communities


Copyright 2002- Social Knowledge, LLC All Rights Reserved.

All times are GMT -7. The time now is 01:53.


Google+
Powered by vBulletin® Version 3.8.8 Beta 1
Copyright ©2000 - 2017, vBulletin Solutions, Inc.
Social Knowledge Networks
Powered by vBulletin® Version 3.8.8 Beta 1
Copyright ©2000 - 2017, vBulletin Solutions, Inc.

ShowCase vBulletin Plugins by Drive Thru Online, Inc.