Cruisers Forum
 


Join CruisersForum Today

Reply
 
Thread Tools Search this Thread Rate Thread Display Modes
Old 22-03-2019, 04:30   #1
Senior Cruiser
 
GordMay's Avatar

Cruisers Forum Supporter

Join Date: Mar 2003
Location: Thunder Bay, Ontario - 48-29N x 89-20W
Boat: (Cruiser Living On Dirt)
Posts: 34,288
Images: 240
“Why Most Published Research Findings Are False”

“Why Most Published Research Findings Are False” ~ by John P. A. Ioannidis
“There is increasing concern that most current published research findings are false. The probability that a research claim is true may depend on study power and bias, the number of other studies on the same question, and, importantly, the ratio of true to no relationships among the relationships probed in each scientific field. In this framework, a research finding is less likely to be true when the studies conducted in a field are smaller; when effect sizes are smaller; when there is a greater number and lesser preselection of tested relationships; where there is greater flexibility in designs, definitions, outcomes, and analytical modes; when there is greater financial and other interest and prejudice; and when more teams are involved in a scientific field in chase of statistical significance. Simulations show that for most study designs and settings, it is more likely for a research claim to be false than true. Moreover, for many current scientific fields, claimed research findings may often be simply accurate measures of the prevailing bias. In this essay, I discuss the implications of these problems for the conduct and interpretation of research...”
Article ➥ https://journals.plos.org/plosmedici...l.pmed.0020124

Note: This article didn't go unchallenged. See "Related PLOS Articles", to the right of the main article.
__________________

__________________
Gord May
"If you didn't have the time or money to do it right in the first place, when will you get the time/$ to fix it?"



GordMay is offline   Reply With Quote
Old 22-03-2019, 04:31   #2
Senior Cruiser
 
GordMay's Avatar

Cruisers Forum Supporter

Join Date: Mar 2003
Location: Thunder Bay, Ontario - 48-29N x 89-20W
Boat: (Cruiser Living On Dirt)
Posts: 34,288
Images: 240
Re: “Why Most Published Research Findings Are False”

“Scientists rise up against statistical significance”
Valentin Amrhein, Sander Greenland, Blake McShane and more than 800 signatories call for an end to hyped claims and the dismissal of possibly crucial effects.
“... For several generations, researchers have been warned that a statistically non-significant result does not ‘prove’ the null hypothesis (the hypothesis that there is no difference between groups or no effect of a treatment on some measured outcome)1. Nor do statistically significant results ‘prove’ some other hypothesis. Such misconceptions have famously warped the literature with overstated claims and, less famously, led to claims of conflicts between studies where none exists.
We have some proposals to keep scientists from falling prey to these misconceptions ...”

Article ➥ https://www.nature.com/articles/d41586-019-00857-9

“It’s time to talk about ditching statistical significance”
https://www.nature.com/articles/d41586-019-00874-8

“Five ways to fix statistics”
https://www.nature.com/articles/d41586-017-07522-z
__________________

__________________
Gord May
"If you didn't have the time or money to do it right in the first place, when will you get the time/$ to fix it?"



GordMay is offline   Reply With Quote
Old 22-03-2019, 04:37   #3
UFO
Registered User

Join Date: Oct 2017
Location: Perth
Boat: UFO 34
Posts: 196
Re: “Why Most Published Research Findings Are False”

"There are three kinds of lies: lies, damned lies, and statistics."
UFO is offline   Reply With Quote
Old 22-03-2019, 04:59   #4
Freelance Delivery Skipper..
 
boatman61's Avatar

Community Sponsor
Cruisers Forum Supporter

Join Date: Jan 2010
Location: PORTUGAL
Posts: 23,484
Images: 2
pirate Re: “Why Most Published Research Findings Are False”

Whoda thunk it..
__________________


Born To Be Wild.. Click on the picture.
boatman61 is offline   Reply With Quote
Old 22-03-2019, 05:29   #5
Registered User
 
Suijin's Avatar

Join Date: Feb 2013
Location: Annapolis MD; currently in Bahamas
Boat: Valiant 40
Posts: 4,405
“Why Most Published Research Findings Are False”

So by extension this research finding has a high statistical probability of being false lolz
__________________
"Having a yacht is reason for being more cheerful than most." -Kurt Vonnegut
Suijin is offline   Reply With Quote
Old 22-03-2019, 05:54   #6
Registered User

Join Date: Sep 2008
Posts: 352
Re: “Why Most Published Research Findings Are False”

Quote:
Originally Posted by Suijin View Post
So by extension this research finding has a high statistical probability of being false lolz

bill352 is offline   Reply With Quote
Old 22-03-2019, 07:00   #7
Senior Cruiser
 
GordMay's Avatar

Cruisers Forum Supporter

Join Date: Mar 2003
Location: Thunder Bay, Ontario - 48-29N x 89-20W
Boat: (Cruiser Living On Dirt)
Posts: 34,288
Images: 240
Re: “Why Most Published Research Findings Are False”

Quote:
Originally Posted by Suijin View Post
So by extension this research finding has a high statistical probability of being false lolz
Indeed; one of the exact points Dr. Wren brings up, in the following paper.


“Truth, Probability, and Frameworks” ~ by Jonathan D Wren
“... Although John P. A. Ioannidis [1] brings up several good points about over-reliance on formal—yet arbitrary—statistical cutoffs and bias against the reporting of negative results, his claim that most published research findings are false is somewhat paradoxical. Ironically, the truer his premise is, the less likely his conclusions are. He, after all, relies heavily on other studies to support his premise, so if most (i.e., greater than 50%) of his cited studies are themselves false (including the eight of 37 that pertain to his own work), then his argument is automatically on shaky ground ...”
https://journals.plos.org/plosmedici...l.pmed.0020361
__________________
Gord May
"If you didn't have the time or money to do it right in the first place, when will you get the time/$ to fix it?"



GordMay is offline   Reply With Quote
Old 22-03-2019, 11:08   #8
Registered User

Join Date: Jan 2017
Posts: 10,088
Re: “Why Most Published Research Findings Are False”

Smells like continued attacks on the fundamental concept that we all share one Reality

about which Science has objectively True things to say.

I completely concede that this is worth challenging philosophically.

But wrt driving government policy and our day to day decisions in practice, the money-driven propaganda efforts to shape our shared Reality toward their own ends must be vigorously resisted.
john61ct is offline   Reply With Quote
Old 22-03-2019, 13:35   #9
Registered User
 
CaptTom's Avatar

Join Date: Apr 2004
Location: Southern Maine
Boat: Prairie 36 Coastal Cruiser
Posts: 1,494
Re: “Why Most Published Research Findings Are False”

Our knowledge is imperfect. We don't know everything. So what do we do about it?

Abandon all common sense and go with our "gut feel" or, more likely, whatever belief most closely resembles our personal preference or political bias?

Should we not even try to push the boundaries of knowledge, because there's an outside chance that, even though our research has advanced science, part of our answer may be found later to be more complex or nuanced than we originally thought?

Honestly, some people will use any justification to stick their heads in the sand!
CaptTom is offline   Reply With Quote
Old 22-03-2019, 13:57   #10
Senior Cruiser
 
GordMay's Avatar

Cruisers Forum Supporter

Join Date: Mar 2003
Location: Thunder Bay, Ontario - 48-29N x 89-20W
Boat: (Cruiser Living On Dirt)
Posts: 34,288
Images: 240
Re: “Why Most Published Research Findings Are False”

[IMG]https://cdn-images-1.medium.com/max/800/1*L2Stp62lKNwHc4j3UgVi9w.png[/IMG]
__________________
Gord May
"If you didn't have the time or money to do it right in the first place, when will you get the time/$ to fix it?"



GordMay is offline   Reply With Quote
Old 22-03-2019, 15:32   #11
Registered User

Join Date: Feb 2018
Posts: 323
Re: “Why Most Published Research Findings Are False”

Quote:
Originally Posted by GordMay View Post
“Why Most Published Research Findings Are False” ~ by John P. A. Ioannidis.....


Note: This article didn't go unchallenged. See "Related PLOS Articles", to the right of the main article.
This subject of bias and methodology (i.e. human nature) is quite old (thousands of years?) and is known to people who know how to read research in their field. Discussing the etiology of the phenomenon is problematic in mixed company as it ordinarily requires reference to religion and politics.

Why the intense interest...in a forum where religion and politics cannot frankly be discussed? To repetitively present the topic is curious in that it effectively says "hey, there's a problem with intellectuals" without being able to discuss what the real problem is. What is the intent or goal here?

https://en.wikipedia.org/wiki/Anti-intellectualism
Attached Thumbnails
Click image for larger version

Name:	socrates.JPG
Views:	76
Size:	104.1 KB
ID:	188529  
Singularity is online now   Reply With Quote
Old 22-03-2019, 15:41   #12
Registered User
 
SailOar's Avatar

Join Date: Jul 2011
Location: USA
Posts: 434
Re: “Why Most Published Research Findings Are False”



[For those who, like me, couldn't see the image Gord posted in #10]
__________________
The greatest deception men suffer is their own opinions.
-Leonardo da Vinci
SailOar is offline   Reply With Quote
Old 22-03-2019, 15:47   #13
Senior Cruiser
 
Dave_S's Avatar

Cruisers Forum Supporter

Join Date: Jun 2016
Location: Brisbane Australia
Boat: Schionning Waterline 1480
Posts: 1,065
Re: “Why Most Published Research Findings Are False”

It's simple...... truth to individuals is what they perceive to be true, it can be unrelated to actual truth. How people perceive an issue is their truth it is not tied to the actual truth at all.

Convince a majority to perceive an issue your way and the minority are suddenly fools.
__________________
Regards
Dave
Dave_S is offline   Reply With Quote
Old 22-03-2019, 16:23   #14
Registered User
 
gamayun's Avatar

Join Date: Aug 2013
Location: Oakland, CA
Boat: Freedom 38
Posts: 1,858
Re: “Why Most Published Research Findings Are False”

"Most" How freaking scientific is that?!
gamayun is offline   Reply With Quote
Old 22-03-2019, 17:12   #15
Senior Cruiser
 
StuM's Avatar

Cruisers Forum Supporter

Join Date: Nov 2013
Location: Port Moresby,Papua New Guinea
Boat: FP Belize Maestro 43
Posts: 8,323
Re: “Why Most Published Research Findings Are False”

Quote:
Originally Posted by gamayun View Post
"Most" How freaking scientific is that?!

Would you prefer "more than 50%" ?
__________________

StuM is offline   Reply With Quote
Reply

Tags
arc, research

Thread Tools Search this Thread
Search this Thread:

Advanced Search
Display Modes Rate This Thread
Rate This Thread:

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are Off
Pingbacks are Off
Refbacks are Off


Similar Threads
Thread Thread Starter Forum Replies Last Post
Help analyze personal inspection findings (1 of 5) pillars Construction, Maintenance & Refit 5 24-09-2018 13:01
Help analyze personal inspection findings (4 of 5) - coolant deposits pillars Construction, Maintenance & Refit 0 07-09-2018 10:57
Help analyze personal inspection findings (3 of 5) - chainplate alignment pillars Construction, Maintenance & Refit 13 31-08-2018 20:26
Help analyze personal inspection findings (2 of 5) - rudder corrosion pillars Construction, Maintenance & Refit 8 30-08-2018 16:30
Findings Issued in Block Island Ferry Collision Soundbounder General Sailing Forum 11 14-06-2011 06:01



Copyright 2002- Social Knowledge, LLC All Rights Reserved.

All times are GMT -7. The time now is 11:05.


Google+
Powered by vBulletin® Version 3.8.8 Beta 1
Copyright ©2000 - 2019, vBulletin Solutions, Inc.
Social Knowledge Networks
Powered by vBulletin® Version 3.8.8 Beta 1
Copyright ©2000 - 2019, vBulletin Solutions, Inc.

ShowCase vBulletin Plugins by Drive Thru Online, Inc.