From: "C.H.J. Hartgerink" <[log in to unmask]>
Date: Fri, 3 Mar 2017 02:36:11 -0500

As a meta-researcher who studies reproducibility, here are some
specific points to evaluate on:
1. Sample size (small? Not worth looking at because publication bias
makes it severely overestimate effects)
2. Did the researchers commit to their bets? (i.e., hypotheses)
Confirmatory research is more useful if they do commit.
3. Are the outcome measures logical? Sometimes researchers report only
one outcome measure when there are multiple, selecting for statistical
significance

This is not an exhaustive list. Peer review contributes greatly to
publication bias, which is the origins of these three points, so you
immediately have some of those problems of peer review.

Cheers,
Chris (member of Meta-research center, Tilburg)



-------- Original Message --------
From: Peter Suber <[log in to unmask]>
Date: Thu, 2 Mar 2017 12:40:12 -0500

Hi Andrée,

For a fairly large list of works on reproducibility (especially in
relation to OA and open data), see the items tagged with
"oa.reproducibility" in the Open Access Tracking Project. As of today,
the tag library contains 674 items:

http://tagteam.harvard.edu/hubs/oatp/tag/oa.reproducibility

Best,
Peter

Peter Suber
bit.ly/petersuber



On Wed, Mar 1, 2017 at 6:47 PM, LIBLICENSE <[log in to unmask]> wrote:
>
> From: Andree Rathemacher <[log in to unmask]>
> Date: Wed, 1 Mar 2017 09:31:39 -0500
>
> Hello all,
>
> I am giving a short talk on a panel called "Teach in: Finding Reliable
> Information in a 'Post-Fact' World."
>
> My focus will be on the reproducibility / replication crisis in a
> number of fields and the separate but related sense that peer review
> needs fixing.
>
> I've got plenty of info already but thought I'd ask if any list
> readers had a favorite article on either of these topics -- a piece
> that you feel really sums up the issue. If so, please send along the
> reference.
>
> Doesn't have to be scholarly... could be a Chronicle article, etc.
>
> Thanks so much,
> Andrée
>
> --
> Andrée Rathemacher | Professor / Head, Acquisitions
> University Libraries, University of Rhode Island | (401) 874-5096 |
> [log in to unmask]