2018 Journal Replicability Rankings

This table shows the Replicability Rankings for 117 psychology journals.

Journals are ranked based on the replicability estimates for the year 2018.

Replicability estimates are obtained from z-curve analyses of automatically extracted test statistics. If you click on the journal name, you can see plots of the z-curve distributions for the years 2010-2018.

Rank	Journal	2018	2017	2016	2015	2014	2013	2012	2011	2010
1	European Journal of Developmental Psychology	89	86	83	63	73	75	78	78	67
2	Journal of Cognition and Development	89	74	77	67	65	68	55	66	69
3	Political Psychology	88	75	78	74	70	71	73	43	66
4	Social Development	84	72	78	62	74	71	71	73	72
5	Social Psychology	84	74	74	72	74	70	64	76	72
6	Depression & Anxiety	83	75	78	70	73	80	80	89	86
7	Journal of Counseling Psychology	83	69	78	77	70	78	77	62	82
8	Personal Relationships	83	76	71	70	69	65	70	58	66
9	Sex Roles	83	81	80	73	72	76	79	73	73
10	Journal of Occupational and Organizational Psychology	82	72	82	79	70	74	77	70	63
11	Cognitive Psychology	81	75	80	72	75	77	71	81	74
12	Epilepsy & Behavior	81	82	81	79	85	84	79	89	76
13	Experimental Psychology	81	74	72	71	76	72	74	72	69
14	Journal of Consumer Behaviour	81	69	79	75	73	81	73	83	79
15	Journal of Health Psychology	81	63	71	79	78	80	76	63	71
16	Journal of Pain	81	67	77	72	80	72	77	73	70
17	Law and Human Behavior	81	75	76	69	60	74	76	83	72
18	Psychology of Religion and Spirituality	81	71	80	80	75	70	55	73	75
19	Social Psychological and Personality Science	81	76	65	60	64	61	57	65	54
20	Evolution & Human Behavior	80	73	80	75	75	62	64	69	62
21	Journal of Personality	80	77	73	68	72	69	72	60	66
22	JPSP-Attitudes & Social Cognition	80	79	55	74	69	49	61	61	60
23	Journal of Vocational Behavior	80	74	85	83	65	83	79	85	77
24	Memory and Cognition	80	80	74	79	76	76	79	76	77
25	Attention, Perception and Psychophysics	79	79	70	73	76	77	80	74	73
26	Consciousness and Cognition	79	78	69	69	74	66	70	73	73
27	Journal of Cognitive Psychology	79	75	77	74	77	72	73	79	85
28	Journal of Educational Psychology	79	78	72	67	75	74	76	77	83
29	Journal of Nonverbal Behavior	79	89	73	63	72	76	71	63	64
30	Journal of Research in Personality	79	78	76	81	77	76	70	72	68
31	Psychophysiology	79	78	78	70	72	68	71	77	78
32	Quarterly Journal of Experimental Psychology	79	76	76	75	74	73	76	75	72
33	Aggressive Behavior	78	72	77	67	70	60	69	79	68
34	Evolutionary Psychology	78	78	82	77	76	81	73	80	69
35	Health Psychology	78	70	61	66	66	67	59	69	68
36	J. of Exp. Psychology – Human Perception and Performance	78	76	77	75	75	75	77	78	76
37	J. of Exp. Psychology – Learning, Memory & Cognition	78	79	78	77	81	74	76	71	80
38	Psychonomic Bulletin and Review	78	75	77	82	78	83	71	70	78
39	British Journal of Psychology	77	77	77	82	75	71	78	79	69
40	British Journal of Developmental Psychology	77	71	76	74	64	67	85	77	77
41	Journal of Cross-Cultural Psychology	77	75	75	80	77	80	71	77	77
42	Journal of Experimental Psychology – General	77	77	74	74	72	74	66	73	68
43	Journal of Family Psychology	77	69	62	72	71	70	64	67	68
44	Journal of Memory and Language	77	80	82	79	74	75	71	79	73
45	JPSP-Personality Processes and Individual Differences	77	65	74	71	73	65	68	70	61
46	Personality and Individual Differences	77	76	74	77	77	76	73	71	70
47	Appetite	76	77	71	64	66	73	71	72	73
48	Cognition	76	76	73	72	74	76	74	72	72
49	European Journal of Personality	76	76	79	68	81	67	67	70	79
50	Journal of Anxiety Disorders	76	79	73	69	76	75	78	71	74
51	Journal of Occupational Health Psychology	76	80	73	72	73	54	75	79	71
52	Cognition and Emotion	75	65	68	74	73	85	85	81	81
53	Journal of Affective Disorders	75	75	84	85	77	84	78	72	71
54	Journal of Child and Family Studies	75	73	72	69	68	74	73	74	73
55	Journal of Experimental Social Psychology	75	71	67	62	61	56	54	57	55
56	Journal of Social and Personal Relationships	75	71	84	59	57	69	61	78	82
57	Psychological Science	75	71	68	69	65	65	63	61	61
58	Cognitive Therapy and Research	74	75	70	71	61	75	74	67	65
59	Frontiers in Psychology	74	76	74	73	73	72	72	68	82
60	Journal of Applied Social Psychology	74	71	79	67	72	69	77	71	75
61	Journal of Religion and Health	74	74	85	80	76	76	89	80	68
62	Psychological Medicine	74	73	82	67	75	78	66	77	72
63	Animal Behavior	73	77	71	69	70	71	71	70	75
64	Child Development	73	66	73	73	68	69	74	71	73
65	Cognitive Development	73	80	74	82	71	71	74	69	63
66	Developmental Psychology	73	75	75	74	75	72	67	68	66
67	Emotion	73	73	71	68	69	72	68	68	73
68	Frontiers in Human Neuroscience	73	70	74	73	74	76	78	76	72
69	Judgment and Decision Making	73	81	78	76	77	68	73	70	71
70	Journal of Experimental Child Psychology	73	72	71	77	75	72	72	71	74
71	Journal of Social Psychology	73	75	73	70	65	62	77	71	75
72	Memory	73	74	79	67	87	76	77	84	88
73	Perception	73	75	76	78	73	79	82	89	93
74	Annals of Behavioral Medicine	72	70	73	63	70	75	77	72	72
75	Archives of Sexual Behavior	72	78	78	79	75	81	78	76	87
76	Frontiers in Behavioral Neuroscience	72	74	70	70	67	70	72	70	67
77	International Journal of Psychophysiology	72	74	64	70	67	62	71	70	65
78	Psychology and Aging	72	78	80	76	81	71	77	76	75
79	Behaviour Research and Therapy	71	70	72	75	76	72	77	66	69
80	Journal of Organizational Psychology	71	73	71	66	73	62	72	66	75
81	Journal of Positive Psychology	71	81	69	72	74	62	67	63	73
82	JPSP-Interpersonal Relationships and Group Processes	71	68	73	64	61	62	56	61	54
83	Organizational Behavior and Human Decision Processes	71	68	72	69	69	72	69	71	63
84	Personality Disorders	71	87	64	63	72	77	52	55	84
85	Personality and Social Psychology Bulletin	71	73	69	64	64	60	59	61	62
86	Acta Psychologica	70	77	73	73	76	74	74	76	74
87	British Journal of Social Psychology	70	78	63	67	61	63	59	70	63
88	Hormones & Behavior	70	61	63	62	62	62	61	66	63
89	Journal of Abnormal Psychology	70	69	64	63	65	69	66	73	70
90	Journal of Consulting and Clinical Psychology	70	77	61	66	65	62	65	66	65
91	Journal of Experimental Psychology – Applied	70	80	69	68	72	65	75	70	71
92	Journal of Happiness Studies	70	56	79	78	78	80	77	88	77
93	Behavioural Brain Research	69	71	68	74	67	70	71	71	72
94	Cognitive Behavioral Therapy	69	75	80	76	62	70	80	72	62
95	Journal of Applied Psychology	69	79	80	70	74	69	73	69	71
96	Journal of Autism and Developmental Disorders	69	71	72	70	65	72	67	67	70
97	Psychology of Music	69	80	79	72	73	75	72	82	87
98	Biological Psychology	68	63	66	70	66	66	61	70	70
99	Developmental Science	68	73	67	69	65	71	67	68	67
100	Journal of Comparative Psychology	68	66	75	75	79	80	71	68	62
101	Psychology and Marketing	68	70	70	65	76	65	71	63	71
102	Psychoneuroendocrinology	68	65	66	63	63	64	62	64	61
103	Psychopharmacology	68	74	75	74	71	73	75	71	71
104	Behavior Therapy	67	71	69	71	74	74	75	63	77
105	Developmental Psychobiology	67	63	66	65	69	70	70	71	64
106	Journal of Consumer Psychology	66	56	53	67	66	64	59	59	64
107	Journal of Consumer Research	66	64	63	51	63	48	61	60	64
108	Journal of Individual Differences	65	82	65	74	63	86	55	91	70
109	Journal of Youth and Adolescence	65	70	84	77	81	76	74	74	75
110	European Journal of Social Psychology	64	73	76	64	71	67	56	68	66
111	Group Processes & Intergroup Relations	64	68	66	70	67	69	65	67	59
112	Journal of Research on Adolescence	62	67	71	67	64	72	74	78	67
113	Journal of Child Psychology and Psychiatry and Allied Disciplines	61	68	67	67	62	68	71	57	62
114	Motivation and Emotion	61	72	63	66	64	66	63	81	67
115	Infancy	59	60	61	61	66	67	63	71	53
116	Behavioral Neuroscience	57	73	68	70	70	68	70	66	72
117	Self and Identity	57	68	68	57	72	71	72	70	73

8 thoughts on “2018 Journal Replicability Rankings”

Pingback: Dr. Ulrich Schimmack’s Blog about Replicability | Replicability-Index
Pingback: Preliminary 2017 Replicability Rankings of 104 Psychology Journals | Replicability-Index
Pingback: Replicability Audit of Social Psychology | Replicability-Index
Pingback: Estimating the Replicability of Psychological Science | Replicability-Index
Brett Pelham says:

December 6, 2019 at 9:48 am

I’m perplexed that someone would you go to the trouble to look at a complex issue such as replication and then ignore, well, replication. Each replicability score for each journal for each year is a replication, and one should average the scores across years rather than just usiing 2018 data before presenting the rankings! If we treat years as the unit of analysis, the average corrected item total correlation for one year’s ratings with the total set of ratings (average across years) is r = .59. So using the average would be fairer and a lot more informative.

LikeLike

1. Dr. R says:
  
  December 6, 2019 at 9:55 am
  
  You can average if you want to know performance over a 9-year time span. However, this would ignore trends in the data like the improvement in Psychological Science from 2010 to 2018. Of course, results for a specific year are noisier and we wouldn’t place to much stock on a specific rank in a specific year, but that is how rankings (or stock prices for that matter) work.
  
  LikeLike
  
Pingback: Once a p-hacker, always a p-hacker? | Replicability-Index
dianakornbrot says:

February 3, 2020 at 4:50 am

would be good to see citation rating and wonload next to repliccability
what happened to quarterly journal of experimental psych? i.e. hw did you choose whihc journals to include? are they all peer reviewed?
you mihgt ,like to compare iwth ionides estimate of open data deposit

LikeLike

Replicability-Index

Improving the replicability of empirical research

2018 Journal Replicability Rankings

8 thoughts on “2018 Journal Replicability Rankings”

Leave a Reply Cancel reply

Rate this:

Share this:

Like this:

8 thoughts on “2018 Journal Replicability Rankings”

Leave a Reply Cancel reply