UPDATE 5/13/2019 Our manuscript on the z-curve method for estimation of mean power after selection for significance has been accepted for publication in Meta-Psychology. As estimation of actual power is an important tool for meta-psychologists, we are happy that z-curve found its home in Meta-Psychology. We also enjoyed the open and constructive review process at Meta-Psychology. Definitely will try Meta-Psychology again for future work (look out for z-curve.2.0 with many new features).
Z.Curve.1.0.Meta.Psychology.In.Press
Since 2015, Jerry Brunner and I have been working on a statistical tool that can estimate mean (statitical) power for a set of studies with heterogeneous sample sizes and effect sizes (heterogeneity in non-centrality parameters and true power). This method corrects for the inflation in mean observed power that is introduced by the selection for statistical significance. Knowledge about mean power makes it possible to predict the success rate of exact replication studies. For example, if a set of studies with mean power of 60% were replicated exactly (including sample sizes), we would expect that 60% of the replication studies produce a significant result again.
Our latest manuscript is a revision of an earlier manuscript that received a revise and resubmit decision from the free, open-peer-review journal Meta-Psychology. We consider it the most authoritative introduction to z-curve that should be used to learn about z-curve, critic z-curve, or as a citation for studies that use z-curve.
Cite as “submitted for publication”.
Final.Revision.874-Manuscript in PDF-2236-1-4-20180425 mva final (002)
Feel free to ask questions, provide comments, and critic our manuscript in the comments section. We are proud to be an open science lab, and consider criticism an opportunity to improve z-curve and our understanding of power estimation.
R-CODE
Latest R-Code to run Z.Curve (Z.Curve.Public.18.10.28).
[updated 18/11/17] [35 lines of code]
call function mean.power = zcurve(pvalues,Plot=FALSE,alpha=.05,bw=.05)[1]
Z-Curve related Talks
Presentation on Z-curve and application to BS Experimental Social Psychology and (Mostly) WS-Cognitive Psychology at U Waterloo (November 2, 2018)
[Powerpoint Slides]
The sentence at the bottom of the first paragraph in the left column of page 1 is not continued in the incomplete sentence at the top of the second column.
Thank you. We had some problems with copy editing. I’ll check and fix it. Much appreciated.
As you use LaTeX, I assume your are using the apa6 class. I can’t imagine how it could have produced a cut-off sentence like that. Incidentally, the spacing of the lines is less than optimal (much badness is TeX’s terms); try using the microtype package or change your hyphenation language.
Jerry wrote the first version in LaTeX, but he was not able to work on the revision so I had to do it editing a PDF. In hindsight I should have learned LaTeX. 🙂
I think, that you are not right. Write to me in PM, we will discuss.
I am not right about what? The comment section allows you to voice constructive criticism. Interesting to hear your thoughts.