Cohen's d Knowledge Test

This study focuses on the effect size measure Cohen’s d for studies in psychology. To assess your prior familiarity with Cohen’s d we will now ask you two questions.

As a rule of thumb - what Cohen’s d values are typically regarded as small, medium, and large in the field of psychology?

Consider a comparison of two groups. The dependent variable in group A has a mean of 3, and that in group B has a mean of 2. The pooled standard deviation equals 2. What is Cohen’s d?

Cohen's 𝞭 Reminder

Instructions for Condition 1

For each study, you will be assigned to one of three conditions where you need to specify the population effect size in different ways. In this experiment you will go through all three conditions. In condition 1 your task will be to specify a point prediction. You can specify your best guess for the effect size with the slider on the left. As you move the slider, the arrow in the graph will move along, representing the value of your best guess. In addition, you can tick the box ''I already know the outcome of this study''. In this case, we will exclude the study for our analysis; however, ticking this box does not affect your probability of winning.

Instructions for Condition 2

In this condition you specify a prior distribution. A prior distribution represents your uncertainty about the true value of the effect size. To keep things simple, we will use a normal distribution. You can adjust the mean (=best guess) and standard deviation (=uncertainty) of your distribution using the sliders. You should put more mass on values that you consider more plausible and less mass on values that you consider less plausible. The more certain you are the more narrow your distribution should be.

The initial prior distribution that you should adjust is shown below on the right:

Below is an example that you could specify if your best guess is 0.5 and you are pretty sure that the effect is between 0 and 1.

Instructions for Condition 3

In this condition, you will first be asked to specify the probability of the null hypothesis. If you choose a value of 1, you indicate that you are absolutely certain that the effect does not exist. If you choose 0, this indicates that you are absolutely certain that the effect exists. A value of 0.5 indicates that you believe the effect is as likely to exist as not. Next you will be asked to specify your prior distribution for the effect size under the assumption that it exists.

Please provide more information below as you wish.