With the steep increase of empirical studies and the advent of secondary studies (aggregation or meta-study), one main concern still affects the quality of the primary studies (e.g., a single experiment). Concerns about different quality issues have been raised for many years; however, due to the complexity of empirical studies in our field – especially when involving human subjects – not all of them seem to be solved. In particular, problems with regard to the appropriate design of experiments and the correct usage of statistical tests are crucial for the trustworthiness of the results. Consequently, we need to better understand the issues and how to mitigate, if not eradicate them.

The workshop’s aim is to increase awareness on the importance of the quality and appropriateness of the methods applied during the different stages of empirical studies to yield reliable results,