Send message to Authors

Short abstract:

We provide a framework for the assessment of the relevance and feasibility of different types of 'reproducibility' (replication) in diverse research contexts to support 'reproducibility' where it is relevant and prevent inappropriate demands for it where it is irrelevant.

Long abstract:

We propose a framework for the assessment of the relevance and feasibility of different kinds of ‘reproducibility’ (replication) in the realm of epistemic diversity. ‘Reproducibility’ is clouded in an immense conceptual confusion within and across disciplines and research approaches. Furthermore, ‘reproducibility’ captures a variety of different practices and functions. Therefore, the first component of our framework helps stakeholders identify crucial parts of ‘reproducibility’ that enable the assessment of its relevance and feasibility in a specific research situation. Importantly, the diversity in knowledge production and justification across the research landscape implies a diversity in research characteristics that affect the appropriateness of ‘reproducibility’. We distinguish between the relevance based on epistemic considerations and the feasibility based on practical aspects of the specific research situation. The relevance is assessed based on whether the function of ‘reproducibility’ (e.g., generalizability, reliability, or validity) makes sense for the kind of knowledge sought and whether it fits into the research quality (trustworthiness) criteria and practices of the type of research. The feasibility is assessed based on, nature of the subject of investigation, the availability of the resources that the research practices depend on, and on the degree of uncertainty that is associated with specific research practices. One of our aims is to enable stakeholders to identify cases where they could put their limited resources to facilitate ‘reproducibility’ when it is relevant but not (yet) feasible. However, our main aim is to prevent the application of a ‘reproducibility’ demand where it does not belong.