View in EDS HTML Full Text PDF Full Text

On the predicted replicability of two decades of experimental research on system justification: A Z‐curve analysis.

Saved in:
Bibliographic Details
Title: On the predicted replicability of two decades of experimental research on system justification: A Z‐curve analysis.
Authors: Sotola, Lukas K., Credé, Marcus
Source: European Journal of Social Psychology. Aug-Oct2022, Vol. 52 Issue 5/6, p895-909. 15p. 1 Diagram, 2 Charts, 8 Graphs.
Subjects: Experimental design, Publication bias, Research evaluation, Meta-analysis, Social theory, Systematic reviews, Social justice, Psychology, Theory, Descriptive statistics, Prediction models, Social psychology, Evaluation
Abstract: We examine the predicted replicability of experimental research on system justification theory (SJT) by conducting a z‐curve analysis. Z‐curve is a meta‐analytic technique similar to p‐curve, but which performs better under conditions of heterogeneity. It estimates the predicted replication rate, average power, false discovery risk, and file drawer ratio (FDR) of a sample of studies. The z‐curve based on 116 papers and 232 unique samples suggests that the experimental SJT literature is likely to show low rates of replicability, as indicated by an overall average statistical power of 16%. Moderator analyses suggest that this may be driven in part by publication pressures, that the replicability of research in this area has improved since 2015, and that studies using system threat manipulations show particularly low estimated replication rates (ERR). Implications for the replicability and validity of the experimental SJT literature are discussed, and recommendations to increase the rigor of research are put forth. [ABSTRACT FROM AUTHOR]
Copyright of European Journal of Social Psychology is the property of Wiley-Blackwell and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)
Database: Psychology and Behavioral Sciences Collection
Full text is not displayed to guests.
FullText Links:
  – Type: pdflink
Text:
  Availability: 1
Header DbId: pbh
DbLabel: Psychology and Behavioral Sciences Collection
An: 159737800
AccessLevel: 6
PubType: Academic Journal
PubTypeId: academicJournal
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: On the predicted replicability of two decades of experimental research on system justification: A Z‐curve analysis.
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Sotola%2C+Lukas+K%2E%22">Sotola, Lukas K.</searchLink><br /><searchLink fieldCode="AR" term="%22Credé%2C+Marcus%22">Credé, Marcus</searchLink>
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="JN" term="%22European+Journal+of+Social+Psychology%22">European Journal of Social Psychology</searchLink>. Aug-Oct2022, Vol. 52 Issue 5/6, p895-909. 15p. 1 Diagram, 2 Charts, 8 Graphs.
– Name: Subject
  Label: Subjects
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Experimental+design%22">Experimental design</searchLink><br /><searchLink fieldCode="DE" term="%22Publication+bias%22">Publication bias</searchLink><br /><searchLink fieldCode="DE" term="%22Research+evaluation%22">Research evaluation</searchLink><br /><searchLink fieldCode="DE" term="%22Meta-analysis%22">Meta-analysis</searchLink><br /><searchLink fieldCode="DE" term="%22Social+theory%22">Social theory</searchLink><br /><searchLink fieldCode="DE" term="%22Systematic+reviews%22">Systematic reviews</searchLink><br /><searchLink fieldCode="DE" term="%22Social+justice%22">Social justice</searchLink><br /><searchLink fieldCode="DE" term="%22Psychology%22">Psychology</searchLink><br /><searchLink fieldCode="DE" term="%22Theory%22">Theory</searchLink><br /><searchLink fieldCode="DE" term="%22Descriptive+statistics%22">Descriptive statistics</searchLink><br /><searchLink fieldCode="DE" term="%22Prediction+models%22">Prediction models</searchLink><br /><searchLink fieldCode="DE" term="%22Social+psychology%22">Social psychology</searchLink><br /><searchLink fieldCode="DE" term="%22Evaluation%22">Evaluation</searchLink>
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: We examine the predicted replicability of experimental research on system justification theory (SJT) by conducting a z‐curve analysis. Z‐curve is a meta‐analytic technique similar to p‐curve, but which performs better under conditions of heterogeneity. It estimates the predicted replication rate, average power, false discovery risk, and file drawer ratio (FDR) of a sample of studies. The z‐curve based on 116 papers and 232 unique samples suggests that the experimental SJT literature is likely to show low rates of replicability, as indicated by an overall average statistical power of 16%. Moderator analyses suggest that this may be driven in part by publication pressures, that the replicability of research in this area has improved since 2015, and that studies using system threat manipulations show particularly low estimated replication rates (ERR). Implications for the replicability and validity of the experimental SJT literature are discussed, and recommendations to increase the rigor of research are put forth. [ABSTRACT FROM AUTHOR]
– Name: AbstractSuppliedCopyright
  Label:
  Group: Ab
  Data: <i>Copyright of European Journal of Social Psychology is the property of Wiley-Blackwell and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract.</i> (Copyright applies to all Abstracts.)
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=pbh&AN=159737800
RecordInfo BibRecord:
  BibEntity:
    Identifiers:
      – Type: doi
        Value: 10.1002/ejsp.2858
    Languages:
      – Code: eng
        Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 15
        StartPage: 895
    Subjects:
      – SubjectFull: Experimental design
        Type: general
      – SubjectFull: Publication bias
        Type: general
      – SubjectFull: Research evaluation
        Type: general
      – SubjectFull: Meta-analysis
        Type: general
      – SubjectFull: Social theory
        Type: general
      – SubjectFull: Systematic reviews
        Type: general
      – SubjectFull: Social justice
        Type: general
      – SubjectFull: Psychology
        Type: general
      – SubjectFull: Theory
        Type: general
      – SubjectFull: Descriptive statistics
        Type: general
      – SubjectFull: Prediction models
        Type: general
      – SubjectFull: Social psychology
        Type: general
      – SubjectFull: Evaluation
        Type: general
    Titles:
      – TitleFull: On the predicted replicability of two decades of experimental research on system justification: A Z‐curve analysis.
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Sotola, Lukas K.
      – PersonEntity:
          Name:
            NameFull: Credé, Marcus
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 08
              Text: Aug-Oct2022
              Type: published
              Y: 2022
          Identifiers:
            – Type: issn-print
              Value: 00462772
          Numbering:
            – Type: volume
              Value: 52
            – Type: issue
              Value: 5/6
          Titles:
            – TitleFull: European Journal of Social Psychology
              Type: main
ResultId 1