Producing Competent Evaluators: A Self-Study of a Graduate Evaluation Program

Saved in:
Bibliographic Details
Title: Producing Competent Evaluators: A Self-Study of a Graduate Evaluation Program
Language: English
Authors: Sandra Nyashaddai Ayoo (ORCID 0000-0002-8091-8289), Tiffany L. S. Tovey (ORCID 0000-0002-7813-4485), Tyler Clark, Stacy Huff (ORCID 0000-0002-1309-2237), Omodolapo Somo-Aina, Jaime R. Moller, Xinru Yan (ORCID 0009-0002-7281-249X), Joy Alcantara Chuquiruna, Charity Odetola, Aileen Reid (ORCID 0000-0002-8099-1435), Ayesha S. Boyce (ORCID 0000-0002-9509-8703)
Source: American Journal of Evaluation. 2026 47(2):191-217.
Availability: SAGE Publications. 2455 Teller Road, Thousand Oaks, CA 91320. Tel: 800-818-7243; Tel: 805-499-9774; Fax: 800-583-2665; e-mail: journals@sagepub.com; Web site: https://sagepub.com
Peer Reviewed: Y
Page Count: 27
Publication Date: 2026
Document Type: Journal Articles
Reports - Research
Education Level: Higher Education
Postsecondary Education
Descriptors: Graduate Study, Evaluation, Evaluators, Skill Development, Job Skills, Minority Serving Institutions, Graduate Students, Alumni, College Curriculum, Student Experience, Competency Based Education, Reflection, Authentic Learning, Standards, Social Justice, Cultural Relevance
Geographic Terms: North Carolina (Greensboro)
DOI: 10.1177/10982140261425204
ISSN: 1098-2140
1557-0878
Abstract: Preparing evaluators requires more than technical training. It requires cultivating the judgment to navigate uncertainty, complexity, and equity concerns. This study examines how evaluator competencies are developed through a collaborative, reflective self-study of a graduate evaluation program at a Minority Serving Institution in the southeastern United States. Twenty-two students and alumni participated in interviews exploring how evaluator competencies were enacted through coursework, assistantships, and applied projects. Findings indicate strengths in Context and Methodology competencies, while Planning and Management and Interpersonal competencies require greater attention. Participants emphasized the importance of safe and brave spaces and identified reflection as essential for linking technical skills with professional judgment, cultural responsiveness, and professional identity. The study introduces the ARC Framework--Action, Reflection, and Competency--as a model for evaluator preparation. Implications extend to embedding authentic practice, making reflection intentional, cultivating dispositions, and integrating justice throughout curricula to prepare evaluators to act wisely and responsibly.
Abstractor: As Provided
Entry Date: 2026
Accession Number: EJ1504246
Database: ERIC
FullText Text:
  Availability: 0
Header DbId: eric
DbLabel: ERIC
An: EJ1504246
AccessLevel: 3
PubType: Academic Journal
PubTypeId: academicJournal
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: Producing Competent Evaluators: A Self-Study of a Graduate Evaluation Program
– Name: Language
  Label: Language
  Group: Lang
  Data: English
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Sandra+Nyashaddai+Ayoo%22">Sandra Nyashaddai Ayoo</searchLink> (ORCID <externalLink term="https://orcid.org/0000-0002-8091-8289">0000-0002-8091-8289</externalLink>)<br /><searchLink fieldCode="AR" term="%22Tiffany+L%2E+S%2E+Tovey%22">Tiffany L. S. Tovey</searchLink> (ORCID <externalLink term="https://orcid.org/0000-0002-7813-4485">0000-0002-7813-4485</externalLink>)<br /><searchLink fieldCode="AR" term="%22Tyler+Clark%22">Tyler Clark</searchLink><br /><searchLink fieldCode="AR" term="%22Stacy+Huff%22">Stacy Huff</searchLink> (ORCID <externalLink term="https://orcid.org/0000-0002-1309-2237">0000-0002-1309-2237</externalLink>)<br /><searchLink fieldCode="AR" term="%22Omodolapo+Somo-Aina%22">Omodolapo Somo-Aina</searchLink><br /><searchLink fieldCode="AR" term="%22Jaime+R%2E+Moller%22">Jaime R. Moller</searchLink><br /><searchLink fieldCode="AR" term="%22Xinru+Yan%22">Xinru Yan</searchLink> (ORCID <externalLink term="https://orcid.org/0009-0002-7281-249X">0009-0002-7281-249X</externalLink>)<br /><searchLink fieldCode="AR" term="%22Joy+Alcantara+Chuquiruna%22">Joy Alcantara Chuquiruna</searchLink><br /><searchLink fieldCode="AR" term="%22Charity+Odetola%22">Charity Odetola</searchLink><br /><searchLink fieldCode="AR" term="%22Aileen+Reid%22">Aileen Reid</searchLink> (ORCID <externalLink term="https://orcid.org/0000-0002-8099-1435">0000-0002-8099-1435</externalLink>)<br /><searchLink fieldCode="AR" term="%22Ayesha+S%2E+Boyce%22">Ayesha S. Boyce</searchLink> (ORCID <externalLink term="https://orcid.org/0000-0002-9509-8703">0000-0002-9509-8703</externalLink>)
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="SO" term="%22American+Journal+of+Evaluation%22"><i>American Journal of Evaluation</i></searchLink>. 2026 47(2):191-217.
– Name: Avail
  Label: Availability
  Group: Avail
  Data: SAGE Publications. 2455 Teller Road, Thousand Oaks, CA 91320. Tel: 800-818-7243; Tel: 805-499-9774; Fax: 800-583-2665; e-mail: journals@sagepub.com; Web site: https://sagepub.com
– Name: PeerReviewed
  Label: Peer Reviewed
  Group: SrcInfo
  Data: Y
– Name: Pages
  Label: Page Count
  Group: Src
  Data: 27
– Name: DatePubCY
  Label: Publication Date
  Group: Date
  Data: 2026
– Name: TypeDocument
  Label: Document Type
  Group: TypDoc
  Data: Journal Articles<br />Reports - Research
– Name: Audience
  Label: Education Level
  Group: Audnce
  Data: <searchLink fieldCode="EL" term="%22Higher+Education%22">Higher Education</searchLink><br /><searchLink fieldCode="EL" term="%22Postsecondary+Education%22">Postsecondary Education</searchLink>
– Name: Subject
  Label: Descriptors
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Graduate+Study%22">Graduate Study</searchLink><br /><searchLink fieldCode="DE" term="%22Evaluation%22">Evaluation</searchLink><br /><searchLink fieldCode="DE" term="%22Evaluators%22">Evaluators</searchLink><br /><searchLink fieldCode="DE" term="%22Skill+Development%22">Skill Development</searchLink><br /><searchLink fieldCode="DE" term="%22Job+Skills%22">Job Skills</searchLink><br /><searchLink fieldCode="DE" term="%22Minority+Serving+Institutions%22">Minority Serving Institutions</searchLink><br /><searchLink fieldCode="DE" term="%22Graduate+Students%22">Graduate Students</searchLink><br /><searchLink fieldCode="DE" term="%22Alumni%22">Alumni</searchLink><br /><searchLink fieldCode="DE" term="%22College+Curriculum%22">College Curriculum</searchLink><br /><searchLink fieldCode="DE" term="%22Student+Experience%22">Student Experience</searchLink><br /><searchLink fieldCode="DE" term="%22Competency+Based+Education%22">Competency Based Education</searchLink><br /><searchLink fieldCode="DE" term="%22Reflection%22">Reflection</searchLink><br /><searchLink fieldCode="DE" term="%22Authentic+Learning%22">Authentic Learning</searchLink><br /><searchLink fieldCode="DE" term="%22Standards%22">Standards</searchLink><br /><searchLink fieldCode="DE" term="%22Social+Justice%22">Social Justice</searchLink><br /><searchLink fieldCode="DE" term="%22Cultural+Relevance%22">Cultural Relevance</searchLink>
– Name: Subject
  Label: Geographic Terms
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22North+Carolina+%28Greensboro%29%22">North Carolina (Greensboro)</searchLink>
– Name: DOI
  Label: DOI
  Group: ID
  Data: 10.1177/10982140261425204
– Name: ISSN
  Label: ISSN
  Group: ISSN
  Data: 1098-2140<br />1557-0878
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: Preparing evaluators requires more than technical training. It requires cultivating the judgment to navigate uncertainty, complexity, and equity concerns. This study examines how evaluator competencies are developed through a collaborative, reflective self-study of a graduate evaluation program at a Minority Serving Institution in the southeastern United States. Twenty-two students and alumni participated in interviews exploring how evaluator competencies were enacted through coursework, assistantships, and applied projects. Findings indicate strengths in Context and Methodology competencies, while Planning and Management and Interpersonal competencies require greater attention. Participants emphasized the importance of safe and brave spaces and identified reflection as essential for linking technical skills with professional judgment, cultural responsiveness, and professional identity. The study introduces the ARC Framework--Action, Reflection, and Competency--as a model for evaluator preparation. Implications extend to embedding authentic practice, making reflection intentional, cultivating dispositions, and integrating justice throughout curricula to prepare evaluators to act wisely and responsibly.
– Name: AbstractInfo
  Label: Abstractor
  Group: Ab
  Data: As Provided
– Name: DateEntry
  Label: Entry Date
  Group: Date
  Data: 2026
– Name: AN
  Label: Accession Number
  Group: ID
  Data: EJ1504246
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=eric&AN=EJ1504246
RecordInfo BibRecord:
  BibEntity:
    Identifiers:
      – Type: doi
        Value: 10.1177/10982140261425204
    Languages:
      – Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 27
        StartPage: 191
    Subjects:
      – SubjectFull: Graduate Study
        Type: general
      – SubjectFull: Evaluation
        Type: general
      – SubjectFull: Evaluators
        Type: general
      – SubjectFull: Skill Development
        Type: general
      – SubjectFull: Job Skills
        Type: general
      – SubjectFull: Minority Serving Institutions
        Type: general
      – SubjectFull: Graduate Students
        Type: general
      – SubjectFull: Alumni
        Type: general
      – SubjectFull: College Curriculum
        Type: general
      – SubjectFull: Student Experience
        Type: general
      – SubjectFull: Competency Based Education
        Type: general
      – SubjectFull: Reflection
        Type: general
      – SubjectFull: Authentic Learning
        Type: general
      – SubjectFull: Standards
        Type: general
      – SubjectFull: Social Justice
        Type: general
      – SubjectFull: Cultural Relevance
        Type: general
      – SubjectFull: North Carolina (Greensboro)
        Type: general
    Titles:
      – TitleFull: Producing Competent Evaluators: A Self-Study of a Graduate Evaluation Program
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Sandra Nyashaddai Ayoo
      – PersonEntity:
          Name:
            NameFull: Tiffany L. S. Tovey
      – PersonEntity:
          Name:
            NameFull: Tyler Clark
      – PersonEntity:
          Name:
            NameFull: Stacy Huff
      – PersonEntity:
          Name:
            NameFull: Omodolapo Somo-Aina
      – PersonEntity:
          Name:
            NameFull: Jaime R. Moller
      – PersonEntity:
          Name:
            NameFull: Xinru Yan
      – PersonEntity:
          Name:
            NameFull: Joy Alcantara Chuquiruna
      – PersonEntity:
          Name:
            NameFull: Charity Odetola
      – PersonEntity:
          Name:
            NameFull: Aileen Reid
      – PersonEntity:
          Name:
            NameFull: Ayesha S. Boyce
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 06
              Type: published
              Y: 2026
          Identifiers:
            – Type: issn-print
              Value: 1098-2140
            – Type: issn-electronic
              Value: 1557-0878
          Numbering:
            – Type: volume
              Value: 47
            – Type: issue
              Value: 2
          Titles:
            – TitleFull: American Journal of Evaluation
              Type: main
ResultId 1