View in EDS HTML Full Text PDF Full Text

Assessing Students' Multimodal Texts in the Subject of English: Synthesising Peers' and Teachers' Recognition of Semiotic Work

Saved in:
Bibliographic Details
Title: Assessing Students' Multimodal Texts in the Subject of English: Synthesising Peers' and Teachers' Recognition of Semiotic Work
Language: English
Authors: Ørevik, Sigrid (ORCID 0000-0002-0812-4572)
Source: Designs for Learning. 2023 15(1):44-57.
Availability: Stockholm University Press. Stockholm University Library, SE-106 91, Stockholm, Sweden. Web site: https://www.designsforlearning.nu
Peer Reviewed: Y
Page Count: 14
Publication Date: 2023
Document Type: Journal Articles
Reports - Research
Education Level: Secondary Education
Descriptors: Semiotics, Learning Activities, Alignment (Education), English (Second Language), Second Language Learning, Second Language Instruction, Persuasive Discourse, Writing (Composition), Secondary School Students, Writing Evaluation, Multiple Literacies, Intervention, Peer Evaluation, Language Teachers, Researchers, Evaluation Criteria, Communicative Competence (Languages), Evaluation Methods, Teacher Student Relationship, Classroom Research
Geographic Terms: Norway
ISSN: 2001-7480
Abstract: While learning activities and text production in language subjects typically include multiple forms of multimodal expression, assessment in the subjects continues to a great extent to depend on students' written texts. As a contribution to an increasing call for alignment of curricular activities and assessment, this article explores an approach to assessment of upper secondary students' production of multimodal persuasive texts in the subject of English as an additional language (EAL). The article reports from a design-based study comprising two classroom interventions where assessment of students' multimodal texts was conducted separately by peer groups and the teacher and researcher in collaboration, applying assessment criteria informed by multimodal social semiotic theory and operationalisations of communicative competence. Comparing the results of peer and teacher assessment of students' multimodal persuasive texts, agreement was found relating to representational, interactional, and compositional aspects of the texts, whereas differences in views mostly concerned nuances in interpersonal aspects. Unpacking these nuances, the article concludes that peers' and teachers' assessments of multimodal texts complement each other in ways that can prompt fruitful discussions on meaning making in the light of context and social factors and thus contribute to heightened semiotic awareness and a broader recognition of the students' communicative competence in the subject.
Abstractor: As Provided
Entry Date: 2023
Accession Number: EJ1397866
Database: ERIC
Full text is not displayed to guests.
FullText Links:
  – Type: pdflink
    Url: https://content.ebscohost.com/cds/retrieve?content=AQICAHj0k_4E0hTGH8RJwT4gCJyBsGNe_WN95AvKlDbXJGqwxwGYcvrsRc_rVF4sATHkfG62AAAA4zCB4AYJKoZIhvcNAQcGoIHSMIHPAgEAMIHJBgkqhkiG9w0BBwEwHgYJYIZIAWUDBAEuMBEEDGfw26n-lSIkl_SwawIBEICBm63RbGRntKryy5VrpVg5NOnCLsX_Qw_GHPipnRIdRJSa1_9KDbYLz_OXgXQfZfGJJL3pjFQxRpXY0-0KAwkSllai82wLQh10KWHQqBtZ-4-x-TLSweeP-mih9d-ClrulIIdwr_6i-l3RZqmrIjs0Q_IkGF1C_kRXmOQbiHlulP-NDKAMArohsW_TQCu2zmyF8TaTnLxvoVT-OlDu
Text:
  Availability: 1
  Value: <anid>AN0174849602;[8urj]01jan.23;2024Aug14.15:00;v2.2.500</anid> <title id="AN0174849602-1">Assessing Students’ Multimodal Texts in the Subject of English: Synthesising Peers’ and Teachers’ Recognition of Semiotic Work </title> <p>While learning activities and text production in language subjects typically include multiple forms of multimodal expression, assessment in the subjects continues to a great extent to depend on students' written texts. As a contribution to an increasing call for alignment of curricular activities and assessment, this article explores an approach to assessment of upper secondary students' production of multimodal persuasive texts in the subject of English as an additional language (EAL). The article reports from a design-based study comprising two classroom interventions where assessment of students' multimodal texts was conducted separately by peer groups and the teacher and researcher in collaboration, applying assessment criteria informed by multimodal social semiotic theory and operationalisations of communicative competence. Comparing the results of peer and teacher assessment of students' multimodal persuasive texts, agreement was found relating to representational, interactional, and compositional aspects of the texts, whereas differences in views mostly concerned nuances in interpersonal aspects. Unpacking these nuances, the article concludes that peers' and teachers' assessments of multimodal texts complement each other in ways that can prompt fruitful discussions on meaning making in the light of context and social factors and thus contribute to heightened semiotic awareness and a broader recognition of the students' communicative competence in the subject.</p> <p>Keywords: multimodal texts; peer assessment; recognition; language subjects; English as an additional language (EAL)</p> <hd id="AN0174849602-2">Introduction</hd> <p></p> <hd id="AN0174849602-3">A call for the inclusion of multimodal meaning-making in assessment</hd> <p>The increasing digitisation of classrooms has brought to the fore questions regarding the changing textual patterns of school subjects and consequences for learning materials and curricular activities (e.g., [<reflink idref="bib6" id="ref1">6</reflink>]; [<reflink idref="bib31" id="ref2">31</reflink>]; [<reflink idref="bib47" id="ref3">47</reflink>]; [<reflink idref="bib49" id="ref4">49</reflink>]; [<reflink idref="bib53" id="ref5">53</reflink>]). For example, digital software enables students easily and efficiently to combine verbal text with other semiotic modes such as images, moving images, and music. Jewitt ([<reflink idref="bib32" id="ref6">32</reflink>]) defines a semiotic mode as 'a socially shaped and culturally given resource for making meaning'. A multimodal perspective of learning acknowledges that the affordances of modes and text authors' choices of semiotic resources influence the ways in which curricular topics are represented ([<reflink idref="bib29" id="ref7">29</reflink>]; [<reflink idref="bib63" id="ref8">63</reflink>]). Notably, explicit recognition of multimodal aspects in processes of conceptualising meaning has the potential of including more learners in knowledge exchange ([<reflink idref="bib5" id="ref9">5</reflink>]). The need for students at all levels of education to develop multimodal literacy is thus evident. Multimodal literacy requires knowledge and understanding of semiotic systems and textual conventions as well as of the role of contextual factors in communication; furthermore, it involves an aesthetic dimension and a critical dimension ([<reflink idref="bib67" id="ref10">67</reflink>]).</p> <p>Students are generally well immersed in multimodal communication, connected both to schoolwork and to their interests outside school ([<reflink idref="bib7" id="ref11">7</reflink>]; [<reflink idref="bib18" id="ref12">18</reflink>]; [<reflink idref="bib30" id="ref13">30</reflink>]). Although forms of communication within school subjects have traditionally been constrained by established text formats codifying what counts as important knowledge and skills ([<reflink idref="bib58" id="ref14">58</reflink>]), the range of texts and communication forms used in teaching and learning contexts has broadened considerably with digitisation ([<reflink idref="bib20" id="ref15">20</reflink>]). Research within language didactics has for many years addressed the challenge of synthesising out-of-school literacies with literacies developed through education, discussing the need for approaches or tools to connect students' intersecting text worlds ([<reflink idref="bib22" id="ref16">22</reflink>]; [<reflink idref="bib46" id="ref17">46</reflink>]). Proceeding from the principle that teaching, learning and assessment in school subjects need to be aligned and integrated ([<reflink idref="bib8" id="ref18">8</reflink>]; [<reflink idref="bib41" id="ref19">41</reflink>]), this also implies a need for assessment practices that recognise students' multimodal meaning making ([<reflink idref="bib29" id="ref20">29</reflink>]; [<reflink idref="bib33" id="ref21">33</reflink>]; [<reflink idref="bib48" id="ref22">48</reflink>]; [<reflink idref="bib49" id="ref23">49</reflink>]). According to Bezemer and Kress ([<reflink idref="bib7" id="ref24">7</reflink>]), recognition of students' semiotic work involves acknowledging what often goes unnoticed in educational contexts and therefore requires 'lenses and methods that move well beyond contemporary metrics' (p. 3).</p> <p>In order to inform further developments in the field, more research is needed as to how teachers work with and assess students' multimodal text production ([<reflink idref="bib60" id="ref25">60</reflink>]). This article seeks to make a small contribution in this regard by reporting from a project involving two classroom interventions in the subject of English as an additional language (EAL) where peer and teacher assessment of students' multimodal texts was combined, aiming for a rich appraisal of the students' products, and promoting the development of literacies in broad terms.</p> <hd id="AN0174849602-4">Assessing multimodal meaning-making</hd> <p></p> <hd id="AN0174849602-5">A need for frameworks that include multimodal aspects of texts</hd> <p>Previous research has uncovered factors that may counteract the inclusion of students' multimodal texts as evidence of competence in school subjects. One such factor is the traditionally marginal role assigned to multimodal texts in assessment situations. Although texts studied by learners during classroom work and test preparation are typically multimodal, tests and exam questions tend to elicit written texts ([<reflink idref="bib28" id="ref26">28</reflink>]; [<reflink idref="bib64" id="ref27">64</reflink>]). Even where students' multimodal texts are in fact assessed, there is a tendency for verbal language to be focused, while meanings expressed through other modes are largely overlooked ([<reflink idref="bib2" id="ref28">2</reflink>]; [<reflink idref="bib22" id="ref29">22</reflink>]; [<reflink idref="bib60" id="ref30">60</reflink>]; [<reflink idref="bib65" id="ref31">65</reflink>]).</p> <p>Researchers have also noted uncertainty among teachers as to how to assess multimodal texts ([<reflink idref="bib46" id="ref32">46</reflink>]; [<reflink idref="bib1" id="ref33">1</reflink>]). Tan et al. ([<reflink idref="bib64" id="ref34">64</reflink>]) found 'evidence that teachers readily rely on assessment criteria that are linked to print media, when faced with the task of assessing multimodal texts created through digital media' (p. 102). According to Aagaard and Lund ([<reflink idref="bib1" id="ref35">1</reflink>]), some teachers report a sense of conflict between new ways of learning mediated by digital technologies and forms of assessment following pre-digital traditions. This suggests a need to integrate multimodal aspects of representation and communication more explicitly in assessment criteria used in schools.</p> <p>Responding to the identified need of tools for the assessment of multimodal literacy, various approaches have been explored (e.g., [<reflink idref="bib12" id="ref36">12</reflink>]; [<reflink idref="bib19" id="ref37">19</reflink>]). The <emph>multiliteracies</emph> framework ([<reflink idref="bib13" id="ref38">13</reflink>]) has been groundbreaking in this regard. Indeed, the multiliteracies paradigm has influenced education policies, for example, in Singapore and Australia, to incorporate aspects of multimodal literacy in EAL curricula ([<reflink idref="bib49" id="ref39">49</reflink>]). Furthermore, the <emph>Common European Framework for Reference of Languages</emph> (CEFR) ([<reflink idref="bib14" id="ref40">14</reflink>], [<reflink idref="bib15" id="ref41">15</reflink>]) has provided a foundation for further development of assessment frameworks addressing specific areas of multimodal literacy (e.g., [<reflink idref="bib11" id="ref42">11</reflink>]; [<reflink idref="bib61" id="ref43">61</reflink>]). There is now a growing body of research and development combining theoretical perspectives, e.g., from writing studies and multimodal analysis, that can be drawn on to implement practices of assessment of multimodal texts (e.g., [<reflink idref="bib23" id="ref44">23</reflink>]).</p> <hd id="AN0174849602-6">Multimodal social semiotics as a theoretical lens</hd> <p>Halliday's theory of systemic functional linguistics (SFL) has been highly influential in the development of multimodal studies as an academic field. SFL posits that three dimensions of meaning are simultaneously enacted in any text, namely, representation of the world, interpersonal relations, and textual organisation, conceptualised as the <emph>ideational, interpersonal</emph>, and <emph>textual metafunctions</emph> ([<reflink idref="bib24" id="ref45">24</reflink>]). These dimensions are reflected in several frameworks theorising the deployment and configuration of semiotic resources (e.g., [<reflink idref="bib39" id="ref46">39</reflink>]; [<reflink idref="bib43" id="ref47">43</reflink>]; [<reflink idref="bib48" id="ref48">48</reflink>]; [<reflink idref="bib52" id="ref49">52</reflink>]; [<reflink idref="bib56" id="ref50">56</reflink>]; [<reflink idref="bib66" id="ref51">66</reflink>]).</p> <p>Multimodal social semiotics (MMSS) ([<reflink idref="bib7" id="ref52">7</reflink>]; [<reflink idref="bib35" id="ref53">35</reflink>]; [<reflink idref="bib39" id="ref54">39</reflink>]) provides a framework for analysis of multimodal texts with a view to interest, identities, and relations of power. Viewing the objective of communicative competence through this theoretical lens, students' multimodal text production can be construed as sign-making through the transformation of available semiotic resources ([<reflink idref="bib35" id="ref55">35</reflink>]). The reader of a multimodal text is also a sign-maker, who forms hypotheses about the sign based on their interest ([<reflink idref="bib36" id="ref56">36</reflink>]; [<reflink idref="bib37" id="ref57">37</reflink>]). By active engagement with an aspect of the world through socially and culturally shaped semiotic resources, learning takes place in the sense that the learner's inner resources are remade ([<reflink idref="bib35" id="ref58">35</reflink>]). Students display evidence of learning through transformation and sign-making activities ([<reflink idref="bib59" id="ref59">59</reflink>]). In the classroom, such transformative engagement may involve, for example, drawing on out-of-school literacies in text production. Kress and van Leeuwen's ([<reflink idref="bib38" id="ref60">38</reflink>]) term <emph>provenance</emph>, 'where signs come from' (p. 10), is of relevance when discussing the practice of 'importing' signs from one context and using it in another. An effect the sign-maker may achieve by such 'import' is to evoke ideas and values associated with the other context ([<reflink idref="bib38" id="ref61">38</reflink>]).</p> <p>The mode of image has become increasingly dominant in the digital age ([<reflink idref="bib34" id="ref62">34</reflink>]) and plays a significant role in young people's communication. An apt framework for the recognition of students' visual meaning making is the <emph>Grammar of Visual Design</emph> ([<reflink idref="bib39" id="ref63">39</reflink>]). Its dimensions of <emph>representation, interaction</emph>, and <emph>composition</emph> builds on Halliday's metafunctions, denoting, respectively, ideational, interpersonal, and textual meaning realised in visuals. Narrative representation of an unfolding event, for instance, may be expressed by vectors formed by lines (e.g., the direction of a depicted person's gaze or hand movement); and conceptual representations, for example taxonomic relations, may be shown by hierarchical ordering of elements. <emph>Validity</emph> as an aspect of interaction concerns the degree to which something is represented as true, indicated by validity markers such as degrees of colour differentiation, contextualisation, or abstraction. Here truth is conceived as a semiotic construct contingent on the values and beliefs of the social groups participating in the communication ([<reflink idref="bib39" id="ref64">39</reflink>]). Interaction in the form of <emph>offer</emph> or <emph>demand</emph> can be realised, respectively, as a person viewed from the side, positioned as an object of the reader's scrutiny, or a depicted person initiating eye contact with the reader. Moreover, the use of camera angle may indicate individuals' power or inferiority. As for the dimension of composition, the spatial organisation of elements in a text is significant, for example in terms of construing information value. An example is <emph>Given-New</emph>, in Western reading tradition organised from left to right, which indicates relations between the well-known, self-evident (Given) and the unknown, 'problematic' (New) ([<reflink idref="bib39" id="ref65">39</reflink>]). Such elements from the grammar of visual design can be translated into accessible tools for students as they work on projects promoting multimodal literacy, as has been done also with other SFL-based frameworks (e.g., [<reflink idref="bib44" id="ref66">44</reflink>]).</p> <hd id="AN0174849602-7">Peer assessment of students' multimodal texts</hd> <p>Peer assessment has been recommended as one of the ways to support students' development of writing skills and awareness of assessment criteria ([<reflink idref="bib42" id="ref67">42</reflink>]). A large-scale metastudy of control-group research documented that peer assessment contributes to improved academic achievement ([<reflink idref="bib17" id="ref68">17</reflink>]). As these studies specifically addressed effects of peer assessment, the findings will also bear relevance to assessment of text production in other modalities than writing.</p> <p>There is no denying, nonetheless, that creating a multimodal text involves a broader range of semiotic choices than writing within a conventional school genre. Moreover, the social worlds with which the producer of the text associates will influence these semiotic choices ([<reflink idref="bib37" id="ref69">37</reflink>]). It is thus useful for teachers and students to negotiate what aspects of multimodal meaning-making to consider in assessment situations ([<reflink idref="bib22" id="ref70">22</reflink>]). Semiotic content that varies in meaning between generations and cultural groups may represent a problem when assessing multimodal meaning making, as exemplified in Aagaard and Silseth ([<reflink idref="bib2" id="ref71">2</reflink>]). An underlying assumption regarding the present project, however, is that assessment from both the teacher's and the students' perspectives will provide a richer and accordingly more valid assessment of the students' semiotic work. Unlike established written school genres where teachers traditionally possess the power to define what constitutes 'a good text', students may feel a higher degree of ownership to multimodal texts associated with genres encountered outside school and consequently state more authoritatively what they believe works to convey a message successfully. Negotiated assessment reduces the hierarchichal nature of the conventional teacher-student relationship and assigns the student a more active and responsible role in the assessment situation ([<reflink idref="bib21" id="ref72">21</reflink>]). This is conducive to increasing the learner's agency in their semiotic work ([<reflink idref="bib37" id="ref73">37</reflink>]).</p> <hd id="AN0174849602-8">The context of the study: Norwegian upper secondary school</hd> <p>The small-scale study presented here, conducted as two classroom interventions in Norwegian upper secondary schools, addressed the following research question: <emph>How can peer assessment and teacher assessment complement each other in their recognition of upper secondary students' semiotic work in the EAL subject?</emph> Complementary perspectives would be achieved by peers viewing the texts through the interpretive lens of youth culture, the teacher ensuring assessment of the texts in line with the aims of the subject, and the researcher anchoring the assessment on theory of multimodality. Both interventions were centred on a literacy event in the EAL classroom that involved students' production of multimodal texts with the communicative purpose of persuasion, and the ensuing assessment of these texts. <emph>Literacy event</emph> is defined by Heath ([<reflink idref="bib25" id="ref74">25</reflink>]) as 'any occasion in which a piece of writing is integral to the nature of participants' interactions and their interpretive processes'. Extending the notion of writing to multimodal text creation, this literacy event would prompt the students to consider and make use of the joint affordances of verbal text and visuals to persuade their audience of a certain viewpoint, as well as discussing to what extent their peers succeeded in obtaining persuasive effects through their deployment of semiotic resources.</p> <p>The subject of English is mandatory in Norway through years 1–11, and most students in Norwegian secondary education can thus be expected to master the language at a relatively high level. Communicative competence ([<reflink idref="bib27" id="ref75">27</reflink>]) constitutes the overarching aim of language learning. Assessment situations conducted throughout the schoolyear feed into an overall grade which describes the student's level of competence in the subject on completion of the course.[<reflink idref="bib1" id="ref76">1</reflink>] Bøhn ([<reflink idref="bib8" id="ref77">8</reflink>]) holds that there is no universal agreement as to what constitutes the construct of communicative competence: this may be operationalised in various ways. The core criterion of communicative competence is, nonetheless, the extent to which a person succeeds in making meaning in accordance with the context and purpose of communication. As noted by multiple scholars internationally (e.g., [<reflink idref="bib4" id="ref78">4</reflink>]; [<reflink idref="bib62" id="ref79">62</reflink>]), communication in its fullest sense cannot be achieved without developing the skills to interpret and express meaning through combinations of linguistic structures with other ways of representing the world. Communicative competence should therefore be conceptualised as comprising multimodal literacy (cf. [<reflink idref="bib26" id="ref80">26</reflink>]; [<reflink idref="bib62" id="ref81">62</reflink>]).</p> <p>Level-specific competence aims in the subject curriculum for English in Norwegian upper secondary education include 'use appropriate digital resources and other aids in language learning, text creation and interaction', and 'discuss and reflect on form, content and language features and literary devices in cultural forms of expression in English from different media in the English-speaking world'. The subject curriculum construes the concept of <emph>text</emph> broadly, specifying that '[t]he texts can contain writing, pictures, audio, drawings, graphs, numbers and other forms of expression that are combined to enhance and present a message' ([<reflink idref="bib51" id="ref82">51</reflink>]). Competence aims for both lower secondary and upper secondary English include the creation of multimodal texts. Even so, criteria for successful achievement of competence aims for text production in EAL at upper secondary level, stated by the [<reflink idref="bib50" id="ref83">50</reflink>] (<emph>Udir</emph>), focus on written and spoken English only, exemplified by the following criterion: 'The student expresses themselves in a precise and nuanced language (...) and adapts the form of communication clearly and coherently to purpose, audience and context in various types of <emph>oral and written texts</emph>' (www.udir.no, 2020, my translation, emphasis added). In other words, the EAL subject in Norway embraces a multimodal view of texts and learning activities but does not explicitly and consistently incorporate this view in documents outlining principles of assessment. This suggests a need for more explicit mention of multimodal aspects in the official discourse of assessment in EAL, supported by research addressing the assessment of students' multimodal meaning making in the subject.</p> <hd id="AN0174849602-9">Methodological approach</hd> <p></p> <hd id="AN0174849602-10">A small-scale design-based research project</hd> <p>The present project can be described as <emph>design-based research</emph>, a category of classroom research where researchers and teachers in collaboration carry out an intervention aiming at solving an identified problem or instigating improvement in an area of practice ([<reflink idref="bib3" id="ref84">3</reflink>]). Anchored on relevant theory, the project should be designed and conducted with an aim to inform practice in the average classroom ([<reflink idref="bib10" id="ref85">10</reflink>]). The practice that the present project sought to improve was the traditional assessment routine in the EAL subject, which typically focused exclusively on students' expression through language. Complementing the general assessment criteria for the subject, the interventions consisted of developing criteria that considered multiple semiotic modes and implementing an assessment procedure for multimodal texts with separate rounds of peer and teacher assessment. Emphasising <emph>multimodal</emph> aspects of the texts, the criteria needed to consider how modes such as image and verbal language were organised and worked in relation to each other. For the <emph>communicative</emph> aspects, the assessment would consider to what extent the configuration of modes conveyed a clear and coherent message. With a view to particular aspects of the students' transformation of signs, the criteria would also consider whether the students 'imported' signs from other contexts into their schoolwork and to what extent the text creators made original and creative use of semiotic resources to get their message across.</p> <p>A characteristic of design-based research is iterative refinement and adjustment of the intervention ([<reflink idref="bib3" id="ref86">3</reflink>]). Instead of implementing the assessment procedure as iterative cycles in the same group of students, I chose to conduct two similar interventions with two student groups aged 16–17 from different schools, to involve a broader range of participants. Their respective teachers of English collaborated with me in organising the literacy event; additionally, they joined me in forming the teacher/researcher assessment team. Participants for the project were purposefully selected ([<reflink idref="bib16" id="ref87">16</reflink>]) by contacting teachers of English that I had previously encountered through my work in teacher education. Findings from the first intervention were reflected on and considered in the refinement of the assessment criteria prior to the second intervention.</p> <hd id="AN0174849602-11">Data collection</hd> <p>In agreement with the teachers, I paid an hour-long visit to the student group at the start of each literacy event, introducing the students to basic principles of multimodal analysis, presenting the aims of the project, and outlining the text assignment and pertaining assessment criteria. The students were asked to create a multimodal text aiming at convincing the reader/viewer of a viewpoint of their own choice, and the teacher organised and supervised the students' text production during two consecutive double sessions of English. To optimise the students' motivation the teacher permitted them to work individually or collaborate with one or two peers as they saw fit.</p> <p>I rejoined the class at the time of the peer assessment. Knowing the students, the teacher put together groups of three or four peers who they envisioned could complement each other in the appraisal of the texts. Each group received one or two texts to assess. I gave the groups some time to discuss the text; then I stopped by each group once for each text they assessed and interviewed them. The interviews were conducted as focus group interviews with the aim of bringing out participants' views on the topic at hand ([<reflink idref="bib40" id="ref88">40</reflink>]). I started by asking the peers how effective they found the text to be in terms of persuasion, then prompted them to elaborate on their views and/or interpret specific features of the text. The interviews lasted from 5 to 10 minutes, depending on the level of detail of the peers' contributions. To ensure unimpeded discussion, the students were allowed to discuss in Norwegian. I transcribed the recordings of the peer group interviews verbatim.</p> <p>The assessment by the teacher/researcher team was conducted separately, applying the following assessment criteria based on the considerations outlined in the previous section.</p> <p></p> <ulist> <item> Relation between modes: visuals and verbal text agreeing (or purposefully conflicting) in ways that emphasised the message would be credited.</item> <p></p> <item> Coherence and clarity: clear, coherent communication in line with the communicative purpose of the genre would result in a high score.</item> <p></p> <item> Intertextuality: recognisable 'import' from one context to another would be credited.</item> <p></p> <item> Originality and creativity: engaging with the topic in an inventive way was assumed to reflect a high degree of transformation of signs and thereby learning.</item> </ulist> <p>Notably, these criteria were refined after the first intervention (see [<reflink idref="bib54" id="ref89">54</reflink>] for details regarding the development of a more fine-grained set of assessment rubrics). The revised rubrics (see Appendix) were used by the teacher/researcher team to assess the texts in the second study. Further to a suggestion from the collaborating teacher, the students were given a shortened and simplified version of the rubrics to consult in their text production and peer assessment.</p> <p>The teacher/researcher team convened in an assessment conference during each intervention. These conferences consisted of brief, pointed discussions, and were therefore not recorded. Taking an active part in the discussions myself, I took notes, marking the level of competence (minimum, medium or high) at which each text was placed by the team and noting the rationale supporting the assessment.</p> <p>In sum, the data from the first intervention comprised 8 peer group interviews and notes from one assessment conference; the data from the second intervention comprised 5 peer group interviews and notes from one assessment conference.</p> <p>Figure 1 visualises the procedure followed in both studies.</p> <p>Graph: Figure 1 Intervention procedure.</p> <hd id="AN0174849602-12">Ethical considerations</hd> <p>The project was registered with the Norwegian Centre for Research Data (NSD/Sikt) and confirmed as complying with national requirements for data protection. I informed participants of their rights, including voluntary and anonymous participation and the right to withdraw from the study at any stage of the project. Students wishing to participate signed a consent form granting me permission to record group interviews[<reflink idref="bib2" id="ref90">2</reflink>] and publish images of their texts connected to dissemination of the research.</p> <hd id="AN0174849602-13">Data analysis</hd> <p>As stated above, the project aimed to establish how assessment by the peers and the teacher/researcher team could complement each other. In line with the principles of thematic analysis ([<reflink idref="bib9" id="ref91">9</reflink>]), I coded the transcriptions of the peer group discussions and the notes from the teacher/researcher's assessment conferences in three subsequent processes. First, I noted elements of sign-making that each of the two assessor groups evaluated as succeeding or failing in fulfilling the communicative purpose of each text. Second, I divided these into categories marked 'agreement' or 'complementary' points relating to each text. Third, based on recurring points in the views expressed by the assessor groups, I identified emerging themes in the assessment of the texts connected to the assessment criteria listed above. The themes were then linked to the analytic dimensions of representation, interaction, and composition ([<reflink idref="bib38" id="ref92">38</reflink>]), viewing the findings through the theoretical lens underpinning the study. This made explicit how agreement and diverging views between the two assessor groups were distributed across dimensions of the students' multimodal communication.</p> <hd id="AN0174849602-14">Results</hd> <p>The first student group produced seven multimodal posters, all digitally created. The second student group submitted five texts, comprising four posters, specifically one digital poster and three analogue-digital hybrids, and one video. Facsimiles of the students' texts are shown in Figures 2 and 3.</p> <p>Graph: Figure 2 Facsimiles of multimodal texts, classroom intervention 1.</p> <p>Graph: Figure 3 Facsimiles of multimodal texts, classroom intervention 2.</p> <p>Results of the two rounds of assessment, sorted into points of agreement and complementary views between the two assessor groups, are presented in Tables 1 and 2. A summary of the themes connected to relevant assessment criteria and MMSS dimensions is provided in Table 3.</p> <p>Table 1 Agreement and complementary assessment, classroom intervention 1.</p> <p> <ephtml> <table><tr><th colspan="3" /></tr><tr><th align="left" valign="top">TITLE OF POSTER</th><th align="left" valign="top">AGREEMENT</th><th align="left" valign="top">COMPLEMENTARY ASSESSMENT</th></tr><tr><td colspan="3" /></tr><tr><td align="left" valign="top"><p><bold><italic>A) Warning! Save the earth now!</italic></bold></p></td><td align="left" valign="top"><p>Combinations of pointed written statements and visuals (images, colour, symbols) create a powerful effect.</p><p>A cause-effect relation is achieved by depicting natural disasters followed by images of injured animals.</p></td><td align="left" valign="top"><p>P: Polar bear is a good representative of precarious animals.</p><p>T/R: Depicted animal making eye contact places a demand on the viewer.</p><p>P: Mark Twain citation is a reminder that you can do nothing about the weather, but you can do something about the climate.</p><p>T/R: Mark Twain citation is an example of creative transformation of semiotic resources.</p></td></tr><tr><td colspan="3" /></tr><tr><td align="left" valign="top"><p><bold><italic>B) We are conducting a mass extinction!</italic></bold></p></td><td align="left" valign="top"><p>The black background and statistics underscore the seriousness of the message. Aesthetically pleasing images and layout makes the text attractive.</p></td><td align="left" valign="top"><p>P: Depicted animals are typical representatives of precarious species.</p><p>P: Images foreground the animals as valuable, accentuated by their beauty and the reminder that they may not last for long.</p><p>T/R: Animal making eye contact places a demand.</p><p>T/R: Missing references to statistics.</p></td></tr><tr><td colspan="3" /></tr><tr><td align="left" valign="top"><p><bold><italic>C) Why we should raise the legal age for tobacco and drinking to 21.</italic></bold></p></td><td align="left" valign="top"><p>The message is at times incoherent.</p><p>Claims in the text are unsupported.</p></td><td align="left" valign="top"><p>P: Social situation in the car gives an attractive impression.</p><p>P: Difficult to identify with depicted older individuals and images of arms/hands. Image of lungs: removed from everyday visual experience.</p></td></tr><tr><td colspan="3" /></tr><tr><td align="left" valign="top"><p><bold><italic>D) Children should learn how to use a PC in elementary school.</italic></bold></p></td><td align="left" valign="top" /><td align="left" valign="top"><p>P: Too much written text is unappealing.</p><p>P: Dark colour gives a sombre effect.</p><p>T/R: The message is focused and coherent.</p></td></tr><tr><td colspan="3" /></tr><tr><td align="left" valign="top"><p><bold><italic>E) Homeschool – better learning and more focus at home!</italic></bold></p></td><td align="left" valign="top"><p>Clear and coherent message.</p></td><td align="left" valign="top"><p>P: Images give immediate information about the content.</p><p>P: The headline contains too much.</p><p>P: Radioactivity symbol makes the danger real.</p><p>T/R: Exact references are given.</p><p>T/R: Depicted individuals do not make eye contact with the viewer: 'offer' instead of 'demand'.</p></td></tr><tr><td colspan="3" /></tr><tr><td align="left" valign="top"><p><bold><italic>F) Hiking is man's best medicine.</italic></bold></p></td><td align="left" valign="top" /><td align="left" valign="top"><p>P: People having fun together is attractive.</p><p>T/R: Most depicted people are viewed from behind, identification difficult.</p><p>T/R: Black as background colour brings darkness, unfortunate in view of the topic.</p></td></tr><tr><td colspan="3" /></tr><tr><td align="left" valign="top"><p><bold><italic>G) Travel the world</italic></bold></p></td><td align="left" valign="top"><p>Aesthetically pleasing image and font.</p><p>Written texts describe positive aspects of travelling, but without support or documentation.</p></td><td align="left" valign="top"><p>P: The prospect of being close to an elephant in idyllic, exotic surroundings appeals to emotions.</p><p>P: The written text contains difficult words.</p></td></tr><tr><td colspan="3" /></tr></table> </ephtml> </p> <p>1 'T/R' = Teacher/researcher team; 'P' = Peer group.</p> <p>Table 2 Agreement and complementary assessment, classroom intervention 2.</p> <p> <ephtml> <table><tr><th colspan="3" /></tr><tr><th align="left" valign="top">TITLE OF POSTER</th><th align="left" valign="top">AGREEMENT</th><th align="left" valign="top">COMPLEMENTARY ASSESSMENT</th></tr><tr><td colspan="3" /></tr><tr><td align="left" valign="top"><p><bold><italic>H) Reduce the limit agefor drivers' licence to 16</italic></bold></p></td><td align="left" valign="top"><p>Headline, images, and captions do not converge into a focused message.</p><p>No support for written statements.</p></td><td align="left" valign="top"><p>P: Should have written their own text instead of using Internet captions for the images.</p><p>P: Image of passenger using phone fails to support the argument.</p></td></tr><tr><td colspan="3" /></tr><tr><td align="left" valign="top"><p><bold><italic>I) Fuck exam!</italic></bold></p></td><td align="left" valign="top"><p>Overall focused message.</p><p>Good connection between writing and visuals.</p></td><td align="left" valign="top"><p>T/R: Style appealing to a young target group.</p><p>P: Phone signals the student's obligation to socialise with friends.</p><p>T/R: Fist signals a threat.</p><p>P: Interpretations of fist: a 'knuckle bump' of encouragement or a threat.</p><p>T/R: Pink and yellow highlight the headline.</p><p>P: Facial expression and posture of depicted student make the stress real.</p><p>P: The message is easy to understand but needs more written text to build argument better.</p></td></tr><tr><td colspan="3" /></tr><tr><td align="left" valign="top"><p><bold><italic>J) 16 years old should be able to drive</italic></bold></p></td><td align="left" valign="top"><p>The use of the 'Drive through' sign is creative.</p></td><td align="left" valign="top"><p>T/R: Relations between visuals and writing function adequately, but communicative function of colours and symbols not always clear.</p><p>T/R: Slight overload of communication, demanding for the reader.</p><p>P: Aesthetic value makes the text convincing.</p><p>P: Good organising conveys the message effectively.</p><p>P: Photo of drinkers older than 16 works well with statement that 16-year-olds drink less.</p><p>P: Photo of motorbike illustrates illogical point that cars have a higher age limit than motorbikes.</p></td></tr><tr><td colspan="3" /></tr><tr><td align="left" valign="top"><p><bold><italic>K) Wear a mask(video)</italic></bold></p></td><td align="left" valign="top"><p>The video stages relevant and realistic situation, easy for youths to identify.</p><p>Focus on the mobile phone underscores its importance for young people.</p></td><td align="left" valign="top"><p>P: Convincing connection between wearing a mask and the opportunity to go to a party.</p><p>P: Panes of written text break the film up in a pleasant way and create suspense.</p><p>T/R: Panes of written text form transitions and have a cohesive function.</p><p>P: At times difficult to hear due to low sound quality.</p></td></tr><tr><td colspan="3" /></tr><tr><td align="left" valign="top"><p><bold><italic>L) Reduce the age limit for driver's licence to 16it can be very dangerous.</italic></bold></p></td><td align="left" valign="top"><p>Clear message, tight relations between visuals and writing.</p></td><td align="left" valign="top"><p>P: Use of traffic light colours is creative, attractive and underscores the topic.</p><p>T/R: The affordances of font and size could have been used better.</p><p>P: Causal relationship between accidents and reasons for accidents well expressed.</p><p>T/R: Causal relationship unclear due to reversed sequence of images.</p><p>P: Mixed views on the black background.</p><p>P: Image of phone illustrates 16-year-olds' immaturity.</p><p>P: Grammatical errors disturb communication somewhat.</p></td></tr><tr><td colspan="3" /></tr></table> </ephtml> </p> <p>2 'T/R' = Teacher/researcher team; 'P' = Peer group.</p> <p>Table 3 Emerging themes from the assessment rounds.</p> <p> <ephtml> <table><tr><th colspan="4" /></tr><tr><th align="left" valign="top">ASSESSMENT CRITERIA</th><th align="left" valign="top">PEERS</th><th align="left" valign="top">TEACHER/RESEARCHER TEAM</th><th align="left" valign="top">DIMENSION</th></tr><tr><td colspan="4" /></tr><tr><td align="left" valign="top"><p>Coherence and clarity</p></td><td align="left" valign="top"><p>Ease of understanding</p></td><td align="left" valign="top" /><td align="left" valign="top"><p>Interaction</p></td></tr><tr><td colspan="4" /></tr><tr><td align="left" valign="top"><p>Coherence and clarity</p></td><td align="left" valign="top"><p>Support of statements</p></td><td align="left" valign="top"><p>Support of statements</p></td><td align="left" valign="top"><p>Interaction</p></td></tr><tr><td colspan="4" /></tr><tr><td align="left" valign="top"><p>Coherence and clarity</p></td><td align="left" valign="top"><p>Purposeful use of layout, font, and colour</p></td><td align="left" valign="top"><p>Purposeful use of layout, font, and colour</p></td><td align="left" valign="top"><p>Composition</p></td></tr><tr><td colspan="4" /></tr><tr><td align="left" valign="top"><p>Relation between modes</p></td><td align="left" valign="top"><p>Language-visuals connection</p></td><td align="left" valign="top"><p>Language-visuals connection</p></td><td align="left" valign="top"><p>Composition</p></td></tr><tr><td colspan="4" /></tr><tr><td align="left" valign="top"><p>Originality and creativity</p></td><td align="left" valign="top"><p>Aesthetic qualities</p></td><td align="left" valign="top" /><td align="left" valign="top"><p>Composition</p></td></tr><tr><td colspan="4" /></tr><tr><td align="left" valign="top"><p>Originality and creativity</p></td><td align="left" valign="top"><p>Making the topic real</p></td><td align="left" valign="top"><p>Making the topic real</p></td><td align="left" valign="top"><p>Representation and interaction</p></td></tr><tr><td colspan="4" /></tr><tr><td align="left" valign="top"><p>Originality and creativity</p></td><td align="left" valign="top"><p>Potential for identification</p></td><td align="left" valign="top"><p>Enactment of offer/demand</p></td><td align="left" valign="top"><p>Interaction</p></td></tr><tr><td colspan="4" /></tr></table> </ephtml> </p> <p>As shown in Table 3, most of the themes were addressed by both peers and the teacher/researcher team. There were, however, important nuances in their perceptions, as evident in Tables 1 and 2.</p> <p>The peers viewed it as important for the text to be easily understandable to get the message across. Text B, where images carried much of the functional load, received credit from the peers in that respect. Similarly, text J was characterised as easily comprehensible due to good organising of the elements. Too much written text (D) or too many difficult words (G), on the other hand, was deemed by the peers as hampering communication. Interestingly, in text L, the students were concerned about linguistic errors, whereas the teacher/researcher team found the text adequately communicative.</p> <p>Both the peers and the teacher/researcher team noted that in several texts, quantifications were stated without documentation (e.g., texts B and F). Therefore, a point concerning accessible references as support of statements was worked into the revised assessment criteria.</p> <p>Layout, font, and colour were commented on in several cases. The teacher and researcher found the layout of text A somewhat messy at first sight but concluded, in agreement with the peers, that it worked well in creating cause-effect relations. The peers found the use of images in text L effective to get the message across, pointing out the red lines forming an arrow from the photos depicting phone texting and drunk driving to the centred image of a serious car accident. The teacher/researcher team acknowledged this but remarked that the direction of the elements did not comply with the conventional Given-New information structure. Colours, particularly red and black, were found by the peers to have a powerful effect (e.g., texts A and B). The use of 'traffic light' colours red, orange, and green in text L was admired by the peers as inventive, as this poster concerned driving. In some cases, both the peers and the teachers detected a sombre, negative effect created by dark colours, but in different texts (D and F, respectively).</p> <p>Both assessor groups considered good connection between language and visuals as important, as noted in their positive assessment of texts E and K. Text H received a less favourable appraisal, as the captions to the images were viewed as disconnected from the overall message of the text.</p> <p>Aesthetic value was regarded by some of the peers as playing an important role in persuasion, more so than for the teacher and researcher, as evident in the assessment of Text J. Peers likewise appreciated the aesthetic qualities of text G, but here they also pointed out some drawbacks weakening the persuasive effect.</p> <p>Another theme was the deployment of visuals to make a topic 'real'. In text C, images contrasting healthy lungs with brown, tarred lungs were not considered effective by the students, since they did not associate images of isolated body parts with their own respiratory organs. In the two posters addressing the dangers of global warming, by contrast (texts A and B), the peers found that the visuals succeeded in representing the seriousness of the situation.</p> <p>As for text I, the peers pointed to the facial expression and the posture of the exam candidate as expressing stress, while the teacher and researcher also commented on the images encircling the student as communicating effectively. An interesting point of contention here was the picture of a fisted arm, which the teacher/researcher team interpreted as a threat, as did one of the peers. Another peer, however, saw a friend offering an encouraging 'fist bump' greeting.</p> <p>The point of importance perhaps most strongly emphasised in the peer assessment was the potential for identification with their own age group. For example, the peers found text C less than convincing, partly because 'old' men were depicted as representing the dangers of smoking and drinking. A similar view was expressed about an image in text J. By contrast, the peers remarked on images showing social scenes with people their own age as attractive and thereby persuasive. In several cases, the mobile phone appeared to signal mediated social activity. Text K, for example, showed the phone as the bearer of messages both from friends (invitation to a party) and from the hospital (results of a Covid test), and the depicted phone in text I was interpreted by the peers as indicating the student's duty to socialise with friends. In text L the phone represented a distraction from driving. When asked if a 16-year-old was more likely than an 18-year-old to use her mobile phone when driving, one of the peers assessing text L replied that younger teenagers were generally more addicted to social media such as SnapChat and would feel compelled to look 'if <emph>that</emph> boy, like, snaps you back'.</p> <p>A theme also relating to personal appeal emerged in two of the other texts, where the teacher/researcher team saw a demand for empathy being placed by a depicted animal. In text A, the reader was met with the gaze of a koala apparently singed by a forest fire, while text B included a gorilla initiating eye contact with the reader. Based on these findings, the potential for interpersonal engagement was integrated in the revised assessment criteria (see Appendix).</p> <hd id="AN0174849602-15">Discussion</hd> <p></p> <hd id="AN0174849602-16">Didactic use of complementary assessment results</hd> <p>In the assessment of most of the students' texts produced in the present project, the peers and the teacher/researcher team expressed coinciding views. This tendency was also evident in the more comprehensive study conducted by Sindoni et al. ([<reflink idref="bib61" id="ref93">61</reflink>]), where correlation was found between teachers' and students' assessment of the same multimodal texts. In the case of the present study, both peers and the teacher/researcher team pointed out support of statements as a sign of credibility, which conveys the important message that multimodal texts need to hold the same standard of accountability as written texts. The two assessor groups also agreed that coherence between verbal and visual semiotic resources was crucial to get the message across, and they agreed on the persuasive power of finding apt visuals to represent core aspects of the message. Here, the peers' appreciation of typical precarious animals depicted to represent the climate crisis, for example, resonates with Royce's ([<reflink idref="bib56" id="ref94">56</reflink>]) indentification of relations of meronymy between images and written text. Extending this further into the curricula of language subjects, identifications of rhetorical devices can form bridges between verbal expressions such as poems and visual expressions in literacy events, drawing, for example, on Royce's ([<reflink idref="bib56" id="ref95">56</reflink>], [<reflink idref="bib57" id="ref96">57</reflink>]) work on intersemiotic complementarity.</p> <p>Instances where views or nuances of meaning differ between groups of assessors, may form a valuable backdrop for reflection on literacy and communication. One example from the present study is text E, where the teacher/researcher team valued the coherent writing in the text, while the peers found the written text dense and unappealing. Such observations may inspire discussions of how to make semiotic choices with the aim to communicate effectively with the intended audience. Interestingly, text J was characterised as 'overloaded' and demanding by the teacher/researcher team, while the peers focused on the aesthetic qualities of the poster. This exemplifies how texts may be perceived fundamentally differently by teachers and students, which forms a useful perspective for teachers seeking out texts apt for classroom work on curricular topics. But this finding also shows a need to problematise the persuasive powers of aesthetics in class discussions, foregrounding the critical dimension of multimodal literacy ([<reflink idref="bib67" id="ref97">67</reflink>]).</p> <p>Differences in the interpretation of signs, such as the depicted fist in text I, illustrate the reality that sign-making is ambiguous, and meaning is dependent on context and participants in communication ([<reflink idref="bib24" id="ref98">24</reflink>]). This came to the fore where there was basic agreement between the two assessor groups but subtle nuances in interpretation, such as the role of the mobile phone in social activity. While the teacher/researcher team saw the depicted phone as a general indicator of its position in youth culture, the peers contributed additional layers of meaning. Overt negotiation of meaning in these cases resulted in extended insights, with the students, the teacher and the researcher all experiencing the role of the reader as sign-maker ([<reflink idref="bib36" id="ref99">36</reflink>]).</p> <hd id="AN0174849602-17">Implementing practices that draw on and enhance students' multimodal literacy</hd> <p>According to Selander and Kress (2017, p. 34), 'signs of learning consist of all the choices of central aspects and choices of expression that are made to show how one has understood something (in a new way)' (my translation). Allowing students to present multimodal texts for assessment gives them a broader repertoire for meaning making and promotes their agency in the subject ([<reflink idref="bib45" id="ref100">45</reflink>]). As touched upon earlier, however, established codes of expression may still stand in the way of making full use of this repertoire. For example, Godhe ([<reflink idref="bib22" id="ref101">22</reflink>]) observed students appearing uncertain as to whether their out-of-school literacies counted in the multimodal text they produced as a school assignment. This suggests a need to explicitly discuss with the students what counts as representation of knowledge ([<reflink idref="bib55" id="ref102">55</reflink>]) and cast a wide net to sample students' knowledge and skills relevant to the subject. Findings from the present study indicate that out-of-school literacies feed into teenagers' multimodal literacy, evidenced by the students' readiness and potential to identify and assess transformation of signs in their peers' multimodal communication.</p> <p>Acknowledging the complex text worlds surrounding today's students, teachers can introduce opportunities for varied text production to elicit evidence of students' knowledge and literacies developed inside and outside school. Silseth and Gilje (2019) suggest that in addition to formative assessment and support during text production, multimodal texts can be included in learner portfolios along with other types of text. In a similar vein, Fjørtoft ([<reflink idref="bib19" id="ref103">19</reflink>]) recommends a longitudinal approach using multimodal digital classroom assessment to obtain rich data on students' learning and development. As demonstrated through the present study, students' recognition of their peers' meaning making contributes additional valuable evidence of learning as transformation of semiotic resources.</p> <hd id="AN0174849602-18">Conclusion</hd> <p>The procedure of assessment implemented in the two classroom interventions described in this article brought out instances of both agreeing and complementary appraisal of students' multimodal texts in the subject of EAL. Areas of agreement concerned compositional aspects, such as the importance of coherence between verbal text and visuals; they also concerned interactional aspects, such as the necessity of supporting claims and the persuasive effect of making the topic real, which connected both to representation and interaction. Differences or nuances in the assessors' interpretation of texts mainly concerned the interactional dimension. Specifically, the peers valued deployment of semiotic resources that facilitated understanding, and they emphasised the potential of identification as crucial for persuasion. The teacher and researcher particularly valued the direct enactment of interaction in the form of demand in some texts. Highlighting the significance of context and social factors in communication, the two rounds of assessment contributed to negotiations of meaning drawing on literacies developed both inside and outside school. Such negotiations of meaning give valuable evidence of students' semiotic work and are conducive to heightening their semiotic awareness.</p> <p>Certain limitations of the study should be pointed out. Summarising and translating the participants' authentic utterances always entail a risk of losing nuances of meaning. Furthermore, the assessment rounds marked the end of the design-based research conducted in each student group. Prolonged research periods involving several iterations might have established the assessment practice more firmly and allowed for additional refinement of the rubrics and the assessment procedure.</p> <p>Acknowledging these limitations, the study showcases a way for teachers to implement a collaborative assessment procedure that involves students actively in the recognition of each other's multimodal meaning making in EAL, thereby promoting the students' agency in learning and assessment, and supporting their development of multimodal literacy as an aspect of communicative competence in the subject.</p> <hd id="AN0174849602-19">Additional file</hd> <p>The additional file for this article can be found as follows:</p> <p>Graph: Additional File 1 Appendix: Revised assessment criteria for persuasive multimodal text. DOI:</p> <hd id="AN0174849602-20">Acknowledgements</hd> <p>I would like to express my sincere gratitude to the teachers and students who agreed to participate in these studies, and to Professor Aud Skulstad who gave me valuable feedback on an early draft of this article.</p> <hd id="AN0174849602-21">Competing Interests</hd> <p>The author has no competing interests to declare.</p> <ref id="AN0174849602-22"> <title> REFERENCES </title> <blist> <bibl id="bib1" idref="ref33" type="bt">1</bibl> <bibtext> Aagaard, T., & Lund, A. (2013). Mind the gap: Divergent objects of assessment in technology-rich learning environments. Nordic Journal of Digital Literacy, 8(4), 225–243. DOI: 10.18261/ISSN1891-943X-2013-04-04</bibtext> </blist> <blist> <bibl id="bib2" idref="ref28" type="bt">2</bibl> <bibtext> Aagaard, T., & Silseth, K. (2017). Teachers' assessment of digital stories: Challenges and dilemmas. Nordic Studies in Education, 37(3–4), 231–242. DOI: 10.18261/issn.1891-5949-2017-03-04-08</bibtext> </blist> <blist> <bibl id="bib3" idref="ref84" type="bt">3</bibl> <bibtext> Anderson, T., & Shattuck, J. (2012). Design-Based Research: A Decade of Progress in Education Research? Educational Researcher, 41(1), 16–25. DOI: 10.3102/0013189X11428813</bibtext> </blist> <blist> <bibl id="bib4" idref="ref78" type="bt">4</bibl> <bibtext> Archer, A. (2000). Communicative competence expanded: A 'multiliteracies' approach to English Additional Language teaching. English Academy Review, 17(1), 83–96. DOI: 10.1080/10131750085310101</bibtext> </blist> <blist> <bibl id="bib5" idref="ref9" type="bt">5</bibl> <bibtext> Archer, A., & Breuer, E. (2015). Methodological and Pedagogical Approaches to Multimodality in Writing. In A. Archer & E. Breuer (Eds.), Multimodality in Writing: The state of the art in theory, methodology and pedagogy (pp. 1–16). Brill. DOI: 10.1163/9789004297197_002</bibtext> </blist> <blist> <bibl id="bib6" idref="ref1" type="bt">6</bibl> <bibtext> Bezemer, J., & Kress, G. (2008). Writing in Multimodal Texts: A Social-Semiotic Account of Designs for Learning. Written Communication, 28, 166–195. DOI: 10.1177/0741088307313177</bibtext> </blist> <blist> <bibl id="bib7" idref="ref11" type="bt">7</bibl> <bibtext> Bezemer, J., & Kress, G. (2016). Multimodality, Learning and Communication: A Social-Semiotic Frame. Routledge. DOI: 10.4324/9781315687537</bibtext> </blist> <blist> <bibl id="bib8" idref="ref18" type="bt">8</bibl> <bibtext> Bøhn, H. (2019). Assessing communicative skills. In T. Burner, C. Carlsen & K. Kverndokken (Eds.), 101 Ways to Work with Communicative Skills. Fagbokforlaget.</bibtext> </blist> <blist> <bibl id="bib9" idref="ref91" type="bt">9</bibl> <bibtext> Braun, V., & Clarke, V. (2006). Using thematic analysis in psychology. Qualitative Research in Psychology, 3(2), 77–101. DOI: 10.1191/1478088706qp063oa</bibtext> </blist> <blist> <bibtext> Brown, A. L. (1992). Design Experiments: Theoretical and Methodological Challenges in Creating Complex Interventions in Classroom Settings. The Journal of the Learning Sciences, 2(2), 141–178. DOI: 10.1207/s15327809jls0202_2</bibtext> </blist> <blist> <bibtext> Campoy-Cubillo, M. C., & Querol-Julián, M. (2015). Assessing multimodal listening. In B. C. Camiciottoli & I. Fortanet-Gómez (Eds.), Multimodal Analysis in Academic Settings: From Research to Teaching (pp. 193–212). Routledge.</bibtext> </blist> <blist> <bibtext> Canale, G. (2019). Technology, Multimodality and Learning: Analyzing Meaning across Scales. Springer. DOI: 10.1007/978-3-030-21795-2</bibtext> </blist> <blist> <bibtext> Cazden, C., Cope, B., Fairclough, N., Gee, J., Kalantzis, M., Kress, G., ... Nakata, M. (1996). A Pedagogy of Multiliteracies: Designing Social Futures. Harvard Educational Review, 66(1), 60–92. DOI: 10.17763/haer.66.1.17370n67v22j160u</bibtext> </blist> <blist> <bibtext> Council of Europe. (2001). Common European Framework for Languages: Learning, Teaching and Assessment. Cambridge University Press.</bibtext> </blist> <blist> <bibtext> Council of Europe. (2020). Common European Framework for Languages: Learning, Teaching and Assessment. Companion Volume. Council of Europe.</bibtext> </blist> <blist> <bibtext> Creswell, J. W. (2014). Research design: qualitative, quantitative, and mixed methods approaches (3rd ed.). SAGE.</bibtext> </blist> <blist> <bibtext> Double, K. S., McGrane, J. A., & Hopfenbeck, T. N. (2019). The Impact of Peer Assessment on Academic Performance: A Meta-analysis of Control Group Studies. Educational Psychology Review, 32, 481–509. DOI: 10.1007/s10648-019-09510-3</bibtext> </blist> <blist> <bibtext> Erstad, O. (2013). Trajectories of Remixing: Digital Literacies, Media Production and Schooling. In C. Lankshear & M. Knobel (Eds.), A New Literacies Reader: Educational Perspectives (pp. 38–56). Peter Lang.</bibtext> </blist> <blist> <bibtext> Fjørtoft, H. (2020). Multimodal digital classroom assessments. Computers & Education, 152, 103892. DOI: 10.1016/j.compedu.2020.103892</bibtext> </blist> <blist> <bibtext> Gilje, Ø. (2021). På nye veier: læremidler og digitale verktøy fra kunnskapsløftet til fagfornyelsen. [Taking new routes: learning materials and digital tools from the knowledge promotion to the subject renewal]. Norsk Pedagogisk Tidsskrift, 2, 227–241. DOI: 10.18261/issn.1504-2987-2021-02-10</bibtext> </blist> <blist> <bibtext> Gipps, C. (2002). Sociocultural Perspectives on Assessment. In G. Wells and G. Claxton (Eds.), Learning for Life in the 21<sups>st</sups> Century (pp. 73–83). Blackwell Publishing. DOI: 10.1002/9780470753545.ch6</bibtext> </blist> <blist> <bibtext> Godhe, A. -L. (2014). Creating and Assessing Multimodal Texts – Negotiations at the Boundary. PhD thesis, University of Gothenburg.</bibtext> </blist> <blist> <bibtext> Hafner, C. A., & Ho, W. Y. J. (2020). Assessing digital multimodal composing in second language writing: Towards a process-based model. Journal of Second Language Writing, 47. DOI: 10.1016/j.jslw.2020.100710</bibtext> </blist> <blist> <bibtext> Halliday, M. A. K. (1994). An introduction to functional grammar (2<sups>nd</sups> ed.). Edward Arnold.</bibtext> </blist> <blist> <bibtext> Heath, S. B. (1982). Protean shapes in literacy events: Ever-shifting oral and literate traditions. In D. Tannen (Ed.), Spoken and written language: Exploring orality and literacy (pp. 91–117). Ablex.</bibtext> </blist> <blist> <bibtext> Heberle, V. (2010). Multimodal literacy for teenage EFL students. Cadernos de Letras (UFRJ), 27, 101–116.</bibtext> </blist> <blist> <bibtext> Hymes, D. (1972). On communicative competence. In J. B. Pride & J. Holmes (Eds.), Sociolinguistics (pp. 269–293). Penguin.</bibtext> </blist> <blist> <bibtext> Jakobsen, I. K. (2019). Inspired by image: A multimodal analysis of 10th grade English school-leaving written examinations set in Norway (2014–2018). Acta Didactica Norge, 13(1). DOI: 10.5617/adno.6248</bibtext> </blist> <blist> <bibtext> Jewitt, C. (2003). Re-thinking Assessment: multimodality, literacy and computer-mediated learning. Assessment in Education: Principles, Policy & Practice, 10(1), 83–102. DOI: 10.1080/09695940301698</bibtext> </blist> <blist> <bibtext> Jewitt, C. (2008). Multimodality and Literacy in School Classrooms. Review of Research in Education, 32, 241–267. February 2008. DOI: 10.3102/0091732X07310586</bibtext> </blist> <blist> <bibtext> Jewitt, C. (2011). Changing Pedagogic Landscape of Subject English in UK Classrooms. In K. L. O'Halloran & B. A. Smith (Eds.), Multimodal Studies: Exploring Issues and Domains (pp. 184–201). Routledge.</bibtext> </blist> <blist> <bibtext> Jewitt, C. (2014). An introduction to multimodality. In C. Jewitt (Ed.), The Routledge Handbook of Multimodal Analysis (pp. 15–30). Routledge.</bibtext> </blist> <blist> <bibtext> Johnson, D., & Kress, G. (2003). Globalisation, Literacy and Society: Redesigning pedagogy and assessment. Assessment in Education: Principles, Policy & Practice, 10(1), 5–14. DOI: 10.1080/09695940301697</bibtext> </blist> <blist> <bibtext> Kress, G. (2003). Literacy in the New Media Age. Routledge. DOI: 10.4324/9780203299234</bibtext> </blist> <blist> <bibtext> Kress, G. (2010). Multimodality: A social semiotic approach to contemporary communication. Routledge.</bibtext> </blist> <blist> <bibtext> Kress, G., & Jewitt, C. (2003). Introduction. In C. Jewitt & G. Kress (Eds.), Multimodal Literacy (pp. 1–18). Peter Lang. DOI: 10.1002/9780470760178.ch</bibtext> </blist> <blist> <bibtext> Kress, G., & Selander, S. (2012). Multimodal design, learning and cultures of recognition. The Internet and Higher Education, 15(4), 265–268. DOI: 10.1016/j.iheduc.2011.12.003</bibtext> </blist> <blist> <bibtext> Kress, G., & van Leeuwen, T. (2001). Multimodal discourse: The modes and media of contemporary communication. Hodder Education.</bibtext> </blist> <blist> <bibtext> Kress, G., & van Leeuwen, T. (2021). Reading Images: The Grammar of Visual Design (3<sups>rd</sups> ed.). Routledge. DOI: 10.4324/9781003099857</bibtext> </blist> <blist> <bibtext> Kvale, S., & Brinkmann, S. (2015). Det kvalitative forskningsintervju [InterView: Learning the Craft of Qualitative Research Interviewing]. 3<sups>rd</sups> ed. Gyldendal Akademisk.</bibtext> </blist> <blist> <bibtext> Lee, I. (2007). Assessment for Learning: Integrating Assessment, Teaching, and Learning in the ESL/EFL Writing Classroom. The Canadian Modern Language Review, 64(1), 199–213. DOI: 10.3138/cmlr.64.1.199</bibtext> </blist> <blist> <bibtext> Lee, I., & Coniam, D. (2013). Introducing assessment for learning for EFL writing in an assessment of learning examination-driven system in Hong Kong. Journal of Second Language Writing, 22, 34–50. DOI: 10.1016/j.jslw.2012.11.003</bibtext> </blist> <blist> <bibtext> Lemke, J. (2002). Travels in hypermodality. Visual Communication, 1(3), 299–325. DOI: 10.1177/147035720200100303</bibtext> </blist> <blist> <bibtext> Lim, F. V. (2018). Developing a systemic functional approach to teach multimodal literacy. Functional Linguistics, 5. DOI: 10.1186/s40554-018-0066-8</bibtext> </blist> <blist> <bibtext> Lim, F. V., & Nguyen, T. T. H. (2022). 'If you have the freedom, you don't need to even think hard' – considerations in designing for student agency through digital multimodal composing in the language classroom. Language and Education, 36. DOI: 10.1080/09500782.2022.2107875</bibtext> </blist> <blist> <bibtext> Lund, A. (2006). The multiple contexts of online language teaching. Language Teaching Research, 10(2), 181–204. DOI: 10.1191/1362168806lr191oa</bibtext> </blist> <blist> <bibtext> Magnusson, P., & Godhe, A.-L. (2019). Multimodality in Language Education – Implications for Teaching. Designs for Learning, 11(1), 127–137. DOI: 10.16993/dfl.127</bibtext> </blist> <blist> <bibtext> Martinec, R., & Salway, A. (2005). A system for image-text relations in new (and old) media. Visual Communication, 4(3), 337–371. DOI: 10.1177/1470357205055928</bibtext> </blist> <blist> <bibtext> Mitsikopoulou, B. (2022). Digital media in foreign language education. Pedio.</bibtext> </blist> <blist> <bibtext> Norwegian Directorate for Education and Training. (<ulink href="http://www.udir.no">http://www.udir.no</ulink>) (n.d.) Criteria for attainment of competence aims, English general and vocational studies. https://<ulink href="http://www.udir.no/laring-og-trivsel/lareplanverket/kjennetegn/kjennetegn-pa-maloppnaelse--engelsk-vg1-sfyf/">www.udir.no/laring-og-trivsel/lareplanverket/kjennetegn/kjennetegn-pa-maloppnaelse--engelsk-vg1-sfyf/</ulink>. Accessed 2 Aug. 2022.</bibtext> </blist> <blist> <bibtext> Norwegian Ministry of Education and Research. (2019). National Curriculum for Knowledge Promotion 2020 (LK20). English subject curriculum (ENG 01–04).</bibtext> </blist> <blist> <bibtext> O'Halloran, K., & Lim, F. V. (2014). Systemic functional multimodal discourse analysis. In S. Norris & C. D. Maier (Eds.), Interactions, Images and Texts: A Reader in Multimodality (pp. 137–153). Mouton De Gruyter. DOI: 10.1515/9781614511175.137</bibtext> </blist> <blist> <bibtext> Ørevik, S. (2015). From book to screen: changing genre patterns and communicative purposes. Nordic Journal of Digital Literacy, 10(2), 102–120. DOI: 10.18261/ISSN1891-943X-2015-02-04</bibtext> </blist> <blist> <bibtext> Ørevik, S. (2022). Developing an Assessment Framework for Multimodal Text Production in the EAL Classroom: The Case of Persuasive Posters. In S. Diamantopoulou & S. Ørevik (Eds.), Multimodality in English Language Learning (pp. 257–271). Routledge. DOI: 10.4324/9781003155300-18</bibtext> </blist> <blist> <bibtext> Romero, D., & Walker, D. (2010). Ethical dilemmas in representation: engaging participative youth. Ethnography and Education, 5(2), 209–227. DOI: 10.1080/17457823.2010.493409</bibtext> </blist> <blist> <bibtext> Royce, T. (1998). Synergy on the Page: Exploring Intersemiotic Complementarity in Page-Based Multimodal Text. JASFL Occasional Papers, 1(1), 25–50.</bibtext> </blist> <blist> <bibtext> Royce, T. (2007). Intersemiotic Complementarity: A Framework for Multimodal Discourse Analysis. In T. Royce & W. Bowcher (Eds.), New Directions in the Analysis of Multimodal Discourse. London and New York: Routledge.</bibtext> </blist> <blist> <bibtext> Selander, S. (1994). Pedagogiske texter och retorik. [Pedagogical texts and rhetoric]. In S. Selander & B. Englund (Eds.), Konsten att informera och övertyga. [The art of informing and persuading]. (pp. 41–54). Stockholm: HLS Förlag.</bibtext> </blist> <blist> <bibtext> Selander, S., & Kress, G. (2017). Design för lärande: ett multimodalt perspektiv. [Designs for learning: a multimodal perspective]. Lund Studentlitteratur.</bibtext> </blist> <blist> <bibtext> Silseth, K., & Gilje, Ø. (2019). Multimodal composition and assessment: a sociocultural perspective. Assessment in Education: Principles, Policy & Practice, 26(1), 26–42. DOI: 10.1080/0969594X.2017.1297292</bibtext> </blist> <blist> <bibtext> Sindoni, M. G., Adami, E., Karatza, S., Marentzi, I., Moschini, I., Petroni, S., & Rocca, M. (2019). The Common Framework of Reference for Intercultural Digital Literacies. EU Made 4ll.</bibtext> </blist> <blist> <bibtext> Skulstad, A. S. (2009). The need for rethinking communicative competence. In R. J. Krumsvik (Ed.), Learning in the Network Society and the Digitized School (pp. 255–267). Nova Science Publishers.</bibtext> </blist> <blist> <bibtext> Skulstad, A. S. (2022). Theoretical perspectives on choice in multimodal text production and consequences for EAL task design. In S. Diamantopoulou & S. Ørevik (Eds.), Multimodality in English Language Learning (pp. 146–158). Routledge. DOI: 10.4324/9781003155300-11</bibtext> </blist> <blist> <bibtext> Tan, L., Zammit, K., D'warte, J., & Gearside, A. (2020). Assessing multimodal literacies in practice: a critical review of its implementations in educational settings. Language and Education, 34(2), 97–114. DOI: 10.1080/09500782.2019.1708926</bibtext> </blist> <blist> <bibtext> Towndrow, P. A., Nelson, M. E., & Yusuf, W. (2013). Squaring Literacy Assessment with Multimodal Design: An Analytic Case for Semiotic Awareness. Journal of Literacy Research, 45(4), 327–355. DOI: 10.1177/1086296X13504155</bibtext> </blist> <blist> <bibtext> Unsworth, L. (2001). Teaching multiliteracies across the curriculum:Changing contexts of texts and image in classroom practice. Open University Press.</bibtext> </blist> <blist> <bibtext> Van Leeuwen, T. (2017). Multimodal literacy. Metaphor, 4, 17–23.</bibtext> </blist> </ref> <ref id="AN0174849602-23"> <title> Footnotes </title> <blist> <bibtext> EAL students may additionally be drawn to sit an oral or written exam.</bibtext> </blist> <blist> <bibtext> All recorded data material was deleted after transcription.</bibtext> </blist> </ref> <aug> <p>By Sigrid Ørevik</p> <p>Reported by Author</p> </aug> <nolink nlid="nl1" bibid="bib31" firstref="ref2"></nolink> <nolink nlid="nl2" bibid="bib47" firstref="ref3"></nolink> <nolink nlid="nl3" bibid="bib49" firstref="ref4"></nolink> <nolink nlid="nl4" bibid="bib53" firstref="ref5"></nolink> <nolink nlid="nl5" bibid="bib32" firstref="ref6"></nolink> <nolink nlid="nl6" bibid="bib29" firstref="ref7"></nolink> <nolink nlid="nl7" bibid="bib63" firstref="ref8"></nolink> <nolink nlid="nl8" bibid="bib67" firstref="ref10"></nolink> <nolink nlid="nl9" bibid="bib18" firstref="ref12"></nolink> <nolink nlid="nl10" bibid="bib30" firstref="ref13"></nolink> <nolink nlid="nl11" bibid="bib58" firstref="ref14"></nolink> <nolink nlid="nl12" bibid="bib20" firstref="ref15"></nolink> <nolink nlid="nl13" bibid="bib22" firstref="ref16"></nolink> <nolink nlid="nl14" bibid="bib46" firstref="ref17"></nolink> <nolink nlid="nl15" bibid="bib41" firstref="ref19"></nolink> <nolink nlid="nl16" bibid="bib33" firstref="ref21"></nolink> <nolink nlid="nl17" bibid="bib48" firstref="ref22"></nolink> <nolink nlid="nl18" bibid="bib60" firstref="ref25"></nolink> <nolink nlid="nl19" bibid="bib28" firstref="ref26"></nolink> <nolink nlid="nl20" bibid="bib64" firstref="ref27"></nolink> <nolink nlid="nl21" bibid="bib65" firstref="ref31"></nolink> <nolink nlid="nl22" bibid="bib12" firstref="ref36"></nolink> <nolink nlid="nl23" bibid="bib19" firstref="ref37"></nolink> <nolink nlid="nl24" bibid="bib13" firstref="ref38"></nolink> <nolink nlid="nl25" bibid="bib14" firstref="ref40"></nolink> <nolink nlid="nl26" bibid="bib15" firstref="ref41"></nolink> <nolink nlid="nl27" bibid="bib11" firstref="ref42"></nolink> <nolink nlid="nl28" bibid="bib61" firstref="ref43"></nolink> <nolink nlid="nl29" bibid="bib23" firstref="ref44"></nolink> <nolink nlid="nl30" bibid="bib24" firstref="ref45"></nolink> <nolink nlid="nl31" bibid="bib39" firstref="ref46"></nolink> <nolink nlid="nl32" bibid="bib43" firstref="ref47"></nolink> <nolink nlid="nl33" bibid="bib52" firstref="ref49"></nolink> <nolink nlid="nl34" bibid="bib56" firstref="ref50"></nolink> <nolink nlid="nl35" bibid="bib66" firstref="ref51"></nolink> <nolink nlid="nl36" bibid="bib35" firstref="ref53"></nolink> <nolink nlid="nl37" bibid="bib36" firstref="ref56"></nolink> <nolink nlid="nl38" bibid="bib37" firstref="ref57"></nolink> <nolink nlid="nl39" bibid="bib59" firstref="ref59"></nolink> <nolink nlid="nl40" bibid="bib38" firstref="ref60"></nolink> <nolink nlid="nl41" bibid="bib34" firstref="ref62"></nolink> <nolink nlid="nl42" bibid="bib44" firstref="ref66"></nolink> <nolink nlid="nl43" bibid="bib42" firstref="ref67"></nolink> <nolink nlid="nl44" bibid="bib17" firstref="ref68"></nolink> <nolink nlid="nl45" bibid="bib21" firstref="ref72"></nolink> <nolink nlid="nl46" bibid="bib25" firstref="ref74"></nolink> <nolink nlid="nl47" bibid="bib27" firstref="ref75"></nolink> <nolink nlid="nl48" bibid="bib62" firstref="ref79"></nolink> <nolink nlid="nl49" bibid="bib26" firstref="ref80"></nolink> <nolink nlid="nl50" bibid="bib51" firstref="ref82"></nolink> <nolink nlid="nl51" bibid="bib50" firstref="ref83"></nolink> <nolink nlid="nl52" bibid="bib10" firstref="ref85"></nolink> <nolink nlid="nl53" bibid="bib16" firstref="ref87"></nolink> <nolink nlid="nl54" bibid="bib40" firstref="ref88"></nolink> <nolink nlid="nl55" bibid="bib54" firstref="ref89"></nolink> <nolink nlid="nl56" bibid="bib57" firstref="ref96"></nolink> <nolink nlid="nl57" bibid="bib45" firstref="ref100"></nolink> <nolink nlid="nl58" bibid="bib55" firstref="ref102"></nolink>
CustomLinks:
  – Url: https://eric.ed.gov/contentdelivery/servlet/ERICServlet?accno=EJ1397866
    Name: ERIC Full Text
    Category: fullText
    Text: Full Text from ERIC
Header DbId: eric
DbLabel: ERIC
An: EJ1397866
AccessLevel: 3
PubType: Academic Journal
PubTypeId: academicJournal
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: Assessing Students' Multimodal Texts in the Subject of English: Synthesising Peers' and Teachers' Recognition of Semiotic Work
– Name: Language
  Label: Language
  Group: Lang
  Data: English
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Ørevik%2C+Sigrid%22">Ørevik, Sigrid</searchLink> (ORCID <externalLink term="https://orcid.org/0000-0002-0812-4572">0000-0002-0812-4572</externalLink>)
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="SO" term="%22Designs+for+Learning%22"><i>Designs for Learning</i></searchLink>. 2023 15(1):44-57.
– Name: Avail
  Label: Availability
  Group: Avail
  Data: Stockholm University Press. Stockholm University Library, SE-106 91, Stockholm, Sweden. Web site: https://www.designsforlearning.nu
– Name: PeerReviewed
  Label: Peer Reviewed
  Group: SrcInfo
  Data: Y
– Name: Pages
  Label: Page Count
  Group: Src
  Data: 14
– Name: DatePubCY
  Label: Publication Date
  Group: Date
  Data: 2023
– Name: TypeDocument
  Label: Document Type
  Group: TypDoc
  Data: Journal Articles<br />Reports - Research
– Name: Audience
  Label: Education Level
  Group: Audnce
  Data: <searchLink fieldCode="EL" term="%22Secondary+Education%22">Secondary Education</searchLink>
– Name: Subject
  Label: Descriptors
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Semiotics%22">Semiotics</searchLink><br /><searchLink fieldCode="DE" term="%22Learning+Activities%22">Learning Activities</searchLink><br /><searchLink fieldCode="DE" term="%22Alignment+%28Education%29%22">Alignment (Education)</searchLink><br /><searchLink fieldCode="DE" term="%22English+%28Second+Language%29%22">English (Second Language)</searchLink><br /><searchLink fieldCode="DE" term="%22Second+Language+Learning%22">Second Language Learning</searchLink><br /><searchLink fieldCode="DE" term="%22Second+Language+Instruction%22">Second Language Instruction</searchLink><br /><searchLink fieldCode="DE" term="%22Persuasive+Discourse%22">Persuasive Discourse</searchLink><br /><searchLink fieldCode="DE" term="%22Writing+%28Composition%29%22">Writing (Composition)</searchLink><br /><searchLink fieldCode="DE" term="%22Secondary+School+Students%22">Secondary School Students</searchLink><br /><searchLink fieldCode="DE" term="%22Writing+Evaluation%22">Writing Evaluation</searchLink><br /><searchLink fieldCode="DE" term="%22Multiple+Literacies%22">Multiple Literacies</searchLink><br /><searchLink fieldCode="DE" term="%22Intervention%22">Intervention</searchLink><br /><searchLink fieldCode="DE" term="%22Peer+Evaluation%22">Peer Evaluation</searchLink><br /><searchLink fieldCode="DE" term="%22Language+Teachers%22">Language Teachers</searchLink><br /><searchLink fieldCode="DE" term="%22Researchers%22">Researchers</searchLink><br /><searchLink fieldCode="DE" term="%22Evaluation+Criteria%22">Evaluation Criteria</searchLink><br /><searchLink fieldCode="DE" term="%22Communicative+Competence+%28Languages%29%22">Communicative Competence (Languages)</searchLink><br /><searchLink fieldCode="DE" term="%22Evaluation+Methods%22">Evaluation Methods</searchLink><br /><searchLink fieldCode="DE" term="%22Teacher+Student+Relationship%22">Teacher Student Relationship</searchLink><br /><searchLink fieldCode="DE" term="%22Classroom+Research%22">Classroom Research</searchLink>
– Name: Subject
  Label: Geographic Terms
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Norway%22">Norway</searchLink>
– Name: ISSN
  Label: ISSN
  Group: ISSN
  Data: 2001-7480
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: While learning activities and text production in language subjects typically include multiple forms of multimodal expression, assessment in the subjects continues to a great extent to depend on students' written texts. As a contribution to an increasing call for alignment of curricular activities and assessment, this article explores an approach to assessment of upper secondary students' production of multimodal persuasive texts in the subject of English as an additional language (EAL). The article reports from a design-based study comprising two classroom interventions where assessment of students' multimodal texts was conducted separately by peer groups and the teacher and researcher in collaboration, applying assessment criteria informed by multimodal social semiotic theory and operationalisations of communicative competence. Comparing the results of peer and teacher assessment of students' multimodal persuasive texts, agreement was found relating to representational, interactional, and compositional aspects of the texts, whereas differences in views mostly concerned nuances in interpersonal aspects. Unpacking these nuances, the article concludes that peers' and teachers' assessments of multimodal texts complement each other in ways that can prompt fruitful discussions on meaning making in the light of context and social factors and thus contribute to heightened semiotic awareness and a broader recognition of the students' communicative competence in the subject.
– Name: AbstractInfo
  Label: Abstractor
  Group: Ab
  Data: As Provided
– Name: DateEntry
  Label: Entry Date
  Group: Date
  Data: 2023
– Name: AN
  Label: Accession Number
  Group: ID
  Data: EJ1397866
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=eric&AN=EJ1397866
RecordInfo BibRecord:
  BibEntity:
    Languages:
      – Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 14
        StartPage: 44
    Subjects:
      – SubjectFull: Semiotics
        Type: general
      – SubjectFull: Learning Activities
        Type: general
      – SubjectFull: Alignment (Education)
        Type: general
      – SubjectFull: English (Second Language)
        Type: general
      – SubjectFull: Second Language Learning
        Type: general
      – SubjectFull: Second Language Instruction
        Type: general
      – SubjectFull: Persuasive Discourse
        Type: general
      – SubjectFull: Writing (Composition)
        Type: general
      – SubjectFull: Secondary School Students
        Type: general
      – SubjectFull: Writing Evaluation
        Type: general
      – SubjectFull: Multiple Literacies
        Type: general
      – SubjectFull: Intervention
        Type: general
      – SubjectFull: Peer Evaluation
        Type: general
      – SubjectFull: Language Teachers
        Type: general
      – SubjectFull: Researchers
        Type: general
      – SubjectFull: Evaluation Criteria
        Type: general
      – SubjectFull: Communicative Competence (Languages)
        Type: general
      – SubjectFull: Evaluation Methods
        Type: general
      – SubjectFull: Teacher Student Relationship
        Type: general
      – SubjectFull: Classroom Research
        Type: general
      – SubjectFull: Norway
        Type: general
    Titles:
      – TitleFull: Assessing Students' Multimodal Texts in the Subject of English: Synthesising Peers' and Teachers' Recognition of Semiotic Work
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Ørevik, Sigrid
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 01
              Type: published
              Y: 2023
          Identifiers:
            – Type: issn-electronic
              Value: 2001-7480
          Numbering:
            – Type: volume
              Value: 15
            – Type: issue
              Value: 1
          Titles:
            – TitleFull: Designs for Learning
              Type: main
ResultId 1