Module 1:
Objectives:
- Discuss and apply best practices in handling unexpected situations that may arise during the exam administration, as well as equality, diversity and inclusion in EXAVER exams.
- Reflect on examiners’ profile, knowledge, and skills, identifying ethical and professional conduct, and responsibilities associated with being examiners.
- Engage in discussions about the legal considerations surrounding EXAVER proficiency exams, including exam security, terms and conditions, and data protection.
Rationale
The inclusion of these seven topics in the EXAVER examiners’ refresher course is fundamental to maintaining the validity, fairness, and social relevance of the examination process. Continuous professional development ensures that examiners’ practices align with standards of quality, consistency, and ethical integrity, all of which directly influence the reliability of test outcomes and the social impact of assessment decisions in the EXAVER proficiency tests.
Developing and updating examiners’ knowledge and skills sustains the technical quality of the testing process. A clear understanding of test procedures, rating scales, and test constructs ensures consistent and evidence-based assessment decisions in the speaking test, thus supporting the reliability and fairness of the examination system. The emphasis on ethical conduct and the responsibilities of examiners reinforces the central role of integrity, impartiality, and professionalism in safeguarding test validity. Examiners’ awareness of their ethical obligations ensures that candidates are treated fairly and respectfully, minimizing bias and reinforcing the credibility of the assessment results. Focusing on real-world scenarios and solutions enables examiners to engage with authentic situations that may arise before, during, or after test administration. This reflective practice supports examiners in applying assessment principles consistently, ensuring that judgments remain valid and grounded in EXAVER’s rating criteria. It also encourages professional confidence in resolving procedural or ethical dilemmas appropriately. Integrating Equality, Diversity and Inclusion (EDI) principles highlights EXAVER’s commitment to providing equitable assessment opportunities for all candidates. Promoting awareness of diversity, cultural sensitivity, and accessibility helps examiners recognize and prevent potential bias, ensuring that each candidate’s performance is judged solely on their English proficiency and not influenced by external factors. An understanding of the terms and conditions governing the EXAVER examination further ensures that examiners are aware of their rights, roles, and obligations. These conditions serve as a binding framework that promotes procedural consistency, ethical accountability, and legal protection for both the institution and its personnel. Training in data protection underscores the examiners’ responsibility to safeguard candidate information in accordance with institutional policies and legal requirements. Responsible handling of personal data reinforces transparency and strengthens public confidence in the EXAVER program as a socially accountable and trustworthy assessment system. Finally, attention to exam security and confidentiality is vital to protecting the integrity of the testing process. By handling materials responsibly and maintaining strict confidentiality, examiners uphold institutional trust and ensure that test results reflect genuine performance rather than procedural irregularities. Together, these topics contribute to a coherent framework that sustains EXAVER’s mission to deliver valid, fair, and socially responsible English proficiency assessments, ensuring that every examiner’s actions reflect the professionalism and integrity that the program represents.
1.1 EXAVER examiners’ knowledge, and skills
Based on your experience as an examiner, what words go in each space? Complete the text with words from the box.
Read the definition of examiner commitment.
Commitment refers to the willingness and determination to dedicate time, energy, and loyalty to a purpose, relationship, or goal, as described by both the Cambridge and Merriam-Webster dictionaries.
Now, in the context of language and proficiency testing, the term examiner commitment refers to an examiner’s dedication to the integrity, fairness, and consistency of the assessment process. More than following procedures, it reflects a professional and ethical stance towards making sure that assessment outcomes are valid representations of candidates’ abilities (Davies, 2008; Fulcher, 2010). Examiner commitment derives from a much broader concept of professionalism in language testing (Davies, 2008). Here, examiners are seen as custodians of fairness and reliability. Thus, commitment implies a sustained responsibility to uphold assessment standards, adhere to rating scales, and engage actively in continuous professional development (Taylor, 2013).
Here’s a list of how commitment translates into actions carried out by the examiner. From the list given, rank from the most important (1) to the least important one (5) based on your experience.
1.2 Examiners ethical conduct and responsibilities
Objective
To develop examiners’ understanding of professional ethics and their role in ensuring fairness, integrity, and respect during English proficiency assessments—particularly in the speaking test.
Read the text on professional ethics below and use the information to participate in the next forum.
Professional ethics in language testing refers to the principles and standards guiding examiners to act fairly, consistently, respectfully, and responsibly toward all candidates. In essence, ethical examiners ensure that every decision is made on the basis of evidence and principle, never on personal preference or bias. According to experts:
1. Ethical testing ensures test fairness—equal opportunity for all candidates to demonstrate their ability. Bachman & Palmer (1996)
2. Ethics are part of the Test Fairness Framework, encompassing validity, access, bias, and social consequences. Kunnan (2000)
3. Ethical testers act with responsibility and care, aware of the social impact of their decisions. Davies (2008)
4. Professional integrity requires accountability and respect for candidates and procedures. Taylor (2013)
Why does ethics matter?
- Ensure valid and defensible results that accurately reflect candidates’ language ability.
- Protect institutional credibility and test integrity.
- Safeguard candidates’ rights and dignity.
- Promote trust between candidates, institutions, and the public.
Six Key Ethical Principles for Examiners
Let’s focus on six ethical principles for examiners’ work: fairness, impartiality, consistency, confidentiality, respect and integrity. The table below lists on the first column, the key ethical principle followed by their descriptions. A third column provides examiners examples to illustrate each principle.
| Principle | Description | Examiner Example |
|---|---|---|
| Fairness | Equal and unbiased treatment for all candidates | Use the same tone, instructions, and time limits for everyone. |
| Impartiality | Judging only linguistic performance, not personal traits | Avoid comments on accent, gender, or cultural expression. |
| Consistency | Applying the rubric and procedures uniformly | Use the official rating scale and avoid subjective impressions. |
| Confidentiality | Protecting all personal data and exam content | Do not share candidate scores or discuss performances with others. |
| Respect | Maintaining professionalism and empathy during testing | Make candidates feel comfortable but not advantaged. |
| Integrity | Acting transparently and reporting irregularities | Inform coordinators of any suspected misconduct or bias. |
Forum 1: Go to the Foros section and clic in Forum1. Read the instructions to participate in the discussion.
1.3 Real-world Scenarios and Solutions
Rationale
Unforeseen situations may arise during the administration of a proficiency test that require immediate and appropriate action from examiners. The Q&A for Contingencies section, known as the “What should I do if document” aims to provide clear guidance for handling such events consistently and fairly, ensuring that the validity and reliability of test results are maintained. According to Bachman and Palmer (1996), test reliability depends not only on well-designed instruments but also on the standardized administration procedures followed by examiners. By the same token, Weir (2005) emphasizes that consistent examiner behavior during unexpected circumstances supports test fairness and construct validity. Providing examiners with contingency guidance minimizes subjective decision-making and promotes procedural transparency (Fulcher, 2010).
By anticipating and clarifying responses to potential disruptions—such as technical issues, candidate misconduct, or environmental disturbances—this section helps safeguard test integrity and uphold ethical assessment standards (Davies, 2008). Ultimately, examiner preparedness strengthens confidence in the testing process and in the accuracy of the results produced.
Objective
Discuss and apply best practices in handling unexpected situations that may arise during the exam administration, as well as equality, diversity and inclusion in EXAVER exams.
About the What should I do if (WSIDI) document. Read the statements and choose True or False.
Read the justification for EXAVER to include a list of conditions to follow in the exam administration and answer the question below.
As part of the standardization procedures, EXAVER supports the validity and reliability of the exam through a list of materials and protocols. By ensuring consistent treatment of all candidates in EXAVER, the What should I do document upholds the principles of fairness and equity by providing clear rules for security and irregularities that might possibly arise during the test administration. It gives the testing organization the legal and procedural defensibility necessary to maintain the integrity and public trust in its high-stakes credential.
Match the WSIDI questions with the section in the document where you can find the answer. You can use the sections more than once.
Listen to the answers and check if your answers are right.
Go to the Foros section and clic in Forum2. Read the instructions to participate in the discussion.
1.4 Equality, Diversity and Inclusion (EDI)
How many words related to Equality, Diversity and Inclusion can you find in the word cloud?
Watch the video “Inclusion of people with disabilities” which lists some ways to help people with disabilities.
According to the video, there are actions to provide assistance to people with disabilities. Does your workplace offer assistance to people with disabilities? Check the boxes with Yes or No.
Development of Reasonable Adjustments in the EXAVER Proficiency Exams
The EXAVER Proficiency Exams began implementing reasonable adjustments in response to the university’s commitment to human rights, equity, and inclusive education outlined in the 2021 Institutional Development Plan. A 2022 request from a visually impaired candidate highlighted the absence of established procedures for accommodating test-takers with disabilities, revealing a gap in accessibility practices. Consequently, EXAVER developed an initiative to provide reasonable adjustments—defined as necessary and appropriate modifications that do not impose disproportionate burdens—to ensure equal conditions for candidates with sensory or physical impairments.
EXAVER offers a list of possible adjustments for candidates with four types of disabilities:
Physical Disabilities
- Wheelchair access
- Extended test time
- Use of personal computer equipment
- Individual testing rooms
Hearing impairment
- Repetition of the audio
- Extended time for Paper the Listening section
- Use of personal headphones
- Individual testing rooms
Visual impairment
- Larger text font
- Use of personal computer equipment
- Adapted oral exams (without images)
- Individual testing rooms
Cognitive Disabilities
- Reading the exam aloud
- Extended test time
- Individual testing rooms
How important is it for examiners to be informed of Equality, Diversity and Inclusion in assessment? The following sentences are part of an explanation of its importance. Put them in order. Number 1 is the example.
1.5 Terms and Conditions
Read the information about Terms and Conditions.
In the context of language proficiency testing, terms and conditions (T&Cs) refer to the formal contractual and regulatory framework governing how a test is offered, administered, and used. They outline the rights, responsibilities, and obligations of all parties involved — including the testing institution, examiners, and candidates. In essence, they form the ethical and legal foundation for the fair, transparent, and secure delivery of an assessment (Davies, 2008; O’Sullivan & Weir, 2011). The typical terms and conditions in a standardized proficiency exam include the following:
The Impact of Terms and Conditions
Here are some examples of scenarios where the Terms and Conditions are at play. Each is provided with a potential impact.
| Scenario | T&Cs at play | Potential Impact |
|---|---|---|
| A candidate shares test content online. | Breach of confidentiality and intellectual property clauses. | Cancellation of results; possible legal action. |
| An examiner discloses candidate scores to a third party. | Violation of data protection and confidentiality clauses. | Dismissal; institutional reputation damage. |
Based on the information afore mentioned Go to the T&Cs of the EXAVER webpage and skim it. Then, answer the following questions:
1.6 Data protection
Rationale
Data protection refers to the ethical and legal management of personal information to prevent unauthorized access, misuse, or disclosure (Bennett & Raab, 2006). In higher education, particularly in the administration of standardized proficiency exams, data protection ensures the confidentiality and integrity of candidates’ identities, scores, and records. Compliance with international and national frameworks such as the General Data Protection Regulation (GDPR) in Europe (Kitchin, 2014) and Mexico’s Ley Federal de Protección de Datos Personales en Posesión de los Particulares (IFAI, 2010) is essential. These frameworks establish institutional accountability for safeguarding personal data through transparent and lawful practices. Breaches of these regulations may result in legal sanctions, financial penalties, and reputational harm (Gray & Rumpe, 2015). Consequently, institutions must adopt robust data management policies consistent with national guidelines and the Lineamientos del Instituto Nacional de Transparencia, Acceso a la Información y Protección de Datos Personales (INAI, 2017).
Thus, within assessment, maintaining strict data protection is essential to ensure fairness, confidentiality, and trust in the EXAVER evaluation process. The following scenarios illustrate common problems caused by poor or missing data protection practices and outline the correct preventive actions.
Read some examples of common problems caused by poor or missing data protection practices.
Conclusion:
Proper data protection ensures that all assessment procedures comply with ethical
and legal standards, preserving test validity, fairness, and institutional credibility
(Fulcher, 2010; Weir, 2005). Every examiner shares responsibility for protecting
candidates’ personal information and upholding the integrity of the EXAVER testing
process.
1.7 Exam Security and Confidentiality
Objectives:
- Define exam security and confidentiality within standardized English proficiency testing.
- Identify common breaches that compromise exam integrity.
- Apply correct procedures before, during, and after the exam.
- Demonstrate ethical and professional behavior aligned with institutional and international standards (GDPR, INAI, among others).
- Reflect on their personal accountability in maintaining fairness and trust in the testing process.
Read about Exam Security and Confidentiality and answer the activities that follow.
Exam security and confidentiality are essential to the validity, reliability, and fairness of all standardized assessments. As Davies (2008) notes, security breaches—whether intentional or accidental—can undermine the credibility of test results and erode public trust. Similarly, Bachman & Palmer (1996) emphasize that maintaining security is part of ensuring the usefulness and ethical soundness of tests. The main principle in this respect is that test integrity results in examiners’ control of all materials and security protocols. The smallest lapse can compromise the entire exam administration.
Exam Security
All measures taken to prevent unauthorized access, sharing, or misuse of test materials before, during, and after administration.
Exam Confidentiality
The ethical and legal duty to protect all information related to candidates.
Select Exam Security, or Exam Confidentiality (EC) in each of the seven actions.
Breaches of confidentiality include discussing candidate performance, disclosing test questions, or sharing recordings without authorization.
Common mistakes and correct procedures
| Exam Stage | Common Failure | Correct Procedure | Why It Matters |
|---|---|---|---|
| Before the Exam | Leaving test papers visible or reviewing materials early. | Keep all materials sealed and locked until authorized opening. | Prevents content leaks and maintains fairness. |
| During the Exam | Allowing unauthorized devices or candidates to hear others' tasks. | Monitor the test room carefully; follow entry and timing protocols. | Ensures equal testing conditions. |
| After the Exam | Discussing questions or performances with colleagues. | Refrain from sharing any exam content; report only via official channels. | Protects confidentiality and institutional trust. |
| Data Management | Saving recordings on personal devices or sending files by personal email. | follow use and delivery of all materials accordingly. | Prevents data breaches. |
| Communication | Informing candidates of scores before official release. | Direct all inquiries to official channels. | Maintains transparency and procedural integrity. |
Ethical Foundations
Ethical testing practices require that examiners:
- Act impartially judge based on evidence, not personal preference.
- Protect privacy treat all test data as confidential.
- Respect procedures follow standardized administration protocols.
- Report irregularities: inform center coordinators immediately if breaches occur.
Go to the Foros section and click in Forum 3. Read the instructions to participate in the discussion.
Conclusion
- Exam security ensures test content protection and standardized administration.
- Confidentiality ensures data privacy and ethical professionalism.
- Every examiner must be vigilant, impartial, and accountable.
- Ethical testing protects both the institution and the candidate.
“The responsibility of the examiner begins before the test and ends only when every piece of test data has been secured.” — Adapted from Fulcher & Davidson (2007)
Evaluate your own practices: