Date : August 2020-December 2020
At this time, CMEC requires the services of a firm that will provide live remote proctoring services in both French and English for up to 2,400 test-takers across Canada, during the pilot administration of the Online Language Assessment Tool on XpressLab, in both French and English. The proctoring services provided by the Proponent are essential to ensuring the success of the pilot, which is to say ensuring that the test is valid, reliable, fair, and consistent. The Proponent will also work with LCWG and other consultants involved in the project to define and address issues relating to the administration of the test.
Please note that 2,400 test-takers are the maximum number of test-takers identified; there is a possibility to have fewer test-takers take the test.
The Online Language Assessment Tool test consists of four one-hour computer-based modules (writing, speaking, reading, listening) with up to a 30-minute break between modules. The tool was commissioned by RTCC and is powered by XpressLab.
The Proponent will have to provide live proctoring services in French and in English during the full duration of the test, i.e., four to six hours. Those services must include:
- exam launch;
- identity verification;
- environment security scans to prevent unpermitted resources;
- live surveillance and monitoring during the full length of the test and intervention, if necessary;
- behaviour analysis.
It is important to note that test-takers are allowed breaks of up to 30 minutes between modules, which means that the identity verification and the environment scan might have to be done several times during the test.
As part of the Project, the Proponent must also ensure testing fairness, consistency, and security, in order to maintain the test’s integrity and validity:
- It will be crucial for the Proponent to ensure test security using live remote proctoring services. Even though the risk of cheating is low because of the low stakes of the pilot test, cheating and harvesting of test items are still identified risks. The Proponent will have to ensure that adequate measures are taken to mitigate those risks.
- Fairness and consistency of the pilot-test administration is also vital for the validation of the pilot. The Proponent must ensure technical support for up to 2,400 test-takers in French and in English, before and during the administration of the pilot test.
The Proponent will also have to work with Wired Solutions (the developer of the XpressLab platform) to ensure that the services provided are compatible with the platform, and in particular with the speaking module, during which test-takers will record their responses, and in the listening module where the test takers listen to pre-recorded stimuli and respond.
The Proponent is expected to have a robust REST-based API, to ensure a smooth integration with XpressLab.
The Proponent must ensure user privacy and data security and will have to delete test-taker any data the proponent has obtained from all aspects of the test proctoring and administration within 45 days of the test administration
The Proponent will enter into Agreement with CCMEC and will be required to work closely with third parties hired by CCMEC outside the scope of the current RFP to ensure the completion of specific Project work. This includes collaboration with:
- the lead consultant for the Project, who will coordinate the work with all the stakeholders for the language proficiency assessment area of work;
- an external IT firm responsible for the RTCC Online Language Assessment Tool (XpressLab). The IT firm will assist with the administration of the online test and with the integration of the remote live proctoring solution.
