REQUEST FOR PROPOSAL: Development of Written Tests of Knowledge in 9 Fields of Practice for Medical Laboratory Technologists (MLTs)
Objectives
1. Develop a comprehensive set of written questions and closed-ended responses that assess the declarative knowledge of MLTs based on the entry-level competency profile drafted by CAMLPR for each field of practice.
2. Ensure that the questions directly align with the competencies as outlined, whether they are common or specific to a particular field of practice.
3. Ensure questions are clear and reflect the current scope and demands of the MLT profession, apply to entry-level practice, and prioritize the safety and well-being of the public.
4. Ensure that the written assessment is psychometrically sound and unbiased.
Tasks
1.Develop Items for Written Assessment
a.Develop items in English and French in each field of practice according to the approved table of specifications. CAMLPR or its designate will review questions for clarity, fairness, and alignment with key concepts.
b.Revise questions based on the feedback from CAMLPR or its designate.
2.Develop a Scoring Guide
a.Develop an answer key
b.Describe, as applicable: point allocation, scoring algorithm, penalties
3.Beta Test the Assessment
a.Administer the assessment in English and French to a small group from the intended audience to identify any issues.
4.Undertake Psychometric Analysis
a.Conduct item-level and test-level psychometric analyses using both classical and item response theory (IRT) analyses
5.Conduct Standard Setting
a.Establish cut-off scores and grading criteria for the English and French assessments in consultation with CAMLPR or its designate.
6.Review and Refine Items
a.Based on psychometric analyses and standard setting, review and refine items in English and French as necessary.
7.Collaborate with Online Test Platform Developer
a.Collaborate with the developer of the online test administration and scoring platform to ensure seamless integration of the assessment content and the delivery system.
8.Project Management
a.Develop a detailed project workplan for approval by CAMLPR.
b.Maintain thorough documentation of the assessment development process, including item development, psychometric analyses, and item revisions.
c.Meet bi-weekly with the Flexible Pathways project management team as required to discuss progress.
The developer shall ensure that the test items developed and associated materials and documentation are kept confidential to maintain the integrity of the testing process. The developer should have measures in place to prevent unauthorized access or distribution of the questions.
