Data Scientist II - Office of Medical Education

Job Description :

The Data Scientist II reports to the Assistant Dean for Assessment, Evaluation, and Scholarship and provides support to the Medical Director of Anaclerio Learning and Assessment Center (ALAC) and the Assistant Dean of Medical Education Research, Scholarship & Faculty Development. This senior role leads the College of Medicine’s analysis and reporting of medical education assessments with a focus on Clinical Skills Examinations (CSEs).

The position applies advanced psychometric methodologies to enhance the validity of high-stakes evaluations. The position also spearheads educational research and scholarship initiatives, overseeing project design, regulatory compliance, data management, and dissemination. Through collaboration, the position supports faculty and trainee development and contributes to the advancement of medical education through rigorous analytics and scholarly output.

About This Ro le :

Psychometric Analysis

• Create psychometric analyses (CTT, IRT, factor, and generalizability / reliability studies) to evaluate and improve high-stakes assessments.
• Conduct inter-rater reliability analyses to improve validity and provide consistency by reducing score drift.
• Collaborate with the Medical Director of ALAC to design and facilitate standard-setting panels, justify defensible passing scores, and revise grading schemas and scoring models.
• Hypothesize ideas to strengthen the reliability, validity, and fairness of CSEs and related high-stakes clinical skills assessments in collaboration with the Medical Director.
• Present actionable psychometric reports to provide continuous quality improvement.

Programmatic Assessment

Research, Scholarship, and Project Management

We Offer Exceptional Benefits :

About the College of Medicine :

The University of Florida's College of Medicine is committed to advancing health through education, research, and patient care. With a focus on innovation and excellence, the college prepares future healthcare leaders through a rigorous curriculum that combines basic sciences with hands-on clinical experience. The College of Medicine emphasizes interdisciplinary collaboration and community engagement, fostering and environment where students, faculty, and staff work together to improve healthcare outcomes. The College is home to cutting-edge research initiatives and state-of-the-art facilities, providing an exceptional training ground for aspiring medical professionals. Dedicated to enhancing the health of diverse populations, the College of Medicine plays a pivotal role in shaping the future of medicine.

For more information about the College of Medicine and its programs, visit .

Expected Salary :

$, - $, annually; commensurate with education and experience.

Required Qualifications :

A Bachelor’s Degree in data science, statistics, bioinformatics, analytics, or similar field and three years of experience; Master’s Degree in data science, statistics, bioinformatics, analytics, or similar field and one year of experience; Doctoral Degree in data science, statistics, bioinformatics, analytics, or similar field.

Preferred :

The ideal candidate will possess :