Epicareer Might not Working Properly
Learn More

Director, Exam Integrity

Salary undisclosed

Apply on


Original
Simplified
Position Overview

The Director of Exam Integrity plays a critical role in ensuring the security and validity of NBME's exam programs. Leveraging expertise in assessment, analytics, legal, and investigatory processes, this role leads exam security initiatives designed to protect NBME's exam products. Reporting directly to the Vice President of Operations Management, the Director collaborates with senior leadership and stakeholders to develop and implement robust security policies. This position requires strong decision-making skills, leadership, and the ability to operate independently while managing a team responsible for investigating, preventing, and mitigating exam security risks.

This role is primarily remote, requiring minimal onsite attendance. While this role can be designated as remote, you are offered the flexibility to select if you prefer to work primarily remotely, hybrid, or onsite. We're open to considering candidates within 50 miles of our office location in Philadelphia, PA.

Diversity, Equity, and Inclusion Statement

At NBME, we continue to innovate and improve how we fulfill the evolving needs of the healthcare community. This commitment starts and ends with the people at NBME. By recruiting and empowering talented individuals from various disciplines and backgrounds, which includes professionals with diverse life experiences, abilities, and perspectives, NBME can take a well-formed, robust approach to advancing medical education and assessment for years to come. We also continue to focus on ensuring that our DEI work is impactful and ingrained in everything we do, including with our staff, workplace culture, products and services, the Philadelphia community, and the broader medical education landscape.

Responsibilities

  • Leadership & Strategy: Provide thought leadership on exam security, serving as a change agent and advocate for the Exam Integrity office. Collaborate with exam program leaders and other stakeholders to identify security risks and implement effective strategies that align with the stakes of each exam.
  • Team Management: Lead a team of exam integrity professionals, offering guidance and support while fostering a culture of continuous improvement. Conduct performance reviews, provide mentorship, and ensure the team stays current on industry best practices.
  • Security Investigations: Direct and oversee investigations of security incidents, utilizing resources efficiently to mitigate risks. Work closely with legal and other departments to resolve incidents and mitigate the likelihood of future reoccurrence.
  • Stakeholder Collaboration: Build and maintain strong relationships with key stakeholders, including program management, content development, IT, legal, and psychometrics teams. Ensure cross-departmental alignment on security protocols and foster open communication.
  • Policy Development: Develop and implement exam security operational policies and procedures that encompass prevention, deterrence, detection, and investigation. Ensure these policies are consistently applied across all exam programs.
  • Industry Engagement: Represent NBME at relevant industry conferences and events, staying informed on the latest trends and challenges in exam security. Apply these insights to continually enhance NBME's security posture.

Qualifications

Skills and Abilities

  • Assessment Expertise: Understands core assessment processes (content development, psychometrics, exam delivery) and ensures alignment with security protocols.
  • Investigative & Legal Proficiency: Strong investigatory skills, including gathering and analyzing evidence, conducting detailed investigations, and compiling comprehensive reports. Experience working with legal teams and senior leadership to address security incidents.
  • Data Analysis & Technical Skills: Proficiency in data analysis tools and methodologies to detect anomalies and security risks. Strong knowledge of psychometrics and exam validation processes.
  • Risk Management: Adept at identifying, assessing, and mitigating exam security risks to protect the integrity and validity of high-stakes exams.
  • Communication & Leadership: Ability to communicate complex security issues clearly to senior leaders, stakeholders, and team members. Demonstrated leadership skills, including team management, delegation, and performance feedback.
  • Strategic Thinking & problem solving: Ability to make informed decisions in high pressure situations, balancing immediate security needs with long-term strategic goals.

Experience

  • Minimum of 8+ years of experience in exam security, investigations, or a related field, with demonstrated success in leading security initiatives and managing complex issues.
  • Proven ability to lead cross-functional teams and collaborate with senior leaders.
  • Experience with legal and technical processes related to risk management and data analysis, particularly in an exam or assessment context.

Education

  • Bachelor's degree in a related field required; advanced degree (e.g., Master's or JD) preferred.

About NBME

NBME offers a versatile selection of high-quality assessments and educational services for students, professionals, educators, regulators and institutions dedicated to the evolving needs of medical education and health care. To ensure our assessments meet the highest standards of quality, stay relevant and align to the current curriculum in medical schools and training programs, we rely on a wide network of collaborators. These include the volunteers who help develop our exam questions, the committees and panels who represent various groups within the medical education community, external researchers and health profession organizations.

We are committed to meeting the needs of educators and learners globally with assessment products and expert services such as NBME Subject Examinations, Customized Assessment Services, Self-Assessments, the International Foundations of Medicine Program and Item Writing Workshops. Together with the Federation of State Medical Boards, NBME develops and manages the United States Medical Licensing Examination, which measures the ability to apply knowledge and skills that form the basis of safe and effective patient care. Our Competency-based Assessment unit is focused on new methods as well as the optimization of assessment in the workplace and education.

As a result of leadership in ongoing research, innovative measurement practices and the exploration of forward-thinking assessment modalities and improvements, NBME advances assessment science. Our grant and funding opportunities further support this dedication to medical education and assessment science. We help develop the next generation of assessment professionals through our Summer Psychometric Internship Program. Through the Stemmler Fund, Strategic Educators Enhancement Fund and Latin America Grants Program, researchers and educators can continue to improve the assessment of health care professionals around the world.

NBME views diversity, equity and inclusion (DEI) as foundational and enduring to our strategy and vision. We continue to focus on ensuring that our DEI work is impactful and ingrained in everything we do, including with our staff, culture, products and services, the Philadelphia community and the broader medical education landscape. Our commitment manifests in our hiring and staff development, recruitment for committees, grants programs, design and review of our assessments, and involvement in our local and national communities.

Learn more about NBME at NBME.org.

The NBME offers competitive salaries, excellent benefits, and a rewarding work environment. Excellent Benefits include: Healthcare, Dental, Prescription, and Vision plans; 401(k) w/match, Tuition Reimbursement Plan, Commuter Benefit: Public Transit or Parking options. Remote Friendly Workplace.

Compensation we are offering for this position ranges $172,000 to $215,000/yr. Please note that the offered rate for this position typically aligns with the minimum to midrange of this grade, but it can vary based on the successful candidate's qualifications and experience, department budget, and an internal equity review.

NBME is an equal-opportunity employer as defined by the EEOC.

#Director

Job Posted by ApplicantPro

Position Overview

The Director of Exam Integrity plays a critical role in ensuring the security and validity of NBME's exam programs. Leveraging expertise in assessment, analytics, legal, and investigatory processes, this role leads exam security initiatives designed to protect NBME's exam products. Reporting directly to the Vice President of Operations Management, the Director collaborates with senior leadership and stakeholders to develop and implement robust security policies. This position requires strong decision-making skills, leadership, and the ability to operate independently while managing a team responsible for investigating, preventing, and mitigating exam security risks.

This role is primarily remote, requiring minimal onsite attendance. While this role can be designated as remote, you are offered the flexibility to select if you prefer to work primarily remotely, hybrid, or onsite. We're open to considering candidates within 50 miles of our office location in Philadelphia, PA.

Diversity, Equity, and Inclusion Statement

At NBME, we continue to innovate and improve how we fulfill the evolving needs of the healthcare community. This commitment starts and ends with the people at NBME. By recruiting and empowering talented individuals from various disciplines and backgrounds, which includes professionals with diverse life experiences, abilities, and perspectives, NBME can take a well-formed, robust approach to advancing medical education and assessment for years to come. We also continue to focus on ensuring that our DEI work is impactful and ingrained in everything we do, including with our staff, workplace culture, products and services, the Philadelphia community, and the broader medical education landscape.

Responsibilities

  • Leadership & Strategy: Provide thought leadership on exam security, serving as a change agent and advocate for the Exam Integrity office. Collaborate with exam program leaders and other stakeholders to identify security risks and implement effective strategies that align with the stakes of each exam.
  • Team Management: Lead a team of exam integrity professionals, offering guidance and support while fostering a culture of continuous improvement. Conduct performance reviews, provide mentorship, and ensure the team stays current on industry best practices.
  • Security Investigations: Direct and oversee investigations of security incidents, utilizing resources efficiently to mitigate risks. Work closely with legal and other departments to resolve incidents and mitigate the likelihood of future reoccurrence.
  • Stakeholder Collaboration: Build and maintain strong relationships with key stakeholders, including program management, content development, IT, legal, and psychometrics teams. Ensure cross-departmental alignment on security protocols and foster open communication.
  • Policy Development: Develop and implement exam security operational policies and procedures that encompass prevention, deterrence, detection, and investigation. Ensure these policies are consistently applied across all exam programs.
  • Industry Engagement: Represent NBME at relevant industry conferences and events, staying informed on the latest trends and challenges in exam security. Apply these insights to continually enhance NBME's security posture.

Qualifications

Skills and Abilities

  • Assessment Expertise: Understands core assessment processes (content development, psychometrics, exam delivery) and ensures alignment with security protocols.
  • Investigative & Legal Proficiency: Strong investigatory skills, including gathering and analyzing evidence, conducting detailed investigations, and compiling comprehensive reports. Experience working with legal teams and senior leadership to address security incidents.
  • Data Analysis & Technical Skills: Proficiency in data analysis tools and methodologies to detect anomalies and security risks. Strong knowledge of psychometrics and exam validation processes.
  • Risk Management: Adept at identifying, assessing, and mitigating exam security risks to protect the integrity and validity of high-stakes exams.
  • Communication & Leadership: Ability to communicate complex security issues clearly to senior leaders, stakeholders, and team members. Demonstrated leadership skills, including team management, delegation, and performance feedback.
  • Strategic Thinking & problem solving: Ability to make informed decisions in high pressure situations, balancing immediate security needs with long-term strategic goals.

Experience

  • Minimum of 8+ years of experience in exam security, investigations, or a related field, with demonstrated success in leading security initiatives and managing complex issues.
  • Proven ability to lead cross-functional teams and collaborate with senior leaders.
  • Experience with legal and technical processes related to risk management and data analysis, particularly in an exam or assessment context.

Education

  • Bachelor's degree in a related field required; advanced degree (e.g., Master's or JD) preferred.

About NBME

NBME offers a versatile selection of high-quality assessments and educational services for students, professionals, educators, regulators and institutions dedicated to the evolving needs of medical education and health care. To ensure our assessments meet the highest standards of quality, stay relevant and align to the current curriculum in medical schools and training programs, we rely on a wide network of collaborators. These include the volunteers who help develop our exam questions, the committees and panels who represent various groups within the medical education community, external researchers and health profession organizations.

We are committed to meeting the needs of educators and learners globally with assessment products and expert services such as NBME® Subject Examinations, Customized Assessment Services, Self-Assessments, the International Foundations of Medicine® Program and Item Writing Workshops. Together with the Federation of State Medical Boards, NBME develops and manages the United States Medical Licensing Examination®, which measures the ability to apply knowledge and skills that form the basis of safe and effective patient care. Our Competency-based Assessment unit is focused on new methods as well as the optimization of assessment in the workplace and education.

As a result of leadership in ongoing research, innovative measurement practices and the exploration of forward-thinking assessment modalities and improvements, NBME advances assessment science. Our grant and funding opportunities further support this dedication to medical education and assessment science. We help develop the next generation of assessment professionals through our Summer Psychometric Internship Program. Through the Stemmler Fund, Strategic Educators Enhancement Fund and Latin America Grants Program, researchers and educators can continue to improve the assessment of health care professionals around the world.

NBME views diversity, equity and inclusion (DEI) as foundational and enduring to our strategy and vision. We continue to focus on ensuring that our DEI work is impactful and ingrained in everything we do, including with our staff, culture, products and services, the Philadelphia community and the broader medical education landscape. Our commitment manifests in our hiring and staff development, recruitment for committees, grants programs, design and review of our assessments, and involvement in our local and national communities.

Learn more about NBME at NBME.org.

The NBME offers competitive salaries, excellent benefits, and a rewarding work environment. Excellent Benefits include: Healthcare, Dental, Prescription, and Vision plans; 401(k) w/match, Tuition Reimbursement Plan, Commuter Benefit: Public Transit or Parking options. Remote Friendly Workplace.

Compensation we are offering for this position ranges $172,000 to $215,000/yr. Please note that the offered rate for this position typically aligns with the minimum to midrange of this grade, but it can vary based on the successful candidate's qualifications and experience, department budget, and an internal equity review.

NBME is an equal-opportunity employer as defined by the EEOC.

#Director

Job Posted by ApplicantPro