Apply Now

Certification Assessment Manager

Chicago, 142 E Ontario St, Chicago, Illinois, United States of America Req #67
Thursday, October 10, 2019
The mission of the American Osteopathic Association is to advance the distinctive philosophy and practice of Osteopathic Medicine.


As a member of the Certifying Board Services (CBS) department, the Certification Assessment Manager will work closely with the certifying boards and conjoint examination committees in all aspects of examination development. In addition, the Assessment Manager will work closely with the AVP of Certifying Board Services and the Director of Psychometrics and Assessment on activities associated with the certifying boards’ exams and other assessment initiatives.


A. Participates in the design, development and maintenance of assessments
B. Conducts item analyses, test analyses and develops technical reports as requested
C. Assists with reliability and validity studies to support the certifying boards
D. Assists with any and all AOA assessment initiatives including but not limited to basic and applied research in psychometrics and/or other medical certification related research for submission to educational conferences, scholarly journals, or other venues
E. Facilitates meetings with subject matter experts/examination committees
F. Collaborates with subject matter experts to improve current assessments
G. Provides training to subject matter experts
H. Manages components of Osteopathic Continuous Certification
I. Ensures the relevancy and currency of public information on the Board websites and testing bulletins
J. Project management as assigned for short and long term assessment development
K. Strategizes and proposes short and long term initiatives to improve test quality

Education:  Bachelor’s degree required, Master’s degree or relevant coursework (certificate work) in education, educational measurement, psychological measurement, evaluation, assessment, instructional design or a related field preferred.

Experience:  A minimum of three (3) years of experience in education, instructional design, test development, measurement, or high-stakes testing required.  Experience in the development of examinations for certification in the healthcare field is preferred.
Licensure or Certification:  N/A.

Systems:  Highly proficient with computer programs and applications including MS Office and contemporary item banking software. Knowledge and demonstrated use of and statistical software (e.g., SPSS, SAS, R, Winsteps or other IRT software) is desirable.

Communication: Ability to manage conflicting perspectives while communicating in a persuasive manner during group decision making. Excellent verbal and written communication skills are required with a demonstrated ability to simplify complex information and craft messages for a wide range of audiences.  

Special Skills and Attributes: Fundamental knowledge and track record of success with data management and validation knowledge of assessment standards, testing methodologies, are required. This position requires the ability to interact tactfully and in a sensitive manner with professionals on all levels within and outside the AOA.  Key competencies also include:

• Self-starter, organized, versatile, capable of performing work independently with minimal direction
• Excellent problem solving skills and ability to prioritize simultaneous, competing client activities
• Takes personal responsibility for service and quality of work delivered
• Excellent communication skills in both written and spoken English
• Strong interpersonal skills with the ability to integrate with various teams in CBS
• Detail oriented, with strong time and project management skills


This position may require remote work while traveling.  This work may include weekday and weekend travel.  Extended workday hours may be necessary around major meetings and other high-volume work periods.

Physical requirements include the ability to remain in a stationary position, the ability to move supplies and equipment up to 25 pounds and the ability to operate office equipment.


This position description reflects the assignment of essential functions.  It does not restrict additional tasks that may be assigned.  This job description is subject to change based on the needs of the organization.

AOA is an Equal Opportunity Employer who fully and actively supports equal access for all people regardless of Race, Color, Religion, Gender, Age, National Origin, Veteran Status, Disability, Genetic Information or Testing, Family and Medical Leave, Sexual Orientation and Gender Identity, expression or any other characteristic protected by applicable federal, state, or local laws.  We prohibit retaliation against individuals who bring forth any complaint, orally or in writing, to the employer or the government, or against any individuals who assist or practice in the investigation of any complaint, or otherwise oppose discrimination. We strongly encourage women, minorities, individuals with disabilities and veterans to apply to all of our job openings.

Other details

  • Pay Type Salary
  • Required Education Bachelor’s Degree
  • Chicago, 142 E Ontario St, Chicago, Illinois, United States of America