Science Test Development Specialist at American Institutes for Research

The Assessment Program at AIR is a well regarded organization that is growing rapidly. We focus on providing our clients with customized assessments that not only measure student achievement against state standards, but also provide meaningful score reports that can help students, parents and educators address any areas of student weakness. Our environment is fast-paced and requires people at all levels who are willing to roll up their sleeves to get the work done on time while maintaining high quality.

We are currently seeking Science Test Development Specialists to join our Assessment Team in Washington, DC. This team is responsible for the creation of all Science test materials, products, and services for the Assessment Program.


Responsibilities:
The Science Test Development Specialist will work with the Science Content Team to develop online and paper-pencil state assessment programs. The Science Test Development Specialist is the primary representative to the client on matters specific to science item and test form development. Duties include:

• Being available and responsive to client needs;
• Managing internal and external item writing and reviewing to meet internal and external deadlines;
• Leading client committee meetings in which stakeholders review the content and grade-appropriateness of test items;
• Leading constructed-response scoring activities to identify exemplar student responses, monitor scorer training, and audit scoring sessions;
• Writing, revising, and reviewing test items (questions) based on scientific content correctness and appropriateness, fairness, and project specifications;
• Helping develop new machine-scored item types;
• Developing ways to use the new item types to assess aspects of science content not amenable to paper-pencil assessment;
• Resolving client feedback on test items and test forms;
• Assembling and reviewing field test and operational test forms, working with technical staff to meet content and statistical specifications;
• Designing, and resolving client feedback on test specification documents, style guides, test blueprints, and specific student aids;
• Supporting technical staff at client committee meetings in which stakeholders review statistical data of administered test forms;
• Managing test item pools;
• Working collaboratively with the Science Content Team across content areas and projects while meeting rolling deadlines.


Qualifications:
Excellent science subject area knowledge, as evidenced by a Ph.D. in a science discipline or science education, or an equivalent combination of education and experience, is required. Original scientific research experience, as evidenced by published conference abstracts and articles in the technical literature, is desirable but not required. Experience in assessment or classroom instruction is desirable but not required. Some experience writing computer code is desirable. Spanish language ability is desirable. Experience working with alternative learners is desirable.

Other requirements are:
• Excellent written communications ability
• Excellent attention to detail
• Ability to deal diplomatically with clients
• Ability and willingness to follow test/item security protocols
• Ability to prioritize tasks and meet tight deadlines
• Ability and willingness to run a project while supporting others’ projects

Required travel for this position ranges from 2 weeks to 6 weeks per year. Candidates should be able to travel as required for 1 to 2 weeks at a time, especially in the summe