COMPUTER SCIENTIST (AI TEST AND EVALUATION)

Clarification from the agency

This announcement is open to All U.S. Citizens, and is being filled under the Direct Hire Authority (DHA) for Certain Personnel of the Department of Defense. Appointment of Military Spouses (5 CFR 315.612)(NonComp Mil Sp), and NonComp Civilian Sp, PPP DoD Retained Grade Preference, PPP DoD Military Reserve (MR) and National Guard (NG) Technician Eligible and PPP DoD MR and NG Preference Eligible Tech Receiving Disability Retirement may also apply.

As a COMPUTER SCIENTIST (AI TEST AND EVALUATION) at the GS-1550-13 some of your typical work assignments may include:

• Plans and executes comprehensive test and evaluation (T&E) of AI/ML systems by developing test plans, defining quantitative and qualitative metrics (e.g., sensitivity, specificity, confidence levels, generalizability), conducting hypothesis testing, and performing verification and validation activities to ensure AI solutions meet performance specifications and requirements.
• Tests AI/ML systems for security, robustness, trustworthiness, and reliability by conducting adversarial testing in operationally realistic environments, performing risk assessments, evaluating functionality and compatibility across diverse scenarios, and building assurance cases that demonstrate the level of confidence in AI system capabilities.
• Develops and executes code-level testing and validation procedures for machine learning models, including automating testing processes, evaluating user experience and human-computer interaction factors, and recording and managing all test data with accuracy and integrity throughout the testing life-cycle.
• Prepares detailed T&E reports and communicates findings, risks, and recommendations to technical and non-technical audiences, including senior leadership, by translating complex test data and evaluative conclusions into clear, actionable courses of action that inform decision-making across the organization.
• Assesses AI systems for bias, security vulnerabilities, and high-impact risks by reviewing AI architectures, analyzing training data sets and system outputs for unintended bias, identifying failure modes and low-probability risks, and developing risk management plans and corrective actions to ensure ethical and trustworthy AI deployment.
• Collaborates with cross-functional teams - including developers, data scientists, cybersecurity professionals, and operational users- to integrate AI T&E frameworks into project test strategies and ensure seamless coordination across DataOps, MLOps, and DevSecOps pipelines, including AI deployment within cloud and IT infrastructure environments.
• Represents the organization in working groups, interagency forums, and professional eventsrelated to AI T&E and responsible AI, while monitoring evolving test and safety standards (e.g., MIL-STD 882E, DO-178C, ISO 26262) to ensure AI evaluation activities remain current, rigorous, and aligned with mission requirements and AI ethical principles.

Conditions of employment

• Must be a U.S. Citizen
• Occasional Travel: Travel in the performance of temporary assignments may be required up to 20% CONUS/OCONUS.
• Work Schedule: Full-time
• Males born after 12-31-59 must be registered for Selective Service
• Suitable for Federal employment, determined by a background investigation
• May be required to successfully complete a probationary period
• Overtime/Compensatory time may be required to accommodate operational needs of the organization
• Tour of Duty: Flexible
• Recruitment Incentives: May be authorized based on funding availability
• Fair Labor Standards Act (FLSA): Exempt
• Financial Disclosure: Not Required
• Telework Eligibility: This position is in-person located at Fort Belvoir, VA. and may be eligible for limited, situational telework subject to supervisory approval and not to exceed current Agency guidelines.
• Must be able to obtain and maintain a TOP SECRET/SCI security clearance.
• Subject to pre-employment drug testing and periodic drug testing thereafter.
• The employee must be willing to comply with each Combatant Command (COCOM) travel medical requirement to include vaccinations.
• Valid Passport required.
• Upon entering this position, you must maintain 8140 compliance by qualifying foundationally within 9 months, and residentially within 12 months, as referenced in DoDM 8140.03.

Qualifications

You may qualify at the GS 13 , if you fulfill the following qualifications:

A. One year of specialized experience equivalent to the 12 grade level in the Federal service as listed below:

• Planning and executing test and evaluation (T&E) of artificial intelligence and machine learning (AI/ML) systems, including developing test plans, defining performance metrics, and conducting verification and validation activities to assess whether AI/ML models and applications meet defined requirements and performance standards.
• Assessing AI/ML systems for risks related to security, robustness, bias, and trustworthiness and recommending risk mitigation strategies to ensure reliable system performance.
• Writing and maintaining code in programming languages commonly used in AI/ML development.
• Preparing technical reports and communicating complex AI/ML test findings, risks, and recommendations to both technical and non-technical stakeholders, including translating test data and evaluative conclusions into actionable recommendations for leadership and cross-functional teams.

Experience refers to paid and unpaid experience, including volunteer work done through National Service programs (e.g., Peace Corps, AmeriCorps) and other organizations (e.g., professional; philanthropic; religious; spiritual; community, student, social). Volunteer work helps build critical competencies, knowledge, and skills and can provide valuable training and experience that translates directly to paid employment. You will receive credit for all qualifying experience, including volunteer experience.


In addition to meeting qualifications, your application package must reflect the applicable experience to meet the Individual Occupational Requirements for the 1550, series as listed below:

Bachelor's degree in computer science or bachelor's degree with 30 semester hours in a combination of mathematics, statistics, and computer science. At least 15 of the 30 semester hours must have included any combination of statistics and mathematics that included differential and integral calculus. All academic degrees and course work must be from accredited or pre-accredited institutions. Applicants should have sufficient knowledge to understand the fundamental concepts and techniques of computer science. Courses designed to provide an introduction to computer science techniques and methodologies, to problems of system design, and to other specialized fields are acceptable. Courses or experience in teaching elementary, business, or shop mathematics are not acceptable.
https://www.opm.gov/policy-data-oversight/classification-qualifications/general-schedule-qualification-standards/1500/computer-science-series-1550/

How you will be evaluated

You will be evaluated for this job based on how well you meet the qualifications above.

We will review your resume and supporting documents, to ensure you meet the basic qualification requirements. We will evaluate each applicant who meets the basic qualifications on the information provided and evaluate your relevant work experiences as it relates to fundamental competencies, identified below, required for this position.

Traditional rating and ranking of applications does not apply to this vacancy. Your application (resume and supporting documentation) will be evaluated to determine if you meet the minimum qualifications required as listed on the announcement under qualification requirements.

Veterans Preference: If you are entitled to veterans preference, you should indicate the type of veterans' preference you are claiming on your resume. Your veterans' preference entitlement will be verified by the employing agency.

For information on entitlement see http://www.fedshirevets.gov/job/vetpref/index.aspx

Appointment of Military Spouses (5 CFR 315.612) (NonComp Mil Sp): To receive this preference, you must choose to apply using the " Appointment of Military Spouses (5 CFR 315.612) (NonComp Mil Sp)" eligibility. If you are claiming Military Spouse eligibility and are determined to be Well Qualified (score of 85 or above) for the position, you will be referred to the hiring manager. Information and required documentation for claiming Military Spouse eligibility may be found at the General Applicant Information and Definitions link below.

Priority Placement Program (PPP) DoD Retained Grade Preference (RGP): In order to receive this preference, you must choose to apply using the "Priority Placement Program, DoD Retained Grade Preference (RGP)" eligibility. If you are claiming RGP and are determined to be Well Qualified for the position, you will be referred to the hiring manager as a priority applicant. Information and required documentation for claiming MSP may be found at the General Applicant Information and Definitions link below. To be eligible as a RGP, you must submit the following supporting documents with your application package: a signed Retained Grade PPP Self-Certification Checklist (DD3145-1 (whs.mil)); a copy of your Notification of Personnel Action (SF-50) effecting the placement in retained grade status; or a copy of the notification letter you received regarding the RIF or classification downgrade.

DoD Military Reserve (MR) and National Guard (NG) Technician (PPP DoD MRNG):
In order to receive this preference, you must choose the Military Reserve and National Guard Technician eligibility, and fill out and submit the Military Reserve and National Guard Technician PPP Self-Certification Checklist and copies of the appropriate documentation.

DoD Military Reserve (MR) and National Guard (NG) Technician Preference Eligible Technician Receiving Disability Retirement:
In order to receive this preference, you must choose the Military Reserve and National Guard Technician Receiving Disability Retirement eligibility, and fill out and submit the Military Reserve and National Guard Technician Disability PPP Self-Certification Checklist and copies of the appropriate documentation.

The documents you are required to submit vary based on the authority you are using to apply (i.e., applying as a veteran, applying as a current permanent Federal employee, applying as a reinstatement, etc.). Your complete application includes your COMPLETE resume, your responses to the online questionnaire, and documents which prove your eligibility to apply. If you fail to provide these documents, you will be marked as having an incomplete application package and you will not be considered any further.

The following documents are REQUIRED

1. Your resume:

• IMPORTANT UPDATE: Your resume must not exceed two (2) pages. If your resume exceeds the two-page limit, you will be removed from consideration for this announcement. The resume and required supporting documentation should provide the minimum qualifications and relevant experience for the announced position. Must include the work schedule, hours worked per week, dates of employment, and duties performed. If multiple resumes are submitted by an applicant, only the last resume submitted will be reviewed for qualifications and referred for selection consideration, if eligible. The resume must not be more than 5MB and should be saved and uploaded as a PDF to maintain formatting and number of pages. We also accept GIF, JPG, JPEG, PNG, RTF, TXT, PDF, ODT or Word (DOC or DOCX). We do not accept PDF portfolio files. Page margins should be 0.5 inches, and font styles must be legible. Consider using 14-point size font for titles and 10-point for the main text. We recommend using a font like Lato, if available. Other widely available options are Calibri, Helvetica, Arial, Verdana, Open San Source Sans Pro, Roboto or Noro Sans.
• Additional guidance on writing a federal resume can be found at: USAJOBS Help Center - How do I write a resume for a federal job? The resume builder can help you create a resume using these recommendations and uses the information in your USAJOBS profile to help you get started.

2. Transcripts:

• This position has a degree or education requirement so you are required to submit a copy of your transcript. We accept unofficial transcripts, as long as they contain your name, the name of the school, the date and degree that was awarded, and the list of classes and credits earned.
• College transcript (s), required if qualifying based on education. We accept unofficial transcripts, as long as they contain your name, the name of the school, the date and degree that was awarded, and the list of classes and credits earned.

3. SF50

• All current and former civilian Federal employees must submit a copy of your MOST RECENT SF50 (Notification of Personnel Action) showing your tenure, grade and step, salary, and type of position occupied (i.e., Excepted or Competitive); or similar Notification of Personnel Action documentation, i.e., Transcript of Service, Form 1150, etc.

4. Veteran's Documents:

• If applying using veteran's preference or under a Veteran's hiring authority you must submit the following documents: DD214 showing character of service, SF-15 Form and VA letter showing final percentage, or certification of expected discharge or release from active duty.

PLEASE REVIEW THE BELOW LINK FOR OTHER SUPPORTING DOCUMENTS needed for proof of eligibility:
https://www.dla.mil/Portals/104/Documents/Careers/downloads/DODCustomersRequiredSupportingDocumentation.pdf?

Next steps