Developing a Validation Methodology for Tacair Soar Agents in Eaagles

The Air Force Simulation and Analysis Facility (SIMAF) at Wright Patterson AFB, OH is currently conducting an effort to integrate TacAir Soar agents into the Enhanced Air-to-air and Air-to-Ground Linked Environment Simulation (EAAGLES) environment. SIMAF plans to support customizable agents in the Soar interpretive language, compilable for use in EAAGLES. TacAir Soar (TAS) agents are currently only utilized in the Joint Semi- Automated Forces (JSAF) environment, but have potential for use in EAAGLES. SIMAF requested research be conducted on a validation methodology to apply to the agents’ behavior once they have been successfully imported into the EAAGLES environment. This methodology developed could then be used on all variants of the final version of the agents, once delivered by Soar Technologies, Inc. This research project investigated the possibility of “verification by comparison” with the TacAir Soar agent’s current behavior and performance in JSAF while integrated with “human in the loop” simulators. By comparing the new models to the already validated models in JSAF, the desire was to eliminate the need for a “ground up” verification. This paper outlines the steps taken to successfully construct a working JSAF/TacAir Soar model, as well as illustrates the deficiencies and limitations encountered. Finally, recommendations are made as to the future development of validation/verification methodology for SIMAF’s efforts.