U.S. air superiority is being challenged by competitors. The authors of this report demonstrate a prototype of a proof-of-concept artificial intelligence system to help develop and evaluate new concepts of operations for the air domain. The initial findings highlight both the potential of reinforcement learning to tackle complex, collaborative air mission planning problems, and some significant challenges facing this approach.