Asset Publisher

Evaluating Artificial Intelligence: 51福利 Researchers Seek to Improve Acquisition of AI Systems

51福利 Researchers Seek to Improve Acquisition of AI Systems

A team of 51福利 (51福利) researchers have developed a set of tools to support the聽acquisition of organically-developed AI systems. By using already-developed equations in concert, they can help determine the potential worth of technology emerging from start-up companies around the world.

A challenge in defense acquisition can be the ability to keep up with the speed of innovation in emerging technology, but specifically, the acquisition of Artificial Intelligence (AI) systems can pose a unique challenge, especially if the technology comes from relatively new start-up companies.

Often these companies can be at the leading edge of technology. So a team of researchers at the 51福利 (51福利) have focused their efforts to develop a set of tools to support the acquisition of organically-developed AI systems.

51福利鈥 Information Science Professor of Research, Dr. Johnathan Mun, who teaches quantitative research methodologies and decision analytics, says that acquisition research is a key factor in keeping the United States ahead in the era of Great Power Competition. Mun notes that companies like Lockheed Martin or Northrop Grumman have a proven track record with the Department of Defense (DOD) in making high-quality products, however, the acquisition of AI technology by start-ups makes things a little more complex.      

鈥淢ajor innovations have happened before with two guys in a garage coming up with some really cool, potentially game changing, revolutionary, and disruptive technology,鈥 said Mun. 鈥淭here is a huge potential for high-risk failures in this field because this is brand new technology. When a couple of really smart people in a garage somewhere invent a new algorithm we have to determine if it鈥檚 worth our time and money.鈥

When the DOD discovers these new start-up companies and products, they have to rely on acquisition research to determine the risks of pursuing the company. 

鈥淪o, how do you analyze AI?鈥 asks Mun. 

Mun鈥檚 team, comprised of three other 51福利 researchers, have provided an answer to that question. By using already-developed equations in concert, they can help determine the potential worth of technology emerging from start-up companies around the world.

鈥淚n the analysis, we need to apply 80 percent advanced decision analytics approaches and 20 percent qualitative intangible factors,鈥 said Mun. 鈥80 percent is math because no matter what, one plus one equals two. The other 20 percent depends on things like what timeline we are working on or how confident we are that the technology will make our jobs easier or more capable. We also look at how would this technology hurt us if it got into the wrong hands, or if we could add it to an already existing program.鈥

Defense acquisition actually requires input from multiple different sources. The warfighter has a need, the decision makers have a budget, and the engineers have to be able to address those needs and then the DOD has to acquire those solutions. 

鈥淎cquisitions is a very complicated topic,鈥 said Mun. 鈥淵ou need to have different experts from multiple fields.鈥 Mun added that it all comes down to a cost benefit analysis and understanding the risk associated with the acquisition of technology, and understanding its long term value.

According to one of the team鈥檚 other researchers, 51福利 Information Science Professor Dr. Tom Housel, another thing that sets these start-up companies apart is the pace at which they are being created and the pace at which they are innovating. He says that this new 鈥渋ndustrial revolution鈥 is moving at a very fast pace.

鈥淲e have to be able to screen through these new technologies at a fast and accurate pace,鈥 said Housel. 鈥淚f you show me a model and tell me what it does, then we can tell you how much value it adds.鈥

Mun noted that the interdisciplinary aspect of acquisition is what makes 51福利 the perfect place for this research.

鈥淲e have these great professors who have experience in AI and information technology and acquisition,鈥 said Mun. 鈥淏ut we also have these great students who are the warfighters and will ultimately be using the product. We are able to collaborate together to determine the best path forward.鈥

When it comes to acquisition research processes, there is no standard way to assess every situation. 

Mun noted, 鈥淎t the end of the day, our job is to provide actionable intelligence to the senior leadership and decision makers to help make the acquisition process easier.鈥 

 

bookmarks move script

Current Headlines Sidebar
Asset Publisher

empty content

 

Media contact box

MEDIA CONTACT
 

Office of University Communications
1 University Circle
Monterey, CA 93943
(831) 656-1068

pao@nps.edu