Artificial intelligence (AI) experts at SRI International to investigate self-aware machine learning

Sept. 26, 2019
How does an artificially intelligent computer know if it's smart enough to do the job, or if it has a skill set that's adequate for the task at hand?

ARLINGTON, Va. – Artificial intelligence (AI) experts at SRI International in Menlo Park, Calif., are helping U.S. military researchers determine if autonomous machines are self-aware of their own competencies and limitations to carry out assigned tasks.

Officials of the U.S. Defense Advanced Research Projects Agency (DARPA) announced a $4.6 million contract to SRI International on Wednesday for the Competency-Aware Machine Learning (CAML) project.

How does a person know if he's smart enough to do the job ... if he has a skill set that's adequate for the task at hand? It sounds simple, but it's a fundamental ability necessary for trust and team building.

Now apply the same question to artificial intelligence technology and machine learning? How does a machine know if it's smart enough to do the job? That's what DARPA and SRI International are aiming at.

Related: Combat robots

The CAML project focuses on competency-awareness machine learning, where an autonomous system can self-assess its task competency and strategy, and express both in a human-understandable form.

This competency-awareness capability contributes to the goal of transforming autonomous systems from tools into trusted, collaborative partners, DARPA officials say. Competency-aware machine learning will enable machines to control their behaviors to match user expectations and enable human operators quickly and accurately to gain insight into a system’s competence in complex, time-critical, dynamic environments. CAML, in short, seeks to improve human-machine teaming.

State-of-the-art machine learning systems today operate in a complex space, and continuously develop behaviors based on their experiences. Nevertheless, these kinds of smart machines with trusted computing capabilities are unable to communicate their task strategies, the completeness of their training on a given task, what might influence their actions, or how likely they are to succeed under specific conditions.

Verifying a machine's competence increasingly is unrealistic for human operators. This can be a big problem for the military, where machines often deal with high-stake decisions, and must cope with dynamic, fast-changing conditions.

Related: Electronic warfare technology heading-up the battlefield

CAML seeks to improve human-machine teaming capabilities by creating a fundamentally new machine-learning approach, and help human operators choose the right smart machines based on the machines' experience and expertise.

CAML is a four-year program divided into a three-year research first phase, and a one-year technology-demonstration second phase. It focuses on four technology areas: self-knowledge or experience; self-knowledge of task strategies; competency-aware learning; and capability demonstrations.

Self-knowledge of Experiences will develop mechanisms for learning systems to discover conditions encountered during operation, and maintain a memory of experiences.

Related: Navy picks L-3 to provide data link to control unmanned helicopters aboard Littoral Combat Ship

Self-knowledge of task strategies will enable a machine learning system to analyze its task behaviors, summarize them into generalized patterns, and identify what controls its behavior.

Competency-aware learning integrates component technologies into a competency-aware learning framework that is able to communicate in human-understandable statements. It will conclude with a demonstration on a proposer-provided platform.

Capability demonstrations will show competency-aware machine learning systems on military platforms. For more information contact SRI International online at www.sri.com, or DARPA at www.darpa.mil.

Voice your opinion!

To join the conversation, and become an exclusive member of Military Aerospace, create an account today!