News

Putting Artificial Intelligence to Work in the Lab

Automated scanning probe microscopy controlled by artificial intelligence/machine learning 

Dr. Agustin Schiffrin and his team at the School of Physics and Astronomy at Monash University).
FLEET

An Australian-German collaboration has demonstrated fully-autonomous scanning probe microscopy (SPM) operation, applying artificial intelligence and deep learning to remove the need for constant human supervision.

The new system, dubbed DeepSPM, bridges the gap between nanoscience, automation, and artificial intelligence (AI), and firmly establishes the use of machine learning for experimental scientific research.

Image acquired by scanning tunneling microscopy (STM): individual silver atoms on a crystalline metal surface.
FLEET

"Optimizing SPM data acquisition can be very tedious. This optimization process is usually performed by the human experimentalist, and is rarely reported," says ARC Centre of Excellence in Future Low-Energy Electronics Technologies (FLEET) chief investigator Dr. Agustin Schiffrin of Monash University.

"Our new AI-driven system can operate and acquire optimal SPM data autonomously, for multiple straight days, and without any human supervision."

The advance brings advanced SPM methodologies such as atomically-precise nanofabrication and high-throughput data acquisition closer to a fully automated turnkey application.

The new deep learning approach can be generalized to other SPM techniques. The researchers have made the entire framework publicly available online as open source, creating an important resource for the nanoscience research community.

Image acquired by atomic force microscopy (AFM): a single molecule, similar to chlorophyll.
FLEET

Fully-Autonomous DeepSPM

"Crucial to the success of DeepSPM is the use of a self-learning agent, as the correct control inputs are not known beforehand," says Dr. Cornelius Krull, project co-leader.

"Learning from experience, our agent adapts to changing experimental conditions and finds a strategy to maintain the system stable," says Krull, who works with Shiffrin at Monash School of Physics and Astronomy.

The AI-driven system begins with an algorithmic search of the best sample regions and proceeds with autonomous data acquisition.

It then uses a convolutional neural network to assess the quality of the data. If the quality of the data is not good, DeepSPM uses a deep reinforcement learning agent to improve the condition of the probe.

DeepSPM can run for several days, acquiring and processing data continuously, while managing SPM parameters in response to varying experimental conditions, without any supervision.

The study demonstrates fully autonomous, long-term SPM operation for the first time by combining:

  • an algorithmic approach for sample area selection and SPM data acquisition;
  • supervised machine learning using convolutional neural networks for quality assessment and classification of SPM data, and
  • deep reinforcement learning for dynamic automated in-situ probe management and conditioning.

- This press release was originally published on the ARC Centre of Excellence in Future Low-Energy Electronics Technologies website