Can you teach a smart speaker?

Key Takeaways

  • New research by MIT scientists points the way to fitting neural networks into tiny devices.
  • MCUNet allows deep learning on systems with limited processing power and memory.
  • The innovation could also allow for smarter, more agile medical devices.
Father and son together holding smart device for maintaining modern interior smart home
Jasmin Merdan / Getty Images

Smart speakers and other devices that make up the Internet of Things (IoT) could one day get the neural network power to do more with less, researchers say.

The research “is one of those brilliant ideas that seems obvious when you hear it,” John Suit, advising CTO at robotics company KODA, said in an email interview. “It’s an elegant approach to the problem. This research is so significant because eventually, they will allow for the real-time optimization of neural networks for any device where the resources can be known to the algorithm.”

“What this really shows is that power doesn’t have to be tied to size..”

Big Calculations on Small Devices 

IoT devices usually run on computer chips with no operating system, making it difficult to run pattern-recognition tasks like deep learning. For more intense analysis, IoT-collected data is often processed in the cloud, though it’s vulnerable to hacking.

There’s a lot that neural networks could do to enhance the growing number of IoT devices, but size has been a problem.

Smart Home voice assistant resting on a table
onurdongel / Getty Images

That’s where the work by the MIT researchers comes in.

TinyEngine to the Rescue

The MIT group designed two components necessary for the operation of neural networks on microcontrollers. One part is TinyEngine, which is similar to an operating system, but strips code down to its essentials. Another is TinyNAS, a neural architecture search algorithm.

“We have a lot of microcontrollers that come with different power capacities and different memory sizes,” Lin said. “So we developed the algorithm [TinyNAS] to optimize the search space for different microcontrollers. The customized nature of TinyNAS means it can generate compact neural networks with the best possible performance for a given microcontroller—with no unnecessary parameters. Then we deliver the final, efficient model to the microcontroller.”

“It’s an elegant approach to the problem.”

Lin’s work could translate to make smarter, more agile medical devices.

“What this really shows is that power doesn’t have to be tied to size, and in hospitals, where everything moves quickly in tight spaces, that can literally mean the difference between life and death,” Kevin Goodwin, CEO of EchoNous, a company that makes AI-assisted medical devices, said in an email interview.

Goodwin said his team spent years building and training a neural network that could then be used to map heart structures in a real-time ultrasound scan—all in a handheld device called KOSMOS that weighs under two pounds.

EchoNous' KOSMOS portable medical device
EchoNous

“Now doctors can move easily from room to room getting diagnostic-quality scans with AI guidance,” he added. “They don’t have to send patients elsewhere for those scans or lose critical time disinfecting cart-based machinery.”

MCUNet is an exciting look at a world where small gadgets could be smarter than ever. As the number of IoT devices grows rapidly, we’ll be looking for everything from smart appliances to medical devices to have their own neural networks.