The world is increasingly instrumented with sensors deployed in cities, farms, remote wilderness, and beneath the ocean, collecting information for science, government, and business. As these sensors grow more sophisticated, they are expected to not only collect data, but also process it, using advanced machine learning to make preliminary inferences before beaming information back to a central hub. But because these sensors often run on batteries and renewable energy such as solar panels, they must be stingy with the amount of energy they dedicate to these power-hungry tasks.

In work that received an Outstanding Paper award at the 2021 IEEE Real-Time and Embedded Technology and Applications Symposium (RTAS), UChicago CS PhD student Tejas Kannan and Associate Professor Henry Hoffmann described a new strategy for sensors balancing these energy constraints and advanced recurrent neural network (RNN) systems. Dubbed Budget RNNs, the approach dynamically adjusts to variable energy environments without sacrificing the accuracy of data collection and processing, allowing low-power sensors to perform efficiently without human intervention. 

“Because recharging is so dependent on the environment, there are periods in which there's no available energy, and the system must survive on battery power alone,” Kannan said. “And since the amount of energy available depends on the environment, the actual budget is something you can't necessarily plan for at design time. So what we wanted to do was develop a system that could perform on-device inference, maintaining high accuracy while also elongating the system to meet any of these variable energy budgets.”

Under ideal conditions — for example, when it is plugged in to a reliable power source — a sensor can collect data as frequently as its owner desires. But for sensors placed at the top of a tall bridge or in a remote forest, that kind of consistent power flow can’t be relied upon. So sensors need to make tough choices when external power drops or batteries run low: sample less data, skimp on data processing, or transmit less frequently. 

Engineers attempt to find the right balance of these trade-offs by using recurrent neural networks, which are well suited to processing data sequences of variable lengths — precisely what sensors sampling data at different rates produce. But these networks are hungry for energy and memory themselves, and require significant training time before deployment. Anticipating every possible energy budget in the field and training and installing an RNN for each scenario can quickly overwhelm a low-cost sensor or require larger, more expensive batteries or storage.

By contrast, the Budget RNN approach designed by Kannan and Hoffmann requires only two RNNs: one that runs at max power when the battery is full and energy is abundant, and another that adapts dynamically to lower energy budgets. The latter design uses a leveled architecture that allows for early exits when energy is low, shrinking the neural network to fit the current environment. When combined with an adaptive sampling approach — under tighter energy constraints, the sensor collects fewer readings — the strategy can preserve accuracy at lower energy levels, allowing the sensor to fulfill its function even in unpredictable states.

“It's really geared towards the idea of sensors being out there without having human intervention for long periods of time,” Kannan said. “Here, we can basically plan for the average case and the system will adapt accordingly with not too much of a loss in its performance.”

The solution could even help low-cost sensor technologies that don’t use connected power or batteries at all, relying entirely upon the energy they can harvest from sun, wind, or other renewable sources. Beyond sensors, the approach could also be useful for smartwatches and other wearable technologies, which would like to maximize computing power without resorting to bulky batteries or memory storage. 

But some challenges remain. Currently, Kannan is exploring the privacy implications of budget RNNs and similar dynamic approaches, which might allow uninvited observers to decode information from the variable power consumption of the device.

“The work we've done here is really concerned with energy efficiency and energy constraints, but I think there's a variety of things we could try, building on this idea,” Kannan said. “I’m interested in developing applications to improve the efficiency, practicality, and usefulness of low-power sensing technologies.”

Related News

More UChicago CS stories from this research area.
UChicago CS News

Sarah Sebo Awarded Prestigious CAREER Grant for Research on Robot Social Skills in Collaborative Learning

Jul 29, 2024
UChicago CS News

Enhancing Multitasking Efficiency: The Role of Muscle Stimulation in Reducing Mental Workload

Jul 10, 2024
UChicago CS News

Unveiling Attention Receipts: Tangible Reflections on Digital Consumption

May 15, 2024
UChicago CS News

University of Chicago Computer Science Researchers To Present Ten Papers at CHI 2024

May 06, 2024
UChicago CS News

FabRobotics: The Fusion of 3D Printing and Mobile Robots

Feb 27, 2024
Video

“Machine Learning Foundations Accelerate Innovation and Promote Trustworthiness” by Rebecca Willett

Jan 26, 2024
Video

Nightshade: Data Poisoning to Fight Generative AI with Ben Zhao

Jan 23, 2024
UChicago CS News

High School Students In The Collegiate Scholars Program Get To Know Robots

Nov 14, 2023
UChicago CS News

Research Suggests That Privacy and Security Protection Fell To The Wayside During Remote Learning

A qualitative research study conducted by faculty and students at the University of Chicago and University of Maryland revealed key...
Oct 18, 2023
UChicago CS News

Five UChicago CS students named to Siebel Scholars Class of 2024

Oct 02, 2023
UChicago CS News

UChicago Computer Scientists Design Small Backpack That Mimics Big Sensations

Sep 11, 2023
UChicago CS News

UChicago Researchers Win Internet Defense Prize and Distinguished Paper Awards at USENIX Security

Sep 05, 2023
arrow-down-largearrow-left-largearrow-right-large-greyarrow-right-large-yellowarrow-right-largearrow-right-smallbutton-arrowclosedocumentfacebookfacet-arrow-down-whitefacet-arrow-downPage 1CheckedCheckedicon-apple-t5backgroundLayer 1icon-google-t5icon-office365-t5icon-outlook-t5backgroundLayer 1icon-outlookcom-t5backgroundLayer 1icon-yahoo-t5backgroundLayer 1internal-yellowinternalintranetlinkedinlinkoutpauseplaypresentationsearch-bluesearchshareslider-arrow-nextslider-arrow-prevtwittervideoyoutube