NUS engineers invent tiny vision processing chip for ultra-small smart vision systems and IoT applications

A team of researchers from the National University of Singapore (NUS) has developed a novel microchip, named EQSCALE, which can capture visual details from video frames at extremely low power consumption. The video feature extractor uses 20 times less power than existing best-in-class chips, and hence requires 20 times smaller battery, and could reduce the size of smart vision systems down to the millimetre range.
a year ago

18 January 2018

Novel video feature extractor uses 20 times less power than existing chips and could reduce the size of untethered vision systems down to the millimetre range

A team of researchers from the National University of Singapore (NUS) has developed a novel microchip, named EQSCALE, which can capture visual details from video frames at extremely low power consumption. The video feature extractor uses 20 times less power than existing best-in-class chips, and hence requires 20 times smaller battery, and could reduce the size of smart vision systems down to the millimetre range. For example, it can be powered continuously by a millimetre-sized solar cell without the need for battery replacement.

Led by Associate Professor Massimo Alioto from the Department of Electrical and Computer Engineering at the NUS Faculty of Engineering, the team’s discovery is a major step forward in developing millimetre-sized smart cameras with near-perpetual lifespan. It will also pave the way for cost-effective Internet of Things (IoT) applications, such as ubiquitous safety surveillance in airports and key infrastructure, building energy management, workplace safety, and elderly care.

Photo: Associate Professor Massimo Alioto and his team from NUS Engineering developed a tiny vision processing chip, EQSCALE, which uses 20 times less power than existing technology. (credit: NUS)

“IoT is a fast-growing technology wave that uses massively distributed sensors to make our environment smarter and human-centric. Vision electronic systems with long lifetime are currently not feasible for IoT applications due to their high power consumption and large size. Our team has addressed these challenges through our tiny EQSCALE chip and we have shown that ubiquitous and always-on smart cameras are viable. We hope that this new capability will accelerate the ambitious endeavour of embedding the sense of sight in the IoT, as well as the realisation of the Smart Nation vision in Singapore,” said Assoc Prof Alioto.

Tiny vision processing chip that works non-stop

A video feature extractor captures visual details taken by a smart camera and turns them into a much smaller set of points of interest and edges for further analysis. Video feature extraction is the basis of any computer vision system that automatically detects, classifies and tracks objects in the visual scene. It needs to be performed on every single frame continuously, thus defining the minimum power of a smart vision system and hence the minimum system size.

The power consumption of previous state-of-the-art chips for feature extraction ranges from various milliwatts to hundreds of milliwatts, which is the average power consumption of a smartwatch and a smartphone, respectively. To enable near-perpetual operation, devices can be powered by solar cells that harvest energy from natural lighting in living spaces. However, such devices would require solar cells with a size in the centimetre scale or larger, thus posing a fundamental limit to the miniaturisation of such vision systems. Shrinking them down to the millimetre scale requires the reduction of the power consumption to much lesser than one milliwatt.

The NUS Engineering team’s microchip, EQSCALE, can perform continuous feature extraction at 0.2 milliwatts, 20 times lower in power consumption than any existing technology. This translates into a major advancement in the level of miniaturisation for smart vision systems. The novel feature extractor is smaller than a millimetre on each side, and can be powered continuously by a solar cell that is only a few millimetres in size. 

Assoc Prof Alioto explained, “This technological breakthrough is achieved through the concept of energy-quality scaling, where the trade-off between energy consumption and quality in the extraction of features is adjusted. This mimics the dynamic change in the level of attention with which humans observe the visual scene, processing it with different levels of detail and quality depending on the task at hand. Energy-quality scaling allows correct object recognition even when a substantial number of points of interests are missed due to the degraded quality of the target.”

Next steps

The development of EQSCALE is a crucial step towards the future demonstration of millimetre-sized vision systems that could operate indefinitely. The NUS research team is looking into developing a miniaturised computer vision system that comprises smart cameras equipped with vision capabilities enabled by the microchip, as well as a machine learning engine that comprehends the visual scene. The ultimate goal of the NUS research team is to enable massively distributed vision systems for wide-area and ubiquitous visual monitoring, vastly exceeding the traditional concept of cameras.

 

Source: National University of Singapore (NUS)

Read more

Comments

No comments to display.

Related posts

Stevia Dessert Industry 2019 Market Size, Growth, Share, Trends, Global Statistics and Forecast Analysis 2025

Stevia Dessert Market 2019 Global Industry Report delivers the Stevia Dessert business profiles, participants, news, developing activities and policies, consumer volume and creating strategies. Stevia Dessert industry also report delivers analysis on a region, products, sales, revenue. Stevia Dessert market report emphases on overall development patterns, focused on key industry players, size, consumption volume, Forecast 2019 to 2025.
17 hours ago

Hula Hoop Industry 2019 Global Market Share, Growth, Manufacturers, Size, Segments and 2025 Forecast

New research report on Hula Hoop Market 2019 Global Industry includes detailed analysis market trends, innovations, growth, and forecast 2025. The report presents market main objective of sharing this market research report is to provide an in-depth analysis of the market share, historical data, profitability, opportunities, sales, and revenue distribution. The research study offers current market size, manufacturers’ analysis and segmentation of Hula Hoop across the globe.
17 hours ago

Curling Irons Industry 2019 Market Size, Growth, Share, Trends, Global Statistics and Forecast Analysis 2025

The Curling Irons Market 2019 Global Industry report consists of all the basic information regarding the Curling Irons Market. This report presents analysis of market trends, industry growth drivers, share, analysis, size, trends, and many other aspects. The global Curling Irons report is an essential reserve of data, primarily for the industry administrators.
17 hours ago

Ukulele Market 2019 Share, Industry Impacting Growth, Global Segments, Manufacturers and Forecast to 2025

The latest research report entitled Global Ukulele Market 2019 provides a detailed and complete global coverage of Ukulele Industry analysis from 2019 to 2025. The Ukulele report begins with the overview of Ukulele Industry growth, share, current situation, trend, size, and classification of the Ukulele Industry on the basis of Ukulele Market top players, key regions, and type.
17 hours ago

Termite Control Market by Species Type, Application, Region - Forecast to 2022

The termite control market was valued at USD 2.96 Billion in 2016. It is projected to grow at a CAGR of 5.6% from 2017, to reach USD 4.11 Billion by 2022.

Call for Projects: PoweredByTF 2.0 Challenge!

Use our alpha release of TensorFlow 2.0 to do something nifty: build a model, a mobile or web application, an art installation, or something else entirely! The sky is the limit - and creativity is encouraged. We're excited to see what you build!
Application Deadline in 2 months

Rising Consumer Demand for Low-Calorie and Healthier Food & Beverage Products Drives the Polyol Sweeteners Market

The polyol sweeteners market is projected to reach USD 3.30 Billion by 2022 at a CAGR of 5.9% from 2017 to 2022.

Call for Proposals: Core Infrastructure Fund to strengthen internet freedom, digital security, and the overall health of the internet

The Core Infrastructure Fund supports the ‘building block’ technologies, infrastructures, and communities relied upon by digital security and circumvention tools strengthening internet freedom, digital security, and the overall health of the internet.
Application Deadline in a month

Joint Replacement Market Comprehensive Analysis and Future Estimations 2024

Joint Replacement Market report also provides CAGR value fluctuation in percentage during the forecast period of 2019-2024 for the market.
18 hours ago