9 January 2018 - WEST LAFAYETTE, Ind.

A new platform enables high-quality 3-D video communication on mobile devices such as smartphones and tablets using existing standard wireless networks.

“To our knowledge, this system is the first of its kind that can deliver dense and accurate 3-D video content in real time across standard wireless networks to remote mobile devices such as smartphones and tablets,” said Song Zhang, an associate professor in Purdue University’s School of Mechanical Engineering.

The platform, called Holostream, drastically reduces the data size of 3-D video without substantially sacrificing data quality, allowing transmission within the bandwidths provided by existing wireless networks, he said.

It improves the quality and expands the capabilities of popular applications already harnessing real-time 3-D data delivery, such as teleconferencing and “telepresence,” which uses virtual reality and other interactive technologies, allowing people to feel or appear as if they were present in a remote location.

Photo: Purdue doctoral student Tyler Bell is lead author of a new research paper about Holostream, an innovative platform that allows high-quality 3-D video communications on mobile devices such as smartphones and tablets. The research is led by Song Zhang, an associate professor in Purdue’s School of Mechanical Engineering. (Purdue University image/ Trevor Mahlmann)

“This technology also could enable emerging applications that may require high-resolution, high-accuracy 3-D video data delivery, such as remote robotic surgery and telemedicine,” said Zhang, director of Purdue’s XYZT Lab. 

Existing 3-D video communication technologies have limited applications, in part because of they require specialized and often expensive hardware, complex system setup, and highly demanding computational resources for operation in real-time, or without delay.Before 3-D video can be transmitted it must be compressed. However, it has been difficult to compress 3-D video for transmission in real time using conventional methods. The new platform solves the problem by first converting 3-D video to 2-D format.

“Standard 2-D image and video compression techniques are quite mature and enable today’s modern 2-D video communications over standard wireless networks,” Zhang said. “If 3-D geometry can be efficiently and precisely converted into standard 2-D images, existing 2-D video communication platforms can be immediately leveraged for low bandwidth 3-D video communications.”

The 3-D objects are represented by a mesh of intersecting lines that form triangles. On top of this geometry is a “texture” of features that make the objects look realistic.

 “This paper presents a novel method for the efficient and precise encoding of 3-D video data and color texture into a regular 2-D video format,” Zhang said. “We developed a novel 3-D video compression method that can drastically reduce 3-D video data size without substantially sacrificing data quality.”

The framework was tested using standard medium-bandwidth networks to simultaneously deliver high-quality 3-D videos to multiple mobile devices.

Holostream is made possible through a new pipeline for 3-D video recording, compression, transmission, decompression and visualization.

The team developed both the hardware and software for the pipeline including a 3-D video capture system. A 3-D camera captures the images, using an LED light to project structured patterns of stripes onto the object being scanned. These stripes allow the system to determine the depth and shape of the object.

The platform could enable applications where real-time delivery of high-resolution, high accuracy of 3-D video data is especially critical, such as collaborative design and online “facial behavior analysis,” which could reveal a person’s mental state and medical conditions such as depression and post-traumatic stress disorder.

The research has been funded by the National Science Foundation. A patent application has been filed through the Purdue Research Foundation’s Office of Technology Commercialization. 

Source: Purdue University

Read more

Comments

No comments to display.

Related posts

EU's Call for Proposals: An empowering, inclusive Next Generation Internet

The objective is to support actions on smarter, open, trusted and personalised learning solutions to optimise digital learning and to allow learners to engage and interact with content and with peers.
Application Deadline in 5 months

Singapore to establish Additive Manufacturing Facility and Applications in Maritime Sector

The facility’s location also leverages PSA’s parts supplier base and facility operations to support just-in-time inventory. This move towards digitised inventories reduces the need to hold excess inventory, which lowers storage costs, while shortening turnaround time from weeks to days due to improved availability of spare parts. In the long run, PSA will expand the scope of these services to the wider maritime industry, including ship owners, to help build its business adjacencies.

EU's Call for Proposals: The AQUAEXCEL2020 twelfth call for access

The facilities available cover the entire range of production systems (cage, pond, recirculation, flowthrough, hatchery and disease challenge); environments (freshwater, marine, cold, temperate and warm water); scales (small, medium and industrial scale); fish species (salmonids, cold and warm water marine fish, freshwater fish and artemia); and fields of expertise (nutrition, physiology, health & welfare, genetics, engineering, monitoring & management technologies).
Application Deadline in a month

Environment and Big Data: Role in Smart Cities of India

This study identifies six environmental factors, which should be integrated in the development of smart cities. These environmental factors include indicators of landscape and geography, climate, atmospheric pollution, water resources, energy resources, and urban green space as a major component of the environment.

Corteva Agriscience and IRRI Ink Partnership to Develop Advanced Rice Technologies and Programs

The partnership seeks to improve the genetic outcomes of breeding programs, encourage sustainable rice cultivation, and develop new rice varieties which deliver higher yields and are more resilient against biotic and abiotic stresses.

Call for Applications: Communication projects which mitigate anthropogenic climate change

The Minor Foundation for Major Challenges (MFMC) is inviting applications from all over the world to fund communication projects which mitigate anthropogenic climate change.
Application Deadline in a month

EU's Call for Proposals: Digital technologies for improved performance in cognitive production plants

Proposals need to develop new technologies to realise cognitive production plants, with improved efficiency and sustainability, by use of smart and networked sensor technologies, intelligent handling and online evaluation of various forms of data streams as well as new methods for self-organizing processes and process chains.
Application Deadline in 4 months

Study reveals best use of wildflowers to benefit crops on farms

For the first time, a Cornell University study of strawberry crops on New York farms tested this theory and found that wildflower strips on farms added pollinators when the farm lay within a "Goldilocks zone," where 25 to 55 percent of the surrounding area contained natural lands.

EU's Call for Proposals: Reinforcing the EU agricultural knowledge base

Activities shall analyse and compare the approaches taken on their performance and impact for farmers/foresters as well as effectivity of the communication and information channels used for dissemination in countries and regions.
Application Deadline in 3 months

The Bali Fintech Agenda: A Blueprint for Successfully Harnessing Fintech’s Opportunities

In response to the Bali Fintech Agenda, the World Bank will focus on using fintech to deepen financial markets, enhance responsible access to financial services, and improve cross-border payments and remittance transfer systems.