Korean researchers develop a processor for real-time hologram generation

Korean researchers have developed a digital holography processor that converts two-dimensional (2D) videos into real-time three-dimensional (3D) holograms. This technology is expected to play a key role in the future of holography, as it enables the instantaneous transformation of ordinary 2D videos into 3D holograms.

The Electronics and Telecommunications Research Institute (ETRI) has announced the development of a programmable semiconductor-based digital holographic media processor (RHP) using Field Programmable Gate Array (FPGA) technology. This processor can convert 2D video into 3D holograms in real-time.

The real-time holography processor is the world’s first to utilize high-bandwidth memory (HBM) to generate real-time, full-color 3D holograms from 2D video. Notably, all the hardware required for hologram generation is integrated into a single system-on-chip (SoC).

The real-time holography processor (RHP) extracts the three primary colors (red, green, and blue) and depth information from 2D video, then reconstructs holographic video information at 4K resolution with a latency of just 30 milliseconds (ms). It is capable of rendering holograms at a processing speed of up to 30 frames per second (FPS), positioning it among the most advanced holography processors in the world.

This processor performs complex numerical calculations for wave propagation to convert 2D information into 3D holograms. Notably, by utilizing high-performance HBM memory instead of DDR memory, the processor enables high-speed processing of large-scale complex-number holographic computations.

This breakthrough achieves high processing speeds and performance dozens of times faster than conventional software-based hologram generation on standard computers, while also significantly reducing power consumption.

In a demonstration using the real-time holographic media processor, the researchers confirmed that any video displayed on a computer screen—including YouTube/Netflix content, video calls, and more—could be converted into 3D holographic video without delay.

Through this research, ETRI has developed a core holographic media technology that enables real-time rendering of ultra-high-resolution holograms using dedicated hardware. Moving forward, the researchers plan to enhance this technology by integrating direct acquisition of natural light-based holograms and high-definition hologram rendering techniques.

ETRI researchers explained that they achieved this technological breakthrough after three years of research and development. The technology was showcased at the 2023 SID Display Week I-Zone exhibition and at SID Display Week 2024 in San Jose, U.S., where it received an enthusiastic response from visitors.

Their research findings were also presented at SIGGRAPH Asia 2024 in Tokyo, Japan, last December, where they garnered significant attention. These achievements demonstrate that ETRI’s holographic processor technology has established itself as a groundbreaking innovation on the global stage.

Kwon Won Ok, the principal researcher at ETRI’s Digital Holography Research Section, stated, “Our goal is to develop a dedicated holographic media processor chip (ASIC) for general-purpose holographic displays by incorporating hardware-based holographic image enhancement technology in the future.”

Hong Kee Hoon, the director of ETRI’s Digital Holography Research Section, added, “The development of the holography processor will enable the creation of real-time holograms with low power consumption and a compact form factor, marking a significant step toward the practical application of holography technology.”