Image Sensors World        Go to the original article...

From: https://newsroom.st.com/media-center/press-item.html/t4598.html

Sphere Studios and STMicroelectronics reveal new details on the world’s largest cinema image sensor 

Jan 11, 2024 Burbank, CA, and Geneva, Switzerland
Sensor custom created for Big Sky – the world’s most advanced camera system – and is used to capture ultra-high-resolution content for Sphere in Las Vegas

Sphere Entertainment Co. (NYSE: SPHR) today revealed new details on its work with STMicroelectronics (NYSE: STM) (“ST”), a global semiconductor leader serving customers across the spectrum of electronics applications, to create the world’s largest image sensor for Sphere’s Big Sky camera system. Big Sky is the groundbreaking, ultra-high-resolution camera system being used to capture content for Sphere, the next-generation entertainment medium in Las Vegas.
 
Inside the venue, Sphere features the world’s largest, high-resolution LED screen which wraps up, over, and around the audience to create a fully immersive visual environment. To capture content for this 160,000 sq. ft., 16K x 16K display, the Big Sky camera system was designed by the team at Sphere Studios – the in-house content studio developing original live entertainment experiences for Sphere. Working with Sphere Studios, ST manufactured a first-of-its-kind, 18K sensor capable of capturing images at the scale and fidelity necessary for Sphere’s display. Big Sky’s sensor – now the world’s largest cinema camera sensor in commercial use – works with the world’s sharpest cinematic lenses to capture detailed, large-format images in a way never before possible.
 
“Big Sky significantly advances cinematic camera technology, with each element representing a leap in design and manufacturing innovation,” said Deanan DaSilva, lead architect of Big Sky at Sphere Studios. “The sensor on any camera is critical to image quality, but given the size and resolution of Sphere’s display, Big Sky’s sensor had to go beyond any existing capability. ST, working closely with Sphere Studios, leveraged their extensive expertise to manufacture a groundbreaking sensor that not only expands the possibilities for immersive content at Sphere, but also across the entertainment industry.”
 
“ST has been on the cutting edge of imaging technology, IP, and tools to create unique solutions with advanced features and performance for almost 25 years,” said Alexandre Balmefrezol, Executive Vice President and Imaging Sub-Group General Manager, STMicroelectronics. “Building a custom sensor of this size, resolution, and speed, with low noise, high dynamic range, and seemingly impossible yield requirements, presented a truly novel challenge for ST – one that we successfully met from the very first wafer out of our 12” (300mm) wafer fab in Crolles, France.”
 
As a leader in the development and manufacturing of image sensors, ST’s imaging technologies and foundry services cater to a wide range of markets, including professional photography and cinematography. Big Sky’s 316 megapixel sensor is almost 7x larger and 40x higher resolution than the full-frame sensors found in high-end commercial cameras. The die, which measures 9.92cm x 8.31cm (82.4 cm2), is twice as large as a wallet-sized photograph, and only four full die fit on a 300mm wafer. The system is also capable of capturing images at 120 fps and transferring data at 60 gigabytes per second.
 
Big Sky also allows filmmakers to capture large-format images from a single camera without having to stitch content together from multiple cameras – avoiding issues common to stitching including near distance limitations and seams between images. Ten patents and counting have been filed by Sphere Studios in association with Big Sky’s technology.
 
Darren Aronofsky’s Postcard from Earth, currently showing at Sphere as part of The Sphere Experience, is the first cinematic production to utilize Big Sky. Since its debut, Postcard from Earth has transported audiences, taking them on a journey spanning all seven continents, and featuring stunning visuals captured with Big Sky that make them feel like they have traveled to new worlds without leaving their seats in Las Vegas. More information about The Sphere Experience is available at thesphere.com.

Go to the original article...

Image Sensors World        Go to the original article...

OPPO, AlpsenTek and Qualcomm Boost AI Motion, Image Quality For Mobile Applications

Jan.11,2024,Las Vegas,USA—OPPO, AlpsenTek and Qualcomm Technologies, Inc. have teamed up with the goal of enhancing innovative Hybrid Vision Sensing (HVS) technology, to better extract valuable motion and image data to enhance picture quality for mobile phone applications.

OPPO and AlpsenTek will collaborate to pioneer the use of Hybrid Vision Sensing technologies, developing a data processing chain to collect relevant camera information to help enhance picture quality and allow for deblurring, augmented resolution, and slow-motion reconstruction, as well as other features required for machine sensing. This will be accomplished by leveraging Snapdragon® Mobile Platforms from Qualcomm Technologies.

“The HVS solution, with the support of hardware and algorithms, significantly enhances the capacities of smartphone cameras”, said Judd Heape VP, Product Management at Qualcomm Technologies, Inc. “We are pleased to contribute to the optimization of this new technology on our Snapdragon platforms – which will help consumers to get the best performance from their smartphone cameras, and capture what’s most precious to them.”

The Image product director, Mr. Xuan ZHANG, from OPPO commented: “Over the years, we have conducted extensive research in new sensor technologies, with a particular focus on HVS (Hybrid Vision System) technology. We have engaged in substantial collaborative developments with AlpsenTek and Qualcomm, involving numerous iterations in both chip design and algorithms. Our confidence in the potential of this technology has driven us to invest time and effort into refining it collaboratively, with the ultimate goal of pushing it towards the application on OPPO’s HyperTone Camera System.” 

Motion information is crucial in photography and machine vision. Traditional image sensors collapse motion information within a period (i.e. the exposure) into a single image. This leads to motion blurs and loss of valuable motion data essential for image/video processing and machine vision algorithms.

Effectively obtaining high-fidelity motion information with a vision sensor is a top demand across various fields today. Current solutions based on conventional image sensors often rely on increasing the frame rate, which is expensive and impractical for many applications. High frame rates lead to a significant amount of data (much of it redundant) and short shutter durations, causing high system resource usage, low efficiency, and poor adaptation to lighting conditions for high-frame-rate cameras.

Event-based Vision Sensing (EVS) is an imaging technology that continuously records change/motion information through its shutter-free mechanism. It provides motion information with high time resolution and lower cost machine vision. With an in-pixel processing chain featuring logarithm amplification, EVS achieves a balance between high frame rate, high dynamic range, and low data redundancy for recording motion information.

However, EVS sensors often lack critical static pictorial information that is needed for many machine vision applications. It typically works alongside a separate traditional image sensor (RGB) to compensate for this drawback, introducing challenges in cost, system complexity, and image registration between the two types of images (EVS and RGB), offsetting many of EVS's advantages.
AlpsenTek's Hybrid Vision Sensing (HVS) technology, introduced in 2019, combines EVS and conventional imaging technology into a single sensor. The ALPIX® sensor from AlpsenTek simultaneously outputs high-quality RGB images and EVS data stream, providing a cost-effective and algorithm-friendly solution for capturing images with embedded motion information.

Jian Deng, Founder and CEO of AlpsenTek, stated, "In the current landscape of vision sensors, there is a growing expectation for more than just 2D RGB information; sensors are now anticipated to provide additional data, such as distance, spectrum, and motion. Collaborating with OPPO and Qualcomm, we collectively designed the ALPIX-Eiger® to seamlessly integrate into mobile phone applications. Considered an enhanced RGB image sensor, it boasts image quality comparable to leading mobile sensors on the market, while introducing the added functionality of EVS. Witnessing the process of bringing our technology from conception to product brings us immense excitement."

Deng further emphasized, "It's important to recognize that what truly changes the world is not the technology itself but the products that it enables. Our passion lies in bringing Hybrid Vision Sensing (HVS) into the hands of everyone. This commitment has been our driving force from the very beginning. We look forward to fruitful outcomes from this collaboration”.

Jian Deng, Founder and CEO of AlpsenTek, stated, "In the current landscape of vision sensors, there is a growing expectation for more than just 2D RGB information; sensors are now anticipated to provide additional data, such as distance, spectrum, and motion. Collaborating with OPPO and Qualcomm, we collectively designed the ALPIX-Eiger® to seamlessly integrate into mobile phone applications. Considered an enhanced RGB image sensor, it boasts image quality comparable to leading mobile sensors on the market, while introducing the added functionality of EVS. Witnessing the process of bringing our technology from conception to product brings us immense excitement."

Deng further emphasized, "It's important to recognize that what truly changes the world is not the technology itself but the products that it enables. Our passion lies in bringing Hybrid Vision Sensing (HVS) into the hands of everyone. This commitment has been our driving force from the very beginning. We look forward to fruitful outcomes from this collaboration”.

This news was also featured on EETimes: https://www.eetimes.com/oppo-alpsentek-and-qualcomm-boost-ai-motion-image-quality-for-mobile-applications/

Go to the original article...

Image Sensors World        Go to the original article...

Go to the original article...

Image Sensors World        Go to the original article...

Tontini et al. from  FBK and University of Trento recently published an article titled "Histogram-less LiDAR through SPAD response linearization" in the IEEE Sensors journal.

Open access link: https://ieeexplore.ieee.org/document/10375298

Abstract:  We present a new method to acquire the 3D information from a SPAD-based direct-Time-of-Flight (d-ToF) imaging system which does not require the construction of a histogram of timestamps and can withstand high flux operation regime. The proposed acquisition scheme emulates the behavior of a SPAD detector with no distortion due to dead time, and extracts the TOF information by a simple average operation on the photon timestamps ensuring ease of integration in a dedicated sensor and scalability to large arrays. The method is validated through a comprehensive mathematical analysis, whose predictions are in agreement with a numerical Monte Carlo model of the problem. Finally, we show the validity of the predictions in a real d-ToF measurement setup under challenging background conditions well beyond the typical pile-up limit of 5% detection rate up to a distance of 3.8m.

Go to the original article...

Image Sensors World        Go to the original article...

Abstract: The miniaturization of image sensors in recent decades has made today’s cameras ubiquitous across many application domains, including medical imaging, smartphones, security, robotics, and autonomous transportation. However, only imagers that are an order of magnitude smaller could enable novel applications in nano-robotics, in vivo imaging, mixed reality, and health monitoring. While sensors with sub-micron pixels exist now, further miniaturization has been primarily prohibited by fundamental limitations of conventional optics. Traditional imaging systems consist of a cascade of refractive elements that correct for aberrations, and these bulky lenses impose a lower limit on camera footprint. In recent years, sub-wavelength diffractive optics, also known as meta-optics have been touted as a promising replacement for the bulky refractive optics. However, the images taken with meta-optics, to date, remain significantly inferior to the ones taken with refractive. Especially, full-color imaging with a large aperture meta-lens remains an important unsolved problem. We employ computationally designed meta-optics to solve this problem and enable ultra-compact cameras. Our solution is to design the meta-optics such that the modulation transfer function (MTF) of all the wavelength across the desired optical bandwidth are the same at the sensor plane. Additionally, the volume under the MTF curve is maximized to ensure enough information is captured enabling computational reconstruction of the image. The same intuition can be employed for different angles to mitigate geometric aberrations as well. In this talk, I will describe our efforts on achieving full-color imaging using a single meta-optic and a computational backend. Starting from traditional extended depth of focus lens [1,2], I will describe inverse-designed meta-optics [3], end-to-end designed meta-optics [4] and hybrid refractive/ meta-optics [5] for visible full-color imaging. I will also talk about how these techniques can be extended for thermal imaging [6,7].

[1] S. Colburn et al., Sci Adv 4, eaar2114 (2018).
[2] L. Huang et al., Photon. Res. 8, 1613 (2020).
[3] E. Bayati et al., Nanophotonics 11, 2531 (2022).
[4] E. Tseng et al., Nature Communications 12, 6493 (2021).
[5] S. Pinilla et al., Science Advances 9, eadg7297.
[6] L. Huang et al., Opt. Mater. Express 11, 2907 (2021).
[7] V. Saragadam et al., arXiv:2212.06345 (2023).

Biography
Professor Arka Majumdar is an associate professor in the departments of electrical and computer engineering and physics at the University of Washington (UW). He received B. Tech. from IIT-Kharagpur (2007), where he was honored with the President’s Gold Medal. He completed his MS (2009) and PhD.(2012) in Electrical Engineering at Stanford University. He spent one year at the University of California, Berkeley (2012-13), and then in Intel Labs (2013-14) as postdoc before joining UW. His research interests include developing a hybrid nanophotonic platform using emerging material systems for optical information science, imaging, and microscopy. Professor Majumdar is the recipient of multiple Young Investigator Awards from the AFOSR (2015), NSF (2019), ONR (2020) and DARPA (2021), Intel early career faculty award (2015), Amazon Catalyst Award (2016), Alfred P. Sloan fellowship (2018), UW college of engineering outstanding junior faculty award (2020), iCANX Young Scientist Award (2021), IIT-Kharagpur Young Alumni Achiever Award (2022) and DARPA Director’s Award (2023). He is co-founder and technical advisor of Tunoptix, a startup commercializing software defined meta-optics.

Go to the original article...