Materials Recognition with ToF Camera

Image Sensors World        Go to the original article...

Springer Machine Vision and Applications Journal publishes a paper "Classification of materials using a pulsed time-of-flight camera" by ShiNan Lang, Jizhong Zhang, Yiheng Cai, Xiaoqing Zhu, and Qiang Wu from Beijing University of Technology, China.

"We propose an innovative method of material classification based on the imaging model of pulsed time-of-flight (ToF) camera integrated with the unique signature that describes physical properties of each material named reflection point spread function (RPSF). First, the optimization method reduces the effect of material surface interreflection, which would affect RPSF and lead to decreased accuracy in classification, by alternating direction method of multipliers (ADMM). A method named feature vector normalization is proposed to extract material RPSF features. Second, according to the nonlinearity of the feature vectors, the structure of hidden layer neurons of radial basis function (RBF) neural network is optimized based on singular value decomposition (SVD) to improve generalization. Finally, the similar appearance of plastics and metals are classified on turntable-based measurement system by own design. The average classification accuracy reaches 93.3%, and the highest classification accuracy reaches 94.6%."

Go to the original article...

Omnivision Announces Stacked AI Processor for DMS Applications

Image Sensors World        Go to the original article...

Businesswire: OmniVision announces the OAX8000 AI-enabled, automotive ASIC for entry-level, stand-alone driver monitoring systems (DMS). The OAX8000 uses a stacked-die architecture to provide the industry’s only DMS processor with on-chip DDR3 SDRAM memory (1GB). This is also the only dedicated DMS processor to integrate a neural processing unit (NPU) and ISP which provides dedicated processing speeds up to 1.1 trillion operations per second for eye gaze and eye tracking algorithms. These fast processing speeds with 1K MAC of CNN acceleration, along with integrated SDRAM, enable the lowest power consumption available for DMS systems—the OAX8000 and OmniVision automotive image sensor consume just 1W in typical conditions, combined. Further optimizing DMS systems, this integration also reduces the board area for the engine control unit (ECU).

According to Yole Développement, the accelerated market drive for DMS is expected to generate a 56% CAGR between 2020 and 2025. This is being driven by the European Union’s Euro NCAP requirement that all new cars sold in the region have a DMS camera by 2022.

Most DMS processors on the market today are not dedicated to this application, requiring added circuitry to perform other system functions that consumes more power, occupies more board space and doesn’t allow room for on-chip SDRAM,” said Brian Pluckebaum, automotive product marketing manager at OmniVision. “By focusing the design of our OAX8000 ASIC on entry-level DMS, we were able to create the automotive industry’s most optimized solution.

The OAX8000’s on-chip NPU is supported by the popular TensorFlow, Caffe, MXNet and ONNX tool chains. Additionally, this ASIC embeds quad Arm Cortex A5 CPU cores with Neon technology for accelerated video encoding/decoding and on-chip video analytics algorithms, along with hardware for image processing, video encoding and RGB/IR processing. Its HDR processing capability allows the ASIC to accept input from RBG/IR image sensors. The integrated video encoder accepts up to 5MP captures from OmniVision’s automotive image sensors, and outputs up to 2K resolution video at 30fps.

Boot-up time for the OAX8000 is significantly faster than its nearest competitor. This rapid startup eliminates any delay between ignition and activation of the DMS camera. Additionally, it supports secure boot features to provide cybersecurity.

Other applications include processing occupant detection algorithms, such as distinguishing a baby from a grocery bag, and providing alerts when objects are left behind in the vehicle. Additionally, this ASIC can be used in automotive video security systems to perform functions such as FaceID, as well as preset driver-comfort settings (e.g., seat position) that are activated when the DMS first scans the driver’s face.

Samples of the new OAX8000 ASIC are available now. It is AEC-Q100 Grade 2 certified for automotive applications.

Go to the original article...

Canon RF 24-105mm f4-7.1 STM review

Cameralabs        Go to the original article...

The Canon RF 24-105mm f4-7.1 STM is a compact, light and affordable general-purpose zoom for the full-frame EOS R mirrorless system. Costing less than half the price of the RF 24-105mm f4L, the cheaper STM version actually turned out to be a lot better than I expected and in my review I’ll show you why it’s the kit zoom the Rf system has been waiting for!…

Go to the original article...

Current and Future Technologies of Capsule Endoscopy

Image Sensors World        Go to the original article...

Archives of Preventive Medicine publishes a paper "Analysis of current and future technologies of capsule endoscopy: A mini review" by Alexander P Brown and Ahalapitiya H Jayatissa from the University of Toledo, OH, USA.

"Many existing methods of endoscopy can be very uncomfortable and potentially even painful for a patient. Using a conventional endoscope is also limited in its usable range, unable to access a majority of the small bowel. Recent advancements in LEDs, optical design, and MEMS (microelectromechanical systems) technologies have provided the ability to create a wireless endoscope. Since its inception, the capsule endoscope has seen advancements in existing technology as well as the introduction of new components. As the capsule endoscope continues to advance, more application possibilities will grow as well."

Go to the original article...

History and Future of Radiation Imaging at CERN

Image Sensors World        Go to the original article...

Elsevier Radiation Measurements Journal publishes a paper "History and future of radiation imaging with single quantum processing pixel detectors" by Erik H.M. Heijne from Czech Technical University in Prague.

"This introductory article treats aspects of the evolution of early semiconductor detectors towards modern radiation imaging instruments, now with millions of signal processing cells, exploiting the potential of silicon nano-technology. The Medipix and Timepix assemblies are among the prime movers in this evolution. Imaging the impacts in the detecting matrix from the individual ionizing particles and photons can be used to study these elementary quanta themselves, or allows one to visualize various characteristics of objects under irradiation. X-ray imaging is probably the most-used modality of the latter, and the new imagers can process each single incident X–photon to obtain an image with additional information about the structure and composition of the object. The atomic distribution can be imaged, taking advantage of the energy-specific X-ray absorption. A myriad of other applications is appearing, as reported in the special issue of this journal. As an example, in molecular spectroscopy, the sub-nanosecond timing in each pixel can deliver in real-time the mapping of the molecular composition of a specimen by time-of-flight for single molecules, a revolution compared with classical gel electrophoresis. References and some personal impressions are provided to illuminate radiation detection and imaging over more than 50 years. Extrapolations and wild guesses for future developments conclude the article."

Go to the original article...

Thesis on Low Power ToF Imaging

Image Sensors World        Go to the original article...

MIT publishes a PhD Thesis "Algorithms and systems for low power time-of-flight imaging" by James Noraky.

"Time-of-flight (ToF) cameras are appealing depth sensors because they obtain dense depth maps with minimal latency. However, for mobile and embedded devices, ToF cameras, which obtain depth by emitting light and estimating its roundtrip time, can be power-hungry and limit the battery life of the underlying device. To reduce the power for depth sensing, we present algorithms to address two scenarios. For applications where RGB images are concurrently collected, we present algorithms that reduce the usage of the ToF camera and estimate new depth maps without illuminating the scene. We exploit the fact that many applications operate in nearly rigid environments, and our algorithms use the sparse correspondences across the consecutive RGB images to estimate the rigid motion and use it to obtain new depth maps.

Our techniques can reduce the usage of the ToF camera by up to 85%, while still estimating new depth maps within 1% of the ground truth for rigid scenes and 1.74% for dynamic ones. When only the data from a ToF camera is used, we propose algorithms that reduce the overall amount of light that the ToF camera emits to obtain accurate depth maps. Our techniques use the rigid motions in the scene, which can be estimated using the infrared images that a ToF camera obtains, to temporally mitigate the impact of noise. We show that our approaches can reduce the amount of emitted light by up to 81% and the mean relative error of the depth maps by up to 64%. Our algorithms are all computationally efficient and can obtain dense depth maps at up to real-time on standard and embedded computing platforms.

Compared to applications that just use the ToF camera and incur the cost of higher sensor power and to those that estimate depth entirely using RGB images, which are inaccurate and have high latency, our algorithms enable energy-efficient, accurate, and low latency depth sensing for many emerging applications."

Go to the original article...

Millimeter Wave Sensing Review

Image Sensors World        Go to the original article...

Eindhoven University of Technology publishes an Arxiv.org paper "Millimeter Wave Sensing: A Review of Application Pipelines and Building Blocks" by Bram van Berlo, Amany Elkelany, Tanir Ozcelebi, and Nirvana Meratnia.

"The millimeter wave spectrum is part of 5G and covers frequencies between 30 and 300 GHz corresponding to wavelengths ranging from 10 to 1 mm. Although millimeter wave is often considered as a communication medium, it has also proved to be an excellent 'sensor', thanks to its narrow beams, operation across a wide bandwidth, and interaction with atmospheric constituents. In this paper, which is to the best of our knowledge the first review that completely covers millimeter wave sensing application pipelines, we provide a comprehensive overview and analysis of different basic application pipeline building blocks, including hardware, algorithms, analytical models, and model evaluation techniques. The review also provides a taxonomy that highlights different millimeter wave sensing application domains. By performing a thorough analysis, complying with the systematic literature review methodology and reviewing 165 papers, we not only extend previous investigations focused only on communication aspects of the millimeter wave technology and using millimeter wave technology for active imaging, but also highlight scientific and technological challenges and trends, and provide a future perspective for applications of millimeter wave as a sensing technology."

Go to the original article...

The Great Wavelength Debate in Automotive LiDARs

Image Sensors World        Go to the original article...

 ON Semi Director of Business Development of SensL Division Bahman Hadji publishes a video "Which Wavelength Will Prevail for Automotive LiDAR – The Great Debate."


Go to the original article...

The Great Wavelength Debate in Automotive LiDARs

Image Sensors World        Go to the original article...

 ON Semi Director of Business Development of SensL Division Bahman Hadji publishes a video "Which Wavelength Will Prevail for Automotive LiDAR – The Great Debate."


Go to the original article...

Samsung Plans to Leapfrog Sony with New 20nm Process

Image Sensors World        Go to the original article...

JoongAng Ibo: Samsung VP  Yong-in Park has been recently promoted from HR to the System LSI Division Strategic Marketing Manager. One of his first decisions was to convert the remaining DRAM capacity on Line 11 to image sensor manufacturing.

The reason Samsung Electronics is converting its DRAM line to image sensor is that it is building a large-scale new DRAM production facility at the Pyeongtaek plant. The Pyeongtaek plant will mass-produce the 4th generation 10-nano class (1a) DRAM using the EUV process from next year. Due to the massive increase in DRAM production capacity, Hwaseong Line 11, which made 20-nano or higher-class DRAM, will be converted into an image sensor for line efficiency.

The newspaper says that (in Microsoft translation) "Sony is still more of ahead in its optical ability to convert light into images. Apple and Huawei have been using Sony products instead of using Samsung image sensors."

Go to the original article...

2020 Acquisitions & IPOs

Image Sensors World        Go to the original article...

As 2020 nears its end, there was a number of image sensor companies acquisitions:

  1. Smartsens acquired Allchip (automotive image sensors)
  2. Nordson acquired vivaMOS (X-Ray sensors)
  3. GE Health acquired Prismatic Sensors (X-Ray sensors)
  4. Goodix acquired Dreamchip (digital design services team)
  5. TE Connectivity acquired First Sensor (SPADs, APDs, InGaAs, and p-i-n photodiodes)
  6. LeddarTech acquired VayaVision (sensor fusion and perception software for LiDARs)
  7. Allegro acquired Voxtel (LiDARs)
  8. Seegrid acquired Box Robotics (LiDARs)
  9. ams acquires Osram (adds laser and LED products to complete 3D sensing portfolio)
  10. Nuvoton acquired Panasonic semiconductor business (including image sensor and stake in TPSCo fab)
  11. Jenoptik acquired Trioptics (camera module test and measurement equipment)
  12. Sony acquired Insightness (event-driven sensors)
  13. Celepixel was acquired by Will Semiconductor (event-driven sensors)
There was a number of IPO announcements, although not all of the deals are closed till the end of the year:
  1. Galaxycore (mobile sensors)
  2. Velodyne (LiDAR, merger with SPAC)
  3. Luminar (LiDAR, merger with SPAC)
  4. Aeva (LiDAR, merger with SPAC)
  5. Innoviz (LiDAR, merger with SPAC)
  6. Ouster (LiDAR, merger with SPAC)

Go to the original article...

The Richest Man in China’s Semiconductor Industry is "Image Sensor Man"

Image Sensors World        Go to the original article...

Halo Finance, DayDayNews: Will Semiconductor chairman and Omnivision CEO Renrong Yu is the richest man in China semiconductor industry. Will Semi is a mother company of Omnivision, Superpix, and Celepixel.

This year, Renrong Yu is ranked 65th on the Forbes China Rich List with a wealth of 51.38 billion yuan ($7.86 billion), an increase of 21.12 billion yuan over the last year. Compared with 2017, the value has increased by nearly 15 times.

On May 4, 2017, at IPO time, the stock price of Will Semi shares was 7 yuan. On December 25 this year, the stock price of Weir shares was 220 yuan, with a total market value of 190.872 billion. The stock price has increased by more than 30 times in 3.5 years.

Will Semi shares have become a "dark horse" with a market value of 100 billion, thanks to the "snake swallowing elephant" acquisition of Beijing Omnivision. It is worth mentioning that in 2018, when Will Semi decided to acquire Omnivision  at a price of 13 billion yuan, Omnivision's total assets were almost 5 times that of Will's and its net assets were nearly 8 times.

Renrong Yu has graduated from Radio Department of Tsinghua University in 1990. He belongs to the group of alumni of this University that many Chinese semiconductor executives originating from. The incomplete list includes Zhao Lixin, founder of Galaxycore Microelectronics, Zhao Weiguo, founder of Tsinghua Unigroup, Shu Qingming, one of the founders of GigaDevice, Feng Chenhui, co-founder of Maxscend Microelectronics, and Zhao Lidong, founder of Enflame Technology, all studied at Tsinghua University Radio Department in 1985-1990.

Go to the original article...

Silicon Integrated Raises $25M in Round B

Image Sensors World        Go to the original article...

I missed this announcement in June 2020. Chinese ToF sensor company Silicon Integrated raised a RMB180M ($25.28M) series B round of financing led by CTC Capital.

Silicon Integrated develops ToF sensor chips and 3D vision solutions, and has already launched mature products. In March 2020, the company has released a BSI ToF sensor chip with independent intellectual property rights. The chip can be widely used in smartphones, face recognition, machine vision and other scenes which require high-performance 3D sensing and imaging effects.

Zhang Xingchen, partner at Source Code Capital, said: "3D sensor chips and modules represented by ToF are becoming a new generation of technological infrastructure. Unlike traditional chip design companies, Silicon Integrated has the ability to define and differentiate hardware through software algorithms, which will promote them to stand out in this field."

Proceeds of the round will be used to expand mass production of BSI ToF products, and the development of lidar, optical sensing and multi-sensing fusion technologies.


The company's first ToF product SIF2X10 features:
  • HVGA (480 x 360) resolution for SIF2310 and VGA (640 x 480) resolution for SIF2610
  • Back-side illumination
  • Ambient light immunity
  • Compatible with 850nm/940nm LED/VCSEL light source
  • QE>30% at 940nm
  • Up to 100MHz modulation frequency
  • 240fps raw data frame rate
  • Region of interest (ROI) function
  • Absolute accuracy < 1% up to 5m
  • Global shutter
  • Opto-package
Silicon Integrated presents a set of pictures (raw data without correction and processing) taken by SIF2310 with a 940nm light source, an average light source power of 140mw, and a target distance of 2m:


According to South China Morning Post, Silicon Integrated's co-founders Rui Quan and CEO Liu Deheng studied engineering at Delft University of Technology in The Netherlands and both landed jobs at Dutch semiconductor companies after graduating.

Liu worked as a research engineer for Philips in Eindhoven for two years while Quan was a senior analogue design engineer at NXP Semiconductors for four years.

Go to the original article...

Silicon Integrated Raises $25M in Round B

Image Sensors World        Go to the original article...

I missed this announcement in June 2020. Chinese ToF sensor company Silicon Integrated raised a RMB180M ($25.28M) series B round of financing led by CTC Capital.

Silicon Integrated develops ToF sensor chips and 3D vision solutions, and has already launched mature products. In March 2020, the company has released a BSI ToF sensor chip with independent intellectual property rights. The chip can be widely used in smartphones, face recognition, machine vision and other scenes which require high-performance 3D sensing and imaging effects.

Zhang Xingchen, partner at Source Code Capital, said: "3D sensor chips and modules represented by ToF are becoming a new generation of technological infrastructure. Unlike traditional chip design companies, Silicon Integrated has the ability to define and differentiate hardware through software algorithms, which will promote them to stand out in this field."

Proceeds of the round will be used to expand mass production of BSI ToF products, and the development of lidar, optical sensing and multi-sensing fusion technologies.


The company's first ToF product family SIF2X10 features:
  • HVGA (480 x 360) resolution for SIF2310 and VGA (640 x 480) resolution for SIF2610
  • Back-side illumination
  • Ambient light immunity
  • Compatible with 850nm/940nm LED/VCSEL light source
  • QE>30% at 940nm
  • Up to 100MHz modulation frequency
  • 240fps raw data frame rate
  • Region of interest (ROI) function
  • Absolute accuracy < 1% up to 5m
  • Global shutter
  • Opto-package
Silicon Integrated presents a set of pictures (raw data without correction and processing) taken by SIF2310 with a 940nm light source, an average light source power of 140mw, and a target distance of 2m:


According to South China Morning Post, Silicon Integrated's co-founders Rui Quan and CEO Liu Deheng studied engineering at Delft University of Technology in The Netherlands and both landed jobs at Dutch semiconductor companies after graduating.

Liu worked as a research engineer for Philips in Eindhoven for two years while Quan was a senior analogue design engineer at NXP Semiconductors for four years.

Go to the original article...

Global TCAD Solutions for CIS

Image Sensors World        Go to the original article...

Global TCAD Solutions GmbH, a spin-off from Vienna University of Technology (TU Wien), Austria, presents its tools for CIS pixel simulations:

One common type of APS cell consists of a Pinned Photodiode (PPD) with four NMOS transistors. Such structure can be Backside Illuminated (BSI) or use a transfer gate (TG) transistor with vertical channel for more compact pixels. This produces a 3D cell structure, with:
  1. A pinned photodiode (PPD),
  2. adjacent Transfer Gate (TG) transistor and Floating Diffusion (FD) region,
  3. a readout circuit, usually consisting of
    Source Follower Attenuator (SFA)
    Reset (RST)
    Row Select (RS) transistors

Go to the original article...

2-stage LOFIC Sensor with 120dB DR

Image Sensors World        Go to the original article...

IEEE TED publishes an open access paper "An Over 120 dB Single Exposure Wide Dynamic Range CMOS Image Sensor With Two-Stage Lateral Overflow Integration Capacitor" by Yasuyuki Fujihara, Maasa Murata, Shota Nakayama, Rihito Kuroda, and Shigetoshi Sugawa from Tohoku University. It appears to be a version of an earlier EI 2020 paper.

"This article presents a prototype linear response single exposure CMOS image sensor with two-stage lateral overflow integration capacitors (LOFIC) exhibiting over the 120-dB dynamic range (DR) with 11.4 Me − full well capacity (FWC) and maximum signal-to-noise ratio (SNR) of 70 dB. The measured SNR at all switching points were over 35 dB thanks to the proposed two-stage LOFIC."

Go to the original article...

Sony Article about Awards for Stacked Sensors

Image Sensors World        Go to the original article...

Sony publishes an article about Taku Umebayashi who has been awarded by Medal with Purple Ribbon, one of the medals of honor granted by the Japanese government in April 2020. He also received a number of other awards:

"The Medal with Purple Ribbon is awarded in recognition of outstanding inventions and discoveries in science and technology and excellent achievements in the academic, sports and arts fields. It is conferred twice a year in the spring and autumn. Umebayashi received this medal of honor for his accomplishments in the development of the stacked CMOS image sensor structure.

For this development, he received the Prime Minister’s Award of the National Commendation for Invention for fiscal 2016 (awarded by Japan Institute of Invention and Innovation).

On the recommendation of the institute, he was given the Awards for Science and Technology (Development Category) of the Commendation for Science and Technology by the Minister of Education, Culture, Sports, Science and Technology in fiscal 2018.

The institute also endorsed Umebayashi for the Medal with Purple Ribbon awarded this time."

Taku Umebayashi says:

"First of all, I would like to say that I am very delighted to have received such a renowned medal. I would not have been able to receive it without the cooperation of many fellow workers, so I would like to once again extend my appreciation to them here. I believe I was granted the medal on behalf of Sony.

The technology for which I received the medal is the stacked CMOS image sensor. This structure came to my mind when I was first assigned to the image sensor section in 2008. Loaded with various functions, the sensor has a structure that is compact and suitable for mass production. I presented the idea directly to the boss and received a green light to proceed with the development.

The development of the sensor thus started on impulse. It was put on the market and ended up being well received, but I remember having a very hard time for the first two years because I was always asked whether it would really sell. It took long to establish evidence and the development project had not progressed so well. However, I think it was very good that I took on a challenge that nobody had attempted before and eventually made a product that had not existed in the world. I believe Sony’s corporate culture, which allowed me to take on such a challenge provides a good organizational climate, and served as a driving force behind my reception of the medal.

I was given the medal for this idea, as I was the first to protect it with a patent. Thinking of this, I believe every engineer has a chance to receive such an honor if they write a good patent and attempt to put it into practice. I hope they will take on new challenges and keep creating new things."

Go to the original article...

Sony Article about Awards for Stacked Sensors

Image Sensors World        Go to the original article...

Sony publishes an article about Taku Umebayashi who has been awarded by Medal with Purple Ribbon, one of the medals of honor granted by the Japanese government in April 2020. He also received a number of other awards:

"The Medal with Purple Ribbon is awarded in recognition of outstanding inventions and discoveries in science and technology and excellent achievements in the academic, sports and arts fields. It is conferred twice a year in the spring and autumn. Umebayashi received this medal of honor for his accomplishments in the development of the stacked CMOS image sensor structure.

For this development, he received the Prime Minister’s Award of the National Commendation for Invention for fiscal 2016 (awarded by Japan Institute of Invention and Innovation).

On the recommendation of the institute, he was given the Awards for Science and Technology (Development Category) of the Commendation for Science and Technology by the Minister of Education, Culture, Sports, Science and Technology in fiscal 2018.

The institute also endorsed Umebayashi for the Medal with Purple Ribbon awarded this time."

Taku Umebayashi says:

"First of all, I would like to say that I am very delighted to have received such a renowned medal. I would not have been able to receive it without the cooperation of many fellow workers, so I would like to once again extend my appreciation to them here. I believe I was granted the medal on behalf of Sony.

The technology for which I received the medal is the stacked CMOS image sensor. This structure came to my mind when I was first assigned to the image sensor section in 2008. Loaded with various functions, the sensor has a structure that is compact and suitable for mass production. I presented the idea directly to the boss and received a green light to proceed with the development.

The development of the sensor thus started on impulse. It was put on the market and ended up being well received, but I remember having a very hard time for the first two years because I was always asked whether it would really sell. It took long to establish evidence and the development project had not progressed so well. However, I think it was very good that I took on a challenge that nobody had attempted before and eventually made a product that had not existed in the world. I believe Sony’s corporate culture, which allowed me to take on such a challenge provides a good organizational climate, and served as a driving force behind my reception of the medal.

I was given the medal for this idea, as I was the first to protect it with a patent. Thinking of this, I believe every engineer has a chance to receive such an honor if they write a good patent and attempt to put it into practice. I hope they will take on new challenges and keep creating new things."

Go to the original article...

ADI Unveils 1MP 3.5um Pixel BSI ToF Sensor

Image Sensors World        Go to the original article...

Analog Devices unveils what appears to be the first fruit of cooperation with Microsoft ToF group (former Canesta). The ADSD3100 sensor targets smartphones, AR/VR systems, and machine vision applications in logistics, inventory, industrial, and consumer fields.

The new sensor features:

  • 1024 (horizonal) × 1024 (vertical) pixel array
  • 3.5 μm × 3.5 μm square pixels
  • 1/3.6 inch optical format
  • BSI
  • Depth and intensity imaging
  • 4-wire SPI or 2-wire I2C serial interface
  • Die size: 5.364 mm × 9.799 mm
  • MIPI CSI-2 Tx interface with support for 1, 2, or 4 data lanes, programmable up to 1.5 Gbps per lane
  • Dual, 3.3 V and 1.27 V external supplies, 1.8 V I/O section


For comparison, below are the figures from Microsoft ISSCC 2018 presentation:

Go to the original article...

BrightWay Presents is Automotive Gated Imaging Camera

Image Sensors World        Go to the original article...

BrightWay Imaging publishes its presentation at Autosens Brussels this year:


Go to the original article...

Credit Suisse on Smartphone Camera Market

Image Sensors World        Go to the original article...

IFNews quotes Credit Suisse market report saying that "nearly all 5G smartphones hitting the market continue to feature at least 3 cameras. However, the ratio of quad-camera models has declined (from 62% in Apr–Jun 2020 to 45% in Jul–Sep 2020), while the ratio of triple-camera models has risen (from 38% to 50%). This is because shipments of mid-market smartphones increased. Quad-cam products continue to account for a high proportion of sales in the premium segment (USD800 models and above). In addition, the quad-cam ratio is still rising for 4G and earlier generation smartphones."


Credit Suisse estimates that CIS production capacity increased by about 14.5% YoY in 2020 and expects it to rise by another 12% in 2021.


According to Pingan Securities, smartphones in 2019 had 3.1 cameras on average, and this number is forecasted to increase to 4.3 in 2021. The market size of mobile phone CIS in 2019 was $13.6B, and is expected to reach $21.8B in 2022 at YoY growth rate of 17%.

Go to the original article...

Huawei Unveils its First Automotive LiDAR and Begins Pilot Production

Image Sensors World        Go to the original article...

CnTechPost, GizChina, InfNews, Huawei: Huawei announces its first automotive LiDAR product. Few key points from the announcement:

  • 120 x 25 deg FOV
  • 0.25 x 0.26 deg resolution
  • 96 lines
  • 150m range at 10% target reflectivity
  • 200m range at 50% target reflectivity
  • BAIC (Beijing Automotive) is the first customer
  • Huawei has built a pilot production line with capacity of 100K units per year
  • The development has started in 2016 and took 4 years
Now, an interesting question is whether Huawei succeeds to capture a major LiDAR player position, like it did in smartphones?

Go to the original article...

Hot, Cold, Warm, and Cool Pixels in Event-Driven Cameras

Image Sensors World        Go to the original article...

Australian National University paper "Event Camera Calibration of Per-pixel Biased Contrast Threshold" by Ziwei Wang, Yonhon Ng, Pieter van Goor, and Robert Mahony discusses pixel mismatch issues in event-driven cameras:

  • Hot Pixels are pixels that have lower threshold values than the assumed value. This means that both positive and negative events are generated more often than expected.
  • Cold Pixels are pixels that have higher threshold values than the assumed value. This means that both positive and negative events are generated less often than expected.
  • Warm Pixels are pixels that have negative bias values. This means positive events are triggered more often, and negative events are triggered less often than expected.
  • Cool Pixels are pixels that have positive bias values. This means negative events are triggered more often, and positive events are triggered less often than expected.

Go to the original article...

BMW In-cabin Monitoring with Melexis ToF Camera

Image Sensors World        Go to the original article...

Melexis publishes a video on its Autosens-Detroit presentation ofToF in-cabin monitoring camera in BMW cars:

Go to the original article...

Ouster Goes Public via Merger with SPAC

Image Sensors World        Go to the original article...

BusinessWire: San Francisco-based LiDAR startup Ouster is said to close a deal to go public at a about $1.9B valuation through a merger with SPAC Colonnade Acquisition Corp. Up to now, Ouster has raised $142M in the previous investment rounds.

The new transaction is expected to provide up to $300M in gross proceeds, comprised of Colonnade Acquisition Corp.’s $200M of cash held in trust and a $100M fully committed common stock PIPE.

The company's Investor Presentation talks about its LiDAR sales and forecasts:

Go to the original article...

2021 International Image Sensor Workshop Call for Papers

Image Sensors World        Go to the original article...

The next International Image Sensor Workshop (IISW) is going to be an on-line event on Sept. 20-24, 2021. The First Call for Papers has been published on International Image Sensor Society web site:

"The 2021 International Image Sensor Workshop (IISW) provides a biennial opportunity to present innovative work in the area of solid-state image sensors and share new results with the image sensor community. Now in its 35th year, the workshop is intended for image sensor technologists; in order to encourage attendee interaction and a shared experience, attendance is limited, with strong acceptance preference given to workshop presenters. As is its tradition, the 2021 workshop will emphasize an open exchange of information among participants.

Submission of abstracts:

An abstract should consist of a single page of maximum 500-words text with up to two pages of illustrations, and include authors’ name(s) and affiliation, mailing address, telephone and e-mail address. The deadline for abstract submission is April 17th, 2021 (CST).

Please visit http://imagesensors.org/CFP2021 for the abstract and paper submission procedures.

Abstracts will be considered on the basis of originality and quality. High quality papers on work in progress are also welcome. Abstracts will be reviewed confidentially by the Technical Program Committee and the IISS Board.

Authors will be notified of the acceptance of their abstract by June 3th, 2021.
Final-form 4-page paper submission date is August 6th, 2021.
Presentation material submission date is September 13th, 2021.

Location and format: 

The IISW 2021 is planned to be held Sept 20-24th. Given the outlook of the pandemic situation and related travel restrictions, the workshop is expected to be an online event, which will be supported by several initiatives to preserve its interactive and open atmosphere. The workshop will not be delayed: in any case the selected papers will be presented in September 2021. More details on the format will be provided in February 2021 with the final call for papers."

Go to the original article...

Review of MoS2 Based Photodetectors

Image Sensors World        Go to the original article...

Royal Society of Chemistry publishes "A review of molybdenum disulfide (MoS2) based photodetectors: from ultra-broadband, selfpowered to flexible devices" by Hari Singh Nalwa from Advanced Technology Research, CA.

"Two-dimensional transition metal dichalcogenides (2D TMDs) have attracted much attention in the field of optoelectronics due to their tunable bandgaps, strong interaction with light and tremendous capability for developing diverse van der Waals heterostructures (vdWHs) with other materials. Molybdenum disulfide (MoS2) atomic layers which exhibit high carrier mobility and optical transparency are very suitable for developing ultra-broadband photodetectors to be used from surveillance and healthcare to optical communication. This review provides a brief introduction to TMD-based photodetectors, exclusively focused on MoS2-based photodetectors. The current research advances show that the photoresponse of atomic layered MoS2 can be significantly improved by boosting its charge carrier mobility and incident light absorption via forming MoS2 based plasmonic nanostructures, halide perovskites–MoS2 heterostructures, 2D–0D MoS2/quantum dots (QDs) and 2D–2D MoS2 hybrid vdWHs, chemical doping, and surface functionalization of MoS2 atomic layers. By utilizing these different integration strategies, MoS2 hybrid heterostructure-based photodetectors exhibited remarkably high photoresponsivity raging from mA W^−1 up to 1010 A W^−1, detectivity from 1e7 to 1e15 Jones and a photoresponse time from seconds (s) to nanoseconds (1e−9 s), varying by several orders of magnitude from deep-ultraviolet (DUV) to the long-wavelength infrared (LWIR) region. The flexible photodetectors developed from MoS2-based hybrid heterostructures with graphene, carbon nanotubes (CNTs), TMDs, and ZnO are also discussed. In addition, strain-induced and self-powered MoS2 based photodetectors have also been summarized. The factors affecting the figure of merit of a very wide range of MoS2-based photodetectors have been analyzed in terms of their photoresponsivity, detectivity, response speed, and quantum efficiency along with their measurement wavelengths and incident laser power densities. Conclusions and the future direction are also outlined on the development of MoS2 and other 2D TMD-based photodetectors."

Go to the original article...

100Mfps HDR Sensor

Image Sensors World        Go to the original article...

University of Strasbourg and CNRS, France, publishes a paper "A High Dynamic Range High Speed Pixel Operating at 100 Million Frames Per Second" by Mathieu Hugoud, Wilfried Uhring, Jean-Baptiste Kammerer, and Jean-Bapstiste Schell presented at 2020 18th IEEE International New Circuits and Systems Conference (NEWCAS).

"The burst imaging concept is a specific imaging method than allows achieving a pixel rate of about 1 Tera pixel per second. This huge data rate can be reached by storing the video frames within the sensor, thus circumventing the bottleneck of the input/output of the sensor. Consequently, a frame rate of several Mega frames per second (Mfps) can be obtained and the use of a fast pixel front end is mandatory. In this paper, a pixel front able to operate at a frame rate of 100 Mfps is proposed. Based on a current mirroring integration approach, it offers a high dynamic range feature compatible with the record of the very fast moving object without blurring effect. The feature is carried out by mirroring in parallel the photocurrent into several integration capacitances. The pixel consumption is as low as 12 μW for one single gain branch at 10 Mfps and 118μW at a frame rate of 100 Mpfs."

Go to the original article...

Review of ToF Approaches

Image Sensors World        Go to the original article...

Arxiv.org paper "An Overview of Depth Cameras and Range Scanners Based on Time-of-Flight Technologies" by Radu Horaud, Miles Hansard, Georgios Evangelidis, and Clement Menier from INRIA Grenoble, Queen Mary University of London, and 4D View Solutions mostly repeats 2016 paper published by Springer.

"Time-of-flight (TOF) cameras are sensors that can measure the depths of scene-points, by illuminating the scene with a controlled laser or LED source, and then analyzing the reflected light. In this paper, we will first describe the underlying measurement principles of time-of-flight cameras, including: (i) pulsed-light cameras, which measure directly the time taken for a light pulse to travel from the device to the object and back again, and (ii) continuous-wave modulated-light cameras, which measure the phase difference between the emitted and received signals, and hence obtain the travel time indirectly. We review the main existing designs, including prototypes as well as commercially available devices. We also review the relevant camera calibration principles, and how they are applied to TOF devices. Finally, we discuss the benefits and challenges of combined TOF and color camera systems."

Go to the original article...

Intel Introduces "Visual Sensing Controller" for PC

Image Sensors World        Go to the original article...

Intel presents a new addition to its EVO PC platform:

"A new platform addition we’re excited to unveil today is the Intel Visual Sensing Controller (codenamed “Clover Falls”), a secure companion chip that helps make PCs more smart and secure through the power of Intel artificial intelligence. This companion module will first arrive in commercial systems, bringing new low-power capabilities to the PC and helping it sense and adapt to its surroundings. For example, the module could help the system automatically adjust display brightness after detecting user presence."

Go to the original article...

css.php