Image Sensors World Go to the original article...
AllTechAsia, ChinaMoneyNetwork: Alibaba investment arm Ant Financial leads Orbbec financing round D of $200m. Other investors include SAIF Partners, R-Z Capital, Green Pine Capital Partners, and Tianlangxing Capital. The structured light 3D camera maker Orbbec is said to be the fourth largest company in the world to mass produce 3D sensors for consumer use. Orbbec says that its solution is now used by over 2,000 companies globally, and can be applied in various fields, including unmanned retail, auto-driving, home systems, smart security, robotics, Industry 4.0, VR/AR, etc.Archives for June 2018
Hayabusa2 Takes Pictures of Ryugu
Image Sensors World Go to the original article...
JAXA: Japanese asteroid explorer Hayabusa2 has arrived to the distance of 20km to Ryugu, the target asteroid, after three and a half years en route. The explorer landing module is expected to bring a sample of asteroid back to Earth in December 2020.Here is one of the first Ryugu images from a short distance:
Talking about Hayabusa2 cameras, there are 4 of them:
Omnivision Loses Lawsuit Against SmartSens
Image Sensors World Go to the original article...
SmartSens kindly sent me an official update on Omnivision lawsuit against Smartsens:"SHANGHAI, June 25, 2018 – SmartSens, a leading provider of high-performance CMOS image sensors, responded to its patent infringement lawsuit today.
With regard to the recent lawsuit that accused SmartSens of infringing patents No. 200510052302.4 (titled “CMOS Image Sensor Using Shared Transistors between Pixels”) and No. 200680019122.9 (titled “Pixel with Symmetrical Field Effect Transistor Placement”), the Patent Reexamination Board of State Intellectual Property Office of the People’s Republic of China has ruled the two patents in question invalid.
According to the relevant judicial interpretation of the Supreme People’s Court, the infringement case regarding the above-mentioned patents will be dismissed.
“As a company researching, developing and utilizing technology, we pay due respect to intellectual property. However, we will not yield to any false accusations and misuse of intellectual property law,” said SmartSens CTO Yaowu Mo, Ph.D. “SmartSens will take legal measures to not only defend the company and its property, but also protect our partners’ and clients’ interest. SmartSens attributes its success to our talent and intellectual property. In this case, we are pleased to see that justice is served and a law-abiding company like SmartSens is protected.”
Thus far, SmartSens has applied for more than 100 patents, of which 75 were submitted in China and more than 20 have been granted. More than 30 patent applications were submitted in the United States, and more than 20 have been granted.
About SmartSens
SmartSens Technology Co., Ltd, a leading supplier of high-performance CMOS imaging systems, was founded by Richard Xu, Ph.D. in 2011. SmartSens’ R&D teams in Silicon Valley and Shanghai develop industry-leading image sensing technology and products. The company receives strong support from strategic partners and an ISO-Certified supply chain infrastructure, and delivers award-winning imaging solutions for security and surveillance, consumer products, automotive and other mass market applications."
LiDARs in China
Image Sensors World Go to the original article...
ResearchInChina publishes "Global and China In-vehicle LiDAR Industry Report, 2017-2022." Few quotes:"Global automotive LiDAR sensor market was USD300 million in 2017, and is expected to reach USD1.4 billion in 2022 and soar to USD4.4 billion in 2027 in the wake of large-scale deployment of L4/5 private autonomous cars. Mature LiDAR firms are mostly foreign ones, such as Valeo and Quanergy. Major companies that have placed LiDARs on prototype autonomous driving test cars are Velodyne, Ibeo, Luminar, Valeo and SICK.
Chinese LiDAR companies lag behind key foreign peers in terms of time of establishment and technology. LiDARs are primarily applied to autonomous logistic vehicles (JD and Cainiao) and self-driving test cars (driverless vehicles of Beijing Union University and Moovita). Baidu launched Pandora (co-developed with Hesai Technologies), the sensor integrating LiDAR and camera, in its Apollo 2.5 hardware solution.
According to ADAS and autonomous driving plans of major OEMs, most of them will roll out SAE L3 models around 2020. Overseas OEMs: PAS SAE L3 (2020), Honda SAE L3 (2020), GM SAE L4 (2021+), Mercedes Benz SAE L3 (Mercedes Benz new-generation S in 2021), BMW SAE L3 (2021). Domestic OEMs: SAIC SAE L3 (2018-2020), FAW SAE L3 (2020), Changan SAE L3 (2020), Great Wall SAE L3 (2020), Geely SAE L3 (2020), and GAC SAE L3 (2020). The L3-and-above models with LiDAR are expected to share 10% of ADAS models in China in 2022. The figure will hit 50% in 2030."
13NewsNow talks about Tesla denying the need in LiDAR altogether: "Tesla has looked to cameras and radar — without lidar — to do much of the work needed for its Autopilot driver assistance system.
But other automakers and tech companies rushing to develop autonomous cars — Waymo, Ford and General Motors, for instance — are betting on lidar.
"Tesla's trying to do it on the cheap," [Sam Abuelsamid, an analyst with Navigant Research] said. "They're trying to take the cheap approach and focus on software. The problem with software is it's only as good as the data you can feed it."
Velodyne CTO Promotes High Resolution LiDAR
Image Sensors World Go to the original article...
Velodyne publishes a video with its CTO Anand Gopalan talking about VLS-128 improvements and features:Vivo Smartphone ToF Camera is Official Now
Image Sensors World Go to the original article...
PRNewswire: Vivo reveals its TOF 3D Sensing Technology "with the promise of a paradigm shift in imaging, AR and human-machine interaction, which will elevate consumer lifestyles with new levels of immersion and smart capability."Vivo's TOF 3D camera features 300,000 depth pixel resolution, which is said to be 10x the number of existing Structured Light Technology. It enables 3D mapping at up to 3m from the phone while having a smaller baseline than Structured Light. TOF 3D Sensing Technology is also simpler and smaller in structure and allows for more flexibility when embedded in a smartphone. This will enable much broader application of this technology than was previously possible.
Vivo's TOF 3D Sensing Technology is no mere proof of concept. The technology is tested and meets industry standards required for integration with current apps soon. Beyond facial recognition, TOF 3D Sensing Technology will open up new possibilities for entertainment as well as work.
Sony FE 400mm f2.8 GM OSS review so far
Cameralabs Go to the original article...
The FE 400mm f2.8 GM OSS is the first super-telephoto for Sony's full-frame Alpha mirrorless system. Aimed at pro sports and wildlife photographers, it boasts sharp results across the frame, very fast autofocus and is comfortably lighter than rivals. I tried it out for my review-so-far!…
The post Sony FE 400mm f2.8 GM OSS review so far appeared first on Cameralabs.
Samsung Cooperates with Fujifilm to Improve Color Separation
Image Sensors World Go to the original article...
BusinessWire: Samsung introduces its new 'ISOCELL Plus' technology. The original ISOCELL circa 2013 forms a physical barrier between the neighboring pixels, reducing color crosstalk and expanding the full-well capacity.With the introduction of ISOCELL Plus, Samsung improves isolation through an optimized pixel architecture. In the existing pixel structure, metal grids are formed over the photodiodes to reduce interference between the pixels, which can also lead to some optical loss as metals tend to reflect and/or absorb the incoming light. For ISOCELL Plus, Samsung replaced the metal barrier with an innovative new material developed by Fujifilm, minimizing optical loss and light reflection.
“We value our strategic relationship with Samsung and would like to congratulate on the completion of the ISOCELL Plus development,” said Naoto Yanagihara, CVP of Fujifilm. “This development is a remarkable milestone for us as it marks the first commercialization of our new material. Through continuous cooperation with Samsung, we anticipate to bring more meaningful innovation to mobile cameras.”
The new ISOCELL Plus delivers higher color fidelity along with up to a 15% enhancement in light sensitivity. The technology is said to enable pixel scaling down to 0.8µm and smaller without a loss in performance.
“Through close collaboration with Fujifilm, an industry leader in imaging and information technology, we have pushed the boundaries of CMOS image sensor technology even further,” said Ben K. Hur, VP of System LSI marketing at Samsung Electronics. “The ISOCELL Plus will not only enable the development of ultra-high-resolution sensors with incredibly small pixel dimensions, but also bring performance advancements for sensors with larger pixel designs.”
Vivo to Integrate ToF Front Camera into its Smartphone
Image Sensors World Go to the original article...
Gizchina reports that Vivo is about to announce a ToF 3D camera integration into its smartphone at the end of this month:"In addition to being able to recognize human faces better and more quickly, the recognition distance can be enhanced. Moreover, it does not require the face to be in front of the screen to process. this technology is very likely to be used in a flagship model launched in the second half of the year."
Samsung to Use EUV in Image Sensors Manufacturing
Image Sensors World Go to the original article...
Samsung investors presentation on June 4, 2018 in Singapore talks about an interesting development at the company's S4 fab:"S4 line provides CMOS image sensor using 45-nanometer and below process node, and we are building EUV line. We started constructing in February this year."
Samsung has been using 28nm design rules in its image sensors for quite a some time. EUV seems to be a natural next step to avoid double patterning limitations on the pixel layout (double patterning is commonly used starting from 22nm node.)
EUV Lithography Drives EUV Imaging
Image Sensors World Go to the original article...
CNET: As Samsung endorses EUV at its 7nm process node, the new generation of photolithography is finally here, after 30 years in development:ASML cooperates with Imec to develop 13.5nm-wavelength image sensors for its EUV machines:
Photon Counting History
Image Sensors World Go to the original article...
Edward Fisher from the University of Edinburgh, UK publishes "Principles and Early Historical Development of Silicon Avalanche and Geiger-Mode Photodiodes" chapter in an open source "Photon Counting" book.The chapter is a historical literature review for the development of solid-state photodetection and avalanche multiplication between 1900 and 1969 based on 110+ primary sources that are key in the field over that time.
The author is looking to fill some of the gaps for a later Springer book covering 1900 to 1999, i.e. 100 years of solid-state photodetection with a distinct avalanche focus (with significantly more detail). Edward Fisher is looking for any key papers or patents the readers of this blog think should be included for the 1900-1969 period.
When the full 1900-1999 analysis is finished, Edward aims for it to be the de-facto literature reference for the field, as it is often difficult for busy technical researchers to either find or read some of the older literature.
"The historical development of technology can inform future innovation, and while theses and review articles attempt to set technologies and methods in context, few can discuss the historical background of a scientific paradigm. In this chapter, the nature of the photon is discussed along with what physical mechanisms allow detection of single-photons using solid-state semiconductor-based technologies. By restricting the scope of this chapter to near-infrared, visible and near-ultraviolet detection we can focus upon the internal photoelectric effect. Likewise, by concentrating on single-photon semiconductor detectors, we can focus upon the carrier-multiplication gain that has allowed sensitivity to approach the single-photon level. This chapter and the references herein aim to provide a historical account and full literature review of key, early developments in the history of photodiodes (PDs), avalanche photodiodes (APDs), single-photon avalanche diodes (SPADs), other Geiger-mode avalanche photodiodes (GM-APDs) and silicon photo-multipliers (Si-PMs).
As there are overlaps with the historical development of the transistor (1940s), we find that development of the p-n junction and the observation of noise from distinct crystal lattice or doping imperfections – called “microplasmas” – were catalysts for innovation. The study of microplasmas, and later dedicated structures acting as known-area, uniform-breakdown artificial microplasmas, allowed the avalanche gain mechanism to be observed, studied and utilised."
Holst Centre and Imec Present Organic Fingerprint Sensor
Image Sensors World Go to the original article...
Charbax publishes a video demo of Imec and Holst Centre organic image sensor:Pico Presents Zense ToF Camera
Image Sensors World Go to the original article...
NotebookItalia: China-based Pico presents Zense camera, its first foray into ToF sensing. The depth processing is based on Rockchip RV1108 with CEVA XM4 vision IP core:Yole Forecast on 3D Sensing Market
Image Sensors World Go to the original article...
Yole Developpement publishes "3D Imaging & Sensing 2018" report:"Apple set the standard for technology and use-case for 3D sensing in consumer. From our initial depiction of the market in March 2017, the main gap is in illumination ASP, which is greater than expected. High expenses in dot and flood illumination VCSELs from Lumentum/II-VI/Finisar, along with the dot illuminator optical assembly from ams, are the biggest technology surprises powering Apple’s $1,000 [iPhone X] smartphone.
Yole Développement (Yole) expects the global 3D imaging & sensing market to expand from $2.1B in 2017 to $18.5B in 2023, at a 44% CAGR. Along with consumer, automotive, industrial, and other high-end markets will also experience a double-digit growth pattern.
The transition from imaging to sensing is happening before our eyes. Despite half-successful attempts like Xbox’s Kinect technology and Leap-Motion hand controllers, 3D sensing is now tracking towards ubiquitousness.
Oppo made the first announcement beginning of the year with Orbeec, while Xiaomi released the Mi 8 explorer edition with Mantis as a technology partner. We expect Huawei to release its own solution soon, probably partnering with ams and Sunny Optical.
...players like Himax are currently paying the price for a lower-performance offering and are struggling to get design-ins beyond AR/VR headsets for Microsoft.
Unlike previous sensing components, the responsibility of system design does not fall on the OEM - instead, a specialist is required, such as the Primesense team that Apple acquired in 2013, or other firms like Mantis, Orbbec, and ams, which want play the “specialist” role in the new 3D imaging & sensing ecosystem. Such players orchestrate the final solution while allowing room for the best in each sub-component category.
Is 3D imaging & sensing now ripe for disruption? Yole expects it will take at least 2 -3 years before any new solution start dramatically lowering total system cost."
Smithers Report on Technology Challenges for Image Sensors in ADAS & Autonomous Vehicle
Image Sensors World Go to the original article...
Smithers Apex publishes a report "Technology Challenges for Image Sensors in ADAS & Autonomous Vehicle Markets to 2023." Few quotes:"...as vehicles approach full autonomy, the need for human-friendly colour reproduction becomes redundant, and the quality requirements on the image sensing for computer vision will increase further. A high dynamic range of 140 dB, resolutions of 8 MP for mono vision and at least 2MP for stereo vision cameras, frame rates beyond 60 fps, a sensitivity of several thousand electrons per lux and second are requested.
At the same time the noise performance should ensure a signal to noise ratio of 1 at 1 millilux, and an exposure time of less than 1/30 s. High dynamic range shall be achieved by as few as possible exposures to minimise motion blur. The compensation of the flickering of LED traffic signs and lights as described in the previous section is even more important for level 4 and 5 vehicles."
SWIR Startup Trieye Raises $3m of Seed Money
Image Sensors World Go to the original article...
Globes: Israeli startup TriEye announces the completion of a $3m seed round led by Grove Ventures. TriEye develops SWIR sensors providing autonomous cars heightened visual capabilities in restricted visual conditions at significantly reduced cost. The technology is based on many years of research at the Hebrew University of Jerusalem by Prof. Uriel Levy.TriEye cofounder and CEO Avi Bakal says, "The company is offering capabilities that in the past were only accessible to defense and aerospace industries and at a minimal cost compared with the past. This capability improves the safety of advanced driver-assistance systems and is a major step forward to the extensive adoption of the technology by the carmakers."
AutoSens Brussels Agenda
Image Sensors World Go to the original article...
Autosens Brussels to be held in September 2018 announces its preliminary speakers list. There is quite a lot of image sensors presentations:- Introduction to the world of Time-of-Flight for 3D imaging, Albert Theuwissen, Harvest Imaging (Tutorial)
- Do we have a lidar bubble? Panel discussion
- Vehicle perception of humans – what level of image quality is needed to recognise behavioural intentions, Panel discussion
- A review of the latest research in photonics-sensor technologies in automotive, Michael Watts, Analog Photonics
- Automotive HDR imaging – the history and future, Mario Heid, Omnivision
- Self-driving cars and lidar, Simon Verghese, Waymo
- Tier 1 achievements with solid state lidar, Filip Geuens, Xenomatix
- An Approach to realize “Safety Cocoon”, Yuichi Motohashi, Sony
- How AI/Computer Vision affects camera design and SOC design, Marco Jacobs, videantis
- Objective and Application Oriented Characterisation of Image Sensors with EMVA’s 1288 Standard, Bernd Jaehne, EMVA 1288 Chair
- Review of IEEE P2020 developments, Patrick Denny, Valeo
Xintec Unable to Fill 12-inch WLP Line
Image Sensors World Go to the original article...
Digitimes reports that Xintec has hard time recovering from the loss of its major investor and customer Omnivision. The company has decided to suspend its 12-inch WLP production line for a year due to disappointing demand for mass-market applications. The 12-inch line workforce will be transferred to 8-inch lines to improve revenue and profit.Tunable Plasmonic Filters Enable Time-Sequential Color Imaging
Image Sensors World Go to the original article...
ACS Photonics paper "Tunable Multispectral Color Sensor with Plasmonic Reflector" by Vladislav Jovanov, Helmut Stiebig, and Dietmar Knipp from Jacobs University Bremen and Institute of Photovoltaics Jülich, Germany proposes plasmonic reflectors for color imaging:"Vertically integrated color sensors with plasmonic reflectors are realized. The complete color information is detected at each color pixel of the sensor array without using optical filters. The spectral responsivity of the sensor is tuned by the applied electric bias and the design of the plasmonic reflector. By introducing an interlayer between the lossy metal back reflector and the sensor, the reflectivity can be modified over a wide spectral range. The detection principle is demonstrated for a silicon thin film detector prepared on a textured silver back reflector. The sensor can be used for RGB color detection replacing conventional color sensors with optical filters. Combining detectors with different spectral reflectivity of the back reflector allows for the realization of multispectral color sensors covering the visible and the near-infrared spectral range.
To our knowledge for the first time a sensor is presented that combines a spatial color multiplexing scheme (side-by-side arrangement of the individual color channels) used by conventional color sensors with the time multiplexing scheme (sequential read-out of colors) of a vertically integrated sensor."
Daqri on Importance of Latency in AR/VR Imaging
Image Sensors World Go to the original article...
Daqri Chief Scientist Daniel Wagner publishes an article "Motion to Photon Latency in AR and VR applications:"Daqri tells about its latency optimization achievements: "Overall, what is the final latency we can achieve with such a system? The answer is: It depends. If we consider rendering using the latest 6DOF pose estimates as the last step in our pipeline that produces fully correct augmentations then achieving a latency of ~17ms is our best-case scenario.
However, late warping can correct most noticeable artefacts, so it makes sense to treat it as valid part of the pipeline. Without using forward prediction for late warping, we can achieve a physical latency of 4 milliseconds per color channel in our example system. However, 4 milliseconds is such a short length of time, making forward prediction almost perfect and pushing perceived latency towards zero. Further, we could actually predict beyond 4ms into the future to achieve a negative perceived latency. However, negative latency is just as unpleasant as positive latency, so this would not make sense for our scenario."
Velodyne Lidar 101
Image Sensors World Go to the original article...
Velodyne publishes a promotional video explaining its technology:WD My Passport Wireless SSD review
Cameralabs Go to the original article...
The WD My Passport Wireless SSD is a smart drive that lets you backup SD cards in the field without lugging around a laptop. Built-in Wifi lets you browse or share the drive with phones or tablets or even stream content to a smart TV. Find out if it's your ideal backup in my review! …
The post WD My Passport Wireless SSD review appeared first on Cameralabs.
Lucid Demos Sony Polarization Sensor
Image Sensors World Go to the original article...
LUCID Vision Labs demos Sony IMX250MYR polarized color sensor in its Phoenix camera family. The 5 MP GS sensor with 3.45µm pixel and frame rates of up to 24 fps is based on the popular IMX250 Sony Pregius CMOS color sensor with polarizing filters added to the pixel. The sensor has four different directional polarizing filters (0°, 90°, 45°, and 135°) on every four pixels:Panasonic Develops 250m-Range APD-based ToF Sensor
Image Sensors World Go to the original article...
Panasonic has developed a TOF image sensorthat uses avalanche PD (APD) pixels and is capable of capturing range imaging of objects up to 250m even at night with poor visibility (there is no mention what is the range in mid-day sunlight). The new sensor applications include automotive range imaging and wide-area surveillance in the dark.The ToF pixel includes an APD and an in-pixel circuit that integrates weak input signals to enables the 3D range imaging 250 m ahead. The sensor resolution is said to be the world's highest 250,000 pixels for a sensor based on electron-multiplying pixels. This high integration is achieved through the lamination of the electron multiplier and the electron storage as well as the area reduction of APD pixels.
The key innovative technologies are:
- The area of APD pixels is significantly reduced while the multiplication performance is maintained through the lamination of the multiplier that amplifies photoelectrons and the electron storage that retains electrons.
The APD multiplication factor is 10,000. - Long-range measurement imaging technology
Trioptics Active Alignment, Assembly and Testing of Camera Modules
Image Sensors World Go to the original article...
Germany-based Trioptics demos Procam, its modular manufacturing line for active alignment, assembly and testing of camera modules in mass production:Fiat-Chrysler Autonomous Car Relies on 5 LiDARs and 8 Cameras
Image Sensors World Go to the original article...
Fiat-Chrysler 5-year plan presentation shows its Level 4 autonomous car with 5 LiDARs and 8 cameras. Most of the LiDARs are defined as "mid-range" possibly meaning their range is shorter than 200m for a cheaper price:Gil Amelio on Patent Infrigements
Image Sensors World Go to the original article...
Investors Business Daily publishes Gil Amelio article with a story of Pictos vs Samsung lawsuit:"A typical small inventive company, Pictos Technologies, was put out of business after Samsung aggressively infringed its intellectual property.
Pictos invented an inexpensive image sensor that could be used in countless applications such as mobile phones and automobile cameras, to name only two. This next-generation Image Sensor was a follow-on to my dozen or so image-sensing patents that helped launch the solid-state image-sensor business years earlier. The Pictos technology, developed after years of investment and design, was protected by a portfolio of patents obtained at substantial cost.
In 2014, Pictos sued Samsung in federal court, alleging that it had "willfully infringed" its intellectual property. After years of costly litigation, the case went to trial, where Pictos lawyers introduced evidence that proved Samsung began as a Pictos customer, secretly copied its engineering designs and production process, and replicated them in Korea. Using our technology and its sizable scale, it went on to dominate this sector of the world electronics market.
Following lengthy litigation, the jury ruled in our favor and awarded substantial damages. The judge then trebled the damages based on "evidence of (Samsung's) conduct at the time of the accused infringement." Please note: Samsung's behavior was so egregious that the judge tripled the jury determination of the infringement costs to us.
That was just the first round, though. The verdict can be overturned on appeal, which, of course, Samsung has filed."
Update: Once we are at historical stuff, SemiWiki publishes Mentor Graphics CEO Wally Rhines memories from the early days of CCD and DRAM imagers in Stanford University in 1960s.
Microsoft Opens Access to Hololens Cameras
Image Sensors World Go to the original article...
Microsoft opens access to a raw video stream from cameras in its Hololens AR headset, including 3D ToF camera:"The depth camera uses active infrared (IR) illumination to determine depth through time-of-flight. The camera can operate in two modes. The first mode enables high-frequency (30 FPS) near-depth sensing, commonly used for hand tracking, while the other is used for lower-frequency (1-5 FPS) far-depth sensing, currently used by spatial mapping. In addition to depth, this camera also delivers actively illuminated IR images that can be valuable in their own right because they are illuminated from the HoloLens and reasonably unaffected by ambient light."
Canon and Nikon pro mirrorless wishlist
Cameralabs Go to the original article...
Canon and Nikon may have concentrated on entry to mid-level mirrorless cameras so far, but both companies are expected to launch high-end models by the end of the year. In a special edition of the cameralabs video podcast, Gordon and Doug discuss their wishlist with contributions by six special guests!…
The post Canon and Nikon pro mirrorless wishlist appeared first on Cameralabs.