Expanded Imaging Processing Options
Total Page:16
File Type:pdf, Size:1020Kb
Expanded Imaging Processing Options Mathew Arcoleo May. 2021 1 © 2021 OmniVision | Security B: Highly Confidential Safe Harbor Statement Except for historical information, the matters discussed in this presentation may contain forward- looking statements. These forward-looking statements are only estimates, and are subject to risks and uncertainties that may affect actual outcomes. Actual events or results may differ materially, and OmniVision disclaims any obligation to update information contained in any forward-looking statement. 2 © 2021 OmniVision | Security B: Highly Confidential Automotive Trends Higher performance expectation across sensor KPI High Dynamic Range (HDR) of 140 dB LED Flicker Mitigation (LFM) Low light performance More pixels and smaller pixel Additional functionality for next-generation use cases Cybersecurity, advanced ROI Global shutter with high Near-Infrared (NIR) Quantum Efficiency (QE), and small form factor Low power across automotive segment 3 © 2021 OmniVision | Security B: Highly Confidential Synergy Across Segments Sub-micron Pixel Global Shutter Smear/ Increase Sensitivity Distortion Free Capture 4-cell 9-cell 16-cell RCCB RYYB Mobile B G B G G R Non-Bayer CF G R Nyxel® Split-pixel/DCG Enhancing NIR QE 4-Cell HDR Imaging HDR GS Nyxel® Security Auto 4 © 2021 OmniVision | Security B: Highly Confidential OX08B40 5 © 2021 OmniVision | Security B: Highly Confidential OX08B40 Target for Front and Surround Sensing Application in ADAS/AD 1st 8.3MP sensor with LFM 1st 8.3MP sensor using optimal HDR scheme for AD (DCG) 1st 82 dB motion free and no SNR drop ~140 dB dynamic range Flare free by design AEC free solution Lowest power consumption Enable 1.7W camera module P2P compatible with OX08A 1 camera design for LFM and non-LFM image sensor 6 © 2021 OmniVision | Security B: Highly Confidential OX08B40 HDR and LFM AEC Free Control Dual Conversion Gain (DCG), SPD HCG (dB) LCG (dB) SPD (dB) VS (dB) and VS 50.0 Sensor on chip combination to 24- bit 40.0 >140 dB enables system 30.0 simplification and no need for AEC control 20.0 Accelerates system bring-up SNR (dB) 10.0 Improved safety, less communciation between sensor and host 0.0 1.0E-03 1.0E-01 1.0E+01 1.0E+03 1.0E+05 • No risk of wrong gain/exposure -10.0 information being sent Pixel illumination 7 © 2021 OmniVision | Security B: Highly Confidential Multiple Regions of Interest (ROI) Output the Most Relevant Data X8B/A offers 2 independent and configurable ROI 2 independent Each ROI can ROI crop to 640 x 480 Reducing BW and offering flexibility in AD applications Total (max) BW = ROI1+ROI2, user configurable Data transferred using different VC Crop Binning Crop Full resolution 8 © 2021 OmniVision | Security B: Highly Confidential Cybersecurity AD Must-have for AD, X8A/B is first product family supporting cybersecurity Threat model addresses key situations and prevents insertion of fake images/videos Replacement by a pirate device Tandem attack (= provide fake data to the CPU) State-of-the-art crypto-system implementation Sensor – CPU communication: SHA-256 engine for authenticating video data Secret key received from host CPU decryption: RSA-2k engine One secret key per device Low power implementation (<50 mW) 9 © 2021 OmniVision | Security B: Highly Confidential OX08B40 Videos HDR+LFM Light Tunnel Building Details LEDs not flickering 10 © 2021 OmniVision | Security B: Highly Confidential OX08B40 Videos HDR+LFM Day Individual LEDs 11 © 2021 OmniVision | Security B: Highly Confidential OX08B40 Videos HDR+LFM Night Individual LEDs 12 © 2021 OmniVision | Security B: Highly Confidential OX03C10 + OAX4000 13 © 2021 OmniVision | Security B: Highly Confidential OX03C10 Solution ─ Technology Innovation PureCel®-S + HALE Algorithm + Split-pixel and Deep Well™ Dual Conversion Gain OX03C10 image sensor Traditional PureCel® BSI Non-Stack Die Stacked Die 3 µm DCG and SP 140 dB HDR and LFM Ultra low power consumption ASIL-C 1920 x 1280p resolution at 60 fps Smaller Die Support Higher full well Substrate Analog / Digital Image Array 14 © 2021 OmniVision | Security B: Highly Confidential Next Generation Tone-Mapping Previous tone-mapping was based on changing local Previous Tone-Mapping Gamma via local mean Next generation addresses these issues Local Contrast Enhancement based on Local Histogram Base Tone Curve Correction Control the total curve based on the local histogram 15 © 2021 OmniVision | Security B: Highly Confidential Advanced Architectures Using the OAX4000 SVS/Fusion OAX4000 increases capabilities Support for 4 cameras Multiple CFA pattern support MV/HV pipelines Solution Advantage High performance: 140dB + LFM Cost saving: one ISP support 4 cameras Cost saving: enable 2M plastic shell camera module Functional Safety: OAX4000 support ASIL B Saving Host MIPI interface 16 © 2021 OmniVision | Security B: Highly Confidential HDR and Detail Video OX03C / OX03F + OAX4000 Individual pipes Detailed lights Individual bricks 17 © 2021 OmniVision | Security B: Highly Confidential LFM Video OX03C / OX03F + OAX4000 Speed limit sign 18 © 2021 OmniVision | Security B: Highly Confidential Lowlight Video OX03C / OX03F + OAX4000 at 0.05lux 19 © 2021 OmniVision | Security B: Highly Confidential 2.2µm BSI Technology 20 © 2021 OmniVision | Security B: Highly Confidential Next Gen. Global Shutter Sensor Next Gen GS sensor QE Curve (2.2µm BSI GS Pixel with Nyxel®) 2.2 µm BSI pixel with Nyxel® RGB-IR and Monochrome CFA 36%@940nm Superior NIR QE optimized for 940nm Compact size by Stacking Cybersecurity OV2312 QE Curve (3µm FSI GS Pixel without Nyxel®) ASIL-B feature Low power consumption 14%@940nm 21 © 2021 OmniVision | Security B: Highly Confidential Image Comparison – Low Light Performance 940nm; Tint=16.6ms; 60fps; 18% Target; F2.0 1700nW/cm^2 Images 3µm FSI GS pixel 2.2µm BSI GS pixel with Nyxel® To achieve SNR 3, 2.2µm BSI GS pixel with Nyxel® only need 55% IR illumination optical power density of 3µm FSI GS pixel. Note the pixel area ratio is almost 2x, so total optical power saving will be ~4X for same resolution. 22 © 2021 OmniVision | Security B: Highly Confidential Sun on Driver’s Face 23 © 2021 OmniVision | Security B: Highly Confidential Night Inside Car Only Illuminated with 940nm 24 © 2021 OmniVision | Security B: Highly Confidential For More Information 25 © 2021 OmniVision | Security B: Highly Confidential Thank You 26 © 2021 OmniVision | Security B: Highly Confidential automotive OAX4000 video processor product brief High-Performance ASIC Image Signal Processor lead free Reduces Automotive Camera Design Complexity available in a lead-free OmniVision’s OAX4000 companion image signal processor Ideal for multiple automotive applications including package (ISP) offers design flexibility for next-generation surround-view systems, e-mirror, and autonomous driving automotive single- and multicamera architectures, enabling cameras, the OAX4000 is a high-performance OEMs to future-proof their designs for added functionality application-specific integrated circuit (ASIC) capable of as market demands change. Traditionally, electronic control processing data streams from up to four cameras at 3MP, modules required two ISPs, however, only one is needed or one camera at 8MP. It supports multiple color filter array when using the new OAX4000, reducing design complexity (CFA) patterns, including Bayer, RCCB, RGB-IR and RYYCy, and space, and improving overall reliability. In combination and provides the option to output stream for both machine with OmniVision’s comprehensive sensor portfolio, the vision and human viewing pipelines independently. OAX4000 provides the ultimate automotive solution. Additionally, the imaging pipeline has been upgraded to provide superior image quality. This includes the The OAX4000 is capable of processing up to four camera next-generation tone-mapping algorithm. modules with 140 dB HDR and it offers the leading LED flicker mitigation (LFM) performance in the industry. The OAX4000 complies with ASIL B advanced safety Additionally, the OAX4000 offers more than 30% power standards. savings over the previous generation ISP. Find out more at www.ovt.com. Applications OAX4000 ¬ Automotive - Automotive driver assistance system - Forward view camera (FVC) (ADAS) - Camera monitor system (CMS) - Surround view system (SVS) - Surround view system (SVS) - Driver monitoring system (DMS) - E-Mirror - Interior monitor system (IMS) - Rear view camera (RVC) Ordering Information ¬ OAX4000-B69G-1A-Z (lead-free) ¬ OAX4000-B69G-TA-Z (lead-free) 169-pin BGA, packed in tray 169-pin BGA, packed in tape and reel Product Features ¬ embedded 32-bit RISC CPU ¬ external frame sychronization capability ¬ up to four 3MP sensor Technical Specifications (1920x1536 @ 30 fps) SVS application ¬ SCCB slave interface lock feature for or a single 8MP sensor register access protect ¬ power supply: ¬ input clock: 8~32 MHz (3840x2160 @ 30 fps) ADAS core: 0.8V -5%~ +10% application (HV+MV) ¬ local and global tone mapping support I/O: 1.8V ±10% ¬ output interface: MIPI TX (2x 4-lane or 4x 2-lane, 2.5 Gbps/lane) ¬ supports mix sensors application with ¬ automatic white balance (AWB), ¬ input interface: MIPI RX different format/resolution/frame rate automatic exposure control (AEC) / (2x 4-lane or 4x 2-lane, 2.5 Gbps/lane) ¬ package dimensions: automatic gain control (AGC), 7 mm x 7 mm (0.5 mm pitch) ¬ multi-camera synchronization 50/60 Hz auto flicker detection and elimination ¬ MIPI DPHY CSI-2 v3.0 specification compliant ¬ embedded line information, including - up to 16 virtual channels