Chips&Media ISP Solution Overview

1. 1
ISP(Image Signal Processing)
IP Product Introduction
CONTENTS
Introducing ISP p2
ISP in real world applications p3
Market Trend P4
ISP flow and key functions P5
ISP key functions p6
Functional block diagram p11
ISP product specification p12
Value proposition p13
ISP roadmap p14
Version Date: May 2016

2. 2
Image Signal Processing IP
Introducing ISP IP
 Complete and configurable full ISP pipeline
 High performance and small size IPs applicable to different processor types
ISP
Processor type Image Processor (Vision) Image processor (Companion processor) CIS
Sensor Size 2M ~ 8MPixel (4K) ~ 2MPixel ~ 2MPixel
Application IP surveillance cameras, Automotive Surveillance cameras Surveillance camera
Market size High or Mass Mass Mass or Entry
Memory (Buffer type) External memory (e.g. Frame buffer) No external memory,
Internal SRAM (Line buffer) and/or SDRAM (SiP)
No external memory
Chips&Media IPs

3. 3
ISP is being widely used in different applications requiring image signal processing
High-end Applications (5MP~13MP)
Low-end Applications (VGA~HD)
Ultra High-end Applications (16MP and higher)
Mid-end Applications (HD~5MP)
Security Camera
Tablet Camera
Camcorder
Smartphone/Tablet Camera
Notebook/PC Camera
Smartphone Camera
Automotive Camera (incl. Dashboard Camera)
Console Game Camera
Smartphone Camera
DSLR Camera
Digital Still Camera
Smartphone/Tablet Camera
Toy Camera
Medical Camera (Endoscopy)
Drone Camera
ISP in Real World Applications

4. 4
Camera Modules market is on sustainable growth with 2MP/8MP being the largest in volume
Market Trend
Global Camera Modules Market Volume by Pixel Count
Global Camera Modules Market by Volume
○ Camera Modules market for Non-Mobile and Mobile
Market is expected to grow continuously
- Non-Mobile Market : 7.9% CAGR; Mobile Market : 21.2%
- Non-Mobile Market including Automotive, Surveillance, and Drones use
multiple number of camera modules
- Mobile Market has trend to integrate dual camera (2 cameras)
○ Demand for high resolution camera is on rapid rise
- The market is expected to divide at 8MP marks as
8MP+ makes up 50% of the market, and 5MP- fills up the rest 50%
- In detailed breakdown, demand for 8MP camera modules and
2MP camera modules are forecasted to be the largest

5. 5
ISP flow and Key Functions
Key Functions
Functions Summary
Lens Shading
Correction
 16x16 2D Mesh Based Shading Correction
 RGB Color Shading Correction support
 Shading Parameter Correction for light source
change
Gamma
Correction
 Bayer/RGB/Y Gamma correction
Color
Enhancement
 Basic 3x3 Color Matrix & Adaptive Correction
 Individual 12-Region Saturation/Hue/ Delta-L
Control support
Gb/Gr
Correction
 Max. 12.5% of single deviation corrections
(None Uniform)
Auto
White Balance
 16x12 RGB, Cb/Cr Base Feed Forward
Algorithm support
Auto Exposure  16x12 Weighting Window support
Auto Focus  3-Type Filter & 9-AF Window support
Noise
Reduction
 Bayer/RGB/Y Noise Reduction
 Texture Preserved Noise Reduction
Edge
Enhancement
 Bayer/RGB/Y Sharpness support
RGB
Interpolation
 Hybrid Type High-Resolution Color
Interpolation
ISP flow
Bayer In
YUV Out
Object Lens Image Sensor Bayer Image Photo(YUV)ISP
ISP Flow and Key functions
<Functional block diagram>

6. 6
ISP Key functions
Key Functions
Functions Summary
Lens Shading
Correction
 16x16 2D Mesh Based Shading Correction
 RGB Color Shading Correction support
 Shading Parameter Correction for light source
change
Gamma
Correction
 Bayer/RGB/Y Gamma correction
Color
Enhancement
 Basic 3x3 Color Matrix & Adaptive Correction
 Individual 12-Region Saturation/Hue/ Delta-L
Control support
Gb/Gr
Correction
 Max. 12.5% of single deviation corrections
(None Uniform)
Auto
White Balance
 16x12 RGB, Cb/Cr Base Feed Forward Algorithm
support
Auto Exposure  16x12 Weighting Window support
Auto Focus  3-Type Filter & 9-AF Window support
Noise
Reduction
 Bayer/RGB/Y Noise Reduction
 Texture Preserved Noise Reduction
Edge
Enhancement
 Bayer/RGB/Y Sharpness support
RGB
Interpolation
 Hybrid Type High-Resolution Color
Interpolation
Lens Shading Correction
 Function: Adjust the effect of lower surrounding RGB value (vs. the value
of the center) due to characteristic relationship between Lens and Sensor
ISP Key functions
Before After
Before After
Gamma Correction
 Function: Adjust gamma value to reproduce more natural image

7. 7
ISP Key functions
Key Functions
Functions Summary
Lens Shading
Correction
 16x16 2D Mesh Based Shading Correction
 RGB Color Shading Correction support
 Shading Parameter Correction for light source
change
Gamma
Correction
 Bayer/RGB/Y Gamma correction
Color
Enhancement
 Basic 3x3 Color Matrix & Adaptive Correction
 Individual 12-Region Saturation/Hue/ Delta-L
Control support
Gb/Gr
Correction
 Max. 12.5% of single deviation corrections
(None Uniform)
Auto
White Balance
 16x12 RGB, Cb/Cr Base Feed Forward
Algorithm support
Auto Exposure  16x12 Weighting Window support
Auto Focus  3-Type Filter & 9-AF Window support
Noise
Reduction
 Bayer/RGB/Y Noise Reduction
 Texture Preserved Noise Reduction
Edge
Enhancement
 Bayer/RGB/Y Sharpness support
RGB
Interpolation
 Hybrid Type High-Resolution Color
Interpolation
Color Enhancement
 Function: Enhance the color input to the sensor to reproduce the actual c
olor of input image
ISP Key functions
Before After
Before After
Gb/Gr Correction
 Function: Correct the disparate values of the even line G and odd line G ca
used by the sensor properties

8. 8
ISP Key functions
Key Functions
Functions Summary
Lens Shading
Correction
 16x16 2D Mesh Based Shading Correction
 RGB Color Shading Correction support
 Shading Parameter Correction for light source
change
Gamma
Correction
 Bayer/RGB/Y Gamma correction
Color
Enhancement
 Basic 3x3 Color Matrix & Adaptive Correction
 Individual 12-Region Saturation/Hue/ Delta-L
Control support
Gb/Gr
Correction
 Max. 12.5% of single deviation corrections
(None Uniform)
Auto
White Balance
 16x12 RGB, Cb/Cr Base Feed Forward
Algorithm support
Auto Exposure  16x12 Weighting Window support
Auto Focus  3-Type Filter & 9-AF Window support
Noise
Reduction
 Bayer/RGB/Y Noise Reduction
 Texture Preserved Noise Reduction
Edge
Enhancement
 Bayer/RGB/Y Sharpness support
RGB
Interpolation
 Hybrid Type High-Resolution Color
Interpolation
Auto White Balance
 Function: Correct RGB values to assign White Color to the input image
ISP Key functions
Before After
Before After
Auto Exposure
 Function: Adjust Exposure and Gain values to optimize the image’s
brightness

9. 9
ISP Key functions
Key Functions
Functions Summary
Lens Shading
Correction
 16x16 2D Mesh Based Shading Correction
 RGB Color Shading Correction support
 Shading Parameter Correction for light source
change
Gamma
Correction
 Bayer/RGB/Y Gamma correction
Color
Enhancement
 Basic 3x3 Color Matrix & Adaptive Correction
 Individual 12-Region Saturation/Hue/ Delta-L
Control support
Gb/Gr
Correction
 Max. 12.5% of single deviation corrections
(None Uniform)
Auto
White Balance
 16x12 RGB, Cb/Cr Base Feed Forward
Algorithm support
Auto Exposure  16x12 Weighting Window support
Auto Focus  3-Type Filter & 9-AF Window support
Noise
Reduction
 Bayer/RGB/Y Noise Reduction
 Texture Preserved Noise Reduction
Edge
Enhancement
 Bayer/RGB/Y Sharpness support
RGB
Interpolation
 Hybrid Type High-Resolution Color
Interpolation
Auto Focus
 Function: Correct RGB values to assign actual White Color to the input
image
ISP Key functions
Before After
Before After
Noise Reduction
 Function: Reduce or remove the noise of input image

10. 10
ISP Key functions
Key Functions
Functions Summary
Lens Shading
Correction
 16x16 2D Mesh Based Shading Correction
 RGB Color Shading Correction support
 Shading Parameter Correction for light source
change
Gamma
Correction
 Bayer/RGB/Y Gamma correction
Color
Enhancement
 Basic 3x3 Color Matrix & Adaptive Correction
 Individual 12-Region Saturation/Hue/ Delta-L
Control support
Gb/Gr Correction
 Max. 12.5% of single deviation corrections
(None Uniform)
Auto
White Balance
 16x12 RGB, Cb/Cr Base Feed Forward
Algorithm support
Auto Exposure  16x12 Weighting Window support
Auto Focus  3-Type Filter & 9-AF Window support
Noise Reduction
 Bayer/RGB/Y Noise Reduction
 Texture Preserved Noise Reduction
Edge
Enhancement
 Bayer/RGB/Y Sharpness support
RGB
Interpolation
 Hybrid Type High-Resolution Color
Interpolation
Edge Enhancement
 Function: Bayer/RGB/Y Sharpness Support
ISP Key functions
Before After
Before After
RGB Interpolation
 Function: Interpolate RGB values in a pixel which only holds a value of R,
G, or B

11. 11
Functional block diagram
Functional Block Diagram
Bayer /
YUV(16bit)
YUV Out
Input
Control
Bayer
Pre-Processing
Bayer
Processing
RGB Interpolation
RGB
Processing
Contrast
Correction
YUV
Processing
Formatting
• Color Correction Matrix
• Gamma Correction
• Color Enhancement
• Noise Reduction
• Sharpness
• Noise Reduction
• Color NR
• Sharpness
• and more
• Noise Reduction
• Defective Pixel Correction
• GbGr Correction
• and more
• Shading
• Gain Correction
3A Statistics
AWB/AE
Gain

12. 12
Product Specification
ISP Product Specification
CS-U02Z-G/0
Size
Logic 390Kgate
Memory 150Kgate
Maximum resolution
Image Up to 2MPixel
Video 1920x1080 at 60fps1)
Synthesizable clock 350MHz (w/ 55nm Lib.)
Input formats Bayer(8bit, 10bit, 12bit), YUV(16bit)
Output formats YUV
1) Requires 160MHz operating clock.
CS-O20Z-G/0
Size
Logic 2.1Mgate
Memory 1.4Mgate
Maximum resolution
Image Up to 20MPixel
Video UHD at 60fps
Synthesizable clock 1.1GHz (w/ 28nm Lib.)
Input formats Bayer(8bit, 10bit, 12bit), YUV(16bit)
Output formats YUV
CS-O08Z-G/0
Size
Logic 620Kgate
Memory 460Kgate
Maximum resolution
Image Up to 8MPixel
Video UHD at 30fps1)
Synthesizable clock 350MHz (w/ 55nm Lib.)
Input formats Bayer(8bit, 10bit, 12bit), YUV(16bit)
Output formats YUV
1) Requires 320MHz operating clock.

13. 13
Customer benefits
Each IPs within Full IP Engine can be selectively and independently
used, based on target quality, Chip Size and Cost requirement. IPs
available are as follows:
Cost Reduction while maintaining
Quality and Flexibility
Cost Effectiveness
Smaller Chip Size
 Gate Count : 50% or lower vs competitors (in same resolution)
1.6
1.1
0.49
S Co. SS Co. C&M
13
12
3.5
S Co. Q Co. C&M
3MP(CIS) 16MP(AP)
Complete and Configurable IP Pipeline
Unit: Million Unit: Million
Value Proposition
 3 Auto
 Lens Shading Correction
 Gamma Correction
 CIS Timing Controller
 Gb/Gr Correction
 Dead Pixel Correction
 Black Level Compensation
 Dark Correction
 RGB Interpolation
Competitively affordable licensing cost with guaranteed
on-time delivery
Competitive License Cost and Delivery Time
C&M Full ISP Engine
Q Company ISP in AP
S Company ISP in AP
Cost(Production/License)
Image Quality
e.g.: 1) Full ISP Pipeline with medium quality
2) Selected ISP Pipeline with high quality (configured)

14. 14
ISP IP and Image Processing Single IP development plan
Item
2015 2016 2017 2018
Current 2Q 3Q 4Q 1Q 2Q 3Q 4Q 1Q
ISP IP
Full IP
(up to 20MP)
Single IP
CS-O20Z-G/0
CS-O08Z-G/0
CS-L20Z-G/0
CS-U02Z-G/0
0.28nm Tech.
1.1GHz Operation
3.5M G/C w/Memory
(20MP)
0.55nm Tech.
200MHz Operation
0.49M G/C w/Memory(FHD)
0.28nm Tech.
600MHz Operation
1.18M G/C w/Memory(8MP)
0.28nm Tech.
1.1GHz Operation
3.1M G/C w/Memory(20MP)
ISP Product Roadmap

15. 15
End of Document
Contact: isp@chipsnmedia.com