SlideShare una empresa de Scribd logo
1 de 15
Video
Transcoding
& Transrating
Yossi Cohen
1
Overview
 Full Transcode
 Open Loop transraters
Coefficient Drop Transrater
Re-quantization transrater

 Closed loop transrater
FPDT

2
Full Transcoder
 Full transcoding does full encoding and
decoding of the video. Features include:
Easy Implementation
Usually used for
 format conversion such as MPEG2 Video->H264
 Video Resize and frame rate reduction

Highest CPU requirements

3
Aided Transcoder
 Full decoding of the video
 Encoding Video while re-using the decoded video
information including:
Qp selection
Motion vectors
Block size (8x8, 4x8 etc.) selection

MV, Qp

4
Aided Transcoder Features
 High CPU requirements
 Like Full transcoder, enables:
 Resizing
 Change of Frame type (P->I, I->P) for sync point changing
 Smooth frame rate conversion
 Accurate (no drift) transcoding

5
Open Loop Transcoders
 Open loop transcoders are fast and simple
transrater.
 Open-loop – does not correct the drift error
created by the transrating on next frames
 Introduces drift error into the video – video
quality seriously degrades as a function of
the distance from last I frame.

6
Coefficient Drop Transrater
 Performs only Entropy Decoding/Encoding
 Drops some of the coefficients according to
psycho-visual models.
 Features
 Fastest transrater
 Poorest video quality per bitrate
 Introduce drift

7
Re-Quanitzation transrater
 Performs Entropy decoding and dequantization followed by quantization with
an Higher Qp (lowers quality & BR)
 Features
 Fast Transrater
 Poor video quality per bitrate
 Introduce drift

8
Closed loop transrater (FPDT)
 Performs Entropy decoding and dequantization followed by quantization with
an Higher Qp (lowers quality & BR)
 Adds quantization error from previous frame
to next frame to avoid drift
Error Store

9
Closed Loop Transrater - Features
 Faster then Transcoders
 No drift
 Quality is transcoder grade per same bitrate

10
Quality / CPU comparison
 Line – Quality, Bar – CPU Cycles

Coefficient
Drop

Re-Quantization
transrater

FPDT

Aided Transcoder

Full Transcode

11
Frame dropping overview
 Frame dropping could improve KPI (5-10%)
and reduce CPU load.
 Smooth frame drop – convert to any fps,
fixed deltaT between frames, frame
interpolation. Very high CPU requirements
 Regular frame drop – drop any frame
introduce some jerkiness
 Limited fps – cant drop any frame, introduce
higher jerkiness
12
Frame Dropping -2
 Transcoders support both Regular frame
drop
 Transraters only supports limited fps frame
drop
 FPDT transrater might support regular
frame drop at additional development time

13
Frame Resize
 Frame Resize could considerably lower
bitrate.
 CPU - Requires per pixel operations for
resizing – higher CPU but lower encoded
frame size which lowers CPU.
 Transcoder could easily support resize –
additional CPU requirements
 FPDT could support resize but would cost
considerable CPU and development time
14
Thank you!
More About me:
 Video Expert
 Lectures on Video / Android / VoIP
 Android Native Developer

Yossi Cohen
yossicohen19@gmail.com
http://www.mobilevideotech.com
+972-545-313092

15

Más contenido relacionado

Más de Yoss Cohen

Autonomous car teleportation architecture
Autonomous car teleportation architectureAutonomous car teleportation architecture
Autonomous car teleportation architectureYoss Cohen
 
Motion estimation overview
Motion estimation overviewMotion estimation overview
Motion estimation overviewYoss Cohen
 
Intro to machine learning with scikit learn
Intro to machine learning with scikit learnIntro to machine learning with scikit learn
Intro to machine learning with scikit learnYoss Cohen
 
DASH and HTTP2.0
DASH and HTTP2.0DASH and HTTP2.0
DASH and HTTP2.0Yoss Cohen
 
HEVC Definitions and high-level syntax
HEVC Definitions and high-level syntaxHEVC Definitions and high-level syntax
HEVC Definitions and high-level syntaxYoss Cohen
 
Introduction to HEVC
Introduction to HEVCIntroduction to HEVC
Introduction to HEVCYoss Cohen
 
FFMPEG on android
FFMPEG on androidFFMPEG on android
FFMPEG on androidYoss Cohen
 
Hands-on Video Course - "RAW Video"
Hands-on Video Course - "RAW Video" Hands-on Video Course - "RAW Video"
Hands-on Video Course - "RAW Video" Yoss Cohen
 
Video quality testing
Video quality testingVideo quality testing
Video quality testingYoss Cohen
 
HEVC / H265 Hands-On course
HEVC / H265 Hands-On courseHEVC / H265 Hands-On course
HEVC / H265 Hands-On courseYoss Cohen
 
Web video standards
Web video standardsWeb video standards
Web video standardsYoss Cohen
 
Product wise computer vision development
Product wise computer vision developmentProduct wise computer vision development
Product wise computer vision developmentYoss Cohen
 
3D Video Programming for Android
3D Video Programming for Android3D Video Programming for Android
3D Video Programming for AndroidYoss Cohen
 
Video optimization for android - Part I
Video optimization for android - Part IVideo optimization for android - Part I
Video optimization for android - Part IYoss Cohen
 
Cross platform computer vision optimization
Cross platform computer vision optimizationCross platform computer vision optimization
Cross platform computer vision optimizationYoss Cohen
 
Native Android for Windows Developers
Native Android for Windows DevelopersNative Android for Windows Developers
Native Android for Windows DevelopersYoss Cohen
 
Android Audio & OpenSL
Android Audio & OpenSLAndroid Audio & OpenSL
Android Audio & OpenSLYoss Cohen
 
Video Quality Measurements
Video Quality MeasurementsVideo Quality Measurements
Video Quality MeasurementsYoss Cohen
 

Más de Yoss Cohen (20)

Autonomous car teleportation architecture
Autonomous car teleportation architectureAutonomous car teleportation architecture
Autonomous car teleportation architecture
 
Motion estimation overview
Motion estimation overviewMotion estimation overview
Motion estimation overview
 
Intro to machine learning with scikit learn
Intro to machine learning with scikit learnIntro to machine learning with scikit learn
Intro to machine learning with scikit learn
 
DASH and HTTP2.0
DASH and HTTP2.0DASH and HTTP2.0
DASH and HTTP2.0
 
HEVC Definitions and high-level syntax
HEVC Definitions and high-level syntaxHEVC Definitions and high-level syntax
HEVC Definitions and high-level syntax
 
Introduction to HEVC
Introduction to HEVCIntroduction to HEVC
Introduction to HEVC
 
FFMPEG on android
FFMPEG on androidFFMPEG on android
FFMPEG on android
 
Hands-on Video Course - "RAW Video"
Hands-on Video Course - "RAW Video" Hands-on Video Course - "RAW Video"
Hands-on Video Course - "RAW Video"
 
Video quality testing
Video quality testingVideo quality testing
Video quality testing
 
HEVC / H265 Hands-On course
HEVC / H265 Hands-On courseHEVC / H265 Hands-On course
HEVC / H265 Hands-On course
 
Web video standards
Web video standardsWeb video standards
Web video standards
 
Product wise computer vision development
Product wise computer vision developmentProduct wise computer vision development
Product wise computer vision development
 
3D Video Programming for Android
3D Video Programming for Android3D Video Programming for Android
3D Video Programming for Android
 
Analog Video
Analog Video Analog Video
Analog Video
 
WiFi Display
WiFi DisplayWiFi Display
WiFi Display
 
Video optimization for android - Part I
Video optimization for android - Part IVideo optimization for android - Part I
Video optimization for android - Part I
 
Cross platform computer vision optimization
Cross platform computer vision optimizationCross platform computer vision optimization
Cross platform computer vision optimization
 
Native Android for Windows Developers
Native Android for Windows DevelopersNative Android for Windows Developers
Native Android for Windows Developers
 
Android Audio & OpenSL
Android Audio & OpenSLAndroid Audio & OpenSL
Android Audio & OpenSL
 
Video Quality Measurements
Video Quality MeasurementsVideo Quality Measurements
Video Quality Measurements
 

Último

Exploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone ProcessorsExploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone Processorsdebabhi2
 
08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking Men08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking MenDelhi Call girls
 
Unblocking The Main Thread Solving ANRs and Frozen Frames
Unblocking The Main Thread Solving ANRs and Frozen FramesUnblocking The Main Thread Solving ANRs and Frozen Frames
Unblocking The Main Thread Solving ANRs and Frozen FramesSinan KOZAK
 
A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)Gabriella Davis
 
08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking MenDelhi Call girls
 
Histor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slideHistor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slidevu2urc
 
The Codex of Business Writing Software for Real-World Solutions 2.pptx
The Codex of Business Writing Software for Real-World Solutions 2.pptxThe Codex of Business Writing Software for Real-World Solutions 2.pptx
The Codex of Business Writing Software for Real-World Solutions 2.pptxMalak Abu Hammad
 
🐬 The future of MySQL is Postgres 🐘
🐬  The future of MySQL is Postgres   🐘🐬  The future of MySQL is Postgres   🐘
🐬 The future of MySQL is Postgres 🐘RTylerCroy
 
Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...
Workshop - Best of Both Worlds_ Combine  KG and Vector search for  enhanced R...Workshop - Best of Both Worlds_ Combine  KG and Vector search for  enhanced R...
Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...Neo4j
 
Breaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path MountBreaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path MountPuma Security, LLC
 
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure serviceWhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure servicePooja Nehwal
 
IAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsIAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsEnterprise Knowledge
 
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law DevelopmentsTrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law DevelopmentsTrustArc
 
Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024The Digital Insurer
 
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Drew Madelung
 
Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...Enterprise Knowledge
 
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Miguel Araújo
 
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationFrom Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationSafe Software
 
Slack Application Development 101 Slides
Slack Application Development 101 SlidesSlack Application Development 101 Slides
Slack Application Development 101 Slidespraypatel2
 
A Call to Action for Generative AI in 2024
A Call to Action for Generative AI in 2024A Call to Action for Generative AI in 2024
A Call to Action for Generative AI in 2024Results
 

Último (20)

Exploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone ProcessorsExploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone Processors
 
08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking Men08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking Men
 
Unblocking The Main Thread Solving ANRs and Frozen Frames
Unblocking The Main Thread Solving ANRs and Frozen FramesUnblocking The Main Thread Solving ANRs and Frozen Frames
Unblocking The Main Thread Solving ANRs and Frozen Frames
 
A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)
 
08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men
 
Histor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slideHistor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slide
 
The Codex of Business Writing Software for Real-World Solutions 2.pptx
The Codex of Business Writing Software for Real-World Solutions 2.pptxThe Codex of Business Writing Software for Real-World Solutions 2.pptx
The Codex of Business Writing Software for Real-World Solutions 2.pptx
 
🐬 The future of MySQL is Postgres 🐘
🐬  The future of MySQL is Postgres   🐘🐬  The future of MySQL is Postgres   🐘
🐬 The future of MySQL is Postgres 🐘
 
Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...
Workshop - Best of Both Worlds_ Combine  KG and Vector search for  enhanced R...Workshop - Best of Both Worlds_ Combine  KG and Vector search for  enhanced R...
Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...
 
Breaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path MountBreaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path Mount
 
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure serviceWhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
 
IAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsIAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI Solutions
 
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law DevelopmentsTrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
 
Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024
 
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
 
Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...
 
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
 
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationFrom Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
 
Slack Application Development 101 Slides
Slack Application Development 101 SlidesSlack Application Development 101 Slides
Slack Application Development 101 Slides
 
A Call to Action for Generative AI in 2024
A Call to Action for Generative AI in 2024A Call to Action for Generative AI in 2024
A Call to Action for Generative AI in 2024
 

Video transcoding transrating

  • 2. Overview  Full Transcode  Open Loop transraters Coefficient Drop Transrater Re-quantization transrater  Closed loop transrater FPDT 2
  • 3. Full Transcoder  Full transcoding does full encoding and decoding of the video. Features include: Easy Implementation Usually used for  format conversion such as MPEG2 Video->H264  Video Resize and frame rate reduction Highest CPU requirements 3
  • 4. Aided Transcoder  Full decoding of the video  Encoding Video while re-using the decoded video information including: Qp selection Motion vectors Block size (8x8, 4x8 etc.) selection MV, Qp 4
  • 5. Aided Transcoder Features  High CPU requirements  Like Full transcoder, enables:  Resizing  Change of Frame type (P->I, I->P) for sync point changing  Smooth frame rate conversion  Accurate (no drift) transcoding 5
  • 6. Open Loop Transcoders  Open loop transcoders are fast and simple transrater.  Open-loop – does not correct the drift error created by the transrating on next frames  Introduces drift error into the video – video quality seriously degrades as a function of the distance from last I frame. 6
  • 7. Coefficient Drop Transrater  Performs only Entropy Decoding/Encoding  Drops some of the coefficients according to psycho-visual models.  Features  Fastest transrater  Poorest video quality per bitrate  Introduce drift 7
  • 8. Re-Quanitzation transrater  Performs Entropy decoding and dequantization followed by quantization with an Higher Qp (lowers quality & BR)  Features  Fast Transrater  Poor video quality per bitrate  Introduce drift 8
  • 9. Closed loop transrater (FPDT)  Performs Entropy decoding and dequantization followed by quantization with an Higher Qp (lowers quality & BR)  Adds quantization error from previous frame to next frame to avoid drift Error Store 9
  • 10. Closed Loop Transrater - Features  Faster then Transcoders  No drift  Quality is transcoder grade per same bitrate 10
  • 11. Quality / CPU comparison  Line – Quality, Bar – CPU Cycles Coefficient Drop Re-Quantization transrater FPDT Aided Transcoder Full Transcode 11
  • 12. Frame dropping overview  Frame dropping could improve KPI (5-10%) and reduce CPU load.  Smooth frame drop – convert to any fps, fixed deltaT between frames, frame interpolation. Very high CPU requirements  Regular frame drop – drop any frame introduce some jerkiness  Limited fps – cant drop any frame, introduce higher jerkiness 12
  • 13. Frame Dropping -2  Transcoders support both Regular frame drop  Transraters only supports limited fps frame drop  FPDT transrater might support regular frame drop at additional development time 13
  • 14. Frame Resize  Frame Resize could considerably lower bitrate.  CPU - Requires per pixel operations for resizing – higher CPU but lower encoded frame size which lowers CPU.  Transcoder could easily support resize – additional CPU requirements  FPDT could support resize but would cost considerable CPU and development time 14
  • 15. Thank you! More About me:  Video Expert  Lectures on Video / Android / VoIP  Android Native Developer Yossi Cohen yossicohen19@gmail.com http://www.mobilevideotech.com +972-545-313092 15