This document introduces the Mali "Egil" video processor from ARM. It provides a highly scalable and flexible video processing solution that can simultaneously encode and decode multiple video streams using various codecs like HEVC, VP9, and H.264. The solution includes dedicated hardware blocks, firmware for codec implementations, and software for control. It is designed to enable 4K and high frame rate video processing on mobile devices.

1. An Introduction to the
Mali “Egil”Video Processor
Roger Barker
Media Processing Group

2. ©ARM 2016
2
ARM® Mali™ Multimedia Suite
 Current high performance configuration
appearing in handsets in 2016
 Integrating multiple solutions for GPU,Video
and Display into Android™ is a challenge
 New SoCs are in design featuring
Mali-T880, Mali-DP550 and Mali-V550
 Mali-DP650 display processor launched January
2016
Mali Multimedia Suite – Better Together

3. ©ARM 2016
3
MaliVideo – ARM does Things Differently
 What?
 Codec analysis, hardware acceleration or software control?
 Develop hardware IP to accelerate where appropriate
 Add specialized dedicated controllers for management and more
 Develop firmware IP to execute requisite codecs and functions
 Add cores to provide scalability
 Why?
 Provides flexibility, enables multi-standard, scalable, flexible codecs
 Enables simultaneous encode & decode of multiple streams
 Enables a degree of tailoring for our more specialist Partners…
 This approach delivers a unified video solution

4. ©ARM 2016
4
Android driver –
source code
Firmware –
binaries
Hardware – RTL,
integration kit
MaliVideo
 Hardware:
 Fixed function blocks
 Dedicated controllers
 Control logic
Memory/register interface
 Software:
 Memory allocation
 Scheduling
 Power gating
Android Driver
Linux Kernel Driver
VP9 Profile 0
VP9 10-bit Profile 2
VP9 Profile 0
VP9 10-bit Profile 2
HEVC Main 10 High Tier
Register interface
 Firmware:
 Codec implementation
 Error concealment
 Display frame
reordering
 Rate control
 Communication
between cores
Host Communication
Decoder Binaries
HEVC Main 10 HighTier
H.264, H.263, MPEG4, MPEG2,
VC1, Real 8/9/10
JPEG
Encoder Binaries
HEVC Lite, H.264, H.263,
MPEG4, MPEG2,VC1,
Real 8/9/10
JPEG
Mali “Egil”

5. ©ARM 2016
5
 Founder Members
 Amazon
 ARM
 Cisco
 Google
 Intel
 Microsoft
 Mozilla
 Netflix
 Nvidia
Alliance for Open Media
 AOMediaVideo pursues a new,
patent royalty-free video codec
specification and open source
implementation based on the
contributions of Alliance members
and the broader developer
community
ARM is a Founding Member

6. ©ARM 2016
6
Mali “Egil” Freedom of Use
 MaliVideo simultaneously encodes and decodes
 Ideal for conferencing
 Sharing what you see
 Can use multiple codecs simultaneously
 So you can still watch the game!

7. ©ARM 2016
7
-
200
400
600
800
1,000
4K20 4K40 4K60 4K80 4K120
“Egil” 16FF @ 800MHz
Mali “Egil” Scalability
No. of
Cores
16FF @
800MHz
Typical
Displays
1 158Mpps 1080p80
2 316Mpps
WQHDp90
1080p160
3 475Mpps
WQXGAp120
4K UHDp60
6 949Mpps 4K UHDp120
I core 2 Core 3 core 4 Core 6 Core
Mpix/S

8. ©ARM 2016
8
Mali “Egil” Focus on Encoding
 VP9 encode available to mobile
 High quality, 10-bit Profile 2 or 8-bit Profile 0 encoding
 Reference Frame Scaling support for both Encode and Decode
 HEVC
 Add B-frames and 10-bit encode support
 General improvements – apply to all encoders
 Redesign of motion estimation engine
 Finer granularity

9. ©ARM 2016
9
Mali “Egil” Exceeds Premium Mobile Requirements
 4K UHD 2160pVP9 encode in a flexible, scalable,
multi-standard IP block
 Adding a completeVP9 codec supportingVP9’s key
differentiators
 Significantly improves encode quality and
performance for HEVC
 High-quality HEVC codec to Main 10 High Profile
 Continues ARM’s delivery of IP optimized for
premium mobile use

10. The trademarks featured in this presentation are registered and/or unregistered trademarks of ARM Limited
(or its subsidiaries) in the EU and/or elsewhere. All rights reserved. All other marks featured may be
trademarks of their respective owners.
Copyright © 2016 ARM Limited
©ARM 2016
Thank you