My Car Won’t Connect to the Internet – Andrew Patterson
Embedded software designers working on In-Vehicle Infotainment (IVI) have had to learn about a lot of new technology in the last 3 years, ranging from the Linux operating systems, support for a wide range of IVI applications, middleware and application services, integration of complex semiconductor SoC platforms, and multi-modal human interface requirements to list a few. The rate of innovation required by vehicle buyers shows no sign of slowing down, as markets now demand on-line access for the car driver and passengers. The truth is, most cars do not connect to the internet today, but there is no doubt that they will need to fairly soon to take advantage of cloud and telematics services becoming available. This session looks at the connectivity options available to embedded designers at OEMs and their Tier 1 suppliers, both from a hardware and software perspective. The work of organizations such as the Car Connectivity Consortium will be explored, as well as specific point solutions provided by mobile operators and leading phone brands.
1. Embedded World Session 26
My Car Won’t Connect to the Internet
ID 300
Andrew Patterson
Business Development Director mentor.com/embedded
Android is a trademark of Google Inc. Use of this trademark is subject to Google Permissions.
Mentor Graphics Ltd Linux is the registered trademark of Linus Torvalds in the U.S. and other countries.
2. History of Connectivity
1876 1910 1946 1973 2012
First First First mobile First mobile 6 Billion Mobile Phones
Telephone Telephone in Telephone service Car phone 87% of world population
Car Chicago Motorola 1.3bn in China
3. Technology Evolution
Bring in the New, Exit the Old
Hi-Fi Stereo
8-Track Tapes
Circa 1970
2012 : Paired Device
‗10s : We are in a decade of
Extraordinary
2013 : Connected Car
Automotive Technology Evolution
We are all involved in one of
the largest technological
collaborations of all time
2020 : Self-Drive Cars
4. Automotive : Non-Stop Connectivity
Cloud
Hands-Free Call
GPS Walk to Destination
Continue Movie
Experience Roaming
5. The Most Connected Cars
■ Top most connected
cars (July 2012)
#1 Ford Fiesta Sync Applink
Pandora Internet Radio
Apps, News
#3 BMW Connected Drive
Some iPhone apps available on dashboard
Google via Telematics Service
#2 Audi A6 Dedicated COnnection
Internet Connection
Google Search, Google Earth
Dedicated Data Connection
Local Hot Spot
#4 Lexus Enform
Links to compatible Smartphone
Embedded Cellular and GPS
Source : Telematics Update Dec 2012
6. 3G/4G Connectivity – How ?
Smart Phone Link Integrated Cellular Electronics
Make use of existing phone Need dedicated data plan
Familiar apps Built-in Infotainment apps
Phone contact list V2X, V2V communication
Includes navigation, maps Lasts for vehicle lifetime
Entertainment, song list Hot-spot / Telematic hub
6
7. Consumer Electronics Influence …
■ The SmartPhone Revolution
■ 3 out of 4 Smart Phones sold are Android
■ Apple & Samsung account for 83% of
market
■ Platform Refresh every 6 months
■ The Car is becoming a Consumer
Electronic Product
■ Lifecycles
— Consumer Electronics : 6 months
— Automotive : 10 years?
8. In-Vehicle Android
Options
• Native
• Android operating system on
―bare metal‖
• Parallel Domain
• Android running as a parallel
operating system
• Virtual Domain, Container
• Tethered
• Linked in via mobile phone
9. Arguments For Android
Acceptance in Consumer Electronics
850,000 new devices daily
Over 700,000 Apps (Oct 2012)
6 billion total downloads
Car features
Android ―Car Mode‖ routes all audio to speaker
Hands-Free support
Other selling points
Familiar UI for users
Development kits & community
Automotive apps peripheral support
11. How to Pay?
In a recent survey by Telematics Update :
19.7% Monthly Contract
14.6% Annual Contract
33.9% Cost of the connected car should be included vehicle as standard.
22.6% Pay-per-use model
9.2% Industry experts believe in single payment charging model
Source: Telematics Update, December 2012, data pool 231
12. System Cost Options
Brand Product Cost
BMW Phone Cradle, iDrive $250 - $2400
Mercedes Benz Mbrace, EU Command Line $660 - $3000
Toyota Ntune $1000
Ford Sync, MyTouch $395 - $1000
• Costs are falling
• Connectivity becoming a ―must have‖
• Embedded Systems hold the solution
Data Source : Telematics Update Dec 2012
13. Driving the Requirement..
• eCall – required in all new cars from 2015
• Tethered Mobile solutions not acceptable
Under the eCall legislation that has already
been approved by EU member nations, all
new cars would have an embedded mobile
communications device that automatically
places a call in the case of a serious
accident. The call can also be made
manually from inside the car.
14. Drivers and Passengers
Driver Passengers
• Navigation • Social Media
• Radio / Media Player • DVD
• Real-time Information • Internet Services
• Hands-free Phone • Android Apps
• Telematics
Courtesy : Volvo Car
15. Enabled Solutions via Connectivity
Collision Notification (eCall)
Insurance Tracking and Billing
Stolen Vehicle
In-car services, concierge, streaming
Eco-driving services
Real-time Cloud data : Traffic, Weather, Road ahead
Car-Car communication The National Highway Traffic Safety
Administration says Connecting our
Driverless car Cars could address as many as 4.3
million crashes, or about 80 percent
Diagnostics and servicing of accidents that don‘t involve
intoxicated drivers.
16. Technology Choices
mentor.com/embedded
Android is a trademark of Google Inc. Use of this trademark is subject to Google Permissions.
Linux is the registered trademark of Linus Torvalds in the U.S. and other countries.
17. Connectivity Options
3G / 4G LTE
Globally Available / Coverage
Good performance
WiFi
Dependent on local hot spots
Use driver/passenger mobile device
Bluetooth
Range limitations : Class 1: 20-30m
Bandwidth limitations / audio only
Road Infrastructure
Traffic information gantries as
transmitters
Highways only
18. Full Infotainment Platform
Display Display
Graphics
Optimization
Layer Management
Automotive
Apps Mobile Consumer
Tier 1 / Android Experience
OEM HTML 5 Apps
OEM Custom
Branding Apps
Android Double Security
Compliance GENIVI HTML 5 Browser
& Compliant
Ecosystem Stack Linux Container Resource
Control
Recipes
ME ATP Linux
MIMO Antenna
Ultra High
Quality
Hardened BSP (LTE, CPU, GPU)
GPU
LTE enabled SoC
Multicore
LTE 4G Stack
Support
21. Operating Systems
OS Features
Win CE widely Established
Windows Wireless Chipset support
Many open source variants / GENIVI
Flexible platform
Linux Low License costs
Strong development community
Widely accepted in Mobile
Consumer Electronics focus
Android open source / SDK support
Highly tuned / good control over functions by
OEM/Tier 1
Proprietary OS Costly to develop and maintain
Commercial Maybe ―closed‖
1st Generation widely established
22. Tethered Smart Phone
―Thin Client‖ on IVI
head unit
Approved Apps only
Enable Internet
Connectivity
Quick Android Speech Engine
IVI
Networking
Navigation Audio
Integration
Stack
Entertainment Telephony
Mobile Office Cloud
23. Car Connectivity Consortium
Standard ―recipes‖ for Smart Phone tethering
Universal Plug and Play (UPnP™) is used for controlled
access to applications
Virtual Network Computing (VNC™) replicates the
phone's display on the navigation screen and
communicate user inputs back to the phone.
80 members
70% market share in vehicles
60% market share in smart phones.
Built-in support on market
Samsung Galaxy III, Nokia, …
24. Virtual Network Computing
VNC Server (Smart Phone )
Runs App
Allows Client to take control
VNC Client
Views the program
Has control of Application on server
RFB Protocol
The VNC protocol (RFB) is simple, based on one
graphic primitive from server to client
("Put a rectangle of pixel data at the specified X,Y
position") and event messages from client to server.
25. Security
Open Access is risky
Apps may provide gateway for hacker /
attacks
May compromise / interfere with
operation of other vehicle functions
WiFi in car / hotspots proposed
around WPA2
Password-level protection
App Management
Which Apps are authorized?
Some Auto OEMs will set up App Stores Renault R-Link Apps Store
26. Security continued
The Open Source OpenXC platform follows on from
Allow Access? the Ford Developer Program to make the SYNC
AppLink application programming interface (API)
available for the creation of smartphone apps that can
be controlled inside the car using your voice.
SandBox Graphics Layer Management
Android Apps
Networking
Navigation
IVI Android OS
Entertainment
Stack
Mobile Office
Mentor IVI Linux OS / LXC Resource Management
Hardware Layer Multi-Core CPU GPU
27. Overview of Linux Containers
• OS-level virtualization method
• Used to run multiple isolated Linux systems
– Can be different distributions
• A single kernel is shared
• The LXC project is hosted on SourceForge
• Userspace control tools are provided for Linux containers
• LXC has been integrated into Mentor Automotive Linux
solutions
•Resource limiting: groups can be set to not exceed a
set memory limit
•Prioritization: some groups may get a larger share of
CPU or disk I/O throughput
•Accounting: to measure how much resources certain
systems use for e.g. billing purposes
•Isolation: separate namespaces for groups, so they
don't see each other's processes, network connections or
files
•Control: freezing groups or checkpointing and restarting
28. Connectivity Recipes within GENIVI Platform
Audio Graphics Multimedia Speech
• ALSA, Alsa Lib, Alsa • X.Org • GStreamer • Festival
Utils • Layer Management • GStreamer Framework, • Pocketsphinx
• PulseAudio • Chromium / Webkit Base plugins • Speech Engine
• AudioManager daemon • Graphics Backend • Tracker
• Echo Cancelation Engine • Open GL-ES • Telephony Stack
• Noise Reduction Engine • Qt Core
CE-device External Access Connectivity Positioning
• Wireless Tools • gypsy
• CE Device Manager • HTTP Server
• Wpa-supplicant
• lighttpd Personal Information
• ConnMan
• lighttpd-mod-webdav Management
• BlueZ
• Bluetooth Hands Free
• Bluetooth Stack • SyncEvolution
Package Networking Security System Infrastructure
• dhcp • •
Management • libcurl • ecryptfs-utils d-bus quota
• gnupg2 • SQlite • udev
• Opkg • nfs-utils
• openssl • qt-core • usb-utils
• Package Manager • Ntp • fuse • libmtp
• Node Startup Controller • HTTP Server • Gettext • File Server
• Indexing Eng.
• MTP Library
OS kernel, drivers and libraries • Systemd
ARM Cortex Processors Linux Kernel • Automotive
GNU libc DLT
• Lib USB
28
29. Internet of cars is coming ..
Embedded Automotive
designers are now
developing Consumer
Products
Editor's Notes
Infotainment systems are become key decision points by customers, more and more influenced by the SmartPhone lifecycle. Users no longer wish to maintain multiple user-interfaces, and contact lists. OEMs and Tier 1s are under pressure to reduce development costs, so this has driven the formation of industry standards and alliances in the area of IVI and Instrument Clusters
Infotainment systems are become key decision points by customers, more and more influenced by the SmartPhone lifecycle. Users no longer wish to maintain multiple user-interfaces, and contact lists. OEMs and Tier 1s are under pressure to reduce development costs, so this has driven the formation of industry standards and alliances in the area of IVI and Instrument Clusters
Many OEMs and TIer1s have recognized that they cannot stay on a proprietary or first generation platform. The QNX operating system has been widely used in the past, but does not offer the open-source path and GENIVI compliance needed to keep future cost base low. Other proprietary solutions for IVI, such as Microsoft or Google, are risky because of potential future license restrictions
Many OEMs and TIer1s have recognized that they cannot stay on a proprietary or first generation platform. The QNX operating system has been widely used in the past, but does not offer the open-source path and GENIVI compliance needed to keep future cost base low. Other proprietary solutions for IVI, such as Microsoft or Google, are risky because of potential future license restrictions
CONFIDENTIAL INFORMATION BELOW. PERMISSION FOR DISCLOSURE NOT OBTAINED.Customer: Conti
Many OEMs and TIer1s have recognized that they cannot stay on a proprietary or first generation platform. The QNX operating system has been widely used in the past, but does not offer the open-source path and GENIVI compliance needed to keep future cost base low. Other proprietary solutions for IVI, such as Microsoft or Google, are risky because of potential future license restrictions
Many OEMs and TIer1s have recognized that they cannot stay on a proprietary or first generation platform. The QNX operating system has been widely used in the past, but does not offer the open-source path and GENIVI compliance needed to keep future cost base low. Other proprietary solutions for IVI, such as Microsoft or Google, are risky because of potential future license restrictions
This slide shows the four key elements to Mentor’s IVI strategy