Tweeting with OpenSplice DDS

Splice DDS OpenSplice DDS OpenSplice DDS OpenSplice DDS OpenSplice DDS OpenSplice DDS OpenSplice DDS OpenSplice DDS OpenSplice DDS

ng
si

t
o
ou e D
n
u
DS
in Tweeting
ab lic ud

A
w
O
a lk
n
pe th
S
p
e
C lo
with
OpenSplice DDS
:: http://www.opensplice.org :: http://www.opensplice.com :: http://www.prismtech.com ::

Angelo Corsaro, Ph.D.
Chief Technology Officer
PrismTech
OMG DDS SIG Co-Chair
angelo.corsaro@prismtech.com

Splice DDS OpenSplice DDS OpenSplice DDS OpenSplice DDS OpenSplice DDS OpenSplice DDS OpenSplice DDS OpenSplice DDS OpenSplice DDS

ng
si

t
o
ou e D
n
u
DS
in Tweeting
ab lic ud

A
w
O
a lk
p
S
p
en he
t
C lo
with
OpenSplice DDS

Open Splice DDS
Explained
...quickly

OpenSplice DDS OpenSplice DDS OpenSplice DDS OpenSplice DDS OpenSplice DD
What is DDS?

‣ A Standard for High-Performance Application

Publish/Subscribe Object/Relational Mapping

Data Local Reconstruction Layer (DLRL)

‣ Defines a standard API (for Content
mainstream languages) and a Wire-
Ownership Durability
Subscription

Protocol Minimum Proﬁle

Data Centric Publish/Subscribe (DCPS)

‣ DDS uses a highly efficient and Real-Time Publish/Subscribe Protocol

extensible binary protocol and DDS Interoperability Wire Protocol

encoding UDP/IP

What is DDS?

Application

‣ Used heaving in complex mission/ Object/Relational Mapping

business critical systems Data Local Reconstruction Layer (DLRL)

Content
‣ Transportation Ownership Durability
Subscription

‣ Aerospace & Defense Minimum Proﬁle

‣ Financial Market
Data Centric Publish/Subscribe (DCPS)

‣ SCADA & Utilities Real-Time Publish/Subscribe Protocol

‣ ... DDS Interoperability Wire Protocol

UDP/IP

How Does it Work?
as a
c an be seen
Note: DDS NDA
n of the LI
relaxatio
odel
coord ination m

‣ DDS is based around the
Brokers
concept of a fully distributed
Global Data Space (GDS)
DDS
‣ Applications can autonomously Global Data Space

and asynchronously read/
written data in the GDS

How Does it Work?

Publisher Brokers Subscriber

‣ Publishers and
Subscribers can
DDS
join and leave the Subscriber
Publisher Global Data Space
GDS at any time

Publisher Subscriber

How Does it Work?

‣ Publishers and Publisher Brokers Subscriber

Subscribers express
their intent to
DDS
produce/consume Publisher
Subscriber
Global Data Space
specific type of data,
e.g., Topics

How Does it Work?


‣ Subscriptions are
matched by taking
DDS
into account data Subscriber
Publisher Global Data Space
types and QoS


How Does it Work?


‣ Subscriptions are
dynamically matched DDS Subscriber
and Data flows from Publisher Global Data Space

Publisher to Subscribers


ng
si

t
o
ou e D
n
u
DS
in Tweeting
ab lic ud

A
w
O
a lk
p
S
p
en he
t
C lo
with
OpenSplice DDS

Starting to Tweet
With OpenSplice DDS

A “Tweet” with DDS

Topic: Tweet

‣ Unit of information
exchanged between Name

Publisher and Subscribers.

‣ An association between a Type Topic QoS

unique name, a type and a
{
QoS setting TweetType
Reliable,
Persistent,
...
}

A “Tweet” with DDS

Topic Type:
‣ Type describing the data
associated with one or more
Topics struct TweetType {
string userId;
string tweet;
‣ A Topic type can have a key };
represented by an arbitrary #pragma keylist Tweet userId

number of attributes

‣ Expressed in IDL (or XML)

Tweeting With DDS

@bird @ocell

‣ Tweeters come... DDS
Global Data Space
‣ Tweeters go... @oiseau @lintu

@lind @vogel

Tweeting With DDS

{@ocell, @oiseau}

@bird @ocell

‣ Tweeters follow DDS
(subscribe) to Global Data Space
@oiseau @lintu
other tweeters {@vogel} {@oiseau, @bird, ocell}

@lind @vogel

Tweeting With DDS

{@ocell, @oiseau}

@birdTopic @ocellTopic
‣ Each Tweeter @bird @ocell

can be @oiseauTopic
represented @lintuTopic
@lintu
with a unique @oiseau @lindTopic
topic {@vogel}
@vogelTopic
{@oiseau, @bird, ocell}

@lind @vogel

can
rti tions
DS pa

Tweeting With DDS
D ng
Note: ied by usi
be specif weeter
.*
g. t
rds, e.
wildca


{@ocell, @oiseau}

‣ ...or each tweeter.bird tweeter.ocel
Tweeter can @TweetTopic @TweetTopic
@ocell
be represented @bird

with a unique @TweetTopic
tweeter.oiseau
partition @TweetTopic
@oiseau @lintu
@TweetTopic tweeter.lintu
‣ All tweeters {@vogel} tweeter.lind {@oiseau, @bird, ocell}
use the same @TweetTopic
tweeter.vogel
topic
@lind @vogel

Tweeting With DDS

{@ocell, @oiseau}

‣ ...or all
Tweeters use
@ocell
the same topic @bird

‣ Content @TweetTopic

filtering or @oiseau @lintu
queries are {@vogel} {@oiseau, @bird, ocell}
used to extract
relevant data
@lind @vogel

Tweeting With DDS

Writing Tweets Reading Tweets
dds::Topic<TweetType> topic("TweetTopic");
dds::Topic<TweetType> topic("TweetTopic");
std::vector<std::string> partitions = {
dds::PublisherQos pubQoS; "tweeter.ocel",
pubQoS.set_partition("Tweeter.bird"); "tweeter.oiseau"
dds::Publisher pub(pubQoS); };
dds::PublisherQos pubQoS;
dds::DataWriter<TweetType> dw(pub); pubQoS.set_partition(partitions);
dds::Publisher pub(pubQoS);
TweetType tt = {
"@bird", dds::DataReader<TweetType> dr(pub);
"Writing next-gen tweeter in DDS"
}; std::vector<TweetType> data;
std::Vector<SampleInfo> info;
dw.write(tt);
dr.read(data, info);

Are you a Persistent Tweeter?

{@ocell, @oiseau}
‣ How do we deal with
persistence?

‣ How do we deal with @bird @ocell

Time Decoupling? DDS
Global Data Space
‣ Tweeter will always
want to see the
history of what
received @oiseau


{@ocell, chirp-chirp}
{@ocell, @oiseau}

@bird @ocell

DDS
Global Data Space
{@oiseau, chirp}

@oiseau


{@ocell, @oiseau}

@ocell: chirp-chirp
@oiseau: chirp @bird @ocell

DDS
Global Data Space

@oiseau


@bird: windsurfing in tarifa
{@ocell, @oiseau}

@ocell: chirp-chirp
@oiseau: chirp @bird @ocell

DDS
Global Data Space

@oiseau


@ocell

DDS
Global Data Space

@oiseau


@ocell: h@ave fun

@ocell

DDS
Global Data Space
@oiseau: time to try kitesurfing :p

@oiseau


{@ocell, @oiseau}

@ocell: chirp-chirp
@oiseau: chirp
@ocell: h@ave fun @bird @ocell
@oiseau: time to try...
DDS
Global Data Space

@oiseau

Yes, I am More than Persistent...

‣ OpenSplice DDS provides a native (non-dbms-based) high
performance persistence implementation

‣ Data Persistence can be controlled at a very fine granularity to
tune scalability, performance and resource usage act ion!
ee t his in
Le t’ s s
in a ction!
see this is in
actio
n!

et’s
h
see t
n! Let’s
in actio
L Let’s see this

What Else Can I Do?

‣ Content Filtering
‣ Queries DBMS

‣ Security
‣ Connection to DBMS
‣ Connector to Apache CAMEL
‣ REST Connector
‣ ... RESTful
Apache
Connector Camel

ng
si

t
o
ou e D
n
u
DS
in Tweeting
ab lic ud

A
w
O
a lk
p
S
p
en he
t
C lo
with
OpenSplice DDS

Getting cloudy

Why the Cloud?

‣ Sometimes you need to
scale your application
world-wide

‣ Relying on proprietary
infrastructure can be very
expensive

‣ For some small companies
this is not an option either

Why OpenSplice DDS on the Cloud?

‣ Adopt a standard-based and Open Source technology to
avoid lock-in int Cloud-Provided Messaging/Caching/Data
Distribution

‣ Leverage OpenSplice DDS high performance within the cloud
‣ Leverage OpenSplice DDS scalability to Ultra Large Scale
Systems across clouds

‣ Leverage OpenSplice DDS technology ecosystem to get your
data where you need and how you need (DBMS, REST, etc.)

tweet...

DDS
tweet...
tweet...
tweet...

DDS

DDS
tweet...

tweet...
DDS
DDS
tweet...
tweet...

DDS

World Wide Tweeting with OpenSplice

tweet...

‣ OpenSplice
within and tweet...
tweet...
DDS
tweet...

across centers DDS
DDS
tweet...

ensures
performance
and scalability
tweet...

‣ Rich set of
tweet...
DDS
DDS DDS
OpenSplice DSD tweet...

connectors

...in Action

tweet...

DDS
DDS RESTful API
DDS

DDS
DDS DDS

...in Action

DDS
tweet...

tweet...
DDS
tweet...
RESTful API
DDS

DDS
tweet...
DDS DDS
tweet...

...in Action
tion!

in ac
tweet...

this
Let’s
in a
see
ction!
this
tweet... tweet...

see DDS
tion!
in ac

t’s
see this
Let’s

Le
action!
Let’s see thisDDS
in RESTful API,
SOAP,
DDS Native DDS

DDS
DDS DDS

tweet...
tweet...

ng
si

t
o
ou e D
n
u
DS
in Tweeting
ab lic ud

A
w
O
a lk
p
S
p
en he
t
C lo
with
OpenSplice DDS

Clouds and
Air-traffic Control?

Cloud and ATC?

Air Trafﬁc Control

CoFlight eFDP ATCC
Brest ATCC
ATCC
Reims

‣ Next-Generation European Flight
Paris

Data Processor ATCC
ATCC
Zurich

Geneve

‣ All data distribution performed
ATCC ATCC
ATCC Milano Padova
Bordeaux
ATCC
Aix-en-

using OpenSplice DDS
Provence

‣ Deployed starting from 2011 in ATCC
Roma

ATCC

France, Italy, and Switzerland
Brindisi

Some Numbers
‣ Hundreds of DDS Publisher/Subscribers per Centers
‣ 11 Centers Spread across 3 Countries

Air Trafﬁc Control

SESAR
‣ Operational integration of
all Air Traffic Control
Centers Pan-European PENS
(Pan-Eropean Network Service)

‣ DDS selected as the
standard to distribute real-
time information Pan-EU

ng
si

t
o
ou e D
n
u
DS
in Tweeting
ab lic ud

A
w
O
a lk
p
S
p
en he
t
C lo
with
OpenSplice DDS

Open Splice DDS USers

OpenSplice DDS

‣ Open Source implementation of
the full OMG DDS Standard Enterprise Ed.

‣ Commercially supported by Professional Ed.
PrismTech
Compact Ed.
‣ Four different supported
Editions to address the from
the most typical to the most Community Ed.

advanced users

OpenSplice DDS Performances
Latency
Throughput -./0/1/23' 456/'

#+(+%++' &&++%++'
Inter-Node Latency
$+(+%++' !"#$%&#'
"!+%++'
"*(%)+' ")(%&!' ""&%,&'&+++%++'
‣ 60 usec
)"#%*)' "++%++'

!+(+%++'
)$,%$*' Inter-Core Read-Latency
‣ 2 usec
)++%++'
&'$($)$*+%

*!#%,&'

!"#$%
,+(+%++' *++%++'
()(!%(*'
Inter-Core Latency
#++%++'
(+(+%++' &")&%+)'
$&"%,,'
‣ <10 usec
$++%++'
&!(,%!)'

&+(+%++'
),,%$#' !++%++'
,*+%&)'
!,*%))'
HW:
(+%++'
,($%!+' (("%!"'
&&)%*$' $"%"$' ,+%($' ,++%++'
‣ Dell blade-server
)' &#' ,(' #!' &()' ($#' $&(' &+(!' (+!)' !+"#' ‣ Dual-core, Dual-CPU, AMD Opteron 2.4 Ghz
!*$$,(*%-./*% OS
Test Scenario ‣ Linux 2.6.21-1.3194.fc7
Network
‣ Single Threaded Application (multi-threaded networking service) ‣ Gigabit Ethernet cards
‣ 8192 bit message batches ‣ Dell PowerConnect 5324 switch

ng
si

t
o
ou e D
n
u
DS
in Tweeting
ab lic ud

A
w
O
a lk
p
S
p
en he
t
C lo
with
OpenSplice DDS

Summing Up...

Key Points

‣ OpenSplice DDS is a very powerful Open Source and Standard/
Based High Performance Data Distribution Technology

‣ OpenSplice DDS is widely used in systems at any scale, from
embedded to ultra large scale systems

‣ OpenSplice DDS provides a rich set of features that make it the
ideal choice as the data distribution technology for a traditional
deployment and equally for a Cloud-based deployment

OpenSplice DDS
References
Delivering Performance, Openness, and Freedom

http://www.opensplice.com/
http://www.opensplice.org/ http://www.slideshare.net/angelo.corsaro
emailto:opensplicedds@prismtech.com

http://bit.ly/1Sreg
http://twitter.com/acorsaro/

http://www.youtube.com/OpenSpliceTube http://opensplice.blogspot.com

ng
si

t
o
ou e D
n
u
DS
in Tweeting
ab lic ud

A
w
O
a lk
p
S
p
en he
t
C lo
with
OpenSplice DDS

THANK You! d the
ta lk? F
end
m
o und
e yo
it
ur
n joye S
.S. E ing? :
P bor s at h.co
m
Blo ody me nt ec
com r ismt
sa ro@p
lo. cor
a nge

Tweeting with OpenSplice DDS

Recomendados

Recomendados

Más contenido relacionado

La actualidad más candente

La actualidad más candente (20)

Destacado

Destacado (20)

Similar a Tweeting with OpenSplice DDS

Similar a Tweeting with OpenSplice DDS (20)

Más de Angelo Corsaro

Más de Angelo Corsaro (20)

Último

Último (20)

Tweeting with OpenSplice DDS