Adrian Cole

1. Clustered Services with
Apache Whirr: From Dev Up
@jclouds

2. agenda
intro
concepts
jclouds
whirr

3. intro
Adrian Cole (@jclouds)
founded jclouds march 2009
member of the Apache Whirr project
chief evangelist at Cloudsoft

4. so you want to build a
cluster..
Web REST
HTable
Browser Client
Public
UI RPC UI RPC UI RPC HTTP
Master RegionServer RegionServer RestServer
listen listen listen listen
Private

5. First, you need to analyze
the roles you need in the
cluster
hadoop- hadoop- hbase-
zookeeper
namenode datanode master
hadoop- hadoop- hbase-
jobtracker tasktracker regionserver

6. Next, organize and
understand the topology
hadoop-
tasktracker
hadoop-
zookeeper
namenode
hadoop-
datanode
hadoop- hbase-
jobtracker master
hbase-
regionserver

7. Then you need to develop
the workflow
provision
bootstrap install
configure
operate manage

8. provision
Public
hbase-master hbase-regionserver hbase-regionserver hbase-restserver
Ubuntu 10.04 Ubuntu 10.04 Ubuntu 10.04 Ubuntu 10.04
8GB RAM 8GB RAM 8GB RAM 2GB RAM
8 Cores 8 Cores 8 Cores 1 CPU
Private

9. install
Public
hbase-master hbase-regionserver hbase-regionserver hbase-restserver
login: hbase login: hbase login: hbase login: hbase
java: 1.6.0_16 java: 1.6.0_16 java: 1.6.0_16 java: 1.6.0_16
hbase: 0.90.1 hbase: 0.90.1 hbase: 0.90.1 hbase: 0.90.1
Private

10. configure
Public
UI RPC UI RPC UI RPC HTTP
Master RegionServer RegionServer RestServer
listen listen listen listen
Private

11. manage
Public
UI RPC UI RPC UI RPC
Master #2 Master RegionServer
listen listen listen
Private

12. you can make a cluster
manager with jclouds
provision
bootstrap install
configure
operate manage

13. Portable APIs
Compute LoadBalancer
BlobStore Table
Provider APIs
Driver-Architecture
Tested Providers!

14. jclouds concepts
Templates abstractly describe nodes:
What OS to use, what versions...
What kind of hardware, what features are needed...
Groups organize identically configured nodes

15. bootstrap
createNodesInGroup
minRam(8192)
hbase-master 1 osFamily(UBUNTU)
runScript(nodeInstall)
hbase-regionserver 6
proxied
hbase- proxied
proxied
master proxied
hbase-
proxied
regionserver

16. operations
Operate based on predicates
runScriptOnNodesMatching
group: hbase state: running
proxied
proxied
proxied
proxied
proxied

17. java overview github jclouds/jclouds
// init
context = new ComputeServiceContextFactory().
createContext("gogrid", apikey, secret,
singleton(new SshjSshClientModule()));
compute = context.getComputeService();
// create a couple nodes and open a couple ports
nodes = compute.createNodesInGroup(“hbase-master”, 1,
runScript(install).
inboundPorts(60000, 60010));
// gather my ip addresses
for (NodeMetadata node : nodes) {
node.getPublicAddresses();
node.getPrivateAddresses();
}

18. Whirr can build your cluster!

19. whirr apache
spec = new ClusterSpec();
spec.setProvider(“cloudservers-uk”);
spec.setIdentity(apikey);
spec.setCredential(secret);
spec.setClusterName(“hbase”);
spec.setInstanceTemplates(ImmutableList.of(
new InstanceTemplate(1,”hbase-master”),
new InstanceTemplate(6,”hbase-regionserver”)));
cluster = new ClusterController().launchCluster(spec);
$ whirr launch-cluster
--cluster-name=hbase
--instance-templates='1 hbase-master,6 hbase-regionserver'

20. Whirr internals
BootstrapClusterAction
creates cluster and runs bootstrap script for all roles
ConfigureClusterAction
configures firewall and runs configure script for all roles
DestroyClusterAction
destroys the nodes in the cluster

21. makes your
cluster sparkle!

22. you can weave in puppet
manifest just like other roles
puppet-logrotate munin::host munin::client
modules come from git or

23. example config

24. Puppet-Whirr implementation
beforeBootstrap
install all modules for roles prefixed with puppet:
beforeConfigure
apply all manifests w/attribs, then puppet apply
Notes!
tar.gz files are staged to a BlobStore instead of scp’ing

25. Special Thanks!
Alex Heneveld: Garrett Honeycutt: Chad Metcalf:
design + puppety advice concept +
integration elaboration

26. What’s next?
• More services
• VBox Support
• Chef Solo/Puppet Master integration
• Cluster healing

27. Questions?
github jclouds-examples
whirr.apache.org
@jclouds
adrian@cloudsoftcorp.com