Jesus Gonzalez-Barahona presented on using Grimoire tools to analyze OpenStack. Grimoire extracts data from source code repositories, issue trackers, and mailing lists about OpenStack and stores it in databases. Visualization tools can then query the databases to generate statistics, charts, and dashboards about OpenStack activity and development over time. The goal is to provide transparency and objective information about the OpenStack community and project.

1. Using *Grimoire to analyze OpenStack
Jesus M. Gonzalez-Barahona
jgb@bitergia.com
http://identi.ca/jgbarah http://twitter.com/jgbarah
Bitergia
GSyC/LibreSoft (Universidad Rey Juan Carlos)
OpenStack Summit, Portland, April 15th, 2013
OpenStack Summit Portland 2013 1/
Jesus Gonzalez-Barahona (Bitergia) Using *Grimoire to analyze OpenStack 20

2. c 2012, 2013 Bitergia
Some rights reserved. This presentation is distributed under the
“Attribution-ShareAlike 3.0” license, by Creative Commons, available at
http://creativecommons.org/licenses/by-sa/3.0/
OpenStack Summit Portland 2013 2/
Jesus Gonzalez-Barahona (Bitergia) Using *Grimoire to analyze OpenStack 20

3. We’ve done the Grizzly companies analysis
http://blog.bitergia.com/2013/04/04/
companies-contributing-to-openstack-grizzly-analysis/
OpenStack Summit Portland 2013 3/
Jesus Gonzalez-Barahona (Bitergia) Using *Grimoire to analyze OpenStack 20

4. We’re deploying the OpenStack activity dashboard
http://activity.openstack.org/dash/
OpenStack Summit Portland 2013 4/
Jesus Gonzalez-Barahona (Bitergia) Using *Grimoire to analyze OpenStack 20

5. We’re deploying the OpenStack activity dashboard (2)
This is a (preliminary) preview!!!
http://activity.openstack.org/dash/dashboard/
OpenStack Summit Portland 2013 5/
Jesus Gonzalez-Barahona (Bitergia) Using *Grimoire to analyze OpenStack 20

6. Measuring OpenStack activity
Information about code, community, development
for OpenStack
can be retrieved, organized, analyzed
Let’s do it!
OpenStack Summit Portland 2013 6/
Jesus Gonzalez-Barahona (Bitergia) Using *Grimoire to analyze OpenStack 20

7. Measuring OpenStack activity (why?)
Why?
Open development: transparency
Complex information: knowledge extraction
Community-based decisions: objective information
Decision tracking: parameters to decide
...
OpenStack Summit Portland 2013 7/
Jesus Gonzalez-Barahona (Bitergia) Using *Grimoire to analyze OpenStack 20

8. Data has to be extracted, mined
Data lives in repositories
usually not designed to release it easily:
tools are needed to retrieve and extract
Data includes many complexities and details
tools are needed to assist in mining, analysis
Analyze free software with free software!
OpenStack Summit Portland 2013 8/
Jesus Gonzalez-Barahona (Bitergia) Using *Grimoire to analyze OpenStack 20

9. The MetricsGrimoire approach
Set of tools specialized in retrieving information from
different kinds of repositories. Among them:
CVSAnalY: source code management
(CVS, Subversion, git, etc.)
Bicho: issue tracking systems
(Bugzilla, Jira, SourceForge, Allura, Launchpad,
Google Code, etc.)
& code revision systems (Gerrit)
MLStats: mailing lists
(mbox files, Mailman archives, etc.)
Store all the information in SQL databases
http://metricsgrimoire.github.com
OpenStack Summit Portland 2013 9/
Jesus Gonzalez-Barahona (Bitergia) Using *Grimoire to analyze OpenStack 20

10. vizGrimoire: Milking the databases
Once information is ready for querying:
it can be queried directly in the database
it can be analyzed from R, Python, etc.
it can be filtered, manually inspected, improved
it can be combined, cross-analyzed
it can be visualized
Set of tools to simplify & automate all of this
https://vizgrimoire.github.com
OpenStack Summit Portland 2013 10 /
Jesus Gonzalez-Barahona (Bitergia) Using *Grimoire to analyze OpenStack 20

11. vizGrimoireR: statistics, charts
R package specialized in managing MetricsGrimoire
information
Connects directly to the database and:
gets the information from it
filters & massages it
does statistical analysis on it
produces charts and WebGL 3D graphs
produces JSON files to export to other tools
...and lets you unleash all the potential of R
OpenStack Summit Portland 2013 11 /
Jesus Gonzalez-Barahona (Bitergia) Using *Grimoire to analyze OpenStack 20

12. vizGrimoireJS: visualization
JavaScript library producing visualizations
Retrieves JSON files and produces:
live charts: evolution, pies, bars, etc.
tables and text
comparative charts
actionable dashboards
soon to support links to information in forge
Integration with HTML5 applications
OpenStack Summit Portland 2013 12 /
Jesus Gonzalez-Barahona (Bitergia) Using *Grimoire to analyze OpenStack 20

13. How the OpenStack dashboard is created
Run MetricsGrimoire (CVSAnalY, Bicho, MLStats) on
repositories
Example: determining which git repositories to mine
Produce queries specific for OpenStack
Example: condition for deciding who closes a ticket
Run customized Python & R scripts to produce JSON
files Example: produce results per OpenStack
subproject
Customize vizGrimoireJS to display charts Example:
remove bots from top tables
Export the result via HTTP We still have performance
issues...
DoGonzalez-Barahona (Bitergia) Using *Grimoire to analyze OpenStack OpenStack Summit Portland 2013 20 /
Jesus
all of this continuously 13

14. Future features: tracking other parameters
0.99 (black) / 0.95 (green) / 0.5 (red) / 0.25 (blue)
6
5
4
3
2
2000 2002 2004 2006 2008 2010 2012
Time
Time-to-close (quantiles over time): Time in minutes, log 10 scale
OpenStack Summit Portland 2013 14 /
Jesus Gonzalez-Barahona (Bitergia) Using *Grimoire to analyze OpenStack 20

15. Future features: tracking other parameters (2)
Time-to-close (quantiles over time)
OpenStack Summit Portland 2013 15 /
Jesus Gonzalez-Barahona (Bitergia) Using *Grimoire to analyze OpenStack 20

16. Future features: tracking other parameters (3)
Demographics (attraction rate, retention rate per generation)
OpenStack Summit Portland 2013 16 /
Jesus Gonzalez-Barahona (Bitergia) Using *Grimoire to analyze OpenStack 20

17. In summary...
OpenStack repositories have a wealth of information
We all can do (and many do) our own analysis
Free software to analyze free software development
Let’s define common formats to interface to different
tools
We can incrementally develop a powerful platform
What would you like to know about OpenStack?
OpenStack Summit Portland 2013 17 /
Jesus Gonzalez-Barahona (Bitergia) Using *Grimoire to analyze OpenStack 20

18. Bitergia: an spin-off
Started operations in July 2012
Builds on the experience of LibreSoft R&D group
Offering professional products and services
Focused on:
Metrics about software development
(including community metrics)
Specialized support for development forges
(including metrics for projects)
http://bitergia.com
OpenStack Summit Portland 2013 18 /
Jesus Gonzalez-Barahona (Bitergia) Using *Grimoire to analyze OpenStack 20

19. Credits
Thanks go to...
Many LibreSoft developers who developed MetricsGrimoire
The (small) community now maintaining MetricsGrimoire
Some Bitergia developers producing vizGrimoire
The (future) community maintaining vizGrimoire
The many free software developers who produced all the software on
which these tools rely
You, who are producing OpenStack
http://libresoft.es
http://bitergia.com
OpenStack Summit Portland 2013 19 /
Jesus Gonzalez-Barahona (Bitergia) Using *Grimoire to analyze OpenStack 20

20. This is the end, my friend
Please, provide *any* feedback
[I would love to know what interested you the most]
[...and the least]
Final note:
Let’s find ways to understand OpenStack a bit better
OpenStack Summit Portland 2013 20 /
Jesus Gonzalez-Barahona (Bitergia) Using *Grimoire to analyze OpenStack 20