Developer-Centric Knowledge Mining fromLarge Open-Source Software Repositories

1. Developer-Centric Knowledge Mining from
Large Open-Source Software Repositories
Paris Open Source Summit, Floss - Innovation
collaborative 2017
Alessandra Bagnato - Softeam
Softeam Paris Open Source Summit 2017 1

2.  Related activities
- Searching for candidate components
- Evaluating a set of retrieved candidate components to find
the most suitable one
- Understanding how to use the selected components
- Monitoring the selected components
Context
Development of new software systems
by reusing existing open source components
2Paris Open Source Summit 2017Softeam

3. Floss Collaborative Innovation: Open Source Software Analysis & Monitoring
 Open Source Software analysis &
Monitoring: storing, tracking,
searching and analyzing software
artefacts:
• OSSMETER FP7 Project -
Automated Measurement and
Analysis of Open Source Software
(1er October 2012 – 31st December
2014)
• CROSSMINER H2020 Project -
Developer-Centric Knowledge
Mining from
Large Open-Source Software
Repositories
• (1er January 2017 – 31st Dec 2019)

4. OW2Con 2017 4
FP7 OSSMETER
https://github.com/ossmeter/ossmeter
Softeam

5. OW2Con 2017 5
H2020 CROSSMINER https://github.com/crossminer
Softeam

6.  Related activities
- Searching for candidate components
- Evaluating a set of retrieved candidate components to find
the most suitable one
- Understanding how to use the selected components
- Monitoring the selected components
Context
Development of new software systems
by reusing existing open source components
6Paris Open Source Summit 2017Softeam

7.  Challenging tasks
- assessing quality, maturity,
activity of development and user
support is not a straightforward
process
 Different and
heterogeneous source of
information
- e.g., code repositories,
communication channels, bug
tracking systems
Selecting and Using OSS components
Source code
Q&A systems
Bug Reports
API
Documentation
Tutorials
Configuration
Management Systems
7Paris Open Source Summit 2017Softeam

8. 8Paris Open Source Summit 2017Softeam

9. 9
Analysis of OSS projects in OSSMETER
OSS
Project
Communication channel
(Newsgroup/forum/
mailing list)
Source Code
Repository
Bug Tracking
System
OSS Forge
Metadata
Paris Open Source Summit 2017Softeam

10. 10
Analysis of OSS projects in OSSMETER
Paris Open Source Summit 2017Softeam

11.  Wealth of data to present
 Needs to be user-friendly / digestible
 Presentation driven by the quality model
Presentation
Paris Open Source Summit 2017Softeam

12. The default OSSMETER quality model
12Paris Open Source Summit 2017Softeam

13. 13Paris Open Source Summit 2017Softeam

14. 14Paris Open Source Summit 2017Softeam

15. CROSSMINER aims at
doing more
15Paris Open Source Summit 2017Softeam

16. 16
Source code
Q&A systems
Bug Reports
API
Documentation
Tutorials
Configuration
Management Systems
Paris Open Source Summit 2017Softeam

17. OW2Con 2017 17
CROSSMINER: high-level view
Data Preprocessing Capturing Context
Producing
Recommendations
Presenting
Recommendations
Softeam

18. Mining and Analysis Tools
18
CROSSMINER: high-level view
Data Preprocessing Capturing Context
Producing
Recommendations
Presenting
Recommendations
Knowledge Base
Source Code
Miner
NLP
Miner
Configuration
Miner
Cross project
Analysis
OSS forges
Source Code
Natural
language
channels
Configuration
Scripts
lookup/store
mine
Paris Open Source Summit 2017Softeam

19. 19
CROSSMINER: high-level view
Data Preprocessing Capturing Context
Producing
Recommendations
Presenting
Recommendations
Developer
IDE
Knowledge Base
query
recommendations
Data
Storage
Real-time recommendations that serve productivity and quality increase
Paris Open Source Summit 2017Softeam

20. 20
CROSSMINER Deployment diagram
Paris Open Source Summit 2017Softeam

21.  FP7 OSSMETER:
https://github.com/ossmeter/ossmeter
 H2020 CROSSMINER https://github.com/crossminer
 Docker Images for the platform component for
ossmeter & the web app for ossmeter:
https://hub.docker.com/u/crossminer/ (this is a
prototype: images are built from a dedicated git
repo, and pushed to docker hub)
21
OSSMETER & CROSSMINER on GitHub & Docker
Softeam Paris Open Source Summit 2017

22. 22
Web site: http://www.ossmeter.org/
Softeam Paris Open Source Summit 2017

23. 23
Web Site: https://www.crossminer.org/
Softeam Paris Open Source Summit 2017

24. www.crossminer.org
@crossminer
University of L'Aquila OW2Con 2017 24

25. Thanks!
Alessandra Bagnato, Softeam R&D
Alessandra.bagnato@softeam.fr
alebagnato@yahoo.com
@alebagnato