This document provides information about the selection of the most influential papers from the 30 year history of the International Symposium on Software Reliability Engineering (ISSRE). It describes the selection criteria, which included a call for proposals, bibliometric analysis of highly cited ISSRE papers, and opinions from former ISSRE program chairs. This resulted in 26 selected papers covering topics like software reliability, testing, aging, and failure analysis from 1992 to 2016. The document lists these selected papers and their authors.

1. @30
Bojan Cukic
Chair, Steering Committee

2. •The first edition of ISSRE
•An Industry initiative!
•AT&T, NASA, HP…
•Industry – University collaboration
• The Legacy!

3. # published
research
papers: 1,074
Average
acceptance
rate for
research
papers: ~30%
Industry
attendance:
30%-45%
Unique
authors:
1879
Citations:
~92,272;
43% citations
by top 100,
80% .. Top
500 authors

4. Most influential papers of 30 years of ISSRE
(highlights from 30 years of ISSRE)
Domenico Cotroneo
Karama Kanoun
Marco Vieira
Mladen Vouk

5. Selection Criteria
• We setup a call for proposal. We received 9 papers proposals
• Bibliometric analysis of all the ISSRE papers (11 more papers with highest
impact);
• «Call for opinions» with former PC-Chairs of all ISSRE editions (6 more papers)
• At the end, we have 26 papers
• Although our effort we know that perfect criteria do not exist !
• For this reason we prefer to talk about
<<Highlights from 30 years of ISSRE>>

6. Software
Reliability
Growth
Failure
Analysis
Software
Testing
Robustness
Testing
Software
Aging
• Software Reliability
• Software
Measurement
• Reliability
Engineering
• …
• Failure Analysis
• Monitoring
• Fault Detection
• …
• Software Testing
• Automatic Testing
• Genetic Mutations
• …
• Robustness
• Fault Tolerance
• Emulation
• …
• Aging
• Software
Maintenance
• Degradation
• …

8. 1992
1994
1999
The operational profile in
software reliability
engineering: an overview
Adjusting measured field
failure intensity for operational
profile variation
J.D. Musa
Assessment of a
sampling method for
measuring safety-critical
software reliability
F. B. Bastani;
A. Pasquini
Scenario-based reliability
analysis of component-
based software
S.M. Yacoub;
B. Cukic;
H.H. Ammar
1994

9. 2000
2003
2009
A novel method for early
software quality prediction
based on support vector
machine
Test-driven development as
a defect-reduction practice
How to Measure the Impact of
Specific Development Practices
on Fielded Defect Density
F Xing;
P Guo;
M. R. Lyu
L. Williams;
E.M. Maximilien;
M. Vouk
A.M. Neufelder
Putting It All Together: Using
Socio-technical Networks to
Predict Failures
C. Bird;
N. Nagappan;
H. Gall;
B. Murphy;
P. Devanbu
2005

10. 1993
1995
2014
Experience in software reliability:
From data collection to
quantitative evaluation
Analysis of failures in the
Tandem NonStop-UX
Operating System
K. Kanoun;
M. Kaaniche;
J.C. Laprie
A. Thakur;
R.K. Iyer;
L. Young;
I. Lee
Failure Analysis of Jobs in
Compute Clouds: A Google
Cluster Case Study
Xin Chen;
Charng-Da Lu;
K. Pattabiraman
Anomaly Detection and Root Cause
Localization in Virtual Network Functions
Experience Report: System Log
Analysis for Anomaly Detection
C. Sauvanaud;
K. Lazri;
M. Kaâniche;
K. Kanoun
Shilin He;
Jieming Zhu;
Pinjia He;
M. R. Lyu
2016
2016

11. 1993
Effect of test set size and block
coverage on the fault detection
effectiveness
A coverage analysis tool for the
effectiveness of software testing
M. R. Lyu;
J.R. Horgan;
S. London
W.E. Wong;
J.R. Horgan;
S. London;
A.P. Mathur
1994
A pattern-based approach for
GUI modeling and testing
Inter-class mutation
operators for Java
A case study using the round-
trip strategy for state-based
class testing
G. Antoniol;
L.C. Briand;
M. Di Penta;
Y. Labiche
R. M. L. M. Moreira;
Ana C. R. Paiva;
A. Memon
Yu-Seung Ma;
Yong-Rae Kwon;
J. Offutt
2002
2013
2002

12. 1995
Development of a benchmark
to measure system
robustness: experiences and
lessons learned
Improving the software
development process using
testability research
Antirandom testing: getting the
most out of black-box testing
Byung-Hoon Suh;
J. Hudak;
D. Siewiorek;
Z. Segall
Y.K. Malaiya
J.M. Voas;
K.W. Miller
1992
Error injection aimed at fault removal
in fault tolerance mechanisms
Emulation of software faults by educated
mutations at machine-code level
J. Duraes;
H. Madeira
J. Christmansson;
P. Santhanam;
R. Chillarege
1996
2002
1992

13. 1998
Analysis of software
rejuvenation using Markov
Regenerative Stochastic
Petri Net
A methodology for
detection and
estimation of
software aging
1995
Software Aging
Analysis of the
Linux Operating
System
S. Garg;
A. Puliafito;
M. Telek;
K.S. Trivedi
D. Cotroneo;
R. Natella;
R. Pietrantuono;
S. Russo
2010
S. Garg;
A. van Moorsel;
K. Vaidyanathan;
K.S. Trivedi