More Related Content Similar to X-PERT: Accurate Identification of Cross-Browser Issues in Web Applications (20) X-PERT: Accurate Identification of Cross-Browser Issues in Web Applications37. Comprehensive(
XBI(Detection9
• Behavioral XBIs
• Content XBIs
• Structural XBIs
Text
Visual
Text(Content)
check(using(9
String(equality9
WebDiff([ICSM’10])
Roy(Choudhary(and(Orso9
CrossCheck([ICST’12])
Roy(Choudhary,(Prasad(and(Orso9
CrossT([ICSE’11](
Mesbah(and(Prasad9
38. Comprehensive(
XBI(Detection9
• Behavioral XBIs
• Content XBIs
• Structural XBIs
Text
Visual
Visual(Content)
check(using(9
Image(Matching9
Computer9
Vision9
WebDiff([ICSM’10])
Roy(Choudhary(and(Orso9
CrossCheck([ICST’12])
Roy(Choudhary,(Prasad(and(Orso9
41. Alignment(Graph((AG)(
9
• A graph capturing structural
relationships between elements
(rectangles) on the webpage
• An AG has:
o Containment relationships
o Alignment relationships
o Attributes
above9
right2align9
left2align9
68. Subjects(
9
Name% Type% States% Transi/ons%
DOM%Nodes%(per%screen)%
max% min% average%
!Organizer! Produc/vity! 13! 99! 27482! 10001! 13051!!
!GrantaBooks! Publisher! 9! 8! 37800! 15625! 25852!!
!DesignTrust! Business! 10! 20! 26437! 7772! 18694!!
!DivineLife! Spiritual! 10! 9! 140611! 9082! 49886!!
!SaiBaba! Religious! 13! 20! 42606! 524! 12162!!
!Breakaway! Sport! 19! 18! 45148! 8191! 13059!!
!Conference! Informa/on! 3! 12! 878! 817! 853!!
!Fisherman! Restaurant! 15! 17! 39146! 15720! 21336!!
!Valleyforge! Lodge! 4! 12! 5416! 4733! 5046!!
!UniMelb! University! 9! 8! 15142! 12131! 13792!!
!Konqueror! SoUware! 5! 4! 17586! 15468! 16187!!
!UBC! Club! 7! 7! 20610! 7834! 12094!!
!BMVBS! Ministry! 5! 20! 19490! 12544! 15695!!
!StarWars! Movie! 10! 9! 28452! 19719! 22626!!!
800(2(140K(elements9
Prior(Art((6)9
Example(and(Survey((4)9
Random((4)9
69. Subjects(
9
Name% Type% States% Transi/ons%
DOM%Nodes%(per%screen)%
max% min% average%
!Organizer! Produc/vity! 13! 99! 27482! 10001! 13051!!
!GrantaBooks! Publisher! 9! 8! 37800! 15625! 25852!!
!DesignTrust! Business! 10! 20! 26437! 7772! 18694!!
!DivineLife! Spiritual! 10! 9! 140611! 9082! 49886!!
!SaiBaba! Religious! 13! 20! 42606! 524! 12162!!
!Breakaway! Sport! 19! 18! 45148! 8191! 13059!!
!Conference! Informa/on! 3! 12! 878! 817! 853!!
!Fisherman! Restaurant! 15! 17! 39146! 15720! 21336!!
!Valleyforge! Lodge! 4! 12! 5416! 4733! 5046!!
!UniMelb! University! 9! 8! 15142! 12131! 13792!!
!Konqueror! SoUware! 5! 4! 17586! 15468! 16187!!
!UBC! Club! 7! 7! 20610! 7834! 12094!!
!BMVBS! Ministry! 5! 20! 19490! 12544! 15695!!
!StarWars! Movie! 10! 9! 28452! 19719! 22626!!!
800(2(140K(elements9
70. Effectiveness(
9
NAME% XBI%
BEHAVIOR% STRUCTURE%
CONTENT%
TOTAL%TEXT% IMAGE%
TP% FP% TP% FP% TP% FP% TP% FP% TP% FP%
Organizer! 10! 1! 0! 9! 0! 0! 0! 0! 0! 10! 0!
GrantaBooks! 27! 16! 0! 11! 0! 0! 0! 0! 0! 27! 0!
DesignTrust! 7! 2! 0! 5! 3! 0! 0! 0! 0! 7! 3!
DivineLife! 11! 7! 0! 3! 6! 1! 0! 0! 0! 11! 6!
SaiBaba! 5! 2! 0! 2! 9! 0! 0! 0! 0! 4! 9!
Breakaway! 13! 0! 0! 10! 2! 0! 0! 0! 0! 10! 2!
Conference! 7! 2! 0! 3! 0! 1! 0! 1! 0! 7! 0!
Fisherman! 5! 1! 0! 3! 1! 0! 1! 1! 0! 5! 2!
Valleyforge! 3! 0! 0! 2! 2! 0! 0! 1! 0! 3! 2!
UniMelb! 2! 2! 0! 0! 0! 0! 0! 0! 1! 2! 1!
Konqueror! 0! 0! 0! 0! 0! 0! 0! 0! 6! 0! 6!
UBC! 0! 0! 0! 0! 0! 0! 0! 0! 0! 0! 0!
BMVBS! 1! 0! 0! 0! 0! 0! 0! 0! 0! 0! 0!
StarWars! 12! 0! 0! 12! 0! 0! 0! 0! 0! 12! 0!
TOTAL% 103% 33% 0% 60% 23% 2% 1% 3% 7% 98% 31%
71. Effectiveness(
9
NAME% XBI%
BEHAVIOR% STRUCTURE%
CONTENT%
TOTAL%TEXT% IMAGE%
TP% FP% TP% FP% TP% FP% TP% FP% TP% FP%
Organizer! 10! 1! 0! 9! 0! 0! 0! 0! 0! 10! 0!
GrantaBooks! 27! 16! 0! 11! 0! 0! 0! 0! 0! 27! 0!
DesignTrust! 7! 2! 0! 5! 3! 0! 0! 0! 0! 7! 3!
DivineLife! 11! 7! 0! 3! 6! 1! 0! 0! 0! 11! 6!
SaiBaba! 5! 2! 0! 2! 9! 0! 0! 0! 0! 4! 9!
Breakaway! 13! 0! 0! 10! 2! 0! 0! 0! 0! 10! 2!
Conference! 7! 2! 0! 3! 0! 1! 0! 1! 0! 7! 0!
Fisherman! 5! 1! 0! 3! 1! 0! 1! 1! 0! 5! 2!
Valleyforge! 3! 0! 0! 2! 2! 0! 0! 1! 0! 3! 2!
UniMelb! 2! 2! 0! 0! 0! 0! 0! 0! 1! 2! 1!
Konqueror! 0! 0! 0! 0! 0! 0! 0! 0! 6! 0! 6!
UBC! 0! 0! 0! 0! 0! 0! 0! 0! 0! 0! 0!
BMVBS! 1! 0! 0! 0! 0! 0! 0! 0! 0! 0! 0!
StarWars! 12! 0! 0! 12! 0! 0! 0! 0! 0! 12! 0!
TOTAL% 103% 33% 0% 60% 23% 2% 1% 3% 7% 98% 31%
RQ1:()
Can(X2PERT(find(XBIs(in(real(web(applications?9
9
Answer:(Yes)
72. Improvement(
9
NAME% XBI%
XQPERT% CROSSCHECK%
Prec% FP% Recl% Dp% Prec% FP% Recl% Dp%
Organizer! 10! 100%! 0! 100%! 0! 80%! 2! 80%! 13!
GrantaBooks! 27! 100%! 0! 100%! 0! 96%! 1! 100%! 0!
DesignTrust! 7! 70%! 3! 100%! 0! 5%! 122! 86%! 3!
DivineLife! 11! 65%! 6! 100%! 0! 29%! 24! 91%! 3!
SaiBaba! 5! 31%! 9! 80%! 0! 7%! 53! 80%! 10!
Breakaway! 13! 83%! 2! 77%! 1! 13%! 49! 54%! 12!
Conference! 7! 100%! 0! 100%! 0! 100%! 0! 100%! 0!
Fisherman! 5! 71%! 2! 100%! 0! 44%! 5! 80%! 8!
Valleyforge! 3! 60%! 2! 100%! 0! 50%! 1! 33%! 0!
UniMelb! 2! 67%! 1! 100%! 0! 7%! 27! 100%! 0!
Konqueror! 0! NA! 6! NA! 0! 0%! 11! NA! 0!
UBC! 0! NA! 0! NA! 0! 0%! 1! NA! 0!
BMVBS! 1! NA! 0! NA! 0! 0%! 2! 0%! 0!
StarWars! 12! 100%! 0! 100%! 0! 10%! 91! 83%! 3!
TOTAL% 103% 77%% 31% 95%% 1% 32%% 389% 74%% 52%
73. Improvement(
9
NAME% XBI%
XQPERT% CROSSCHECK%
Prec% FP% Recl% Dp% Prec% FP% Recl% Dp%
Organizer! 10! 100%! 0! 100%! 0! 80%! 2! 80%! 13!
GrantaBooks! 27! 100%! 0! 100%! 0! 96%! 1! 100%! 0!
DesignTrust! 7! 70%! 3! 100%! 0! 5%! 122! 86%! 3!
DivineLife! 11! 65%! 6! 100%! 0! 29%! 24! 91%! 3!
SaiBaba! 5! 31%! 9! 80%! 0! 7%! 53! 80%! 10!
Breakaway! 13! 83%! 2! 77%! 1! 13%! 49! 54%! 12!
Conference! 7! 100%! 0! 100%! 0! 100%! 0! 100%! 0!
Fisherman! 5! 71%! 2! 100%! 0! 44%! 5! 80%! 8!
Valleyforge! 3! 60%! 2! 100%! 0! 50%! 1! 33%! 0!
UniMelb! 2! 67%! 1! 100%! 0! 7%! 27! 100%! 0!
Konqueror! 0! NA! 6! NA! 0! 0%! 11! NA! 0!
UBC! 0! NA! 0! NA! 0! 0%! 1! NA! 0!
BMVBS! 1! NA! 0! NA! 0! 0%! 2! 0%! 0!
StarWars! 12! 100%! 0! 100%! 0! 10%! 91! 83%! 3!
TOTAL% 103% 77%% 31% 95%% 1% 32%% 389% 74%% 52%
X"PERT)
9
Precision()
((=(77%((
(((((45%!)9
9
Recall()
((=(95%(
(((((14%!)9
74. Improvement(
9
NAME% XBI%
XQPERT% CROSSCHECK%
Prec% FP% Recl% Dp% Prec% FP% Recl% Dp%
Organizer! 10! 100%! 0! 100%! 0! 80%! 2! 80%! 13!
GrantaBooks! 27! 100%! 0! 100%! 0! 96%! 1! 100%! 0!
DesignTrust! 7! 70%! 3! 100%! 0! 5%! 122! 86%! 3!
DivineLife! 11! 65%! 6! 100%! 0! 29%! 24! 91%! 3!
SaiBaba! 5! 31%! 9! 80%! 0! 7%! 53! 80%! 10!
Breakaway! 13! 83%! 2! 77%! 1! 13%! 49! 54%! 12!
Conference! 7! 100%! 0! 100%! 0! 100%! 0! 100%! 0!
Fisherman! 5! 71%! 2! 100%! 0! 44%! 5! 80%! 8!
Valleyforge! 3! 60%! 2! 100%! 0! 50%! 1! 33%! 0!
UniMelb! 2! 67%! 1! 100%! 0! 7%! 27! 100%! 0!
Konqueror! 0! NA! 6! NA! 0! 0%! 11! NA! 0!
UBC! 0! NA! 0! NA! 0! 0%! 1! NA! 0!
BMVBS! 1! NA! 0! NA! 0! 0%! 2! 0%! 0!
StarWars! 12! 100%! 0! 100%! 0! 10%! 91! 83%! 3!
TOTAL% 103% 77%% 31% 95%% 1% 32%% 389% 74%% 52%
X"PERT)
9
Precision()
((=(77%((
(((((45%!)9
9
Recall()
((=(95%(
(((((14%!)9
RQ2:()
How(does(X2PERT(compare(to(the(state2of2art?9
9
Answer:(X"PERT(has(be[er(precision(and(recall)
76. Related(Work9
o Industrial tools
• Test Suites for Web Browsers – Acid and test262
• MS Expression Web, BrowserShots, BrowserStack
• Browsera, MogoTest, BrowserBite
o Research techniques
• Eaton & Memon [IJWET’07]
• Dallmeier, Burger, Orth & Zeller [JSTools’12]
77