1. 1
Joint work with
Ravi Kumar & Andrew Tomkins (Google)
Rediet Abebe & Jon Kleinberg (Cornell)
Michael Schaub & Ali Jadbabaie (MIT)
Set prediction three ways
Austin R. Benson · Cornell
SCAN Seminar · September 10, 2018
Slides. bit.ly/arb-SCAN18
3. This talk looks at predicting sets from three perspectives.
3
Set-based data is common, but we don’t have a great understanding
of its complexities and the associated human behavior.
• Team formation (writing papers, organizational behavior).
• Multiple classification codes in hospital visits.
• Co-purchasing sets on Amazon.
• Sets of annotations on questions on web forums.
4. 4
Set Prediction #1. Individuals repeating interactions.
Given a history of an individual’s set-based interactions, which ones repeat?
Who will repeat as my coauthors on my next paper?
Sequences of Sets. Benson, Kumar, & Tomkins. KDD, 2018.
5. Lots of data looks like sequences of sets.
5
EMAIL
Sequence of recipient sets in my email ⟶ one sequence of sets
Collection of email senders ⟶ sequences of sets.
6. Lots of data looks like sequences of sets.
6
Q&A
FORUM
TAGS
7. Our work provides a generative model that captures
the important characteristics of sequences of sets.
7
1. email data
sequence for each account
sets are recipients on emails sent by account
2. Stack Exchange tags
sequence for each user
sets are tags on questions asked by the user
3. Coauthorship
sequence for each academic
sets are coauthors on paper
4. Proximity contact
sequence for each person
sets are people interacting with the person
tags-mathoverflow
tags-math-sx
email-Enron-core
email-Eu-core
contact-prim-school
contact-high-school
coauth-Business
coauth-Geology
8. Our work provides a generative model that captures
the important characteristics of sequences of sets.
8
Applications.
1. Predicting new sets.
2. Understanding basic user behaviors.
3. Generative model ⟶ event likelihood ⟶ anomaly detection.
4. Generative model ⟶ simulation.
5. Amenable to analysis.
10. Most sets are not entirely novel &
many are exact repeats.
10
tags-mathoverflow
tags-math-sx
email-Enron-core
email-Eu-core
contact-prim-school
contact-high-school
coauth-Business
coauth-Geology
11. Subsets and supersets of prior sets are common.
11
tags-mathoverflow
tags-math-sx
email-Enron-core
email-Eu-core
contact-prim-school
contact-high-school
coauth-Business
coauth-Geology
12. There is recency bias in the repeat behavior.
12
Consistent with previous results on sequences of single items.
[Benson-Kumar-Tomkins 16; Anderson+ 14]
13. size-2 subset counts size-3 subset counts
Dataset data null model data null model
email-Enron-core 5.82 4.34 ± 0.043 4.23 2.67 ± 0.038
email-Eu-core 4.46 3.11 ± 0.008 3.23 2.08 ± 0.007
contact-prim-school 2.36 1.87 ± 0.003 1.35 1.09 ± 0.002
contact-high-school 4.49 3.26 ± 0.007 2.09 1.35 ± 0.004
tags-mathoverflow 1.49 1.41 ± 0.002 1.18 1.15 ± 0.002
tags-math-sx 1.49 1.31 ± 0.001 1.21 1.12 ± 0.001
coauth-Business 1.50 1.30 ± 0.001 1.40 1.24 ± 0.001
coauth-Geology 1.29 1.15 ± 0.000 1.15 1.07 ± 0.000
<latexit sha1_base64="PbRgN8ZetYi3/8RQh4MqDOE3dR8=">AAAHBXicdVXJjts2GFbS2E3UbdIceyE6bpAeZGjzjOcWpC3aYwp0kgCWMaBo2haGiyCSzUwFnXPuNX2G3ope+xx9hL5Ff1JepLFjwyD9bT9N/pTzkhVKh+G/9+5/9GAw/PjhI/+TTz/7/IuTx1++UtJUhF4SyWT1JseKskLQS11oRt+UFcU8Z/R1fv2d5V//SitVSPGLvi3pnOOVKJYFwRqgq8eDB5mgb4nkHItFnS2whjDdzKJ5nWl6o4WsOGb1adQ0fk9JRSVFs3PUlOOCBT9YNCCyogd6cyg2R5VECl1WBe/oLYSJDiwcKLKWkh1zrYvV+ojLwh9wcazX6qbj0XilAosGAB8RS9jMJZNvj1l23B1fbhScjlK9pWEDNV5smTuOFYWDW90eGn7cEI3vZzldFQKqw1E3M53P/QyEjIqVXsPZ4RyaQ9GyqeNSNx21YbhqaoZI+wZKy7IyjPpPUcYN0wUYDRd13NSkqVXxGw1ipEwO6YhII7TKyjUWWvIatgg9RR+0JX1bg7LMzwgvFrbcs+rbOg6SpgekwaTxv29/MyTbXw+DMIwhLheUHcWyDPnZJsQftZ05AslkPI1hSMdJikZZyUcoHIdp4qDYDvH47HzPJFNYHtjNyCnSMxiScRTtFeHUQRsvfNsz58iZt707corERkTjaadImDgombghvOgwMdpn2Ja1GXYdF23Rs141t4CLbdaeSduMbjuOnCptxWnUq2ihaNoOkx6zi1E3vYCkGxA5KG6HKO4yzr/t/DZhErYJ4UFC2jJx2mNcxOYqtAnxxeFSwy3kNvS8x9h+y6WGVnW9Aa2x2F2B3Te4Plcnp85gPYeTaDM59Tavl1cn/2ULSQynQhOGlZpFYannNa7gGkCenxm4ephc4xWdwVRgTtW8do/rBn0DyAItZQUfYS8HoF1HjblStzwHpTuAu5wFj3Ezo5fTeV2I0mgqSFtoaRjSEtlnP1oUFSWa3cIEk6qAtSKyxhU8I+Efolcll/IatkbBcwb2Jrq7E4eTV/E4CsfRz/Hp8xebXXrofeV97T3zIu/ce+795L30Lj0yuB78Png/+GP4bvjn8K/h3630/r2N54nXew3/+R80STIk</latexit><latexit sha1_base64="PbRgN8ZetYi3/8RQh4MqDOE3dR8=">AAAHBXicdVXJjts2GFbS2E3UbdIceyE6bpAeZGjzjOcWpC3aYwp0kgCWMaBo2haGiyCSzUwFnXPuNX2G3ope+xx9hL5Ff1JepLFjwyD9bT9N/pTzkhVKh+G/9+5/9GAw/PjhI/+TTz/7/IuTx1++UtJUhF4SyWT1JseKskLQS11oRt+UFcU8Z/R1fv2d5V//SitVSPGLvi3pnOOVKJYFwRqgq8eDB5mgb4nkHItFnS2whjDdzKJ5nWl6o4WsOGb1adQ0fk9JRSVFs3PUlOOCBT9YNCCyogd6cyg2R5VECl1WBe/oLYSJDiwcKLKWkh1zrYvV+ojLwh9wcazX6qbj0XilAosGAB8RS9jMJZNvj1l23B1fbhScjlK9pWEDNV5smTuOFYWDW90eGn7cEI3vZzldFQKqw1E3M53P/QyEjIqVXsPZ4RyaQ9GyqeNSNx21YbhqaoZI+wZKy7IyjPpPUcYN0wUYDRd13NSkqVXxGw1ipEwO6YhII7TKyjUWWvIatgg9RR+0JX1bg7LMzwgvFrbcs+rbOg6SpgekwaTxv29/MyTbXw+DMIwhLheUHcWyDPnZJsQftZ05AslkPI1hSMdJikZZyUcoHIdp4qDYDvH47HzPJFNYHtjNyCnSMxiScRTtFeHUQRsvfNsz58iZt707corERkTjaadImDgombghvOgwMdpn2Ja1GXYdF23Rs141t4CLbdaeSduMbjuOnCptxWnUq2ihaNoOkx6zi1E3vYCkGxA5KG6HKO4yzr/t/DZhErYJ4UFC2jJx2mNcxOYqtAnxxeFSwy3kNvS8x9h+y6WGVnW9Aa2x2F2B3Te4Plcnp85gPYeTaDM59Tavl1cn/2ULSQynQhOGlZpFYannNa7gGkCenxm4ephc4xWdwVRgTtW8do/rBn0DyAItZQUfYS8HoF1HjblStzwHpTuAu5wFj3Ezo5fTeV2I0mgqSFtoaRjSEtlnP1oUFSWa3cIEk6qAtSKyxhU8I+Efolcll/IatkbBcwb2Jrq7E4eTV/E4CsfRz/Hp8xebXXrofeV97T3zIu/ce+795L30Lj0yuB78Png/+GP4bvjn8K/h3630/r2N54nXew3/+R80STIk</latexit><latexit sha1_base64="PbRgN8ZetYi3/8RQh4MqDOE3dR8=">AAAHBXicdVXJjts2GFbS2E3UbdIceyE6bpAeZGjzjOcWpC3aYwp0kgCWMaBo2haGiyCSzUwFnXPuNX2G3ope+xx9hL5Ff1JepLFjwyD9bT9N/pTzkhVKh+G/9+5/9GAw/PjhI/+TTz/7/IuTx1++UtJUhF4SyWT1JseKskLQS11oRt+UFcU8Z/R1fv2d5V//SitVSPGLvi3pnOOVKJYFwRqgq8eDB5mgb4nkHItFnS2whjDdzKJ5nWl6o4WsOGb1adQ0fk9JRSVFs3PUlOOCBT9YNCCyogd6cyg2R5VECl1WBe/oLYSJDiwcKLKWkh1zrYvV+ojLwh9wcazX6qbj0XilAosGAB8RS9jMJZNvj1l23B1fbhScjlK9pWEDNV5smTuOFYWDW90eGn7cEI3vZzldFQKqw1E3M53P/QyEjIqVXsPZ4RyaQ9GyqeNSNx21YbhqaoZI+wZKy7IyjPpPUcYN0wUYDRd13NSkqVXxGw1ipEwO6YhII7TKyjUWWvIatgg9RR+0JX1bg7LMzwgvFrbcs+rbOg6SpgekwaTxv29/MyTbXw+DMIwhLheUHcWyDPnZJsQftZ05AslkPI1hSMdJikZZyUcoHIdp4qDYDvH47HzPJFNYHtjNyCnSMxiScRTtFeHUQRsvfNsz58iZt707corERkTjaadImDgombghvOgwMdpn2Ja1GXYdF23Rs141t4CLbdaeSduMbjuOnCptxWnUq2ihaNoOkx6zi1E3vYCkGxA5KG6HKO4yzr/t/DZhErYJ4UFC2jJx2mNcxOYqtAnxxeFSwy3kNvS8x9h+y6WGVnW9Aa2x2F2B3Te4Plcnp85gPYeTaDM59Tavl1cn/2ULSQynQhOGlZpFYannNa7gGkCenxm4ephc4xWdwVRgTtW8do/rBn0DyAItZQUfYS8HoF1HjblStzwHpTuAu5wFj3Ezo5fTeV2I0mgqSFtoaRjSEtlnP1oUFSWa3cIEk6qAtSKyxhU8I+Efolcll/IatkbBcwb2Jrq7E4eTV/E4CsfRz/Hp8xebXXrofeV97T3zIu/ce+795L30Lj0yuB78Png/+GP4bvjn8K/h3630/r2N54nXew3/+R80STIk</latexit><latexit sha1_base64="PbRgN8ZetYi3/8RQh4MqDOE3dR8=">AAAHBXicdVXJjts2GFbS2E3UbdIceyE6bpAeZGjzjOcWpC3aYwp0kgCWMaBo2haGiyCSzUwFnXPuNX2G3ope+xx9hL5Ff1JepLFjwyD9bT9N/pTzkhVKh+G/9+5/9GAw/PjhI/+TTz/7/IuTx1++UtJUhF4SyWT1JseKskLQS11oRt+UFcU8Z/R1fv2d5V//SitVSPGLvi3pnOOVKJYFwRqgq8eDB5mgb4nkHItFnS2whjDdzKJ5nWl6o4WsOGb1adQ0fk9JRSVFs3PUlOOCBT9YNCCyogd6cyg2R5VECl1WBe/oLYSJDiwcKLKWkh1zrYvV+ojLwh9wcazX6qbj0XilAosGAB8RS9jMJZNvj1l23B1fbhScjlK9pWEDNV5smTuOFYWDW90eGn7cEI3vZzldFQKqw1E3M53P/QyEjIqVXsPZ4RyaQ9GyqeNSNx21YbhqaoZI+wZKy7IyjPpPUcYN0wUYDRd13NSkqVXxGw1ipEwO6YhII7TKyjUWWvIatgg9RR+0JX1bg7LMzwgvFrbcs+rbOg6SpgekwaTxv29/MyTbXw+DMIwhLheUHcWyDPnZJsQftZ05AslkPI1hSMdJikZZyUcoHIdp4qDYDvH47HzPJFNYHtjNyCnSMxiScRTtFeHUQRsvfNsz58iZt707corERkTjaadImDgombghvOgwMdpn2Ja1GXYdF23Rs141t4CLbdaeSduMbjuOnCptxWnUq2ihaNoOkx6zi1E3vYCkGxA5KG6HKO4yzr/t/DZhErYJ4UFC2jJx2mNcxOYqtAnxxeFSwy3kNvS8x9h+y6WGVnW9Aa2x2F2B3Te4Plcnp85gPYeTaDM59Tavl1cn/2ULSQynQhOGlZpFYannNa7gGkCenxm4ephc4xWdwVRgTtW8do/rBn0DyAItZQUfYS8HoF1HjblStzwHpTuAu5wFj3Ezo5fTeV2I0mgqSFtoaRjSEtlnP1oUFSWa3cIEk6qAtSKyxhU8I+Efolcll/IatkbBcwb2Jrq7E4eTV/E4CsfRz/Hp8xebXXrofeV97T3zIu/ce+795L30Lj0yuB78Png/+GP4bvjn8K/h3630/r2N54nXew3/+R80STIk</latexit>
There is correlation in what gets repeated.
13
• For each sequence in each dataset, we count the number of
times each size-2 and size-3 subset appears.
• We then count the same statistics under a null model where
elements are randomly places into sets.
14. 14
How do we model the next set in a
sequence given the history?
15. Our Correlated Repeat Unions (CRU) model captures
repeat behavior,recency bias,and correlations.
15
Setup.
Observe sequence of sets S1, …, Sk.
Given number r of repeated elements in Sk+1.
Model selects r elements from .
CRU model.
Start with , given r.
1. Sample set Sk-j from j steps back with recency weight wj.
2. Sample T by keeping each item x in Sk-j with correlation probability p.
3. .
4. Repeat steps 1—3 until .
(if T makes N too large, randomly drop elements from T)
[k
j=1Sj<latexit sha1_base64="JMq9QvYWP/n1zUVVfzVZ7XzazRU=">AAAHPnicfVVdb9s2FFW7zeu0r3R53Au71MBQ2I6VIksyIICBFcUKtFg2O22ByM0o6spiTVIaSTV2Cf2WvW7/Yn9jf2Bvw173uEvbWSwnGwFbFHnPObyXR2RSCm5sv//7rdvvvPte6/07H4QffvTxJ59u3f3suSkqzeCUFaLQLxNqQHAFp5ZbAS9LDVQmAl4k02/8/Is3oA0v1MjOSxhLOlE844xaHDrf2r4fs6o8d6+Po/qVm9bD89f3z7d2+r3+opHrnWjV2QlW7eT8bms7TgtWSVCWCWrMWdQv7dhRbTkTUIdxZaCkbEoncIZdRSWYsVusviZtHElJVmj8KUsWo+E6BHk0nTdYnKVJJaieNUeTopjijKnDsKlps8Ox46qsLCi2lMwqQWxBfFFIyjUwK+akqWv59G1HcQaZpqxDpZHU5p2S+3V27PRtd6JpmXcknQIDIa6GlqvycMETTfXcp1BcmE6CzBNdVCo1nZJaC1oZxFvNZx2T0xJMJ+O2w6hg/j31mFIUVlI9Nf/F2pNgKU4uKifAulGVWfgB0tppSO8d9u8lAnXXI2wOEw2gard4+JiLnFvYiElEBbXz/2sRYZvk1pbm691dC7OescgNM5ZTNYEeK+TuTxUY7y6zG321f7R3tGtAcjRhgp6T3Qtu865PostVN0Grgl7EPTzYWT7C2BeUopV9fcJ4IoqEihhfYw8bgDKVhkFaCDTAAI3MihSOYw2Czi6xBS6+aaKzUTR2fuO8ARq7fDIaUuWLq0HBBSYgqUpdnFHJxTyFjFbC1i422WW/aRKTeVfUYXtdzOAOQnrc7x11mOQoirYQaHkUsDOTeYpmksgdKzvzVIMl2JkHZ/it7Y/rzaQeAX5kGoZzmRTiMabkliymdt89e1o75SUkr52sHcflxkOwNwXjQLoJSVaQlYYHDKsEt9NWfktvFthUGD5+5ktyKTCKGuVzyax2RlyJ+OAl2j3BSF8DKsqc1ldL/fHJRtXTiQDO8u6y9jfN4EYbPF6a54P0NOu7LId8IlEpXrrK07k4kS5ejtfXbCGf4uGa3oRYTdRNiQfxLKH6DM0X50kxc/Eb/98O41xXAkgOfJJbPF0P9ktL2mSUA6HMVlQQhIXxFE+Ifm9vH2Ztctna5BFeDFQxIAnYC/x+fSxBMWIWZQyXUu2QkAVBt9+LQLYv0cO80FgdriakUARNRQRklhiegkes5bUT1f+S4AXw8H9J9CKTBUvtq4DXSLR5aVzvPN/rRbi87/d2BoerC+VO8HnwRfBlEAUHwSD4NjgJTgMWzIOfg1+CX1u/tf5o/dn6axl6+9YKsx00WuvvfwAkCY0R</latexit><latexit sha1_base64="JMq9QvYWP/n1zUVVfzVZ7XzazRU=">AAAHPnicfVVdb9s2FFW7zeu0r3R53Au71MBQ2I6VIksyIICBFcUKtFg2O22ByM0o6spiTVIaSTV2Cf2WvW7/Yn9jf2Bvw173uEvbWSwnGwFbFHnPObyXR2RSCm5sv//7rdvvvPte6/07H4QffvTxJ59u3f3suSkqzeCUFaLQLxNqQHAFp5ZbAS9LDVQmAl4k02/8/Is3oA0v1MjOSxhLOlE844xaHDrf2r4fs6o8d6+Po/qVm9bD89f3z7d2+r3+opHrnWjV2QlW7eT8bms7TgtWSVCWCWrMWdQv7dhRbTkTUIdxZaCkbEoncIZdRSWYsVusviZtHElJVmj8KUsWo+E6BHk0nTdYnKVJJaieNUeTopjijKnDsKlps8Ox46qsLCi2lMwqQWxBfFFIyjUwK+akqWv59G1HcQaZpqxDpZHU5p2S+3V27PRtd6JpmXcknQIDIa6GlqvycMETTfXcp1BcmE6CzBNdVCo1nZJaC1oZxFvNZx2T0xJMJ+O2w6hg/j31mFIUVlI9Nf/F2pNgKU4uKifAulGVWfgB0tppSO8d9u8lAnXXI2wOEw2gard4+JiLnFvYiElEBbXz/2sRYZvk1pbm691dC7OescgNM5ZTNYEeK+TuTxUY7y6zG321f7R3tGtAcjRhgp6T3Qtu865PostVN0Grgl7EPTzYWT7C2BeUopV9fcJ4IoqEihhfYw8bgDKVhkFaCDTAAI3MihSOYw2Czi6xBS6+aaKzUTR2fuO8ARq7fDIaUuWLq0HBBSYgqUpdnFHJxTyFjFbC1i422WW/aRKTeVfUYXtdzOAOQnrc7x11mOQoirYQaHkUsDOTeYpmksgdKzvzVIMl2JkHZ/it7Y/rzaQeAX5kGoZzmRTiMabkliymdt89e1o75SUkr52sHcflxkOwNwXjQLoJSVaQlYYHDKsEt9NWfktvFthUGD5+5ktyKTCKGuVzyax2RlyJ+OAl2j3BSF8DKsqc1ldL/fHJRtXTiQDO8u6y9jfN4EYbPF6a54P0NOu7LId8IlEpXrrK07k4kS5ejtfXbCGf4uGa3oRYTdRNiQfxLKH6DM0X50kxc/Eb/98O41xXAkgOfJJbPF0P9ktL2mSUA6HMVlQQhIXxFE+Ifm9vH2Ztctna5BFeDFQxIAnYC/x+fSxBMWIWZQyXUu2QkAVBt9+LQLYv0cO80FgdriakUARNRQRklhiegkes5bUT1f+S4AXw8H9J9CKTBUvtq4DXSLR5aVzvPN/rRbi87/d2BoerC+VO8HnwRfBlEAUHwSD4NjgJTgMWzIOfg1+CX1u/tf5o/dn6axl6+9YKsx00WuvvfwAkCY0R</latexit><latexit sha1_base64="JMq9QvYWP/n1zUVVfzVZ7XzazRU=">AAAHPnicfVVdb9s2FFW7zeu0r3R53Au71MBQ2I6VIksyIICBFcUKtFg2O22ByM0o6spiTVIaSTV2Cf2WvW7/Yn9jf2Bvw173uEvbWSwnGwFbFHnPObyXR2RSCm5sv//7rdvvvPte6/07H4QffvTxJ59u3f3suSkqzeCUFaLQLxNqQHAFp5ZbAS9LDVQmAl4k02/8/Is3oA0v1MjOSxhLOlE844xaHDrf2r4fs6o8d6+Po/qVm9bD89f3z7d2+r3+opHrnWjV2QlW7eT8bms7TgtWSVCWCWrMWdQv7dhRbTkTUIdxZaCkbEoncIZdRSWYsVusviZtHElJVmj8KUsWo+E6BHk0nTdYnKVJJaieNUeTopjijKnDsKlps8Ox46qsLCi2lMwqQWxBfFFIyjUwK+akqWv59G1HcQaZpqxDpZHU5p2S+3V27PRtd6JpmXcknQIDIa6GlqvycMETTfXcp1BcmE6CzBNdVCo1nZJaC1oZxFvNZx2T0xJMJ+O2w6hg/j31mFIUVlI9Nf/F2pNgKU4uKifAulGVWfgB0tppSO8d9u8lAnXXI2wOEw2gard4+JiLnFvYiElEBbXz/2sRYZvk1pbm691dC7OescgNM5ZTNYEeK+TuTxUY7y6zG321f7R3tGtAcjRhgp6T3Qtu865PostVN0Grgl7EPTzYWT7C2BeUopV9fcJ4IoqEihhfYw8bgDKVhkFaCDTAAI3MihSOYw2Czi6xBS6+aaKzUTR2fuO8ARq7fDIaUuWLq0HBBSYgqUpdnFHJxTyFjFbC1i422WW/aRKTeVfUYXtdzOAOQnrc7x11mOQoirYQaHkUsDOTeYpmksgdKzvzVIMl2JkHZ/it7Y/rzaQeAX5kGoZzmRTiMabkliymdt89e1o75SUkr52sHcflxkOwNwXjQLoJSVaQlYYHDKsEt9NWfktvFthUGD5+5ktyKTCKGuVzyax2RlyJ+OAl2j3BSF8DKsqc1ldL/fHJRtXTiQDO8u6y9jfN4EYbPF6a54P0NOu7LId8IlEpXrrK07k4kS5ejtfXbCGf4uGa3oRYTdRNiQfxLKH6DM0X50kxc/Eb/98O41xXAkgOfJJbPF0P9ktL2mSUA6HMVlQQhIXxFE+Ifm9vH2Ztctna5BFeDFQxIAnYC/x+fSxBMWIWZQyXUu2QkAVBt9+LQLYv0cO80FgdriakUARNRQRklhiegkes5bUT1f+S4AXw8H9J9CKTBUvtq4DXSLR5aVzvPN/rRbi87/d2BoerC+VO8HnwRfBlEAUHwSD4NjgJTgMWzIOfg1+CX1u/tf5o/dn6axl6+9YKsx00WuvvfwAkCY0R</latexit><latexit sha1_base64="JMq9QvYWP/n1zUVVfzVZ7XzazRU=">AAAHPnicfVVdb9s2FFW7zeu0r3R53Au71MBQ2I6VIksyIICBFcUKtFg2O22ByM0o6spiTVIaSTV2Cf2WvW7/Yn9jf2Bvw173uEvbWSwnGwFbFHnPObyXR2RSCm5sv//7rdvvvPte6/07H4QffvTxJ59u3f3suSkqzeCUFaLQLxNqQHAFp5ZbAS9LDVQmAl4k02/8/Is3oA0v1MjOSxhLOlE844xaHDrf2r4fs6o8d6+Po/qVm9bD89f3z7d2+r3+opHrnWjV2QlW7eT8bms7TgtWSVCWCWrMWdQv7dhRbTkTUIdxZaCkbEoncIZdRSWYsVusviZtHElJVmj8KUsWo+E6BHk0nTdYnKVJJaieNUeTopjijKnDsKlps8Ox46qsLCi2lMwqQWxBfFFIyjUwK+akqWv59G1HcQaZpqxDpZHU5p2S+3V27PRtd6JpmXcknQIDIa6GlqvycMETTfXcp1BcmE6CzBNdVCo1nZJaC1oZxFvNZx2T0xJMJ+O2w6hg/j31mFIUVlI9Nf/F2pNgKU4uKifAulGVWfgB0tppSO8d9u8lAnXXI2wOEw2gard4+JiLnFvYiElEBbXz/2sRYZvk1pbm691dC7OescgNM5ZTNYEeK+TuTxUY7y6zG321f7R3tGtAcjRhgp6T3Qtu865PostVN0Grgl7EPTzYWT7C2BeUopV9fcJ4IoqEihhfYw8bgDKVhkFaCDTAAI3MihSOYw2Czi6xBS6+aaKzUTR2fuO8ARq7fDIaUuWLq0HBBSYgqUpdnFHJxTyFjFbC1i422WW/aRKTeVfUYXtdzOAOQnrc7x11mOQoirYQaHkUsDOTeYpmksgdKzvzVIMl2JkHZ/it7Y/rzaQeAX5kGoZzmRTiMabkliymdt89e1o75SUkr52sHcflxkOwNwXjQLoJSVaQlYYHDKsEt9NWfktvFthUGD5+5ktyKTCKGuVzyax2RlyJ+OAl2j3BSF8DKsqc1ldL/fHJRtXTiQDO8u6y9jfN4EYbPF6a54P0NOu7LId8IlEpXrrK07k4kS5ejtfXbCGf4uGa3oRYTdRNiQfxLKH6DM0X50kxc/Eb/98O41xXAkgOfJJbPF0P9ktL2mSUA6HMVlQQhIXxFE+Ifm9vH2Ztctna5BFeDFQxIAnYC/x+fSxBMWIWZQyXUu2QkAVBt9+LQLYv0cO80FgdriakUARNRQRklhiegkes5bUT1f+S4AXw8H9J9CKTBUvtq4DXSLR5aVzvPN/rRbi87/d2BoerC+VO8HnwRfBlEAUHwSD4NjgJTgMWzIOfg1+CX1u/tf5o/dn6axl6+9YKsx00WuvvfwAkCY0R</latexit>
N = ;<latexit sha1_base64="cCQugb7Mu1I9KkNyw7/c0OFwvuY=">AAAHOnicfVVdb9s2FFW7zeu0j6br417YpQaGwnbsFFmaAQGMrShWoN2y2WkLWEZKSVcSYZLSSKqRS+iX7HX7F/sje93bsNf9gF1azmI52QjYosh7zuG9PCLDgjNthsPfb9x85933Ou/f+sD/8KOPP7m9c+fTFzovVQSnUc5z9SqkGjiTcGqY4fCqUEBFyOFluPjGzb98A0qzXE7NsoC5oKlkCYuowaGzndv3vyPHJABRmKUGc/9sZ3c4GK4audoZrTu73rqdnN3p3A3iPCoFSBNxqvVsNCzM3FJlWMSh9oNSQ0GjBU1hhl1JBei5Xa28Jl0ciUmSK/xJQ1aj/iYEeRRdtlisoWHJqarao2GeL3BG177f1jTJo7llsigNyKiRTEpOTE5cQUjMFESGL0lb17DF255kESSKRj0qtKAm6xXMrbNnFm/7qaJF1hN0ARFwfjnUrMrBOQsVVUuXQn6ueyEypyovZax7BTUGlNSIN4pVPZ3RAnQvYaYXUR6599hhCp4bQdVC/xfrQIChOLmqHAdjp2Vi4EeIa6sgvvdoeC/kqLsZYTJIFYCs7erhYs4zZmArJuQl1Nb9b0T4XZIZU+iv9vYMVANtkBuqKKMyhUGUi72fStDOWXpv9OXB0f7RngbB0IAh+k30z5nJ+i6JPpP9EG0KahX38HC3efiBKyhFG7v6+EHK85DyAF8DBxuD1KWCcZxzNMAYTRzlMRwHCjitLrA5Lr5totl0NLdu45wBWrt8Mp1Q6YqrQMI5JiCojG2QUMH4MoaEltzUNtDJRb9tEp04V9R+d1NM4w5CfDwcHPUiwVAUbcHR8ihgKp04inaSyB1IUzmqcQO2+sEMv7WDeb2d1GPAj0zBZCnCnD/BlGzDomv7/fNntZVOQrDaitoyXG4wAXNdMA7E25BwDVlrOMCkDHE7Tem29HqBbYXJk+euJBcC01GrfDasaqv5pYgLbtD2KUa6GlBeZLS+XOrrp1tVj1MOLMr6Te2vm8GN1ni8tM8H4Wg2d1lMWCpQKWhc5ehsEAobNOP1FVuIZ3iwxtch1hN1W+JBUIVUzdB8QRbmlQ3euP+uH2Sq5EAyYGlm8HQ9PCgM6ZJpBoRGpqScIMwPFnhCDAf7B1B1yUXrksd4KVAZAQnBnOP362IJihG9KqPfSHV9QlYE/eFgBKJ7gZ5kucLqMJmSXBI0FeGQGKJZDA6xkdfuqP6XBC+Ah/9LolaZrFhqVwW8Rkbbl8bVzov9wQiX98P+7vjr9YVyy/vM+9z7wht5h97Y+9Y78U69yCu9n71fvF87v3X+6PzZ+asJvXljjbnrtVrn738AcTqK5Q==</latexit><latexit sha1_base64="cCQugb7Mu1I9KkNyw7/c0OFwvuY=">AAAHOnicfVVdb9s2FFW7zeu0j6br417YpQaGwnbsFFmaAQGMrShWoN2y2WkLWEZKSVcSYZLSSKqRS+iX7HX7F/sje93bsNf9gF1azmI52QjYosh7zuG9PCLDgjNthsPfb9x85933Ou/f+sD/8KOPP7m9c+fTFzovVQSnUc5z9SqkGjiTcGqY4fCqUEBFyOFluPjGzb98A0qzXE7NsoC5oKlkCYuowaGzndv3vyPHJABRmKUGc/9sZ3c4GK4audoZrTu73rqdnN3p3A3iPCoFSBNxqvVsNCzM3FJlWMSh9oNSQ0GjBU1hhl1JBei5Xa28Jl0ciUmSK/xJQ1aj/iYEeRRdtlisoWHJqarao2GeL3BG177f1jTJo7llsigNyKiRTEpOTE5cQUjMFESGL0lb17DF255kESSKRj0qtKAm6xXMrbNnFm/7qaJF1hN0ARFwfjnUrMrBOQsVVUuXQn6ueyEypyovZax7BTUGlNSIN4pVPZ3RAnQvYaYXUR6599hhCp4bQdVC/xfrQIChOLmqHAdjp2Vi4EeIa6sgvvdoeC/kqLsZYTJIFYCs7erhYs4zZmArJuQl1Nb9b0T4XZIZU+iv9vYMVANtkBuqKKMyhUGUi72fStDOWXpv9OXB0f7RngbB0IAh+k30z5nJ+i6JPpP9EG0KahX38HC3efiBKyhFG7v6+EHK85DyAF8DBxuD1KWCcZxzNMAYTRzlMRwHCjitLrA5Lr5totl0NLdu45wBWrt8Mp1Q6YqrQMI5JiCojG2QUMH4MoaEltzUNtDJRb9tEp04V9R+d1NM4w5CfDwcHPUiwVAUbcHR8ihgKp04inaSyB1IUzmqcQO2+sEMv7WDeb2d1GPAj0zBZCnCnD/BlGzDomv7/fNntZVOQrDaitoyXG4wAXNdMA7E25BwDVlrOMCkDHE7Tem29HqBbYXJk+euJBcC01GrfDasaqv5pYgLbtD2KUa6GlBeZLS+XOrrp1tVj1MOLMr6Te2vm8GN1ni8tM8H4Wg2d1lMWCpQKWhc5ehsEAobNOP1FVuIZ3iwxtch1hN1W+JBUIVUzdB8QRbmlQ3euP+uH2Sq5EAyYGlm8HQ9PCgM6ZJpBoRGpqScIMwPFnhCDAf7B1B1yUXrksd4KVAZAQnBnOP362IJihG9KqPfSHV9QlYE/eFgBKJ7gZ5kucLqMJmSXBI0FeGQGKJZDA6xkdfuqP6XBC+Ah/9LolaZrFhqVwW8Rkbbl8bVzov9wQiX98P+7vjr9YVyy/vM+9z7wht5h97Y+9Y78U69yCu9n71fvF87v3X+6PzZ+asJvXljjbnrtVrn738AcTqK5Q==</latexit><latexit sha1_base64="cCQugb7Mu1I9KkNyw7/c0OFwvuY=">AAAHOnicfVVdb9s2FFW7zeu0j6br417YpQaGwnbsFFmaAQGMrShWoN2y2WkLWEZKSVcSYZLSSKqRS+iX7HX7F/sje93bsNf9gF1azmI52QjYosh7zuG9PCLDgjNthsPfb9x85933Ou/f+sD/8KOPP7m9c+fTFzovVQSnUc5z9SqkGjiTcGqY4fCqUEBFyOFluPjGzb98A0qzXE7NsoC5oKlkCYuowaGzndv3vyPHJABRmKUGc/9sZ3c4GK4audoZrTu73rqdnN3p3A3iPCoFSBNxqvVsNCzM3FJlWMSh9oNSQ0GjBU1hhl1JBei5Xa28Jl0ciUmSK/xJQ1aj/iYEeRRdtlisoWHJqarao2GeL3BG177f1jTJo7llsigNyKiRTEpOTE5cQUjMFESGL0lb17DF255kESSKRj0qtKAm6xXMrbNnFm/7qaJF1hN0ARFwfjnUrMrBOQsVVUuXQn6ueyEypyovZax7BTUGlNSIN4pVPZ3RAnQvYaYXUR6599hhCp4bQdVC/xfrQIChOLmqHAdjp2Vi4EeIa6sgvvdoeC/kqLsZYTJIFYCs7erhYs4zZmArJuQl1Nb9b0T4XZIZU+iv9vYMVANtkBuqKKMyhUGUi72fStDOWXpv9OXB0f7RngbB0IAh+k30z5nJ+i6JPpP9EG0KahX38HC3efiBKyhFG7v6+EHK85DyAF8DBxuD1KWCcZxzNMAYTRzlMRwHCjitLrA5Lr5totl0NLdu45wBWrt8Mp1Q6YqrQMI5JiCojG2QUMH4MoaEltzUNtDJRb9tEp04V9R+d1NM4w5CfDwcHPUiwVAUbcHR8ihgKp04inaSyB1IUzmqcQO2+sEMv7WDeb2d1GPAj0zBZCnCnD/BlGzDomv7/fNntZVOQrDaitoyXG4wAXNdMA7E25BwDVlrOMCkDHE7Tem29HqBbYXJk+euJBcC01GrfDasaqv5pYgLbtD2KUa6GlBeZLS+XOrrp1tVj1MOLMr6Te2vm8GN1ni8tM8H4Wg2d1lMWCpQKWhc5ehsEAobNOP1FVuIZ3iwxtch1hN1W+JBUIVUzdB8QRbmlQ3euP+uH2Sq5EAyYGlm8HQ9PCgM6ZJpBoRGpqScIMwPFnhCDAf7B1B1yUXrksd4KVAZAQnBnOP362IJihG9KqPfSHV9QlYE/eFgBKJ7gZ5kucLqMJmSXBI0FeGQGKJZDA6xkdfuqP6XBC+Ah/9LolaZrFhqVwW8Rkbbl8bVzov9wQiX98P+7vjr9YVyy/vM+9z7wht5h97Y+9Y78U69yCu9n71fvF87v3X+6PzZ+asJvXljjbnrtVrn738AcTqK5Q==</latexit><latexit sha1_base64="cCQugb7Mu1I9KkNyw7/c0OFwvuY=">AAAHOnicfVVdb9s2FFW7zeu0j6br417YpQaGwnbsFFmaAQGMrShWoN2y2WkLWEZKSVcSYZLSSKqRS+iX7HX7F/sje93bsNf9gF1azmI52QjYosh7zuG9PCLDgjNthsPfb9x85933Ou/f+sD/8KOPP7m9c+fTFzovVQSnUc5z9SqkGjiTcGqY4fCqUEBFyOFluPjGzb98A0qzXE7NsoC5oKlkCYuowaGzndv3vyPHJABRmKUGc/9sZ3c4GK4audoZrTu73rqdnN3p3A3iPCoFSBNxqvVsNCzM3FJlWMSh9oNSQ0GjBU1hhl1JBei5Xa28Jl0ciUmSK/xJQ1aj/iYEeRRdtlisoWHJqarao2GeL3BG177f1jTJo7llsigNyKiRTEpOTE5cQUjMFESGL0lb17DF255kESSKRj0qtKAm6xXMrbNnFm/7qaJF1hN0ARFwfjnUrMrBOQsVVUuXQn6ueyEypyovZax7BTUGlNSIN4pVPZ3RAnQvYaYXUR6599hhCp4bQdVC/xfrQIChOLmqHAdjp2Vi4EeIa6sgvvdoeC/kqLsZYTJIFYCs7erhYs4zZmArJuQl1Nb9b0T4XZIZU+iv9vYMVANtkBuqKKMyhUGUi72fStDOWXpv9OXB0f7RngbB0IAh+k30z5nJ+i6JPpP9EG0KahX38HC3efiBKyhFG7v6+EHK85DyAF8DBxuD1KWCcZxzNMAYTRzlMRwHCjitLrA5Lr5totl0NLdu45wBWrt8Mp1Q6YqrQMI5JiCojG2QUMH4MoaEltzUNtDJRb9tEp04V9R+d1NM4w5CfDwcHPUiwVAUbcHR8ihgKp04inaSyB1IUzmqcQO2+sEMv7WDeb2d1GPAj0zBZCnCnD/BlGzDomv7/fNntZVOQrDaitoyXG4wAXNdMA7E25BwDVlrOMCkDHE7Tem29HqBbYXJk+euJBcC01GrfDasaqv5pYgLbtD2KUa6GlBeZLS+XOrrp1tVj1MOLMr6Te2vm8GN1ni8tM8H4Wg2d1lMWCpQKWhc5ehsEAobNOP1FVuIZ3iwxtch1hN1W+JBUIVUzdB8QRbmlQ3euP+uH2Sq5EAyYGlm8HQ9PCgM6ZJpBoRGpqScIMwPFnhCDAf7B1B1yUXrksd4KVAZAQnBnOP362IJihG9KqPfSHV9QlYE/eFgBKJ7gZ5kucLqMJmSXBI0FeGQGKJZDA6xkdfuqP6XBC+Ah/9LolaZrFhqVwW8Rkbbl8bVzov9wQiX98P+7vjr9YVyy/vM+9z7wht5h97Y+9Y78U69yCu9n71fvF87v3X+6PzZ+asJvXljjbnrtVrn738AcTqK5Q==</latexit>
N = N [ T<latexit sha1_base64="+8IXgngcg4Tx80sHc3gtOzbENVM=">AAAHN3icfVVdjxs1FJ0WCGX4aukjLy7bSKhKsslWy3aRVoqgqqjUloVk20o7oXg8d2as2J7B9nQnteZ/8Ar/gp/CE2+IV/4B10mWzWQXLCXjse85x/f6jB2Xghs7HP5+7fpbb7/TeffGe+H7H3z40cc3b33y3BSVZnDCClHolzE1ILiCE8utgJelBipjAS/i+dd+/sVr0IYXamoXJcwkzRRPOaMWh364+4wckWckYlVJpndf3dwZDobLRi53RuvOTrBux69udW5HScEqCcoyQY05HQ1LO3NUW84ENGFUGSgpm9MMTrGrqAQzc8tlN6SLIwlJC40/ZclyNNyEII+mixaLszSuBNV1ezQuijnOmCYM25o2fTBzXJWVBcVWkmkliC2IrwZJuAZmxYK0dS2fv+kpziDVlPWoNJLavFdyv86enb/pZ5qWeU/SOTAQ4mJotSoPFzzWVC98CsWZ6cXInOmiUonpldRa0Mog3mpe90xOSzC9lNseo4L598RjSlFYSfXc/BfrQIKlOLmsnADrplVq4XtIGqchufNgeCcWqLsZYXPINIBq3PLhY85ybmErJhYVNM7/b0SEXZJbW5ovd3ct1ANjkRtqllOVwYAVcvenCoy3ldkdfbF/uHe4a0BydF+MZpP9M27zvk+iz1U/Ro+CXsbdP9hZPcLIF5Sih319wigTRUxFhK+Rh41BmUrDOCkEGmCMDmZFAkeRBkHrc2yBi2+b6HQ6mjm/cd4ArV0+nk6o8sXVoOAME5BUJS5KqeRikUBKK2EbF5n0vN82iUm9K5qwuylmcAchORoODntMchRFWwi0PArY2qSeop0kckfK1p5qvAI7c+8Uv7X9WbOd1EPAj0zDZCHjQjzClNyKxTTu26dPGqe8hOSNk43juNxoAvaqYBxItiHxGrLW8IBJFeN22spv6dUC2wqTR099Sc4FpqNW+VxcN86ICxEfvEK7xxjpa0BFmdPmYqk/Pt6qepIJ4Czvr2p/1QxutMHjpX0+SE+zuctywjOJStHKVZ7ORbF00Wq8uWQL+QRP1eQqxHqiaUvci+qY6lM0X5THRe2i1/6/G0a5rgSQHHiWWzxdD/ZLS7pkmgOhzFZUEISF0RxPiOFgbx/qLjlvXfIQbwSqGJAY7Bl+vz6WoBgxyzKGK6luSMiSoD8cjEB2z9GTvNBYHa4yUiiCpiICUksMT8AjNvLaGTX/kuAFcP9/SfQykyVL46uA18ho+9K43Hm+Nxjh8r7b2xl/tb5QbgSfBp8Fnwej4CAYB98Ex8FJwAId/Bz8Evza+a3zR+fPzl+r0OvX1pjbQat1/v4HOH2JWQ==</latexit><latexit sha1_base64="+8IXgngcg4Tx80sHc3gtOzbENVM=">AAAHN3icfVVdjxs1FJ0WCGX4aukjLy7bSKhKsslWy3aRVoqgqqjUloVk20o7oXg8d2as2J7B9nQnteZ/8Ar/gp/CE2+IV/4B10mWzWQXLCXjse85x/f6jB2Xghs7HP5+7fpbb7/TeffGe+H7H3z40cc3b33y3BSVZnDCClHolzE1ILiCE8utgJelBipjAS/i+dd+/sVr0IYXamoXJcwkzRRPOaMWh364+4wckWckYlVJpndf3dwZDobLRi53RuvOTrBux69udW5HScEqCcoyQY05HQ1LO3NUW84ENGFUGSgpm9MMTrGrqAQzc8tlN6SLIwlJC40/ZclyNNyEII+mixaLszSuBNV1ezQuijnOmCYM25o2fTBzXJWVBcVWkmkliC2IrwZJuAZmxYK0dS2fv+kpziDVlPWoNJLavFdyv86enb/pZ5qWeU/SOTAQ4mJotSoPFzzWVC98CsWZ6cXInOmiUonpldRa0Mog3mpe90xOSzC9lNseo4L598RjSlFYSfXc/BfrQIKlOLmsnADrplVq4XtIGqchufNgeCcWqLsZYXPINIBq3PLhY85ybmErJhYVNM7/b0SEXZJbW5ovd3ct1ANjkRtqllOVwYAVcvenCoy3ldkdfbF/uHe4a0BydF+MZpP9M27zvk+iz1U/Ro+CXsbdP9hZPcLIF5Sih319wigTRUxFhK+Rh41BmUrDOCkEGmCMDmZFAkeRBkHrc2yBi2+b6HQ6mjm/cd4ArV0+nk6o8sXVoOAME5BUJS5KqeRikUBKK2EbF5n0vN82iUm9K5qwuylmcAchORoODntMchRFWwi0PArY2qSeop0kckfK1p5qvAI7c+8Uv7X9WbOd1EPAj0zDZCHjQjzClNyKxTTu26dPGqe8hOSNk43juNxoAvaqYBxItiHxGrLW8IBJFeN22spv6dUC2wqTR099Sc4FpqNW+VxcN86ICxEfvEK7xxjpa0BFmdPmYqk/Pt6qepIJ4Czvr2p/1QxutMHjpX0+SE+zuctywjOJStHKVZ7ORbF00Wq8uWQL+QRP1eQqxHqiaUvci+qY6lM0X5THRe2i1/6/G0a5rgSQHHiWWzxdD/ZLS7pkmgOhzFZUEISF0RxPiOFgbx/qLjlvXfIQbwSqGJAY7Bl+vz6WoBgxyzKGK6luSMiSoD8cjEB2z9GTvNBYHa4yUiiCpiICUksMT8AjNvLaGTX/kuAFcP9/SfQykyVL46uA18ho+9K43Hm+Nxjh8r7b2xl/tb5QbgSfBp8Fnwej4CAYB98Ex8FJwAId/Bz8Evza+a3zR+fPzl+r0OvX1pjbQat1/v4HOH2JWQ==</latexit><latexit sha1_base64="+8IXgngcg4Tx80sHc3gtOzbENVM=">AAAHN3icfVVdjxs1FJ0WCGX4aukjLy7bSKhKsslWy3aRVoqgqqjUloVk20o7oXg8d2as2J7B9nQnteZ/8Ar/gp/CE2+IV/4B10mWzWQXLCXjse85x/f6jB2Xghs7HP5+7fpbb7/TeffGe+H7H3z40cc3b33y3BSVZnDCClHolzE1ILiCE8utgJelBipjAS/i+dd+/sVr0IYXamoXJcwkzRRPOaMWh364+4wckWckYlVJpndf3dwZDobLRi53RuvOTrBux69udW5HScEqCcoyQY05HQ1LO3NUW84ENGFUGSgpm9MMTrGrqAQzc8tlN6SLIwlJC40/ZclyNNyEII+mixaLszSuBNV1ezQuijnOmCYM25o2fTBzXJWVBcVWkmkliC2IrwZJuAZmxYK0dS2fv+kpziDVlPWoNJLavFdyv86enb/pZ5qWeU/SOTAQ4mJotSoPFzzWVC98CsWZ6cXInOmiUonpldRa0Mog3mpe90xOSzC9lNseo4L598RjSlFYSfXc/BfrQIKlOLmsnADrplVq4XtIGqchufNgeCcWqLsZYXPINIBq3PLhY85ybmErJhYVNM7/b0SEXZJbW5ovd3ct1ANjkRtqllOVwYAVcvenCoy3ldkdfbF/uHe4a0BydF+MZpP9M27zvk+iz1U/Ro+CXsbdP9hZPcLIF5Sih319wigTRUxFhK+Rh41BmUrDOCkEGmCMDmZFAkeRBkHrc2yBi2+b6HQ6mjm/cd4ArV0+nk6o8sXVoOAME5BUJS5KqeRikUBKK2EbF5n0vN82iUm9K5qwuylmcAchORoODntMchRFWwi0PArY2qSeop0kckfK1p5qvAI7c+8Uv7X9WbOd1EPAj0zDZCHjQjzClNyKxTTu26dPGqe8hOSNk43juNxoAvaqYBxItiHxGrLW8IBJFeN22spv6dUC2wqTR099Sc4FpqNW+VxcN86ICxEfvEK7xxjpa0BFmdPmYqk/Pt6qepIJ4Czvr2p/1QxutMHjpX0+SE+zuctywjOJStHKVZ7ORbF00Wq8uWQL+QRP1eQqxHqiaUvci+qY6lM0X5THRe2i1/6/G0a5rgSQHHiWWzxdD/ZLS7pkmgOhzFZUEISF0RxPiOFgbx/qLjlvXfIQbwSqGJAY7Bl+vz6WoBgxyzKGK6luSMiSoD8cjEB2z9GTvNBYHa4yUiiCpiICUksMT8AjNvLaGTX/kuAFcP9/SfQykyVL46uA18ho+9K43Hm+Nxjh8r7b2xl/tb5QbgSfBp8Fnwej4CAYB98Ex8FJwAId/Bz8Evza+a3zR+fPzl+r0OvX1pjbQat1/v4HOH2JWQ==</latexit><latexit sha1_base64="+8IXgngcg4Tx80sHc3gtOzbENVM=">AAAHN3icfVVdjxs1FJ0WCGX4aukjLy7bSKhKsslWy3aRVoqgqqjUloVk20o7oXg8d2as2J7B9nQnteZ/8Ar/gp/CE2+IV/4B10mWzWQXLCXjse85x/f6jB2Xghs7HP5+7fpbb7/TeffGe+H7H3z40cc3b33y3BSVZnDCClHolzE1ILiCE8utgJelBipjAS/i+dd+/sVr0IYXamoXJcwkzRRPOaMWh364+4wckWckYlVJpndf3dwZDobLRi53RuvOTrBux69udW5HScEqCcoyQY05HQ1LO3NUW84ENGFUGSgpm9MMTrGrqAQzc8tlN6SLIwlJC40/ZclyNNyEII+mixaLszSuBNV1ezQuijnOmCYM25o2fTBzXJWVBcVWkmkliC2IrwZJuAZmxYK0dS2fv+kpziDVlPWoNJLavFdyv86enb/pZ5qWeU/SOTAQ4mJotSoPFzzWVC98CsWZ6cXInOmiUonpldRa0Mog3mpe90xOSzC9lNseo4L598RjSlFYSfXc/BfrQIKlOLmsnADrplVq4XtIGqchufNgeCcWqLsZYXPINIBq3PLhY85ybmErJhYVNM7/b0SEXZJbW5ovd3ct1ANjkRtqllOVwYAVcvenCoy3ldkdfbF/uHe4a0BydF+MZpP9M27zvk+iz1U/Ro+CXsbdP9hZPcLIF5Sih319wigTRUxFhK+Rh41BmUrDOCkEGmCMDmZFAkeRBkHrc2yBi2+b6HQ6mjm/cd4ArV0+nk6o8sXVoOAME5BUJS5KqeRikUBKK2EbF5n0vN82iUm9K5qwuylmcAchORoODntMchRFWwi0PArY2qSeop0kckfK1p5qvAI7c+8Uv7X9WbOd1EPAj0zDZCHjQjzClNyKxTTu26dPGqe8hOSNk43juNxoAvaqYBxItiHxGrLW8IBJFeN22spv6dUC2wqTR099Sc4FpqNW+VxcN86ICxEfvEK7xxjpa0BFmdPmYqk/Pt6qepIJ4Czvr2p/1QxutMHjpX0+SE+zuctywjOJStHKVZ7ORbF00Wq8uWQL+QRP1eQqxHqiaUvci+qY6lM0X5THRe2i1/6/G0a5rgSQHHiWWzxdD/ZLS7pkmgOhzFZUEISF0RxPiOFgbx/qLjlvXfIQbwSqGJAY7Bl+vz6WoBgxyzKGK6luSMiSoD8cjEB2z9GTvNBYHa4yUiiCpiICUksMT8AjNvLaGTX/kuAFcP9/SfQykyVL46uA18ho+9K43Hm+Nxjh8r7b2xl/tb5QbgSfBp8Fnwej4CAYB98Ex8FJwAId/Bz8Evza+a3zR+fPzl+r0OvX1pjbQat1/v4HOH2JWQ==</latexit>
|N| = r<latexit sha1_base64="tQEGT1dKiB0d6p4CljzChDc5oR0=">AAAHQHicfVVdb9s2FFW7zeu0j6Yr9rQXdqmBoZAdO0WWZkAAYyuKFWi3bHbaApaRUdKVRJikNJJq5BL6MXvd/sX+xf7B3oa97mmXtrNYTjYCtijynnN4L4/IqORMm8Hg9xs333r7nc67t97z3//gw49u79z5+IUuKhXDaVzwQr2KqAbOJJwaZji8KhVQEXF4Gc2/dvMvX4PSrJATsyhhJmgmWcpianDobOeT+yHHeUO+JaFado6Jun+2szvoD5aNXO0M151db91Ozu507oZJEVcCpIk51Xo6HJRmZqkyLObQ+GGloaTxnGYwxa6kAvTMLtffkC6OJCQtFP6kIctRfxOCPIouWizW0KjiVNXt0ago5jijG99va5r00cwyWVYGZLySTCtOTEFcWUjCFMSGL0hb17D5m0CyGFJF44AKLajJg5K5dQZm/qaXKVrmgaBziIHzy6HVqhycs0hRtXApFOc6iJA5U0UlEx2U1BhQUiPeKFYHOqcl6CBlJogpj9174jAlL4ygaq7/i7UvwFCcXFaOg7GTKjXwAySNVZDcezS4F3HU3YwwOWQKQDZ2+XAx5zkzsBUT8Qoa6/43IvwuyY0p9Zd7ewbqvjbIDXWcU5lBPy7E3k8VaOcvvTf84uBo/2hPg2DorghdJ3rnzOQ9l0SPyV6EZgW1jHt4uLt6+KErKEUzu/r4YcaLiPIQX0MHG4HUlYJRUnA0wAitHBcJHIcKOK0vsAUuvm2i6WQ4s27jnAFau3wyGVPpiqtAwjkmIKhMbJhSwfgigZRW3DQ21OlFv20SnTpXNH53U0zjDkJyPOgfBbFgKIq24Gh5FDC1Th1FO0nkDqWpHdVoBbb6wRS/tYNZs53UY8CPTMF4IaKCP8GU7IpFN/a7588aK52EYI0VjWW43HAM5rpgHEi2IdEastZwgHEV4Xaaym3p9QLbCuMnz11JLgQmw1b5bFQ3VvNLERe8QtunGOlqQHmZ0+ZyqT8+3ap6knFgcd5b1f66GdxojcdL+3wQjmZzl8WYZQKVwpWrHJ0NI2HD1XhzxRbiGR6vyXWI9UTTlngQ1hFVUzRfmEdFbcPX7r/rh7mqOJAcWJYbPF0PD0pDumSSA6GxqSgnCPPDOZ4Qg/7+AdRdctG65DFeDVTGQCIw5/j9uliCYkQvy+ivpLo+IUuC3qA/BNG9QI/zQmF1mMxIIQmainBIDdEsAYfYyGt32PxLghfAw/8lUctMliyNqwJeI8PtS+Nq58V+f4jL+35/d/TV+kK55X3qfeZ97g29Q2/kfeOdeKde7FnvZ+8X79fOb50/On92/lqF3ryxxtz1Wq3z9z/OTY0U</latexit><latexit sha1_base64="tQEGT1dKiB0d6p4CljzChDc5oR0=">AAAHQHicfVVdb9s2FFW7zeu0j6Yr9rQXdqmBoZAdO0WWZkAAYyuKFWi3bHbaApaRUdKVRJikNJJq5BL6MXvd/sX+xf7B3oa97mmXtrNYTjYCtijynnN4L4/IqORMm8Hg9xs333r7nc67t97z3//gw49u79z5+IUuKhXDaVzwQr2KqAbOJJwaZji8KhVQEXF4Gc2/dvMvX4PSrJATsyhhJmgmWcpianDobOeT+yHHeUO+JaFado6Jun+2szvoD5aNXO0M151db91Ozu507oZJEVcCpIk51Xo6HJRmZqkyLObQ+GGloaTxnGYwxa6kAvTMLtffkC6OJCQtFP6kIctRfxOCPIouWizW0KjiVNXt0ago5jijG99va5r00cwyWVYGZLySTCtOTEFcWUjCFMSGL0hb17D5m0CyGFJF44AKLajJg5K5dQZm/qaXKVrmgaBziIHzy6HVqhycs0hRtXApFOc6iJA5U0UlEx2U1BhQUiPeKFYHOqcl6CBlJogpj9174jAlL4ygaq7/i7UvwFCcXFaOg7GTKjXwAySNVZDcezS4F3HU3YwwOWQKQDZ2+XAx5zkzsBUT8Qoa6/43IvwuyY0p9Zd7ewbqvjbIDXWcU5lBPy7E3k8VaOcvvTf84uBo/2hPg2DorghdJ3rnzOQ9l0SPyV6EZgW1jHt4uLt6+KErKEUzu/r4YcaLiPIQX0MHG4HUlYJRUnA0wAitHBcJHIcKOK0vsAUuvm2i6WQ4s27jnAFau3wyGVPpiqtAwjkmIKhMbJhSwfgigZRW3DQ21OlFv20SnTpXNH53U0zjDkJyPOgfBbFgKIq24Gh5FDC1Th1FO0nkDqWpHdVoBbb6wRS/tYNZs53UY8CPTMF4IaKCP8GU7IpFN/a7588aK52EYI0VjWW43HAM5rpgHEi2IdEastZwgHEV4Xaaym3p9QLbCuMnz11JLgQmw1b5bFQ3VvNLERe8QtunGOlqQHmZ0+ZyqT8+3ap6knFgcd5b1f66GdxojcdL+3wQjmZzl8WYZQKVwpWrHJ0NI2HD1XhzxRbiGR6vyXWI9UTTlngQ1hFVUzRfmEdFbcPX7r/rh7mqOJAcWJYbPF0PD0pDumSSA6GxqSgnCPPDOZ4Qg/7+AdRdctG65DFeDVTGQCIw5/j9uliCYkQvy+ivpLo+IUuC3qA/BNG9QI/zQmF1mMxIIQmainBIDdEsAYfYyGt32PxLghfAw/8lUctMliyNqwJeI8PtS+Nq58V+f4jL+35/d/TV+kK55X3qfeZ97g29Q2/kfeOdeKde7FnvZ+8X79fOb50/On92/lqF3ryxxtz1Wq3z9z/OTY0U</latexit><latexit sha1_base64="tQEGT1dKiB0d6p4CljzChDc5oR0=">AAAHQHicfVVdb9s2FFW7zeu0j6Yr9rQXdqmBoZAdO0WWZkAAYyuKFWi3bHbaApaRUdKVRJikNJJq5BL6MXvd/sX+xf7B3oa97mmXtrNYTjYCtijynnN4L4/IqORMm8Hg9xs333r7nc67t97z3//gw49u79z5+IUuKhXDaVzwQr2KqAbOJJwaZji8KhVQEXF4Gc2/dvMvX4PSrJATsyhhJmgmWcpianDobOeT+yHHeUO+JaFado6Jun+2szvoD5aNXO0M151db91Ozu507oZJEVcCpIk51Xo6HJRmZqkyLObQ+GGloaTxnGYwxa6kAvTMLtffkC6OJCQtFP6kIctRfxOCPIouWizW0KjiVNXt0ago5jijG99va5r00cwyWVYGZLySTCtOTEFcWUjCFMSGL0hb17D5m0CyGFJF44AKLajJg5K5dQZm/qaXKVrmgaBziIHzy6HVqhycs0hRtXApFOc6iJA5U0UlEx2U1BhQUiPeKFYHOqcl6CBlJogpj9174jAlL4ygaq7/i7UvwFCcXFaOg7GTKjXwAySNVZDcezS4F3HU3YwwOWQKQDZ2+XAx5zkzsBUT8Qoa6/43IvwuyY0p9Zd7ewbqvjbIDXWcU5lBPy7E3k8VaOcvvTf84uBo/2hPg2DorghdJ3rnzOQ9l0SPyV6EZgW1jHt4uLt6+KErKEUzu/r4YcaLiPIQX0MHG4HUlYJRUnA0wAitHBcJHIcKOK0vsAUuvm2i6WQ4s27jnAFau3wyGVPpiqtAwjkmIKhMbJhSwfgigZRW3DQ21OlFv20SnTpXNH53U0zjDkJyPOgfBbFgKIq24Gh5FDC1Th1FO0nkDqWpHdVoBbb6wRS/tYNZs53UY8CPTMF4IaKCP8GU7IpFN/a7588aK52EYI0VjWW43HAM5rpgHEi2IdEastZwgHEV4Xaaym3p9QLbCuMnz11JLgQmw1b5bFQ3VvNLERe8QtunGOlqQHmZ0+ZyqT8+3ap6knFgcd5b1f66GdxojcdL+3wQjmZzl8WYZQKVwpWrHJ0NI2HD1XhzxRbiGR6vyXWI9UTTlngQ1hFVUzRfmEdFbcPX7r/rh7mqOJAcWJYbPF0PD0pDumSSA6GxqSgnCPPDOZ4Qg/7+AdRdctG65DFeDVTGQCIw5/j9uliCYkQvy+ivpLo+IUuC3qA/BNG9QI/zQmF1mMxIIQmainBIDdEsAYfYyGt32PxLghfAw/8lUctMliyNqwJeI8PtS+Nq58V+f4jL+35/d/TV+kK55X3qfeZ97g29Q2/kfeOdeKde7FnvZ+8X79fOb50/On92/lqF3ryxxtz1Wq3z9z/OTY0U</latexit><latexit sha1_base64="tQEGT1dKiB0d6p4CljzChDc5oR0=">AAAHQHicfVVdb9s2FFW7zeu0j6Yr9rQXdqmBoZAdO0WWZkAAYyuKFWi3bHbaApaRUdKVRJikNJJq5BL6MXvd/sX+xf7B3oa97mmXtrNYTjYCtijynnN4L4/IqORMm8Hg9xs333r7nc67t97z3//gw49u79z5+IUuKhXDaVzwQr2KqAbOJJwaZji8KhVQEXF4Gc2/dvMvX4PSrJATsyhhJmgmWcpianDobOeT+yHHeUO+JaFado6Jun+2szvoD5aNXO0M151db91Ozu507oZJEVcCpIk51Xo6HJRmZqkyLObQ+GGloaTxnGYwxa6kAvTMLtffkC6OJCQtFP6kIctRfxOCPIouWizW0KjiVNXt0ago5jijG99va5r00cwyWVYGZLySTCtOTEFcWUjCFMSGL0hb17D5m0CyGFJF44AKLajJg5K5dQZm/qaXKVrmgaBziIHzy6HVqhycs0hRtXApFOc6iJA5U0UlEx2U1BhQUiPeKFYHOqcl6CBlJogpj9174jAlL4ygaq7/i7UvwFCcXFaOg7GTKjXwAySNVZDcezS4F3HU3YwwOWQKQDZ2+XAx5zkzsBUT8Qoa6/43IvwuyY0p9Zd7ewbqvjbIDXWcU5lBPy7E3k8VaOcvvTf84uBo/2hPg2DorghdJ3rnzOQ9l0SPyV6EZgW1jHt4uLt6+KErKEUzu/r4YcaLiPIQX0MHG4HUlYJRUnA0wAitHBcJHIcKOK0vsAUuvm2i6WQ4s27jnAFau3wyGVPpiqtAwjkmIKhMbJhSwfgigZRW3DQ21OlFv20SnTpXNH53U0zjDkJyPOgfBbFgKIq24Gh5FDC1Th1FO0nkDqWpHdVoBbb6wRS/tYNZs53UY8CPTMF4IaKCP8GU7IpFN/a7588aK52EYI0VjWW43HAM5rpgHEi2IdEastZwgHEV4Xaaym3p9QLbCuMnz11JLgQmw1b5bFQ3VvNLERe8QtunGOlqQHmZ0+ZyqT8+3ap6knFgcd5b1f66GdxojcdL+3wQjmZzl8WYZQKVwpWrHJ0NI2HD1XhzxRbiGR6vyXWI9UTTlngQ1hFVUzRfmEdFbcPX7r/rh7mqOJAcWJYbPF0PD0pDumSSA6GxqSgnCPPDOZ4Qg/7+AdRdctG65DFeDVTGQCIw5/j9uliCYkQvy+ivpLo+IUuC3qA/BNG9QI/zQmF1mMxIIQmainBIDdEsAYfYyGt32PxLghfAw/8lUctMliyNqwJeI8PtS+Nq58V+f4jL+35/d/TV+kK55X3qfeZ97g29Q2/kfeOdeKde7FnvZ+8X79fOb50/On92/lqF3ryxxtz1Wq3z9z/OTY0U</latexit>
16. Our Correlated Repeat Unions (CRU) model captures
repeat behavior,recency bias,and correlations.
16
Setup (k = 3).
Observe S1, …, S3: {a, b}, {c}, {a, c, d}.
Given that S4 has 3 repeated elements.
Model selects three elements from {a, b, c, d}.
CRU model (p = 0.8; w1 = 0.6,w2 = 0.3 w3 = 0.1).
{a, b} w3 = 0.1{c} w2 = 0.3{a, c, d} w1 = 0.6
0. N = ;.<latexit sha1_base64="koOJt4XUWyg16qZo3FixiqcvPXI=">AAAHQXicfVVdb9s2FFXbzeu0j6YtsJe9sEsNDIXt2CmyNBsCGFtRrEC7ZbPTFoiMjJKuJMIkpZFUI5fTn9nr9i/2K/YT9jbsdS+7tJzFcrIRsEWR95zDe3lEhgVn2gyHv1+7fuOttzvv3HzXf+/9Dz68tXX7zgudlyqC4yjnuXoVUg2cSTg2zHB4VSigIuTwMpx/5eZfvgalWS6nZlHATNBUsoRF1ODQ6dZHw0HwBbn/DTkkAYjCLDSY+wP/dGt7OBguG7ncGa06296qHZ3e7twN4jwqBUgTcar1yWhYmJmlyrCIQ+0HpYaCRnOawgl2JRWgZ3aZQE26OBKTJFf4k4YsR/11CPIoumixWEPDklNVtUfDPJ/jjK59v61pkkczy2RRGpBRI5mUnJicuLqQmCmIDF+Qtq5h8zc9ySJIFI16VGhBTdYrmFtnz8zf9FNFi6wn6Bwi4PxiqFmVg3MWKqoWLoX8TPdCZE5VXspY9wpqDCipEW8Uq3o6owXoXsJML6I8cu+xwxQ8N4Kquf4v1oEAQ3FyWTkOxk7LxMD3ENdWQXzv0fBeyFF3PcJkkCoAWdvlw8WcZczARkzIS6it+1+L8LskM6bQn+/sGKgG2iA3VFFGZQqDKBc7P5agncH0zuizvYPdgx0NgqEPQ7Sd6J8xk/VdEn0m+yG6FdQy7uH+dvPwA1dQim529fGDlOch5QG+Bg42BqlLBeM452iAMXo5ymM4DBRwWp1jc1x820Qn09HMuo1zBmjt8tF0QqUrrgIJZ5iAoDK2QUIF44sYElpyU9tAJ+f9tkl04lxR+911MY07CPHhcHDQiwRDUbQFR8ujgKl04ijaSSJ3IE3lqMYN2OoHJ/it7c3qzaQeA35kCiYLEeb8CaZkGxZd22+fP6utdBKC1VbUluFygwmYq4JxIN6EhCvISsMBJmWI22lKt6VXC2wqTJ48dyU5F5iOWuWzYVVbzS9EXHCDtk8x0tWA8iKj9cVSf3i6UfU45cCirN/U/qoZ3GiNx0v7fBCOZn2XxYSlApWCxlWOzgahsEEzXl+yhXiG52t8FWI1UbclHgRVSNUJmi/IwryywWv33/WDTJUcSAYszQyervt7hSFdMs2A0MiUlBOE+cEcT4jhYHcPqi45b13yGO8GKiMgIZgz/H5dLEExopdl9Buprk/IkqA/HIxAdM/RkyxXWB0mU5JLgqYiHBJDNIvBIdby2h7V/5LgBfDwf0nUMpMlS+2qgNfIaPPSuNx5sTsY4fK+290ef7m6UG56H3ufeJ96I2/fG3tfe0fesRd5P3k/e794v3Z+6/zR+bPzVxN6/doKc9drtc7f/wCI04x4</latexit><latexit sha1_base64="koOJt4XUWyg16qZo3FixiqcvPXI=">AAAHQXicfVVdb9s2FFXbzeu0j6YtsJe9sEsNDIXt2CmyNBsCGFtRrEC7ZbPTFoiMjJKuJMIkpZFUI5fTn9nr9i/2K/YT9jbsdS+7tJzFcrIRsEWR95zDe3lEhgVn2gyHv1+7fuOttzvv3HzXf+/9Dz68tXX7zgudlyqC4yjnuXoVUg2cSTg2zHB4VSigIuTwMpx/5eZfvgalWS6nZlHATNBUsoRF1ODQ6dZHw0HwBbn/DTkkAYjCLDSY+wP/dGt7OBguG7ncGa06296qHZ3e7twN4jwqBUgTcar1yWhYmJmlyrCIQ+0HpYaCRnOawgl2JRWgZ3aZQE26OBKTJFf4k4YsR/11CPIoumixWEPDklNVtUfDPJ/jjK59v61pkkczy2RRGpBRI5mUnJicuLqQmCmIDF+Qtq5h8zc9ySJIFI16VGhBTdYrmFtnz8zf9FNFi6wn6Bwi4PxiqFmVg3MWKqoWLoX8TPdCZE5VXspY9wpqDCipEW8Uq3o6owXoXsJML6I8cu+xwxQ8N4Kquf4v1oEAQ3FyWTkOxk7LxMD3ENdWQXzv0fBeyFF3PcJkkCoAWdvlw8WcZczARkzIS6it+1+L8LskM6bQn+/sGKgG2iA3VFFGZQqDKBc7P5agncH0zuizvYPdgx0NgqEPQ7Sd6J8xk/VdEn0m+yG6FdQy7uH+dvPwA1dQim529fGDlOch5QG+Bg42BqlLBeM452iAMXo5ymM4DBRwWp1jc1x820Qn09HMuo1zBmjt8tF0QqUrrgIJZ5iAoDK2QUIF44sYElpyU9tAJ+f9tkl04lxR+911MY07CPHhcHDQiwRDUbQFR8ujgKl04ijaSSJ3IE3lqMYN2OoHJ/it7c3qzaQeA35kCiYLEeb8CaZkGxZd22+fP6utdBKC1VbUluFygwmYq4JxIN6EhCvISsMBJmWI22lKt6VXC2wqTJ48dyU5F5iOWuWzYVVbzS9EXHCDtk8x0tWA8iKj9cVSf3i6UfU45cCirN/U/qoZ3GiNx0v7fBCOZn2XxYSlApWCxlWOzgahsEEzXl+yhXiG52t8FWI1UbclHgRVSNUJmi/IwryywWv33/WDTJUcSAYszQyervt7hSFdMs2A0MiUlBOE+cEcT4jhYHcPqi45b13yGO8GKiMgIZgz/H5dLEExopdl9Buprk/IkqA/HIxAdM/RkyxXWB0mU5JLgqYiHBJDNIvBIdby2h7V/5LgBfDwf0nUMpMlS+2qgNfIaPPSuNx5sTsY4fK+290ef7m6UG56H3ufeJ96I2/fG3tfe0fesRd5P3k/e794v3Z+6/zR+bPzVxN6/doKc9drtc7f/wCI04x4</latexit><latexit sha1_base64="koOJt4XUWyg16qZo3FixiqcvPXI=">AAAHQXicfVVdb9s2FFXbzeu0j6YtsJe9sEsNDIXt2CmyNBsCGFtRrEC7ZbPTFoiMjJKuJMIkpZFUI5fTn9nr9i/2K/YT9jbsdS+7tJzFcrIRsEWR95zDe3lEhgVn2gyHv1+7fuOttzvv3HzXf+/9Dz68tXX7zgudlyqC4yjnuXoVUg2cSTg2zHB4VSigIuTwMpx/5eZfvgalWS6nZlHATNBUsoRF1ODQ6dZHw0HwBbn/DTkkAYjCLDSY+wP/dGt7OBguG7ncGa06296qHZ3e7twN4jwqBUgTcar1yWhYmJmlyrCIQ+0HpYaCRnOawgl2JRWgZ3aZQE26OBKTJFf4k4YsR/11CPIoumixWEPDklNVtUfDPJ/jjK59v61pkkczy2RRGpBRI5mUnJicuLqQmCmIDF+Qtq5h8zc9ySJIFI16VGhBTdYrmFtnz8zf9FNFi6wn6Bwi4PxiqFmVg3MWKqoWLoX8TPdCZE5VXspY9wpqDCipEW8Uq3o6owXoXsJML6I8cu+xwxQ8N4Kquf4v1oEAQ3FyWTkOxk7LxMD3ENdWQXzv0fBeyFF3PcJkkCoAWdvlw8WcZczARkzIS6it+1+L8LskM6bQn+/sGKgG2iA3VFFGZQqDKBc7P5agncH0zuizvYPdgx0NgqEPQ7Sd6J8xk/VdEn0m+yG6FdQy7uH+dvPwA1dQim529fGDlOch5QG+Bg42BqlLBeM452iAMXo5ymM4DBRwWp1jc1x820Qn09HMuo1zBmjt8tF0QqUrrgIJZ5iAoDK2QUIF44sYElpyU9tAJ+f9tkl04lxR+911MY07CPHhcHDQiwRDUbQFR8ujgKl04ijaSSJ3IE3lqMYN2OoHJ/it7c3qzaQeA35kCiYLEeb8CaZkGxZd22+fP6utdBKC1VbUluFygwmYq4JxIN6EhCvISsMBJmWI22lKt6VXC2wqTJ48dyU5F5iOWuWzYVVbzS9EXHCDtk8x0tWA8iKj9cVSf3i6UfU45cCirN/U/qoZ3GiNx0v7fBCOZn2XxYSlApWCxlWOzgahsEEzXl+yhXiG52t8FWI1UbclHgRVSNUJmi/IwryywWv33/WDTJUcSAYszQyervt7hSFdMs2A0MiUlBOE+cEcT4jhYHcPqi45b13yGO8GKiMgIZgz/H5dLEExopdl9Buprk/IkqA/HIxAdM/RkyxXWB0mU5JLgqYiHBJDNIvBIdby2h7V/5LgBfDwf0nUMpMlS+2qgNfIaPPSuNx5sTsY4fK+290ef7m6UG56H3ufeJ96I2/fG3tfe0fesRd5P3k/e794v3Z+6/zR+bPzVxN6/doKc9drtc7f/wCI04x4</latexit><latexit sha1_base64="koOJt4XUWyg16qZo3FixiqcvPXI=">AAAHQXicfVVdb9s2FFXbzeu0j6YtsJe9sEsNDIXt2CmyNBsCGFtRrEC7ZbPTFoiMjJKuJMIkpZFUI5fTn9nr9i/2K/YT9jbsdS+7tJzFcrIRsEWR95zDe3lEhgVn2gyHv1+7fuOttzvv3HzXf+/9Dz68tXX7zgudlyqC4yjnuXoVUg2cSTg2zHB4VSigIuTwMpx/5eZfvgalWS6nZlHATNBUsoRF1ODQ6dZHw0HwBbn/DTkkAYjCLDSY+wP/dGt7OBguG7ncGa06296qHZ3e7twN4jwqBUgTcar1yWhYmJmlyrCIQ+0HpYaCRnOawgl2JRWgZ3aZQE26OBKTJFf4k4YsR/11CPIoumixWEPDklNVtUfDPJ/jjK59v61pkkczy2RRGpBRI5mUnJicuLqQmCmIDF+Qtq5h8zc9ySJIFI16VGhBTdYrmFtnz8zf9FNFi6wn6Bwi4PxiqFmVg3MWKqoWLoX8TPdCZE5VXspY9wpqDCipEW8Uq3o6owXoXsJML6I8cu+xwxQ8N4Kquf4v1oEAQ3FyWTkOxk7LxMD3ENdWQXzv0fBeyFF3PcJkkCoAWdvlw8WcZczARkzIS6it+1+L8LskM6bQn+/sGKgG2iA3VFFGZQqDKBc7P5agncH0zuizvYPdgx0NgqEPQ7Sd6J8xk/VdEn0m+yG6FdQy7uH+dvPwA1dQim529fGDlOch5QG+Bg42BqlLBeM452iAMXo5ymM4DBRwWp1jc1x820Qn09HMuo1zBmjt8tF0QqUrrgIJZ5iAoDK2QUIF44sYElpyU9tAJ+f9tkl04lxR+911MY07CPHhcHDQiwRDUbQFR8ujgKl04ijaSSJ3IE3lqMYN2OoHJ/it7c3qzaQeA35kCiYLEeb8CaZkGxZd22+fP6utdBKC1VbUluFygwmYq4JxIN6EhCvISsMBJmWI22lKt6VXC2wqTJ48dyU5F5iOWuWzYVVbzS9EXHCDtk8x0tWA8iKj9cVSf3i6UfU45cCirN/U/qoZ3GiNx0v7fBCOZn2XxYSlApWCxlWOzgahsEEzXl+yhXiG52t8FWI1UbclHgRVSNUJmi/IwryywWv33/WDTJUcSAYszQyervt7hSFdMs2A0MiUlBOE+cEcT4jhYHcPqi45b13yGO8GKiMgIZgz/H5dLEExopdl9Buprk/IkqA/HIxAdM/RkyxXWB0mU5JLgqYiHBJDNIvBIdby2h7V/5LgBfDwf0nUMpMlS+2qgNfIaPPSuNx5sTsY4fK+290ef7m6UG56H3ufeJ96I2/fG3tfe0fesRd5P3k/e794v3Z+6/zR+bPzVxN6/doKc9drtc7f/wCI04x4</latexit>
1. N = {a, c}.<latexit sha1_base64="/m/3pGpI42L2jFUUwxh1JPMNRRA=">AAAHQHicfVVdjxs1FJ0WCGX42lLxxIvLNhKqJtlkq2W7oJUiqCoqtbCQbFtpJ1o8njsZK7ZnsD3dpNb8GF7hX/Av+Ae8IV554jofbCa7YCkZj33POb7XZ+ykFNzYXu/3GzffePOt1tu33gnffe/9Dz7cuf3Rc1NUmsEpK0ShXybUgOAKTi23Al6WGqhMBLxIpl/7+RevQBteqJGdlzCWdKJ4xhm1OHS+83G/G39J7n1LjknsaERYXN/rhuc7u71ub9HI1U5/1dkNVu3k/HbrTpwWrJKgLBPUmLN+r7RjR7XlTEAdxpWBkrIpncAZdhWVYMZusf6atHEkJVmh8acsWYyGmxDk0XTeYHGWJpWgetYcTYpiijOmDsOmps0ejh1XZWVBsaVkVgliC+LLQlKugVkxJ01dy6evI8UZZJqyiEojqc2jkvt1Rnb6ujPRtMwjSafAQIjLoeWqPFzwRFM99ykUFyZKkHmii0qlJiqptaCVQbzVfBaZnJZgoozbiFHB/HvqMaUorKR6av6LtSvBUpxcVE6AdaMqs/ADpLXTkN592LubCNTdjLA5TDSAqt3i4WMucm5hKyYRFdTO/29EhG2SW1uaL/b2LMy6xiI3zFhO1QS6rJB7P1VgvL/MXv/zg6P9oz0DkqMNE3Sd7Fxwm3d8Eh2uOgmaFfQi7sHh7vIRxr6gFM3s6xPGE1EkVMT4GnvYAJSpNAzSQqABBmhlVqRwHGsQdLbGFrj4ponORv2x8xvnDdDY5ZPRkCpfXA0KLjABSVXq4oxKLuYpZLQStnaxydb9pklM5l1Rh+1NMYM7COlxr3sUMclRFG0h0PIoYGcm8xTNJJE7VnbmqQZLsDP3z/BbOxjX20k9AvzINAznMinEY0zJLVlM7b579rR2yktIXjtZO47LjYdgrwvGgXQbkqwgKw0PGFYJbqet/JZeL7CtMHz8zJdkLTDqN8rnklntjLgU8cFLtHuCkb4GVJQ5rS+X+uOTraqnEwGc5Z1l7a+bwY02eLw0zwfpaTZ3WQ75RKJSvHSVp3NxIl28HK+v2EI+xeM1vQ6xmqibEvfjWUL1GZovzpNi5uJX/r8dxrmuBJAc+CS3eLoeHpSWtMkoB0KZraggCAvjKZ4Qve7+AczaZN3a5BFeDVQxIAnYC/x+fSxBMWIWZQyXUu2QkAVBp9ftg2yv0cO80FgdriakUARNRQRklhiegkds5LXbr/8lwQvgwf+S6EUmC5baVwGvkf72pXG183y/28flfb+/O/hqdaHcCj4JPg0+C/rBYTAIvglOgtOABS74Ofgl+LX1W+uP1p+tv5ahN2+sMHeCRmv9/Q/4S4tY</latexit><latexit sha1_base64="/m/3pGpI42L2jFUUwxh1JPMNRRA=">AAAHQHicfVVdjxs1FJ0WCGX42lLxxIvLNhKqJtlkq2W7oJUiqCoqtbCQbFtpJ1o8njsZK7ZnsD3dpNb8GF7hX/Av+Ae8IV554jofbCa7YCkZj33POb7XZ+ykFNzYXu/3GzffePOt1tu33gnffe/9Dz7cuf3Rc1NUmsEpK0ShXybUgOAKTi23Al6WGqhMBLxIpl/7+RevQBteqJGdlzCWdKJ4xhm1OHS+83G/G39J7n1LjknsaERYXN/rhuc7u71ub9HI1U5/1dkNVu3k/HbrTpwWrJKgLBPUmLN+r7RjR7XlTEAdxpWBkrIpncAZdhWVYMZusf6atHEkJVmh8acsWYyGmxDk0XTeYHGWJpWgetYcTYpiijOmDsOmps0ejh1XZWVBsaVkVgliC+LLQlKugVkxJ01dy6evI8UZZJqyiEojqc2jkvt1Rnb6ujPRtMwjSafAQIjLoeWqPFzwRFM99ykUFyZKkHmii0qlJiqptaCVQbzVfBaZnJZgoozbiFHB/HvqMaUorKR6av6LtSvBUpxcVE6AdaMqs/ADpLXTkN592LubCNTdjLA5TDSAqt3i4WMucm5hKyYRFdTO/29EhG2SW1uaL/b2LMy6xiI3zFhO1QS6rJB7P1VgvL/MXv/zg6P9oz0DkqMNE3Sd7Fxwm3d8Eh2uOgmaFfQi7sHh7vIRxr6gFM3s6xPGE1EkVMT4GnvYAJSpNAzSQqABBmhlVqRwHGsQdLbGFrj4ponORv2x8xvnDdDY5ZPRkCpfXA0KLjABSVXq4oxKLuYpZLQStnaxydb9pklM5l1Rh+1NMYM7COlxr3sUMclRFG0h0PIoYGcm8xTNJJE7VnbmqQZLsDP3z/BbOxjX20k9AvzINAznMinEY0zJLVlM7b579rR2yktIXjtZO47LjYdgrwvGgXQbkqwgKw0PGFYJbqet/JZeL7CtMHz8zJdkLTDqN8rnklntjLgU8cFLtHuCkb4GVJQ5rS+X+uOTraqnEwGc5Z1l7a+bwY02eLw0zwfpaTZ3WQ75RKJSvHSVp3NxIl28HK+v2EI+xeM1vQ6xmqibEvfjWUL1GZovzpNi5uJX/r8dxrmuBJAc+CS3eLoeHpSWtMkoB0KZraggCAvjKZ4Qve7+AczaZN3a5BFeDVQxIAnYC/x+fSxBMWIWZQyXUu2QkAVBp9ftg2yv0cO80FgdriakUARNRQRklhiegkds5LXbr/8lwQvgwf+S6EUmC5baVwGvkf72pXG183y/28flfb+/O/hqdaHcCj4JPg0+C/rBYTAIvglOgtOABS74Ofgl+LX1W+uP1p+tv5ahN2+sMHeCRmv9/Q/4S4tY</latexit><latexit sha1_base64="/m/3pGpI42L2jFUUwxh1JPMNRRA=">AAAHQHicfVVdjxs1FJ0WCGX42lLxxIvLNhKqJtlkq2W7oJUiqCoqtbCQbFtpJ1o8njsZK7ZnsD3dpNb8GF7hX/Av+Ae8IV554jofbCa7YCkZj33POb7XZ+ykFNzYXu/3GzffePOt1tu33gnffe/9Dz7cuf3Rc1NUmsEpK0ShXybUgOAKTi23Al6WGqhMBLxIpl/7+RevQBteqJGdlzCWdKJ4xhm1OHS+83G/G39J7n1LjknsaERYXN/rhuc7u71ub9HI1U5/1dkNVu3k/HbrTpwWrJKgLBPUmLN+r7RjR7XlTEAdxpWBkrIpncAZdhWVYMZusf6atHEkJVmh8acsWYyGmxDk0XTeYHGWJpWgetYcTYpiijOmDsOmps0ejh1XZWVBsaVkVgliC+LLQlKugVkxJ01dy6evI8UZZJqyiEojqc2jkvt1Rnb6ujPRtMwjSafAQIjLoeWqPFzwRFM99ykUFyZKkHmii0qlJiqptaCVQbzVfBaZnJZgoozbiFHB/HvqMaUorKR6av6LtSvBUpxcVE6AdaMqs/ADpLXTkN592LubCNTdjLA5TDSAqt3i4WMucm5hKyYRFdTO/29EhG2SW1uaL/b2LMy6xiI3zFhO1QS6rJB7P1VgvL/MXv/zg6P9oz0DkqMNE3Sd7Fxwm3d8Eh2uOgmaFfQi7sHh7vIRxr6gFM3s6xPGE1EkVMT4GnvYAJSpNAzSQqABBmhlVqRwHGsQdLbGFrj4ponORv2x8xvnDdDY5ZPRkCpfXA0KLjABSVXq4oxKLuYpZLQStnaxydb9pklM5l1Rh+1NMYM7COlxr3sUMclRFG0h0PIoYGcm8xTNJJE7VnbmqQZLsDP3z/BbOxjX20k9AvzINAznMinEY0zJLVlM7b579rR2yktIXjtZO47LjYdgrwvGgXQbkqwgKw0PGFYJbqet/JZeL7CtMHz8zJdkLTDqN8rnklntjLgU8cFLtHuCkb4GVJQ5rS+X+uOTraqnEwGc5Z1l7a+bwY02eLw0zwfpaTZ3WQ75RKJSvHSVp3NxIl28HK+v2EI+xeM1vQ6xmqibEvfjWUL1GZovzpNi5uJX/r8dxrmuBJAc+CS3eLoeHpSWtMkoB0KZraggCAvjKZ4Qve7+AczaZN3a5BFeDVQxIAnYC/x+fSxBMWIWZQyXUu2QkAVBp9ftg2yv0cO80FgdriakUARNRQRklhiegkds5LXbr/8lwQvgwf+S6EUmC5baVwGvkf72pXG183y/28flfb+/O/hqdaHcCj4JPg0+C/rBYTAIvglOgtOABS74Ofgl+LX1W+uP1p+tv5ahN2+sMHeCRmv9/Q/4S4tY</latexit><latexit sha1_base64="/m/3pGpI42L2jFUUwxh1JPMNRRA=">AAAHQHicfVVdjxs1FJ0WCGX42lLxxIvLNhKqJtlkq2W7oJUiqCoqtbCQbFtpJ1o8njsZK7ZnsD3dpNb8GF7hX/Av+Ae8IV554jofbCa7YCkZj33POb7XZ+ykFNzYXu/3GzffePOt1tu33gnffe/9Dz7cuf3Rc1NUmsEpK0ShXybUgOAKTi23Al6WGqhMBLxIpl/7+RevQBteqJGdlzCWdKJ4xhm1OHS+83G/G39J7n1LjknsaERYXN/rhuc7u71ub9HI1U5/1dkNVu3k/HbrTpwWrJKgLBPUmLN+r7RjR7XlTEAdxpWBkrIpncAZdhWVYMZusf6atHEkJVmh8acsWYyGmxDk0XTeYHGWJpWgetYcTYpiijOmDsOmps0ejh1XZWVBsaVkVgliC+LLQlKugVkxJ01dy6evI8UZZJqyiEojqc2jkvt1Rnb6ujPRtMwjSafAQIjLoeWqPFzwRFM99ykUFyZKkHmii0qlJiqptaCVQbzVfBaZnJZgoozbiFHB/HvqMaUorKR6av6LtSvBUpxcVE6AdaMqs/ADpLXTkN592LubCNTdjLA5TDSAqt3i4WMucm5hKyYRFdTO/29EhG2SW1uaL/b2LMy6xiI3zFhO1QS6rJB7P1VgvL/MXv/zg6P9oz0DkqMNE3Sd7Fxwm3d8Eh2uOgmaFfQi7sHh7vIRxr6gFM3s6xPGE1EkVMT4GnvYAJSpNAzSQqABBmhlVqRwHGsQdLbGFrj4ponORv2x8xvnDdDY5ZPRkCpfXA0KLjABSVXq4oxKLuYpZLQStnaxydb9pklM5l1Rh+1NMYM7COlxr3sUMclRFG0h0PIoYGcm8xTNJJE7VnbmqQZLsDP3z/BbOxjX20k9AvzINAznMinEY0zJLVlM7b579rR2yktIXjtZO47LjYdgrwvGgXQbkqwgKw0PGFYJbqet/JZeL7CtMHz8zJdkLTDqN8rnklntjLgU8cFLtHuCkb4GVJQ5rS+X+uOTraqnEwGc5Z1l7a+bwY02eLw0zwfpaTZ3WQ75RKJSvHSVp3NxIl28HK+v2EI+xeM1vQ6xmqibEvfjWUL1GZovzpNi5uJX/r8dxrmuBJAc+CS3eLoeHpSWtMkoB0KZraggCAvjKZ4Qve7+AczaZN3a5BFeDVQxIAnYC/x+fSxBMWIWZQyXUu2QkAVBp9ftg2yv0cO80FgdriakUARNRQRklhiegkds5LXbr/8lwQvgwf+S6EUmC5baVwGvkf72pXG183y/28flfb+/O/hqdaHcCj4JPg0+C/rBYTAIvglOgtOABS74Ofgl+LX1W+uP1p+tv5ahN2+sMHeCRmv9/Q/4S4tY</latexit>
2. N = {a, c}.<latexit sha1_base64="UnWGOPG7NpsLB9xNGGE4KhYy81s=">AAAHQHicfVVdjxs1FJ0WCGX42lLxxIvLNhKqJtlkq2W7oJUiqCoqtbCQbFtpJ1o8njsZK7ZnsD3dpNb8GF7hX/Av+Ae8IV554jofbCa7YCkZj33POb7XZ+ykFNzYXu/3GzffePOt1tu33gnffe/9Dz7cuf3Rc1NUmsEpK0ShXybUgOAKTi23Al6WGqhMBLxIpl/7+RevQBteqJGdlzCWdKJ4xhm1OHS+8/F+N/6S3PuWHJPY0YiwuL7XDc93dnvd3qKRq53+qrMbrNrJ+e3WnTgtWCVBWSaoMWf9XmnHjmrLmYA6jCsDJWVTOoEz7CoqwYzdYv01aeNISrJC409ZshgNNyHIo+m8weIsTSpB9aw5mhTFFGdMHYZNTZs9HDuuysqCYkvJrBLEFsSXhaRcA7NiTpq6lk9fR4ozyDRlEZVGUptHJffrjOz0dWeiaZlHkk6BgRCXQ8tVebjgiaZ67lMoLkyUIPNEF5VKTVRSa0Erg3ir+SwyOS3BRBm3EaOC+ffUY0pRWEn11PwXa1eCpTi5qJwA60ZVZuEHSGunIb37sHc3Eai7GWFzmGgAVbvFw8dc5NzCVkwiKqid/9+ICNskt7Y0X+ztWZh1jUVumLGcqgl0WSH3fqrAeH+Zvf7nB0f7R3sGJEcbJug62bngNu/4JDpcdRI0K+hF3IPD3eUjjH1BKZrZ1yeMJ6JIqIjxNfawAShTaRikhUADDNDKrEjhONYg6GyNLXDxTROdjfpj5zfOG6CxyyejIVW+uBoUXGACkqrUxRmVXMxTyGglbO1ik637TZOYzLuiDtubYgZ3ENLjXvcoYpKjKNpCoOVRwM5M5imaSSJ3rOzMUw2WYGfun+G3djCut5N6BPiRaRjOZVKIx5iSW7KY2n337GntlJeQvHaydhyXGw/BXheMA+k2JFlBVhoeMKwS3E5b+S29XmBbYfj4mS/JWmDUb5TPJbPaGXEp4oOXaPcEI30NqChzWl8u9ccnW1VPJwI4yzvL2l83gxtt8Hhpng/S02zushzyiUSleOkqT+fiRLp4OV5fsYV8isdreh1iNVE3Je7Hs4TqMzRfnCfFzMWv/H87jHNdCSA58Elu8XQ9PCgtaZNRDoQyW1FBEBbGUzwhet39A5i1ybq1ySO8GqhiQBKwF/j9+liCYsQsyhgupdohIQuCTq/bB9leo4d5obE6XE1IoQiaigjILDE8BY/YyGu3X/9LghfAg/8l0YtMFiy1rwJeI/3tS+Nq5/l+t4/L+35/d/DV6kK5FXwSfBp8FvSDw2AQfBOcBKcBC1zwc/BL8Gvrt9YfrT9bfy1Db95YYe4Ejdb6+x//JYtZ</latexit><latexit sha1_base64="UnWGOPG7NpsLB9xNGGE4KhYy81s=">AAAHQHicfVVdjxs1FJ0WCGX42lLxxIvLNhKqJtlkq2W7oJUiqCoqtbCQbFtpJ1o8njsZK7ZnsD3dpNb8GF7hX/Av+Ae8IV554jofbCa7YCkZj33POb7XZ+ykFNzYXu/3GzffePOt1tu33gnffe/9Dz7cuf3Rc1NUmsEpK0ShXybUgOAKTi23Al6WGqhMBLxIpl/7+RevQBteqJGdlzCWdKJ4xhm1OHS+8/F+N/6S3PuWHJPY0YiwuL7XDc93dnvd3qKRq53+qrMbrNrJ+e3WnTgtWCVBWSaoMWf9XmnHjmrLmYA6jCsDJWVTOoEz7CoqwYzdYv01aeNISrJC409ZshgNNyHIo+m8weIsTSpB9aw5mhTFFGdMHYZNTZs9HDuuysqCYkvJrBLEFsSXhaRcA7NiTpq6lk9fR4ozyDRlEZVGUptHJffrjOz0dWeiaZlHkk6BgRCXQ8tVebjgiaZ67lMoLkyUIPNEF5VKTVRSa0Erg3ir+SwyOS3BRBm3EaOC+ffUY0pRWEn11PwXa1eCpTi5qJwA60ZVZuEHSGunIb37sHc3Eai7GWFzmGgAVbvFw8dc5NzCVkwiKqid/9+ICNskt7Y0X+ztWZh1jUVumLGcqgl0WSH3fqrAeH+Zvf7nB0f7R3sGJEcbJug62bngNu/4JDpcdRI0K+hF3IPD3eUjjH1BKZrZ1yeMJ6JIqIjxNfawAShTaRikhUADDNDKrEjhONYg6GyNLXDxTROdjfpj5zfOG6CxyyejIVW+uBoUXGACkqrUxRmVXMxTyGglbO1ik637TZOYzLuiDtubYgZ3ENLjXvcoYpKjKNpCoOVRwM5M5imaSSJ3rOzMUw2WYGfun+G3djCut5N6BPiRaRjOZVKIx5iSW7KY2n337GntlJeQvHaydhyXGw/BXheMA+k2JFlBVhoeMKwS3E5b+S29XmBbYfj4mS/JWmDUb5TPJbPaGXEp4oOXaPcEI30NqChzWl8u9ccnW1VPJwI4yzvL2l83gxtt8Hhpng/S02zushzyiUSleOkqT+fiRLp4OV5fsYV8isdreh1iNVE3Je7Hs4TqMzRfnCfFzMWv/H87jHNdCSA58Elu8XQ9PCgtaZNRDoQyW1FBEBbGUzwhet39A5i1ybq1ySO8GqhiQBKwF/j9+liCYsQsyhgupdohIQuCTq/bB9leo4d5obE6XE1IoQiaigjILDE8BY/YyGu3X/9LghfAg/8l0YtMFiy1rwJeI/3tS+Nq5/l+t4/L+35/d/DV6kK5FXwSfBp8FvSDw2AQfBOcBKcBC1zwc/BL8Gvrt9YfrT9bfy1Db95YYe4Ejdb6+x//JYtZ</latexit><latexit sha1_base64="UnWGOPG7NpsLB9xNGGE4KhYy81s=">AAAHQHicfVVdjxs1FJ0WCGX42lLxxIvLNhKqJtlkq2W7oJUiqCoqtbCQbFtpJ1o8njsZK7ZnsD3dpNb8GF7hX/Av+Ae8IV554jofbCa7YCkZj33POb7XZ+ykFNzYXu/3GzffePOt1tu33gnffe/9Dz7cuf3Rc1NUmsEpK0ShXybUgOAKTi23Al6WGqhMBLxIpl/7+RevQBteqJGdlzCWdKJ4xhm1OHS+8/F+N/6S3PuWHJPY0YiwuL7XDc93dnvd3qKRq53+qrMbrNrJ+e3WnTgtWCVBWSaoMWf9XmnHjmrLmYA6jCsDJWVTOoEz7CoqwYzdYv01aeNISrJC409ZshgNNyHIo+m8weIsTSpB9aw5mhTFFGdMHYZNTZs9HDuuysqCYkvJrBLEFsSXhaRcA7NiTpq6lk9fR4ozyDRlEZVGUptHJffrjOz0dWeiaZlHkk6BgRCXQ8tVebjgiaZ67lMoLkyUIPNEF5VKTVRSa0Erg3ir+SwyOS3BRBm3EaOC+ffUY0pRWEn11PwXa1eCpTi5qJwA60ZVZuEHSGunIb37sHc3Eai7GWFzmGgAVbvFw8dc5NzCVkwiKqid/9+ICNskt7Y0X+ztWZh1jUVumLGcqgl0WSH3fqrAeH+Zvf7nB0f7R3sGJEcbJug62bngNu/4JDpcdRI0K+hF3IPD3eUjjH1BKZrZ1yeMJ6JIqIjxNfawAShTaRikhUADDNDKrEjhONYg6GyNLXDxTROdjfpj5zfOG6CxyyejIVW+uBoUXGACkqrUxRmVXMxTyGglbO1ik637TZOYzLuiDtubYgZ3ENLjXvcoYpKjKNpCoOVRwM5M5imaSSJ3rOzMUw2WYGfun+G3djCut5N6BPiRaRjOZVKIx5iSW7KY2n337GntlJeQvHaydhyXGw/BXheMA+k2JFlBVhoeMKwS3E5b+S29XmBbYfj4mS/JWmDUb5TPJbPaGXEp4oOXaPcEI30NqChzWl8u9ccnW1VPJwI4yzvL2l83gxtt8Hhpng/S02zushzyiUSleOkqT+fiRLp4OV5fsYV8isdreh1iNVE3Je7Hs4TqMzRfnCfFzMWv/H87jHNdCSA58Elu8XQ9PCgtaZNRDoQyW1FBEBbGUzwhet39A5i1ybq1ySO8GqhiQBKwF/j9+liCYsQsyhgupdohIQuCTq/bB9leo4d5obE6XE1IoQiaigjILDE8BY/YyGu3X/9LghfAg/8l0YtMFiy1rwJeI/3tS+Nq5/l+t4/L+35/d/DV6kK5FXwSfBp8FvSDw2AQfBOcBKcBC1zwc/BL8Gvrt9YfrT9bfy1Db95YYe4Ejdb6+x//JYtZ</latexit><latexit sha1_base64="UnWGOPG7NpsLB9xNGGE4KhYy81s=">AAAHQHicfVVdjxs1FJ0WCGX42lLxxIvLNhKqJtlkq2W7oJUiqCoqtbCQbFtpJ1o8njsZK7ZnsD3dpNb8GF7hX/Av+Ae8IV554jofbCa7YCkZj33POb7XZ+ykFNzYXu/3GzffePOt1tu33gnffe/9Dz7cuf3Rc1NUmsEpK0ShXybUgOAKTi23Al6WGqhMBLxIpl/7+RevQBteqJGdlzCWdKJ4xhm1OHS+8/F+N/6S3PuWHJPY0YiwuL7XDc93dnvd3qKRq53+qrMbrNrJ+e3WnTgtWCVBWSaoMWf9XmnHjmrLmYA6jCsDJWVTOoEz7CoqwYzdYv01aeNISrJC409ZshgNNyHIo+m8weIsTSpB9aw5mhTFFGdMHYZNTZs9HDuuysqCYkvJrBLEFsSXhaRcA7NiTpq6lk9fR4ozyDRlEZVGUptHJffrjOz0dWeiaZlHkk6BgRCXQ8tVebjgiaZ67lMoLkyUIPNEF5VKTVRSa0Erg3ir+SwyOS3BRBm3EaOC+ffUY0pRWEn11PwXa1eCpTi5qJwA60ZVZuEHSGunIb37sHc3Eai7GWFzmGgAVbvFw8dc5NzCVkwiKqid/9+ICNskt7Y0X+ztWZh1jUVumLGcqgl0WSH3fqrAeH+Zvf7nB0f7R3sGJEcbJug62bngNu/4JDpcdRI0K+hF3IPD3eUjjH1BKZrZ1yeMJ6JIqIjxNfawAShTaRikhUADDNDKrEjhONYg6GyNLXDxTROdjfpj5zfOG6CxyyejIVW+uBoUXGACkqrUxRmVXMxTyGglbO1ik637TZOYzLuiDtubYgZ3ENLjXvcoYpKjKNpCoOVRwM5M5imaSSJ3rOzMUw2WYGfun+G3djCut5N6BPiRaRjOZVKIx5iSW7KY2n337GntlJeQvHaydhyXGw/BXheMA+k2JFlBVhoeMKwS3E5b+S29XmBbYfj4mS/JWmDUb5TPJbPaGXEp4oOXaPcEI30NqChzWl8u9ccnW1VPJwI4yzvL2l83gxtt8Hhpng/S02zushzyiUSleOkqT+fiRLp4OV5fsYV8isdreh1iNVE3Je7Hs4TqMzRfnCfFzMWv/H87jHNdCSA58Elu8XQ9PCgtaZNRDoQyW1FBEBbGUzwhet39A5i1ybq1ySO8GqhiQBKwF/j9+liCYsQsyhgupdohIQuCTq/bB9leo4d5obE6XE1IoQiaigjILDE8BY/YyGu3X/9LghfAg/8l0YtMFiy1rwJeI/3tS+Nq5/l+t4/L+35/d/DV6kK5FXwSfBp8FvSDw2AQfBOcBKcBC1zwc/BL8Gvrt9YfrT9bfy1Db95YYe4Ejdb6+x//JYtZ</latexit>
3. N = {a, c, b}.<latexit sha1_base64="mSDh8p6Sw4A+jd6Q91R/Xl/FxcY=">AAAHQ3icfVVdjxs1FJ0WCGX46Ja+IPHiso2Eqkk22dWyXdBKEVQVlVpYSLattBMtHs+djBXbM9ieblJr+DW8wr/gR/AbeEO8InGdZNlMdsFSMh77nnN8r8/YSSm4sb3e7zduvvHmW623b70Tvvve+x/c3rrz4XNTVJrBCStEoV8m1IDgCk4stwJelhqoTAS8SKZf+fkXr0AbXqiRnZcwlnSieMYZtTh0tvXRXjf+gtz/hhyR2NGIsIgkcX2/G55tbfe6vUUjVzv9VWc7WLXjszutu3FasEqCskxQY077vdKOHdWWMwF1GFcGSsqmdAKn2FVUghm7RQo1aeNISrJC409ZshgN1yHIo+m8weIsTSpB9aw5mhTFFGdMHYZNTZs9HDuuysqCYkvJrBLEFsRXhqRcA7NiTpq6lk9fR4ozyDRlEZVGUptHJffrjOz0dWeiaZlHkk6BgRCXQ8tVebjgiaZ67lMozk2UIPNEF5VKTVRSa0Erg3ir+SwyOS3BRBm3EaOC+ffUY0pRWEn11PwXa1eCpTi5qJwA60ZVZuF7SGunIb33sHcvEai7HmFzmGgAVbvFw8ec59zCRkwiKqid/1+LCNskt7Y0n+/sWJh1jUVumLGcqgl0WSF3fqzAeIuZnf5n+4e7hzsGJEcnJmg82TnnNu/4JDpcdRL0K+hF3N7B9vIRxr6gFP3s6xPGE1EkVMT4GnvYAJSpNAzSQqABBuhmVqRwFGsQdHaBLXDxTROdjvpj5zfOG6Cxy8ejIVW+uBoUnGMCkqrUxRmVXMxTyGglbO1ik130myYxmXdFHbbXxQzuIKRHve5hxCRHUbSFQMujgJ2ZzFM0k0TuWNmZpxoswc48OMVvbX9cbyb1CPAj0zCcy6QQjzElt2Qxtfv22dPaKS8hee1k7TguNx6CvS4YB9JNSLKCrDQ8YFgluJ228lt6vcCmwvDxM1+SC4FRv1E+l8xqZ8SliA9eot0TjPQ1oKLMaX251B+ebFQ9nQjgLO8sa3/dDG60weOleT5IT7O+y3LIJxKV4qWrPJ2LE+ni5Xh9xRbyKZ6w6XWI1UTdlHgQzxKqT9F8cZ4UMxe/8v/tMM51JYDkwCe5xdP1YL+0pE1GORDKbEUFQVgYT/GE6HV392HWJhetTR7h7UAVA5KAPcfv18cSFCNmUcZwKdUOCVkQdHrdPsj2BXqYFxqrw9WEFIqgqYiAzBLDU/CItby2+/W/JHgB7P0viV5ksmCpfRXwGulvXhpXO893u31c3ne724MvVxfKreDj4JPg06AfHASD4OvgODgJWPBT8HPwS/Br67fWH60/W38tQ2/eWGHuBo3W+vsfL+KMJg==</latexit><latexit sha1_base64="mSDh8p6Sw4A+jd6Q91R/Xl/FxcY=">AAAHQ3icfVVdjxs1FJ0WCGX46Ja+IPHiso2Eqkk22dWyXdBKEVQVlVpYSLattBMtHs+djBXbM9ieblJr+DW8wr/gR/AbeEO8InGdZNlMdsFSMh77nnN8r8/YSSm4sb3e7zduvvHmW623b70Tvvve+x/c3rrz4XNTVJrBCStEoV8m1IDgCk4stwJelhqoTAS8SKZf+fkXr0AbXqiRnZcwlnSieMYZtTh0tvXRXjf+gtz/hhyR2NGIsIgkcX2/G55tbfe6vUUjVzv9VWc7WLXjszutu3FasEqCskxQY077vdKOHdWWMwF1GFcGSsqmdAKn2FVUghm7RQo1aeNISrJC409ZshgN1yHIo+m8weIsTSpB9aw5mhTFFGdMHYZNTZs9HDuuysqCYkvJrBLEFsRXhqRcA7NiTpq6lk9fR4ozyDRlEZVGUptHJffrjOz0dWeiaZlHkk6BgRCXQ8tVebjgiaZ67lMozk2UIPNEF5VKTVRSa0Erg3ir+SwyOS3BRBm3EaOC+ffUY0pRWEn11PwXa1eCpTi5qJwA60ZVZuF7SGunIb33sHcvEai7HmFzmGgAVbvFw8ec59zCRkwiKqid/1+LCNskt7Y0n+/sWJh1jUVumLGcqgl0WSF3fqzAeIuZnf5n+4e7hzsGJEcnJmg82TnnNu/4JDpcdRL0K+hF3N7B9vIRxr6gFP3s6xPGE1EkVMT4GnvYAJSpNAzSQqABBuhmVqRwFGsQdHaBLXDxTROdjvpj5zfOG6Cxy8ejIVW+uBoUnGMCkqrUxRmVXMxTyGglbO1ik130myYxmXdFHbbXxQzuIKRHve5hxCRHUbSFQMujgJ2ZzFM0k0TuWNmZpxoswc48OMVvbX9cbyb1CPAj0zCcy6QQjzElt2Qxtfv22dPaKS8hee1k7TguNx6CvS4YB9JNSLKCrDQ8YFgluJ228lt6vcCmwvDxM1+SC4FRv1E+l8xqZ8SliA9eot0TjPQ1oKLMaX251B+ebFQ9nQjgLO8sa3/dDG60weOleT5IT7O+y3LIJxKV4qWrPJ2LE+ni5Xh9xRbyKZ6w6XWI1UTdlHgQzxKqT9F8cZ4UMxe/8v/tMM51JYDkwCe5xdP1YL+0pE1GORDKbEUFQVgYT/GE6HV392HWJhetTR7h7UAVA5KAPcfv18cSFCNmUcZwKdUOCVkQdHrdPsj2BXqYFxqrw9WEFIqgqYiAzBLDU/CItby2+/W/JHgB7P0viV5ksmCpfRXwGulvXhpXO893u31c3ne724MvVxfKreDj4JPg06AfHASD4OvgODgJWPBT8HPwS/Br67fWH60/W38tQ2/eWGHuBo3W+vsfL+KMJg==</latexit><latexit sha1_base64="mSDh8p6Sw4A+jd6Q91R/Xl/FxcY=">AAAHQ3icfVVdjxs1FJ0WCGX46Ja+IPHiso2Eqkk22dWyXdBKEVQVlVpYSLattBMtHs+djBXbM9ieblJr+DW8wr/gR/AbeEO8InGdZNlMdsFSMh77nnN8r8/YSSm4sb3e7zduvvHmW623b70Tvvve+x/c3rrz4XNTVJrBCStEoV8m1IDgCk4stwJelhqoTAS8SKZf+fkXr0AbXqiRnZcwlnSieMYZtTh0tvXRXjf+gtz/hhyR2NGIsIgkcX2/G55tbfe6vUUjVzv9VWc7WLXjszutu3FasEqCskxQY077vdKOHdWWMwF1GFcGSsqmdAKn2FVUghm7RQo1aeNISrJC409ZshgN1yHIo+m8weIsTSpB9aw5mhTFFGdMHYZNTZs9HDuuysqCYkvJrBLEFsRXhqRcA7NiTpq6lk9fR4ozyDRlEZVGUptHJffrjOz0dWeiaZlHkk6BgRCXQ8tVebjgiaZ67lMozk2UIPNEF5VKTVRSa0Erg3ir+SwyOS3BRBm3EaOC+ffUY0pRWEn11PwXa1eCpTi5qJwA60ZVZuF7SGunIb33sHcvEai7HmFzmGgAVbvFw8ec59zCRkwiKqid/1+LCNskt7Y0n+/sWJh1jUVumLGcqgl0WSF3fqzAeIuZnf5n+4e7hzsGJEcnJmg82TnnNu/4JDpcdRL0K+hF3N7B9vIRxr6gFP3s6xPGE1EkVMT4GnvYAJSpNAzSQqABBuhmVqRwFGsQdHaBLXDxTROdjvpj5zfOG6Cxy8ejIVW+uBoUnGMCkqrUxRmVXMxTyGglbO1ik130myYxmXdFHbbXxQzuIKRHve5hxCRHUbSFQMujgJ2ZzFM0k0TuWNmZpxoswc48OMVvbX9cbyb1CPAj0zCcy6QQjzElt2Qxtfv22dPaKS8hee1k7TguNx6CvS4YB9JNSLKCrDQ8YFgluJ228lt6vcCmwvDxM1+SC4FRv1E+l8xqZ8SliA9eot0TjPQ1oKLMaX251B+ebFQ9nQjgLO8sa3/dDG60weOleT5IT7O+y3LIJxKV4qWrPJ2LE+ni5Xh9xRbyKZ6w6XWI1UTdlHgQzxKqT9F8cZ4UMxe/8v/tMM51JYDkwCe5xdP1YL+0pE1GORDKbEUFQVgYT/GE6HV392HWJhetTR7h7UAVA5KAPcfv18cSFCNmUcZwKdUOCVkQdHrdPsj2BXqYFxqrw9WEFIqgqYiAzBLDU/CItby2+/W/JHgB7P0viV5ksmCpfRXwGulvXhpXO893u31c3ne724MvVxfKreDj4JPg06AfHASD4OvgODgJWPBT8HPwS/Br67fWH60/W38tQ2/eWGHuBo3W+vsfL+KMJg==</latexit><latexit sha1_base64="mSDh8p6Sw4A+jd6Q91R/Xl/FxcY=">AAAHQ3icfVVdjxs1FJ0WCGX46Ja+IPHiso2Eqkk22dWyXdBKEVQVlVpYSLattBMtHs+djBXbM9ieblJr+DW8wr/gR/AbeEO8InGdZNlMdsFSMh77nnN8r8/YSSm4sb3e7zduvvHmW623b70Tvvve+x/c3rrz4XNTVJrBCStEoV8m1IDgCk4stwJelhqoTAS8SKZf+fkXr0AbXqiRnZcwlnSieMYZtTh0tvXRXjf+gtz/hhyR2NGIsIgkcX2/G55tbfe6vUUjVzv9VWc7WLXjszutu3FasEqCskxQY077vdKOHdWWMwF1GFcGSsqmdAKn2FVUghm7RQo1aeNISrJC409ZshgN1yHIo+m8weIsTSpB9aw5mhTFFGdMHYZNTZs9HDuuysqCYkvJrBLEFsRXhqRcA7NiTpq6lk9fR4ozyDRlEZVGUptHJffrjOz0dWeiaZlHkk6BgRCXQ8tVebjgiaZ67lMozk2UIPNEF5VKTVRSa0Erg3ir+SwyOS3BRBm3EaOC+ffUY0pRWEn11PwXa1eCpTi5qJwA60ZVZuF7SGunIb33sHcvEai7HmFzmGgAVbvFw8ec59zCRkwiKqid/1+LCNskt7Y0n+/sWJh1jUVumLGcqgl0WSF3fqzAeIuZnf5n+4e7hzsGJEcnJmg82TnnNu/4JDpcdRL0K+hF3N7B9vIRxr6gFP3s6xPGE1EkVMT4GnvYAJSpNAzSQqABBuhmVqRwFGsQdHaBLXDxTROdjvpj5zfOG6Cxy8ejIVW+uBoUnGMCkqrUxRmVXMxTyGglbO1ik130myYxmXdFHbbXxQzuIKRHve5hxCRHUbSFQMujgJ2ZzFM0k0TuWNmZpxoswc48OMVvbX9cbyb1CPAj0zCcy6QQjzElt2Qxtfv22dPaKS8hee1k7TguNx6CvS4YB9JNSLKCrDQ8YFgluJ228lt6vcCmwvDxM1+SC4FRv1E+l8xqZ8SliA9eot0TjPQ1oKLMaX251B+ebFQ9nQjgLO8sa3/dDG60weOleT5IT7O+y3LIJxKV4qWrPJ2LE+ni5Xh9xRbyKZ6w6XWI1UTdlHgQzxKqT9F8cZ4UMxe/8v/tMM51JYDkwCe5xdP1YL+0pE1GORDKbEUFQVgYT/GE6HV392HWJhetTR7h7UAVA5KAPcfv18cSFCNmUcZwKdUOCVkQdHrdPsj2BXqYFxqrw9WEFIqgqYiAzBLDU/CItby2+/W/JHgB7P0viV5ksmCpfRXwGulvXhpXO893u31c3ne724MvVxfKreDj4JPg06AfHASD4OvgODgJWPBT8HPwS/Br67fWH60/W38tQ2/eWGHuBo3W+vsfL+KMJg==</latexit>
0. N = ;.<latexit sha1_base64="koOJt4XUWyg16qZo3FixiqcvPXI=">AAAHQXicfVVdb9s2FFXbzeu0j6YtsJe9sEsNDIXt2CmyNBsCGFtRrEC7ZbPTFoiMjJKuJMIkpZFUI5fTn9nr9i/2K/YT9jbsdS+7tJzFcrIRsEWR95zDe3lEhgVn2gyHv1+7fuOttzvv3HzXf+/9Dz68tXX7zgudlyqC4yjnuXoVUg2cSTg2zHB4VSigIuTwMpx/5eZfvgalWS6nZlHATNBUsoRF1ODQ6dZHw0HwBbn/DTkkAYjCLDSY+wP/dGt7OBguG7ncGa06296qHZ3e7twN4jwqBUgTcar1yWhYmJmlyrCIQ+0HpYaCRnOawgl2JRWgZ3aZQE26OBKTJFf4k4YsR/11CPIoumixWEPDklNVtUfDPJ/jjK59v61pkkczy2RRGpBRI5mUnJicuLqQmCmIDF+Qtq5h8zc9ySJIFI16VGhBTdYrmFtnz8zf9FNFi6wn6Bwi4PxiqFmVg3MWKqoWLoX8TPdCZE5VXspY9wpqDCipEW8Uq3o6owXoXsJML6I8cu+xwxQ8N4Kquf4v1oEAQ3FyWTkOxk7LxMD3ENdWQXzv0fBeyFF3PcJkkCoAWdvlw8WcZczARkzIS6it+1+L8LskM6bQn+/sGKgG2iA3VFFGZQqDKBc7P5agncH0zuizvYPdgx0NgqEPQ7Sd6J8xk/VdEn0m+yG6FdQy7uH+dvPwA1dQim529fGDlOch5QG+Bg42BqlLBeM452iAMXo5ymM4DBRwWp1jc1x820Qn09HMuo1zBmjt8tF0QqUrrgIJZ5iAoDK2QUIF44sYElpyU9tAJ+f9tkl04lxR+911MY07CPHhcHDQiwRDUbQFR8ujgKl04ijaSSJ3IE3lqMYN2OoHJ/it7c3qzaQeA35kCiYLEeb8CaZkGxZd22+fP6utdBKC1VbUluFygwmYq4JxIN6EhCvISsMBJmWI22lKt6VXC2wqTJ48dyU5F5iOWuWzYVVbzS9EXHCDtk8x0tWA8iKj9cVSf3i6UfU45cCirN/U/qoZ3GiNx0v7fBCOZn2XxYSlApWCxlWOzgahsEEzXl+yhXiG52t8FWI1UbclHgRVSNUJmi/IwryywWv33/WDTJUcSAYszQyervt7hSFdMs2A0MiUlBOE+cEcT4jhYHcPqi45b13yGO8GKiMgIZgz/H5dLEExopdl9Buprk/IkqA/HIxAdM/RkyxXWB0mU5JLgqYiHBJDNIvBIdby2h7V/5LgBfDwf0nUMpMlS+2qgNfIaPPSuNx5sTsY4fK+290ef7m6UG56H3ufeJ96I2/fG3tfe0fesRd5P3k/e794v3Z+6/zR+bPzVxN6/doKc9drtc7f/wCI04x4</latexit><latexit sha1_base64="koOJt4XUWyg16qZo3FixiqcvPXI=">AAAHQXicfVVdb9s2FFXbzeu0j6YtsJe9sEsNDIXt2CmyNBsCGFtRrEC7ZbPTFoiMjJKuJMIkpZFUI5fTn9nr9i/2K/YT9jbsdS+7tJzFcrIRsEWR95zDe3lEhgVn2gyHv1+7fuOttzvv3HzXf+/9Dz68tXX7zgudlyqC4yjnuXoVUg2cSTg2zHB4VSigIuTwMpx/5eZfvgalWS6nZlHATNBUsoRF1ODQ6dZHw0HwBbn/DTkkAYjCLDSY+wP/dGt7OBguG7ncGa06296qHZ3e7twN4jwqBUgTcar1yWhYmJmlyrCIQ+0HpYaCRnOawgl2JRWgZ3aZQE26OBKTJFf4k4YsR/11CPIoumixWEPDklNVtUfDPJ/jjK59v61pkkczy2RRGpBRI5mUnJicuLqQmCmIDF+Qtq5h8zc9ySJIFI16VGhBTdYrmFtnz8zf9FNFi6wn6Bwi4PxiqFmVg3MWKqoWLoX8TPdCZE5VXspY9wpqDCipEW8Uq3o6owXoXsJML6I8cu+xwxQ8N4Kquf4v1oEAQ3FyWTkOxk7LxMD3ENdWQXzv0fBeyFF3PcJkkCoAWdvlw8WcZczARkzIS6it+1+L8LskM6bQn+/sGKgG2iA3VFFGZQqDKBc7P5agncH0zuizvYPdgx0NgqEPQ7Sd6J8xk/VdEn0m+yG6FdQy7uH+dvPwA1dQim529fGDlOch5QG+Bg42BqlLBeM452iAMXo5ymM4DBRwWp1jc1x820Qn09HMuo1zBmjt8tF0QqUrrgIJZ5iAoDK2QUIF44sYElpyU9tAJ+f9tkl04lxR+911MY07CPHhcHDQiwRDUbQFR8ujgKl04ijaSSJ3IE3lqMYN2OoHJ/it7c3qzaQeA35kCiYLEeb8CaZkGxZd22+fP6utdBKC1VbUluFygwmYq4JxIN6EhCvISsMBJmWI22lKt6VXC2wqTJ48dyU5F5iOWuWzYVVbzS9EXHCDtk8x0tWA8iKj9cVSf3i6UfU45cCirN/U/qoZ3GiNx0v7fBCOZn2XxYSlApWCxlWOzgahsEEzXl+yhXiG52t8FWI1UbclHgRVSNUJmi/IwryywWv33/WDTJUcSAYszQyervt7hSFdMs2A0MiUlBOE+cEcT4jhYHcPqi45b13yGO8GKiMgIZgz/H5dLEExopdl9Buprk/IkqA/HIxAdM/RkyxXWB0mU5JLgqYiHBJDNIvBIdby2h7V/5LgBfDwf0nUMpMlS+2qgNfIaPPSuNx5sTsY4fK+290ef7m6UG56H3ufeJ96I2/fG3tfe0fesRd5P3k/e794v3Z+6/zR+bPzVxN6/doKc9drtc7f/wCI04x4</latexit><latexit sha1_base64="koOJt4XUWyg16qZo3FixiqcvPXI=">AAAHQXicfVVdb9s2FFXbzeu0j6YtsJe9sEsNDIXt2CmyNBsCGFtRrEC7ZbPTFoiMjJKuJMIkpZFUI5fTn9nr9i/2K/YT9jbsdS+7tJzFcrIRsEWR95zDe3lEhgVn2gyHv1+7fuOttzvv3HzXf+/9Dz68tXX7zgudlyqC4yjnuXoVUg2cSTg2zHB4VSigIuTwMpx/5eZfvgalWS6nZlHATNBUsoRF1ODQ6dZHw0HwBbn/DTkkAYjCLDSY+wP/dGt7OBguG7ncGa06296qHZ3e7twN4jwqBUgTcar1yWhYmJmlyrCIQ+0HpYaCRnOawgl2JRWgZ3aZQE26OBKTJFf4k4YsR/11CPIoumixWEPDklNVtUfDPJ/jjK59v61pkkczy2RRGpBRI5mUnJicuLqQmCmIDF+Qtq5h8zc9ySJIFI16VGhBTdYrmFtnz8zf9FNFi6wn6Bwi4PxiqFmVg3MWKqoWLoX8TPdCZE5VXspY9wpqDCipEW8Uq3o6owXoXsJML6I8cu+xwxQ8N4Kquf4v1oEAQ3FyWTkOxk7LxMD3ENdWQXzv0fBeyFF3PcJkkCoAWdvlw8WcZczARkzIS6it+1+L8LskM6bQn+/sGKgG2iA3VFFGZQqDKBc7P5agncH0zuizvYPdgx0NgqEPQ7Sd6J8xk/VdEn0m+yG6FdQy7uH+dvPwA1dQim529fGDlOch5QG+Bg42BqlLBeM452iAMXo5ymM4DBRwWp1jc1x820Qn09HMuo1zBmjt8tF0QqUrrgIJZ5iAoDK2QUIF44sYElpyU9tAJ+f9tkl04lxR+911MY07CPHhcHDQiwRDUbQFR8ujgKl04ijaSSJ3IE3lqMYN2OoHJ/it7c3qzaQeA35kCiYLEeb8CaZkGxZd22+fP6utdBKC1VbUluFygwmYq4JxIN6EhCvISsMBJmWI22lKt6VXC2wqTJ48dyU5F5iOWuWzYVVbzS9EXHCDtk8x0tWA8iKj9cVSf3i6UfU45cCirN/U/qoZ3GiNx0v7fBCOZn2XxYSlApWCxlWOzgahsEEzXl+yhXiG52t8FWI1UbclHgRVSNUJmi/IwryywWv33/WDTJUcSAYszQyervt7hSFdMs2A0MiUlBOE+cEcT4jhYHcPqi45b13yGO8GKiMgIZgz/H5dLEExopdl9Buprk/IkqA/HIxAdM/RkyxXWB0mU5JLgqYiHBJDNIvBIdby2h7V/5LgBfDwf0nUMpMlS+2qgNfIaPPSuNx5sTsY4fK+290ef7m6UG56H3ufeJ96I2/fG3tfe0fesRd5P3k/e794v3Z+6/zR+bPzVxN6/doKc9drtc7f/wCI04x4</latexit><latexit sha1_base64="koOJt4XUWyg16qZo3FixiqcvPXI=">AAAHQXicfVVdb9s2FFXbzeu0j6YtsJe9sEsNDIXt2CmyNBsCGFtRrEC7ZbPTFoiMjJKuJMIkpZFUI5fTn9nr9i/2K/YT9jbsdS+7tJzFcrIRsEWR95zDe3lEhgVn2gyHv1+7fuOttzvv3HzXf+/9Dz68tXX7zgudlyqC4yjnuXoVUg2cSTg2zHB4VSigIuTwMpx/5eZfvgalWS6nZlHATNBUsoRF1ODQ6dZHw0HwBbn/DTkkAYjCLDSY+wP/dGt7OBguG7ncGa06296qHZ3e7twN4jwqBUgTcar1yWhYmJmlyrCIQ+0HpYaCRnOawgl2JRWgZ3aZQE26OBKTJFf4k4YsR/11CPIoumixWEPDklNVtUfDPJ/jjK59v61pkkczy2RRGpBRI5mUnJicuLqQmCmIDF+Qtq5h8zc9ySJIFI16VGhBTdYrmFtnz8zf9FNFi6wn6Bwi4PxiqFmVg3MWKqoWLoX8TPdCZE5VXspY9wpqDCipEW8Uq3o6owXoXsJML6I8cu+xwxQ8N4Kquf4v1oEAQ3FyWTkOxk7LxMD3ENdWQXzv0fBeyFF3PcJkkCoAWdvlw8WcZczARkzIS6it+1+L8LskM6bQn+/sGKgG2iA3VFFGZQqDKBc7P5agncH0zuizvYPdgx0NgqEPQ7Sd6J8xk/VdEn0m+yG6FdQy7uH+dvPwA1dQim529fGDlOch5QG+Bg42BqlLBeM452iAMXo5ymM4DBRwWp1jc1x820Qn09HMuo1zBmjt8tF0QqUrrgIJZ5iAoDK2QUIF44sYElpyU9tAJ+f9tkl04lxR+911MY07CPHhcHDQiwRDUbQFR8ujgKl04ijaSSJ3IE3lqMYN2OoHJ/it7c3qzaQeA35kCiYLEeb8CaZkGxZd22+fP6utdBKC1VbUluFygwmYq4JxIN6EhCvISsMBJmWI22lKt6VXC2wqTJ48dyU5F5iOWuWzYVVbzS9EXHCDtk8x0tWA8iKj9cVSf3i6UfU45cCirN/U/qoZ3GiNx0v7fBCOZn2XxYSlApWCxlWOzgahsEEzXl+yhXiG52t8FWI1UbclHgRVSNUJmi/IwryywWv33/WDTJUcSAYszQyervt7hSFdMs2A0MiUlBOE+cEcT4jhYHcPqi45b13yGO8GKiMgIZgz/H5dLEExopdl9Buprk/IkqA/HIxAdM/RkyxXWB0mU5JLgqYiHBJDNIvBIdby2h7V/5LgBfDwf0nUMpMlS+2qgNfIaPPSuNx5sTsY4fK+290ef7m6UG56H3ufeJ96I2/fG3tfe0fesRd5P3k/e794v3Z+6/zR+bPzVxN6/doKc9drtc7f/wCI04x4</latexit>
1. N = {a, c, d}.<latexit sha1_base64="cQc0H4GWbHtVI0fEsTgfVT1qu8Q=">AAAHQ3icfVVdjxs1FJ22EMrw0W37gsSLyzYSqibZZKtlu6CVIqgqKrWwkGxbaSdaPJ47GSu2Z7A93aTW8Gt4hX/Bj+A38IZ4ReI6ybKZ7IKlZDz2Pef4Xp+xk1JwY3u9369dv/HW2613br4bvvf+Bx/e2rp954UpKs3gmBWi0K8SakBwBceWWwGvSg1UJgJeJtOv/PzL16ANL9TIzksYSzpRPOOMWhw63fqo342/IPe/IYckdjQiLCJpXN/vhqdb271ub9HI5U5/1dkOVu3o9HbrbpwWrJKgLBPUmJN+r7RjR7XlTEAdxpWBkrIpncAJdhWVYMZukUJN2jiSkqzQ+FOWLEbDdQjyaDpvsDhLk0pQPWuOJkUxxRlTh2FT02aPxo6rsrKg2FIyqwSxBfGVISnXwKyYk6au5dM3keIMMk1ZRKWR1OZRyf06Izt905loWuaRpFNgIMTF0HJVHi54oqme+xSKMxMlyDzRRaVSE5XUWtDKIN5qPotMTkswUcZtxKhg/j31mFIUVlI9Nf/F2pVgKU4uKifAulGVWfge0tppSO896t1LBOquR9gcJhpA1W7x8DFnObewEZOICmrn/9ciwjbJrS3N5zs7FmZdY5EbZiynagJdVsidHysw3mJmp//Z3sHuwY4BydGJCRpPds64zTs+iQ5XnQT9CnoR93B/e/kIY19Qin729QnjiSgSKmJ8jT1sAMpUGgZpIdAAA3QzK1I4jDUIOjvHFrj4polORv2x8xvnDdDY5aPRkCpfXA0KzjABSVXq4oxKLuYpZLQStnaxyc77TZOYzLuiDtvrYgZ3ENLDXvcgYpKjKNpCoOVRwM5M5imaSSJ3rOzMUw2WYGcenOC3tjeuN5N6DPiRaRjOZVKIJ5iSW7KY2n37/FntlJeQvHaydhyXGw/BXhWMA+kmJFlBVhoeMKwS3E5b+S29WmBTYfjkuS/JucCo3yifS2a1M+JCxAcv0e4pRvoaUFHmtL5Y6g9PN6qeTgRwlneWtb9qBjfa4PHSPB+kp1nfZTnkE4lK8dJVns7FiXTxcry+ZAv5DE/Y9CrEaqJuSjyIZwnVJ2i+OE+KmYtf+/92GOe6EkBy4JPc4um6v1da0iajHAhltqKCICyMp3hC9Lq7ezBrk/PWJo/xdqCKAUnAnuH362MJihGzKGO4lGqHhCwIOr1uH2T7HD3MC43V4WpCCkXQVERAZonhKXjEWl7b/fpfErwAHv4viV5ksmCpfRXwGulvXhqXOy92u31c3ne724MvVxfKzeDj4JPg06Af7AeD4OvgKDgOWPBT8HPwS/Br67fWH60/W38tQ69fW2HuBo3W+vsfL76MJg==</latexit><latexit sha1_base64="cQc0H4GWbHtVI0fEsTgfVT1qu8Q=">AAAHQ3icfVVdjxs1FJ22EMrw0W37gsSLyzYSqibZZKtlu6CVIqgqKrWwkGxbaSdaPJ47GSu2Z7A93aTW8Gt4hX/Bj+A38IZ4ReI6ybKZ7IKlZDz2Pef4Xp+xk1JwY3u9369dv/HW2613br4bvvf+Bx/e2rp954UpKs3gmBWi0K8SakBwBceWWwGvSg1UJgJeJtOv/PzL16ANL9TIzksYSzpRPOOMWhw63fqo342/IPe/IYckdjQiLCJpXN/vhqdb271ub9HI5U5/1dkOVu3o9HbrbpwWrJKgLBPUmJN+r7RjR7XlTEAdxpWBkrIpncAJdhWVYMZukUJN2jiSkqzQ+FOWLEbDdQjyaDpvsDhLk0pQPWuOJkUxxRlTh2FT02aPxo6rsrKg2FIyqwSxBfGVISnXwKyYk6au5dM3keIMMk1ZRKWR1OZRyf06Izt905loWuaRpFNgIMTF0HJVHi54oqme+xSKMxMlyDzRRaVSE5XUWtDKIN5qPotMTkswUcZtxKhg/j31mFIUVlI9Nf/F2pVgKU4uKifAulGVWfge0tppSO896t1LBOquR9gcJhpA1W7x8DFnObewEZOICmrn/9ciwjbJrS3N5zs7FmZdY5EbZiynagJdVsidHysw3mJmp//Z3sHuwY4BydGJCRpPds64zTs+iQ5XnQT9CnoR93B/e/kIY19Qin729QnjiSgSKmJ8jT1sAMpUGgZpIdAAA3QzK1I4jDUIOjvHFrj4polORv2x8xvnDdDY5aPRkCpfXA0KzjABSVXq4oxKLuYpZLQStnaxyc77TZOYzLuiDtvrYgZ3ENLDXvcgYpKjKNpCoOVRwM5M5imaSSJ3rOzMUw2WYGcenOC3tjeuN5N6DPiRaRjOZVKIJ5iSW7KY2n37/FntlJeQvHaydhyXGw/BXhWMA+kmJFlBVhoeMKwS3E5b+S29WmBTYfjkuS/JucCo3yifS2a1M+JCxAcv0e4pRvoaUFHmtL5Y6g9PN6qeTgRwlneWtb9qBjfa4PHSPB+kp1nfZTnkE4lK8dJVns7FiXTxcry+ZAv5DE/Y9CrEaqJuSjyIZwnVJ2i+OE+KmYtf+/92GOe6EkBy4JPc4um6v1da0iajHAhltqKCICyMp3hC9Lq7ezBrk/PWJo/xdqCKAUnAnuH362MJihGzKGO4lGqHhCwIOr1uH2T7HD3MC43V4WpCCkXQVERAZonhKXjEWl7b/fpfErwAHv4viV5ksmCpfRXwGulvXhqXOy92u31c3ne724MvVxfKzeDj4JPg06Af7AeD4OvgKDgOWPBT8HPwS/Br67fWH60/W38tQ69fW2HuBo3W+vsfL76MJg==</latexit><latexit sha1_base64="cQc0H4GWbHtVI0fEsTgfVT1qu8Q=">AAAHQ3icfVVdjxs1FJ22EMrw0W37gsSLyzYSqibZZKtlu6CVIqgqKrWwkGxbaSdaPJ47GSu2Z7A93aTW8Gt4hX/Bj+A38IZ4ReI6ybKZ7IKlZDz2Pef4Xp+xk1JwY3u9369dv/HW2613br4bvvf+Bx/e2rp954UpKs3gmBWi0K8SakBwBceWWwGvSg1UJgJeJtOv/PzL16ANL9TIzksYSzpRPOOMWhw63fqo342/IPe/IYckdjQiLCJpXN/vhqdb271ub9HI5U5/1dkOVu3o9HbrbpwWrJKgLBPUmJN+r7RjR7XlTEAdxpWBkrIpncAJdhWVYMZukUJN2jiSkqzQ+FOWLEbDdQjyaDpvsDhLk0pQPWuOJkUxxRlTh2FT02aPxo6rsrKg2FIyqwSxBfGVISnXwKyYk6au5dM3keIMMk1ZRKWR1OZRyf06Izt905loWuaRpFNgIMTF0HJVHi54oqme+xSKMxMlyDzRRaVSE5XUWtDKIN5qPotMTkswUcZtxKhg/j31mFIUVlI9Nf/F2pVgKU4uKifAulGVWfge0tppSO896t1LBOquR9gcJhpA1W7x8DFnObewEZOICmrn/9ciwjbJrS3N5zs7FmZdY5EbZiynagJdVsidHysw3mJmp//Z3sHuwY4BydGJCRpPds64zTs+iQ5XnQT9CnoR93B/e/kIY19Qin729QnjiSgSKmJ8jT1sAMpUGgZpIdAAA3QzK1I4jDUIOjvHFrj4polORv2x8xvnDdDY5aPRkCpfXA0KzjABSVXq4oxKLuYpZLQStnaxyc77TZOYzLuiDtvrYgZ3ENLDXvcgYpKjKNpCoOVRwM5M5imaSSJ3rOzMUw2WYGcenOC3tjeuN5N6DPiRaRjOZVKIJ5iSW7KY2n37/FntlJeQvHaydhyXGw/BXhWMA+kmJFlBVhoeMKwS3E5b+S29WmBTYfjkuS/JucCo3yifS2a1M+JCxAcv0e4pRvoaUFHmtL5Y6g9PN6qeTgRwlneWtb9qBjfa4PHSPB+kp1nfZTnkE4lK8dJVns7FiXTxcry+ZAv5DE/Y9CrEaqJuSjyIZwnVJ2i+OE+KmYtf+/92GOe6EkBy4JPc4um6v1da0iajHAhltqKCICyMp3hC9Lq7ezBrk/PWJo/xdqCKAUnAnuH362MJihGzKGO4lGqHhCwIOr1uH2T7HD3MC43V4WpCCkXQVERAZonhKXjEWl7b/fpfErwAHv4viV5ksmCpfRXwGulvXhqXOy92u31c3ne724MvVxfKzeDj4JPg06Af7AeD4OvgKDgOWPBT8HPwS/Br67fWH60/W38tQ69fW2HuBo3W+vsfL76MJg==</latexit><latexit sha1_base64="cQc0H4GWbHtVI0fEsTgfVT1qu8Q=">AAAHQ3icfVVdjxs1FJ22EMrw0W37gsSLyzYSqibZZKtlu6CVIqgqKrWwkGxbaSdaPJ47GSu2Z7A93aTW8Gt4hX/Bj+A38IZ4ReI6ybKZ7IKlZDz2Pef4Xp+xk1JwY3u9369dv/HW2613br4bvvf+Bx/e2rp954UpKs3gmBWi0K8SakBwBceWWwGvSg1UJgJeJtOv/PzL16ANL9TIzksYSzpRPOOMWhw63fqo342/IPe/IYckdjQiLCJpXN/vhqdb271ub9HI5U5/1dkOVu3o9HbrbpwWrJKgLBPUmJN+r7RjR7XlTEAdxpWBkrIpncAJdhWVYMZukUJN2jiSkqzQ+FOWLEbDdQjyaDpvsDhLk0pQPWuOJkUxxRlTh2FT02aPxo6rsrKg2FIyqwSxBfGVISnXwKyYk6au5dM3keIMMk1ZRKWR1OZRyf06Izt905loWuaRpFNgIMTF0HJVHi54oqme+xSKMxMlyDzRRaVSE5XUWtDKIN5qPotMTkswUcZtxKhg/j31mFIUVlI9Nf/F2pVgKU4uKifAulGVWfge0tppSO896t1LBOquR9gcJhpA1W7x8DFnObewEZOICmrn/9ciwjbJrS3N5zs7FmZdY5EbZiynagJdVsidHysw3mJmp//Z3sHuwY4BydGJCRpPds64zTs+iQ5XnQT9CnoR93B/e/kIY19Qin729QnjiSgSKmJ8jT1sAMpUGgZpIdAAA3QzK1I4jDUIOjvHFrj4polORv2x8xvnDdDY5aPRkCpfXA0KzjABSVXq4oxKLuYpZLQStnaxyc77TZOYzLuiDtvrYgZ3ENLDXvcgYpKjKNpCoOVRwM5M5imaSSJ3rOzMUw2WYGcenOC3tjeuN5N6DPiRaRjOZVKIJ5iSW7KY2n37/FntlJeQvHaydhyXGw/BXhWMA+kmJFlBVhoeMKwS3E5b+S29WmBTYfjkuS/JucCo3yifS2a1M+JCxAcv0e4pRvoaUFHmtL5Y6g9PN6qeTgRwlneWtb9qBjfa4PHSPB+kp1nfZTnkE4lK8dJVns7FiXTxcry+ZAv5DE/Y9CrEaqJuSjyIZwnVJ2i+OE+KmYtf+/92GOe6EkBy4JPc4um6v1da0iajHAhltqKCICyMp3hC9Lq7ezBrk/PWJo/xdqCKAUnAnuH362MJihGzKGO4lGqHhCwIOr1uH2T7HD3MC43V4WpCCkXQVERAZonhKXjEWl7b/fpfErwAHv4viV5ksmCpfRXwGulvXhqXOy92u31c3ne724MvVxfKzeDj4JPg06Af7AeD4OvgKDgOWPBT8HPwS/Br67fWH60/W38tQ69fW2HuBo3W+vsfL76MJg==</latexit>
0.8·0.8·0.8
0.8·0.8·0.2
0.8 + 0.2
0.2·0.8 + 0.8·0.8
17. We can learn model parameters with maximum
likelihood estimation.
17
1. Fix correlation probability p and learn recency weights w.
⟶ single p, vector w learned for entire dataset.
2. Grid search over p, gradient descent on w.
⟶ structure of CRU model makes it easy to compute gradients.
18. The optimal correlation probability is consistent within
domain but differs between domains.
18
Meanper-setlikelihood
x Baseline model (flat, no structure). Similar to [Anderson+ 14]
CRU model.
19. Learned weights tend to decrease monotonically,
which agrees with recency bias in the data.
19
100
101
102
index
10 3
10 2
10 1
Recencyweightw
contact-prim-school
100
101
102
index
10 3
10 2
Recencyweightw
email-Eu-core
100
101
102
index
10 3
10 2
Recencyweightw
coauth-Geology
100
101
102
index
10 2
Recencyweightw
tags-mathoverflow
Correlation
probability p.
20. Asymptotic behavior depends on the
recency weight model parameters.
20
Theorem.
Let Wj =
Pj
i=1 wi.
If W1 < 1, the model tips with probability 1.
If W1 = 1, then every pair occurs infinitely often.<latexit sha1_base64="aOBbWA3HiGqepuD2cTVGzYijJ6s=">AAAH3HicfVXfb9s2ELa7re60H03Xhz3shV1iYChsx0qRpRlmwNiKbAFSLJvdpkDkepR0sjiTlEZStV1Cb3sb9rr/Y3/O/psdbWexnGwCbFHkfffx7r4jw5wzbbrdv+t33nn3vbuNe+97H3z40cf3dx588lJnhYrgRZTxTL0KqQbOJLwwzHB4lSugIuRwEU6/desXb0BplsmhWeQwEnQiWcIianBqvPNXIDMmY5CGnIEhexdj+0tJeiTQhRhb1vPL1zgxG7O9DgkC7zRZmgRMJmZRkq/JarTXIiYFIrIYODEs12TGTEpylYU0ZJyZBfFvw/cqeEkAt7ogOWWKZFFUKE1wmUlmgC9IlhiQHW+8s9vtdJcPuTnw14Pd2vo5Hz+4+zCIs6gQGGTEqdaXfjc3I0uVYRGH0gsKDTmNpnQClziUVIAe2WVuS9LEmZgkmcIfJmk5621C0I+ii4oXa2hYcKrm1dkwy6a4okvPq3Ka5OnIMpkXGGC0okwKTGRGXMlIzBREBjNQ5TVs+rYlWQSJolGLCi2oSVs5c/tsmenb9kTRPG0JOoUIOL+eWu3KwTkLFVULF0I2060QPU9UVshYt3JqDCipEW8Um7d0SnPQrYSZVkR55L5jh8l5ZgRVU/1fXjsCDMXFZeY4GDsssJA/QVxaBfGjp91HIUfeTQvUwkQByNIuX85mlqIItmxCXkBp3f+GhdckqTG5/mp/38C8ow36hnmUUjmBTpSJ/V8L0E77et//8vD44Hhfg2CouxA7QrSdbtsuiDaT7RAbCdTS7snR7urlBS6hFBvN5ccLJhw1zgP8DBysD1IXCvpxxlEAfWyzCJuiFyjgdH6FzXDzVRFdDv2RdYVzAqhU+Xw4oNIlV4GEGQYgqIxtkFDB+CKGhBbclDbQydW4KhKdOFWUXnOTTGMFIe51O8etSDAkRVlwlDwSmLlOnItqkOg7kGbuXPVXYKsfX2KvHY7K7aCeATaZgsFChBk/wZDsyosu7Q/Pz0orHYVgpRWlZbjdYADmNmOciLch4Rqy5nCAQRFiOU3hSno7wTbD4OS5S8kVwdCvpM+G89Jqfk3ijFdoe4qWLgeU5yktr7f68+lW1uMJBxal7VXub1vBQms8Xqrng3BuNqssBmwikClYqcq5s0EobLCaL2/IQpzh0R/fhlgvlFWKx8E8pOoSxRekYTa3wRv33/SCVBUcSApskho8XY8Oc0OaZIiHPI1MQTlBmBdM8YTodg4OYd4kV0+TPMNri8oISAhmhv3rbAmSEb1Mo7eianqELB20ux0fRPMKPUgzhdlhckIyubxWOCSGaBaDQ2zEteuX/zrBC+DJ/zpRy0iWXkqXBbxG/O1L4+bg5UHHx+39eLDb/2Z9odyrfVb7vPZFza8d1fq172vntRe1qP5pvVc/qX/XeN34rfF744+V6Z36GvOwVnkaf/4DFizBCg==</latexit><latexit sha1_base64="aOBbWA3HiGqepuD2cTVGzYijJ6s=">AAAH3HicfVXfb9s2ELa7re60H03Xhz3shV1iYChsx0qRpRlmwNiKbAFSLJvdpkDkepR0sjiTlEZStV1Cb3sb9rr/Y3/O/psdbWexnGwCbFHkfffx7r4jw5wzbbrdv+t33nn3vbuNe+97H3z40cf3dx588lJnhYrgRZTxTL0KqQbOJLwwzHB4lSugIuRwEU6/desXb0BplsmhWeQwEnQiWcIianBqvPNXIDMmY5CGnIEhexdj+0tJeiTQhRhb1vPL1zgxG7O9DgkC7zRZmgRMJmZRkq/JarTXIiYFIrIYODEs12TGTEpylYU0ZJyZBfFvw/cqeEkAt7ogOWWKZFFUKE1wmUlmgC9IlhiQHW+8s9vtdJcPuTnw14Pd2vo5Hz+4+zCIs6gQGGTEqdaXfjc3I0uVYRGH0gsKDTmNpnQClziUVIAe2WVuS9LEmZgkmcIfJmk5621C0I+ii4oXa2hYcKrm1dkwy6a4okvPq3Ka5OnIMpkXGGC0okwKTGRGXMlIzBREBjNQ5TVs+rYlWQSJolGLCi2oSVs5c/tsmenb9kTRPG0JOoUIOL+eWu3KwTkLFVULF0I2060QPU9UVshYt3JqDCipEW8Um7d0SnPQrYSZVkR55L5jh8l5ZgRVU/1fXjsCDMXFZeY4GDsssJA/QVxaBfGjp91HIUfeTQvUwkQByNIuX85mlqIItmxCXkBp3f+GhdckqTG5/mp/38C8ow36hnmUUjmBTpSJ/V8L0E77et//8vD44Hhfg2CouxA7QrSdbtsuiDaT7RAbCdTS7snR7urlBS6hFBvN5ccLJhw1zgP8DBysD1IXCvpxxlEAfWyzCJuiFyjgdH6FzXDzVRFdDv2RdYVzAqhU+Xw4oNIlV4GEGQYgqIxtkFDB+CKGhBbclDbQydW4KhKdOFWUXnOTTGMFIe51O8etSDAkRVlwlDwSmLlOnItqkOg7kGbuXPVXYKsfX2KvHY7K7aCeATaZgsFChBk/wZDsyosu7Q/Pz0orHYVgpRWlZbjdYADmNmOciLch4Rqy5nCAQRFiOU3hSno7wTbD4OS5S8kVwdCvpM+G89Jqfk3ijFdoe4qWLgeU5yktr7f68+lW1uMJBxal7VXub1vBQms8Xqrng3BuNqssBmwikClYqcq5s0EobLCaL2/IQpzh0R/fhlgvlFWKx8E8pOoSxRekYTa3wRv33/SCVBUcSApskho8XY8Oc0OaZIiHPI1MQTlBmBdM8YTodg4OYd4kV0+TPMNri8oISAhmhv3rbAmSEb1Mo7eianqELB20ux0fRPMKPUgzhdlhckIyubxWOCSGaBaDQ2zEteuX/zrBC+DJ/zpRy0iWXkqXBbxG/O1L4+bg5UHHx+39eLDb/2Z9odyrfVb7vPZFza8d1fq172vntRe1qP5pvVc/qX/XeN34rfF744+V6Z36GvOwVnkaf/4DFizBCg==</latexit><latexit sha1_base64="aOBbWA3HiGqepuD2cTVGzYijJ6s=">AAAH3HicfVXfb9s2ELa7re60H03Xhz3shV1iYChsx0qRpRlmwNiKbAFSLJvdpkDkepR0sjiTlEZStV1Cb3sb9rr/Y3/O/psdbWexnGwCbFHkfffx7r4jw5wzbbrdv+t33nn3vbuNe+97H3z40cf3dx588lJnhYrgRZTxTL0KqQbOJLwwzHB4lSugIuRwEU6/desXb0BplsmhWeQwEnQiWcIianBqvPNXIDMmY5CGnIEhexdj+0tJeiTQhRhb1vPL1zgxG7O9DgkC7zRZmgRMJmZRkq/JarTXIiYFIrIYODEs12TGTEpylYU0ZJyZBfFvw/cqeEkAt7ogOWWKZFFUKE1wmUlmgC9IlhiQHW+8s9vtdJcPuTnw14Pd2vo5Hz+4+zCIs6gQGGTEqdaXfjc3I0uVYRGH0gsKDTmNpnQClziUVIAe2WVuS9LEmZgkmcIfJmk5621C0I+ii4oXa2hYcKrm1dkwy6a4okvPq3Ka5OnIMpkXGGC0okwKTGRGXMlIzBREBjNQ5TVs+rYlWQSJolGLCi2oSVs5c/tsmenb9kTRPG0JOoUIOL+eWu3KwTkLFVULF0I2060QPU9UVshYt3JqDCipEW8Um7d0SnPQrYSZVkR55L5jh8l5ZgRVU/1fXjsCDMXFZeY4GDsssJA/QVxaBfGjp91HIUfeTQvUwkQByNIuX85mlqIItmxCXkBp3f+GhdckqTG5/mp/38C8ow36hnmUUjmBTpSJ/V8L0E77et//8vD44Hhfg2CouxA7QrSdbtsuiDaT7RAbCdTS7snR7urlBS6hFBvN5ccLJhw1zgP8DBysD1IXCvpxxlEAfWyzCJuiFyjgdH6FzXDzVRFdDv2RdYVzAqhU+Xw4oNIlV4GEGQYgqIxtkFDB+CKGhBbclDbQydW4KhKdOFWUXnOTTGMFIe51O8etSDAkRVlwlDwSmLlOnItqkOg7kGbuXPVXYKsfX2KvHY7K7aCeATaZgsFChBk/wZDsyosu7Q/Pz0orHYVgpRWlZbjdYADmNmOciLch4Rqy5nCAQRFiOU3hSno7wTbD4OS5S8kVwdCvpM+G89Jqfk3ijFdoe4qWLgeU5yktr7f68+lW1uMJBxal7VXub1vBQms8Xqrng3BuNqssBmwikClYqcq5s0EobLCaL2/IQpzh0R/fhlgvlFWKx8E8pOoSxRekYTa3wRv33/SCVBUcSApskho8XY8Oc0OaZIiHPI1MQTlBmBdM8YTodg4OYd4kV0+TPMNri8oISAhmhv3rbAmSEb1Mo7eianqELB20ux0fRPMKPUgzhdlhckIyubxWOCSGaBaDQ2zEteuX/zrBC+DJ/zpRy0iWXkqXBbxG/O1L4+bg5UHHx+39eLDb/2Z9odyrfVb7vPZFza8d1fq172vntRe1qP5pvVc/qX/XeN34rfF744+V6Z36GvOwVnkaf/4DFizBCg==</latexit><latexit sha1_base64="aOBbWA3HiGqepuD2cTVGzYijJ6s=">AAAH3HicfVXfb9s2ELa7re60H03Xhz3shV1iYChsx0qRpRlmwNiKbAFSLJvdpkDkepR0sjiTlEZStV1Cb3sb9rr/Y3/O/psdbWexnGwCbFHkfffx7r4jw5wzbbrdv+t33nn3vbuNe+97H3z40cf3dx588lJnhYrgRZTxTL0KqQbOJLwwzHB4lSugIuRwEU6/desXb0BplsmhWeQwEnQiWcIianBqvPNXIDMmY5CGnIEhexdj+0tJeiTQhRhb1vPL1zgxG7O9DgkC7zRZmgRMJmZRkq/JarTXIiYFIrIYODEs12TGTEpylYU0ZJyZBfFvw/cqeEkAt7ogOWWKZFFUKE1wmUlmgC9IlhiQHW+8s9vtdJcPuTnw14Pd2vo5Hz+4+zCIs6gQGGTEqdaXfjc3I0uVYRGH0gsKDTmNpnQClziUVIAe2WVuS9LEmZgkmcIfJmk5621C0I+ii4oXa2hYcKrm1dkwy6a4okvPq3Ka5OnIMpkXGGC0okwKTGRGXMlIzBREBjNQ5TVs+rYlWQSJolGLCi2oSVs5c/tsmenb9kTRPG0JOoUIOL+eWu3KwTkLFVULF0I2060QPU9UVshYt3JqDCipEW8Um7d0SnPQrYSZVkR55L5jh8l5ZgRVU/1fXjsCDMXFZeY4GDsssJA/QVxaBfGjp91HIUfeTQvUwkQByNIuX85mlqIItmxCXkBp3f+GhdckqTG5/mp/38C8ow36hnmUUjmBTpSJ/V8L0E77et//8vD44Hhfg2CouxA7QrSdbtsuiDaT7RAbCdTS7snR7urlBS6hFBvN5ccLJhw1zgP8DBysD1IXCvpxxlEAfWyzCJuiFyjgdH6FzXDzVRFdDv2RdYVzAqhU+Xw4oNIlV4GEGQYgqIxtkFDB+CKGhBbclDbQydW4KhKdOFWUXnOTTGMFIe51O8etSDAkRVlwlDwSmLlOnItqkOg7kGbuXPVXYKsfX2KvHY7K7aCeATaZgsFChBk/wZDsyosu7Q/Pz0orHYVgpRWlZbjdYADmNmOciLch4Rqy5nCAQRFiOU3hSno7wTbD4OS5S8kVwdCvpM+G89Jqfk3ijFdoe4qWLgeU5yktr7f68+lW1uMJBxal7VXub1vBQms8Xqrng3BuNqssBmwikClYqcq5s0EobLCaL2/IQpzh0R/fhlgvlFWKx8E8pOoSxRekYTa3wRv33/SCVBUcSApskho8XY8Oc0OaZIiHPI1MQTlBmBdM8YTodg4OYd4kV0+TPMNri8oISAhmhv3rbAmSEb1Mo7eianqELB20ux0fRPMKPUgzhdlhckIyubxWOCSGaBaDQ2zEteuX/zrBC+DJ/zpRy0iWXkqXBbxG/O1L4+bg5UHHx+39eLDb/2Z9odyrfVb7vPZFza8d1fq172vntRe1qP5pvVc/qX/XeN34rfF744+V6Z36GvOwVnkaf/4DFizBCg==</latexit>
We say that the model tips if
after some point, only one set appears forever more.
(Similar flavor of result to single-item sequence models [Anderson+ 14].)
21. Recap on Set Prediction #1.
Individuals repeating interactions.
21
1. The data exhibits complex repetition patterns.
2. Correlated Repeated Unions (CRU) is a model for repeat structure.
3. Optimal correlation probabilities are consistent within domain
but different across domains.
4. Optimal weights look the same across domains—fat tails.
5. Can analyze the asymptotic behavior of the model.
{a, b, c}, {a, b}, {c, d, e, f}, {a, c}, {c}, {a, b, c}, {e, g, h}, {h}, …
{a, b}, {a, x}, {a, y}, {a}, {a}, {a}, {z}, {a, b, x, y, z}, …
{j}, {j, k, l}, {a, j}, {a}, {a, k}, {a, j, k, l}, {j, k, l}, {j, k, l}, {j, k}…
Code. bit.ly/SoS-code
Data. bit.ly/SoS-data
22. 22
Set Prediction #2. Subset choice models.
Given a slate of alternatives, how do people choose a subset of the alternatives?
What to buy after browsing Amazon? How to construct a playlist on Spotify?
A discrete choice model for subset selection. Benson, Kumar, & Tomkins. WSDM, 2018.
23. Given some slate of alternatives,
how do people make choices?
23
• If choosing just one thing (buying a car, picking a restaurant, etc.), there
are many good ML techniques (logistic regression, deep nets, etc.)
• If choosing a subset of the alternatives (what to buy after browsing
Amazon, constructing a playlist on Spotify, etc.), there are not many tools.
• We develop a simple and interpretable model for subset selection.
24. Our discrete choice model for subset selection
as illustrated through choosing party snacks.
24
Large set of snack options and want to choose a few.
{tortilla chips, potato chips, cookies, pretzels, guacamole, celery, nut mix, hummus,
meatballs, cupcakes, pigs in blankets, cupcakes, potato skins, chicken wings, taquitos, …}
Model 1.
Independent choices.
Easy computation,
but not realistic.
Model 2.
All subsets as options.
Harder computation, but
more modeling power
Our model.
Some“special subsets”as options +
independent choices.
Interpolate between computation
and modeling power.
healthyfoodtribe.comtoday.com
25. Our model is based on a generalization of classical discrete
choice and random utility maximization theory.
25
Discrete Choice Methods with Simulation,Train,2009 (https://eml.berkeley.edu/books/choice2.html)
• Observe choice set C with items 1, …, c. Choose one element.
• Random utility of ith item: Ui = Vi + ei
Vi is base utility, ei is i.i.d. Gumbel distributed error
• If choosing the item with largest random utility…
• (Logistic regression assumes for feature vector x of sample)
Pr[select item i | C] = eVi
P
j2C e
Vj
<latexit sha1_base64="MHw/TabkLT3RqXx2r462XmZzKDE=">AAAHeHicfVVdb9s2FFW7Lem0j6br417Yxca2wnbsFFmaFQGMpShWoMGy2U0LmF5GSVcWa5LSSKqxS+hX7df0dfsXe9ql7SyRk42AJOrynnt4Lw/JqBDc2G73/a3bH3z40cbmnY/DTz797PO7W/e+ODV5qWN4Geci168jZkBwBS8ttwJeFxqYjAS8iqZHfvzVW9CG52po5wWMJZsonvKYWTSdbR2f6BGiIbaEW5CkwRukQZ9QxFj6BPtHjTFpHBKaahY7+NWdnvGqctSU8sy9IZQrclQtzG+qqnG2td3tdBeNXO/0Vp3tYNVOzu5t3KdJHpcSlI0FM2bU6xZ27Ji2PBZQhbQ0ULB4yiYwwq5iEszYLfKuSBMtCUlzjY+yZGENr0IwjmbzWhRnWVQKpmd1a5TnUxwxVRjWOW36eOy4KkoLKl5SpqUgNie+nCThGmsn5qTOa/n0XUvxGHzZWkwayWzWKrifZ8tO37UnmhVZS7IpxCDEpWk5Kw8XPNJMz30K+blpRRh5ovNSJaZVMGtBK4N4q/msZTJWgGml3LZiJmL/n3hMIXIrmZ6a/4rakWAZDi4qJ8C6YZla+AWSymlIHjzuPogE8l71sBlMNICq3OLjfc4zlM6aTyRKqJx/X/EImySztjDf7+xYmHWMxdgwizOmJtCJc7nzewnG69Ls9L7bO9g92DEgOUoxQrXK9jm3Wdsn0eaqHaHIQS/8Hu1vLz8h9QVluAl8fUI6EXnEBMVf6mF9UKbU0E9ygQLo4xaI8wQOqQbBZhfYHCdfF9Fo2Bs7v3BeALVVPhkOmPLF1aDgHBOQTCWOpkxyMU8gZaWwfq+kF/26SEzqVVGFzatkBlcQksNu56AVS46kKAuBkkcCOzOpD1FPEmNTZWc+VH8JdubhCPfa3rhaT+op4CbTMJjLKBfPMCW3jGIq99Pxi8opTyF55WTlOE6XDsDe5IyGZB0SrSArDg8YlBEupy39kt5MsM4weHbsS3JBMOzVyueiWeWMuCTxzku0e46evgZMFBmrLqf62/O1qicTATzO2sva3zSCC23weKmfD9KHubrKcsAnEpnoUlU+nKORdHRpr67JQr7AYzm5CbEaqOoUD+ksYnqE4qNZlM8cfevfzZBmuhRAMuCTzOLpur9XWNIkwwwIi23JBEFYSKd4QnQ7u3swa5KL1iRP8UphKgYSgT3H/et9CZIRsyhjuKRqhoQsArS7nR7I5gV6kOUaq8PVhOSKoKiIgNQSwxPwiCt5bfeqf4PgBfDof4PoRSaLKJWvAl4jvfVL43rndLfTw+n9vLvd/2F1odwJvgy+Cr4JesF+0A9+DE6Cl0Ec/BG8D/4M/tr4e5Nsfr357dL19q0V5n5Qa5u7/wBGwJ7r</latexit><latexit sha1_base64="MHw/TabkLT3RqXx2r462XmZzKDE=">AAAHeHicfVVdb9s2FFW7Lem0j6br417Yxca2wnbsFFmaFQGMpShWoMGy2U0LmF5GSVcWa5LSSKqxS+hX7df0dfsXe9ql7SyRk42AJOrynnt4Lw/JqBDc2G73/a3bH3z40cbmnY/DTz797PO7W/e+ODV5qWN4Geci168jZkBwBS8ttwJeFxqYjAS8iqZHfvzVW9CG52po5wWMJZsonvKYWTSdbR2f6BGiIbaEW5CkwRukQZ9QxFj6BPtHjTFpHBKaahY7+NWdnvGqctSU8sy9IZQrclQtzG+qqnG2td3tdBeNXO/0Vp3tYNVOzu5t3KdJHpcSlI0FM2bU6xZ27Ji2PBZQhbQ0ULB4yiYwwq5iEszYLfKuSBMtCUlzjY+yZGENr0IwjmbzWhRnWVQKpmd1a5TnUxwxVRjWOW36eOy4KkoLKl5SpqUgNie+nCThGmsn5qTOa/n0XUvxGHzZWkwayWzWKrifZ8tO37UnmhVZS7IpxCDEpWk5Kw8XPNJMz30K+blpRRh5ovNSJaZVMGtBK4N4q/msZTJWgGml3LZiJmL/n3hMIXIrmZ6a/4rakWAZDi4qJ8C6YZla+AWSymlIHjzuPogE8l71sBlMNICq3OLjfc4zlM6aTyRKqJx/X/EImySztjDf7+xYmHWMxdgwizOmJtCJc7nzewnG69Ls9L7bO9g92DEgOUoxQrXK9jm3Wdsn0eaqHaHIQS/8Hu1vLz8h9QVluAl8fUI6EXnEBMVf6mF9UKbU0E9ygQLo4xaI8wQOqQbBZhfYHCdfF9Fo2Bs7v3BeALVVPhkOmPLF1aDgHBOQTCWOpkxyMU8gZaWwfq+kF/26SEzqVVGFzatkBlcQksNu56AVS46kKAuBkkcCOzOpD1FPEmNTZWc+VH8JdubhCPfa3rhaT+op4CbTMJjLKBfPMCW3jGIq99Pxi8opTyF55WTlOE6XDsDe5IyGZB0SrSArDg8YlBEupy39kt5MsM4weHbsS3JBMOzVyueiWeWMuCTxzku0e46evgZMFBmrLqf62/O1qicTATzO2sva3zSCC23weKmfD9KHubrKcsAnEpnoUlU+nKORdHRpr67JQr7AYzm5CbEaqOoUD+ksYnqE4qNZlM8cfevfzZBmuhRAMuCTzOLpur9XWNIkwwwIi23JBEFYSKd4QnQ7u3swa5KL1iRP8UphKgYSgT3H/et9CZIRsyhjuKRqhoQsArS7nR7I5gV6kOUaq8PVhOSKoKiIgNQSwxPwiCt5bfeqf4PgBfDof4PoRSaLKJWvAl4jvfVL43rndLfTw+n9vLvd/2F1odwJvgy+Cr4JesF+0A9+DE6Cl0Ec/BG8D/4M/tr4e5Nsfr357dL19q0V5n5Qa5u7/wBGwJ7r</latexit><latexit sha1_base64="MHw/TabkLT3RqXx2r462XmZzKDE=">AAAHeHicfVVdb9s2FFW7Lem0j6br417Yxca2wnbsFFmaFQGMpShWoMGy2U0LmF5GSVcWa5LSSKqxS+hX7df0dfsXe9ql7SyRk42AJOrynnt4Lw/JqBDc2G73/a3bH3z40cbmnY/DTz797PO7W/e+ODV5qWN4Geci168jZkBwBS8ttwJeFxqYjAS8iqZHfvzVW9CG52po5wWMJZsonvKYWTSdbR2f6BGiIbaEW5CkwRukQZ9QxFj6BPtHjTFpHBKaahY7+NWdnvGqctSU8sy9IZQrclQtzG+qqnG2td3tdBeNXO/0Vp3tYNVOzu5t3KdJHpcSlI0FM2bU6xZ27Ji2PBZQhbQ0ULB4yiYwwq5iEszYLfKuSBMtCUlzjY+yZGENr0IwjmbzWhRnWVQKpmd1a5TnUxwxVRjWOW36eOy4KkoLKl5SpqUgNie+nCThGmsn5qTOa/n0XUvxGHzZWkwayWzWKrifZ8tO37UnmhVZS7IpxCDEpWk5Kw8XPNJMz30K+blpRRh5ovNSJaZVMGtBK4N4q/msZTJWgGml3LZiJmL/n3hMIXIrmZ6a/4rakWAZDi4qJ8C6YZla+AWSymlIHjzuPogE8l71sBlMNICq3OLjfc4zlM6aTyRKqJx/X/EImySztjDf7+xYmHWMxdgwizOmJtCJc7nzewnG69Ls9L7bO9g92DEgOUoxQrXK9jm3Wdsn0eaqHaHIQS/8Hu1vLz8h9QVluAl8fUI6EXnEBMVf6mF9UKbU0E9ygQLo4xaI8wQOqQbBZhfYHCdfF9Fo2Bs7v3BeALVVPhkOmPLF1aDgHBOQTCWOpkxyMU8gZaWwfq+kF/26SEzqVVGFzatkBlcQksNu56AVS46kKAuBkkcCOzOpD1FPEmNTZWc+VH8JdubhCPfa3rhaT+op4CbTMJjLKBfPMCW3jGIq99Pxi8opTyF55WTlOE6XDsDe5IyGZB0SrSArDg8YlBEupy39kt5MsM4weHbsS3JBMOzVyueiWeWMuCTxzku0e46evgZMFBmrLqf62/O1qicTATzO2sva3zSCC23weKmfD9KHubrKcsAnEpnoUlU+nKORdHRpr67JQr7AYzm5CbEaqOoUD+ksYnqE4qNZlM8cfevfzZBmuhRAMuCTzOLpur9XWNIkwwwIi23JBEFYSKd4QnQ7u3swa5KL1iRP8UphKgYSgT3H/et9CZIRsyhjuKRqhoQsArS7nR7I5gV6kOUaq8PVhOSKoKiIgNQSwxPwiCt5bfeqf4PgBfDof4PoRSaLKJWvAl4jvfVL43rndLfTw+n9vLvd/2F1odwJvgy+Cr4JesF+0A9+DE6Cl0Ec/BG8D/4M/tr4e5Nsfr357dL19q0V5n5Qa5u7/wBGwJ7r</latexit><latexit sha1_base64="MHw/TabkLT3RqXx2r462XmZzKDE=">AAAHeHicfVVdb9s2FFW7Lem0j6br417Yxca2wnbsFFmaFQGMpShWoMGy2U0LmF5GSVcWa5LSSKqxS+hX7df0dfsXe9ql7SyRk42AJOrynnt4Lw/JqBDc2G73/a3bH3z40cbmnY/DTz797PO7W/e+ODV5qWN4Geci168jZkBwBS8ttwJeFxqYjAS8iqZHfvzVW9CG52po5wWMJZsonvKYWTSdbR2f6BGiIbaEW5CkwRukQZ9QxFj6BPtHjTFpHBKaahY7+NWdnvGqctSU8sy9IZQrclQtzG+qqnG2td3tdBeNXO/0Vp3tYNVOzu5t3KdJHpcSlI0FM2bU6xZ27Ji2PBZQhbQ0ULB4yiYwwq5iEszYLfKuSBMtCUlzjY+yZGENr0IwjmbzWhRnWVQKpmd1a5TnUxwxVRjWOW36eOy4KkoLKl5SpqUgNie+nCThGmsn5qTOa/n0XUvxGHzZWkwayWzWKrifZ8tO37UnmhVZS7IpxCDEpWk5Kw8XPNJMz30K+blpRRh5ovNSJaZVMGtBK4N4q/msZTJWgGml3LZiJmL/n3hMIXIrmZ6a/4rakWAZDi4qJ8C6YZla+AWSymlIHjzuPogE8l71sBlMNICq3OLjfc4zlM6aTyRKqJx/X/EImySztjDf7+xYmHWMxdgwizOmJtCJc7nzewnG69Ls9L7bO9g92DEgOUoxQrXK9jm3Wdsn0eaqHaHIQS/8Hu1vLz8h9QVluAl8fUI6EXnEBMVf6mF9UKbU0E9ygQLo4xaI8wQOqQbBZhfYHCdfF9Fo2Bs7v3BeALVVPhkOmPLF1aDgHBOQTCWOpkxyMU8gZaWwfq+kF/26SEzqVVGFzatkBlcQksNu56AVS46kKAuBkkcCOzOpD1FPEmNTZWc+VH8JdubhCPfa3rhaT+op4CbTMJjLKBfPMCW3jGIq99Pxi8opTyF55WTlOE6XDsDe5IyGZB0SrSArDg8YlBEupy39kt5MsM4weHbsS3JBMOzVyueiWeWMuCTxzku0e46evgZMFBmrLqf62/O1qicTATzO2sva3zSCC23weKmfD9KHubrKcsAnEpnoUlU+nKORdHRpr67JQr7AYzm5CbEaqOoUD+ksYnqE4qNZlM8cfevfzZBmuhRAMuCTzOLpur9XWNIkwwwIi23JBEFYSKd4QnQ7u3swa5KL1iRP8UphKgYSgT3H/et9CZIRsyhjuKRqhoQsArS7nR7I5gV6kOUaq8PVhOSKoKiIgNQSwxPwiCt5bfeqf4PgBfDof4PoRSaLKJWvAl4jvfVL43rndLfTw+n9vLvd/2F1odwJvgy+Cr4JesF+0A9+DE6Cl0Ec/BG8D/4M/tr4e5Nsfr357dL19q0V5n5Qa5u7/wBGwJ7r</latexit>
Vi = T
i x<latexit sha1_base64="WMg3r0ygm8YS1z2N1nlA4xcLFbY=">AAAHPXicfVXdbts2FFbbzeu0v7S93A271MBQyI6dIkszIICxFcUKtFg2O2mByM0o6UgiTFIqSTVyCb3Kbre32HPsAXY37Ha3O7SdxXKyEbBFkec73/n5REYlZ9oMBr/fuHnrvfc7H9z+0P/o408+/Wzrzt0TXVQqhuO44IV6FVENnEk4NsxweFUqoCLi8DKafev2X74FpVkhJ2ZewlTQTLKUxdTg0tnW3QcnZ4wckjACQ8/Y60n94Gxre9AfLAa5OhmuJtveahyd3encC5MirgRIE3Oq9elwUJqppcqwmEPjh5WGksYzmsEpTiUVoKd2EXxDuriSkLRQ+JOGLFb9dQj6UXTe8mINjSpOVd1ejYpihju68f02p0kfTy2TZWVAxkvKtOLEFMTVhCRMQWz4nLR5DZu9CySLIVU0DqjQgpo8KJmLMzCzd71M0TIPBJ1BDJxfLi2jcnDOIkXV3KVQnOsgQs+ZKiqZ6KCkxoCSGvFGsTrQOS1BBykzQUx57N4Thyl5YQRVM/1fXvsCW4ebi8pxMHZSpQZ+hKSxCpL7jwf3I4686xYmh0wByMYuHs7mPGcGNmwiXkFj3f+ahd8luTGl/npnx0Dd1wZ9Qx3nVGbQjwux86YC7cSld4Zf7R3sHuxoEAw1GKHkRO+cmbznkugx2YtQqaAWdo/2t5cPP3QFpahkVx8/zHgRUR7ia+hgI5C6UjBKCo4CGKGO4yKBw1ABp/UFtsDg2yI6nQyn1jXOCaDV5aPJmEpXXAUSzjEBQWViw5QKxucJpLTiprGhTi/mbZHo1Kmi8bvrZBo7CMnhoH8QxIIhKcqCo+SRwNQ6dS7aSaLvUJrauRotwVY/PMVvbW/abCb1BPAjUzCei6jgTzElu/SiG/v9i+eNlY5CsMaKxjIMNxyDuc4YF5JNSLSCrDgcYFxF2E5TuZZeT7DJMH76wpXkgmAybJXPRnVjNb8kccZLtH2Glq4GlJc5bS5D/enZRtWTjAOL896y9tftYKM1Hi/t80E4N+tdFmOWCWQKl6py7mwYCRsu15srshDP8WxNrkOsNpo2xcOwjqg6RfGFeVTUNnzr/rt+mKuKA8mBZbnB03V/rzSkSyY5EBqbinKCMD+c4Qkx6O/uQd0lF6NLnuC9QGUMBA/tc/x+nS1BMqIXZfSXVF2fkIWD3qA/BNG9QI/zQmF1mMxIIQmKinBIDdEsAYdYy2t72PzrBC+AR//rRC0yWXhpXBXwGhluXhpXJye7/SGG98Pu9uib1YVy2/vc+8L70ht6+97I+8478o692Ku9n71fvF87v3X+6PzZ+WtpevPGCnPPa43O3/8AAp+L5g==</latexit><latexit sha1_base64="WMg3r0ygm8YS1z2N1nlA4xcLFbY=">AAAHPXicfVXdbts2FFbbzeu0v7S93A271MBQyI6dIkszIICxFcUKtFg2O2mByM0o6UgiTFIqSTVyCb3Kbre32HPsAXY37Ha3O7SdxXKyEbBFkec73/n5REYlZ9oMBr/fuHnrvfc7H9z+0P/o408+/Wzrzt0TXVQqhuO44IV6FVENnEk4NsxweFUqoCLi8DKafev2X74FpVkhJ2ZewlTQTLKUxdTg0tnW3QcnZ4wckjACQ8/Y60n94Gxre9AfLAa5OhmuJtveahyd3encC5MirgRIE3Oq9elwUJqppcqwmEPjh5WGksYzmsEpTiUVoKd2EXxDuriSkLRQ+JOGLFb9dQj6UXTe8mINjSpOVd1ejYpihju68f02p0kfTy2TZWVAxkvKtOLEFMTVhCRMQWz4nLR5DZu9CySLIVU0DqjQgpo8KJmLMzCzd71M0TIPBJ1BDJxfLi2jcnDOIkXV3KVQnOsgQs+ZKiqZ6KCkxoCSGvFGsTrQOS1BBykzQUx57N4Thyl5YQRVM/1fXvsCW4ebi8pxMHZSpQZ+hKSxCpL7jwf3I4686xYmh0wByMYuHs7mPGcGNmwiXkFj3f+ahd8luTGl/npnx0Dd1wZ9Qx3nVGbQjwux86YC7cSld4Zf7R3sHuxoEAw1GKHkRO+cmbznkugx2YtQqaAWdo/2t5cPP3QFpahkVx8/zHgRUR7ia+hgI5C6UjBKCo4CGKGO4yKBw1ABp/UFtsDg2yI6nQyn1jXOCaDV5aPJmEpXXAUSzjEBQWViw5QKxucJpLTiprGhTi/mbZHo1Kmi8bvrZBo7CMnhoH8QxIIhKcqCo+SRwNQ6dS7aSaLvUJrauRotwVY/PMVvbW/abCb1BPAjUzCei6jgTzElu/SiG/v9i+eNlY5CsMaKxjIMNxyDuc4YF5JNSLSCrDgcYFxF2E5TuZZeT7DJMH76wpXkgmAybJXPRnVjNb8kccZLtH2Glq4GlJc5bS5D/enZRtWTjAOL896y9tftYKM1Hi/t80E4N+tdFmOWCWQKl6py7mwYCRsu15srshDP8WxNrkOsNpo2xcOwjqg6RfGFeVTUNnzr/rt+mKuKA8mBZbnB03V/rzSkSyY5EBqbinKCMD+c4Qkx6O/uQd0lF6NLnuC9QGUMBA/tc/x+nS1BMqIXZfSXVF2fkIWD3qA/BNG9QI/zQmF1mMxIIQmKinBIDdEsAYdYy2t72PzrBC+AR//rRC0yWXhpXBXwGhluXhpXJye7/SGG98Pu9uib1YVy2/vc+8L70ht6+97I+8478o692Ku9n71fvF87v3X+6PzZ+WtpevPGCnPPa43O3/8AAp+L5g==</latexit><latexit sha1_base64="WMg3r0ygm8YS1z2N1nlA4xcLFbY=">AAAHPXicfVXdbts2FFbbzeu0v7S93A271MBQyI6dIkszIICxFcUKtFg2O2mByM0o6UgiTFIqSTVyCb3Kbre32HPsAXY37Ha3O7SdxXKyEbBFkec73/n5REYlZ9oMBr/fuHnrvfc7H9z+0P/o408+/Wzrzt0TXVQqhuO44IV6FVENnEk4NsxweFUqoCLi8DKafev2X74FpVkhJ2ZewlTQTLKUxdTg0tnW3QcnZ4wckjACQ8/Y60n94Gxre9AfLAa5OhmuJtveahyd3encC5MirgRIE3Oq9elwUJqppcqwmEPjh5WGksYzmsEpTiUVoKd2EXxDuriSkLRQ+JOGLFb9dQj6UXTe8mINjSpOVd1ejYpihju68f02p0kfTy2TZWVAxkvKtOLEFMTVhCRMQWz4nLR5DZu9CySLIVU0DqjQgpo8KJmLMzCzd71M0TIPBJ1BDJxfLi2jcnDOIkXV3KVQnOsgQs+ZKiqZ6KCkxoCSGvFGsTrQOS1BBykzQUx57N4Thyl5YQRVM/1fXvsCW4ebi8pxMHZSpQZ+hKSxCpL7jwf3I4686xYmh0wByMYuHs7mPGcGNmwiXkFj3f+ahd8luTGl/npnx0Dd1wZ9Qx3nVGbQjwux86YC7cSld4Zf7R3sHuxoEAw1GKHkRO+cmbznkugx2YtQqaAWdo/2t5cPP3QFpahkVx8/zHgRUR7ia+hgI5C6UjBKCo4CGKGO4yKBw1ABp/UFtsDg2yI6nQyn1jXOCaDV5aPJmEpXXAUSzjEBQWViw5QKxucJpLTiprGhTi/mbZHo1Kmi8bvrZBo7CMnhoH8QxIIhKcqCo+SRwNQ6dS7aSaLvUJrauRotwVY/PMVvbW/abCb1BPAjUzCei6jgTzElu/SiG/v9i+eNlY5CsMaKxjIMNxyDuc4YF5JNSLSCrDgcYFxF2E5TuZZeT7DJMH76wpXkgmAybJXPRnVjNb8kccZLtH2Glq4GlJc5bS5D/enZRtWTjAOL896y9tftYKM1Hi/t80E4N+tdFmOWCWQKl6py7mwYCRsu15srshDP8WxNrkOsNpo2xcOwjqg6RfGFeVTUNnzr/rt+mKuKA8mBZbnB03V/rzSkSyY5EBqbinKCMD+c4Qkx6O/uQd0lF6NLnuC9QGUMBA/tc/x+nS1BMqIXZfSXVF2fkIWD3qA/BNG9QI/zQmF1mMxIIQmKinBIDdEsAYdYy2t72PzrBC+AR//rRC0yWXhpXBXwGhluXhpXJye7/SGG98Pu9uib1YVy2/vc+8L70ht6+97I+8478o692Ku9n71fvF87v3X+6PzZ+WtpevPGCnPPa43O3/8AAp+L5g==</latexit><latexit sha1_base64="WMg3r0ygm8YS1z2N1nlA4xcLFbY=">AAAHPXicfVXdbts2FFbbzeu0v7S93A271MBQyI6dIkszIICxFcUKtFg2O2mByM0o6UgiTFIqSTVyCb3Kbre32HPsAXY37Ha3O7SdxXKyEbBFkec73/n5REYlZ9oMBr/fuHnrvfc7H9z+0P/o408+/Wzrzt0TXVQqhuO44IV6FVENnEk4NsxweFUqoCLi8DKafev2X74FpVkhJ2ZewlTQTLKUxdTg0tnW3QcnZ4wckjACQ8/Y60n94Gxre9AfLAa5OhmuJtveahyd3encC5MirgRIE3Oq9elwUJqppcqwmEPjh5WGksYzmsEpTiUVoKd2EXxDuriSkLRQ+JOGLFb9dQj6UXTe8mINjSpOVd1ejYpihju68f02p0kfTy2TZWVAxkvKtOLEFMTVhCRMQWz4nLR5DZu9CySLIVU0DqjQgpo8KJmLMzCzd71M0TIPBJ1BDJxfLi2jcnDOIkXV3KVQnOsgQs+ZKiqZ6KCkxoCSGvFGsTrQOS1BBykzQUx57N4Thyl5YQRVM/1fXvsCW4ebi8pxMHZSpQZ+hKSxCpL7jwf3I4686xYmh0wByMYuHs7mPGcGNmwiXkFj3f+ahd8luTGl/npnx0Dd1wZ9Qx3nVGbQjwux86YC7cSld4Zf7R3sHuxoEAw1GKHkRO+cmbznkugx2YtQqaAWdo/2t5cPP3QFpahkVx8/zHgRUR7ia+hgI5C6UjBKCo4CGKGO4yKBw1ABp/UFtsDg2yI6nQyn1jXOCaDV5aPJmEpXXAUSzjEBQWViw5QKxucJpLTiprGhTi/mbZHo1Kmi8bvrZBo7CMnhoH8QxIIhKcqCo+SRwNQ6dS7aSaLvUJrauRotwVY/PMVvbW/abCb1BPAjUzCei6jgTzElu/SiG/v9i+eNlY5CsMaKxjIMNxyDuc4YF5JNSLSCrDgcYFxF2E5TuZZeT7DJMH76wpXkgmAybJXPRnVjNb8kccZLtH2Glq4GlJc5bS5D/enZRtWTjAOL896y9tftYKM1Hi/t80E4N+tdFmOWCWQKl6py7mwYCRsu15srshDP8WxNrkOsNpo2xcOwjqg6RfGFeVTUNnzr/rt+mKuKA8mBZbnB03V/rzSkSyY5EBqbinKCMD+c4Qkx6O/uQd0lF6NLnuC9QGUMBA/tc/x+nS1BMqIXZfSXVF2fkIWD3qA/BNG9QI/zQmF1mMxIIQmKinBIDdEsAYdYy2t72PzrBC+AR//rRC0yWXhpXBXwGhluXhpXJye7/SGG98Pu9uib1YVy2/vc+8L70ht6+97I+8478o692Ku9n71fvF87v3X+6PzZ+WtpevPGCnPPa43O3/8AAp+L5g==</latexit>
26. A basic subset choice choice model could assume set
utility is additive in the elements.
26
• Observe choice set C with items 1, …, c. Choose two elements.
(repeats allowed)
• Random utility of (i, j) pair: Uij = Vi + Vj + eij
Vi is base utility, eij i.i.d. Gumbel distributed error
• If choosing the set with largest random utility…
Pr[select set {i, j} | C] = e
Vi+Vj
P
{k,l}⇢C eVk+Vl
<latexit sha1_base64="k8hNq795y+cv+adMlMxth/n2hx8=">AAAHlXicfVVdb9s2FFW6rem0r3R92MNe2CUGhk527BRZmhUBgiUIVqBFszlJC4ReRklXFmNS0kiqsUvwP+51f2Sv26XtLJaTTYAtirznHN7DSzKuBNem2/1z5d4HH350f/XBx+Enn372+RdrD78802WtEjhNSlGqtzHTIHgBp4YbAW8rBUzGAt7EowM//uYdKM3L4sRMKhhINix4xhNmsOti7fJYnSMaEkM0GLJBLY8uqdvA1nOKQEOfY/tgY0A29gjNFEss/GrPLjj5jpxdXDpnqa7lhaV2FBFBHcHP2DMduGncaBonnNsIL9bWu53u9CG3G715Yz2YP8cXD+8/ommZ1BIKkwim9XmvW5mBZcrwRIALaa2hYsmIDeEcmwWToAd2aoojLexJSVYq/BWGTHvDRQjyKDZpsFjD4lowNW72xmU5whHtwrCpabJnA8uLqjZQJDPJrBbElMR7TVKu0FgxIU1dw0fvo4In4O2MmNSSmTyquJ9nZEbv20PFqjySbAQJCHHTNZuVhwseK6YmPoXySkcxMg9VWRepjipmDKhCI94oPo50zirQUcZNlDCR+O/UYypRGsnUSP8Xa0eCYTg4dU6AsSd1ZuAXSJ1VkD5+1n0cC9RdjDA5DBVA4ez05WOucm5gKSYWNTjr/xciwhbJjan0D5ubBsYdbZAbxknOiiF0klJu/l6D9kWrN3vfb+9u7W5qkBxLNMZSlu0rbvK2T6LNi3aMOwDUNO7pzvrsFVJvKMMd4v0J6VCUMRMUP6mH7UOhawX7aSmwAPZxfyRlCntUgWDja2yJk28W0flJb2D9wvkCaKzy8UmfFd5cBQVcYQKSFamlGZNcTFLIWC2M3z3ZdbtZJDrzVeHC1qKYxhWEdK/b2Y0SyVEUy0JgyaOAGevMUzSTRG5amLGn2p+BrX5yjntte+CWkzoE3GQK+hMZl+IIU7IzFu3s61cvnS28hOTOSmc5Tpf2wdwVjB3pMiSeQ+YaHtDHcwIPrNov6d0Cywr9o1fekmuBk17DPhuPndXiRsQHz9D2BUZ6D5iocuZupvrbiyXX06EAnuTtmfd3jeBCazxemueD9DSLqyz7fChRic6qytNZGktLZ/3uVlnIl3hmp3ch5gOuKfGEjmOmzrH4aB6XY0vf+f9WSHNVCyA58GFu8HTd2a4MaZGTHAhLTM0EQVhIR3hCdDtb2zBukeunRQ7xvmFFAiQGc4X718cSFCN6amM4k2qFhEwJ2t1OD2TrGt3PS4Xu8GJIyoJgUREBGV4rPAWPWMhrvef+JcEL4On/kqhpJlMW513Aa6S3fGncbpxtdXo4vZ+31vd/nF8oD4Kvg2+Cb4NesBPsBz8Fx8FpkAR/BH8Ff68Eq1+t7q0erh7NQu+tzDGPgsaz+vofdD+nOw==</latexit><latexit sha1_base64="k8hNq795y+cv+adMlMxth/n2hx8=">AAAHlXicfVVdb9s2FFW6rem0r3R92MNe2CUGhk527BRZmhUBgiUIVqBFszlJC4ReRklXFmNS0kiqsUvwP+51f2Sv26XtLJaTTYAtirznHN7DSzKuBNem2/1z5d4HH350f/XBx+Enn372+RdrD78802WtEjhNSlGqtzHTIHgBp4YbAW8rBUzGAt7EowM//uYdKM3L4sRMKhhINix4xhNmsOti7fJYnSMaEkM0GLJBLY8uqdvA1nOKQEOfY/tgY0A29gjNFEss/GrPLjj5jpxdXDpnqa7lhaV2FBFBHcHP2DMduGncaBonnNsIL9bWu53u9CG3G715Yz2YP8cXD+8/ommZ1BIKkwim9XmvW5mBZcrwRIALaa2hYsmIDeEcmwWToAd2aoojLexJSVYq/BWGTHvDRQjyKDZpsFjD4lowNW72xmU5whHtwrCpabJnA8uLqjZQJDPJrBbElMR7TVKu0FgxIU1dw0fvo4In4O2MmNSSmTyquJ9nZEbv20PFqjySbAQJCHHTNZuVhwseK6YmPoXySkcxMg9VWRepjipmDKhCI94oPo50zirQUcZNlDCR+O/UYypRGsnUSP8Xa0eCYTg4dU6AsSd1ZuAXSJ1VkD5+1n0cC9RdjDA5DBVA4ez05WOucm5gKSYWNTjr/xciwhbJjan0D5ubBsYdbZAbxknOiiF0klJu/l6D9kWrN3vfb+9u7W5qkBxLNMZSlu0rbvK2T6LNi3aMOwDUNO7pzvrsFVJvKMMd4v0J6VCUMRMUP6mH7UOhawX7aSmwAPZxfyRlCntUgWDja2yJk28W0flJb2D9wvkCaKzy8UmfFd5cBQVcYQKSFamlGZNcTFLIWC2M3z3ZdbtZJDrzVeHC1qKYxhWEdK/b2Y0SyVEUy0JgyaOAGevMUzSTRG5amLGn2p+BrX5yjntte+CWkzoE3GQK+hMZl+IIU7IzFu3s61cvnS28hOTOSmc5Tpf2wdwVjB3pMiSeQ+YaHtDHcwIPrNov6d0Cywr9o1fekmuBk17DPhuPndXiRsQHz9D2BUZ6D5iocuZupvrbiyXX06EAnuTtmfd3jeBCazxemueD9DSLqyz7fChRic6qytNZGktLZ/3uVlnIl3hmp3ch5gOuKfGEjmOmzrH4aB6XY0vf+f9WSHNVCyA58GFu8HTd2a4MaZGTHAhLTM0EQVhIR3hCdDtb2zBukeunRQ7xvmFFAiQGc4X718cSFCN6amM4k2qFhEwJ2t1OD2TrGt3PS4Xu8GJIyoJgUREBGV4rPAWPWMhrvef+JcEL4On/kqhpJlMW513Aa6S3fGncbpxtdXo4vZ+31vd/nF8oD4Kvg2+Cb4NesBPsBz8Fx8FpkAR/BH8Ff68Eq1+t7q0erh7NQu+tzDGPgsaz+vofdD+nOw==</latexit><latexit sha1_base64="k8hNq795y+cv+adMlMxth/n2hx8=">AAAHlXicfVVdb9s2FFW6rem0r3R92MNe2CUGhk527BRZmhUBgiUIVqBFszlJC4ReRklXFmNS0kiqsUvwP+51f2Sv26XtLJaTTYAtirznHN7DSzKuBNem2/1z5d4HH350f/XBx+Enn372+RdrD78802WtEjhNSlGqtzHTIHgBp4YbAW8rBUzGAt7EowM//uYdKM3L4sRMKhhINix4xhNmsOti7fJYnSMaEkM0GLJBLY8uqdvA1nOKQEOfY/tgY0A29gjNFEss/GrPLjj5jpxdXDpnqa7lhaV2FBFBHcHP2DMduGncaBonnNsIL9bWu53u9CG3G715Yz2YP8cXD+8/ommZ1BIKkwim9XmvW5mBZcrwRIALaa2hYsmIDeEcmwWToAd2aoojLexJSVYq/BWGTHvDRQjyKDZpsFjD4lowNW72xmU5whHtwrCpabJnA8uLqjZQJDPJrBbElMR7TVKu0FgxIU1dw0fvo4In4O2MmNSSmTyquJ9nZEbv20PFqjySbAQJCHHTNZuVhwseK6YmPoXySkcxMg9VWRepjipmDKhCI94oPo50zirQUcZNlDCR+O/UYypRGsnUSP8Xa0eCYTg4dU6AsSd1ZuAXSJ1VkD5+1n0cC9RdjDA5DBVA4ez05WOucm5gKSYWNTjr/xciwhbJjan0D5ubBsYdbZAbxknOiiF0klJu/l6D9kWrN3vfb+9u7W5qkBxLNMZSlu0rbvK2T6LNi3aMOwDUNO7pzvrsFVJvKMMd4v0J6VCUMRMUP6mH7UOhawX7aSmwAPZxfyRlCntUgWDja2yJk28W0flJb2D9wvkCaKzy8UmfFd5cBQVcYQKSFamlGZNcTFLIWC2M3z3ZdbtZJDrzVeHC1qKYxhWEdK/b2Y0SyVEUy0JgyaOAGevMUzSTRG5amLGn2p+BrX5yjntte+CWkzoE3GQK+hMZl+IIU7IzFu3s61cvnS28hOTOSmc5Tpf2wdwVjB3pMiSeQ+YaHtDHcwIPrNov6d0Cywr9o1fekmuBk17DPhuPndXiRsQHz9D2BUZ6D5iocuZupvrbiyXX06EAnuTtmfd3jeBCazxemueD9DSLqyz7fChRic6qytNZGktLZ/3uVlnIl3hmp3ch5gOuKfGEjmOmzrH4aB6XY0vf+f9WSHNVCyA58GFu8HTd2a4MaZGTHAhLTM0EQVhIR3hCdDtb2zBukeunRQ7xvmFFAiQGc4X718cSFCN6amM4k2qFhEwJ2t1OD2TrGt3PS4Xu8GJIyoJgUREBGV4rPAWPWMhrvef+JcEL4On/kqhpJlMW513Aa6S3fGncbpxtdXo4vZ+31vd/nF8oD4Kvg2+Cb4NesBPsBz8Fx8FpkAR/BH8Ff68Eq1+t7q0erh7NQu+tzDGPgsaz+vofdD+nOw==</latexit><latexit sha1_base64="k8hNq795y+cv+adMlMxth/n2hx8=">AAAHlXicfVVdb9s2FFW6rem0r3R92MNe2CUGhk527BRZmhUBgiUIVqBFszlJC4ReRklXFmNS0kiqsUvwP+51f2Sv26XtLJaTTYAtirznHN7DSzKuBNem2/1z5d4HH350f/XBx+Enn372+RdrD78802WtEjhNSlGqtzHTIHgBp4YbAW8rBUzGAt7EowM//uYdKM3L4sRMKhhINix4xhNmsOti7fJYnSMaEkM0GLJBLY8uqdvA1nOKQEOfY/tgY0A29gjNFEss/GrPLjj5jpxdXDpnqa7lhaV2FBFBHcHP2DMduGncaBonnNsIL9bWu53u9CG3G715Yz2YP8cXD+8/ommZ1BIKkwim9XmvW5mBZcrwRIALaa2hYsmIDeEcmwWToAd2aoojLexJSVYq/BWGTHvDRQjyKDZpsFjD4lowNW72xmU5whHtwrCpabJnA8uLqjZQJDPJrBbElMR7TVKu0FgxIU1dw0fvo4In4O2MmNSSmTyquJ9nZEbv20PFqjySbAQJCHHTNZuVhwseK6YmPoXySkcxMg9VWRepjipmDKhCI94oPo50zirQUcZNlDCR+O/UYypRGsnUSP8Xa0eCYTg4dU6AsSd1ZuAXSJ1VkD5+1n0cC9RdjDA5DBVA4ez05WOucm5gKSYWNTjr/xciwhbJjan0D5ubBsYdbZAbxknOiiF0klJu/l6D9kWrN3vfb+9u7W5qkBxLNMZSlu0rbvK2T6LNi3aMOwDUNO7pzvrsFVJvKMMd4v0J6VCUMRMUP6mH7UOhawX7aSmwAPZxfyRlCntUgWDja2yJk28W0flJb2D9wvkCaKzy8UmfFd5cBQVcYQKSFamlGZNcTFLIWC2M3z3ZdbtZJDrzVeHC1qKYxhWEdK/b2Y0SyVEUy0JgyaOAGevMUzSTRG5amLGn2p+BrX5yjntte+CWkzoE3GQK+hMZl+IIU7IzFu3s61cvnS28hOTOSmc5Tpf2wdwVjB3pMiSeQ+YaHtDHcwIPrNov6d0Cywr9o1fekmuBk17DPhuPndXiRsQHz9D2BUZ6D5iocuZupvrbiyXX06EAnuTtmfd3jeBCazxemueD9DSLqyz7fChRic6qytNZGktLZ/3uVlnIl3hmp3ch5gOuKfGEjmOmzrH4aB6XY0vf+f9WSHNVCyA58GFu8HTd2a4MaZGTHAhLTM0EQVhIR3hCdDtb2zBukeunRQ7xvmFFAiQGc4X718cSFCN6amM4k2qFhEwJ2t1OD2TrGt3PS4Xu8GJIyoJgUREBGV4rPAWPWMhrvef+JcEL4On/kqhpJlMW513Aa6S3fGncbpxtdXo4vZ+31vd/nF8oD4Kvg2+Cb4NesBPsBz8Fx8FpkAR/BH8Ff68Eq1+t7q0erh7NQu+tzDGPgsaz+vofdD+nOw==</latexit>
Pr[select set {i, j} | C, j] = eVi
P
k2C eVk
<latexit sha1_base64="ZaJhcD7ScvxQtNfQTogu245TRXE=">AAAHg3icfVVdb9s2FFW7te60j6br417YxQaGTnbsdFmaFQEMpChaoMWy2UkDmF5GSVcWa1LSSKqxS+iv7X/sfa/bb9il7SyWk42AJOrynnt4Dy/JsBBcm273j1u3P/r4zt3GvU/8Tz/7/Iv7Ww++PNV5qSI4iXKRq7OQaRA8gxPDjYCzQgGToYC34fTIjb99D0rzPBuaeQFjySYZT3jEDJrOt86O1QjREBmiwZAmtTx4R6sm9p5RBBr6DPtHzYA03zXHpHlIaKJYZOEXe3rOq8pSXcpzOyWUZ+SoWpinVdX0z7e2u53uopHrnd6qs+2t2vH5g7sPaZxHpYTMRIJpPep1CzO2TBkeCah8WmooWDRlExhhN2MS9NguJKhICy0xSXKFT2bIwuqvQzCOYvNaFGtYWAqmZnVrmOdTHNGV79c5TfJ0bHlWlAayaEmZlIKYnDhlScwVyijmpM5r+PRDkPEInG4Bk1oykwYFd/MMzPRDe6JYkQaSTSECIa5My1k5uOChYmruUsgvdBBi5InKyyzWQcGMAZVpxBvFZ4FOWQE6SLgJIiYi9x87TCFyI5ma6v+K2pFgGA4ulBNg7LBMDPwMcWUVxI+edh+FAnnXPUwKEwWQVXbxcT4XKTew4ROKEirr3msefoukxhT6h50dA7OONhgbZlHKsgl0olzu/FaCdiWqd3rf7x3sHuxokBwLMsTCle0LbtK2S6LNs3aI9Q5q4fdkf3v58akTlOF+cPr4dCLykAmKv9TB+pDpUkE/zgUWQB93Q5THcEgVCDa7xOY4+XoRjYa9sXUL5wqgtsrHwwHLnLgKMrjABCTLYksTJrmYx5CwUhi3WZLLfr1IdOKqovJb62QaVxDiw27nIIgkR1IsC4EljwRmphMXop4kxqaZmblQ/SXY6scj3Gt742ozqeeAm0zBYC7DXLzAlOwyiq7sj29eVzZzFJJXVlaW43TpAMxNzmiINyHhCrLicIBBGeJymtIt6c0EmwyDF2+cJJcEw15NPhvOKqvFFYlzXqLtK/R0GjBRpKy6muqvrzZUjycCeJS2l9rfNIILrfF4qZ8P0oVZX2U54BOJTHRZVS6cpaG0dGmvrpWFfI0ndHwTYjVQ1Ske01nI1AiLj6ZhPrP0vXu3fJqqUgBJgU9Sg6fr/l5hSIsMUyAsMiUTBGE+neIJ0e3s7sGsRS5bizzH24VlEZAQzAXuX+dLkIzohYz+kqrlE7II0O52eiBbl+hBmitUh2cTkmcEi4oISPAS4TE4xFpe273q3yB4ATz53yBqkckiSuVUwGukt3lpXO+c7nZ6OL2fdrf7L1cXyj3vK+9r7xuv5+17fe+ld+ydeJH3u/en95f3d+NO49vGbuO7pevtWyvMQ6/WGof/AOdZoU0=</latexit><latexit sha1_base64="ZaJhcD7ScvxQtNfQTogu245TRXE=">AAAHg3icfVVdb9s2FFW7te60j6br417YxQaGTnbsdFmaFQEMpChaoMWy2UkDmF5GSVcWa1LSSKqxS+iv7X/sfa/bb9il7SyWk42AJOrynnt4Dy/JsBBcm273j1u3P/r4zt3GvU/8Tz/7/Iv7Ww++PNV5qSI4iXKRq7OQaRA8gxPDjYCzQgGToYC34fTIjb99D0rzPBuaeQFjySYZT3jEDJrOt86O1QjREBmiwZAmtTx4R6sm9p5RBBr6DPtHzYA03zXHpHlIaKJYZOEXe3rOq8pSXcpzOyWUZ+SoWpinVdX0z7e2u53uopHrnd6qs+2t2vH5g7sPaZxHpYTMRIJpPep1CzO2TBkeCah8WmooWDRlExhhN2MS9NguJKhICy0xSXKFT2bIwuqvQzCOYvNaFGtYWAqmZnVrmOdTHNGV79c5TfJ0bHlWlAayaEmZlIKYnDhlScwVyijmpM5r+PRDkPEInG4Bk1oykwYFd/MMzPRDe6JYkQaSTSECIa5My1k5uOChYmruUsgvdBBi5InKyyzWQcGMAZVpxBvFZ4FOWQE6SLgJIiYi9x87TCFyI5ma6v+K2pFgGA4ulBNg7LBMDPwMcWUVxI+edh+FAnnXPUwKEwWQVXbxcT4XKTew4ROKEirr3msefoukxhT6h50dA7OONhgbZlHKsgl0olzu/FaCdiWqd3rf7x3sHuxokBwLMsTCle0LbtK2S6LNs3aI9Q5q4fdkf3v58akTlOF+cPr4dCLykAmKv9TB+pDpUkE/zgUWQB93Q5THcEgVCDa7xOY4+XoRjYa9sXUL5wqgtsrHwwHLnLgKMrjABCTLYksTJrmYx5CwUhi3WZLLfr1IdOKqovJb62QaVxDiw27nIIgkR1IsC4EljwRmphMXop4kxqaZmblQ/SXY6scj3Gt742ozqeeAm0zBYC7DXLzAlOwyiq7sj29eVzZzFJJXVlaW43TpAMxNzmiINyHhCrLicIBBGeJymtIt6c0EmwyDF2+cJJcEw15NPhvOKqvFFYlzXqLtK/R0GjBRpKy6muqvrzZUjycCeJS2l9rfNIILrfF4qZ8P0oVZX2U54BOJTHRZVS6cpaG0dGmvrpWFfI0ndHwTYjVQ1Ske01nI1AiLj6ZhPrP0vXu3fJqqUgBJgU9Sg6fr/l5hSIsMUyAsMiUTBGE+neIJ0e3s7sGsRS5bizzH24VlEZAQzAXuX+dLkIzohYz+kqrlE7II0O52eiBbl+hBmitUh2cTkmcEi4oISPAS4TE4xFpe273q3yB4ATz53yBqkckiSuVUwGukt3lpXO+c7nZ6OL2fdrf7L1cXyj3vK+9r7xuv5+17fe+ld+ydeJH3u/en95f3d+NO49vGbuO7pevtWyvMQ6/WGof/AOdZoU0=</latexit><latexit sha1_base64="ZaJhcD7ScvxQtNfQTogu245TRXE=">AAAHg3icfVVdb9s2FFW7te60j6br417YxQaGTnbsdFmaFQEMpChaoMWy2UkDmF5GSVcWa1LSSKqxS+iv7X/sfa/bb9il7SyWk42AJOrynnt4Dy/JsBBcm273j1u3P/r4zt3GvU/8Tz/7/Iv7Ww++PNV5qSI4iXKRq7OQaRA8gxPDjYCzQgGToYC34fTIjb99D0rzPBuaeQFjySYZT3jEDJrOt86O1QjREBmiwZAmtTx4R6sm9p5RBBr6DPtHzYA03zXHpHlIaKJYZOEXe3rOq8pSXcpzOyWUZ+SoWpinVdX0z7e2u53uopHrnd6qs+2t2vH5g7sPaZxHpYTMRIJpPep1CzO2TBkeCah8WmooWDRlExhhN2MS9NguJKhICy0xSXKFT2bIwuqvQzCOYvNaFGtYWAqmZnVrmOdTHNGV79c5TfJ0bHlWlAayaEmZlIKYnDhlScwVyijmpM5r+PRDkPEInG4Bk1oykwYFd/MMzPRDe6JYkQaSTSECIa5My1k5uOChYmruUsgvdBBi5InKyyzWQcGMAZVpxBvFZ4FOWQE6SLgJIiYi9x87TCFyI5ma6v+K2pFgGA4ulBNg7LBMDPwMcWUVxI+edh+FAnnXPUwKEwWQVXbxcT4XKTew4ROKEirr3msefoukxhT6h50dA7OONhgbZlHKsgl0olzu/FaCdiWqd3rf7x3sHuxokBwLMsTCle0LbtK2S6LNs3aI9Q5q4fdkf3v58akTlOF+cPr4dCLykAmKv9TB+pDpUkE/zgUWQB93Q5THcEgVCDa7xOY4+XoRjYa9sXUL5wqgtsrHwwHLnLgKMrjABCTLYksTJrmYx5CwUhi3WZLLfr1IdOKqovJb62QaVxDiw27nIIgkR1IsC4EljwRmphMXop4kxqaZmblQ/SXY6scj3Gt742ozqeeAm0zBYC7DXLzAlOwyiq7sj29eVzZzFJJXVlaW43TpAMxNzmiINyHhCrLicIBBGeJymtIt6c0EmwyDF2+cJJcEw15NPhvOKqvFFYlzXqLtK/R0GjBRpKy6muqvrzZUjycCeJS2l9rfNIILrfF4qZ8P0oVZX2U54BOJTHRZVS6cpaG0dGmvrpWFfI0ndHwTYjVQ1Ske01nI1AiLj6ZhPrP0vXu3fJqqUgBJgU9Sg6fr/l5hSIsMUyAsMiUTBGE+neIJ0e3s7sGsRS5bizzH24VlEZAQzAXuX+dLkIzohYz+kqrlE7II0O52eiBbl+hBmitUh2cTkmcEi4oISPAS4TE4xFpe273q3yB4ATz53yBqkckiSuVUwGukt3lpXO+c7nZ6OL2fdrf7L1cXyj3vK+9r7xuv5+17fe+ld+ydeJH3u/en95f3d+NO49vGbuO7pevtWyvMQ6/WGof/AOdZoU0=</latexit><latexit sha1_base64="ZaJhcD7ScvxQtNfQTogu245TRXE=">AAAHg3icfVVdb9s2FFW7te60j6br417YxQaGTnbsdFmaFQEMpChaoMWy2UkDmF5GSVcWa1LSSKqxS+iv7X/sfa/bb9il7SyWk42AJOrynnt4Dy/JsBBcm273j1u3P/r4zt3GvU/8Tz/7/Iv7Ww++PNV5qSI4iXKRq7OQaRA8gxPDjYCzQgGToYC34fTIjb99D0rzPBuaeQFjySYZT3jEDJrOt86O1QjREBmiwZAmtTx4R6sm9p5RBBr6DPtHzYA03zXHpHlIaKJYZOEXe3rOq8pSXcpzOyWUZ+SoWpinVdX0z7e2u53uopHrnd6qs+2t2vH5g7sPaZxHpYTMRIJpPep1CzO2TBkeCah8WmooWDRlExhhN2MS9NguJKhICy0xSXKFT2bIwuqvQzCOYvNaFGtYWAqmZnVrmOdTHNGV79c5TfJ0bHlWlAayaEmZlIKYnDhlScwVyijmpM5r+PRDkPEInG4Bk1oykwYFd/MMzPRDe6JYkQaSTSECIa5My1k5uOChYmruUsgvdBBi5InKyyzWQcGMAZVpxBvFZ4FOWQE6SLgJIiYi9x87TCFyI5ma6v+K2pFgGA4ulBNg7LBMDPwMcWUVxI+edh+FAnnXPUwKEwWQVXbxcT4XKTew4ROKEirr3msefoukxhT6h50dA7OONhgbZlHKsgl0olzu/FaCdiWqd3rf7x3sHuxokBwLMsTCle0LbtK2S6LNs3aI9Q5q4fdkf3v58akTlOF+cPr4dCLykAmKv9TB+pDpUkE/zgUWQB93Q5THcEgVCDa7xOY4+XoRjYa9sXUL5wqgtsrHwwHLnLgKMrjABCTLYksTJrmYx5CwUhi3WZLLfr1IdOKqovJb62QaVxDiw27nIIgkR1IsC4EljwRmphMXop4kxqaZmblQ/SXY6scj3Gt742ozqeeAm0zBYC7DXLzAlOwyiq7sj29eVzZzFJJXVlaW43TpAMxNzmiINyHhCrLicIBBGeJymtIt6c0EmwyDF2+cJJcEw15NPhvOKqvFFYlzXqLtK/R0GjBRpKy6muqvrzZUjycCeJS2l9rfNIILrfF4qZ8P0oVZX2U54BOJTHRZVS6cpaG0dGmvrpWFfI0ndHwTYjVQ1Ske01nI1AiLj6ZhPrP0vXu3fJqqUgBJgU9Sg6fr/l5hSIsMUyAsMiUTBGE+neIJ0e3s7sGsRS5bizzH24VlEZAQzAXuX+dLkIzohYz+kqrlE7II0O52eiBbl+hBmitUh2cTkmcEi4oISPAS4TE4xFpe273q3yB4ATz53yBqkckiSuVUwGukt3lpXO+c7nZ6OL2fdrf7L1cXyj3vK+9r7xuv5+17fe+ld+ydeJH3u/en95f3d+NO49vGbuO7pevtWyvMQ6/WGof/AOdZoU0=</latexit>
Observation. Probability of selecting i, given j, is the same for all j.