SlideShare una empresa de Scribd logo
1 de 66
Descargar para leer sin conexión
1
Joint work with
Ravi Kumar & Andrew Tomkins (Google)
Rediet Abebe & Jon Kleinberg (Cornell)
Michael Schaub & Ali Jadbabaie (MIT)
Set prediction three ways
Austin R. Benson · Cornell
SCAN Seminar · September 10, 2018
Slides. bit.ly/arb-SCAN18
We usually think about predicting single-item events.
2
This talk looks at predicting sets from three perspectives.
3
Set-based data is common, but we don’t have a great understanding
of its complexities and the associated human behavior.
• Team formation (writing papers, organizational behavior).
• Multiple classification codes in hospital visits.
• Co-purchasing sets on Amazon.
• Sets of annotations on questions on web forums.
4
Set Prediction #1. Individuals repeating interactions.
Given a history of an individual’s set-based interactions, which ones repeat?
Who will repeat as my coauthors on my next paper?
Sequences of Sets. Benson, Kumar, & Tomkins. KDD, 2018.
Lots of data looks like sequences of sets.
5
EMAIL
Sequence of recipient sets in my email ⟶ one sequence of sets
Collection of email senders ⟶ sequences of sets.
Lots of data looks like sequences of sets.
6
Q&A
FORUM
TAGS
Our work provides a generative model that captures
the important characteristics of sequences of sets.
7
1. email data
sequence for each account
sets are recipients on emails sent by account
2. Stack Exchange tags
sequence for each user
sets are tags on questions asked by the user
3. Coauthorship
sequence for each academic
sets are coauthors on paper
4. Proximity contact
sequence for each person
sets are people interacting with the person
tags-mathoverflow
tags-math-sx
email-Enron-core
email-Eu-core
contact-prim-school
contact-high-school
coauth-Business
coauth-Geology
Our work provides a generative model that captures
the important characteristics of sequences of sets.
8
Applications.
1. Predicting new sets.
2. Understanding basic user behaviors.
3. Generative model ⟶ event likelihood ⟶ anomaly detection.
4. Generative model ⟶ simulation.
5. Amenable to analysis.
9
What are the important
characteristics of the data?
Most sets are not entirely novel &
many are exact repeats.
10
tags-mathoverflow
tags-math-sx
email-Enron-core
email-Eu-core
contact-prim-school
contact-high-school
coauth-Business
coauth-Geology
Subsets and supersets of prior sets are common.
11
tags-mathoverflow
tags-math-sx
email-Enron-core
email-Eu-core
contact-prim-school
contact-high-school
coauth-Business
coauth-Geology
There is recency bias in the repeat behavior.
12
Consistent with previous results on sequences of single items.
[Benson-Kumar-Tomkins 16; Anderson+ 14]
size-2 subset counts size-3 subset counts
Dataset data null model data null model
email-Enron-core 5.82 4.34 ± 0.043 4.23 2.67 ± 0.038
email-Eu-core 4.46 3.11 ± 0.008 3.23 2.08 ± 0.007
contact-prim-school 2.36 1.87 ± 0.003 1.35 1.09 ± 0.002
contact-high-school 4.49 3.26 ± 0.007 2.09 1.35 ± 0.004
tags-mathoverflow 1.49 1.41 ± 0.002 1.18 1.15 ± 0.002
tags-math-sx 1.49 1.31 ± 0.001 1.21 1.12 ± 0.001
coauth-Business 1.50 1.30 ± 0.001 1.40 1.24 ± 0.001
coauth-Geology 1.29 1.15 ± 0.000 1.15 1.07 ± 0.000
<latexit sha1_base64="PbRgN8ZetYi3/8RQh4MqDOE3dR8=">AAAHBXicdVXJjts2GFbS2E3UbdIceyE6bpAeZGjzjOcWpC3aYwp0kgCWMaBo2haGiyCSzUwFnXPuNX2G3ope+xx9hL5Ff1JepLFjwyD9bT9N/pTzkhVKh+G/9+5/9GAw/PjhI/+TTz/7/IuTx1++UtJUhF4SyWT1JseKskLQS11oRt+UFcU8Z/R1fv2d5V//SitVSPGLvi3pnOOVKJYFwRqgq8eDB5mgb4nkHItFnS2whjDdzKJ5nWl6o4WsOGb1adQ0fk9JRSVFs3PUlOOCBT9YNCCyogd6cyg2R5VECl1WBe/oLYSJDiwcKLKWkh1zrYvV+ojLwh9wcazX6qbj0XilAosGAB8RS9jMJZNvj1l23B1fbhScjlK9pWEDNV5smTuOFYWDW90eGn7cEI3vZzldFQKqw1E3M53P/QyEjIqVXsPZ4RyaQ9GyqeNSNx21YbhqaoZI+wZKy7IyjPpPUcYN0wUYDRd13NSkqVXxGw1ipEwO6YhII7TKyjUWWvIatgg9RR+0JX1bg7LMzwgvFrbcs+rbOg6SpgekwaTxv29/MyTbXw+DMIwhLheUHcWyDPnZJsQftZ05AslkPI1hSMdJikZZyUcoHIdp4qDYDvH47HzPJFNYHtjNyCnSMxiScRTtFeHUQRsvfNsz58iZt707corERkTjaadImDgombghvOgwMdpn2Ja1GXYdF23Rs141t4CLbdaeSduMbjuOnCptxWnUq2ihaNoOkx6zi1E3vYCkGxA5KG6HKO4yzr/t/DZhErYJ4UFC2jJx2mNcxOYqtAnxxeFSwy3kNvS8x9h+y6WGVnW9Aa2x2F2B3Te4Plcnp85gPYeTaDM59Tavl1cn/2ULSQynQhOGlZpFYannNa7gGkCenxm4ephc4xWdwVRgTtW8do/rBn0DyAItZQUfYS8HoF1HjblStzwHpTuAu5wFj3Ezo5fTeV2I0mgqSFtoaRjSEtlnP1oUFSWa3cIEk6qAtSKyxhU8I+Efolcll/IatkbBcwb2Jrq7E4eTV/E4CsfRz/Hp8xebXXrofeV97T3zIu/ce+795L30Lj0yuB78Png/+GP4bvjn8K/h3630/r2N54nXew3/+R80STIk</latexit><latexit sha1_base64="PbRgN8ZetYi3/8RQh4MqDOE3dR8=">AAAHBXicdVXJjts2GFbS2E3UbdIceyE6bpAeZGjzjOcWpC3aYwp0kgCWMaBo2haGiyCSzUwFnXPuNX2G3ope+xx9hL5Ff1JepLFjwyD9bT9N/pTzkhVKh+G/9+5/9GAw/PjhI/+TTz/7/IuTx1++UtJUhF4SyWT1JseKskLQS11oRt+UFcU8Z/R1fv2d5V//SitVSPGLvi3pnOOVKJYFwRqgq8eDB5mgb4nkHItFnS2whjDdzKJ5nWl6o4WsOGb1adQ0fk9JRSVFs3PUlOOCBT9YNCCyogd6cyg2R5VECl1WBe/oLYSJDiwcKLKWkh1zrYvV+ojLwh9wcazX6qbj0XilAosGAB8RS9jMJZNvj1l23B1fbhScjlK9pWEDNV5smTuOFYWDW90eGn7cEI3vZzldFQKqw1E3M53P/QyEjIqVXsPZ4RyaQ9GyqeNSNx21YbhqaoZI+wZKy7IyjPpPUcYN0wUYDRd13NSkqVXxGw1ipEwO6YhII7TKyjUWWvIatgg9RR+0JX1bg7LMzwgvFrbcs+rbOg6SpgekwaTxv29/MyTbXw+DMIwhLheUHcWyDPnZJsQftZ05AslkPI1hSMdJikZZyUcoHIdp4qDYDvH47HzPJFNYHtjNyCnSMxiScRTtFeHUQRsvfNsz58iZt707corERkTjaadImDgombghvOgwMdpn2Ja1GXYdF23Rs141t4CLbdaeSduMbjuOnCptxWnUq2ihaNoOkx6zi1E3vYCkGxA5KG6HKO4yzr/t/DZhErYJ4UFC2jJx2mNcxOYqtAnxxeFSwy3kNvS8x9h+y6WGVnW9Aa2x2F2B3Te4Plcnp85gPYeTaDM59Tavl1cn/2ULSQynQhOGlZpFYannNa7gGkCenxm4ephc4xWdwVRgTtW8do/rBn0DyAItZQUfYS8HoF1HjblStzwHpTuAu5wFj3Ezo5fTeV2I0mgqSFtoaRjSEtlnP1oUFSWa3cIEk6qAtSKyxhU8I+Efolcll/IatkbBcwb2Jrq7E4eTV/E4CsfRz/Hp8xebXXrofeV97T3zIu/ce+795L30Lj0yuB78Png/+GP4bvjn8K/h3630/r2N54nXew3/+R80STIk</latexit><latexit sha1_base64="PbRgN8ZetYi3/8RQh4MqDOE3dR8=">AAAHBXicdVXJjts2GFbS2E3UbdIceyE6bpAeZGjzjOcWpC3aYwp0kgCWMaBo2haGiyCSzUwFnXPuNX2G3ope+xx9hL5Ff1JepLFjwyD9bT9N/pTzkhVKh+G/9+5/9GAw/PjhI/+TTz/7/IuTx1++UtJUhF4SyWT1JseKskLQS11oRt+UFcU8Z/R1fv2d5V//SitVSPGLvi3pnOOVKJYFwRqgq8eDB5mgb4nkHItFnS2whjDdzKJ5nWl6o4WsOGb1adQ0fk9JRSVFs3PUlOOCBT9YNCCyogd6cyg2R5VECl1WBe/oLYSJDiwcKLKWkh1zrYvV+ojLwh9wcazX6qbj0XilAosGAB8RS9jMJZNvj1l23B1fbhScjlK9pWEDNV5smTuOFYWDW90eGn7cEI3vZzldFQKqw1E3M53P/QyEjIqVXsPZ4RyaQ9GyqeNSNx21YbhqaoZI+wZKy7IyjPpPUcYN0wUYDRd13NSkqVXxGw1ipEwO6YhII7TKyjUWWvIatgg9RR+0JX1bg7LMzwgvFrbcs+rbOg6SpgekwaTxv29/MyTbXw+DMIwhLheUHcWyDPnZJsQftZ05AslkPI1hSMdJikZZyUcoHIdp4qDYDvH47HzPJFNYHtjNyCnSMxiScRTtFeHUQRsvfNsz58iZt707corERkTjaadImDgombghvOgwMdpn2Ja1GXYdF23Rs141t4CLbdaeSduMbjuOnCptxWnUq2ihaNoOkx6zi1E3vYCkGxA5KG6HKO4yzr/t/DZhErYJ4UFC2jJx2mNcxOYqtAnxxeFSwy3kNvS8x9h+y6WGVnW9Aa2x2F2B3Te4Plcnp85gPYeTaDM59Tavl1cn/2ULSQynQhOGlZpFYannNa7gGkCenxm4ephc4xWdwVRgTtW8do/rBn0DyAItZQUfYS8HoF1HjblStzwHpTuAu5wFj3Ezo5fTeV2I0mgqSFtoaRjSEtlnP1oUFSWa3cIEk6qAtSKyxhU8I+Efolcll/IatkbBcwb2Jrq7E4eTV/E4CsfRz/Hp8xebXXrofeV97T3zIu/ce+795L30Lj0yuB78Png/+GP4bvjn8K/h3630/r2N54nXew3/+R80STIk</latexit><latexit sha1_base64="PbRgN8ZetYi3/8RQh4MqDOE3dR8=">AAAHBXicdVXJjts2GFbS2E3UbdIceyE6bpAeZGjzjOcWpC3aYwp0kgCWMaBo2haGiyCSzUwFnXPuNX2G3ope+xx9hL5Ff1JepLFjwyD9bT9N/pTzkhVKh+G/9+5/9GAw/PjhI/+TTz/7/IuTx1++UtJUhF4SyWT1JseKskLQS11oRt+UFcU8Z/R1fv2d5V//SitVSPGLvi3pnOOVKJYFwRqgq8eDB5mgb4nkHItFnS2whjDdzKJ5nWl6o4WsOGb1adQ0fk9JRSVFs3PUlOOCBT9YNCCyogd6cyg2R5VECl1WBe/oLYSJDiwcKLKWkh1zrYvV+ojLwh9wcazX6qbj0XilAosGAB8RS9jMJZNvj1l23B1fbhScjlK9pWEDNV5smTuOFYWDW90eGn7cEI3vZzldFQKqw1E3M53P/QyEjIqVXsPZ4RyaQ9GyqeNSNx21YbhqaoZI+wZKy7IyjPpPUcYN0wUYDRd13NSkqVXxGw1ipEwO6YhII7TKyjUWWvIatgg9RR+0JX1bg7LMzwgvFrbcs+rbOg6SpgekwaTxv29/MyTbXw+DMIwhLheUHcWyDPnZJsQftZ05AslkPI1hSMdJikZZyUcoHIdp4qDYDvH47HzPJFNYHtjNyCnSMxiScRTtFeHUQRsvfNsz58iZt707corERkTjaadImDgombghvOgwMdpn2Ja1GXYdF23Rs141t4CLbdaeSduMbjuOnCptxWnUq2ihaNoOkx6zi1E3vYCkGxA5KG6HKO4yzr/t/DZhErYJ4UFC2jJx2mNcxOYqtAnxxeFSwy3kNvS8x9h+y6WGVnW9Aa2x2F2B3Te4Plcnp85gPYeTaDM59Tavl1cn/2ULSQynQhOGlZpFYannNa7gGkCenxm4ephc4xWdwVRgTtW8do/rBn0DyAItZQUfYS8HoF1HjblStzwHpTuAu5wFj3Ezo5fTeV2I0mgqSFtoaRjSEtlnP1oUFSWa3cIEk6qAtSKyxhU8I+Efolcll/IatkbBcwb2Jrq7E4eTV/E4CsfRz/Hp8xebXXrofeV97T3zIu/ce+795L30Lj0yuB78Png/+GP4bvjn8K/h3630/r2N54nXew3/+R80STIk</latexit>
There is correlation in what gets repeated.
13
• For each sequence in each dataset, we count the number of
times each size-2 and size-3 subset appears.
• We then count the same statistics under a null model where
elements are randomly places into sets.
14
How do we model the next set in a
sequence given the history?
Our Correlated Repeat Unions (CRU) model captures
repeat behavior,recency bias,and correlations.
15
Setup.
Observe sequence of sets S1, …, Sk.
Given number r of repeated elements in Sk+1.
Model selects r elements from .
CRU model.
Start with , given r.
1. Sample set Sk-j from j steps back with recency weight wj.
2. Sample T by keeping each item x in Sk-j with correlation probability p.
3. .
4. Repeat steps 1—3 until .
(if T makes N too large, randomly drop elements from T)
[k
j=1Sj<latexit sha1_base64="JMq9QvYWP/n1zUVVfzVZ7XzazRU=">AAAHPnicfVVdb9s2FFW7zeu0r3R53Au71MBQ2I6VIksyIICBFcUKtFg2O22ByM0o6spiTVIaSTV2Cf2WvW7/Yn9jf2Bvw173uEvbWSwnGwFbFHnPObyXR2RSCm5sv//7rdvvvPte6/07H4QffvTxJ59u3f3suSkqzeCUFaLQLxNqQHAFp5ZbAS9LDVQmAl4k02/8/Is3oA0v1MjOSxhLOlE844xaHDrf2r4fs6o8d6+Po/qVm9bD89f3z7d2+r3+opHrnWjV2QlW7eT8bms7TgtWSVCWCWrMWdQv7dhRbTkTUIdxZaCkbEoncIZdRSWYsVusviZtHElJVmj8KUsWo+E6BHk0nTdYnKVJJaieNUeTopjijKnDsKlps8Ox46qsLCi2lMwqQWxBfFFIyjUwK+akqWv59G1HcQaZpqxDpZHU5p2S+3V27PRtd6JpmXcknQIDIa6GlqvycMETTfXcp1BcmE6CzBNdVCo1nZJaC1oZxFvNZx2T0xJMJ+O2w6hg/j31mFIUVlI9Nf/F2pNgKU4uKifAulGVWfgB0tppSO8d9u8lAnXXI2wOEw2gard4+JiLnFvYiElEBbXz/2sRYZvk1pbm691dC7OescgNM5ZTNYEeK+TuTxUY7y6zG321f7R3tGtAcjRhgp6T3Qtu865PostVN0Grgl7EPTzYWT7C2BeUopV9fcJ4IoqEihhfYw8bgDKVhkFaCDTAAI3MihSOYw2Czi6xBS6+aaKzUTR2fuO8ARq7fDIaUuWLq0HBBSYgqUpdnFHJxTyFjFbC1i422WW/aRKTeVfUYXtdzOAOQnrc7x11mOQoirYQaHkUsDOTeYpmksgdKzvzVIMl2JkHZ/it7Y/rzaQeAX5kGoZzmRTiMabkliymdt89e1o75SUkr52sHcflxkOwNwXjQLoJSVaQlYYHDKsEt9NWfktvFthUGD5+5ktyKTCKGuVzyax2RlyJ+OAl2j3BSF8DKsqc1ldL/fHJRtXTiQDO8u6y9jfN4EYbPF6a54P0NOu7LId8IlEpXrrK07k4kS5ejtfXbCGf4uGa3oRYTdRNiQfxLKH6DM0X50kxc/Eb/98O41xXAkgOfJJbPF0P9ktL2mSUA6HMVlQQhIXxFE+Ifm9vH2Ztctna5BFeDFQxIAnYC/x+fSxBMWIWZQyXUu2QkAVBt9+LQLYv0cO80FgdriakUARNRQRklhiegkes5bUT1f+S4AXw8H9J9CKTBUvtq4DXSLR5aVzvPN/rRbi87/d2BoerC+VO8HnwRfBlEAUHwSD4NjgJTgMWzIOfg1+CX1u/tf5o/dn6axl6+9YKsx00WuvvfwAkCY0R</latexit><latexit sha1_base64="JMq9QvYWP/n1zUVVfzVZ7XzazRU=">AAAHPnicfVVdb9s2FFW7zeu0r3R53Au71MBQ2I6VIksyIICBFcUKtFg2O22ByM0o6spiTVIaSTV2Cf2WvW7/Yn9jf2Bvw173uEvbWSwnGwFbFHnPObyXR2RSCm5sv//7rdvvvPte6/07H4QffvTxJ59u3f3suSkqzeCUFaLQLxNqQHAFp5ZbAS9LDVQmAl4k02/8/Is3oA0v1MjOSxhLOlE844xaHDrf2r4fs6o8d6+Po/qVm9bD89f3z7d2+r3+opHrnWjV2QlW7eT8bms7TgtWSVCWCWrMWdQv7dhRbTkTUIdxZaCkbEoncIZdRSWYsVusviZtHElJVmj8KUsWo+E6BHk0nTdYnKVJJaieNUeTopjijKnDsKlps8Ox46qsLCi2lMwqQWxBfFFIyjUwK+akqWv59G1HcQaZpqxDpZHU5p2S+3V27PRtd6JpmXcknQIDIa6GlqvycMETTfXcp1BcmE6CzBNdVCo1nZJaC1oZxFvNZx2T0xJMJ+O2w6hg/j31mFIUVlI9Nf/F2pNgKU4uKifAulGVWfgB0tppSO8d9u8lAnXXI2wOEw2gard4+JiLnFvYiElEBbXz/2sRYZvk1pbm691dC7OescgNM5ZTNYEeK+TuTxUY7y6zG321f7R3tGtAcjRhgp6T3Qtu865PostVN0Grgl7EPTzYWT7C2BeUopV9fcJ4IoqEihhfYw8bgDKVhkFaCDTAAI3MihSOYw2Czi6xBS6+aaKzUTR2fuO8ARq7fDIaUuWLq0HBBSYgqUpdnFHJxTyFjFbC1i422WW/aRKTeVfUYXtdzOAOQnrc7x11mOQoirYQaHkUsDOTeYpmksgdKzvzVIMl2JkHZ/it7Y/rzaQeAX5kGoZzmRTiMabkliymdt89e1o75SUkr52sHcflxkOwNwXjQLoJSVaQlYYHDKsEt9NWfktvFthUGD5+5ktyKTCKGuVzyax2RlyJ+OAl2j3BSF8DKsqc1ldL/fHJRtXTiQDO8u6y9jfN4EYbPF6a54P0NOu7LId8IlEpXrrK07k4kS5ejtfXbCGf4uGa3oRYTdRNiQfxLKH6DM0X50kxc/Eb/98O41xXAkgOfJJbPF0P9ktL2mSUA6HMVlQQhIXxFE+Ifm9vH2Ztctna5BFeDFQxIAnYC/x+fSxBMWIWZQyXUu2QkAVBt9+LQLYv0cO80FgdriakUARNRQRklhiegkes5bUT1f+S4AXw8H9J9CKTBUvtq4DXSLR5aVzvPN/rRbi87/d2BoerC+VO8HnwRfBlEAUHwSD4NjgJTgMWzIOfg1+CX1u/tf5o/dn6axl6+9YKsx00WuvvfwAkCY0R</latexit><latexit sha1_base64="JMq9QvYWP/n1zUVVfzVZ7XzazRU=">AAAHPnicfVVdb9s2FFW7zeu0r3R53Au71MBQ2I6VIksyIICBFcUKtFg2O22ByM0o6spiTVIaSTV2Cf2WvW7/Yn9jf2Bvw173uEvbWSwnGwFbFHnPObyXR2RSCm5sv//7rdvvvPte6/07H4QffvTxJ59u3f3suSkqzeCUFaLQLxNqQHAFp5ZbAS9LDVQmAl4k02/8/Is3oA0v1MjOSxhLOlE844xaHDrf2r4fs6o8d6+Po/qVm9bD89f3z7d2+r3+opHrnWjV2QlW7eT8bms7TgtWSVCWCWrMWdQv7dhRbTkTUIdxZaCkbEoncIZdRSWYsVusviZtHElJVmj8KUsWo+E6BHk0nTdYnKVJJaieNUeTopjijKnDsKlps8Ox46qsLCi2lMwqQWxBfFFIyjUwK+akqWv59G1HcQaZpqxDpZHU5p2S+3V27PRtd6JpmXcknQIDIa6GlqvycMETTfXcp1BcmE6CzBNdVCo1nZJaC1oZxFvNZx2T0xJMJ+O2w6hg/j31mFIUVlI9Nf/F2pNgKU4uKifAulGVWfgB0tppSO8d9u8lAnXXI2wOEw2gard4+JiLnFvYiElEBbXz/2sRYZvk1pbm691dC7OescgNM5ZTNYEeK+TuTxUY7y6zG321f7R3tGtAcjRhgp6T3Qtu865PostVN0Grgl7EPTzYWT7C2BeUopV9fcJ4IoqEihhfYw8bgDKVhkFaCDTAAI3MihSOYw2Czi6xBS6+aaKzUTR2fuO8ARq7fDIaUuWLq0HBBSYgqUpdnFHJxTyFjFbC1i422WW/aRKTeVfUYXtdzOAOQnrc7x11mOQoirYQaHkUsDOTeYpmksgdKzvzVIMl2JkHZ/it7Y/rzaQeAX5kGoZzmRTiMabkliymdt89e1o75SUkr52sHcflxkOwNwXjQLoJSVaQlYYHDKsEt9NWfktvFthUGD5+5ktyKTCKGuVzyax2RlyJ+OAl2j3BSF8DKsqc1ldL/fHJRtXTiQDO8u6y9jfN4EYbPF6a54P0NOu7LId8IlEpXrrK07k4kS5ejtfXbCGf4uGa3oRYTdRNiQfxLKH6DM0X50kxc/Eb/98O41xXAkgOfJJbPF0P9ktL2mSUA6HMVlQQhIXxFE+Ifm9vH2Ztctna5BFeDFQxIAnYC/x+fSxBMWIWZQyXUu2QkAVBt9+LQLYv0cO80FgdriakUARNRQRklhiegkes5bUT1f+S4AXw8H9J9CKTBUvtq4DXSLR5aVzvPN/rRbi87/d2BoerC+VO8HnwRfBlEAUHwSD4NjgJTgMWzIOfg1+CX1u/tf5o/dn6axl6+9YKsx00WuvvfwAkCY0R</latexit><latexit sha1_base64="JMq9QvYWP/n1zUVVfzVZ7XzazRU=">AAAHPnicfVVdb9s2FFW7zeu0r3R53Au71MBQ2I6VIksyIICBFcUKtFg2O22ByM0o6spiTVIaSTV2Cf2WvW7/Yn9jf2Bvw173uEvbWSwnGwFbFHnPObyXR2RSCm5sv//7rdvvvPte6/07H4QffvTxJ59u3f3suSkqzeCUFaLQLxNqQHAFp5ZbAS9LDVQmAl4k02/8/Is3oA0v1MjOSxhLOlE844xaHDrf2r4fs6o8d6+Po/qVm9bD89f3z7d2+r3+opHrnWjV2QlW7eT8bms7TgtWSVCWCWrMWdQv7dhRbTkTUIdxZaCkbEoncIZdRSWYsVusviZtHElJVmj8KUsWo+E6BHk0nTdYnKVJJaieNUeTopjijKnDsKlps8Ox46qsLCi2lMwqQWxBfFFIyjUwK+akqWv59G1HcQaZpqxDpZHU5p2S+3V27PRtd6JpmXcknQIDIa6GlqvycMETTfXcp1BcmE6CzBNdVCo1nZJaC1oZxFvNZx2T0xJMJ+O2w6hg/j31mFIUVlI9Nf/F2pNgKU4uKifAulGVWfgB0tppSO8d9u8lAnXXI2wOEw2gard4+JiLnFvYiElEBbXz/2sRYZvk1pbm691dC7OescgNM5ZTNYEeK+TuTxUY7y6zG321f7R3tGtAcjRhgp6T3Qtu865PostVN0Grgl7EPTzYWT7C2BeUopV9fcJ4IoqEihhfYw8bgDKVhkFaCDTAAI3MihSOYw2Czi6xBS6+aaKzUTR2fuO8ARq7fDIaUuWLq0HBBSYgqUpdnFHJxTyFjFbC1i422WW/aRKTeVfUYXtdzOAOQnrc7x11mOQoirYQaHkUsDOTeYpmksgdKzvzVIMl2JkHZ/it7Y/rzaQeAX5kGoZzmRTiMabkliymdt89e1o75SUkr52sHcflxkOwNwXjQLoJSVaQlYYHDKsEt9NWfktvFthUGD5+5ktyKTCKGuVzyax2RlyJ+OAl2j3BSF8DKsqc1ldL/fHJRtXTiQDO8u6y9jfN4EYbPF6a54P0NOu7LId8IlEpXrrK07k4kS5ejtfXbCGf4uGa3oRYTdRNiQfxLKH6DM0X50kxc/Eb/98O41xXAkgOfJJbPF0P9ktL2mSUA6HMVlQQhIXxFE+Ifm9vH2Ztctna5BFeDFQxIAnYC/x+fSxBMWIWZQyXUu2QkAVBt9+LQLYv0cO80FgdriakUARNRQRklhiegkes5bUT1f+S4AXw8H9J9CKTBUvtq4DXSLR5aVzvPN/rRbi87/d2BoerC+VO8HnwRfBlEAUHwSD4NjgJTgMWzIOfg1+CX1u/tf5o/dn6axl6+9YKsx00WuvvfwAkCY0R</latexit>
N = ;<latexit sha1_base64="cCQugb7Mu1I9KkNyw7/c0OFwvuY=">AAAHOnicfVVdb9s2FFW7zeu0j6br417YpQaGwnbsFFmaAQGMrShWoN2y2WkLWEZKSVcSYZLSSKqRS+iX7HX7F/sje93bsNf9gF1azmI52QjYosh7zuG9PCLDgjNthsPfb9x85933Ou/f+sD/8KOPP7m9c+fTFzovVQSnUc5z9SqkGjiTcGqY4fCqUEBFyOFluPjGzb98A0qzXE7NsoC5oKlkCYuowaGzndv3vyPHJABRmKUGc/9sZ3c4GK4audoZrTu73rqdnN3p3A3iPCoFSBNxqvVsNCzM3FJlWMSh9oNSQ0GjBU1hhl1JBei5Xa28Jl0ciUmSK/xJQ1aj/iYEeRRdtlisoWHJqarao2GeL3BG177f1jTJo7llsigNyKiRTEpOTE5cQUjMFESGL0lb17DF255kESSKRj0qtKAm6xXMrbNnFm/7qaJF1hN0ARFwfjnUrMrBOQsVVUuXQn6ueyEypyovZax7BTUGlNSIN4pVPZ3RAnQvYaYXUR6599hhCp4bQdVC/xfrQIChOLmqHAdjp2Vi4EeIa6sgvvdoeC/kqLsZYTJIFYCs7erhYs4zZmArJuQl1Nb9b0T4XZIZU+iv9vYMVANtkBuqKKMyhUGUi72fStDOWXpv9OXB0f7RngbB0IAh+k30z5nJ+i6JPpP9EG0KahX38HC3efiBKyhFG7v6+EHK85DyAF8DBxuD1KWCcZxzNMAYTRzlMRwHCjitLrA5Lr5totl0NLdu45wBWrt8Mp1Q6YqrQMI5JiCojG2QUMH4MoaEltzUNtDJRb9tEp04V9R+d1NM4w5CfDwcHPUiwVAUbcHR8ihgKp04inaSyB1IUzmqcQO2+sEMv7WDeb2d1GPAj0zBZCnCnD/BlGzDomv7/fNntZVOQrDaitoyXG4wAXNdMA7E25BwDVlrOMCkDHE7Tem29HqBbYXJk+euJBcC01GrfDasaqv5pYgLbtD2KUa6GlBeZLS+XOrrp1tVj1MOLMr6Te2vm8GN1ni8tM8H4Wg2d1lMWCpQKWhc5ehsEAobNOP1FVuIZ3iwxtch1hN1W+JBUIVUzdB8QRbmlQ3euP+uH2Sq5EAyYGlm8HQ9PCgM6ZJpBoRGpqScIMwPFnhCDAf7B1B1yUXrksd4KVAZAQnBnOP362IJihG9KqPfSHV9QlYE/eFgBKJ7gZ5kucLqMJmSXBI0FeGQGKJZDA6xkdfuqP6XBC+Ah/9LolaZrFhqVwW8Rkbbl8bVzov9wQiX98P+7vjr9YVyy/vM+9z7wht5h97Y+9Y78U69yCu9n71fvF87v3X+6PzZ+asJvXljjbnrtVrn738AcTqK5Q==</latexit><latexit sha1_base64="cCQugb7Mu1I9KkNyw7/c0OFwvuY=">AAAHOnicfVVdb9s2FFW7zeu0j6br417YpQaGwnbsFFmaAQGMrShWoN2y2WkLWEZKSVcSYZLSSKqRS+iX7HX7F/sje93bsNf9gF1azmI52QjYosh7zuG9PCLDgjNthsPfb9x85933Ou/f+sD/8KOPP7m9c+fTFzovVQSnUc5z9SqkGjiTcGqY4fCqUEBFyOFluPjGzb98A0qzXE7NsoC5oKlkCYuowaGzndv3vyPHJABRmKUGc/9sZ3c4GK4audoZrTu73rqdnN3p3A3iPCoFSBNxqvVsNCzM3FJlWMSh9oNSQ0GjBU1hhl1JBei5Xa28Jl0ciUmSK/xJQ1aj/iYEeRRdtlisoWHJqarao2GeL3BG177f1jTJo7llsigNyKiRTEpOTE5cQUjMFESGL0lb17DF255kESSKRj0qtKAm6xXMrbNnFm/7qaJF1hN0ARFwfjnUrMrBOQsVVUuXQn6ueyEypyovZax7BTUGlNSIN4pVPZ3RAnQvYaYXUR6599hhCp4bQdVC/xfrQIChOLmqHAdjp2Vi4EeIa6sgvvdoeC/kqLsZYTJIFYCs7erhYs4zZmArJuQl1Nb9b0T4XZIZU+iv9vYMVANtkBuqKKMyhUGUi72fStDOWXpv9OXB0f7RngbB0IAh+k30z5nJ+i6JPpP9EG0KahX38HC3efiBKyhFG7v6+EHK85DyAF8DBxuD1KWCcZxzNMAYTRzlMRwHCjitLrA5Lr5totl0NLdu45wBWrt8Mp1Q6YqrQMI5JiCojG2QUMH4MoaEltzUNtDJRb9tEp04V9R+d1NM4w5CfDwcHPUiwVAUbcHR8ihgKp04inaSyB1IUzmqcQO2+sEMv7WDeb2d1GPAj0zBZCnCnD/BlGzDomv7/fNntZVOQrDaitoyXG4wAXNdMA7E25BwDVlrOMCkDHE7Tem29HqBbYXJk+euJBcC01GrfDasaqv5pYgLbtD2KUa6GlBeZLS+XOrrp1tVj1MOLMr6Te2vm8GN1ni8tM8H4Wg2d1lMWCpQKWhc5ehsEAobNOP1FVuIZ3iwxtch1hN1W+JBUIVUzdB8QRbmlQ3euP+uH2Sq5EAyYGlm8HQ9PCgM6ZJpBoRGpqScIMwPFnhCDAf7B1B1yUXrksd4KVAZAQnBnOP362IJihG9KqPfSHV9QlYE/eFgBKJ7gZ5kucLqMJmSXBI0FeGQGKJZDA6xkdfuqP6XBC+Ah/9LolaZrFhqVwW8Rkbbl8bVzov9wQiX98P+7vjr9YVyy/vM+9z7wht5h97Y+9Y78U69yCu9n71fvF87v3X+6PzZ+asJvXljjbnrtVrn738AcTqK5Q==</latexit><latexit sha1_base64="cCQugb7Mu1I9KkNyw7/c0OFwvuY=">AAAHOnicfVVdb9s2FFW7zeu0j6br417YpQaGwnbsFFmaAQGMrShWoN2y2WkLWEZKSVcSYZLSSKqRS+iX7HX7F/sje93bsNf9gF1azmI52QjYosh7zuG9PCLDgjNthsPfb9x85933Ou/f+sD/8KOPP7m9c+fTFzovVQSnUc5z9SqkGjiTcGqY4fCqUEBFyOFluPjGzb98A0qzXE7NsoC5oKlkCYuowaGzndv3vyPHJABRmKUGc/9sZ3c4GK4audoZrTu73rqdnN3p3A3iPCoFSBNxqvVsNCzM3FJlWMSh9oNSQ0GjBU1hhl1JBei5Xa28Jl0ciUmSK/xJQ1aj/iYEeRRdtlisoWHJqarao2GeL3BG177f1jTJo7llsigNyKiRTEpOTE5cQUjMFESGL0lb17DF255kESSKRj0qtKAm6xXMrbNnFm/7qaJF1hN0ARFwfjnUrMrBOQsVVUuXQn6ueyEypyovZax7BTUGlNSIN4pVPZ3RAnQvYaYXUR6599hhCp4bQdVC/xfrQIChOLmqHAdjp2Vi4EeIa6sgvvdoeC/kqLsZYTJIFYCs7erhYs4zZmArJuQl1Nb9b0T4XZIZU+iv9vYMVANtkBuqKKMyhUGUi72fStDOWXpv9OXB0f7RngbB0IAh+k30z5nJ+i6JPpP9EG0KahX38HC3efiBKyhFG7v6+EHK85DyAF8DBxuD1KWCcZxzNMAYTRzlMRwHCjitLrA5Lr5totl0NLdu45wBWrt8Mp1Q6YqrQMI5JiCojG2QUMH4MoaEltzUNtDJRb9tEp04V9R+d1NM4w5CfDwcHPUiwVAUbcHR8ihgKp04inaSyB1IUzmqcQO2+sEMv7WDeb2d1GPAj0zBZCnCnD/BlGzDomv7/fNntZVOQrDaitoyXG4wAXNdMA7E25BwDVlrOMCkDHE7Tem29HqBbYXJk+euJBcC01GrfDasaqv5pYgLbtD2KUa6GlBeZLS+XOrrp1tVj1MOLMr6Te2vm8GN1ni8tM8H4Wg2d1lMWCpQKWhc5ehsEAobNOP1FVuIZ3iwxtch1hN1W+JBUIVUzdB8QRbmlQ3euP+uH2Sq5EAyYGlm8HQ9PCgM6ZJpBoRGpqScIMwPFnhCDAf7B1B1yUXrksd4KVAZAQnBnOP362IJihG9KqPfSHV9QlYE/eFgBKJ7gZ5kucLqMJmSXBI0FeGQGKJZDA6xkdfuqP6XBC+Ah/9LolaZrFhqVwW8Rkbbl8bVzov9wQiX98P+7vjr9YVyy/vM+9z7wht5h97Y+9Y78U69yCu9n71fvF87v3X+6PzZ+asJvXljjbnrtVrn738AcTqK5Q==</latexit><latexit sha1_base64="cCQugb7Mu1I9KkNyw7/c0OFwvuY=">AAAHOnicfVVdb9s2FFW7zeu0j6br417YpQaGwnbsFFmaAQGMrShWoN2y2WkLWEZKSVcSYZLSSKqRS+iX7HX7F/sje93bsNf9gF1azmI52QjYosh7zuG9PCLDgjNthsPfb9x85933Ou/f+sD/8KOPP7m9c+fTFzovVQSnUc5z9SqkGjiTcGqY4fCqUEBFyOFluPjGzb98A0qzXE7NsoC5oKlkCYuowaGzndv3vyPHJABRmKUGc/9sZ3c4GK4audoZrTu73rqdnN3p3A3iPCoFSBNxqvVsNCzM3FJlWMSh9oNSQ0GjBU1hhl1JBei5Xa28Jl0ciUmSK/xJQ1aj/iYEeRRdtlisoWHJqarao2GeL3BG177f1jTJo7llsigNyKiRTEpOTE5cQUjMFESGL0lb17DF255kESSKRj0qtKAm6xXMrbNnFm/7qaJF1hN0ARFwfjnUrMrBOQsVVUuXQn6ueyEypyovZax7BTUGlNSIN4pVPZ3RAnQvYaYXUR6599hhCp4bQdVC/xfrQIChOLmqHAdjp2Vi4EeIa6sgvvdoeC/kqLsZYTJIFYCs7erhYs4zZmArJuQl1Nb9b0T4XZIZU+iv9vYMVANtkBuqKKMyhUGUi72fStDOWXpv9OXB0f7RngbB0IAh+k30z5nJ+i6JPpP9EG0KahX38HC3efiBKyhFG7v6+EHK85DyAF8DBxuD1KWCcZxzNMAYTRzlMRwHCjitLrA5Lr5totl0NLdu45wBWrt8Mp1Q6YqrQMI5JiCojG2QUMH4MoaEltzUNtDJRb9tEp04V9R+d1NM4w5CfDwcHPUiwVAUbcHR8ihgKp04inaSyB1IUzmqcQO2+sEMv7WDeb2d1GPAj0zBZCnCnD/BlGzDomv7/fNntZVOQrDaitoyXG4wAXNdMA7E25BwDVlrOMCkDHE7Tem29HqBbYXJk+euJBcC01GrfDasaqv5pYgLbtD2KUa6GlBeZLS+XOrrp1tVj1MOLMr6Te2vm8GN1ni8tM8H4Wg2d1lMWCpQKWhc5ehsEAobNOP1FVuIZ3iwxtch1hN1W+JBUIVUzdB8QRbmlQ3euP+uH2Sq5EAyYGlm8HQ9PCgM6ZJpBoRGpqScIMwPFnhCDAf7B1B1yUXrksd4KVAZAQnBnOP362IJihG9KqPfSHV9QlYE/eFgBKJ7gZ5kucLqMJmSXBI0FeGQGKJZDA6xkdfuqP6XBC+Ah/9LolaZrFhqVwW8Rkbbl8bVzov9wQiX98P+7vjr9YVyy/vM+9z7wht5h97Y+9Y78U69yCu9n71fvF87v3X+6PzZ+asJvXljjbnrtVrn738AcTqK5Q==</latexit>
N = N [ T<latexit sha1_base64="+8IXgngcg4Tx80sHc3gtOzbENVM=">AAAHN3icfVVdjxs1FJ0WCGX4aukjLy7bSKhKsslWy3aRVoqgqqjUloVk20o7oXg8d2as2J7B9nQnteZ/8Ar/gp/CE2+IV/4B10mWzWQXLCXjse85x/f6jB2Xghs7HP5+7fpbb7/TeffGe+H7H3z40cc3b33y3BSVZnDCClHolzE1ILiCE8utgJelBipjAS/i+dd+/sVr0IYXamoXJcwkzRRPOaMWh364+4wckWckYlVJpndf3dwZDobLRi53RuvOTrBux69udW5HScEqCcoyQY05HQ1LO3NUW84ENGFUGSgpm9MMTrGrqAQzc8tlN6SLIwlJC40/ZclyNNyEII+mixaLszSuBNV1ezQuijnOmCYM25o2fTBzXJWVBcVWkmkliC2IrwZJuAZmxYK0dS2fv+kpziDVlPWoNJLavFdyv86enb/pZ5qWeU/SOTAQ4mJotSoPFzzWVC98CsWZ6cXInOmiUonpldRa0Mog3mpe90xOSzC9lNseo4L598RjSlFYSfXc/BfrQIKlOLmsnADrplVq4XtIGqchufNgeCcWqLsZYXPINIBq3PLhY85ybmErJhYVNM7/b0SEXZJbW5ovd3ct1ANjkRtqllOVwYAVcvenCoy3ldkdfbF/uHe4a0BydF+MZpP9M27zvk+iz1U/Ro+CXsbdP9hZPcLIF5Sih319wigTRUxFhK+Rh41BmUrDOCkEGmCMDmZFAkeRBkHrc2yBi2+b6HQ6mjm/cd4ArV0+nk6o8sXVoOAME5BUJS5KqeRikUBKK2EbF5n0vN82iUm9K5qwuylmcAchORoODntMchRFWwi0PArY2qSeop0kckfK1p5qvAI7c+8Uv7X9WbOd1EPAj0zDZCHjQjzClNyKxTTu26dPGqe8hOSNk43juNxoAvaqYBxItiHxGrLW8IBJFeN22spv6dUC2wqTR099Sc4FpqNW+VxcN86ICxEfvEK7xxjpa0BFmdPmYqk/Pt6qepIJ4Czvr2p/1QxutMHjpX0+SE+zuctywjOJStHKVZ7ORbF00Wq8uWQL+QRP1eQqxHqiaUvci+qY6lM0X5THRe2i1/6/G0a5rgSQHHiWWzxdD/ZLS7pkmgOhzFZUEISF0RxPiOFgbx/qLjlvXfIQbwSqGJAY7Bl+vz6WoBgxyzKGK6luSMiSoD8cjEB2z9GTvNBYHa4yUiiCpiICUksMT8AjNvLaGTX/kuAFcP9/SfQykyVL46uA18ho+9K43Hm+Nxjh8r7b2xl/tb5QbgSfBp8Fnwej4CAYB98Ex8FJwAId/Bz8Evza+a3zR+fPzl+r0OvX1pjbQat1/v4HOH2JWQ==</latexit><latexit sha1_base64="+8IXgngcg4Tx80sHc3gtOzbENVM=">AAAHN3icfVVdjxs1FJ0WCGX4aukjLy7bSKhKsslWy3aRVoqgqqjUloVk20o7oXg8d2as2J7B9nQnteZ/8Ar/gp/CE2+IV/4B10mWzWQXLCXjse85x/f6jB2Xghs7HP5+7fpbb7/TeffGe+H7H3z40cc3b33y3BSVZnDCClHolzE1ILiCE8utgJelBipjAS/i+dd+/sVr0IYXamoXJcwkzRRPOaMWh364+4wckWckYlVJpndf3dwZDobLRi53RuvOTrBux69udW5HScEqCcoyQY05HQ1LO3NUW84ENGFUGSgpm9MMTrGrqAQzc8tlN6SLIwlJC40/ZclyNNyEII+mixaLszSuBNV1ezQuijnOmCYM25o2fTBzXJWVBcVWkmkliC2IrwZJuAZmxYK0dS2fv+kpziDVlPWoNJLavFdyv86enb/pZ5qWeU/SOTAQ4mJotSoPFzzWVC98CsWZ6cXInOmiUonpldRa0Mog3mpe90xOSzC9lNseo4L598RjSlFYSfXc/BfrQIKlOLmsnADrplVq4XtIGqchufNgeCcWqLsZYXPINIBq3PLhY85ybmErJhYVNM7/b0SEXZJbW5ovd3ct1ANjkRtqllOVwYAVcvenCoy3ldkdfbF/uHe4a0BydF+MZpP9M27zvk+iz1U/Ro+CXsbdP9hZPcLIF5Sih319wigTRUxFhK+Rh41BmUrDOCkEGmCMDmZFAkeRBkHrc2yBi2+b6HQ6mjm/cd4ArV0+nk6o8sXVoOAME5BUJS5KqeRikUBKK2EbF5n0vN82iUm9K5qwuylmcAchORoODntMchRFWwi0PArY2qSeop0kckfK1p5qvAI7c+8Uv7X9WbOd1EPAj0zDZCHjQjzClNyKxTTu26dPGqe8hOSNk43juNxoAvaqYBxItiHxGrLW8IBJFeN22spv6dUC2wqTR099Sc4FpqNW+VxcN86ICxEfvEK7xxjpa0BFmdPmYqk/Pt6qepIJ4Czvr2p/1QxutMHjpX0+SE+zuctywjOJStHKVZ7ORbF00Wq8uWQL+QRP1eQqxHqiaUvci+qY6lM0X5THRe2i1/6/G0a5rgSQHHiWWzxdD/ZLS7pkmgOhzFZUEISF0RxPiOFgbx/qLjlvXfIQbwSqGJAY7Bl+vz6WoBgxyzKGK6luSMiSoD8cjEB2z9GTvNBYHa4yUiiCpiICUksMT8AjNvLaGTX/kuAFcP9/SfQykyVL46uA18ho+9K43Hm+Nxjh8r7b2xl/tb5QbgSfBp8Fnwej4CAYB98Ex8FJwAId/Bz8Evza+a3zR+fPzl+r0OvX1pjbQat1/v4HOH2JWQ==</latexit><latexit sha1_base64="+8IXgngcg4Tx80sHc3gtOzbENVM=">AAAHN3icfVVdjxs1FJ0WCGX4aukjLy7bSKhKsslWy3aRVoqgqqjUloVk20o7oXg8d2as2J7B9nQnteZ/8Ar/gp/CE2+IV/4B10mWzWQXLCXjse85x/f6jB2Xghs7HP5+7fpbb7/TeffGe+H7H3z40cc3b33y3BSVZnDCClHolzE1ILiCE8utgJelBipjAS/i+dd+/sVr0IYXamoXJcwkzRRPOaMWh364+4wckWckYlVJpndf3dwZDobLRi53RuvOTrBux69udW5HScEqCcoyQY05HQ1LO3NUW84ENGFUGSgpm9MMTrGrqAQzc8tlN6SLIwlJC40/ZclyNNyEII+mixaLszSuBNV1ezQuijnOmCYM25o2fTBzXJWVBcVWkmkliC2IrwZJuAZmxYK0dS2fv+kpziDVlPWoNJLavFdyv86enb/pZ5qWeU/SOTAQ4mJotSoPFzzWVC98CsWZ6cXInOmiUonpldRa0Mog3mpe90xOSzC9lNseo4L598RjSlFYSfXc/BfrQIKlOLmsnADrplVq4XtIGqchufNgeCcWqLsZYXPINIBq3PLhY85ybmErJhYVNM7/b0SEXZJbW5ovd3ct1ANjkRtqllOVwYAVcvenCoy3ldkdfbF/uHe4a0BydF+MZpP9M27zvk+iz1U/Ro+CXsbdP9hZPcLIF5Sih319wigTRUxFhK+Rh41BmUrDOCkEGmCMDmZFAkeRBkHrc2yBi2+b6HQ6mjm/cd4ArV0+nk6o8sXVoOAME5BUJS5KqeRikUBKK2EbF5n0vN82iUm9K5qwuylmcAchORoODntMchRFWwi0PArY2qSeop0kckfK1p5qvAI7c+8Uv7X9WbOd1EPAj0zDZCHjQjzClNyKxTTu26dPGqe8hOSNk43juNxoAvaqYBxItiHxGrLW8IBJFeN22spv6dUC2wqTR099Sc4FpqNW+VxcN86ICxEfvEK7xxjpa0BFmdPmYqk/Pt6qepIJ4Czvr2p/1QxutMHjpX0+SE+zuctywjOJStHKVZ7ORbF00Wq8uWQL+QRP1eQqxHqiaUvci+qY6lM0X5THRe2i1/6/G0a5rgSQHHiWWzxdD/ZLS7pkmgOhzFZUEISF0RxPiOFgbx/qLjlvXfIQbwSqGJAY7Bl+vz6WoBgxyzKGK6luSMiSoD8cjEB2z9GTvNBYHa4yUiiCpiICUksMT8AjNvLaGTX/kuAFcP9/SfQykyVL46uA18ho+9K43Hm+Nxjh8r7b2xl/tb5QbgSfBp8Fnwej4CAYB98Ex8FJwAId/Bz8Evza+a3zR+fPzl+r0OvX1pjbQat1/v4HOH2JWQ==</latexit><latexit sha1_base64="+8IXgngcg4Tx80sHc3gtOzbENVM=">AAAHN3icfVVdjxs1FJ0WCGX4aukjLy7bSKhKsslWy3aRVoqgqqjUloVk20o7oXg8d2as2J7B9nQnteZ/8Ar/gp/CE2+IV/4B10mWzWQXLCXjse85x/f6jB2Xghs7HP5+7fpbb7/TeffGe+H7H3z40cc3b33y3BSVZnDCClHolzE1ILiCE8utgJelBipjAS/i+dd+/sVr0IYXamoXJcwkzRRPOaMWh364+4wckWckYlVJpndf3dwZDobLRi53RuvOTrBux69udW5HScEqCcoyQY05HQ1LO3NUW84ENGFUGSgpm9MMTrGrqAQzc8tlN6SLIwlJC40/ZclyNNyEII+mixaLszSuBNV1ezQuijnOmCYM25o2fTBzXJWVBcVWkmkliC2IrwZJuAZmxYK0dS2fv+kpziDVlPWoNJLavFdyv86enb/pZ5qWeU/SOTAQ4mJotSoPFzzWVC98CsWZ6cXInOmiUonpldRa0Mog3mpe90xOSzC9lNseo4L598RjSlFYSfXc/BfrQIKlOLmsnADrplVq4XtIGqchufNgeCcWqLsZYXPINIBq3PLhY85ybmErJhYVNM7/b0SEXZJbW5ovd3ct1ANjkRtqllOVwYAVcvenCoy3ldkdfbF/uHe4a0BydF+MZpP9M27zvk+iz1U/Ro+CXsbdP9hZPcLIF5Sih319wigTRUxFhK+Rh41BmUrDOCkEGmCMDmZFAkeRBkHrc2yBi2+b6HQ6mjm/cd4ArV0+nk6o8sXVoOAME5BUJS5KqeRikUBKK2EbF5n0vN82iUm9K5qwuylmcAchORoODntMchRFWwi0PArY2qSeop0kckfK1p5qvAI7c+8Uv7X9WbOd1EPAj0zDZCHjQjzClNyKxTTu26dPGqe8hOSNk43juNxoAvaqYBxItiHxGrLW8IBJFeN22spv6dUC2wqTR099Sc4FpqNW+VxcN86ICxEfvEK7xxjpa0BFmdPmYqk/Pt6qepIJ4Czvr2p/1QxutMHjpX0+SE+zuctywjOJStHKVZ7ORbF00Wq8uWQL+QRP1eQqxHqiaUvci+qY6lM0X5THRe2i1/6/G0a5rgSQHHiWWzxdD/ZLS7pkmgOhzFZUEISF0RxPiOFgbx/qLjlvXfIQbwSqGJAY7Bl+vz6WoBgxyzKGK6luSMiSoD8cjEB2z9GTvNBYHa4yUiiCpiICUksMT8AjNvLaGTX/kuAFcP9/SfQykyVL46uA18ho+9K43Hm+Nxjh8r7b2xl/tb5QbgSfBp8Fnwej4CAYB98Ex8FJwAId/Bz8Evza+a3zR+fPzl+r0OvX1pjbQat1/v4HOH2JWQ==</latexit>
|N| = r<latexit sha1_base64="tQEGT1dKiB0d6p4CljzChDc5oR0=">AAAHQHicfVVdb9s2FFW7zeu0j6Yr9rQXdqmBoZAdO0WWZkAAYyuKFWi3bHbaApaRUdKVRJikNJJq5BL6MXvd/sX+xf7B3oa97mmXtrNYTjYCtijynnN4L4/IqORMm8Hg9xs333r7nc67t97z3//gw49u79z5+IUuKhXDaVzwQr2KqAbOJJwaZji8KhVQEXF4Gc2/dvMvX4PSrJATsyhhJmgmWcpianDobOeT+yHHeUO+JaFado6Jun+2szvoD5aNXO0M151db91Ozu507oZJEVcCpIk51Xo6HJRmZqkyLObQ+GGloaTxnGYwxa6kAvTMLtffkC6OJCQtFP6kIctRfxOCPIouWizW0KjiVNXt0ago5jijG99va5r00cwyWVYGZLySTCtOTEFcWUjCFMSGL0hb17D5m0CyGFJF44AKLajJg5K5dQZm/qaXKVrmgaBziIHzy6HVqhycs0hRtXApFOc6iJA5U0UlEx2U1BhQUiPeKFYHOqcl6CBlJogpj9174jAlL4ygaq7/i7UvwFCcXFaOg7GTKjXwAySNVZDcezS4F3HU3YwwOWQKQDZ2+XAx5zkzsBUT8Qoa6/43IvwuyY0p9Zd7ewbqvjbIDXWcU5lBPy7E3k8VaOcvvTf84uBo/2hPg2DorghdJ3rnzOQ9l0SPyV6EZgW1jHt4uLt6+KErKEUzu/r4YcaLiPIQX0MHG4HUlYJRUnA0wAitHBcJHIcKOK0vsAUuvm2i6WQ4s27jnAFau3wyGVPpiqtAwjkmIKhMbJhSwfgigZRW3DQ21OlFv20SnTpXNH53U0zjDkJyPOgfBbFgKIq24Gh5FDC1Th1FO0nkDqWpHdVoBbb6wRS/tYNZs53UY8CPTMF4IaKCP8GU7IpFN/a7588aK52EYI0VjWW43HAM5rpgHEi2IdEastZwgHEV4Xaaym3p9QLbCuMnz11JLgQmw1b5bFQ3VvNLERe8QtunGOlqQHmZ0+ZyqT8+3ap6knFgcd5b1f66GdxojcdL+3wQjmZzl8WYZQKVwpWrHJ0NI2HD1XhzxRbiGR6vyXWI9UTTlngQ1hFVUzRfmEdFbcPX7r/rh7mqOJAcWJYbPF0PD0pDumSSA6GxqSgnCPPDOZ4Qg/7+AdRdctG65DFeDVTGQCIw5/j9uliCYkQvy+ivpLo+IUuC3qA/BNG9QI/zQmF1mMxIIQmainBIDdEsAYfYyGt32PxLghfAw/8lUctMliyNqwJeI8PtS+Nq58V+f4jL+35/d/TV+kK55X3qfeZ97g29Q2/kfeOdeKde7FnvZ+8X79fOb50/On92/lqF3ryxxtz1Wq3z9z/OTY0U</latexit><latexit sha1_base64="tQEGT1dKiB0d6p4CljzChDc5oR0=">AAAHQHicfVVdb9s2FFW7zeu0j6Yr9rQXdqmBoZAdO0WWZkAAYyuKFWi3bHbaApaRUdKVRJikNJJq5BL6MXvd/sX+xf7B3oa97mmXtrNYTjYCtijynnN4L4/IqORMm8Hg9xs333r7nc67t97z3//gw49u79z5+IUuKhXDaVzwQr2KqAbOJJwaZji8KhVQEXF4Gc2/dvMvX4PSrJATsyhhJmgmWcpianDobOeT+yHHeUO+JaFado6Jun+2szvoD5aNXO0M151db91Ozu507oZJEVcCpIk51Xo6HJRmZqkyLObQ+GGloaTxnGYwxa6kAvTMLtffkC6OJCQtFP6kIctRfxOCPIouWizW0KjiVNXt0ago5jijG99va5r00cwyWVYGZLySTCtOTEFcWUjCFMSGL0hb17D5m0CyGFJF44AKLajJg5K5dQZm/qaXKVrmgaBziIHzy6HVqhycs0hRtXApFOc6iJA5U0UlEx2U1BhQUiPeKFYHOqcl6CBlJogpj9174jAlL4ygaq7/i7UvwFCcXFaOg7GTKjXwAySNVZDcezS4F3HU3YwwOWQKQDZ2+XAx5zkzsBUT8Qoa6/43IvwuyY0p9Zd7ewbqvjbIDXWcU5lBPy7E3k8VaOcvvTf84uBo/2hPg2DorghdJ3rnzOQ9l0SPyV6EZgW1jHt4uLt6+KErKEUzu/r4YcaLiPIQX0MHG4HUlYJRUnA0wAitHBcJHIcKOK0vsAUuvm2i6WQ4s27jnAFau3wyGVPpiqtAwjkmIKhMbJhSwfgigZRW3DQ21OlFv20SnTpXNH53U0zjDkJyPOgfBbFgKIq24Gh5FDC1Th1FO0nkDqWpHdVoBbb6wRS/tYNZs53UY8CPTMF4IaKCP8GU7IpFN/a7588aK52EYI0VjWW43HAM5rpgHEi2IdEastZwgHEV4Xaaym3p9QLbCuMnz11JLgQmw1b5bFQ3VvNLERe8QtunGOlqQHmZ0+ZyqT8+3ap6knFgcd5b1f66GdxojcdL+3wQjmZzl8WYZQKVwpWrHJ0NI2HD1XhzxRbiGR6vyXWI9UTTlngQ1hFVUzRfmEdFbcPX7r/rh7mqOJAcWJYbPF0PD0pDumSSA6GxqSgnCPPDOZ4Qg/7+AdRdctG65DFeDVTGQCIw5/j9uliCYkQvy+ivpLo+IUuC3qA/BNG9QI/zQmF1mMxIIQmainBIDdEsAYfYyGt32PxLghfAw/8lUctMliyNqwJeI8PtS+Nq58V+f4jL+35/d/TV+kK55X3qfeZ97g29Q2/kfeOdeKde7FnvZ+8X79fOb50/On92/lqF3ryxxtz1Wq3z9z/OTY0U</latexit><latexit sha1_base64="tQEGT1dKiB0d6p4CljzChDc5oR0=">AAAHQHicfVVdb9s2FFW7zeu0j6Yr9rQXdqmBoZAdO0WWZkAAYyuKFWi3bHbaApaRUdKVRJikNJJq5BL6MXvd/sX+xf7B3oa97mmXtrNYTjYCtijynnN4L4/IqORMm8Hg9xs333r7nc67t97z3//gw49u79z5+IUuKhXDaVzwQr2KqAbOJJwaZji8KhVQEXF4Gc2/dvMvX4PSrJATsyhhJmgmWcpianDobOeT+yHHeUO+JaFado6Jun+2szvoD5aNXO0M151db91Ozu507oZJEVcCpIk51Xo6HJRmZqkyLObQ+GGloaTxnGYwxa6kAvTMLtffkC6OJCQtFP6kIctRfxOCPIouWizW0KjiVNXt0ago5jijG99va5r00cwyWVYGZLySTCtOTEFcWUjCFMSGL0hb17D5m0CyGFJF44AKLajJg5K5dQZm/qaXKVrmgaBziIHzy6HVqhycs0hRtXApFOc6iJA5U0UlEx2U1BhQUiPeKFYHOqcl6CBlJogpj9174jAlL4ygaq7/i7UvwFCcXFaOg7GTKjXwAySNVZDcezS4F3HU3YwwOWQKQDZ2+XAx5zkzsBUT8Qoa6/43IvwuyY0p9Zd7ewbqvjbIDXWcU5lBPy7E3k8VaOcvvTf84uBo/2hPg2DorghdJ3rnzOQ9l0SPyV6EZgW1jHt4uLt6+KErKEUzu/r4YcaLiPIQX0MHG4HUlYJRUnA0wAitHBcJHIcKOK0vsAUuvm2i6WQ4s27jnAFau3wyGVPpiqtAwjkmIKhMbJhSwfgigZRW3DQ21OlFv20SnTpXNH53U0zjDkJyPOgfBbFgKIq24Gh5FDC1Th1FO0nkDqWpHdVoBbb6wRS/tYNZs53UY8CPTMF4IaKCP8GU7IpFN/a7588aK52EYI0VjWW43HAM5rpgHEi2IdEastZwgHEV4Xaaym3p9QLbCuMnz11JLgQmw1b5bFQ3VvNLERe8QtunGOlqQHmZ0+ZyqT8+3ap6knFgcd5b1f66GdxojcdL+3wQjmZzl8WYZQKVwpWrHJ0NI2HD1XhzxRbiGR6vyXWI9UTTlngQ1hFVUzRfmEdFbcPX7r/rh7mqOJAcWJYbPF0PD0pDumSSA6GxqSgnCPPDOZ4Qg/7+AdRdctG65DFeDVTGQCIw5/j9uliCYkQvy+ivpLo+IUuC3qA/BNG9QI/zQmF1mMxIIQmainBIDdEsAYfYyGt32PxLghfAw/8lUctMliyNqwJeI8PtS+Nq58V+f4jL+35/d/TV+kK55X3qfeZ97g29Q2/kfeOdeKde7FnvZ+8X79fOb50/On92/lqF3ryxxtz1Wq3z9z/OTY0U</latexit><latexit sha1_base64="tQEGT1dKiB0d6p4CljzChDc5oR0=">AAAHQHicfVVdb9s2FFW7zeu0j6Yr9rQXdqmBoZAdO0WWZkAAYyuKFWi3bHbaApaRUdKVRJikNJJq5BL6MXvd/sX+xf7B3oa97mmXtrNYTjYCtijynnN4L4/IqORMm8Hg9xs333r7nc67t97z3//gw49u79z5+IUuKhXDaVzwQr2KqAbOJJwaZji8KhVQEXF4Gc2/dvMvX4PSrJATsyhhJmgmWcpianDobOeT+yHHeUO+JaFado6Jun+2szvoD5aNXO0M151db91Ozu507oZJEVcCpIk51Xo6HJRmZqkyLObQ+GGloaTxnGYwxa6kAvTMLtffkC6OJCQtFP6kIctRfxOCPIouWizW0KjiVNXt0ago5jijG99va5r00cwyWVYGZLySTCtOTEFcWUjCFMSGL0hb17D5m0CyGFJF44AKLajJg5K5dQZm/qaXKVrmgaBziIHzy6HVqhycs0hRtXApFOc6iJA5U0UlEx2U1BhQUiPeKFYHOqcl6CBlJogpj9174jAlL4ygaq7/i7UvwFCcXFaOg7GTKjXwAySNVZDcezS4F3HU3YwwOWQKQDZ2+XAx5zkzsBUT8Qoa6/43IvwuyY0p9Zd7ewbqvjbIDXWcU5lBPy7E3k8VaOcvvTf84uBo/2hPg2DorghdJ3rnzOQ9l0SPyV6EZgW1jHt4uLt6+KErKEUzu/r4YcaLiPIQX0MHG4HUlYJRUnA0wAitHBcJHIcKOK0vsAUuvm2i6WQ4s27jnAFau3wyGVPpiqtAwjkmIKhMbJhSwfgigZRW3DQ21OlFv20SnTpXNH53U0zjDkJyPOgfBbFgKIq24Gh5FDC1Th1FO0nkDqWpHdVoBbb6wRS/tYNZs53UY8CPTMF4IaKCP8GU7IpFN/a7588aK52EYI0VjWW43HAM5rpgHEi2IdEastZwgHEV4Xaaym3p9QLbCuMnz11JLgQmw1b5bFQ3VvNLERe8QtunGOlqQHmZ0+ZyqT8+3ap6knFgcd5b1f66GdxojcdL+3wQjmZzl8WYZQKVwpWrHJ0NI2HD1XhzxRbiGR6vyXWI9UTTlngQ1hFVUzRfmEdFbcPX7r/rh7mqOJAcWJYbPF0PD0pDumSSA6GxqSgnCPPDOZ4Qg/7+AdRdctG65DFeDVTGQCIw5/j9uliCYkQvy+ivpLo+IUuC3qA/BNG9QI/zQmF1mMxIIQmainBIDdEsAYfYyGt32PxLghfAw/8lUctMliyNqwJeI8PtS+Nq58V+f4jL+35/d/TV+kK55X3qfeZ97g29Q2/kfeOdeKde7FnvZ+8X79fOb50/On92/lqF3ryxxtz1Wq3z9z/OTY0U</latexit>
Our Correlated Repeat Unions (CRU) model captures
repeat behavior,recency bias,and correlations.
16
Setup (k = 3).
Observe S1, …, S3: {a, b}, {c}, {a, c, d}.
Given that S4 has 3 repeated elements.
Model selects three elements from {a, b, c, d}.
CRU model (p = 0.8; w1 = 0.6,w2 = 0.3 w3 = 0.1).
{a, b} w3 = 0.1{c} w2 = 0.3{a, c, d} w1 = 0.6
0. N = ;.<latexit sha1_base64="koOJt4XUWyg16qZo3FixiqcvPXI=">AAAHQXicfVVdb9s2FFXbzeu0j6YtsJe9sEsNDIXt2CmyNBsCGFtRrEC7ZbPTFoiMjJKuJMIkpZFUI5fTn9nr9i/2K/YT9jbsdS+7tJzFcrIRsEWR95zDe3lEhgVn2gyHv1+7fuOttzvv3HzXf+/9Dz68tXX7zgudlyqC4yjnuXoVUg2cSTg2zHB4VSigIuTwMpx/5eZfvgalWS6nZlHATNBUsoRF1ODQ6dZHw0HwBbn/DTkkAYjCLDSY+wP/dGt7OBguG7ncGa06296qHZ3e7twN4jwqBUgTcar1yWhYmJmlyrCIQ+0HpYaCRnOawgl2JRWgZ3aZQE26OBKTJFf4k4YsR/11CPIoumixWEPDklNVtUfDPJ/jjK59v61pkkczy2RRGpBRI5mUnJicuLqQmCmIDF+Qtq5h8zc9ySJIFI16VGhBTdYrmFtnz8zf9FNFi6wn6Bwi4PxiqFmVg3MWKqoWLoX8TPdCZE5VXspY9wpqDCipEW8Uq3o6owXoXsJML6I8cu+xwxQ8N4Kquf4v1oEAQ3FyWTkOxk7LxMD3ENdWQXzv0fBeyFF3PcJkkCoAWdvlw8WcZczARkzIS6it+1+L8LskM6bQn+/sGKgG2iA3VFFGZQqDKBc7P5agncH0zuizvYPdgx0NgqEPQ7Sd6J8xk/VdEn0m+yG6FdQy7uH+dvPwA1dQim529fGDlOch5QG+Bg42BqlLBeM452iAMXo5ymM4DBRwWp1jc1x820Qn09HMuo1zBmjt8tF0QqUrrgIJZ5iAoDK2QUIF44sYElpyU9tAJ+f9tkl04lxR+911MY07CPHhcHDQiwRDUbQFR8ujgKl04ijaSSJ3IE3lqMYN2OoHJ/it7c3qzaQeA35kCiYLEeb8CaZkGxZd22+fP6utdBKC1VbUluFygwmYq4JxIN6EhCvISsMBJmWI22lKt6VXC2wqTJ48dyU5F5iOWuWzYVVbzS9EXHCDtk8x0tWA8iKj9cVSf3i6UfU45cCirN/U/qoZ3GiNx0v7fBCOZn2XxYSlApWCxlWOzgahsEEzXl+yhXiG52t8FWI1UbclHgRVSNUJmi/IwryywWv33/WDTJUcSAYszQyervt7hSFdMs2A0MiUlBOE+cEcT4jhYHcPqi45b13yGO8GKiMgIZgz/H5dLEExopdl9Buprk/IkqA/HIxAdM/RkyxXWB0mU5JLgqYiHBJDNIvBIdby2h7V/5LgBfDwf0nUMpMlS+2qgNfIaPPSuNx5sTsY4fK+290ef7m6UG56H3ufeJ96I2/fG3tfe0fesRd5P3k/e794v3Z+6/zR+bPzVxN6/doKc9drtc7f/wCI04x4</latexit><latexit sha1_base64="koOJt4XUWyg16qZo3FixiqcvPXI=">AAAHQXicfVVdb9s2FFXbzeu0j6YtsJe9sEsNDIXt2CmyNBsCGFtRrEC7ZbPTFoiMjJKuJMIkpZFUI5fTn9nr9i/2K/YT9jbsdS+7tJzFcrIRsEWR95zDe3lEhgVn2gyHv1+7fuOttzvv3HzXf+/9Dz68tXX7zgudlyqC4yjnuXoVUg2cSTg2zHB4VSigIuTwMpx/5eZfvgalWS6nZlHATNBUsoRF1ODQ6dZHw0HwBbn/DTkkAYjCLDSY+wP/dGt7OBguG7ncGa06296qHZ3e7twN4jwqBUgTcar1yWhYmJmlyrCIQ+0HpYaCRnOawgl2JRWgZ3aZQE26OBKTJFf4k4YsR/11CPIoumixWEPDklNVtUfDPJ/jjK59v61pkkczy2RRGpBRI5mUnJicuLqQmCmIDF+Qtq5h8zc9ySJIFI16VGhBTdYrmFtnz8zf9FNFi6wn6Bwi4PxiqFmVg3MWKqoWLoX8TPdCZE5VXspY9wpqDCipEW8Uq3o6owXoXsJML6I8cu+xwxQ8N4Kquf4v1oEAQ3FyWTkOxk7LxMD3ENdWQXzv0fBeyFF3PcJkkCoAWdvlw8WcZczARkzIS6it+1+L8LskM6bQn+/sGKgG2iA3VFFGZQqDKBc7P5agncH0zuizvYPdgx0NgqEPQ7Sd6J8xk/VdEn0m+yG6FdQy7uH+dvPwA1dQim529fGDlOch5QG+Bg42BqlLBeM452iAMXo5ymM4DBRwWp1jc1x820Qn09HMuo1zBmjt8tF0QqUrrgIJZ5iAoDK2QUIF44sYElpyU9tAJ+f9tkl04lxR+911MY07CPHhcHDQiwRDUbQFR8ujgKl04ijaSSJ3IE3lqMYN2OoHJ/it7c3qzaQeA35kCiYLEeb8CaZkGxZd22+fP6utdBKC1VbUluFygwmYq4JxIN6EhCvISsMBJmWI22lKt6VXC2wqTJ48dyU5F5iOWuWzYVVbzS9EXHCDtk8x0tWA8iKj9cVSf3i6UfU45cCirN/U/qoZ3GiNx0v7fBCOZn2XxYSlApWCxlWOzgahsEEzXl+yhXiG52t8FWI1UbclHgRVSNUJmi/IwryywWv33/WDTJUcSAYszQyervt7hSFdMs2A0MiUlBOE+cEcT4jhYHcPqi45b13yGO8GKiMgIZgz/H5dLEExopdl9Buprk/IkqA/HIxAdM/RkyxXWB0mU5JLgqYiHBJDNIvBIdby2h7V/5LgBfDwf0nUMpMlS+2qgNfIaPPSuNx5sTsY4fK+290ef7m6UG56H3ufeJ96I2/fG3tfe0fesRd5P3k/e794v3Z+6/zR+bPzVxN6/doKc9drtc7f/wCI04x4</latexit><latexit sha1_base64="koOJt4XUWyg16qZo3FixiqcvPXI=">AAAHQXicfVVdb9s2FFXbzeu0j6YtsJe9sEsNDIXt2CmyNBsCGFtRrEC7ZbPTFoiMjJKuJMIkpZFUI5fTn9nr9i/2K/YT9jbsdS+7tJzFcrIRsEWR95zDe3lEhgVn2gyHv1+7fuOttzvv3HzXf+/9Dz68tXX7zgudlyqC4yjnuXoVUg2cSTg2zHB4VSigIuTwMpx/5eZfvgalWS6nZlHATNBUsoRF1ODQ6dZHw0HwBbn/DTkkAYjCLDSY+wP/dGt7OBguG7ncGa06296qHZ3e7twN4jwqBUgTcar1yWhYmJmlyrCIQ+0HpYaCRnOawgl2JRWgZ3aZQE26OBKTJFf4k4YsR/11CPIoumixWEPDklNVtUfDPJ/jjK59v61pkkczy2RRGpBRI5mUnJicuLqQmCmIDF+Qtq5h8zc9ySJIFI16VGhBTdYrmFtnz8zf9FNFi6wn6Bwi4PxiqFmVg3MWKqoWLoX8TPdCZE5VXspY9wpqDCipEW8Uq3o6owXoXsJML6I8cu+xwxQ8N4Kquf4v1oEAQ3FyWTkOxk7LxMD3ENdWQXzv0fBeyFF3PcJkkCoAWdvlw8WcZczARkzIS6it+1+L8LskM6bQn+/sGKgG2iA3VFFGZQqDKBc7P5agncH0zuizvYPdgx0NgqEPQ7Sd6J8xk/VdEn0m+yG6FdQy7uH+dvPwA1dQim529fGDlOch5QG+Bg42BqlLBeM452iAMXo5ymM4DBRwWp1jc1x820Qn09HMuo1zBmjt8tF0QqUrrgIJZ5iAoDK2QUIF44sYElpyU9tAJ+f9tkl04lxR+911MY07CPHhcHDQiwRDUbQFR8ujgKl04ijaSSJ3IE3lqMYN2OoHJ/it7c3qzaQeA35kCiYLEeb8CaZkGxZd22+fP6utdBKC1VbUluFygwmYq4JxIN6EhCvISsMBJmWI22lKt6VXC2wqTJ48dyU5F5iOWuWzYVVbzS9EXHCDtk8x0tWA8iKj9cVSf3i6UfU45cCirN/U/qoZ3GiNx0v7fBCOZn2XxYSlApWCxlWOzgahsEEzXl+yhXiG52t8FWI1UbclHgRVSNUJmi/IwryywWv33/WDTJUcSAYszQyervt7hSFdMs2A0MiUlBOE+cEcT4jhYHcPqi45b13yGO8GKiMgIZgz/H5dLEExopdl9Buprk/IkqA/HIxAdM/RkyxXWB0mU5JLgqYiHBJDNIvBIdby2h7V/5LgBfDwf0nUMpMlS+2qgNfIaPPSuNx5sTsY4fK+290ef7m6UG56H3ufeJ96I2/fG3tfe0fesRd5P3k/e794v3Z+6/zR+bPzVxN6/doKc9drtc7f/wCI04x4</latexit><latexit sha1_base64="koOJt4XUWyg16qZo3FixiqcvPXI=">AAAHQXicfVVdb9s2FFXbzeu0j6YtsJe9sEsNDIXt2CmyNBsCGFtRrEC7ZbPTFoiMjJKuJMIkpZFUI5fTn9nr9i/2K/YT9jbsdS+7tJzFcrIRsEWR95zDe3lEhgVn2gyHv1+7fuOttzvv3HzXf+/9Dz68tXX7zgudlyqC4yjnuXoVUg2cSTg2zHB4VSigIuTwMpx/5eZfvgalWS6nZlHATNBUsoRF1ODQ6dZHw0HwBbn/DTkkAYjCLDSY+wP/dGt7OBguG7ncGa06296qHZ3e7twN4jwqBUgTcar1yWhYmJmlyrCIQ+0HpYaCRnOawgl2JRWgZ3aZQE26OBKTJFf4k4YsR/11CPIoumixWEPDklNVtUfDPJ/jjK59v61pkkczy2RRGpBRI5mUnJicuLqQmCmIDF+Qtq5h8zc9ySJIFI16VGhBTdYrmFtnz8zf9FNFi6wn6Bwi4PxiqFmVg3MWKqoWLoX8TPdCZE5VXspY9wpqDCipEW8Uq3o6owXoXsJML6I8cu+xwxQ8N4Kquf4v1oEAQ3FyWTkOxk7LxMD3ENdWQXzv0fBeyFF3PcJkkCoAWdvlw8WcZczARkzIS6it+1+L8LskM6bQn+/sGKgG2iA3VFFGZQqDKBc7P5agncH0zuizvYPdgx0NgqEPQ7Sd6J8xk/VdEn0m+yG6FdQy7uH+dvPwA1dQim529fGDlOch5QG+Bg42BqlLBeM452iAMXo5ymM4DBRwWp1jc1x820Qn09HMuo1zBmjt8tF0QqUrrgIJZ5iAoDK2QUIF44sYElpyU9tAJ+f9tkl04lxR+911MY07CPHhcHDQiwRDUbQFR8ujgKl04ijaSSJ3IE3lqMYN2OoHJ/it7c3qzaQeA35kCiYLEeb8CaZkGxZd22+fP6utdBKC1VbUluFygwmYq4JxIN6EhCvISsMBJmWI22lKt6VXC2wqTJ48dyU5F5iOWuWzYVVbzS9EXHCDtk8x0tWA8iKj9cVSf3i6UfU45cCirN/U/qoZ3GiNx0v7fBCOZn2XxYSlApWCxlWOzgahsEEzXl+yhXiG52t8FWI1UbclHgRVSNUJmi/IwryywWv33/WDTJUcSAYszQyervt7hSFdMs2A0MiUlBOE+cEcT4jhYHcPqi45b13yGO8GKiMgIZgz/H5dLEExopdl9Buprk/IkqA/HIxAdM/RkyxXWB0mU5JLgqYiHBJDNIvBIdby2h7V/5LgBfDwf0nUMpMlS+2qgNfIaPPSuNx5sTsY4fK+290ef7m6UG56H3ufeJ96I2/fG3tfe0fesRd5P3k/e794v3Z+6/zR+bPzVxN6/doKc9drtc7f/wCI04x4</latexit>
1. N = {a, c}.<latexit sha1_base64="/m/3pGpI42L2jFUUwxh1JPMNRRA=">AAAHQHicfVVdjxs1FJ0WCGX42lLxxIvLNhKqJtlkq2W7oJUiqCoqtbCQbFtpJ1o8njsZK7ZnsD3dpNb8GF7hX/Av+Ae8IV554jofbCa7YCkZj33POb7XZ+ykFNzYXu/3GzffePOt1tu33gnffe/9Dz7cuf3Rc1NUmsEpK0ShXybUgOAKTi23Al6WGqhMBLxIpl/7+RevQBteqJGdlzCWdKJ4xhm1OHS+83G/G39J7n1LjknsaERYXN/rhuc7u71ub9HI1U5/1dkNVu3k/HbrTpwWrJKgLBPUmLN+r7RjR7XlTEAdxpWBkrIpncAZdhWVYMZusf6atHEkJVmh8acsWYyGmxDk0XTeYHGWJpWgetYcTYpiijOmDsOmps0ejh1XZWVBsaVkVgliC+LLQlKugVkxJ01dy6evI8UZZJqyiEojqc2jkvt1Rnb6ujPRtMwjSafAQIjLoeWqPFzwRFM99ykUFyZKkHmii0qlJiqptaCVQbzVfBaZnJZgoozbiFHB/HvqMaUorKR6av6LtSvBUpxcVE6AdaMqs/ADpLXTkN592LubCNTdjLA5TDSAqt3i4WMucm5hKyYRFdTO/29EhG2SW1uaL/b2LMy6xiI3zFhO1QS6rJB7P1VgvL/MXv/zg6P9oz0DkqMNE3Sd7Fxwm3d8Eh2uOgmaFfQi7sHh7vIRxr6gFM3s6xPGE1EkVMT4GnvYAJSpNAzSQqABBmhlVqRwHGsQdLbGFrj4ponORv2x8xvnDdDY5ZPRkCpfXA0KLjABSVXq4oxKLuYpZLQStnaxydb9pklM5l1Rh+1NMYM7COlxr3sUMclRFG0h0PIoYGcm8xTNJJE7VnbmqQZLsDP3z/BbOxjX20k9AvzINAznMinEY0zJLVlM7b579rR2yktIXjtZO47LjYdgrwvGgXQbkqwgKw0PGFYJbqet/JZeL7CtMHz8zJdkLTDqN8rnklntjLgU8cFLtHuCkb4GVJQ5rS+X+uOTraqnEwGc5Z1l7a+bwY02eLw0zwfpaTZ3WQ75RKJSvHSVp3NxIl28HK+v2EI+xeM1vQ6xmqibEvfjWUL1GZovzpNi5uJX/r8dxrmuBJAc+CS3eLoeHpSWtMkoB0KZraggCAvjKZ4Qve7+AczaZN3a5BFeDVQxIAnYC/x+fSxBMWIWZQyXUu2QkAVBp9ftg2yv0cO80FgdriakUARNRQRklhiegkds5LXbr/8lwQvgwf+S6EUmC5baVwGvkf72pXG183y/28flfb+/O/hqdaHcCj4JPg0+C/rBYTAIvglOgtOABS74Ofgl+LX1W+uP1p+tv5ahN2+sMHeCRmv9/Q/4S4tY</latexit><latexit sha1_base64="/m/3pGpI42L2jFUUwxh1JPMNRRA=">AAAHQHicfVVdjxs1FJ0WCGX42lLxxIvLNhKqJtlkq2W7oJUiqCoqtbCQbFtpJ1o8njsZK7ZnsD3dpNb8GF7hX/Av+Ae8IV554jofbCa7YCkZj33POb7XZ+ykFNzYXu/3GzffePOt1tu33gnffe/9Dz7cuf3Rc1NUmsEpK0ShXybUgOAKTi23Al6WGqhMBLxIpl/7+RevQBteqJGdlzCWdKJ4xhm1OHS+83G/G39J7n1LjknsaERYXN/rhuc7u71ub9HI1U5/1dkNVu3k/HbrTpwWrJKgLBPUmLN+r7RjR7XlTEAdxpWBkrIpncAZdhWVYMZusf6atHEkJVmh8acsWYyGmxDk0XTeYHGWJpWgetYcTYpiijOmDsOmps0ejh1XZWVBsaVkVgliC+LLQlKugVkxJ01dy6evI8UZZJqyiEojqc2jkvt1Rnb6ujPRtMwjSafAQIjLoeWqPFzwRFM99ykUFyZKkHmii0qlJiqptaCVQbzVfBaZnJZgoozbiFHB/HvqMaUorKR6av6LtSvBUpxcVE6AdaMqs/ADpLXTkN592LubCNTdjLA5TDSAqt3i4WMucm5hKyYRFdTO/29EhG2SW1uaL/b2LMy6xiI3zFhO1QS6rJB7P1VgvL/MXv/zg6P9oz0DkqMNE3Sd7Fxwm3d8Eh2uOgmaFfQi7sHh7vIRxr6gFM3s6xPGE1EkVMT4GnvYAJSpNAzSQqABBmhlVqRwHGsQdLbGFrj4ponORv2x8xvnDdDY5ZPRkCpfXA0KLjABSVXq4oxKLuYpZLQStnaxydb9pklM5l1Rh+1NMYM7COlxr3sUMclRFG0h0PIoYGcm8xTNJJE7VnbmqQZLsDP3z/BbOxjX20k9AvzINAznMinEY0zJLVlM7b579rR2yktIXjtZO47LjYdgrwvGgXQbkqwgKw0PGFYJbqet/JZeL7CtMHz8zJdkLTDqN8rnklntjLgU8cFLtHuCkb4GVJQ5rS+X+uOTraqnEwGc5Z1l7a+bwY02eLw0zwfpaTZ3WQ75RKJSvHSVp3NxIl28HK+v2EI+xeM1vQ6xmqibEvfjWUL1GZovzpNi5uJX/r8dxrmuBJAc+CS3eLoeHpSWtMkoB0KZraggCAvjKZ4Qve7+AczaZN3a5BFeDVQxIAnYC/x+fSxBMWIWZQyXUu2QkAVBp9ftg2yv0cO80FgdriakUARNRQRklhiegkds5LXbr/8lwQvgwf+S6EUmC5baVwGvkf72pXG183y/28flfb+/O/hqdaHcCj4JPg0+C/rBYTAIvglOgtOABS74Ofgl+LX1W+uP1p+tv5ahN2+sMHeCRmv9/Q/4S4tY</latexit><latexit sha1_base64="/m/3pGpI42L2jFUUwxh1JPMNRRA=">AAAHQHicfVVdjxs1FJ0WCGX42lLxxIvLNhKqJtlkq2W7oJUiqCoqtbCQbFtpJ1o8njsZK7ZnsD3dpNb8GF7hX/Av+Ae8IV554jofbCa7YCkZj33POb7XZ+ykFNzYXu/3GzffePOt1tu33gnffe/9Dz7cuf3Rc1NUmsEpK0ShXybUgOAKTi23Al6WGqhMBLxIpl/7+RevQBteqJGdlzCWdKJ4xhm1OHS+83G/G39J7n1LjknsaERYXN/rhuc7u71ub9HI1U5/1dkNVu3k/HbrTpwWrJKgLBPUmLN+r7RjR7XlTEAdxpWBkrIpncAZdhWVYMZusf6atHEkJVmh8acsWYyGmxDk0XTeYHGWJpWgetYcTYpiijOmDsOmps0ejh1XZWVBsaVkVgliC+LLQlKugVkxJ01dy6evI8UZZJqyiEojqc2jkvt1Rnb6ujPRtMwjSafAQIjLoeWqPFzwRFM99ykUFyZKkHmii0qlJiqptaCVQbzVfBaZnJZgoozbiFHB/HvqMaUorKR6av6LtSvBUpxcVE6AdaMqs/ADpLXTkN592LubCNTdjLA5TDSAqt3i4WMucm5hKyYRFdTO/29EhG2SW1uaL/b2LMy6xiI3zFhO1QS6rJB7P1VgvL/MXv/zg6P9oz0DkqMNE3Sd7Fxwm3d8Eh2uOgmaFfQi7sHh7vIRxr6gFM3s6xPGE1EkVMT4GnvYAJSpNAzSQqABBmhlVqRwHGsQdLbGFrj4ponORv2x8xvnDdDY5ZPRkCpfXA0KLjABSVXq4oxKLuYpZLQStnaxydb9pklM5l1Rh+1NMYM7COlxr3sUMclRFG0h0PIoYGcm8xTNJJE7VnbmqQZLsDP3z/BbOxjX20k9AvzINAznMinEY0zJLVlM7b579rR2yktIXjtZO47LjYdgrwvGgXQbkqwgKw0PGFYJbqet/JZeL7CtMHz8zJdkLTDqN8rnklntjLgU8cFLtHuCkb4GVJQ5rS+X+uOTraqnEwGc5Z1l7a+bwY02eLw0zwfpaTZ3WQ75RKJSvHSVp3NxIl28HK+v2EI+xeM1vQ6xmqibEvfjWUL1GZovzpNi5uJX/r8dxrmuBJAc+CS3eLoeHpSWtMkoB0KZraggCAvjKZ4Qve7+AczaZN3a5BFeDVQxIAnYC/x+fSxBMWIWZQyXUu2QkAVBp9ftg2yv0cO80FgdriakUARNRQRklhiegkds5LXbr/8lwQvgwf+S6EUmC5baVwGvkf72pXG183y/28flfb+/O/hqdaHcCj4JPg0+C/rBYTAIvglOgtOABS74Ofgl+LX1W+uP1p+tv5ahN2+sMHeCRmv9/Q/4S4tY</latexit><latexit sha1_base64="/m/3pGpI42L2jFUUwxh1JPMNRRA=">AAAHQHicfVVdjxs1FJ0WCGX42lLxxIvLNhKqJtlkq2W7oJUiqCoqtbCQbFtpJ1o8njsZK7ZnsD3dpNb8GF7hX/Av+Ae8IV554jofbCa7YCkZj33POb7XZ+ykFNzYXu/3GzffePOt1tu33gnffe/9Dz7cuf3Rc1NUmsEpK0ShXybUgOAKTi23Al6WGqhMBLxIpl/7+RevQBteqJGdlzCWdKJ4xhm1OHS+83G/G39J7n1LjknsaERYXN/rhuc7u71ub9HI1U5/1dkNVu3k/HbrTpwWrJKgLBPUmLN+r7RjR7XlTEAdxpWBkrIpncAZdhWVYMZusf6atHEkJVmh8acsWYyGmxDk0XTeYHGWJpWgetYcTYpiijOmDsOmps0ejh1XZWVBsaVkVgliC+LLQlKugVkxJ01dy6evI8UZZJqyiEojqc2jkvt1Rnb6ujPRtMwjSafAQIjLoeWqPFzwRFM99ykUFyZKkHmii0qlJiqptaCVQbzVfBaZnJZgoozbiFHB/HvqMaUorKR6av6LtSvBUpxcVE6AdaMqs/ADpLXTkN592LubCNTdjLA5TDSAqt3i4WMucm5hKyYRFdTO/29EhG2SW1uaL/b2LMy6xiI3zFhO1QS6rJB7P1VgvL/MXv/zg6P9oz0DkqMNE3Sd7Fxwm3d8Eh2uOgmaFfQi7sHh7vIRxr6gFM3s6xPGE1EkVMT4GnvYAJSpNAzSQqABBmhlVqRwHGsQdLbGFrj4ponORv2x8xvnDdDY5ZPRkCpfXA0KLjABSVXq4oxKLuYpZLQStnaxydb9pklM5l1Rh+1NMYM7COlxr3sUMclRFG0h0PIoYGcm8xTNJJE7VnbmqQZLsDP3z/BbOxjX20k9AvzINAznMinEY0zJLVlM7b579rR2yktIXjtZO47LjYdgrwvGgXQbkqwgKw0PGFYJbqet/JZeL7CtMHz8zJdkLTDqN8rnklntjLgU8cFLtHuCkb4GVJQ5rS+X+uOTraqnEwGc5Z1l7a+bwY02eLw0zwfpaTZ3WQ75RKJSvHSVp3NxIl28HK+v2EI+xeM1vQ6xmqibEvfjWUL1GZovzpNi5uJX/r8dxrmuBJAc+CS3eLoeHpSWtMkoB0KZraggCAvjKZ4Qve7+AczaZN3a5BFeDVQxIAnYC/x+fSxBMWIWZQyXUu2QkAVBp9ftg2yv0cO80FgdriakUARNRQRklhiegkds5LXbr/8lwQvgwf+S6EUmC5baVwGvkf72pXG183y/28flfb+/O/hqdaHcCj4JPg0+C/rBYTAIvglOgtOABS74Ofgl+LX1W+uP1p+tv5ahN2+sMHeCRmv9/Q/4S4tY</latexit>
2. N = {a, c}.<latexit sha1_base64="UnWGOPG7NpsLB9xNGGE4KhYy81s=">AAAHQHicfVVdjxs1FJ0WCGX42lLxxIvLNhKqJtlkq2W7oJUiqCoqtbCQbFtpJ1o8njsZK7ZnsD3dpNb8GF7hX/Av+Ae8IV554jofbCa7YCkZj33POb7XZ+ykFNzYXu/3GzffePOt1tu33gnffe/9Dz7cuf3Rc1NUmsEpK0ShXybUgOAKTi23Al6WGqhMBLxIpl/7+RevQBteqJGdlzCWdKJ4xhm1OHS+8/F+N/6S3PuWHJPY0YiwuL7XDc93dnvd3qKRq53+qrMbrNrJ+e3WnTgtWCVBWSaoMWf9XmnHjmrLmYA6jCsDJWVTOoEz7CoqwYzdYv01aeNISrJC409ZshgNNyHIo+m8weIsTSpB9aw5mhTFFGdMHYZNTZs9HDuuysqCYkvJrBLEFsSXhaRcA7NiTpq6lk9fR4ozyDRlEZVGUptHJffrjOz0dWeiaZlHkk6BgRCXQ8tVebjgiaZ67lMoLkyUIPNEF5VKTVRSa0Erg3ir+SwyOS3BRBm3EaOC+ffUY0pRWEn11PwXa1eCpTi5qJwA60ZVZuEHSGunIb37sHc3Eai7GWFzmGgAVbvFw8dc5NzCVkwiKqid/9+ICNskt7Y0X+ztWZh1jUVumLGcqgl0WSH3fqrAeH+Zvf7nB0f7R3sGJEcbJug62bngNu/4JDpcdRI0K+hF3IPD3eUjjH1BKZrZ1yeMJ6JIqIjxNfawAShTaRikhUADDNDKrEjhONYg6GyNLXDxTROdjfpj5zfOG6CxyyejIVW+uBoUXGACkqrUxRmVXMxTyGglbO1ik637TZOYzLuiDtubYgZ3ENLjXvcoYpKjKNpCoOVRwM5M5imaSSJ3rOzMUw2WYGfun+G3djCut5N6BPiRaRjOZVKIx5iSW7KY2n337GntlJeQvHaydhyXGw/BXheMA+k2JFlBVhoeMKwS3E5b+S29XmBbYfj4mS/JWmDUb5TPJbPaGXEp4oOXaPcEI30NqChzWl8u9ccnW1VPJwI4yzvL2l83gxtt8Hhpng/S02zushzyiUSleOkqT+fiRLp4OV5fsYV8isdreh1iNVE3Je7Hs4TqMzRfnCfFzMWv/H87jHNdCSA58Elu8XQ9PCgtaZNRDoQyW1FBEBbGUzwhet39A5i1ybq1ySO8GqhiQBKwF/j9+liCYsQsyhgupdohIQuCTq/bB9leo4d5obE6XE1IoQiaigjILDE8BY/YyGu3X/9LghfAg/8l0YtMFiy1rwJeI/3tS+Nq5/l+t4/L+35/d/DV6kK5FXwSfBp8FvSDw2AQfBOcBKcBC1zwc/BL8Gvrt9YfrT9bfy1Db95YYe4Ejdb6+x//JYtZ</latexit><latexit sha1_base64="UnWGOPG7NpsLB9xNGGE4KhYy81s=">AAAHQHicfVVdjxs1FJ0WCGX42lLxxIvLNhKqJtlkq2W7oJUiqCoqtbCQbFtpJ1o8njsZK7ZnsD3dpNb8GF7hX/Av+Ae8IV554jofbCa7YCkZj33POb7XZ+ykFNzYXu/3GzffePOt1tu33gnffe/9Dz7cuf3Rc1NUmsEpK0ShXybUgOAKTi23Al6WGqhMBLxIpl/7+RevQBteqJGdlzCWdKJ4xhm1OHS+8/F+N/6S3PuWHJPY0YiwuL7XDc93dnvd3qKRq53+qrMbrNrJ+e3WnTgtWCVBWSaoMWf9XmnHjmrLmYA6jCsDJWVTOoEz7CoqwYzdYv01aeNISrJC409ZshgNNyHIo+m8weIsTSpB9aw5mhTFFGdMHYZNTZs9HDuuysqCYkvJrBLEFsSXhaRcA7NiTpq6lk9fR4ozyDRlEZVGUptHJffrjOz0dWeiaZlHkk6BgRCXQ8tVebjgiaZ67lMoLkyUIPNEF5VKTVRSa0Erg3ir+SwyOS3BRBm3EaOC+ffUY0pRWEn11PwXa1eCpTi5qJwA60ZVZuEHSGunIb37sHc3Eai7GWFzmGgAVbvFw8dc5NzCVkwiKqid/9+ICNskt7Y0X+ztWZh1jUVumLGcqgl0WSH3fqrAeH+Zvf7nB0f7R3sGJEcbJug62bngNu/4JDpcdRI0K+hF3IPD3eUjjH1BKZrZ1yeMJ6JIqIjxNfawAShTaRikhUADDNDKrEjhONYg6GyNLXDxTROdjfpj5zfOG6CxyyejIVW+uBoUXGACkqrUxRmVXMxTyGglbO1ik637TZOYzLuiDtubYgZ3ENLjXvcoYpKjKNpCoOVRwM5M5imaSSJ3rOzMUw2WYGfun+G3djCut5N6BPiRaRjOZVKIx5iSW7KY2n337GntlJeQvHaydhyXGw/BXheMA+k2JFlBVhoeMKwS3E5b+S29XmBbYfj4mS/JWmDUb5TPJbPaGXEp4oOXaPcEI30NqChzWl8u9ccnW1VPJwI4yzvL2l83gxtt8Hhpng/S02zushzyiUSleOkqT+fiRLp4OV5fsYV8isdreh1iNVE3Je7Hs4TqMzRfnCfFzMWv/H87jHNdCSA58Elu8XQ9PCgtaZNRDoQyW1FBEBbGUzwhet39A5i1ybq1ySO8GqhiQBKwF/j9+liCYsQsyhgupdohIQuCTq/bB9leo4d5obE6XE1IoQiaigjILDE8BY/YyGu3X/9LghfAg/8l0YtMFiy1rwJeI/3tS+Nq5/l+t4/L+35/d/DV6kK5FXwSfBp8FvSDw2AQfBOcBKcBC1zwc/BL8Gvrt9YfrT9bfy1Db95YYe4Ejdb6+x//JYtZ</latexit><latexit sha1_base64="UnWGOPG7NpsLB9xNGGE4KhYy81s=">AAAHQHicfVVdjxs1FJ0WCGX42lLxxIvLNhKqJtlkq2W7oJUiqCoqtbCQbFtpJ1o8njsZK7ZnsD3dpNb8GF7hX/Av+Ae8IV554jofbCa7YCkZj33POb7XZ+ykFNzYXu/3GzffePOt1tu33gnffe/9Dz7cuf3Rc1NUmsEpK0ShXybUgOAKTi23Al6WGqhMBLxIpl/7+RevQBteqJGdlzCWdKJ4xhm1OHS+8/F+N/6S3PuWHJPY0YiwuL7XDc93dnvd3qKRq53+qrMbrNrJ+e3WnTgtWCVBWSaoMWf9XmnHjmrLmYA6jCsDJWVTOoEz7CoqwYzdYv01aeNISrJC409ZshgNNyHIo+m8weIsTSpB9aw5mhTFFGdMHYZNTZs9HDuuysqCYkvJrBLEFsSXhaRcA7NiTpq6lk9fR4ozyDRlEZVGUptHJffrjOz0dWeiaZlHkk6BgRCXQ8tVebjgiaZ67lMoLkyUIPNEF5VKTVRSa0Erg3ir+SwyOS3BRBm3EaOC+ffUY0pRWEn11PwXa1eCpTi5qJwA60ZVZuEHSGunIb37sHc3Eai7GWFzmGgAVbvFw8dc5NzCVkwiKqid/9+ICNskt7Y0X+ztWZh1jUVumLGcqgl0WSH3fqrAeH+Zvf7nB0f7R3sGJEcbJug62bngNu/4JDpcdRI0K+hF3IPD3eUjjH1BKZrZ1yeMJ6JIqIjxNfawAShTaRikhUADDNDKrEjhONYg6GyNLXDxTROdjfpj5zfOG6CxyyejIVW+uBoUXGACkqrUxRmVXMxTyGglbO1ik637TZOYzLuiDtubYgZ3ENLjXvcoYpKjKNpCoOVRwM5M5imaSSJ3rOzMUw2WYGfun+G3djCut5N6BPiRaRjOZVKIx5iSW7KY2n337GntlJeQvHaydhyXGw/BXheMA+k2JFlBVhoeMKwS3E5b+S29XmBbYfj4mS/JWmDUb5TPJbPaGXEp4oOXaPcEI30NqChzWl8u9ccnW1VPJwI4yzvL2l83gxtt8Hhpng/S02zushzyiUSleOkqT+fiRLp4OV5fsYV8isdreh1iNVE3Je7Hs4TqMzRfnCfFzMWv/H87jHNdCSA58Elu8XQ9PCgtaZNRDoQyW1FBEBbGUzwhet39A5i1ybq1ySO8GqhiQBKwF/j9+liCYsQsyhgupdohIQuCTq/bB9leo4d5obE6XE1IoQiaigjILDE8BY/YyGu3X/9LghfAg/8l0YtMFiy1rwJeI/3tS+Nq5/l+t4/L+35/d/DV6kK5FXwSfBp8FvSDw2AQfBOcBKcBC1zwc/BL8Gvrt9YfrT9bfy1Db95YYe4Ejdb6+x//JYtZ</latexit><latexit sha1_base64="UnWGOPG7NpsLB9xNGGE4KhYy81s=">AAAHQHicfVVdjxs1FJ0WCGX42lLxxIvLNhKqJtlkq2W7oJUiqCoqtbCQbFtpJ1o8njsZK7ZnsD3dpNb8GF7hX/Av+Ae8IV554jofbCa7YCkZj33POb7XZ+ykFNzYXu/3GzffePOt1tu33gnffe/9Dz7cuf3Rc1NUmsEpK0ShXybUgOAKTi23Al6WGqhMBLxIpl/7+RevQBteqJGdlzCWdKJ4xhm1OHS+8/F+N/6S3PuWHJPY0YiwuL7XDc93dnvd3qKRq53+qrMbrNrJ+e3WnTgtWCVBWSaoMWf9XmnHjmrLmYA6jCsDJWVTOoEz7CoqwYzdYv01aeNISrJC409ZshgNNyHIo+m8weIsTSpB9aw5mhTFFGdMHYZNTZs9HDuuysqCYkvJrBLEFsSXhaRcA7NiTpq6lk9fR4ozyDRlEZVGUptHJffrjOz0dWeiaZlHkk6BgRCXQ8tVebjgiaZ67lMoLkyUIPNEF5VKTVRSa0Erg3ir+SwyOS3BRBm3EaOC+ffUY0pRWEn11PwXa1eCpTi5qJwA60ZVZuEHSGunIb37sHc3Eai7GWFzmGgAVbvFw8dc5NzCVkwiKqid/9+ICNskt7Y0X+ztWZh1jUVumLGcqgl0WSH3fqrAeH+Zvf7nB0f7R3sGJEcbJug62bngNu/4JDpcdRI0K+hF3IPD3eUjjH1BKZrZ1yeMJ6JIqIjxNfawAShTaRikhUADDNDKrEjhONYg6GyNLXDxTROdjfpj5zfOG6CxyyejIVW+uBoUXGACkqrUxRmVXMxTyGglbO1ik637TZOYzLuiDtubYgZ3ENLjXvcoYpKjKNpCoOVRwM5M5imaSSJ3rOzMUw2WYGfun+G3djCut5N6BPiRaRjOZVKIx5iSW7KY2n337GntlJeQvHaydhyXGw/BXheMA+k2JFlBVhoeMKwS3E5b+S29XmBbYfj4mS/JWmDUb5TPJbPaGXEp4oOXaPcEI30NqChzWl8u9ccnW1VPJwI4yzvL2l83gxtt8Hhpng/S02zushzyiUSleOkqT+fiRLp4OV5fsYV8isdreh1iNVE3Je7Hs4TqMzRfnCfFzMWv/H87jHNdCSA58Elu8XQ9PCgtaZNRDoQyW1FBEBbGUzwhet39A5i1ybq1ySO8GqhiQBKwF/j9+liCYsQsyhgupdohIQuCTq/bB9leo4d5obE6XE1IoQiaigjILDE8BY/YyGu3X/9LghfAg/8l0YtMFiy1rwJeI/3tS+Nq5/l+t4/L+35/d/DV6kK5FXwSfBp8FvSDw2AQfBOcBKcBC1zwc/BL8Gvrt9YfrT9bfy1Db95YYe4Ejdb6+x//JYtZ</latexit>
3. N = {a, c, b}.<latexit sha1_base64="mSDh8p6Sw4A+jd6Q91R/Xl/FxcY=">AAAHQ3icfVVdjxs1FJ0WCGX46Ja+IPHiso2Eqkk22dWyXdBKEVQVlVpYSLattBMtHs+djBXbM9ieblJr+DW8wr/gR/AbeEO8InGdZNlMdsFSMh77nnN8r8/YSSm4sb3e7zduvvHmW623b70Tvvve+x/c3rrz4XNTVJrBCStEoV8m1IDgCk4stwJelhqoTAS8SKZf+fkXr0AbXqiRnZcwlnSieMYZtTh0tvXRXjf+gtz/hhyR2NGIsIgkcX2/G55tbfe6vUUjVzv9VWc7WLXjszutu3FasEqCskxQY077vdKOHdWWMwF1GFcGSsqmdAKn2FVUghm7RQo1aeNISrJC409ZshgN1yHIo+m8weIsTSpB9aw5mhTFFGdMHYZNTZs9HDuuysqCYkvJrBLEFsRXhqRcA7NiTpq6lk9fR4ozyDRlEZVGUptHJffrjOz0dWeiaZlHkk6BgRCXQ8tVebjgiaZ67lMozk2UIPNEF5VKTVRSa0Erg3ir+SwyOS3BRBm3EaOC+ffUY0pRWEn11PwXa1eCpTi5qJwA60ZVZuF7SGunIb33sHcvEai7HmFzmGgAVbvFw8ec59zCRkwiKqid/1+LCNskt7Y0n+/sWJh1jUVumLGcqgl0WSF3fqzAeIuZnf5n+4e7hzsGJEcnJmg82TnnNu/4JDpcdRL0K+hF3N7B9vIRxr6gFP3s6xPGE1EkVMT4GnvYAJSpNAzSQqABBuhmVqRwFGsQdHaBLXDxTROdjvpj5zfOG6Cxy8ejIVW+uBoUnGMCkqrUxRmVXMxTyGglbO1ik130myYxmXdFHbbXxQzuIKRHve5hxCRHUbSFQMujgJ2ZzFM0k0TuWNmZpxoswc48OMVvbX9cbyb1CPAj0zCcy6QQjzElt2Qxtfv22dPaKS8hee1k7TguNx6CvS4YB9JNSLKCrDQ8YFgluJ228lt6vcCmwvDxM1+SC4FRv1E+l8xqZ8SliA9eot0TjPQ1oKLMaX251B+ebFQ9nQjgLO8sa3/dDG60weOleT5IT7O+y3LIJxKV4qWrPJ2LE+ni5Xh9xRbyKZ6w6XWI1UTdlHgQzxKqT9F8cZ4UMxe/8v/tMM51JYDkwCe5xdP1YL+0pE1GORDKbEUFQVgYT/GE6HV392HWJhetTR7h7UAVA5KAPcfv18cSFCNmUcZwKdUOCVkQdHrdPsj2BXqYFxqrw9WEFIqgqYiAzBLDU/CItby2+/W/JHgB7P0viV5ksmCpfRXwGulvXhpXO893u31c3ne724MvVxfKreDj4JPg06AfHASD4OvgODgJWPBT8HPwS/Br67fWH60/W38tQ2/eWGHuBo3W+vsfL+KMJg==</latexit><latexit sha1_base64="mSDh8p6Sw4A+jd6Q91R/Xl/FxcY=">AAAHQ3icfVVdjxs1FJ0WCGX46Ja+IPHiso2Eqkk22dWyXdBKEVQVlVpYSLattBMtHs+djBXbM9ieblJr+DW8wr/gR/AbeEO8InGdZNlMdsFSMh77nnN8r8/YSSm4sb3e7zduvvHmW623b70Tvvve+x/c3rrz4XNTVJrBCStEoV8m1IDgCk4stwJelhqoTAS8SKZf+fkXr0AbXqiRnZcwlnSieMYZtTh0tvXRXjf+gtz/hhyR2NGIsIgkcX2/G55tbfe6vUUjVzv9VWc7WLXjszutu3FasEqCskxQY077vdKOHdWWMwF1GFcGSsqmdAKn2FVUghm7RQo1aeNISrJC409ZshgN1yHIo+m8weIsTSpB9aw5mhTFFGdMHYZNTZs9HDuuysqCYkvJrBLEFsRXhqRcA7NiTpq6lk9fR4ozyDRlEZVGUptHJffrjOz0dWeiaZlHkk6BgRCXQ8tVebjgiaZ67lMozk2UIPNEF5VKTVRSa0Erg3ir+SwyOS3BRBm3EaOC+ffUY0pRWEn11PwXa1eCpTi5qJwA60ZVZuF7SGunIb33sHcvEai7HmFzmGgAVbvFw8ec59zCRkwiKqid/1+LCNskt7Y0n+/sWJh1jUVumLGcqgl0WSF3fqzAeIuZnf5n+4e7hzsGJEcnJmg82TnnNu/4JDpcdRL0K+hF3N7B9vIRxr6gFP3s6xPGE1EkVMT4GnvYAJSpNAzSQqABBuhmVqRwFGsQdHaBLXDxTROdjvpj5zfOG6Cxy8ejIVW+uBoUnGMCkqrUxRmVXMxTyGglbO1ik130myYxmXdFHbbXxQzuIKRHve5hxCRHUbSFQMujgJ2ZzFM0k0TuWNmZpxoswc48OMVvbX9cbyb1CPAj0zCcy6QQjzElt2Qxtfv22dPaKS8hee1k7TguNx6CvS4YB9JNSLKCrDQ8YFgluJ228lt6vcCmwvDxM1+SC4FRv1E+l8xqZ8SliA9eot0TjPQ1oKLMaX251B+ebFQ9nQjgLO8sa3/dDG60weOleT5IT7O+y3LIJxKV4qWrPJ2LE+ni5Xh9xRbyKZ6w6XWI1UTdlHgQzxKqT9F8cZ4UMxe/8v/tMM51JYDkwCe5xdP1YL+0pE1GORDKbEUFQVgYT/GE6HV392HWJhetTR7h7UAVA5KAPcfv18cSFCNmUcZwKdUOCVkQdHrdPsj2BXqYFxqrw9WEFIqgqYiAzBLDU/CItby2+/W/JHgB7P0viV5ksmCpfRXwGulvXhpXO893u31c3ne724MvVxfKreDj4JPg06AfHASD4OvgODgJWPBT8HPwS/Br67fWH60/W38tQ2/eWGHuBo3W+vsfL+KMJg==</latexit><latexit sha1_base64="mSDh8p6Sw4A+jd6Q91R/Xl/FxcY=">AAAHQ3icfVVdjxs1FJ0WCGX46Ja+IPHiso2Eqkk22dWyXdBKEVQVlVpYSLattBMtHs+djBXbM9ieblJr+DW8wr/gR/AbeEO8InGdZNlMdsFSMh77nnN8r8/YSSm4sb3e7zduvvHmW623b70Tvvve+x/c3rrz4XNTVJrBCStEoV8m1IDgCk4stwJelhqoTAS8SKZf+fkXr0AbXqiRnZcwlnSieMYZtTh0tvXRXjf+gtz/hhyR2NGIsIgkcX2/G55tbfe6vUUjVzv9VWc7WLXjszutu3FasEqCskxQY077vdKOHdWWMwF1GFcGSsqmdAKn2FVUghm7RQo1aeNISrJC409ZshgN1yHIo+m8weIsTSpB9aw5mhTFFGdMHYZNTZs9HDuuysqCYkvJrBLEFsRXhqRcA7NiTpq6lk9fR4ozyDRlEZVGUptHJffrjOz0dWeiaZlHkk6BgRCXQ8tVebjgiaZ67lMozk2UIPNEF5VKTVRSa0Erg3ir+SwyOS3BRBm3EaOC+ffUY0pRWEn11PwXa1eCpTi5qJwA60ZVZuF7SGunIb33sHcvEai7HmFzmGgAVbvFw8ec59zCRkwiKqid/1+LCNskt7Y0n+/sWJh1jUVumLGcqgl0WSF3fqzAeIuZnf5n+4e7hzsGJEcnJmg82TnnNu/4JDpcdRL0K+hF3N7B9vIRxr6gFP3s6xPGE1EkVMT4GnvYAJSpNAzSQqABBuhmVqRwFGsQdHaBLXDxTROdjvpj5zfOG6Cxy8ejIVW+uBoUnGMCkqrUxRmVXMxTyGglbO1ik130myYxmXdFHbbXxQzuIKRHve5hxCRHUbSFQMujgJ2ZzFM0k0TuWNmZpxoswc48OMVvbX9cbyb1CPAj0zCcy6QQjzElt2Qxtfv22dPaKS8hee1k7TguNx6CvS4YB9JNSLKCrDQ8YFgluJ228lt6vcCmwvDxM1+SC4FRv1E+l8xqZ8SliA9eot0TjPQ1oKLMaX251B+ebFQ9nQjgLO8sa3/dDG60weOleT5IT7O+y3LIJxKV4qWrPJ2LE+ni5Xh9xRbyKZ6w6XWI1UTdlHgQzxKqT9F8cZ4UMxe/8v/tMM51JYDkwCe5xdP1YL+0pE1GORDKbEUFQVgYT/GE6HV392HWJhetTR7h7UAVA5KAPcfv18cSFCNmUcZwKdUOCVkQdHrdPsj2BXqYFxqrw9WEFIqgqYiAzBLDU/CItby2+/W/JHgB7P0viV5ksmCpfRXwGulvXhpXO893u31c3ne724MvVxfKreDj4JPg06AfHASD4OvgODgJWPBT8HPwS/Br67fWH60/W38tQ2/eWGHuBo3W+vsfL+KMJg==</latexit><latexit sha1_base64="mSDh8p6Sw4A+jd6Q91R/Xl/FxcY=">AAAHQ3icfVVdjxs1FJ0WCGX46Ja+IPHiso2Eqkk22dWyXdBKEVQVlVpYSLattBMtHs+djBXbM9ieblJr+DW8wr/gR/AbeEO8InGdZNlMdsFSMh77nnN8r8/YSSm4sb3e7zduvvHmW623b70Tvvve+x/c3rrz4XNTVJrBCStEoV8m1IDgCk4stwJelhqoTAS8SKZf+fkXr0AbXqiRnZcwlnSieMYZtTh0tvXRXjf+gtz/hhyR2NGIsIgkcX2/G55tbfe6vUUjVzv9VWc7WLXjszutu3FasEqCskxQY077vdKOHdWWMwF1GFcGSsqmdAKn2FVUghm7RQo1aeNISrJC409ZshgN1yHIo+m8weIsTSpB9aw5mhTFFGdMHYZNTZs9HDuuysqCYkvJrBLEFsRXhqRcA7NiTpq6lk9fR4ozyDRlEZVGUptHJffrjOz0dWeiaZlHkk6BgRCXQ8tVebjgiaZ67lMozk2UIPNEF5VKTVRSa0Erg3ir+SwyOS3BRBm3EaOC+ffUY0pRWEn11PwXa1eCpTi5qJwA60ZVZuF7SGunIb33sHcvEai7HmFzmGgAVbvFw8ec59zCRkwiKqid/1+LCNskt7Y0n+/sWJh1jUVumLGcqgl0WSF3fqzAeIuZnf5n+4e7hzsGJEcnJmg82TnnNu/4JDpcdRL0K+hF3N7B9vIRxr6gFP3s6xPGE1EkVMT4GnvYAJSpNAzSQqABBuhmVqRwFGsQdHaBLXDxTROdjvpj5zfOG6Cxy8ejIVW+uBoUnGMCkqrUxRmVXMxTyGglbO1ik130myYxmXdFHbbXxQzuIKRHve5hxCRHUbSFQMujgJ2ZzFM0k0TuWNmZpxoswc48OMVvbX9cbyb1CPAj0zCcy6QQjzElt2Qxtfv22dPaKS8hee1k7TguNx6CvS4YB9JNSLKCrDQ8YFgluJ228lt6vcCmwvDxM1+SC4FRv1E+l8xqZ8SliA9eot0TjPQ1oKLMaX251B+ebFQ9nQjgLO8sa3/dDG60weOleT5IT7O+y3LIJxKV4qWrPJ2LE+ni5Xh9xRbyKZ6w6XWI1UTdlHgQzxKqT9F8cZ4UMxe/8v/tMM51JYDkwCe5xdP1YL+0pE1GORDKbEUFQVgYT/GE6HV392HWJhetTR7h7UAVA5KAPcfv18cSFCNmUcZwKdUOCVkQdHrdPsj2BXqYFxqrw9WEFIqgqYiAzBLDU/CItby2+/W/JHgB7P0viV5ksmCpfRXwGulvXhpXO893u31c3ne724MvVxfKreDj4JPg06AfHASD4OvgODgJWPBT8HPwS/Br67fWH60/W38tQ2/eWGHuBo3W+vsfL+KMJg==</latexit>
0. N = ;.<latexit sha1_base64="koOJt4XUWyg16qZo3FixiqcvPXI=">AAAHQXicfVVdb9s2FFXbzeu0j6YtsJe9sEsNDIXt2CmyNBsCGFtRrEC7ZbPTFoiMjJKuJMIkpZFUI5fTn9nr9i/2K/YT9jbsdS+7tJzFcrIRsEWR95zDe3lEhgVn2gyHv1+7fuOttzvv3HzXf+/9Dz68tXX7zgudlyqC4yjnuXoVUg2cSTg2zHB4VSigIuTwMpx/5eZfvgalWS6nZlHATNBUsoRF1ODQ6dZHw0HwBbn/DTkkAYjCLDSY+wP/dGt7OBguG7ncGa06296qHZ3e7twN4jwqBUgTcar1yWhYmJmlyrCIQ+0HpYaCRnOawgl2JRWgZ3aZQE26OBKTJFf4k4YsR/11CPIoumixWEPDklNVtUfDPJ/jjK59v61pkkczy2RRGpBRI5mUnJicuLqQmCmIDF+Qtq5h8zc9ySJIFI16VGhBTdYrmFtnz8zf9FNFi6wn6Bwi4PxiqFmVg3MWKqoWLoX8TPdCZE5VXspY9wpqDCipEW8Uq3o6owXoXsJML6I8cu+xwxQ8N4Kquf4v1oEAQ3FyWTkOxk7LxMD3ENdWQXzv0fBeyFF3PcJkkCoAWdvlw8WcZczARkzIS6it+1+L8LskM6bQn+/sGKgG2iA3VFFGZQqDKBc7P5agncH0zuizvYPdgx0NgqEPQ7Sd6J8xk/VdEn0m+yG6FdQy7uH+dvPwA1dQim529fGDlOch5QG+Bg42BqlLBeM452iAMXo5ymM4DBRwWp1jc1x820Qn09HMuo1zBmjt8tF0QqUrrgIJZ5iAoDK2QUIF44sYElpyU9tAJ+f9tkl04lxR+911MY07CPHhcHDQiwRDUbQFR8ujgKl04ijaSSJ3IE3lqMYN2OoHJ/it7c3qzaQeA35kCiYLEeb8CaZkGxZd22+fP6utdBKC1VbUluFygwmYq4JxIN6EhCvISsMBJmWI22lKt6VXC2wqTJ48dyU5F5iOWuWzYVVbzS9EXHCDtk8x0tWA8iKj9cVSf3i6UfU45cCirN/U/qoZ3GiNx0v7fBCOZn2XxYSlApWCxlWOzgahsEEzXl+yhXiG52t8FWI1UbclHgRVSNUJmi/IwryywWv33/WDTJUcSAYszQyervt7hSFdMs2A0MiUlBOE+cEcT4jhYHcPqi45b13yGO8GKiMgIZgz/H5dLEExopdl9Buprk/IkqA/HIxAdM/RkyxXWB0mU5JLgqYiHBJDNIvBIdby2h7V/5LgBfDwf0nUMpMlS+2qgNfIaPPSuNx5sTsY4fK+290ef7m6UG56H3ufeJ96I2/fG3tfe0fesRd5P3k/e794v3Z+6/zR+bPzVxN6/doKc9drtc7f/wCI04x4</latexit><latexit sha1_base64="koOJt4XUWyg16qZo3FixiqcvPXI=">AAAHQXicfVVdb9s2FFXbzeu0j6YtsJe9sEsNDIXt2CmyNBsCGFtRrEC7ZbPTFoiMjJKuJMIkpZFUI5fTn9nr9i/2K/YT9jbsdS+7tJzFcrIRsEWR95zDe3lEhgVn2gyHv1+7fuOttzvv3HzXf+/9Dz68tXX7zgudlyqC4yjnuXoVUg2cSTg2zHB4VSigIuTwMpx/5eZfvgalWS6nZlHATNBUsoRF1ODQ6dZHw0HwBbn/DTkkAYjCLDSY+wP/dGt7OBguG7ncGa06296qHZ3e7twN4jwqBUgTcar1yWhYmJmlyrCIQ+0HpYaCRnOawgl2JRWgZ3aZQE26OBKTJFf4k4YsR/11CPIoumixWEPDklNVtUfDPJ/jjK59v61pkkczy2RRGpBRI5mUnJicuLqQmCmIDF+Qtq5h8zc9ySJIFI16VGhBTdYrmFtnz8zf9FNFi6wn6Bwi4PxiqFmVg3MWKqoWLoX8TPdCZE5VXspY9wpqDCipEW8Uq3o6owXoXsJML6I8cu+xwxQ8N4Kquf4v1oEAQ3FyWTkOxk7LxMD3ENdWQXzv0fBeyFF3PcJkkCoAWdvlw8WcZczARkzIS6it+1+L8LskM6bQn+/sGKgG2iA3VFFGZQqDKBc7P5agncH0zuizvYPdgx0NgqEPQ7Sd6J8xk/VdEn0m+yG6FdQy7uH+dvPwA1dQim529fGDlOch5QG+Bg42BqlLBeM452iAMXo5ymM4DBRwWp1jc1x820Qn09HMuo1zBmjt8tF0QqUrrgIJZ5iAoDK2QUIF44sYElpyU9tAJ+f9tkl04lxR+911MY07CPHhcHDQiwRDUbQFR8ujgKl04ijaSSJ3IE3lqMYN2OoHJ/it7c3qzaQeA35kCiYLEeb8CaZkGxZd22+fP6utdBKC1VbUluFygwmYq4JxIN6EhCvISsMBJmWI22lKt6VXC2wqTJ48dyU5F5iOWuWzYVVbzS9EXHCDtk8x0tWA8iKj9cVSf3i6UfU45cCirN/U/qoZ3GiNx0v7fBCOZn2XxYSlApWCxlWOzgahsEEzXl+yhXiG52t8FWI1UbclHgRVSNUJmi/IwryywWv33/WDTJUcSAYszQyervt7hSFdMs2A0MiUlBOE+cEcT4jhYHcPqi45b13yGO8GKiMgIZgz/H5dLEExopdl9Buprk/IkqA/HIxAdM/RkyxXWB0mU5JLgqYiHBJDNIvBIdby2h7V/5LgBfDwf0nUMpMlS+2qgNfIaPPSuNx5sTsY4fK+290ef7m6UG56H3ufeJ96I2/fG3tfe0fesRd5P3k/e794v3Z+6/zR+bPzVxN6/doKc9drtc7f/wCI04x4</latexit><latexit sha1_base64="koOJt4XUWyg16qZo3FixiqcvPXI=">AAAHQXicfVVdb9s2FFXbzeu0j6YtsJe9sEsNDIXt2CmyNBsCGFtRrEC7ZbPTFoiMjJKuJMIkpZFUI5fTn9nr9i/2K/YT9jbsdS+7tJzFcrIRsEWR95zDe3lEhgVn2gyHv1+7fuOttzvv3HzXf+/9Dz68tXX7zgudlyqC4yjnuXoVUg2cSTg2zHB4VSigIuTwMpx/5eZfvgalWS6nZlHATNBUsoRF1ODQ6dZHw0HwBbn/DTkkAYjCLDSY+wP/dGt7OBguG7ncGa06296qHZ3e7twN4jwqBUgTcar1yWhYmJmlyrCIQ+0HpYaCRnOawgl2JRWgZ3aZQE26OBKTJFf4k4YsR/11CPIoumixWEPDklNVtUfDPJ/jjK59v61pkkczy2RRGpBRI5mUnJicuLqQmCmIDF+Qtq5h8zc9ySJIFI16VGhBTdYrmFtnz8zf9FNFi6wn6Bwi4PxiqFmVg3MWKqoWLoX8TPdCZE5VXspY9wpqDCipEW8Uq3o6owXoXsJML6I8cu+xwxQ8N4Kquf4v1oEAQ3FyWTkOxk7LxMD3ENdWQXzv0fBeyFF3PcJkkCoAWdvlw8WcZczARkzIS6it+1+L8LskM6bQn+/sGKgG2iA3VFFGZQqDKBc7P5agncH0zuizvYPdgx0NgqEPQ7Sd6J8xk/VdEn0m+yG6FdQy7uH+dvPwA1dQim529fGDlOch5QG+Bg42BqlLBeM452iAMXo5ymM4DBRwWp1jc1x820Qn09HMuo1zBmjt8tF0QqUrrgIJZ5iAoDK2QUIF44sYElpyU9tAJ+f9tkl04lxR+911MY07CPHhcHDQiwRDUbQFR8ujgKl04ijaSSJ3IE3lqMYN2OoHJ/it7c3qzaQeA35kCiYLEeb8CaZkGxZd22+fP6utdBKC1VbUluFygwmYq4JxIN6EhCvISsMBJmWI22lKt6VXC2wqTJ48dyU5F5iOWuWzYVVbzS9EXHCDtk8x0tWA8iKj9cVSf3i6UfU45cCirN/U/qoZ3GiNx0v7fBCOZn2XxYSlApWCxlWOzgahsEEzXl+yhXiG52t8FWI1UbclHgRVSNUJmi/IwryywWv33/WDTJUcSAYszQyervt7hSFdMs2A0MiUlBOE+cEcT4jhYHcPqi45b13yGO8GKiMgIZgz/H5dLEExopdl9Buprk/IkqA/HIxAdM/RkyxXWB0mU5JLgqYiHBJDNIvBIdby2h7V/5LgBfDwf0nUMpMlS+2qgNfIaPPSuNx5sTsY4fK+290ef7m6UG56H3ufeJ96I2/fG3tfe0fesRd5P3k/e794v3Z+6/zR+bPzVxN6/doKc9drtc7f/wCI04x4</latexit><latexit sha1_base64="koOJt4XUWyg16qZo3FixiqcvPXI=">AAAHQXicfVVdb9s2FFXbzeu0j6YtsJe9sEsNDIXt2CmyNBsCGFtRrEC7ZbPTFoiMjJKuJMIkpZFUI5fTn9nr9i/2K/YT9jbsdS+7tJzFcrIRsEWR95zDe3lEhgVn2gyHv1+7fuOttzvv3HzXf+/9Dz68tXX7zgudlyqC4yjnuXoVUg2cSTg2zHB4VSigIuTwMpx/5eZfvgalWS6nZlHATNBUsoRF1ODQ6dZHw0HwBbn/DTkkAYjCLDSY+wP/dGt7OBguG7ncGa06296qHZ3e7twN4jwqBUgTcar1yWhYmJmlyrCIQ+0HpYaCRnOawgl2JRWgZ3aZQE26OBKTJFf4k4YsR/11CPIoumixWEPDklNVtUfDPJ/jjK59v61pkkczy2RRGpBRI5mUnJicuLqQmCmIDF+Qtq5h8zc9ySJIFI16VGhBTdYrmFtnz8zf9FNFi6wn6Bwi4PxiqFmVg3MWKqoWLoX8TPdCZE5VXspY9wpqDCipEW8Uq3o6owXoXsJML6I8cu+xwxQ8N4Kquf4v1oEAQ3FyWTkOxk7LxMD3ENdWQXzv0fBeyFF3PcJkkCoAWdvlw8WcZczARkzIS6it+1+L8LskM6bQn+/sGKgG2iA3VFFGZQqDKBc7P5agncH0zuizvYPdgx0NgqEPQ7Sd6J8xk/VdEn0m+yG6FdQy7uH+dvPwA1dQim529fGDlOch5QG+Bg42BqlLBeM452iAMXo5ymM4DBRwWp1jc1x820Qn09HMuo1zBmjt8tF0QqUrrgIJZ5iAoDK2QUIF44sYElpyU9tAJ+f9tkl04lxR+911MY07CPHhcHDQiwRDUbQFR8ujgKl04ijaSSJ3IE3lqMYN2OoHJ/it7c3qzaQeA35kCiYLEeb8CaZkGxZd22+fP6utdBKC1VbUluFygwmYq4JxIN6EhCvISsMBJmWI22lKt6VXC2wqTJ48dyU5F5iOWuWzYVVbzS9EXHCDtk8x0tWA8iKj9cVSf3i6UfU45cCirN/U/qoZ3GiNx0v7fBCOZn2XxYSlApWCxlWOzgahsEEzXl+yhXiG52t8FWI1UbclHgRVSNUJmi/IwryywWv33/WDTJUcSAYszQyervt7hSFdMs2A0MiUlBOE+cEcT4jhYHcPqi45b13yGO8GKiMgIZgz/H5dLEExopdl9Buprk/IkqA/HIxAdM/RkyxXWB0mU5JLgqYiHBJDNIvBIdby2h7V/5LgBfDwf0nUMpMlS+2qgNfIaPPSuNx5sTsY4fK+290ef7m6UG56H3ufeJ96I2/fG3tfe0fesRd5P3k/e794v3Z+6/zR+bPzVxN6/doKc9drtc7f/wCI04x4</latexit>
1. N = {a, c, d}.<latexit sha1_base64="cQc0H4GWbHtVI0fEsTgfVT1qu8Q=">AAAHQ3icfVVdjxs1FJ22EMrw0W37gsSLyzYSqibZZKtlu6CVIqgqKrWwkGxbaSdaPJ47GSu2Z7A93aTW8Gt4hX/Bj+A38IZ4ReI6ybKZ7IKlZDz2Pef4Xp+xk1JwY3u9369dv/HW2613br4bvvf+Bx/e2rp954UpKs3gmBWi0K8SakBwBceWWwGvSg1UJgJeJtOv/PzL16ANL9TIzksYSzpRPOOMWhw63fqo342/IPe/IYckdjQiLCJpXN/vhqdb271ub9HI5U5/1dkOVu3o9HbrbpwWrJKgLBPUmJN+r7RjR7XlTEAdxpWBkrIpncAJdhWVYMZukUJN2jiSkqzQ+FOWLEbDdQjyaDpvsDhLk0pQPWuOJkUxxRlTh2FT02aPxo6rsrKg2FIyqwSxBfGVISnXwKyYk6au5dM3keIMMk1ZRKWR1OZRyf06Izt905loWuaRpFNgIMTF0HJVHi54oqme+xSKMxMlyDzRRaVSE5XUWtDKIN5qPotMTkswUcZtxKhg/j31mFIUVlI9Nf/F2pVgKU4uKifAulGVWfge0tppSO896t1LBOquR9gcJhpA1W7x8DFnObewEZOICmrn/9ciwjbJrS3N5zs7FmZdY5EbZiynagJdVsidHysw3mJmp//Z3sHuwY4BydGJCRpPds64zTs+iQ5XnQT9CnoR93B/e/kIY19Qin729QnjiSgSKmJ8jT1sAMpUGgZpIdAAA3QzK1I4jDUIOjvHFrj4polORv2x8xvnDdDY5aPRkCpfXA0KzjABSVXq4oxKLuYpZLQStnaxyc77TZOYzLuiDtvrYgZ3ENLDXvcgYpKjKNpCoOVRwM5M5imaSSJ3rOzMUw2WYGcenOC3tjeuN5N6DPiRaRjOZVKIJ5iSW7KY2n37/FntlJeQvHaydhyXGw/BXhWMA+kmJFlBVhoeMKwS3E5b+S29WmBTYfjkuS/JucCo3yifS2a1M+JCxAcv0e4pRvoaUFHmtL5Y6g9PN6qeTgRwlneWtb9qBjfa4PHSPB+kp1nfZTnkE4lK8dJVns7FiXTxcry+ZAv5DE/Y9CrEaqJuSjyIZwnVJ2i+OE+KmYtf+/92GOe6EkBy4JPc4um6v1da0iajHAhltqKCICyMp3hC9Lq7ezBrk/PWJo/xdqCKAUnAnuH362MJihGzKGO4lGqHhCwIOr1uH2T7HD3MC43V4WpCCkXQVERAZonhKXjEWl7b/fpfErwAHv4viV5ksmCpfRXwGulvXhqXOy92u31c3ne724MvVxfKzeDj4JPg06Af7AeD4OvgKDgOWPBT8HPwS/Br67fWH60/W38tQ69fW2HuBo3W+vsfL76MJg==</latexit><latexit sha1_base64="cQc0H4GWbHtVI0fEsTgfVT1qu8Q=">AAAHQ3icfVVdjxs1FJ22EMrw0W37gsSLyzYSqibZZKtlu6CVIqgqKrWwkGxbaSdaPJ47GSu2Z7A93aTW8Gt4hX/Bj+A38IZ4ReI6ybKZ7IKlZDz2Pef4Xp+xk1JwY3u9369dv/HW2613br4bvvf+Bx/e2rp954UpKs3gmBWi0K8SakBwBceWWwGvSg1UJgJeJtOv/PzL16ANL9TIzksYSzpRPOOMWhw63fqo342/IPe/IYckdjQiLCJpXN/vhqdb271ub9HI5U5/1dkOVu3o9HbrbpwWrJKgLBPUmJN+r7RjR7XlTEAdxpWBkrIpncAJdhWVYMZukUJN2jiSkqzQ+FOWLEbDdQjyaDpvsDhLk0pQPWuOJkUxxRlTh2FT02aPxo6rsrKg2FIyqwSxBfGVISnXwKyYk6au5dM3keIMMk1ZRKWR1OZRyf06Izt905loWuaRpFNgIMTF0HJVHi54oqme+xSKMxMlyDzRRaVSE5XUWtDKIN5qPotMTkswUcZtxKhg/j31mFIUVlI9Nf/F2pVgKU4uKifAulGVWfge0tppSO896t1LBOquR9gcJhpA1W7x8DFnObewEZOICmrn/9ciwjbJrS3N5zs7FmZdY5EbZiynagJdVsidHysw3mJmp//Z3sHuwY4BydGJCRpPds64zTs+iQ5XnQT9CnoR93B/e/kIY19Qin729QnjiSgSKmJ8jT1sAMpUGgZpIdAAA3QzK1I4jDUIOjvHFrj4polORv2x8xvnDdDY5aPRkCpfXA0KzjABSVXq4oxKLuYpZLQStnaxyc77TZOYzLuiDtvrYgZ3ENLDXvcgYpKjKNpCoOVRwM5M5imaSSJ3rOzMUw2WYGcenOC3tjeuN5N6DPiRaRjOZVKIJ5iSW7KY2n37/FntlJeQvHaydhyXGw/BXhWMA+kmJFlBVhoeMKwS3E5b+S29WmBTYfjkuS/JucCo3yifS2a1M+JCxAcv0e4pRvoaUFHmtL5Y6g9PN6qeTgRwlneWtb9qBjfa4PHSPB+kp1nfZTnkE4lK8dJVns7FiXTxcry+ZAv5DE/Y9CrEaqJuSjyIZwnVJ2i+OE+KmYtf+/92GOe6EkBy4JPc4um6v1da0iajHAhltqKCICyMp3hC9Lq7ezBrk/PWJo/xdqCKAUnAnuH362MJihGzKGO4lGqHhCwIOr1uH2T7HD3MC43V4WpCCkXQVERAZonhKXjEWl7b/fpfErwAHv4viV5ksmCpfRXwGulvXhqXOy92u31c3ne724MvVxfKzeDj4JPg06Af7AeD4OvgKDgOWPBT8HPwS/Br67fWH60/W38tQ69fW2HuBo3W+vsfL76MJg==</latexit><latexit sha1_base64="cQc0H4GWbHtVI0fEsTgfVT1qu8Q=">AAAHQ3icfVVdjxs1FJ22EMrw0W37gsSLyzYSqibZZKtlu6CVIqgqKrWwkGxbaSdaPJ47GSu2Z7A93aTW8Gt4hX/Bj+A38IZ4ReI6ybKZ7IKlZDz2Pef4Xp+xk1JwY3u9369dv/HW2613br4bvvf+Bx/e2rp954UpKs3gmBWi0K8SakBwBceWWwGvSg1UJgJeJtOv/PzL16ANL9TIzksYSzpRPOOMWhw63fqo342/IPe/IYckdjQiLCJpXN/vhqdb271ub9HI5U5/1dkOVu3o9HbrbpwWrJKgLBPUmJN+r7RjR7XlTEAdxpWBkrIpncAJdhWVYMZukUJN2jiSkqzQ+FOWLEbDdQjyaDpvsDhLk0pQPWuOJkUxxRlTh2FT02aPxo6rsrKg2FIyqwSxBfGVISnXwKyYk6au5dM3keIMMk1ZRKWR1OZRyf06Izt905loWuaRpFNgIMTF0HJVHi54oqme+xSKMxMlyDzRRaVSE5XUWtDKIN5qPotMTkswUcZtxKhg/j31mFIUVlI9Nf/F2pVgKU4uKifAulGVWfge0tppSO896t1LBOquR9gcJhpA1W7x8DFnObewEZOICmrn/9ciwjbJrS3N5zs7FmZdY5EbZiynagJdVsidHysw3mJmp//Z3sHuwY4BydGJCRpPds64zTs+iQ5XnQT9CnoR93B/e/kIY19Qin729QnjiSgSKmJ8jT1sAMpUGgZpIdAAA3QzK1I4jDUIOjvHFrj4polORv2x8xvnDdDY5aPRkCpfXA0KzjABSVXq4oxKLuYpZLQStnaxyc77TZOYzLuiDtvrYgZ3ENLDXvcgYpKjKNpCoOVRwM5M5imaSSJ3rOzMUw2WYGcenOC3tjeuN5N6DPiRaRjOZVKIJ5iSW7KY2n37/FntlJeQvHaydhyXGw/BXhWMA+kmJFlBVhoeMKwS3E5b+S29WmBTYfjkuS/JucCo3yifS2a1M+JCxAcv0e4pRvoaUFHmtL5Y6g9PN6qeTgRwlneWtb9qBjfa4PHSPB+kp1nfZTnkE4lK8dJVns7FiXTxcry+ZAv5DE/Y9CrEaqJuSjyIZwnVJ2i+OE+KmYtf+/92GOe6EkBy4JPc4um6v1da0iajHAhltqKCICyMp3hC9Lq7ezBrk/PWJo/xdqCKAUnAnuH362MJihGzKGO4lGqHhCwIOr1uH2T7HD3MC43V4WpCCkXQVERAZonhKXjEWl7b/fpfErwAHv4viV5ksmCpfRXwGulvXhqXOy92u31c3ne724MvVxfKzeDj4JPg06Af7AeD4OvgKDgOWPBT8HPwS/Br67fWH60/W38tQ69fW2HuBo3W+vsfL76MJg==</latexit><latexit sha1_base64="cQc0H4GWbHtVI0fEsTgfVT1qu8Q=">AAAHQ3icfVVdjxs1FJ22EMrw0W37gsSLyzYSqibZZKtlu6CVIqgqKrWwkGxbaSdaPJ47GSu2Z7A93aTW8Gt4hX/Bj+A38IZ4ReI6ybKZ7IKlZDz2Pef4Xp+xk1JwY3u9369dv/HW2613br4bvvf+Bx/e2rp954UpKs3gmBWi0K8SakBwBceWWwGvSg1UJgJeJtOv/PzL16ANL9TIzksYSzpRPOOMWhw63fqo342/IPe/IYckdjQiLCJpXN/vhqdb271ub9HI5U5/1dkOVu3o9HbrbpwWrJKgLBPUmJN+r7RjR7XlTEAdxpWBkrIpncAJdhWVYMZukUJN2jiSkqzQ+FOWLEbDdQjyaDpvsDhLk0pQPWuOJkUxxRlTh2FT02aPxo6rsrKg2FIyqwSxBfGVISnXwKyYk6au5dM3keIMMk1ZRKWR1OZRyf06Izt905loWuaRpFNgIMTF0HJVHi54oqme+xSKMxMlyDzRRaVSE5XUWtDKIN5qPotMTkswUcZtxKhg/j31mFIUVlI9Nf/F2pVgKU4uKifAulGVWfge0tppSO896t1LBOquR9gcJhpA1W7x8DFnObewEZOICmrn/9ciwjbJrS3N5zs7FmZdY5EbZiynagJdVsidHysw3mJmp//Z3sHuwY4BydGJCRpPds64zTs+iQ5XnQT9CnoR93B/e/kIY19Qin729QnjiSgSKmJ8jT1sAMpUGgZpIdAAA3QzK1I4jDUIOjvHFrj4polORv2x8xvnDdDY5aPRkCpfXA0KzjABSVXq4oxKLuYpZLQStnaxyc77TZOYzLuiDtvrYgZ3ENLDXvcgYpKjKNpCoOVRwM5M5imaSSJ3rOzMUw2WYGcenOC3tjeuN5N6DPiRaRjOZVKIJ5iSW7KY2n37/FntlJeQvHaydhyXGw/BXhWMA+kmJFlBVhoeMKwS3E5b+S29WmBTYfjkuS/JucCo3yifS2a1M+JCxAcv0e4pRvoaUFHmtL5Y6g9PN6qeTgRwlneWtb9qBjfa4PHSPB+kp1nfZTnkE4lK8dJVns7FiXTxcry+ZAv5DE/Y9CrEaqJuSjyIZwnVJ2i+OE+KmYtf+/92GOe6EkBy4JPc4um6v1da0iajHAhltqKCICyMp3hC9Lq7ezBrk/PWJo/xdqCKAUnAnuH362MJihGzKGO4lGqHhCwIOr1uH2T7HD3MC43V4WpCCkXQVERAZonhKXjEWl7b/fpfErwAHv4viV5ksmCpfRXwGulvXhqXOy92u31c3ne724MvVxfKzeDj4JPg06Af7AeD4OvgKDgOWPBT8HPwS/Br67fWH60/W38tQ69fW2HuBo3W+vsfL76MJg==</latexit>
0.8·0.8·0.8
0.8·0.8·0.2
0.8 + 0.2
0.2·0.8 + 0.8·0.8
We can learn model parameters with maximum
likelihood estimation.
17
1. Fix correlation probability p and learn recency weights w.
⟶ single p, vector w learned for entire dataset.
2. Grid search over p, gradient descent on w.
⟶ structure of CRU model makes it easy to compute gradients.
The optimal correlation probability is consistent within
domain but differs between domains.
18
Meanper-setlikelihood
x Baseline model (flat, no structure). Similar to [Anderson+ 14]
CRU model.
Learned weights tend to decrease monotonically,
which agrees with recency bias in the data.
19
100
101
102
index
10 3
10 2
10 1
Recencyweightw
contact-prim-school
100
101
102
index
10 3
10 2
Recencyweightw
email-Eu-core
100
101
102
index
10 3
10 2
Recencyweightw
coauth-Geology
100
101
102
index
10 2
Recencyweightw
tags-mathoverflow
Correlation
probability p.
Asymptotic behavior depends on the
recency weight model parameters.
20
Theorem.
Let Wj =
Pj
i=1 wi.
If W1 < 1, the model tips with probability 1.
If W1 = 1, then every pair occurs infinitely often.<latexit sha1_base64="aOBbWA3HiGqepuD2cTVGzYijJ6s=">AAAH3HicfVXfb9s2ELa7re60H03Xhz3shV1iYChsx0qRpRlmwNiKbAFSLJvdpkDkepR0sjiTlEZStV1Cb3sb9rr/Y3/O/psdbWexnGwCbFHkfffx7r4jw5wzbbrdv+t33nn3vbuNe+97H3z40cf3dx588lJnhYrgRZTxTL0KqQbOJLwwzHB4lSugIuRwEU6/desXb0BplsmhWeQwEnQiWcIianBqvPNXIDMmY5CGnIEhexdj+0tJeiTQhRhb1vPL1zgxG7O9DgkC7zRZmgRMJmZRkq/JarTXIiYFIrIYODEs12TGTEpylYU0ZJyZBfFvw/cqeEkAt7ogOWWKZFFUKE1wmUlmgC9IlhiQHW+8s9vtdJcPuTnw14Pd2vo5Hz+4+zCIs6gQGGTEqdaXfjc3I0uVYRGH0gsKDTmNpnQClziUVIAe2WVuS9LEmZgkmcIfJmk5621C0I+ii4oXa2hYcKrm1dkwy6a4okvPq3Ka5OnIMpkXGGC0okwKTGRGXMlIzBREBjNQ5TVs+rYlWQSJolGLCi2oSVs5c/tsmenb9kTRPG0JOoUIOL+eWu3KwTkLFVULF0I2060QPU9UVshYt3JqDCipEW8Um7d0SnPQrYSZVkR55L5jh8l5ZgRVU/1fXjsCDMXFZeY4GDsssJA/QVxaBfGjp91HIUfeTQvUwkQByNIuX85mlqIItmxCXkBp3f+GhdckqTG5/mp/38C8ow36hnmUUjmBTpSJ/V8L0E77et//8vD44Hhfg2CouxA7QrSdbtsuiDaT7RAbCdTS7snR7urlBS6hFBvN5ccLJhw1zgP8DBysD1IXCvpxxlEAfWyzCJuiFyjgdH6FzXDzVRFdDv2RdYVzAqhU+Xw4oNIlV4GEGQYgqIxtkFDB+CKGhBbclDbQydW4KhKdOFWUXnOTTGMFIe51O8etSDAkRVlwlDwSmLlOnItqkOg7kGbuXPVXYKsfX2KvHY7K7aCeATaZgsFChBk/wZDsyosu7Q/Pz0orHYVgpRWlZbjdYADmNmOciLch4Rqy5nCAQRFiOU3hSno7wTbD4OS5S8kVwdCvpM+G89Jqfk3ijFdoe4qWLgeU5yktr7f68+lW1uMJBxal7VXub1vBQms8Xqrng3BuNqssBmwikClYqcq5s0EobLCaL2/IQpzh0R/fhlgvlFWKx8E8pOoSxRekYTa3wRv33/SCVBUcSApskho8XY8Oc0OaZIiHPI1MQTlBmBdM8YTodg4OYd4kV0+TPMNri8oISAhmhv3rbAmSEb1Mo7eianqELB20ux0fRPMKPUgzhdlhckIyubxWOCSGaBaDQ2zEteuX/zrBC+DJ/zpRy0iWXkqXBbxG/O1L4+bg5UHHx+39eLDb/2Z9odyrfVb7vPZFza8d1fq172vntRe1qP5pvVc/qX/XeN34rfF744+V6Z36GvOwVnkaf/4DFizBCg==</latexit><latexit sha1_base64="aOBbWA3HiGqepuD2cTVGzYijJ6s=">AAAH3HicfVXfb9s2ELa7re60H03Xhz3shV1iYChsx0qRpRlmwNiKbAFSLJvdpkDkepR0sjiTlEZStV1Cb3sb9rr/Y3/O/psdbWexnGwCbFHkfffx7r4jw5wzbbrdv+t33nn3vbuNe+97H3z40cf3dx588lJnhYrgRZTxTL0KqQbOJLwwzHB4lSugIuRwEU6/desXb0BplsmhWeQwEnQiWcIianBqvPNXIDMmY5CGnIEhexdj+0tJeiTQhRhb1vPL1zgxG7O9DgkC7zRZmgRMJmZRkq/JarTXIiYFIrIYODEs12TGTEpylYU0ZJyZBfFvw/cqeEkAt7ogOWWKZFFUKE1wmUlmgC9IlhiQHW+8s9vtdJcPuTnw14Pd2vo5Hz+4+zCIs6gQGGTEqdaXfjc3I0uVYRGH0gsKDTmNpnQClziUVIAe2WVuS9LEmZgkmcIfJmk5621C0I+ii4oXa2hYcKrm1dkwy6a4okvPq3Ka5OnIMpkXGGC0okwKTGRGXMlIzBREBjNQ5TVs+rYlWQSJolGLCi2oSVs5c/tsmenb9kTRPG0JOoUIOL+eWu3KwTkLFVULF0I2060QPU9UVshYt3JqDCipEW8Um7d0SnPQrYSZVkR55L5jh8l5ZgRVU/1fXjsCDMXFZeY4GDsssJA/QVxaBfGjp91HIUfeTQvUwkQByNIuX85mlqIItmxCXkBp3f+GhdckqTG5/mp/38C8ow36hnmUUjmBTpSJ/V8L0E77et//8vD44Hhfg2CouxA7QrSdbtsuiDaT7RAbCdTS7snR7urlBS6hFBvN5ccLJhw1zgP8DBysD1IXCvpxxlEAfWyzCJuiFyjgdH6FzXDzVRFdDv2RdYVzAqhU+Xw4oNIlV4GEGQYgqIxtkFDB+CKGhBbclDbQydW4KhKdOFWUXnOTTGMFIe51O8etSDAkRVlwlDwSmLlOnItqkOg7kGbuXPVXYKsfX2KvHY7K7aCeATaZgsFChBk/wZDsyosu7Q/Pz0orHYVgpRWlZbjdYADmNmOciLch4Rqy5nCAQRFiOU3hSno7wTbD4OS5S8kVwdCvpM+G89Jqfk3ijFdoe4qWLgeU5yktr7f68+lW1uMJBxal7VXub1vBQms8Xqrng3BuNqssBmwikClYqcq5s0EobLCaL2/IQpzh0R/fhlgvlFWKx8E8pOoSxRekYTa3wRv33/SCVBUcSApskho8XY8Oc0OaZIiHPI1MQTlBmBdM8YTodg4OYd4kV0+TPMNri8oISAhmhv3rbAmSEb1Mo7eianqELB20ux0fRPMKPUgzhdlhckIyubxWOCSGaBaDQ2zEteuX/zrBC+DJ/zpRy0iWXkqXBbxG/O1L4+bg5UHHx+39eLDb/2Z9odyrfVb7vPZFza8d1fq172vntRe1qP5pvVc/qX/XeN34rfF744+V6Z36GvOwVnkaf/4DFizBCg==</latexit><latexit sha1_base64="aOBbWA3HiGqepuD2cTVGzYijJ6s=">AAAH3HicfVXfb9s2ELa7re60H03Xhz3shV1iYChsx0qRpRlmwNiKbAFSLJvdpkDkepR0sjiTlEZStV1Cb3sb9rr/Y3/O/psdbWexnGwCbFHkfffx7r4jw5wzbbrdv+t33nn3vbuNe+97H3z40cf3dx588lJnhYrgRZTxTL0KqQbOJLwwzHB4lSugIuRwEU6/desXb0BplsmhWeQwEnQiWcIianBqvPNXIDMmY5CGnIEhexdj+0tJeiTQhRhb1vPL1zgxG7O9DgkC7zRZmgRMJmZRkq/JarTXIiYFIrIYODEs12TGTEpylYU0ZJyZBfFvw/cqeEkAt7ogOWWKZFFUKE1wmUlmgC9IlhiQHW+8s9vtdJcPuTnw14Pd2vo5Hz+4+zCIs6gQGGTEqdaXfjc3I0uVYRGH0gsKDTmNpnQClziUVIAe2WVuS9LEmZgkmcIfJmk5621C0I+ii4oXa2hYcKrm1dkwy6a4okvPq3Ka5OnIMpkXGGC0okwKTGRGXMlIzBREBjNQ5TVs+rYlWQSJolGLCi2oSVs5c/tsmenb9kTRPG0JOoUIOL+eWu3KwTkLFVULF0I2060QPU9UVshYt3JqDCipEW8Um7d0SnPQrYSZVkR55L5jh8l5ZgRVU/1fXjsCDMXFZeY4GDsssJA/QVxaBfGjp91HIUfeTQvUwkQByNIuX85mlqIItmxCXkBp3f+GhdckqTG5/mp/38C8ow36hnmUUjmBTpSJ/V8L0E77et//8vD44Hhfg2CouxA7QrSdbtsuiDaT7RAbCdTS7snR7urlBS6hFBvN5ccLJhw1zgP8DBysD1IXCvpxxlEAfWyzCJuiFyjgdH6FzXDzVRFdDv2RdYVzAqhU+Xw4oNIlV4GEGQYgqIxtkFDB+CKGhBbclDbQydW4KhKdOFWUXnOTTGMFIe51O8etSDAkRVlwlDwSmLlOnItqkOg7kGbuXPVXYKsfX2KvHY7K7aCeATaZgsFChBk/wZDsyosu7Q/Pz0orHYVgpRWlZbjdYADmNmOciLch4Rqy5nCAQRFiOU3hSno7wTbD4OS5S8kVwdCvpM+G89Jqfk3ijFdoe4qWLgeU5yktr7f68+lW1uMJBxal7VXub1vBQms8Xqrng3BuNqssBmwikClYqcq5s0EobLCaL2/IQpzh0R/fhlgvlFWKx8E8pOoSxRekYTa3wRv33/SCVBUcSApskho8XY8Oc0OaZIiHPI1MQTlBmBdM8YTodg4OYd4kV0+TPMNri8oISAhmhv3rbAmSEb1Mo7eianqELB20ux0fRPMKPUgzhdlhckIyubxWOCSGaBaDQ2zEteuX/zrBC+DJ/zpRy0iWXkqXBbxG/O1L4+bg5UHHx+39eLDb/2Z9odyrfVb7vPZFza8d1fq172vntRe1qP5pvVc/qX/XeN34rfF744+V6Z36GvOwVnkaf/4DFizBCg==</latexit><latexit sha1_base64="aOBbWA3HiGqepuD2cTVGzYijJ6s=">AAAH3HicfVXfb9s2ELa7re60H03Xhz3shV1iYChsx0qRpRlmwNiKbAFSLJvdpkDkepR0sjiTlEZStV1Cb3sb9rr/Y3/O/psdbWexnGwCbFHkfffx7r4jw5wzbbrdv+t33nn3vbuNe+97H3z40cf3dx588lJnhYrgRZTxTL0KqQbOJLwwzHB4lSugIuRwEU6/desXb0BplsmhWeQwEnQiWcIianBqvPNXIDMmY5CGnIEhexdj+0tJeiTQhRhb1vPL1zgxG7O9DgkC7zRZmgRMJmZRkq/JarTXIiYFIrIYODEs12TGTEpylYU0ZJyZBfFvw/cqeEkAt7ogOWWKZFFUKE1wmUlmgC9IlhiQHW+8s9vtdJcPuTnw14Pd2vo5Hz+4+zCIs6gQGGTEqdaXfjc3I0uVYRGH0gsKDTmNpnQClziUVIAe2WVuS9LEmZgkmcIfJmk5621C0I+ii4oXa2hYcKrm1dkwy6a4okvPq3Ka5OnIMpkXGGC0okwKTGRGXMlIzBREBjNQ5TVs+rYlWQSJolGLCi2oSVs5c/tsmenb9kTRPG0JOoUIOL+eWu3KwTkLFVULF0I2060QPU9UVshYt3JqDCipEW8Um7d0SnPQrYSZVkR55L5jh8l5ZgRVU/1fXjsCDMXFZeY4GDsssJA/QVxaBfGjp91HIUfeTQvUwkQByNIuX85mlqIItmxCXkBp3f+GhdckqTG5/mp/38C8ow36hnmUUjmBTpSJ/V8L0E77et//8vD44Hhfg2CouxA7QrSdbtsuiDaT7RAbCdTS7snR7urlBS6hFBvN5ccLJhw1zgP8DBysD1IXCvpxxlEAfWyzCJuiFyjgdH6FzXDzVRFdDv2RdYVzAqhU+Xw4oNIlV4GEGQYgqIxtkFDB+CKGhBbclDbQydW4KhKdOFWUXnOTTGMFIe51O8etSDAkRVlwlDwSmLlOnItqkOg7kGbuXPVXYKsfX2KvHY7K7aCeATaZgsFChBk/wZDsyosu7Q/Pz0orHYVgpRWlZbjdYADmNmOciLch4Rqy5nCAQRFiOU3hSno7wTbD4OS5S8kVwdCvpM+G89Jqfk3ijFdoe4qWLgeU5yktr7f68+lW1uMJBxal7VXub1vBQms8Xqrng3BuNqssBmwikClYqcq5s0EobLCaL2/IQpzh0R/fhlgvlFWKx8E8pOoSxRekYTa3wRv33/SCVBUcSApskho8XY8Oc0OaZIiHPI1MQTlBmBdM8YTodg4OYd4kV0+TPMNri8oISAhmhv3rbAmSEb1Mo7eianqELB20ux0fRPMKPUgzhdlhckIyubxWOCSGaBaDQ2zEteuX/zrBC+DJ/zpRy0iWXkqXBbxG/O1L4+bg5UHHx+39eLDb/2Z9odyrfVb7vPZFza8d1fq172vntRe1qP5pvVc/qX/XeN34rfF744+V6Z36GvOwVnkaf/4DFizBCg==</latexit>
We say that the model tips if
after some point, only one set appears forever more.
(Similar flavor of result to single-item sequence models [Anderson+ 14].)
Recap on Set Prediction #1.
Individuals repeating interactions.
21
1. The data exhibits complex repetition patterns.
2. Correlated Repeated Unions (CRU) is a model for repeat structure.
3. Optimal correlation probabilities are consistent within domain
but different across domains.
4. Optimal weights look the same across domains—fat tails.
5. Can analyze the asymptotic behavior of the model.
{a, b, c}, {a, b}, {c, d, e, f}, {a, c}, {c}, {a, b, c}, {e, g, h}, {h}, …
{a, b}, {a, x}, {a, y}, {a}, {a}, {a}, {z}, {a, b, x, y, z}, …
{j}, {j, k, l}, {a, j}, {a}, {a, k}, {a, j, k, l}, {j, k, l}, {j, k, l}, {j, k}…
Code. bit.ly/SoS-code
Data. bit.ly/SoS-data
22
Set Prediction #2. Subset choice models.
Given a slate of alternatives, how do people choose a subset of the alternatives?
What to buy after browsing Amazon? How to construct a playlist on Spotify?
A discrete choice model for subset selection. Benson, Kumar, & Tomkins. WSDM, 2018.
Given some slate of alternatives,
how do people make choices?
23
• If choosing just one thing (buying a car, picking a restaurant, etc.), there
are many good ML techniques (logistic regression, deep nets, etc.)
• If choosing a subset of the alternatives (what to buy after browsing
Amazon, constructing a playlist on Spotify, etc.), there are not many tools.
• We develop a simple and interpretable model for subset selection.
Our discrete choice model for subset selection
as illustrated through choosing party snacks.
24
Large set of snack options and want to choose a few.
{tortilla chips, potato chips, cookies, pretzels, guacamole, celery, nut mix, hummus,
meatballs, cupcakes, pigs in blankets, cupcakes, potato skins, chicken wings, taquitos, …}
Model 1.
Independent choices.
Easy computation,
but not realistic.
Model 2.
All subsets as options.
Harder computation, but
more modeling power
Our model.
Some“special subsets”as options +
independent choices.
Interpolate between computation
and modeling power.
healthyfoodtribe.comtoday.com
Our model is based on a generalization of classical discrete
choice and random utility maximization theory.
25
Discrete Choice Methods with Simulation,Train,2009 (https://eml.berkeley.edu/books/choice2.html)
• Observe choice set C with items 1, …, c. Choose one element.
• Random utility of ith item: Ui = Vi + ei
Vi is base utility, ei is i.i.d. Gumbel distributed error
• If choosing the item with largest random utility…
• (Logistic regression assumes for feature vector x of sample)
Pr[select item i | C] = eVi
P
j2C e
Vj
<latexit sha1_base64="MHw/TabkLT3RqXx2r462XmZzKDE=">AAAHeHicfVVdb9s2FFW7Lem0j6br417Yxca2wnbsFFmaFQGMpShWoMGy2U0LmF5GSVcWa5LSSKqxS+hX7df0dfsXe9ql7SyRk42AJOrynnt4Lw/JqBDc2G73/a3bH3z40cbmnY/DTz797PO7W/e+ODV5qWN4Geci168jZkBwBS8ttwJeFxqYjAS8iqZHfvzVW9CG52po5wWMJZsonvKYWTSdbR2f6BGiIbaEW5CkwRukQZ9QxFj6BPtHjTFpHBKaahY7+NWdnvGqctSU8sy9IZQrclQtzG+qqnG2td3tdBeNXO/0Vp3tYNVOzu5t3KdJHpcSlI0FM2bU6xZ27Ji2PBZQhbQ0ULB4yiYwwq5iEszYLfKuSBMtCUlzjY+yZGENr0IwjmbzWhRnWVQKpmd1a5TnUxwxVRjWOW36eOy4KkoLKl5SpqUgNie+nCThGmsn5qTOa/n0XUvxGHzZWkwayWzWKrifZ8tO37UnmhVZS7IpxCDEpWk5Kw8XPNJMz30K+blpRRh5ovNSJaZVMGtBK4N4q/msZTJWgGml3LZiJmL/n3hMIXIrmZ6a/4rakWAZDi4qJ8C6YZla+AWSymlIHjzuPogE8l71sBlMNICq3OLjfc4zlM6aTyRKqJx/X/EImySztjDf7+xYmHWMxdgwizOmJtCJc7nzewnG69Ls9L7bO9g92DEgOUoxQrXK9jm3Wdsn0eaqHaHIQS/8Hu1vLz8h9QVluAl8fUI6EXnEBMVf6mF9UKbU0E9ygQLo4xaI8wQOqQbBZhfYHCdfF9Fo2Bs7v3BeALVVPhkOmPLF1aDgHBOQTCWOpkxyMU8gZaWwfq+kF/26SEzqVVGFzatkBlcQksNu56AVS46kKAuBkkcCOzOpD1FPEmNTZWc+VH8JdubhCPfa3rhaT+op4CbTMJjLKBfPMCW3jGIq99Pxi8opTyF55WTlOE6XDsDe5IyGZB0SrSArDg8YlBEupy39kt5MsM4weHbsS3JBMOzVyueiWeWMuCTxzku0e46evgZMFBmrLqf62/O1qicTATzO2sva3zSCC23weKmfD9KHubrKcsAnEpnoUlU+nKORdHRpr67JQr7AYzm5CbEaqOoUD+ksYnqE4qNZlM8cfevfzZBmuhRAMuCTzOLpur9XWNIkwwwIi23JBEFYSKd4QnQ7u3swa5KL1iRP8UphKgYSgT3H/et9CZIRsyhjuKRqhoQsArS7nR7I5gV6kOUaq8PVhOSKoKiIgNQSwxPwiCt5bfeqf4PgBfDof4PoRSaLKJWvAl4jvfVL43rndLfTw+n9vLvd/2F1odwJvgy+Cr4JesF+0A9+DE6Cl0Ec/BG8D/4M/tr4e5Nsfr357dL19q0V5n5Qa5u7/wBGwJ7r</latexit><latexit sha1_base64="MHw/TabkLT3RqXx2r462XmZzKDE=">AAAHeHicfVVdb9s2FFW7Lem0j6br417Yxca2wnbsFFmaFQGMpShWoMGy2U0LmF5GSVcWa5LSSKqxS+hX7df0dfsXe9ql7SyRk42AJOrynnt4Lw/JqBDc2G73/a3bH3z40cbmnY/DTz797PO7W/e+ODV5qWN4Geci168jZkBwBS8ttwJeFxqYjAS8iqZHfvzVW9CG52po5wWMJZsonvKYWTSdbR2f6BGiIbaEW5CkwRukQZ9QxFj6BPtHjTFpHBKaahY7+NWdnvGqctSU8sy9IZQrclQtzG+qqnG2td3tdBeNXO/0Vp3tYNVOzu5t3KdJHpcSlI0FM2bU6xZ27Ji2PBZQhbQ0ULB4yiYwwq5iEszYLfKuSBMtCUlzjY+yZGENr0IwjmbzWhRnWVQKpmd1a5TnUxwxVRjWOW36eOy4KkoLKl5SpqUgNie+nCThGmsn5qTOa/n0XUvxGHzZWkwayWzWKrifZ8tO37UnmhVZS7IpxCDEpWk5Kw8XPNJMz30K+blpRRh5ovNSJaZVMGtBK4N4q/msZTJWgGml3LZiJmL/n3hMIXIrmZ6a/4rakWAZDi4qJ8C6YZla+AWSymlIHjzuPogE8l71sBlMNICq3OLjfc4zlM6aTyRKqJx/X/EImySztjDf7+xYmHWMxdgwizOmJtCJc7nzewnG69Ls9L7bO9g92DEgOUoxQrXK9jm3Wdsn0eaqHaHIQS/8Hu1vLz8h9QVluAl8fUI6EXnEBMVf6mF9UKbU0E9ygQLo4xaI8wQOqQbBZhfYHCdfF9Fo2Bs7v3BeALVVPhkOmPLF1aDgHBOQTCWOpkxyMU8gZaWwfq+kF/26SEzqVVGFzatkBlcQksNu56AVS46kKAuBkkcCOzOpD1FPEmNTZWc+VH8JdubhCPfa3rhaT+op4CbTMJjLKBfPMCW3jGIq99Pxi8opTyF55WTlOE6XDsDe5IyGZB0SrSArDg8YlBEupy39kt5MsM4weHbsS3JBMOzVyueiWeWMuCTxzku0e46evgZMFBmrLqf62/O1qicTATzO2sva3zSCC23weKmfD9KHubrKcsAnEpnoUlU+nKORdHRpr67JQr7AYzm5CbEaqOoUD+ksYnqE4qNZlM8cfevfzZBmuhRAMuCTzOLpur9XWNIkwwwIi23JBEFYSKd4QnQ7u3swa5KL1iRP8UphKgYSgT3H/et9CZIRsyhjuKRqhoQsArS7nR7I5gV6kOUaq8PVhOSKoKiIgNQSwxPwiCt5bfeqf4PgBfDof4PoRSaLKJWvAl4jvfVL43rndLfTw+n9vLvd/2F1odwJvgy+Cr4JesF+0A9+DE6Cl0Ec/BG8D/4M/tr4e5Nsfr357dL19q0V5n5Qa5u7/wBGwJ7r</latexit><latexit sha1_base64="MHw/TabkLT3RqXx2r462XmZzKDE=">AAAHeHicfVVdb9s2FFW7Lem0j6br417Yxca2wnbsFFmaFQGMpShWoMGy2U0LmF5GSVcWa5LSSKqxS+hX7df0dfsXe9ql7SyRk42AJOrynnt4Lw/JqBDc2G73/a3bH3z40cbmnY/DTz797PO7W/e+ODV5qWN4Geci168jZkBwBS8ttwJeFxqYjAS8iqZHfvzVW9CG52po5wWMJZsonvKYWTSdbR2f6BGiIbaEW5CkwRukQZ9QxFj6BPtHjTFpHBKaahY7+NWdnvGqctSU8sy9IZQrclQtzG+qqnG2td3tdBeNXO/0Vp3tYNVOzu5t3KdJHpcSlI0FM2bU6xZ27Ji2PBZQhbQ0ULB4yiYwwq5iEszYLfKuSBMtCUlzjY+yZGENr0IwjmbzWhRnWVQKpmd1a5TnUxwxVRjWOW36eOy4KkoLKl5SpqUgNie+nCThGmsn5qTOa/n0XUvxGHzZWkwayWzWKrifZ8tO37UnmhVZS7IpxCDEpWk5Kw8XPNJMz30K+blpRRh5ovNSJaZVMGtBK4N4q/msZTJWgGml3LZiJmL/n3hMIXIrmZ6a/4rakWAZDi4qJ8C6YZla+AWSymlIHjzuPogE8l71sBlMNICq3OLjfc4zlM6aTyRKqJx/X/EImySztjDf7+xYmHWMxdgwizOmJtCJc7nzewnG69Ls9L7bO9g92DEgOUoxQrXK9jm3Wdsn0eaqHaHIQS/8Hu1vLz8h9QVluAl8fUI6EXnEBMVf6mF9UKbU0E9ygQLo4xaI8wQOqQbBZhfYHCdfF9Fo2Bs7v3BeALVVPhkOmPLF1aDgHBOQTCWOpkxyMU8gZaWwfq+kF/26SEzqVVGFzatkBlcQksNu56AVS46kKAuBkkcCOzOpD1FPEmNTZWc+VH8JdubhCPfa3rhaT+op4CbTMJjLKBfPMCW3jGIq99Pxi8opTyF55WTlOE6XDsDe5IyGZB0SrSArDg8YlBEupy39kt5MsM4weHbsS3JBMOzVyueiWeWMuCTxzku0e46evgZMFBmrLqf62/O1qicTATzO2sva3zSCC23weKmfD9KHubrKcsAnEpnoUlU+nKORdHRpr67JQr7AYzm5CbEaqOoUD+ksYnqE4qNZlM8cfevfzZBmuhRAMuCTzOLpur9XWNIkwwwIi23JBEFYSKd4QnQ7u3swa5KL1iRP8UphKgYSgT3H/et9CZIRsyhjuKRqhoQsArS7nR7I5gV6kOUaq8PVhOSKoKiIgNQSwxPwiCt5bfeqf4PgBfDof4PoRSaLKJWvAl4jvfVL43rndLfTw+n9vLvd/2F1odwJvgy+Cr4JesF+0A9+DE6Cl0Ec/BG8D/4M/tr4e5Nsfr357dL19q0V5n5Qa5u7/wBGwJ7r</latexit><latexit sha1_base64="MHw/TabkLT3RqXx2r462XmZzKDE=">AAAHeHicfVVdb9s2FFW7Lem0j6br417Yxca2wnbsFFmaFQGMpShWoMGy2U0LmF5GSVcWa5LSSKqxS+hX7df0dfsXe9ql7SyRk42AJOrynnt4Lw/JqBDc2G73/a3bH3z40cbmnY/DTz797PO7W/e+ODV5qWN4Geci168jZkBwBS8ttwJeFxqYjAS8iqZHfvzVW9CG52po5wWMJZsonvKYWTSdbR2f6BGiIbaEW5CkwRukQZ9QxFj6BPtHjTFpHBKaahY7+NWdnvGqctSU8sy9IZQrclQtzG+qqnG2td3tdBeNXO/0Vp3tYNVOzu5t3KdJHpcSlI0FM2bU6xZ27Ji2PBZQhbQ0ULB4yiYwwq5iEszYLfKuSBMtCUlzjY+yZGENr0IwjmbzWhRnWVQKpmd1a5TnUxwxVRjWOW36eOy4KkoLKl5SpqUgNie+nCThGmsn5qTOa/n0XUvxGHzZWkwayWzWKrifZ8tO37UnmhVZS7IpxCDEpWk5Kw8XPNJMz30K+blpRRh5ovNSJaZVMGtBK4N4q/msZTJWgGml3LZiJmL/n3hMIXIrmZ6a/4rakWAZDi4qJ8C6YZla+AWSymlIHjzuPogE8l71sBlMNICq3OLjfc4zlM6aTyRKqJx/X/EImySztjDf7+xYmHWMxdgwizOmJtCJc7nzewnG69Ls9L7bO9g92DEgOUoxQrXK9jm3Wdsn0eaqHaHIQS/8Hu1vLz8h9QVluAl8fUI6EXnEBMVf6mF9UKbU0E9ygQLo4xaI8wQOqQbBZhfYHCdfF9Fo2Bs7v3BeALVVPhkOmPLF1aDgHBOQTCWOpkxyMU8gZaWwfq+kF/26SEzqVVGFzatkBlcQksNu56AVS46kKAuBkkcCOzOpD1FPEmNTZWc+VH8JdubhCPfa3rhaT+op4CbTMJjLKBfPMCW3jGIq99Pxi8opTyF55WTlOE6XDsDe5IyGZB0SrSArDg8YlBEupy39kt5MsM4weHbsS3JBMOzVyueiWeWMuCTxzku0e46evgZMFBmrLqf62/O1qicTATzO2sva3zSCC23weKmfD9KHubrKcsAnEpnoUlU+nKORdHRpr67JQr7AYzm5CbEaqOoUD+ksYnqE4qNZlM8cfevfzZBmuhRAMuCTzOLpur9XWNIkwwwIi23JBEFYSKd4QnQ7u3swa5KL1iRP8UphKgYSgT3H/et9CZIRsyhjuKRqhoQsArS7nR7I5gV6kOUaq8PVhOSKoKiIgNQSwxPwiCt5bfeqf4PgBfDof4PoRSaLKJWvAl4jvfVL43rndLfTw+n9vLvd/2F1odwJvgy+Cr4JesF+0A9+DE6Cl0Ec/BG8D/4M/tr4e5Nsfr357dL19q0V5n5Qa5u7/wBGwJ7r</latexit>
Vi = T
i x<latexit sha1_base64="WMg3r0ygm8YS1z2N1nlA4xcLFbY=">AAAHPXicfVXdbts2FFbbzeu0v7S93A271MBQyI6dIkszIICxFcUKtFg2O2mByM0o6UgiTFIqSTVyCb3Kbre32HPsAXY37Ha3O7SdxXKyEbBFkec73/n5REYlZ9oMBr/fuHnrvfc7H9z+0P/o408+/Wzrzt0TXVQqhuO44IV6FVENnEk4NsxweFUqoCLi8DKafev2X74FpVkhJ2ZewlTQTLKUxdTg0tnW3QcnZ4wckjACQ8/Y60n94Gxre9AfLAa5OhmuJtveahyd3encC5MirgRIE3Oq9elwUJqppcqwmEPjh5WGksYzmsEpTiUVoKd2EXxDuriSkLRQ+JOGLFb9dQj6UXTe8mINjSpOVd1ejYpihju68f02p0kfTy2TZWVAxkvKtOLEFMTVhCRMQWz4nLR5DZu9CySLIVU0DqjQgpo8KJmLMzCzd71M0TIPBJ1BDJxfLi2jcnDOIkXV3KVQnOsgQs+ZKiqZ6KCkxoCSGvFGsTrQOS1BBykzQUx57N4Thyl5YQRVM/1fXvsCW4ebi8pxMHZSpQZ+hKSxCpL7jwf3I4686xYmh0wByMYuHs7mPGcGNmwiXkFj3f+ahd8luTGl/npnx0Dd1wZ9Qx3nVGbQjwux86YC7cSld4Zf7R3sHuxoEAw1GKHkRO+cmbznkugx2YtQqaAWdo/2t5cPP3QFpahkVx8/zHgRUR7ia+hgI5C6UjBKCo4CGKGO4yKBw1ABp/UFtsDg2yI6nQyn1jXOCaDV5aPJmEpXXAUSzjEBQWViw5QKxucJpLTiprGhTi/mbZHo1Kmi8bvrZBo7CMnhoH8QxIIhKcqCo+SRwNQ6dS7aSaLvUJrauRotwVY/PMVvbW/abCb1BPAjUzCei6jgTzElu/SiG/v9i+eNlY5CsMaKxjIMNxyDuc4YF5JNSLSCrDgcYFxF2E5TuZZeT7DJMH76wpXkgmAybJXPRnVjNb8kccZLtH2Glq4GlJc5bS5D/enZRtWTjAOL896y9tftYKM1Hi/t80E4N+tdFmOWCWQKl6py7mwYCRsu15srshDP8WxNrkOsNpo2xcOwjqg6RfGFeVTUNnzr/rt+mKuKA8mBZbnB03V/rzSkSyY5EBqbinKCMD+c4Qkx6O/uQd0lF6NLnuC9QGUMBA/tc/x+nS1BMqIXZfSXVF2fkIWD3qA/BNG9QI/zQmF1mMxIIQmKinBIDdEsAYdYy2t72PzrBC+AR//rRC0yWXhpXBXwGhluXhpXJye7/SGG98Pu9uib1YVy2/vc+8L70ht6+97I+8478o692Ku9n71fvF87v3X+6PzZ+WtpevPGCnPPa43O3/8AAp+L5g==</latexit><latexit sha1_base64="WMg3r0ygm8YS1z2N1nlA4xcLFbY=">AAAHPXicfVXdbts2FFbbzeu0v7S93A271MBQyI6dIkszIICxFcUKtFg2O2mByM0o6UgiTFIqSTVyCb3Kbre32HPsAXY37Ha3O7SdxXKyEbBFkec73/n5REYlZ9oMBr/fuHnrvfc7H9z+0P/o408+/Wzrzt0TXVQqhuO44IV6FVENnEk4NsxweFUqoCLi8DKafev2X74FpVkhJ2ZewlTQTLKUxdTg0tnW3QcnZ4wckjACQ8/Y60n94Gxre9AfLAa5OhmuJtveahyd3encC5MirgRIE3Oq9elwUJqppcqwmEPjh5WGksYzmsEpTiUVoKd2EXxDuriSkLRQ+JOGLFb9dQj6UXTe8mINjSpOVd1ejYpihju68f02p0kfTy2TZWVAxkvKtOLEFMTVhCRMQWz4nLR5DZu9CySLIVU0DqjQgpo8KJmLMzCzd71M0TIPBJ1BDJxfLi2jcnDOIkXV3KVQnOsgQs+ZKiqZ6KCkxoCSGvFGsTrQOS1BBykzQUx57N4Thyl5YQRVM/1fXvsCW4ebi8pxMHZSpQZ+hKSxCpL7jwf3I4686xYmh0wByMYuHs7mPGcGNmwiXkFj3f+ahd8luTGl/npnx0Dd1wZ9Qx3nVGbQjwux86YC7cSld4Zf7R3sHuxoEAw1GKHkRO+cmbznkugx2YtQqaAWdo/2t5cPP3QFpahkVx8/zHgRUR7ia+hgI5C6UjBKCo4CGKGO4yKBw1ABp/UFtsDg2yI6nQyn1jXOCaDV5aPJmEpXXAUSzjEBQWViw5QKxucJpLTiprGhTi/mbZHo1Kmi8bvrZBo7CMnhoH8QxIIhKcqCo+SRwNQ6dS7aSaLvUJrauRotwVY/PMVvbW/abCb1BPAjUzCei6jgTzElu/SiG/v9i+eNlY5CsMaKxjIMNxyDuc4YF5JNSLSCrDgcYFxF2E5TuZZeT7DJMH76wpXkgmAybJXPRnVjNb8kccZLtH2Glq4GlJc5bS5D/enZRtWTjAOL896y9tftYKM1Hi/t80E4N+tdFmOWCWQKl6py7mwYCRsu15srshDP8WxNrkOsNpo2xcOwjqg6RfGFeVTUNnzr/rt+mKuKA8mBZbnB03V/rzSkSyY5EBqbinKCMD+c4Qkx6O/uQd0lF6NLnuC9QGUMBA/tc/x+nS1BMqIXZfSXVF2fkIWD3qA/BNG9QI/zQmF1mMxIIQmKinBIDdEsAYdYy2t72PzrBC+AR//rRC0yWXhpXBXwGhluXhpXJye7/SGG98Pu9uib1YVy2/vc+8L70ht6+97I+8478o692Ku9n71fvF87v3X+6PzZ+WtpevPGCnPPa43O3/8AAp+L5g==</latexit><latexit sha1_base64="WMg3r0ygm8YS1z2N1nlA4xcLFbY=">AAAHPXicfVXdbts2FFbbzeu0v7S93A271MBQyI6dIkszIICxFcUKtFg2O2mByM0o6UgiTFIqSTVyCb3Kbre32HPsAXY37Ha3O7SdxXKyEbBFkec73/n5REYlZ9oMBr/fuHnrvfc7H9z+0P/o408+/Wzrzt0TXVQqhuO44IV6FVENnEk4NsxweFUqoCLi8DKafev2X74FpVkhJ2ZewlTQTLKUxdTg0tnW3QcnZ4wckjACQ8/Y60n94Gxre9AfLAa5OhmuJtveahyd3encC5MirgRIE3Oq9elwUJqppcqwmEPjh5WGksYzmsEpTiUVoKd2EXxDuriSkLRQ+JOGLFb9dQj6UXTe8mINjSpOVd1ejYpihju68f02p0kfTy2TZWVAxkvKtOLEFMTVhCRMQWz4nLR5DZu9CySLIVU0DqjQgpo8KJmLMzCzd71M0TIPBJ1BDJxfLi2jcnDOIkXV3KVQnOsgQs+ZKiqZ6KCkxoCSGvFGsTrQOS1BBykzQUx57N4Thyl5YQRVM/1fXvsCW4ebi8pxMHZSpQZ+hKSxCpL7jwf3I4686xYmh0wByMYuHs7mPGcGNmwiXkFj3f+ahd8luTGl/npnx0Dd1wZ9Qx3nVGbQjwux86YC7cSld4Zf7R3sHuxoEAw1GKHkRO+cmbznkugx2YtQqaAWdo/2t5cPP3QFpahkVx8/zHgRUR7ia+hgI5C6UjBKCo4CGKGO4yKBw1ABp/UFtsDg2yI6nQyn1jXOCaDV5aPJmEpXXAUSzjEBQWViw5QKxucJpLTiprGhTi/mbZHo1Kmi8bvrZBo7CMnhoH8QxIIhKcqCo+SRwNQ6dS7aSaLvUJrauRotwVY/PMVvbW/abCb1BPAjUzCei6jgTzElu/SiG/v9i+eNlY5CsMaKxjIMNxyDuc4YF5JNSLSCrDgcYFxF2E5TuZZeT7DJMH76wpXkgmAybJXPRnVjNb8kccZLtH2Glq4GlJc5bS5D/enZRtWTjAOL896y9tftYKM1Hi/t80E4N+tdFmOWCWQKl6py7mwYCRsu15srshDP8WxNrkOsNpo2xcOwjqg6RfGFeVTUNnzr/rt+mKuKA8mBZbnB03V/rzSkSyY5EBqbinKCMD+c4Qkx6O/uQd0lF6NLnuC9QGUMBA/tc/x+nS1BMqIXZfSXVF2fkIWD3qA/BNG9QI/zQmF1mMxIIQmKinBIDdEsAYdYy2t72PzrBC+AR//rRC0yWXhpXBXwGhluXhpXJye7/SGG98Pu9uib1YVy2/vc+8L70ht6+97I+8478o692Ku9n71fvF87v3X+6PzZ+WtpevPGCnPPa43O3/8AAp+L5g==</latexit><latexit sha1_base64="WMg3r0ygm8YS1z2N1nlA4xcLFbY=">AAAHPXicfVXdbts2FFbbzeu0v7S93A271MBQyI6dIkszIICxFcUKtFg2O2mByM0o6UgiTFIqSTVyCb3Kbre32HPsAXY37Ha3O7SdxXKyEbBFkec73/n5REYlZ9oMBr/fuHnrvfc7H9z+0P/o408+/Wzrzt0TXVQqhuO44IV6FVENnEk4NsxweFUqoCLi8DKafev2X74FpVkhJ2ZewlTQTLKUxdTg0tnW3QcnZ4wckjACQ8/Y60n94Gxre9AfLAa5OhmuJtveahyd3encC5MirgRIE3Oq9elwUJqppcqwmEPjh5WGksYzmsEpTiUVoKd2EXxDuriSkLRQ+JOGLFb9dQj6UXTe8mINjSpOVd1ejYpihju68f02p0kfTy2TZWVAxkvKtOLEFMTVhCRMQWz4nLR5DZu9CySLIVU0DqjQgpo8KJmLMzCzd71M0TIPBJ1BDJxfLi2jcnDOIkXV3KVQnOsgQs+ZKiqZ6KCkxoCSGvFGsTrQOS1BBykzQUx57N4Thyl5YQRVM/1fXvsCW4ebi8pxMHZSpQZ+hKSxCpL7jwf3I4686xYmh0wByMYuHs7mPGcGNmwiXkFj3f+ahd8luTGl/npnx0Dd1wZ9Qx3nVGbQjwux86YC7cSld4Zf7R3sHuxoEAw1GKHkRO+cmbznkugx2YtQqaAWdo/2t5cPP3QFpahkVx8/zHgRUR7ia+hgI5C6UjBKCo4CGKGO4yKBw1ABp/UFtsDg2yI6nQyn1jXOCaDV5aPJmEpXXAUSzjEBQWViw5QKxucJpLTiprGhTi/mbZHo1Kmi8bvrZBo7CMnhoH8QxIIhKcqCo+SRwNQ6dS7aSaLvUJrauRotwVY/PMVvbW/abCb1BPAjUzCei6jgTzElu/SiG/v9i+eNlY5CsMaKxjIMNxyDuc4YF5JNSLSCrDgcYFxF2E5TuZZeT7DJMH76wpXkgmAybJXPRnVjNb8kccZLtH2Glq4GlJc5bS5D/enZRtWTjAOL896y9tftYKM1Hi/t80E4N+tdFmOWCWQKl6py7mwYCRsu15srshDP8WxNrkOsNpo2xcOwjqg6RfGFeVTUNnzr/rt+mKuKA8mBZbnB03V/rzSkSyY5EBqbinKCMD+c4Qkx6O/uQd0lF6NLnuC9QGUMBA/tc/x+nS1BMqIXZfSXVF2fkIWD3qA/BNG9QI/zQmF1mMxIIQmKinBIDdEsAYdYy2t72PzrBC+AR//rRC0yWXhpXBXwGhluXhpXJye7/SGG98Pu9uib1YVy2/vc+8L70ht6+97I+8478o692Ku9n71fvF87v3X+6PzZ+WtpevPGCnPPa43O3/8AAp+L5g==</latexit>
A basic subset choice choice model could assume set
utility is additive in the elements.
26
• Observe choice set C with items 1, …, c. Choose two elements.
(repeats allowed)
• Random utility of (i, j) pair: Uij = Vi + Vj + eij
Vi is base utility, eij i.i.d. Gumbel distributed error
• If choosing the set with largest random utility…
Pr[select set {i, j} | C] = e
Vi+Vj
P
{k,l}⇢C eVk+Vl
<latexit sha1_base64="k8hNq795y+cv+adMlMxth/n2hx8=">AAAHlXicfVVdb9s2FFW6rem0r3R92MNe2CUGhk527BRZmhUBgiUIVqBFszlJC4ReRklXFmNS0kiqsUvwP+51f2Sv26XtLJaTTYAtirznHN7DSzKuBNem2/1z5d4HH350f/XBx+Enn372+RdrD78802WtEjhNSlGqtzHTIHgBp4YbAW8rBUzGAt7EowM//uYdKM3L4sRMKhhINix4xhNmsOti7fJYnSMaEkM0GLJBLY8uqdvA1nOKQEOfY/tgY0A29gjNFEss/GrPLjj5jpxdXDpnqa7lhaV2FBFBHcHP2DMduGncaBonnNsIL9bWu53u9CG3G715Yz2YP8cXD+8/ommZ1BIKkwim9XmvW5mBZcrwRIALaa2hYsmIDeEcmwWToAd2aoojLexJSVYq/BWGTHvDRQjyKDZpsFjD4lowNW72xmU5whHtwrCpabJnA8uLqjZQJDPJrBbElMR7TVKu0FgxIU1dw0fvo4In4O2MmNSSmTyquJ9nZEbv20PFqjySbAQJCHHTNZuVhwseK6YmPoXySkcxMg9VWRepjipmDKhCI94oPo50zirQUcZNlDCR+O/UYypRGsnUSP8Xa0eCYTg4dU6AsSd1ZuAXSJ1VkD5+1n0cC9RdjDA5DBVA4ez05WOucm5gKSYWNTjr/xciwhbJjan0D5ubBsYdbZAbxknOiiF0klJu/l6D9kWrN3vfb+9u7W5qkBxLNMZSlu0rbvK2T6LNi3aMOwDUNO7pzvrsFVJvKMMd4v0J6VCUMRMUP6mH7UOhawX7aSmwAPZxfyRlCntUgWDja2yJk28W0flJb2D9wvkCaKzy8UmfFd5cBQVcYQKSFamlGZNcTFLIWC2M3z3ZdbtZJDrzVeHC1qKYxhWEdK/b2Y0SyVEUy0JgyaOAGevMUzSTRG5amLGn2p+BrX5yjntte+CWkzoE3GQK+hMZl+IIU7IzFu3s61cvnS28hOTOSmc5Tpf2wdwVjB3pMiSeQ+YaHtDHcwIPrNov6d0Cywr9o1fekmuBk17DPhuPndXiRsQHz9D2BUZ6D5iocuZupvrbiyXX06EAnuTtmfd3jeBCazxemueD9DSLqyz7fChRic6qytNZGktLZ/3uVlnIl3hmp3ch5gOuKfGEjmOmzrH4aB6XY0vf+f9WSHNVCyA58GFu8HTd2a4MaZGTHAhLTM0EQVhIR3hCdDtb2zBukeunRQ7xvmFFAiQGc4X718cSFCN6amM4k2qFhEwJ2t1OD2TrGt3PS4Xu8GJIyoJgUREBGV4rPAWPWMhrvef+JcEL4On/kqhpJlMW513Aa6S3fGncbpxtdXo4vZ+31vd/nF8oD4Kvg2+Cb4NesBPsBz8Fx8FpkAR/BH8Ff68Eq1+t7q0erh7NQu+tzDGPgsaz+vofdD+nOw==</latexit><latexit sha1_base64="k8hNq795y+cv+adMlMxth/n2hx8=">AAAHlXicfVVdb9s2FFW6rem0r3R92MNe2CUGhk527BRZmhUBgiUIVqBFszlJC4ReRklXFmNS0kiqsUvwP+51f2Sv26XtLJaTTYAtirznHN7DSzKuBNem2/1z5d4HH350f/XBx+Enn372+RdrD78802WtEjhNSlGqtzHTIHgBp4YbAW8rBUzGAt7EowM//uYdKM3L4sRMKhhINix4xhNmsOti7fJYnSMaEkM0GLJBLY8uqdvA1nOKQEOfY/tgY0A29gjNFEss/GrPLjj5jpxdXDpnqa7lhaV2FBFBHcHP2DMduGncaBonnNsIL9bWu53u9CG3G715Yz2YP8cXD+8/ommZ1BIKkwim9XmvW5mBZcrwRIALaa2hYsmIDeEcmwWToAd2aoojLexJSVYq/BWGTHvDRQjyKDZpsFjD4lowNW72xmU5whHtwrCpabJnA8uLqjZQJDPJrBbElMR7TVKu0FgxIU1dw0fvo4In4O2MmNSSmTyquJ9nZEbv20PFqjySbAQJCHHTNZuVhwseK6YmPoXySkcxMg9VWRepjipmDKhCI94oPo50zirQUcZNlDCR+O/UYypRGsnUSP8Xa0eCYTg4dU6AsSd1ZuAXSJ1VkD5+1n0cC9RdjDA5DBVA4ez05WOucm5gKSYWNTjr/xciwhbJjan0D5ubBsYdbZAbxknOiiF0klJu/l6D9kWrN3vfb+9u7W5qkBxLNMZSlu0rbvK2T6LNi3aMOwDUNO7pzvrsFVJvKMMd4v0J6VCUMRMUP6mH7UOhawX7aSmwAPZxfyRlCntUgWDja2yJk28W0flJb2D9wvkCaKzy8UmfFd5cBQVcYQKSFamlGZNcTFLIWC2M3z3ZdbtZJDrzVeHC1qKYxhWEdK/b2Y0SyVEUy0JgyaOAGevMUzSTRG5amLGn2p+BrX5yjntte+CWkzoE3GQK+hMZl+IIU7IzFu3s61cvnS28hOTOSmc5Tpf2wdwVjB3pMiSeQ+YaHtDHcwIPrNov6d0Cywr9o1fekmuBk17DPhuPndXiRsQHz9D2BUZ6D5iocuZupvrbiyXX06EAnuTtmfd3jeBCazxemueD9DSLqyz7fChRic6qytNZGktLZ/3uVlnIl3hmp3ch5gOuKfGEjmOmzrH4aB6XY0vf+f9WSHNVCyA58GFu8HTd2a4MaZGTHAhLTM0EQVhIR3hCdDtb2zBukeunRQ7xvmFFAiQGc4X718cSFCN6amM4k2qFhEwJ2t1OD2TrGt3PS4Xu8GJIyoJgUREBGV4rPAWPWMhrvef+JcEL4On/kqhpJlMW513Aa6S3fGncbpxtdXo4vZ+31vd/nF8oD4Kvg2+Cb4NesBPsBz8Fx8FpkAR/BH8Ff68Eq1+t7q0erh7NQu+tzDGPgsaz+vofdD+nOw==</latexit><latexit sha1_base64="k8hNq795y+cv+adMlMxth/n2hx8=">AAAHlXicfVVdb9s2FFW6rem0r3R92MNe2CUGhk527BRZmhUBgiUIVqBFszlJC4ReRklXFmNS0kiqsUvwP+51f2Sv26XtLJaTTYAtirznHN7DSzKuBNem2/1z5d4HH350f/XBx+Enn372+RdrD78802WtEjhNSlGqtzHTIHgBp4YbAW8rBUzGAt7EowM//uYdKM3L4sRMKhhINix4xhNmsOti7fJYnSMaEkM0GLJBLY8uqdvA1nOKQEOfY/tgY0A29gjNFEss/GrPLjj5jpxdXDpnqa7lhaV2FBFBHcHP2DMduGncaBonnNsIL9bWu53u9CG3G715Yz2YP8cXD+8/ommZ1BIKkwim9XmvW5mBZcrwRIALaa2hYsmIDeEcmwWToAd2aoojLexJSVYq/BWGTHvDRQjyKDZpsFjD4lowNW72xmU5whHtwrCpabJnA8uLqjZQJDPJrBbElMR7TVKu0FgxIU1dw0fvo4In4O2MmNSSmTyquJ9nZEbv20PFqjySbAQJCHHTNZuVhwseK6YmPoXySkcxMg9VWRepjipmDKhCI94oPo50zirQUcZNlDCR+O/UYypRGsnUSP8Xa0eCYTg4dU6AsSd1ZuAXSJ1VkD5+1n0cC9RdjDA5DBVA4ez05WOucm5gKSYWNTjr/xciwhbJjan0D5ubBsYdbZAbxknOiiF0klJu/l6D9kWrN3vfb+9u7W5qkBxLNMZSlu0rbvK2T6LNi3aMOwDUNO7pzvrsFVJvKMMd4v0J6VCUMRMUP6mH7UOhawX7aSmwAPZxfyRlCntUgWDja2yJk28W0flJb2D9wvkCaKzy8UmfFd5cBQVcYQKSFamlGZNcTFLIWC2M3z3ZdbtZJDrzVeHC1qKYxhWEdK/b2Y0SyVEUy0JgyaOAGevMUzSTRG5amLGn2p+BrX5yjntte+CWkzoE3GQK+hMZl+IIU7IzFu3s61cvnS28hOTOSmc5Tpf2wdwVjB3pMiSeQ+YaHtDHcwIPrNov6d0Cywr9o1fekmuBk17DPhuPndXiRsQHz9D2BUZ6D5iocuZupvrbiyXX06EAnuTtmfd3jeBCazxemueD9DSLqyz7fChRic6qytNZGktLZ/3uVlnIl3hmp3ch5gOuKfGEjmOmzrH4aB6XY0vf+f9WSHNVCyA58GFu8HTd2a4MaZGTHAhLTM0EQVhIR3hCdDtb2zBukeunRQ7xvmFFAiQGc4X718cSFCN6amM4k2qFhEwJ2t1OD2TrGt3PS4Xu8GJIyoJgUREBGV4rPAWPWMhrvef+JcEL4On/kqhpJlMW513Aa6S3fGncbpxtdXo4vZ+31vd/nF8oD4Kvg2+Cb4NesBPsBz8Fx8FpkAR/BH8Ff68Eq1+t7q0erh7NQu+tzDGPgsaz+vofdD+nOw==</latexit><latexit sha1_base64="k8hNq795y+cv+adMlMxth/n2hx8=">AAAHlXicfVVdb9s2FFW6rem0r3R92MNe2CUGhk527BRZmhUBgiUIVqBFszlJC4ReRklXFmNS0kiqsUvwP+51f2Sv26XtLJaTTYAtirznHN7DSzKuBNem2/1z5d4HH350f/XBx+Enn372+RdrD78802WtEjhNSlGqtzHTIHgBp4YbAW8rBUzGAt7EowM//uYdKM3L4sRMKhhINix4xhNmsOti7fJYnSMaEkM0GLJBLY8uqdvA1nOKQEOfY/tgY0A29gjNFEss/GrPLjj5jpxdXDpnqa7lhaV2FBFBHcHP2DMduGncaBonnNsIL9bWu53u9CG3G715Yz2YP8cXD+8/ommZ1BIKkwim9XmvW5mBZcrwRIALaa2hYsmIDeEcmwWToAd2aoojLexJSVYq/BWGTHvDRQjyKDZpsFjD4lowNW72xmU5whHtwrCpabJnA8uLqjZQJDPJrBbElMR7TVKu0FgxIU1dw0fvo4In4O2MmNSSmTyquJ9nZEbv20PFqjySbAQJCHHTNZuVhwseK6YmPoXySkcxMg9VWRepjipmDKhCI94oPo50zirQUcZNlDCR+O/UYypRGsnUSP8Xa0eCYTg4dU6AsSd1ZuAXSJ1VkD5+1n0cC9RdjDA5DBVA4ez05WOucm5gKSYWNTjr/xciwhbJjan0D5ubBsYdbZAbxknOiiF0klJu/l6D9kWrN3vfb+9u7W5qkBxLNMZSlu0rbvK2T6LNi3aMOwDUNO7pzvrsFVJvKMMd4v0J6VCUMRMUP6mH7UOhawX7aSmwAPZxfyRlCntUgWDja2yJk28W0flJb2D9wvkCaKzy8UmfFd5cBQVcYQKSFamlGZNcTFLIWC2M3z3ZdbtZJDrzVeHC1qKYxhWEdK/b2Y0SyVEUy0JgyaOAGevMUzSTRG5amLGn2p+BrX5yjntte+CWkzoE3GQK+hMZl+IIU7IzFu3s61cvnS28hOTOSmc5Tpf2wdwVjB3pMiSeQ+YaHtDHcwIPrNov6d0Cywr9o1fekmuBk17DPhuPndXiRsQHz9D2BUZ6D5iocuZupvrbiyXX06EAnuTtmfd3jeBCazxemueD9DSLqyz7fChRic6qytNZGktLZ/3uVlnIl3hmp3ch5gOuKfGEjmOmzrH4aB6XY0vf+f9WSHNVCyA58GFu8HTd2a4MaZGTHAhLTM0EQVhIR3hCdDtb2zBukeunRQ7xvmFFAiQGc4X718cSFCN6amM4k2qFhEwJ2t1OD2TrGt3PS4Xu8GJIyoJgUREBGV4rPAWPWMhrvef+JcEL4On/kqhpJlMW513Aa6S3fGncbpxtdXo4vZ+31vd/nF8oD4Kvg2+Cb4NesBPsBz8Fx8FpkAR/BH8Ff68Eq1+t7q0erh7NQu+tzDGPgsaz+vofdD+nOw==</latexit>
Pr[select set {i, j} | C, j] = eVi
P
k2C eVk
<latexit sha1_base64="ZaJhcD7ScvxQtNfQTogu245TRXE=">AAAHg3icfVVdb9s2FFW7te60j6br417YxQaGTnbsdFmaFQEMpChaoMWy2UkDmF5GSVcWa1LSSKqxS+iv7X/sfa/bb9il7SyWk42AJOrynnt4Dy/JsBBcm273j1u3P/r4zt3GvU/8Tz/7/Iv7Ww++PNV5qSI4iXKRq7OQaRA8gxPDjYCzQgGToYC34fTIjb99D0rzPBuaeQFjySYZT3jEDJrOt86O1QjREBmiwZAmtTx4R6sm9p5RBBr6DPtHzYA03zXHpHlIaKJYZOEXe3rOq8pSXcpzOyWUZ+SoWpinVdX0z7e2u53uopHrnd6qs+2t2vH5g7sPaZxHpYTMRIJpPep1CzO2TBkeCah8WmooWDRlExhhN2MS9NguJKhICy0xSXKFT2bIwuqvQzCOYvNaFGtYWAqmZnVrmOdTHNGV79c5TfJ0bHlWlAayaEmZlIKYnDhlScwVyijmpM5r+PRDkPEInG4Bk1oykwYFd/MMzPRDe6JYkQaSTSECIa5My1k5uOChYmruUsgvdBBi5InKyyzWQcGMAZVpxBvFZ4FOWQE6SLgJIiYi9x87TCFyI5ma6v+K2pFgGA4ulBNg7LBMDPwMcWUVxI+edh+FAnnXPUwKEwWQVXbxcT4XKTew4ROKEirr3msefoukxhT6h50dA7OONhgbZlHKsgl0olzu/FaCdiWqd3rf7x3sHuxokBwLMsTCle0LbtK2S6LNs3aI9Q5q4fdkf3v58akTlOF+cPr4dCLykAmKv9TB+pDpUkE/zgUWQB93Q5THcEgVCDa7xOY4+XoRjYa9sXUL5wqgtsrHwwHLnLgKMrjABCTLYksTJrmYx5CwUhi3WZLLfr1IdOKqovJb62QaVxDiw27nIIgkR1IsC4EljwRmphMXop4kxqaZmblQ/SXY6scj3Gt742ozqeeAm0zBYC7DXLzAlOwyiq7sj29eVzZzFJJXVlaW43TpAMxNzmiINyHhCrLicIBBGeJymtIt6c0EmwyDF2+cJJcEw15NPhvOKqvFFYlzXqLtK/R0GjBRpKy6muqvrzZUjycCeJS2l9rfNIILrfF4qZ8P0oVZX2U54BOJTHRZVS6cpaG0dGmvrpWFfI0ndHwTYjVQ1Ske01nI1AiLj6ZhPrP0vXu3fJqqUgBJgU9Sg6fr/l5hSIsMUyAsMiUTBGE+neIJ0e3s7sGsRS5bizzH24VlEZAQzAXuX+dLkIzohYz+kqrlE7II0O52eiBbl+hBmitUh2cTkmcEi4oISPAS4TE4xFpe273q3yB4ATz53yBqkckiSuVUwGukt3lpXO+c7nZ6OL2fdrf7L1cXyj3vK+9r7xuv5+17fe+ld+ydeJH3u/en95f3d+NO49vGbuO7pevtWyvMQ6/WGof/AOdZoU0=</latexit><latexit sha1_base64="ZaJhcD7ScvxQtNfQTogu245TRXE=">AAAHg3icfVVdb9s2FFW7te60j6br417YxQaGTnbsdFmaFQEMpChaoMWy2UkDmF5GSVcWa1LSSKqxS+iv7X/sfa/bb9il7SyWk42AJOrynnt4Dy/JsBBcm273j1u3P/r4zt3GvU/8Tz/7/Iv7Ww++PNV5qSI4iXKRq7OQaRA8gxPDjYCzQgGToYC34fTIjb99D0rzPBuaeQFjySYZT3jEDJrOt86O1QjREBmiwZAmtTx4R6sm9p5RBBr6DPtHzYA03zXHpHlIaKJYZOEXe3rOq8pSXcpzOyWUZ+SoWpinVdX0z7e2u53uopHrnd6qs+2t2vH5g7sPaZxHpYTMRIJpPep1CzO2TBkeCah8WmooWDRlExhhN2MS9NguJKhICy0xSXKFT2bIwuqvQzCOYvNaFGtYWAqmZnVrmOdTHNGV79c5TfJ0bHlWlAayaEmZlIKYnDhlScwVyijmpM5r+PRDkPEInG4Bk1oykwYFd/MMzPRDe6JYkQaSTSECIa5My1k5uOChYmruUsgvdBBi5InKyyzWQcGMAZVpxBvFZ4FOWQE6SLgJIiYi9x87TCFyI5ma6v+K2pFgGA4ulBNg7LBMDPwMcWUVxI+edh+FAnnXPUwKEwWQVXbxcT4XKTew4ROKEirr3msefoukxhT6h50dA7OONhgbZlHKsgl0olzu/FaCdiWqd3rf7x3sHuxokBwLMsTCle0LbtK2S6LNs3aI9Q5q4fdkf3v58akTlOF+cPr4dCLykAmKv9TB+pDpUkE/zgUWQB93Q5THcEgVCDa7xOY4+XoRjYa9sXUL5wqgtsrHwwHLnLgKMrjABCTLYksTJrmYx5CwUhi3WZLLfr1IdOKqovJb62QaVxDiw27nIIgkR1IsC4EljwRmphMXop4kxqaZmblQ/SXY6scj3Gt742ozqeeAm0zBYC7DXLzAlOwyiq7sj29eVzZzFJJXVlaW43TpAMxNzmiINyHhCrLicIBBGeJymtIt6c0EmwyDF2+cJJcEw15NPhvOKqvFFYlzXqLtK/R0GjBRpKy6muqvrzZUjycCeJS2l9rfNIILrfF4qZ8P0oVZX2U54BOJTHRZVS6cpaG0dGmvrpWFfI0ndHwTYjVQ1Ske01nI1AiLj6ZhPrP0vXu3fJqqUgBJgU9Sg6fr/l5hSIsMUyAsMiUTBGE+neIJ0e3s7sGsRS5bizzH24VlEZAQzAXuX+dLkIzohYz+kqrlE7II0O52eiBbl+hBmitUh2cTkmcEi4oISPAS4TE4xFpe273q3yB4ATz53yBqkckiSuVUwGukt3lpXO+c7nZ6OL2fdrf7L1cXyj3vK+9r7xuv5+17fe+ld+ydeJH3u/en95f3d+NO49vGbuO7pevtWyvMQ6/WGof/AOdZoU0=</latexit><latexit sha1_base64="ZaJhcD7ScvxQtNfQTogu245TRXE=">AAAHg3icfVVdb9s2FFW7te60j6br417YxQaGTnbsdFmaFQEMpChaoMWy2UkDmF5GSVcWa1LSSKqxS+iv7X/sfa/bb9il7SyWk42AJOrynnt4Dy/JsBBcm273j1u3P/r4zt3GvU/8Tz/7/Iv7Ww++PNV5qSI4iXKRq7OQaRA8gxPDjYCzQgGToYC34fTIjb99D0rzPBuaeQFjySYZT3jEDJrOt86O1QjREBmiwZAmtTx4R6sm9p5RBBr6DPtHzYA03zXHpHlIaKJYZOEXe3rOq8pSXcpzOyWUZ+SoWpinVdX0z7e2u53uopHrnd6qs+2t2vH5g7sPaZxHpYTMRIJpPep1CzO2TBkeCah8WmooWDRlExhhN2MS9NguJKhICy0xSXKFT2bIwuqvQzCOYvNaFGtYWAqmZnVrmOdTHNGV79c5TfJ0bHlWlAayaEmZlIKYnDhlScwVyijmpM5r+PRDkPEInG4Bk1oykwYFd/MMzPRDe6JYkQaSTSECIa5My1k5uOChYmruUsgvdBBi5InKyyzWQcGMAZVpxBvFZ4FOWQE6SLgJIiYi9x87TCFyI5ma6v+K2pFgGA4ulBNg7LBMDPwMcWUVxI+edh+FAnnXPUwKEwWQVXbxcT4XKTew4ROKEirr3msefoukxhT6h50dA7OONhgbZlHKsgl0olzu/FaCdiWqd3rf7x3sHuxokBwLMsTCle0LbtK2S6LNs3aI9Q5q4fdkf3v58akTlOF+cPr4dCLykAmKv9TB+pDpUkE/zgUWQB93Q5THcEgVCDa7xOY4+XoRjYa9sXUL5wqgtsrHwwHLnLgKMrjABCTLYksTJrmYx5CwUhi3WZLLfr1IdOKqovJb62QaVxDiw27nIIgkR1IsC4EljwRmphMXop4kxqaZmblQ/SXY6scj3Gt742ozqeeAm0zBYC7DXLzAlOwyiq7sj29eVzZzFJJXVlaW43TpAMxNzmiINyHhCrLicIBBGeJymtIt6c0EmwyDF2+cJJcEw15NPhvOKqvFFYlzXqLtK/R0GjBRpKy6muqvrzZUjycCeJS2l9rfNIILrfF4qZ8P0oVZX2U54BOJTHRZVS6cpaG0dGmvrpWFfI0ndHwTYjVQ1Ske01nI1AiLj6ZhPrP0vXu3fJqqUgBJgU9Sg6fr/l5hSIsMUyAsMiUTBGE+neIJ0e3s7sGsRS5bizzH24VlEZAQzAXuX+dLkIzohYz+kqrlE7II0O52eiBbl+hBmitUh2cTkmcEi4oISPAS4TE4xFpe273q3yB4ATz53yBqkckiSuVUwGukt3lpXO+c7nZ6OL2fdrf7L1cXyj3vK+9r7xuv5+17fe+ld+ydeJH3u/en95f3d+NO49vGbuO7pevtWyvMQ6/WGof/AOdZoU0=</latexit><latexit sha1_base64="ZaJhcD7ScvxQtNfQTogu245TRXE=">AAAHg3icfVVdb9s2FFW7te60j6br417YxQaGTnbsdFmaFQEMpChaoMWy2UkDmF5GSVcWa1LSSKqxS+iv7X/sfa/bb9il7SyWk42AJOrynnt4Dy/JsBBcm273j1u3P/r4zt3GvU/8Tz/7/Iv7Ww++PNV5qSI4iXKRq7OQaRA8gxPDjYCzQgGToYC34fTIjb99D0rzPBuaeQFjySYZT3jEDJrOt86O1QjREBmiwZAmtTx4R6sm9p5RBBr6DPtHzYA03zXHpHlIaKJYZOEXe3rOq8pSXcpzOyWUZ+SoWpinVdX0z7e2u53uopHrnd6qs+2t2vH5g7sPaZxHpYTMRIJpPep1CzO2TBkeCah8WmooWDRlExhhN2MS9NguJKhICy0xSXKFT2bIwuqvQzCOYvNaFGtYWAqmZnVrmOdTHNGV79c5TfJ0bHlWlAayaEmZlIKYnDhlScwVyijmpM5r+PRDkPEInG4Bk1oykwYFd/MMzPRDe6JYkQaSTSECIa5My1k5uOChYmruUsgvdBBi5InKyyzWQcGMAZVpxBvFZ4FOWQE6SLgJIiYi9x87TCFyI5ma6v+K2pFgGA4ulBNg7LBMDPwMcWUVxI+edh+FAnnXPUwKEwWQVXbxcT4XKTew4ROKEirr3msefoukxhT6h50dA7OONhgbZlHKsgl0olzu/FaCdiWqd3rf7x3sHuxokBwLMsTCle0LbtK2S6LNs3aI9Q5q4fdkf3v58akTlOF+cPr4dCLykAmKv9TB+pDpUkE/zgUWQB93Q5THcEgVCDa7xOY4+XoRjYa9sXUL5wqgtsrHwwHLnLgKMrjABCTLYksTJrmYx5CwUhi3WZLLfr1IdOKqovJb62QaVxDiw27nIIgkR1IsC4EljwRmphMXop4kxqaZmblQ/SXY6scj3Gt742ozqeeAm0zBYC7DXLzAlOwyiq7sj29eVzZzFJJXVlaW43TpAMxNzmiINyHhCrLicIBBGeJymtIt6c0EmwyDF2+cJJcEw15NPhvOKqvFFYlzXqLtK/R0GjBRpKy6muqvrzZUjycCeJS2l9rfNIILrfF4qZ8P0oVZX2U54BOJTHRZVS6cpaG0dGmvrpWFfI0ndHwTYjVQ1Ske01nI1AiLj6ZhPrP0vXu3fJqqUgBJgU9Sg6fr/l5hSIsMUyAsMiUTBGE+neIJ0e3s7sGsRS5bizzH24VlEZAQzAXuX+dLkIzohYz+kqrlE7II0O52eiBbl+hBmitUh2cTkmcEi4oISPAS4TE4xFpe273q3yB4ATz53yBqkckiSuVUwGukt3lpXO+c7nZ6OL2fdrf7L1cXyj3vK+9r7xuv5+17fe+ld+ydeJH3u/en95f3d+NO49vGbuO7pevtWyvMQ6/WGof/AOdZoU0=</latexit>
Observation. Probability of selecting i, given j, is the same for all j.
Set prediction three ways
Set prediction three ways
Set prediction three ways
Set prediction three ways
Set prediction three ways
Set prediction three ways
Set prediction three ways
Set prediction three ways
Set prediction three ways
Set prediction three ways
Set prediction three ways
Set prediction three ways
Set prediction three ways
Set prediction three ways
Set prediction three ways
Set prediction three ways
Set prediction three ways
Set prediction three ways
Set prediction three ways
Set prediction three ways
Set prediction three ways
Set prediction three ways
Set prediction three ways
Set prediction three ways
Set prediction three ways
Set prediction three ways
Set prediction three ways
Set prediction three ways
Set prediction three ways
Set prediction three ways
Set prediction three ways
Set prediction three ways
Set prediction three ways
Set prediction three ways
Set prediction three ways
Set prediction three ways
Set prediction three ways
Set prediction three ways
Set prediction three ways
Set prediction three ways

Más contenido relacionado

La actualidad más candente

Sequences of Sets KDD '18
Sequences of Sets KDD '18Sequences of Sets KDD '18
Sequences of Sets KDD '18Austin Benson
 
Sampling methods for counting temporal motifs
Sampling methods for counting temporal motifsSampling methods for counting temporal motifs
Sampling methods for counting temporal motifsAustin Benson
 
Simplicial closure and higher-order link prediction
Simplicial closure and higher-order link predictionSimplicial closure and higher-order link prediction
Simplicial closure and higher-order link predictionAustin Benson
 
Choosing to grow a graph
Choosing to grow a graphChoosing to grow a graph
Choosing to grow a graphAustin Benson
 
Computational Frameworks for Higher-order Network Data Analysis
Computational Frameworks for Higher-order Network Data AnalysisComputational Frameworks for Higher-order Network Data Analysis
Computational Frameworks for Higher-order Network Data AnalysisAustin Benson
 
Higher-order link prediction and other hypergraph modeling
Higher-order link prediction and other hypergraph modelingHigher-order link prediction and other hypergraph modeling
Higher-order link prediction and other hypergraph modelingAustin Benson
 
Simplicial closure and higher-order link prediction LA/OPT
Simplicial closure and higher-order link prediction LA/OPTSimplicial closure and higher-order link prediction LA/OPT
Simplicial closure and higher-order link prediction LA/OPTAustin Benson
 
Data enriched linear regression
Data enriched linear regressionData enriched linear regression
Data enriched linear regressionSunny Kr
 
A PROCESS OF LINK MINING
A PROCESS OF LINK MININGA PROCESS OF LINK MINING
A PROCESS OF LINK MININGcsandit
 
Confiscation of Duplicate Tuples in The Relational Databases
Confiscation of Duplicate Tuples in The Relational DatabasesConfiscation of Duplicate Tuples in The Relational Databases
Confiscation of Duplicate Tuples in The Relational DatabasesIJERA Editor
 
Simplicial closure and simplicial diffusions
Simplicial closure and simplicial diffusionsSimplicial closure and simplicial diffusions
Simplicial closure and simplicial diffusionsAustin Benson
 
Web Based Fuzzy Clustering Analysis
Web Based Fuzzy Clustering AnalysisWeb Based Fuzzy Clustering Analysis
Web Based Fuzzy Clustering Analysisinventy
 
Ijarcet vol-2-issue-7-2252-2257
Ijarcet vol-2-issue-7-2252-2257Ijarcet vol-2-issue-7-2252-2257
Ijarcet vol-2-issue-7-2252-2257Editor IJARCET
 
International Journal of Engineering Research and Development (IJERD)
International Journal of Engineering Research and Development (IJERD)International Journal of Engineering Research and Development (IJERD)
International Journal of Engineering Research and Development (IJERD)IJERD Editor
 
Statistical Analysis based Hypothesis Testing Method in Biological Knowledge ...
Statistical Analysis based Hypothesis Testing Method in Biological Knowledge ...Statistical Analysis based Hypothesis Testing Method in Biological Knowledge ...
Statistical Analysis based Hypothesis Testing Method in Biological Knowledge ...ijcsa
 

La actualidad más candente (20)

Sequences of Sets KDD '18
Sequences of Sets KDD '18Sequences of Sets KDD '18
Sequences of Sets KDD '18
 
Sampling methods for counting temporal motifs
Sampling methods for counting temporal motifsSampling methods for counting temporal motifs
Sampling methods for counting temporal motifs
 
Simplicial closure and higher-order link prediction
Simplicial closure and higher-order link predictionSimplicial closure and higher-order link prediction
Simplicial closure and higher-order link prediction
 
Choosing to grow a graph
Choosing to grow a graphChoosing to grow a graph
Choosing to grow a graph
 
Computational Frameworks for Higher-order Network Data Analysis
Computational Frameworks for Higher-order Network Data AnalysisComputational Frameworks for Higher-order Network Data Analysis
Computational Frameworks for Higher-order Network Data Analysis
 
Higher-order link prediction and other hypergraph modeling
Higher-order link prediction and other hypergraph modelingHigher-order link prediction and other hypergraph modeling
Higher-order link prediction and other hypergraph modeling
 
Simplicial closure and higher-order link prediction LA/OPT
Simplicial closure and higher-order link prediction LA/OPTSimplicial closure and higher-order link prediction LA/OPT
Simplicial closure and higher-order link prediction LA/OPT
 
Data enriched linear regression
Data enriched linear regressionData enriched linear regression
Data enriched linear regression
 
Bi4101343346
Bi4101343346Bi4101343346
Bi4101343346
 
A PROCESS OF LINK MINING
A PROCESS OF LINK MININGA PROCESS OF LINK MINING
A PROCESS OF LINK MINING
 
Confiscation of Duplicate Tuples in The Relational Databases
Confiscation of Duplicate Tuples in The Relational DatabasesConfiscation of Duplicate Tuples in The Relational Databases
Confiscation of Duplicate Tuples in The Relational Databases
 
ma52009id421
ma52009id421ma52009id421
ma52009id421
 
Mcs 021
Mcs 021Mcs 021
Mcs 021
 
Simplicial closure and simplicial diffusions
Simplicial closure and simplicial diffusionsSimplicial closure and simplicial diffusions
Simplicial closure and simplicial diffusions
 
K04302082087
K04302082087K04302082087
K04302082087
 
Web Based Fuzzy Clustering Analysis
Web Based Fuzzy Clustering AnalysisWeb Based Fuzzy Clustering Analysis
Web Based Fuzzy Clustering Analysis
 
Mcs 021 solve assignment
Mcs 021 solve assignmentMcs 021 solve assignment
Mcs 021 solve assignment
 
Ijarcet vol-2-issue-7-2252-2257
Ijarcet vol-2-issue-7-2252-2257Ijarcet vol-2-issue-7-2252-2257
Ijarcet vol-2-issue-7-2252-2257
 
International Journal of Engineering Research and Development (IJERD)
International Journal of Engineering Research and Development (IJERD)International Journal of Engineering Research and Development (IJERD)
International Journal of Engineering Research and Development (IJERD)
 
Statistical Analysis based Hypothesis Testing Method in Biological Knowledge ...
Statistical Analysis based Hypothesis Testing Method in Biological Knowledge ...Statistical Analysis based Hypothesis Testing Method in Biological Knowledge ...
Statistical Analysis based Hypothesis Testing Method in Biological Knowledge ...
 

Similar a Set prediction three ways

11.0004www.iiste.org call for paper.on demand quality of web services using r...
11.0004www.iiste.org call for paper.on demand quality of web services using r...11.0004www.iiste.org call for paper.on demand quality of web services using r...
11.0004www.iiste.org call for paper.on demand quality of web services using r...Alexander Decker
 
4.on demand quality of web services using ranking by multi criteria 31-35
4.on demand quality of web services using ranking by multi criteria 31-354.on demand quality of web services using ranking by multi criteria 31-35
4.on demand quality of web services using ranking by multi criteria 31-35Alexander Decker
 
EFFICIENTLY PROCESSING OF TOP-K TYPICALITY QUERY FOR STRUCTURED DATA
EFFICIENTLY PROCESSING OF TOP-K TYPICALITY QUERY FOR STRUCTURED DATAEFFICIENTLY PROCESSING OF TOP-K TYPICALITY QUERY FOR STRUCTURED DATA
EFFICIENTLY PROCESSING OF TOP-K TYPICALITY QUERY FOR STRUCTURED DATAcsandit
 
Elasticsearch - basics and beyond
Elasticsearch - basics and beyondElasticsearch - basics and beyond
Elasticsearch - basics and beyondErnesto Reig
 
COLOCATION MINING IN UNCERTAIN DATA SETS: A PROBABILISTIC APPROACH
COLOCATION MINING IN UNCERTAIN DATA SETS: A PROBABILISTIC APPROACHCOLOCATION MINING IN UNCERTAIN DATA SETS: A PROBABILISTIC APPROACH
COLOCATION MINING IN UNCERTAIN DATA SETS: A PROBABILISTIC APPROACHIJCI JOURNAL
 
What's "For Free" on Craigslist?
What's "For Free" on Craigslist? What's "For Free" on Craigslist?
What's "For Free" on Craigslist? Josh Mayer
 
K-NN Classifier Performs Better Than K-Means Clustering in Missing Value Imp...
K-NN Classifier Performs Better Than K-Means Clustering in  Missing Value Imp...K-NN Classifier Performs Better Than K-Means Clustering in  Missing Value Imp...
K-NN Classifier Performs Better Than K-Means Clustering in Missing Value Imp...IOSR Journals
 
EFFICIENT SCHEMA BASED KEYWORD SEARCH IN RELATIONAL DATABASES
EFFICIENT SCHEMA BASED KEYWORD SEARCH IN RELATIONAL DATABASESEFFICIENT SCHEMA BASED KEYWORD SEARCH IN RELATIONAL DATABASES
EFFICIENT SCHEMA BASED KEYWORD SEARCH IN RELATIONAL DATABASESIJCSEIT Journal
 
Certain Investigation on Dynamic Clustering in Dynamic Datamining
Certain Investigation on Dynamic Clustering in Dynamic DataminingCertain Investigation on Dynamic Clustering in Dynamic Datamining
Certain Investigation on Dynamic Clustering in Dynamic Dataminingijdmtaiir
 
The improved k means with particle swarm optimization
The improved k means with particle swarm optimizationThe improved k means with particle swarm optimization
The improved k means with particle swarm optimizationAlexander Decker
 
Tim Menzies, directions in Data Science
Tim Menzies, directions in Data ScienceTim Menzies, directions in Data Science
Tim Menzies, directions in Data ScienceCS, NcState
 
Mncs 16-10-1주-변승규-introduction to the machine learning #2
Mncs 16-10-1주-변승규-introduction to the machine learning #2Mncs 16-10-1주-변승규-introduction to the machine learning #2
Mncs 16-10-1주-변승규-introduction to the machine learning #2Seung-gyu Byeon
 
Active Image Clustering: Seeking Constraints from Humans to Complement Algori...
Active Image Clustering: Seeking Constraints from Humans to Complement Algori...Active Image Clustering: Seeking Constraints from Humans to Complement Algori...
Active Image Clustering: Seeking Constraints from Humans to Complement Algori...Harish Vaidyanathan
 
An Heterogeneous Population-Based Genetic Algorithm for Data Clustering
An Heterogeneous Population-Based Genetic Algorithm for Data ClusteringAn Heterogeneous Population-Based Genetic Algorithm for Data Clustering
An Heterogeneous Population-Based Genetic Algorithm for Data Clusteringijeei-iaes
 
02 Network Data Collection
02 Network Data Collection02 Network Data Collection
02 Network Data Collectiondnac
 
Complex Relations Extraction
Complex Relations ExtractionComplex Relations Extraction
Complex Relations ExtractionNaveed Afzal
 

Similar a Set prediction three ways (20)

11.0004www.iiste.org call for paper.on demand quality of web services using r...
11.0004www.iiste.org call for paper.on demand quality of web services using r...11.0004www.iiste.org call for paper.on demand quality of web services using r...
11.0004www.iiste.org call for paper.on demand quality of web services using r...
 
4.on demand quality of web services using ranking by multi criteria 31-35
4.on demand quality of web services using ranking by multi criteria 31-354.on demand quality of web services using ranking by multi criteria 31-35
4.on demand quality of web services using ranking by multi criteria 31-35
 
Bank loan purchase modeling
Bank loan purchase modelingBank loan purchase modeling
Bank loan purchase modeling
 
EFFICIENTLY PROCESSING OF TOP-K TYPICALITY QUERY FOR STRUCTURED DATA
EFFICIENTLY PROCESSING OF TOP-K TYPICALITY QUERY FOR STRUCTURED DATAEFFICIENTLY PROCESSING OF TOP-K TYPICALITY QUERY FOR STRUCTURED DATA
EFFICIENTLY PROCESSING OF TOP-K TYPICALITY QUERY FOR STRUCTURED DATA
 
Elasticsearch - basics and beyond
Elasticsearch - basics and beyondElasticsearch - basics and beyond
Elasticsearch - basics and beyond
 
COLOCATION MINING IN UNCERTAIN DATA SETS: A PROBABILISTIC APPROACH
COLOCATION MINING IN UNCERTAIN DATA SETS: A PROBABILISTIC APPROACHCOLOCATION MINING IN UNCERTAIN DATA SETS: A PROBABILISTIC APPROACH
COLOCATION MINING IN UNCERTAIN DATA SETS: A PROBABILISTIC APPROACH
 
What's "For Free" on Craigslist?
What's "For Free" on Craigslist? What's "For Free" on Craigslist?
What's "For Free" on Craigslist?
 
K-NN Classifier Performs Better Than K-Means Clustering in Missing Value Imp...
K-NN Classifier Performs Better Than K-Means Clustering in  Missing Value Imp...K-NN Classifier Performs Better Than K-Means Clustering in  Missing Value Imp...
K-NN Classifier Performs Better Than K-Means Clustering in Missing Value Imp...
 
EFFICIENT SCHEMA BASED KEYWORD SEARCH IN RELATIONAL DATABASES
EFFICIENT SCHEMA BASED KEYWORD SEARCH IN RELATIONAL DATABASESEFFICIENT SCHEMA BASED KEYWORD SEARCH IN RELATIONAL DATABASES
EFFICIENT SCHEMA BASED KEYWORD SEARCH IN RELATIONAL DATABASES
 
MyStataLab Assignment Help
MyStataLab Assignment HelpMyStataLab Assignment Help
MyStataLab Assignment Help
 
Final Project Statr 503
Final Project Statr 503Final Project Statr 503
Final Project Statr 503
 
Certain Investigation on Dynamic Clustering in Dynamic Datamining
Certain Investigation on Dynamic Clustering in Dynamic DataminingCertain Investigation on Dynamic Clustering in Dynamic Datamining
Certain Investigation on Dynamic Clustering in Dynamic Datamining
 
The improved k means with particle swarm optimization
The improved k means with particle swarm optimizationThe improved k means with particle swarm optimization
The improved k means with particle swarm optimization
 
Tim Menzies, directions in Data Science
Tim Menzies, directions in Data ScienceTim Menzies, directions in Data Science
Tim Menzies, directions in Data Science
 
Mncs 16-10-1주-변승규-introduction to the machine learning #2
Mncs 16-10-1주-변승규-introduction to the machine learning #2Mncs 16-10-1주-변승규-introduction to the machine learning #2
Mncs 16-10-1주-변승규-introduction to the machine learning #2
 
Active Image Clustering: Seeking Constraints from Humans to Complement Algori...
Active Image Clustering: Seeking Constraints from Humans to Complement Algori...Active Image Clustering: Seeking Constraints from Humans to Complement Algori...
Active Image Clustering: Seeking Constraints from Humans to Complement Algori...
 
An Heterogeneous Population-Based Genetic Algorithm for Data Clustering
An Heterogeneous Population-Based Genetic Algorithm for Data ClusteringAn Heterogeneous Population-Based Genetic Algorithm for Data Clustering
An Heterogeneous Population-Based Genetic Algorithm for Data Clustering
 
02 Network Data Collection
02 Network Data Collection02 Network Data Collection
02 Network Data Collection
 
02 Network Data Collection (2016)
02 Network Data Collection (2016)02 Network Data Collection (2016)
02 Network Data Collection (2016)
 
Complex Relations Extraction
Complex Relations ExtractionComplex Relations Extraction
Complex Relations Extraction
 

Más de Austin Benson

Hypergraph Cuts with General Splitting Functions (JMM)
Hypergraph Cuts with General Splitting Functions (JMM)Hypergraph Cuts with General Splitting Functions (JMM)
Hypergraph Cuts with General Splitting Functions (JMM)Austin Benson
 
Spectral embeddings and evolving networks
Spectral embeddings and evolving networksSpectral embeddings and evolving networks
Spectral embeddings and evolving networksAustin Benson
 
Hypergraph Cuts with General Splitting Functions
Hypergraph Cuts with General Splitting FunctionsHypergraph Cuts with General Splitting Functions
Hypergraph Cuts with General Splitting FunctionsAustin Benson
 
Hypergraph Cuts with General Splitting Functions
Hypergraph Cuts with General Splitting FunctionsHypergraph Cuts with General Splitting Functions
Hypergraph Cuts with General Splitting FunctionsAustin Benson
 
Semi-supervised learning of edge flows
Semi-supervised learning of edge flowsSemi-supervised learning of edge flows
Semi-supervised learning of edge flowsAustin Benson
 
Random spatial network models for core-periphery structure
Random spatial network models for core-periphery structureRandom spatial network models for core-periphery structure
Random spatial network models for core-periphery structureAustin Benson
 
Random spatial network models for core-periphery structure.
Random spatial network models for core-periphery structure.Random spatial network models for core-periphery structure.
Random spatial network models for core-periphery structure.Austin Benson
 
Simplicial closure & higher-order link prediction
Simplicial closure & higher-order link predictionSimplicial closure & higher-order link prediction
Simplicial closure & higher-order link predictionAustin Benson
 
Higher-order clustering in networks
Higher-order clustering in networksHigher-order clustering in networks
Higher-order clustering in networksAustin Benson
 
New perspectives on measuring network clustering
New perspectives on measuring network clusteringNew perspectives on measuring network clustering
New perspectives on measuring network clusteringAustin Benson
 
Higher-order spectral graph clustering with motifs
Higher-order spectral graph clustering with motifsHigher-order spectral graph clustering with motifs
Higher-order spectral graph clustering with motifsAustin Benson
 
Tensor Eigenvectors and Stochastic Processes
Tensor Eigenvectors and Stochastic ProcessesTensor Eigenvectors and Stochastic Processes
Tensor Eigenvectors and Stochastic ProcessesAustin Benson
 
Spacey random walks CMStatistics 2017
Spacey random walks CMStatistics 2017Spacey random walks CMStatistics 2017
Spacey random walks CMStatistics 2017Austin Benson
 
Spacey random walks CAM Colloquium
Spacey random walks CAM ColloquiumSpacey random walks CAM Colloquium
Spacey random walks CAM ColloquiumAustin Benson
 

Más de Austin Benson (14)

Hypergraph Cuts with General Splitting Functions (JMM)
Hypergraph Cuts with General Splitting Functions (JMM)Hypergraph Cuts with General Splitting Functions (JMM)
Hypergraph Cuts with General Splitting Functions (JMM)
 
Spectral embeddings and evolving networks
Spectral embeddings and evolving networksSpectral embeddings and evolving networks
Spectral embeddings and evolving networks
 
Hypergraph Cuts with General Splitting Functions
Hypergraph Cuts with General Splitting FunctionsHypergraph Cuts with General Splitting Functions
Hypergraph Cuts with General Splitting Functions
 
Hypergraph Cuts with General Splitting Functions
Hypergraph Cuts with General Splitting FunctionsHypergraph Cuts with General Splitting Functions
Hypergraph Cuts with General Splitting Functions
 
Semi-supervised learning of edge flows
Semi-supervised learning of edge flowsSemi-supervised learning of edge flows
Semi-supervised learning of edge flows
 
Random spatial network models for core-periphery structure
Random spatial network models for core-periphery structureRandom spatial network models for core-periphery structure
Random spatial network models for core-periphery structure
 
Random spatial network models for core-periphery structure.
Random spatial network models for core-periphery structure.Random spatial network models for core-periphery structure.
Random spatial network models for core-periphery structure.
 
Simplicial closure & higher-order link prediction
Simplicial closure & higher-order link predictionSimplicial closure & higher-order link prediction
Simplicial closure & higher-order link prediction
 
Higher-order clustering in networks
Higher-order clustering in networksHigher-order clustering in networks
Higher-order clustering in networks
 
New perspectives on measuring network clustering
New perspectives on measuring network clusteringNew perspectives on measuring network clustering
New perspectives on measuring network clustering
 
Higher-order spectral graph clustering with motifs
Higher-order spectral graph clustering with motifsHigher-order spectral graph clustering with motifs
Higher-order spectral graph clustering with motifs
 
Tensor Eigenvectors and Stochastic Processes
Tensor Eigenvectors and Stochastic ProcessesTensor Eigenvectors and Stochastic Processes
Tensor Eigenvectors and Stochastic Processes
 
Spacey random walks CMStatistics 2017
Spacey random walks CMStatistics 2017Spacey random walks CMStatistics 2017
Spacey random walks CMStatistics 2017
 
Spacey random walks CAM Colloquium
Spacey random walks CAM ColloquiumSpacey random walks CAM Colloquium
Spacey random walks CAM Colloquium
 

Último

RadioAdProWritingCinderellabyButleri.pdf
RadioAdProWritingCinderellabyButleri.pdfRadioAdProWritingCinderellabyButleri.pdf
RadioAdProWritingCinderellabyButleri.pdfgstagge
 
Identifying Appropriate Test Statistics Involving Population Mean
Identifying Appropriate Test Statistics Involving Population MeanIdentifying Appropriate Test Statistics Involving Population Mean
Identifying Appropriate Test Statistics Involving Population MeanMYRABACSAFRA2
 
Effects of Smartphone Addiction on the Academic Performances of Grades 9 to 1...
Effects of Smartphone Addiction on the Academic Performances of Grades 9 to 1...Effects of Smartphone Addiction on the Academic Performances of Grades 9 to 1...
Effects of Smartphone Addiction on the Academic Performances of Grades 9 to 1...limedy534
 
ASML's Taxonomy Adventure by Daniel Canter
ASML's Taxonomy Adventure by Daniel CanterASML's Taxonomy Adventure by Daniel Canter
ASML's Taxonomy Adventure by Daniel Cantervoginip
 
毕业文凭制作#回国入职#diploma#degree澳洲中央昆士兰大学毕业证成绩单pdf电子版制作修改#毕业文凭制作#回国入职#diploma#degree
毕业文凭制作#回国入职#diploma#degree澳洲中央昆士兰大学毕业证成绩单pdf电子版制作修改#毕业文凭制作#回国入职#diploma#degree毕业文凭制作#回国入职#diploma#degree澳洲中央昆士兰大学毕业证成绩单pdf电子版制作修改#毕业文凭制作#回国入职#diploma#degree
毕业文凭制作#回国入职#diploma#degree澳洲中央昆士兰大学毕业证成绩单pdf电子版制作修改#毕业文凭制作#回国入职#diploma#degreeyuu sss
 
专业一比一美国俄亥俄大学毕业证成绩单pdf电子版制作修改
专业一比一美国俄亥俄大学毕业证成绩单pdf电子版制作修改专业一比一美国俄亥俄大学毕业证成绩单pdf电子版制作修改
专业一比一美国俄亥俄大学毕业证成绩单pdf电子版制作修改yuu sss
 
Statistics, Data Analysis, and Decision Modeling, 5th edition by James R. Eva...
Statistics, Data Analysis, and Decision Modeling, 5th edition by James R. Eva...Statistics, Data Analysis, and Decision Modeling, 5th edition by James R. Eva...
Statistics, Data Analysis, and Decision Modeling, 5th edition by James R. Eva...ssuserf63bd7
 
Heart Disease Classification Report: A Data Analysis Project
Heart Disease Classification Report: A Data Analysis ProjectHeart Disease Classification Report: A Data Analysis Project
Heart Disease Classification Report: A Data Analysis ProjectBoston Institute of Analytics
 
Call Girls In Dwarka 9654467111 Escorts Service
Call Girls In Dwarka 9654467111 Escorts ServiceCall Girls In Dwarka 9654467111 Escorts Service
Call Girls In Dwarka 9654467111 Escorts ServiceSapana Sha
 
Predictive Analysis for Loan Default Presentation : Data Analysis Project PPT
Predictive Analysis for Loan Default  Presentation : Data Analysis Project PPTPredictive Analysis for Loan Default  Presentation : Data Analysis Project PPT
Predictive Analysis for Loan Default Presentation : Data Analysis Project PPTBoston Institute of Analytics
 
NO1 Certified Black Magic Specialist Expert Amil baba in Lahore Islamabad Raw...
NO1 Certified Black Magic Specialist Expert Amil baba in Lahore Islamabad Raw...NO1 Certified Black Magic Specialist Expert Amil baba in Lahore Islamabad Raw...
NO1 Certified Black Magic Specialist Expert Amil baba in Lahore Islamabad Raw...Amil Baba Dawood bangali
 
From idea to production in a day – Leveraging Azure ML and Streamlit to build...
From idea to production in a day – Leveraging Azure ML and Streamlit to build...From idea to production in a day – Leveraging Azure ML and Streamlit to build...
From idea to production in a day – Leveraging Azure ML and Streamlit to build...Florian Roscheck
 
Semantic Shed - Squashing and Squeezing.pptx
Semantic Shed - Squashing and Squeezing.pptxSemantic Shed - Squashing and Squeezing.pptx
Semantic Shed - Squashing and Squeezing.pptxMike Bennett
 
Consent & Privacy Signals on Google *Pixels* - MeasureCamp Amsterdam 2024
Consent & Privacy Signals on Google *Pixels* - MeasureCamp Amsterdam 2024Consent & Privacy Signals on Google *Pixels* - MeasureCamp Amsterdam 2024
Consent & Privacy Signals on Google *Pixels* - MeasureCamp Amsterdam 2024thyngster
 
Top 5 Best Data Analytics Courses In Queens
Top 5 Best Data Analytics Courses In QueensTop 5 Best Data Analytics Courses In Queens
Top 5 Best Data Analytics Courses In Queensdataanalyticsqueen03
 
Building on a FAIRly Strong Foundation to Connect Academic Research to Transl...
Building on a FAIRly Strong Foundation to Connect Academic Research to Transl...Building on a FAIRly Strong Foundation to Connect Academic Research to Transl...
Building on a FAIRly Strong Foundation to Connect Academic Research to Transl...Jack DiGiovanna
 
Predicting Salary Using Data Science: A Comprehensive Analysis.pdf
Predicting Salary Using Data Science: A Comprehensive Analysis.pdfPredicting Salary Using Data Science: A Comprehensive Analysis.pdf
Predicting Salary Using Data Science: A Comprehensive Analysis.pdfBoston Institute of Analytics
 
Multiple time frame trading analysis -brianshannon.pdf
Multiple time frame trading analysis -brianshannon.pdfMultiple time frame trading analysis -brianshannon.pdf
Multiple time frame trading analysis -brianshannon.pdfchwongval
 
原版1:1定制南十字星大学毕业证(SCU毕业证)#文凭成绩单#真实留信学历认证永久存档
原版1:1定制南十字星大学毕业证(SCU毕业证)#文凭成绩单#真实留信学历认证永久存档原版1:1定制南十字星大学毕业证(SCU毕业证)#文凭成绩单#真实留信学历认证永久存档
原版1:1定制南十字星大学毕业证(SCU毕业证)#文凭成绩单#真实留信学历认证永久存档208367051
 

Último (20)

RadioAdProWritingCinderellabyButleri.pdf
RadioAdProWritingCinderellabyButleri.pdfRadioAdProWritingCinderellabyButleri.pdf
RadioAdProWritingCinderellabyButleri.pdf
 
Identifying Appropriate Test Statistics Involving Population Mean
Identifying Appropriate Test Statistics Involving Population MeanIdentifying Appropriate Test Statistics Involving Population Mean
Identifying Appropriate Test Statistics Involving Population Mean
 
Effects of Smartphone Addiction on the Academic Performances of Grades 9 to 1...
Effects of Smartphone Addiction on the Academic Performances of Grades 9 to 1...Effects of Smartphone Addiction on the Academic Performances of Grades 9 to 1...
Effects of Smartphone Addiction on the Academic Performances of Grades 9 to 1...
 
ASML's Taxonomy Adventure by Daniel Canter
ASML's Taxonomy Adventure by Daniel CanterASML's Taxonomy Adventure by Daniel Canter
ASML's Taxonomy Adventure by Daniel Canter
 
毕业文凭制作#回国入职#diploma#degree澳洲中央昆士兰大学毕业证成绩单pdf电子版制作修改#毕业文凭制作#回国入职#diploma#degree
毕业文凭制作#回国入职#diploma#degree澳洲中央昆士兰大学毕业证成绩单pdf电子版制作修改#毕业文凭制作#回国入职#diploma#degree毕业文凭制作#回国入职#diploma#degree澳洲中央昆士兰大学毕业证成绩单pdf电子版制作修改#毕业文凭制作#回国入职#diploma#degree
毕业文凭制作#回国入职#diploma#degree澳洲中央昆士兰大学毕业证成绩单pdf电子版制作修改#毕业文凭制作#回国入职#diploma#degree
 
专业一比一美国俄亥俄大学毕业证成绩单pdf电子版制作修改
专业一比一美国俄亥俄大学毕业证成绩单pdf电子版制作修改专业一比一美国俄亥俄大学毕业证成绩单pdf电子版制作修改
专业一比一美国俄亥俄大学毕业证成绩单pdf电子版制作修改
 
Statistics, Data Analysis, and Decision Modeling, 5th edition by James R. Eva...
Statistics, Data Analysis, and Decision Modeling, 5th edition by James R. Eva...Statistics, Data Analysis, and Decision Modeling, 5th edition by James R. Eva...
Statistics, Data Analysis, and Decision Modeling, 5th edition by James R. Eva...
 
Heart Disease Classification Report: A Data Analysis Project
Heart Disease Classification Report: A Data Analysis ProjectHeart Disease Classification Report: A Data Analysis Project
Heart Disease Classification Report: A Data Analysis Project
 
Call Girls In Dwarka 9654467111 Escorts Service
Call Girls In Dwarka 9654467111 Escorts ServiceCall Girls In Dwarka 9654467111 Escorts Service
Call Girls In Dwarka 9654467111 Escorts Service
 
Predictive Analysis for Loan Default Presentation : Data Analysis Project PPT
Predictive Analysis for Loan Default  Presentation : Data Analysis Project PPTPredictive Analysis for Loan Default  Presentation : Data Analysis Project PPT
Predictive Analysis for Loan Default Presentation : Data Analysis Project PPT
 
NO1 Certified Black Magic Specialist Expert Amil baba in Lahore Islamabad Raw...
NO1 Certified Black Magic Specialist Expert Amil baba in Lahore Islamabad Raw...NO1 Certified Black Magic Specialist Expert Amil baba in Lahore Islamabad Raw...
NO1 Certified Black Magic Specialist Expert Amil baba in Lahore Islamabad Raw...
 
From idea to production in a day – Leveraging Azure ML and Streamlit to build...
From idea to production in a day – Leveraging Azure ML and Streamlit to build...From idea to production in a day – Leveraging Azure ML and Streamlit to build...
From idea to production in a day – Leveraging Azure ML and Streamlit to build...
 
Semantic Shed - Squashing and Squeezing.pptx
Semantic Shed - Squashing and Squeezing.pptxSemantic Shed - Squashing and Squeezing.pptx
Semantic Shed - Squashing and Squeezing.pptx
 
Consent & Privacy Signals on Google *Pixels* - MeasureCamp Amsterdam 2024
Consent & Privacy Signals on Google *Pixels* - MeasureCamp Amsterdam 2024Consent & Privacy Signals on Google *Pixels* - MeasureCamp Amsterdam 2024
Consent & Privacy Signals on Google *Pixels* - MeasureCamp Amsterdam 2024
 
Top 5 Best Data Analytics Courses In Queens
Top 5 Best Data Analytics Courses In QueensTop 5 Best Data Analytics Courses In Queens
Top 5 Best Data Analytics Courses In Queens
 
Building on a FAIRly Strong Foundation to Connect Academic Research to Transl...
Building on a FAIRly Strong Foundation to Connect Academic Research to Transl...Building on a FAIRly Strong Foundation to Connect Academic Research to Transl...
Building on a FAIRly Strong Foundation to Connect Academic Research to Transl...
 
Predicting Salary Using Data Science: A Comprehensive Analysis.pdf
Predicting Salary Using Data Science: A Comprehensive Analysis.pdfPredicting Salary Using Data Science: A Comprehensive Analysis.pdf
Predicting Salary Using Data Science: A Comprehensive Analysis.pdf
 
Call Girls in Saket 99530🔝 56974 Escort Service
Call Girls in Saket 99530🔝 56974 Escort ServiceCall Girls in Saket 99530🔝 56974 Escort Service
Call Girls in Saket 99530🔝 56974 Escort Service
 
Multiple time frame trading analysis -brianshannon.pdf
Multiple time frame trading analysis -brianshannon.pdfMultiple time frame trading analysis -brianshannon.pdf
Multiple time frame trading analysis -brianshannon.pdf
 
原版1:1定制南十字星大学毕业证(SCU毕业证)#文凭成绩单#真实留信学历认证永久存档
原版1:1定制南十字星大学毕业证(SCU毕业证)#文凭成绩单#真实留信学历认证永久存档原版1:1定制南十字星大学毕业证(SCU毕业证)#文凭成绩单#真实留信学历认证永久存档
原版1:1定制南十字星大学毕业证(SCU毕业证)#文凭成绩单#真实留信学历认证永久存档
 

Set prediction three ways

  • 1. 1 Joint work with Ravi Kumar & Andrew Tomkins (Google) Rediet Abebe & Jon Kleinberg (Cornell) Michael Schaub & Ali Jadbabaie (MIT) Set prediction three ways Austin R. Benson · Cornell SCAN Seminar · September 10, 2018 Slides. bit.ly/arb-SCAN18
  • 2. We usually think about predicting single-item events. 2
  • 3. This talk looks at predicting sets from three perspectives. 3 Set-based data is common, but we don’t have a great understanding of its complexities and the associated human behavior. • Team formation (writing papers, organizational behavior). • Multiple classification codes in hospital visits. • Co-purchasing sets on Amazon. • Sets of annotations on questions on web forums.
  • 4. 4 Set Prediction #1. Individuals repeating interactions. Given a history of an individual’s set-based interactions, which ones repeat? Who will repeat as my coauthors on my next paper? Sequences of Sets. Benson, Kumar, & Tomkins. KDD, 2018.
  • 5. Lots of data looks like sequences of sets. 5 EMAIL Sequence of recipient sets in my email ⟶ one sequence of sets Collection of email senders ⟶ sequences of sets.
  • 6. Lots of data looks like sequences of sets. 6 Q&A FORUM TAGS
  • 7. Our work provides a generative model that captures the important characteristics of sequences of sets. 7 1. email data sequence for each account sets are recipients on emails sent by account 2. Stack Exchange tags sequence for each user sets are tags on questions asked by the user 3. Coauthorship sequence for each academic sets are coauthors on paper 4. Proximity contact sequence for each person sets are people interacting with the person tags-mathoverflow tags-math-sx email-Enron-core email-Eu-core contact-prim-school contact-high-school coauth-Business coauth-Geology
  • 8. Our work provides a generative model that captures the important characteristics of sequences of sets. 8 Applications. 1. Predicting new sets. 2. Understanding basic user behaviors. 3. Generative model ⟶ event likelihood ⟶ anomaly detection. 4. Generative model ⟶ simulation. 5. Amenable to analysis.
  • 9. 9 What are the important characteristics of the data?
  • 10. Most sets are not entirely novel & many are exact repeats. 10 tags-mathoverflow tags-math-sx email-Enron-core email-Eu-core contact-prim-school contact-high-school coauth-Business coauth-Geology
  • 11. Subsets and supersets of prior sets are common. 11 tags-mathoverflow tags-math-sx email-Enron-core email-Eu-core contact-prim-school contact-high-school coauth-Business coauth-Geology
  • 12. There is recency bias in the repeat behavior. 12 Consistent with previous results on sequences of single items. [Benson-Kumar-Tomkins 16; Anderson+ 14]
  • 13. size-2 subset counts size-3 subset counts Dataset data null model data null model email-Enron-core 5.82 4.34 ± 0.043 4.23 2.67 ± 0.038 email-Eu-core 4.46 3.11 ± 0.008 3.23 2.08 ± 0.007 contact-prim-school 2.36 1.87 ± 0.003 1.35 1.09 ± 0.002 contact-high-school 4.49 3.26 ± 0.007 2.09 1.35 ± 0.004 tags-mathoverflow 1.49 1.41 ± 0.002 1.18 1.15 ± 0.002 tags-math-sx 1.49 1.31 ± 0.001 1.21 1.12 ± 0.001 coauth-Business 1.50 1.30 ± 0.001 1.40 1.24 ± 0.001 coauth-Geology 1.29 1.15 ± 0.000 1.15 1.07 ± 0.000 <latexit sha1_base64="PbRgN8ZetYi3/8RQh4MqDOE3dR8=">AAAHBXicdVXJjts2GFbS2E3UbdIceyE6bpAeZGjzjOcWpC3aYwp0kgCWMaBo2haGiyCSzUwFnXPuNX2G3ope+xx9hL5Ff1JepLFjwyD9bT9N/pTzkhVKh+G/9+5/9GAw/PjhI/+TTz/7/IuTx1++UtJUhF4SyWT1JseKskLQS11oRt+UFcU8Z/R1fv2d5V//SitVSPGLvi3pnOOVKJYFwRqgq8eDB5mgb4nkHItFnS2whjDdzKJ5nWl6o4WsOGb1adQ0fk9JRSVFs3PUlOOCBT9YNCCyogd6cyg2R5VECl1WBe/oLYSJDiwcKLKWkh1zrYvV+ojLwh9wcazX6qbj0XilAosGAB8RS9jMJZNvj1l23B1fbhScjlK9pWEDNV5smTuOFYWDW90eGn7cEI3vZzldFQKqw1E3M53P/QyEjIqVXsPZ4RyaQ9GyqeNSNx21YbhqaoZI+wZKy7IyjPpPUcYN0wUYDRd13NSkqVXxGw1ipEwO6YhII7TKyjUWWvIatgg9RR+0JX1bg7LMzwgvFrbcs+rbOg6SpgekwaTxv29/MyTbXw+DMIwhLheUHcWyDPnZJsQftZ05AslkPI1hSMdJikZZyUcoHIdp4qDYDvH47HzPJFNYHtjNyCnSMxiScRTtFeHUQRsvfNsz58iZt707corERkTjaadImDgombghvOgwMdpn2Ja1GXYdF23Rs141t4CLbdaeSduMbjuOnCptxWnUq2ihaNoOkx6zi1E3vYCkGxA5KG6HKO4yzr/t/DZhErYJ4UFC2jJx2mNcxOYqtAnxxeFSwy3kNvS8x9h+y6WGVnW9Aa2x2F2B3Te4Plcnp85gPYeTaDM59Tavl1cn/2ULSQynQhOGlZpFYannNa7gGkCenxm4ephc4xWdwVRgTtW8do/rBn0DyAItZQUfYS8HoF1HjblStzwHpTuAu5wFj3Ezo5fTeV2I0mgqSFtoaRjSEtlnP1oUFSWa3cIEk6qAtSKyxhU8I+Efolcll/IatkbBcwb2Jrq7E4eTV/E4CsfRz/Hp8xebXXrofeV97T3zIu/ce+795L30Lj0yuB78Png/+GP4bvjn8K/h3630/r2N54nXew3/+R80STIk</latexit><latexit sha1_base64="PbRgN8ZetYi3/8RQh4MqDOE3dR8=">AAAHBXicdVXJjts2GFbS2E3UbdIceyE6bpAeZGjzjOcWpC3aYwp0kgCWMaBo2haGiyCSzUwFnXPuNX2G3ope+xx9hL5Ff1JepLFjwyD9bT9N/pTzkhVKh+G/9+5/9GAw/PjhI/+TTz/7/IuTx1++UtJUhF4SyWT1JseKskLQS11oRt+UFcU8Z/R1fv2d5V//SitVSPGLvi3pnOOVKJYFwRqgq8eDB5mgb4nkHItFnS2whjDdzKJ5nWl6o4WsOGb1adQ0fk9JRSVFs3PUlOOCBT9YNCCyogd6cyg2R5VECl1WBe/oLYSJDiwcKLKWkh1zrYvV+ojLwh9wcazX6qbj0XilAosGAB8RS9jMJZNvj1l23B1fbhScjlK9pWEDNV5smTuOFYWDW90eGn7cEI3vZzldFQKqw1E3M53P/QyEjIqVXsPZ4RyaQ9GyqeNSNx21YbhqaoZI+wZKy7IyjPpPUcYN0wUYDRd13NSkqVXxGw1ipEwO6YhII7TKyjUWWvIatgg9RR+0JX1bg7LMzwgvFrbcs+rbOg6SpgekwaTxv29/MyTbXw+DMIwhLheUHcWyDPnZJsQftZ05AslkPI1hSMdJikZZyUcoHIdp4qDYDvH47HzPJFNYHtjNyCnSMxiScRTtFeHUQRsvfNsz58iZt707corERkTjaadImDgombghvOgwMdpn2Ja1GXYdF23Rs141t4CLbdaeSduMbjuOnCptxWnUq2ihaNoOkx6zi1E3vYCkGxA5KG6HKO4yzr/t/DZhErYJ4UFC2jJx2mNcxOYqtAnxxeFSwy3kNvS8x9h+y6WGVnW9Aa2x2F2B3Te4Plcnp85gPYeTaDM59Tavl1cn/2ULSQynQhOGlZpFYannNa7gGkCenxm4ephc4xWdwVRgTtW8do/rBn0DyAItZQUfYS8HoF1HjblStzwHpTuAu5wFj3Ezo5fTeV2I0mgqSFtoaRjSEtlnP1oUFSWa3cIEk6qAtSKyxhU8I+Efolcll/IatkbBcwb2Jrq7E4eTV/E4CsfRz/Hp8xebXXrofeV97T3zIu/ce+795L30Lj0yuB78Png/+GP4bvjn8K/h3630/r2N54nXew3/+R80STIk</latexit><latexit sha1_base64="PbRgN8ZetYi3/8RQh4MqDOE3dR8=">AAAHBXicdVXJjts2GFbS2E3UbdIceyE6bpAeZGjzjOcWpC3aYwp0kgCWMaBo2haGiyCSzUwFnXPuNX2G3ope+xx9hL5Ff1JepLFjwyD9bT9N/pTzkhVKh+G/9+5/9GAw/PjhI/+TTz/7/IuTx1++UtJUhF4SyWT1JseKskLQS11oRt+UFcU8Z/R1fv2d5V//SitVSPGLvi3pnOOVKJYFwRqgq8eDB5mgb4nkHItFnS2whjDdzKJ5nWl6o4WsOGb1adQ0fk9JRSVFs3PUlOOCBT9YNCCyogd6cyg2R5VECl1WBe/oLYSJDiwcKLKWkh1zrYvV+ojLwh9wcazX6qbj0XilAosGAB8RS9jMJZNvj1l23B1fbhScjlK9pWEDNV5smTuOFYWDW90eGn7cEI3vZzldFQKqw1E3M53P/QyEjIqVXsPZ4RyaQ9GyqeNSNx21YbhqaoZI+wZKy7IyjPpPUcYN0wUYDRd13NSkqVXxGw1ipEwO6YhII7TKyjUWWvIatgg9RR+0JX1bg7LMzwgvFrbcs+rbOg6SpgekwaTxv29/MyTbXw+DMIwhLheUHcWyDPnZJsQftZ05AslkPI1hSMdJikZZyUcoHIdp4qDYDvH47HzPJFNYHtjNyCnSMxiScRTtFeHUQRsvfNsz58iZt707corERkTjaadImDgombghvOgwMdpn2Ja1GXYdF23Rs141t4CLbdaeSduMbjuOnCptxWnUq2ihaNoOkx6zi1E3vYCkGxA5KG6HKO4yzr/t/DZhErYJ4UFC2jJx2mNcxOYqtAnxxeFSwy3kNvS8x9h+y6WGVnW9Aa2x2F2B3Te4Plcnp85gPYeTaDM59Tavl1cn/2ULSQynQhOGlZpFYannNa7gGkCenxm4ephc4xWdwVRgTtW8do/rBn0DyAItZQUfYS8HoF1HjblStzwHpTuAu5wFj3Ezo5fTeV2I0mgqSFtoaRjSEtlnP1oUFSWa3cIEk6qAtSKyxhU8I+Efolcll/IatkbBcwb2Jrq7E4eTV/E4CsfRz/Hp8xebXXrofeV97T3zIu/ce+795L30Lj0yuB78Png/+GP4bvjn8K/h3630/r2N54nXew3/+R80STIk</latexit><latexit sha1_base64="PbRgN8ZetYi3/8RQh4MqDOE3dR8=">AAAHBXicdVXJjts2GFbS2E3UbdIceyE6bpAeZGjzjOcWpC3aYwp0kgCWMaBo2haGiyCSzUwFnXPuNX2G3ope+xx9hL5Ff1JepLFjwyD9bT9N/pTzkhVKh+G/9+5/9GAw/PjhI/+TTz/7/IuTx1++UtJUhF4SyWT1JseKskLQS11oRt+UFcU8Z/R1fv2d5V//SitVSPGLvi3pnOOVKJYFwRqgq8eDB5mgb4nkHItFnS2whjDdzKJ5nWl6o4WsOGb1adQ0fk9JRSVFs3PUlOOCBT9YNCCyogd6cyg2R5VECl1WBe/oLYSJDiwcKLKWkh1zrYvV+ojLwh9wcazX6qbj0XilAosGAB8RS9jMJZNvj1l23B1fbhScjlK9pWEDNV5smTuOFYWDW90eGn7cEI3vZzldFQKqw1E3M53P/QyEjIqVXsPZ4RyaQ9GyqeNSNx21YbhqaoZI+wZKy7IyjPpPUcYN0wUYDRd13NSkqVXxGw1ipEwO6YhII7TKyjUWWvIatgg9RR+0JX1bg7LMzwgvFrbcs+rbOg6SpgekwaTxv29/MyTbXw+DMIwhLheUHcWyDPnZJsQftZ05AslkPI1hSMdJikZZyUcoHIdp4qDYDvH47HzPJFNYHtjNyCnSMxiScRTtFeHUQRsvfNsz58iZt707corERkTjaadImDgombghvOgwMdpn2Ja1GXYdF23Rs141t4CLbdaeSduMbjuOnCptxWnUq2ihaNoOkx6zi1E3vYCkGxA5KG6HKO4yzr/t/DZhErYJ4UFC2jJx2mNcxOYqtAnxxeFSwy3kNvS8x9h+y6WGVnW9Aa2x2F2B3Te4Plcnp85gPYeTaDM59Tavl1cn/2ULSQynQhOGlZpFYannNa7gGkCenxm4ephc4xWdwVRgTtW8do/rBn0DyAItZQUfYS8HoF1HjblStzwHpTuAu5wFj3Ezo5fTeV2I0mgqSFtoaRjSEtlnP1oUFSWa3cIEk6qAtSKyxhU8I+Efolcll/IatkbBcwb2Jrq7E4eTV/E4CsfRz/Hp8xebXXrofeV97T3zIu/ce+795L30Lj0yuB78Png/+GP4bvjn8K/h3630/r2N54nXew3/+R80STIk</latexit> There is correlation in what gets repeated. 13 • For each sequence in each dataset, we count the number of times each size-2 and size-3 subset appears. • We then count the same statistics under a null model where elements are randomly places into sets.
  • 14. 14 How do we model the next set in a sequence given the history?
  • 15. Our Correlated Repeat Unions (CRU) model captures repeat behavior,recency bias,and correlations. 15 Setup. Observe sequence of sets S1, …, Sk. Given number r of repeated elements in Sk+1. Model selects r elements from . CRU model. Start with , given r. 1. Sample set Sk-j from j steps back with recency weight wj. 2. Sample T by keeping each item x in Sk-j with correlation probability p. 3. . 4. Repeat steps 1—3 until . (if T makes N too large, randomly drop elements from T) [k j=1Sj<latexit sha1_base64="JMq9QvYWP/n1zUVVfzVZ7XzazRU=">AAAHPnicfVVdb9s2FFW7zeu0r3R53Au71MBQ2I6VIksyIICBFcUKtFg2O22ByM0o6spiTVIaSTV2Cf2WvW7/Yn9jf2Bvw173uEvbWSwnGwFbFHnPObyXR2RSCm5sv//7rdvvvPte6/07H4QffvTxJ59u3f3suSkqzeCUFaLQLxNqQHAFp5ZbAS9LDVQmAl4k02/8/Is3oA0v1MjOSxhLOlE844xaHDrf2r4fs6o8d6+Po/qVm9bD89f3z7d2+r3+opHrnWjV2QlW7eT8bms7TgtWSVCWCWrMWdQv7dhRbTkTUIdxZaCkbEoncIZdRSWYsVusviZtHElJVmj8KUsWo+E6BHk0nTdYnKVJJaieNUeTopjijKnDsKlps8Ox46qsLCi2lMwqQWxBfFFIyjUwK+akqWv59G1HcQaZpqxDpZHU5p2S+3V27PRtd6JpmXcknQIDIa6GlqvycMETTfXcp1BcmE6CzBNdVCo1nZJaC1oZxFvNZx2T0xJMJ+O2w6hg/j31mFIUVlI9Nf/F2pNgKU4uKifAulGVWfgB0tppSO8d9u8lAnXXI2wOEw2gard4+JiLnFvYiElEBbXz/2sRYZvk1pbm691dC7OescgNM5ZTNYEeK+TuTxUY7y6zG321f7R3tGtAcjRhgp6T3Qtu865PostVN0Grgl7EPTzYWT7C2BeUopV9fcJ4IoqEihhfYw8bgDKVhkFaCDTAAI3MihSOYw2Czi6xBS6+aaKzUTR2fuO8ARq7fDIaUuWLq0HBBSYgqUpdnFHJxTyFjFbC1i422WW/aRKTeVfUYXtdzOAOQnrc7x11mOQoirYQaHkUsDOTeYpmksgdKzvzVIMl2JkHZ/it7Y/rzaQeAX5kGoZzmRTiMabkliymdt89e1o75SUkr52sHcflxkOwNwXjQLoJSVaQlYYHDKsEt9NWfktvFthUGD5+5ktyKTCKGuVzyax2RlyJ+OAl2j3BSF8DKsqc1ldL/fHJRtXTiQDO8u6y9jfN4EYbPF6a54P0NOu7LId8IlEpXrrK07k4kS5ejtfXbCGf4uGa3oRYTdRNiQfxLKH6DM0X50kxc/Eb/98O41xXAkgOfJJbPF0P9ktL2mSUA6HMVlQQhIXxFE+Ifm9vH2Ztctna5BFeDFQxIAnYC/x+fSxBMWIWZQyXUu2QkAVBt9+LQLYv0cO80FgdriakUARNRQRklhiegkes5bUT1f+S4AXw8H9J9CKTBUvtq4DXSLR5aVzvPN/rRbi87/d2BoerC+VO8HnwRfBlEAUHwSD4NjgJTgMWzIOfg1+CX1u/tf5o/dn6axl6+9YKsx00WuvvfwAkCY0R</latexit><latexit sha1_base64="JMq9QvYWP/n1zUVVfzVZ7XzazRU=">AAAHPnicfVVdb9s2FFW7zeu0r3R53Au71MBQ2I6VIksyIICBFcUKtFg2O22ByM0o6spiTVIaSTV2Cf2WvW7/Yn9jf2Bvw173uEvbWSwnGwFbFHnPObyXR2RSCm5sv//7rdvvvPte6/07H4QffvTxJ59u3f3suSkqzeCUFaLQLxNqQHAFp5ZbAS9LDVQmAl4k02/8/Is3oA0v1MjOSxhLOlE844xaHDrf2r4fs6o8d6+Po/qVm9bD89f3z7d2+r3+opHrnWjV2QlW7eT8bms7TgtWSVCWCWrMWdQv7dhRbTkTUIdxZaCkbEoncIZdRSWYsVusviZtHElJVmj8KUsWo+E6BHk0nTdYnKVJJaieNUeTopjijKnDsKlps8Ox46qsLCi2lMwqQWxBfFFIyjUwK+akqWv59G1HcQaZpqxDpZHU5p2S+3V27PRtd6JpmXcknQIDIa6GlqvycMETTfXcp1BcmE6CzBNdVCo1nZJaC1oZxFvNZx2T0xJMJ+O2w6hg/j31mFIUVlI9Nf/F2pNgKU4uKifAulGVWfgB0tppSO8d9u8lAnXXI2wOEw2gard4+JiLnFvYiElEBbXz/2sRYZvk1pbm691dC7OescgNM5ZTNYEeK+TuTxUY7y6zG321f7R3tGtAcjRhgp6T3Qtu865PostVN0Grgl7EPTzYWT7C2BeUopV9fcJ4IoqEihhfYw8bgDKVhkFaCDTAAI3MihSOYw2Czi6xBS6+aaKzUTR2fuO8ARq7fDIaUuWLq0HBBSYgqUpdnFHJxTyFjFbC1i422WW/aRKTeVfUYXtdzOAOQnrc7x11mOQoirYQaHkUsDOTeYpmksgdKzvzVIMl2JkHZ/it7Y/rzaQeAX5kGoZzmRTiMabkliymdt89e1o75SUkr52sHcflxkOwNwXjQLoJSVaQlYYHDKsEt9NWfktvFthUGD5+5ktyKTCKGuVzyax2RlyJ+OAl2j3BSF8DKsqc1ldL/fHJRtXTiQDO8u6y9jfN4EYbPF6a54P0NOu7LId8IlEpXrrK07k4kS5ejtfXbCGf4uGa3oRYTdRNiQfxLKH6DM0X50kxc/Eb/98O41xXAkgOfJJbPF0P9ktL2mSUA6HMVlQQhIXxFE+Ifm9vH2Ztctna5BFeDFQxIAnYC/x+fSxBMWIWZQyXUu2QkAVBt9+LQLYv0cO80FgdriakUARNRQRklhiegkes5bUT1f+S4AXw8H9J9CKTBUvtq4DXSLR5aVzvPN/rRbi87/d2BoerC+VO8HnwRfBlEAUHwSD4NjgJTgMWzIOfg1+CX1u/tf5o/dn6axl6+9YKsx00WuvvfwAkCY0R</latexit><latexit sha1_base64="JMq9QvYWP/n1zUVVfzVZ7XzazRU=">AAAHPnicfVVdb9s2FFW7zeu0r3R53Au71MBQ2I6VIksyIICBFcUKtFg2O22ByM0o6spiTVIaSTV2Cf2WvW7/Yn9jf2Bvw173uEvbWSwnGwFbFHnPObyXR2RSCm5sv//7rdvvvPte6/07H4QffvTxJ59u3f3suSkqzeCUFaLQLxNqQHAFp5ZbAS9LDVQmAl4k02/8/Is3oA0v1MjOSxhLOlE844xaHDrf2r4fs6o8d6+Po/qVm9bD89f3z7d2+r3+opHrnWjV2QlW7eT8bms7TgtWSVCWCWrMWdQv7dhRbTkTUIdxZaCkbEoncIZdRSWYsVusviZtHElJVmj8KUsWo+E6BHk0nTdYnKVJJaieNUeTopjijKnDsKlps8Ox46qsLCi2lMwqQWxBfFFIyjUwK+akqWv59G1HcQaZpqxDpZHU5p2S+3V27PRtd6JpmXcknQIDIa6GlqvycMETTfXcp1BcmE6CzBNdVCo1nZJaC1oZxFvNZx2T0xJMJ+O2w6hg/j31mFIUVlI9Nf/F2pNgKU4uKifAulGVWfgB0tppSO8d9u8lAnXXI2wOEw2gard4+JiLnFvYiElEBbXz/2sRYZvk1pbm691dC7OescgNM5ZTNYEeK+TuTxUY7y6zG321f7R3tGtAcjRhgp6T3Qtu865PostVN0Grgl7EPTzYWT7C2BeUopV9fcJ4IoqEihhfYw8bgDKVhkFaCDTAAI3MihSOYw2Czi6xBS6+aaKzUTR2fuO8ARq7fDIaUuWLq0HBBSYgqUpdnFHJxTyFjFbC1i422WW/aRKTeVfUYXtdzOAOQnrc7x11mOQoirYQaHkUsDOTeYpmksgdKzvzVIMl2JkHZ/it7Y/rzaQeAX5kGoZzmRTiMabkliymdt89e1o75SUkr52sHcflxkOwNwXjQLoJSVaQlYYHDKsEt9NWfktvFthUGD5+5ktyKTCKGuVzyax2RlyJ+OAl2j3BSF8DKsqc1ldL/fHJRtXTiQDO8u6y9jfN4EYbPF6a54P0NOu7LId8IlEpXrrK07k4kS5ejtfXbCGf4uGa3oRYTdRNiQfxLKH6DM0X50kxc/Eb/98O41xXAkgOfJJbPF0P9ktL2mSUA6HMVlQQhIXxFE+Ifm9vH2Ztctna5BFeDFQxIAnYC/x+fSxBMWIWZQyXUu2QkAVBt9+LQLYv0cO80FgdriakUARNRQRklhiegkes5bUT1f+S4AXw8H9J9CKTBUvtq4DXSLR5aVzvPN/rRbi87/d2BoerC+VO8HnwRfBlEAUHwSD4NjgJTgMWzIOfg1+CX1u/tf5o/dn6axl6+9YKsx00WuvvfwAkCY0R</latexit><latexit sha1_base64="JMq9QvYWP/n1zUVVfzVZ7XzazRU=">AAAHPnicfVVdb9s2FFW7zeu0r3R53Au71MBQ2I6VIksyIICBFcUKtFg2O22ByM0o6spiTVIaSTV2Cf2WvW7/Yn9jf2Bvw173uEvbWSwnGwFbFHnPObyXR2RSCm5sv//7rdvvvPte6/07H4QffvTxJ59u3f3suSkqzeCUFaLQLxNqQHAFp5ZbAS9LDVQmAl4k02/8/Is3oA0v1MjOSxhLOlE844xaHDrf2r4fs6o8d6+Po/qVm9bD89f3z7d2+r3+opHrnWjV2QlW7eT8bms7TgtWSVCWCWrMWdQv7dhRbTkTUIdxZaCkbEoncIZdRSWYsVusviZtHElJVmj8KUsWo+E6BHk0nTdYnKVJJaieNUeTopjijKnDsKlps8Ox46qsLCi2lMwqQWxBfFFIyjUwK+akqWv59G1HcQaZpqxDpZHU5p2S+3V27PRtd6JpmXcknQIDIa6GlqvycMETTfXcp1BcmE6CzBNdVCo1nZJaC1oZxFvNZx2T0xJMJ+O2w6hg/j31mFIUVlI9Nf/F2pNgKU4uKifAulGVWfgB0tppSO8d9u8lAnXXI2wOEw2gard4+JiLnFvYiElEBbXz/2sRYZvk1pbm691dC7OescgNM5ZTNYEeK+TuTxUY7y6zG321f7R3tGtAcjRhgp6T3Qtu865PostVN0Grgl7EPTzYWT7C2BeUopV9fcJ4IoqEihhfYw8bgDKVhkFaCDTAAI3MihSOYw2Czi6xBS6+aaKzUTR2fuO8ARq7fDIaUuWLq0HBBSYgqUpdnFHJxTyFjFbC1i422WW/aRKTeVfUYXtdzOAOQnrc7x11mOQoirYQaHkUsDOTeYpmksgdKzvzVIMl2JkHZ/it7Y/rzaQeAX5kGoZzmRTiMabkliymdt89e1o75SUkr52sHcflxkOwNwXjQLoJSVaQlYYHDKsEt9NWfktvFthUGD5+5ktyKTCKGuVzyax2RlyJ+OAl2j3BSF8DKsqc1ldL/fHJRtXTiQDO8u6y9jfN4EYbPF6a54P0NOu7LId8IlEpXrrK07k4kS5ejtfXbCGf4uGa3oRYTdRNiQfxLKH6DM0X50kxc/Eb/98O41xXAkgOfJJbPF0P9ktL2mSUA6HMVlQQhIXxFE+Ifm9vH2Ztctna5BFeDFQxIAnYC/x+fSxBMWIWZQyXUu2QkAVBt9+LQLYv0cO80FgdriakUARNRQRklhiegkes5bUT1f+S4AXw8H9J9CKTBUvtq4DXSLR5aVzvPN/rRbi87/d2BoerC+VO8HnwRfBlEAUHwSD4NjgJTgMWzIOfg1+CX1u/tf5o/dn6axl6+9YKsx00WuvvfwAkCY0R</latexit> N = ;<latexit sha1_base64="cCQugb7Mu1I9KkNyw7/c0OFwvuY=">AAAHOnicfVVdb9s2FFW7zeu0j6br417YpQaGwnbsFFmaAQGMrShWoN2y2WkLWEZKSVcSYZLSSKqRS+iX7HX7F/sje93bsNf9gF1azmI52QjYosh7zuG9PCLDgjNthsPfb9x85933Ou/f+sD/8KOPP7m9c+fTFzovVQSnUc5z9SqkGjiTcGqY4fCqUEBFyOFluPjGzb98A0qzXE7NsoC5oKlkCYuowaGzndv3vyPHJABRmKUGc/9sZ3c4GK4audoZrTu73rqdnN3p3A3iPCoFSBNxqvVsNCzM3FJlWMSh9oNSQ0GjBU1hhl1JBei5Xa28Jl0ciUmSK/xJQ1aj/iYEeRRdtlisoWHJqarao2GeL3BG177f1jTJo7llsigNyKiRTEpOTE5cQUjMFESGL0lb17DF255kESSKRj0qtKAm6xXMrbNnFm/7qaJF1hN0ARFwfjnUrMrBOQsVVUuXQn6ueyEypyovZax7BTUGlNSIN4pVPZ3RAnQvYaYXUR6599hhCp4bQdVC/xfrQIChOLmqHAdjp2Vi4EeIa6sgvvdoeC/kqLsZYTJIFYCs7erhYs4zZmArJuQl1Nb9b0T4XZIZU+iv9vYMVANtkBuqKKMyhUGUi72fStDOWXpv9OXB0f7RngbB0IAh+k30z5nJ+i6JPpP9EG0KahX38HC3efiBKyhFG7v6+EHK85DyAF8DBxuD1KWCcZxzNMAYTRzlMRwHCjitLrA5Lr5totl0NLdu45wBWrt8Mp1Q6YqrQMI5JiCojG2QUMH4MoaEltzUNtDJRb9tEp04V9R+d1NM4w5CfDwcHPUiwVAUbcHR8ihgKp04inaSyB1IUzmqcQO2+sEMv7WDeb2d1GPAj0zBZCnCnD/BlGzDomv7/fNntZVOQrDaitoyXG4wAXNdMA7E25BwDVlrOMCkDHE7Tem29HqBbYXJk+euJBcC01GrfDasaqv5pYgLbtD2KUa6GlBeZLS+XOrrp1tVj1MOLMr6Te2vm8GN1ni8tM8H4Wg2d1lMWCpQKWhc5ehsEAobNOP1FVuIZ3iwxtch1hN1W+JBUIVUzdB8QRbmlQ3euP+uH2Sq5EAyYGlm8HQ9PCgM6ZJpBoRGpqScIMwPFnhCDAf7B1B1yUXrksd4KVAZAQnBnOP362IJihG9KqPfSHV9QlYE/eFgBKJ7gZ5kucLqMJmSXBI0FeGQGKJZDA6xkdfuqP6XBC+Ah/9LolaZrFhqVwW8Rkbbl8bVzov9wQiX98P+7vjr9YVyy/vM+9z7wht5h97Y+9Y78U69yCu9n71fvF87v3X+6PzZ+asJvXljjbnrtVrn738AcTqK5Q==</latexit><latexit sha1_base64="cCQugb7Mu1I9KkNyw7/c0OFwvuY=">AAAHOnicfVVdb9s2FFW7zeu0j6br417YpQaGwnbsFFmaAQGMrShWoN2y2WkLWEZKSVcSYZLSSKqRS+iX7HX7F/sje93bsNf9gF1azmI52QjYosh7zuG9PCLDgjNthsPfb9x85933Ou/f+sD/8KOPP7m9c+fTFzovVQSnUc5z9SqkGjiTcGqY4fCqUEBFyOFluPjGzb98A0qzXE7NsoC5oKlkCYuowaGzndv3vyPHJABRmKUGc/9sZ3c4GK4audoZrTu73rqdnN3p3A3iPCoFSBNxqvVsNCzM3FJlWMSh9oNSQ0GjBU1hhl1JBei5Xa28Jl0ciUmSK/xJQ1aj/iYEeRRdtlisoWHJqarao2GeL3BG177f1jTJo7llsigNyKiRTEpOTE5cQUjMFESGL0lb17DF255kESSKRj0qtKAm6xXMrbNnFm/7qaJF1hN0ARFwfjnUrMrBOQsVVUuXQn6ueyEypyovZax7BTUGlNSIN4pVPZ3RAnQvYaYXUR6599hhCp4bQdVC/xfrQIChOLmqHAdjp2Vi4EeIa6sgvvdoeC/kqLsZYTJIFYCs7erhYs4zZmArJuQl1Nb9b0T4XZIZU+iv9vYMVANtkBuqKKMyhUGUi72fStDOWXpv9OXB0f7RngbB0IAh+k30z5nJ+i6JPpP9EG0KahX38HC3efiBKyhFG7v6+EHK85DyAF8DBxuD1KWCcZxzNMAYTRzlMRwHCjitLrA5Lr5totl0NLdu45wBWrt8Mp1Q6YqrQMI5JiCojG2QUMH4MoaEltzUNtDJRb9tEp04V9R+d1NM4w5CfDwcHPUiwVAUbcHR8ihgKp04inaSyB1IUzmqcQO2+sEMv7WDeb2d1GPAj0zBZCnCnD/BlGzDomv7/fNntZVOQrDaitoyXG4wAXNdMA7E25BwDVlrOMCkDHE7Tem29HqBbYXJk+euJBcC01GrfDasaqv5pYgLbtD2KUa6GlBeZLS+XOrrp1tVj1MOLMr6Te2vm8GN1ni8tM8H4Wg2d1lMWCpQKWhc5ehsEAobNOP1FVuIZ3iwxtch1hN1W+JBUIVUzdB8QRbmlQ3euP+uH2Sq5EAyYGlm8HQ9PCgM6ZJpBoRGpqScIMwPFnhCDAf7B1B1yUXrksd4KVAZAQnBnOP362IJihG9KqPfSHV9QlYE/eFgBKJ7gZ5kucLqMJmSXBI0FeGQGKJZDA6xkdfuqP6XBC+Ah/9LolaZrFhqVwW8Rkbbl8bVzov9wQiX98P+7vjr9YVyy/vM+9z7wht5h97Y+9Y78U69yCu9n71fvF87v3X+6PzZ+asJvXljjbnrtVrn738AcTqK5Q==</latexit><latexit sha1_base64="cCQugb7Mu1I9KkNyw7/c0OFwvuY=">AAAHOnicfVVdb9s2FFW7zeu0j6br417YpQaGwnbsFFmaAQGMrShWoN2y2WkLWEZKSVcSYZLSSKqRS+iX7HX7F/sje93bsNf9gF1azmI52QjYosh7zuG9PCLDgjNthsPfb9x85933Ou/f+sD/8KOPP7m9c+fTFzovVQSnUc5z9SqkGjiTcGqY4fCqUEBFyOFluPjGzb98A0qzXE7NsoC5oKlkCYuowaGzndv3vyPHJABRmKUGc/9sZ3c4GK4audoZrTu73rqdnN3p3A3iPCoFSBNxqvVsNCzM3FJlWMSh9oNSQ0GjBU1hhl1JBei5Xa28Jl0ciUmSK/xJQ1aj/iYEeRRdtlisoWHJqarao2GeL3BG177f1jTJo7llsigNyKiRTEpOTE5cQUjMFESGL0lb17DF255kESSKRj0qtKAm6xXMrbNnFm/7qaJF1hN0ARFwfjnUrMrBOQsVVUuXQn6ueyEypyovZax7BTUGlNSIN4pVPZ3RAnQvYaYXUR6599hhCp4bQdVC/xfrQIChOLmqHAdjp2Vi4EeIa6sgvvdoeC/kqLsZYTJIFYCs7erhYs4zZmArJuQl1Nb9b0T4XZIZU+iv9vYMVANtkBuqKKMyhUGUi72fStDOWXpv9OXB0f7RngbB0IAh+k30z5nJ+i6JPpP9EG0KahX38HC3efiBKyhFG7v6+EHK85DyAF8DBxuD1KWCcZxzNMAYTRzlMRwHCjitLrA5Lr5totl0NLdu45wBWrt8Mp1Q6YqrQMI5JiCojG2QUMH4MoaEltzUNtDJRb9tEp04V9R+d1NM4w5CfDwcHPUiwVAUbcHR8ihgKp04inaSyB1IUzmqcQO2+sEMv7WDeb2d1GPAj0zBZCnCnD/BlGzDomv7/fNntZVOQrDaitoyXG4wAXNdMA7E25BwDVlrOMCkDHE7Tem29HqBbYXJk+euJBcC01GrfDasaqv5pYgLbtD2KUa6GlBeZLS+XOrrp1tVj1MOLMr6Te2vm8GN1ni8tM8H4Wg2d1lMWCpQKWhc5ehsEAobNOP1FVuIZ3iwxtch1hN1W+JBUIVUzdB8QRbmlQ3euP+uH2Sq5EAyYGlm8HQ9PCgM6ZJpBoRGpqScIMwPFnhCDAf7B1B1yUXrksd4KVAZAQnBnOP362IJihG9KqPfSHV9QlYE/eFgBKJ7gZ5kucLqMJmSXBI0FeGQGKJZDA6xkdfuqP6XBC+Ah/9LolaZrFhqVwW8Rkbbl8bVzov9wQiX98P+7vjr9YVyy/vM+9z7wht5h97Y+9Y78U69yCu9n71fvF87v3X+6PzZ+asJvXljjbnrtVrn738AcTqK5Q==</latexit><latexit sha1_base64="cCQugb7Mu1I9KkNyw7/c0OFwvuY=">AAAHOnicfVVdb9s2FFW7zeu0j6br417YpQaGwnbsFFmaAQGMrShWoN2y2WkLWEZKSVcSYZLSSKqRS+iX7HX7F/sje93bsNf9gF1azmI52QjYosh7zuG9PCLDgjNthsPfb9x85933Ou/f+sD/8KOPP7m9c+fTFzovVQSnUc5z9SqkGjiTcGqY4fCqUEBFyOFluPjGzb98A0qzXE7NsoC5oKlkCYuowaGzndv3vyPHJABRmKUGc/9sZ3c4GK4audoZrTu73rqdnN3p3A3iPCoFSBNxqvVsNCzM3FJlWMSh9oNSQ0GjBU1hhl1JBei5Xa28Jl0ciUmSK/xJQ1aj/iYEeRRdtlisoWHJqarao2GeL3BG177f1jTJo7llsigNyKiRTEpOTE5cQUjMFESGL0lb17DF255kESSKRj0qtKAm6xXMrbNnFm/7qaJF1hN0ARFwfjnUrMrBOQsVVUuXQn6ueyEypyovZax7BTUGlNSIN4pVPZ3RAnQvYaYXUR6599hhCp4bQdVC/xfrQIChOLmqHAdjp2Vi4EeIa6sgvvdoeC/kqLsZYTJIFYCs7erhYs4zZmArJuQl1Nb9b0T4XZIZU+iv9vYMVANtkBuqKKMyhUGUi72fStDOWXpv9OXB0f7RngbB0IAh+k30z5nJ+i6JPpP9EG0KahX38HC3efiBKyhFG7v6+EHK85DyAF8DBxuD1KWCcZxzNMAYTRzlMRwHCjitLrA5Lr5totl0NLdu45wBWrt8Mp1Q6YqrQMI5JiCojG2QUMH4MoaEltzUNtDJRb9tEp04V9R+d1NM4w5CfDwcHPUiwVAUbcHR8ihgKp04inaSyB1IUzmqcQO2+sEMv7WDeb2d1GPAj0zBZCnCnD/BlGzDomv7/fNntZVOQrDaitoyXG4wAXNdMA7E25BwDVlrOMCkDHE7Tem29HqBbYXJk+euJBcC01GrfDasaqv5pYgLbtD2KUa6GlBeZLS+XOrrp1tVj1MOLMr6Te2vm8GN1ni8tM8H4Wg2d1lMWCpQKWhc5ehsEAobNOP1FVuIZ3iwxtch1hN1W+JBUIVUzdB8QRbmlQ3euP+uH2Sq5EAyYGlm8HQ9PCgM6ZJpBoRGpqScIMwPFnhCDAf7B1B1yUXrksd4KVAZAQnBnOP362IJihG9KqPfSHV9QlYE/eFgBKJ7gZ5kucLqMJmSXBI0FeGQGKJZDA6xkdfuqP6XBC+Ah/9LolaZrFhqVwW8Rkbbl8bVzov9wQiX98P+7vjr9YVyy/vM+9z7wht5h97Y+9Y78U69yCu9n71fvF87v3X+6PzZ+asJvXljjbnrtVrn738AcTqK5Q==</latexit> N = N [ T<latexit sha1_base64="+8IXgngcg4Tx80sHc3gtOzbENVM=">AAAHN3icfVVdjxs1FJ0WCGX4aukjLy7bSKhKsslWy3aRVoqgqqjUloVk20o7oXg8d2as2J7B9nQnteZ/8Ar/gp/CE2+IV/4B10mWzWQXLCXjse85x/f6jB2Xghs7HP5+7fpbb7/TeffGe+H7H3z40cc3b33y3BSVZnDCClHolzE1ILiCE8utgJelBipjAS/i+dd+/sVr0IYXamoXJcwkzRRPOaMWh364+4wckWckYlVJpndf3dwZDobLRi53RuvOTrBux69udW5HScEqCcoyQY05HQ1LO3NUW84ENGFUGSgpm9MMTrGrqAQzc8tlN6SLIwlJC40/ZclyNNyEII+mixaLszSuBNV1ezQuijnOmCYM25o2fTBzXJWVBcVWkmkliC2IrwZJuAZmxYK0dS2fv+kpziDVlPWoNJLavFdyv86enb/pZ5qWeU/SOTAQ4mJotSoPFzzWVC98CsWZ6cXInOmiUonpldRa0Mog3mpe90xOSzC9lNseo4L598RjSlFYSfXc/BfrQIKlOLmsnADrplVq4XtIGqchufNgeCcWqLsZYXPINIBq3PLhY85ybmErJhYVNM7/b0SEXZJbW5ovd3ct1ANjkRtqllOVwYAVcvenCoy3ldkdfbF/uHe4a0BydF+MZpP9M27zvk+iz1U/Ro+CXsbdP9hZPcLIF5Sih319wigTRUxFhK+Rh41BmUrDOCkEGmCMDmZFAkeRBkHrc2yBi2+b6HQ6mjm/cd4ArV0+nk6o8sXVoOAME5BUJS5KqeRikUBKK2EbF5n0vN82iUm9K5qwuylmcAchORoODntMchRFWwi0PArY2qSeop0kckfK1p5qvAI7c+8Uv7X9WbOd1EPAj0zDZCHjQjzClNyKxTTu26dPGqe8hOSNk43juNxoAvaqYBxItiHxGrLW8IBJFeN22spv6dUC2wqTR099Sc4FpqNW+VxcN86ICxEfvEK7xxjpa0BFmdPmYqk/Pt6qepIJ4Czvr2p/1QxutMHjpX0+SE+zuctywjOJStHKVZ7ORbF00Wq8uWQL+QRP1eQqxHqiaUvci+qY6lM0X5THRe2i1/6/G0a5rgSQHHiWWzxdD/ZLS7pkmgOhzFZUEISF0RxPiOFgbx/qLjlvXfIQbwSqGJAY7Bl+vz6WoBgxyzKGK6luSMiSoD8cjEB2z9GTvNBYHa4yUiiCpiICUksMT8AjNvLaGTX/kuAFcP9/SfQykyVL46uA18ho+9K43Hm+Nxjh8r7b2xl/tb5QbgSfBp8Fnwej4CAYB98Ex8FJwAId/Bz8Evza+a3zR+fPzl+r0OvX1pjbQat1/v4HOH2JWQ==</latexit><latexit sha1_base64="+8IXgngcg4Tx80sHc3gtOzbENVM=">AAAHN3icfVVdjxs1FJ0WCGX4aukjLy7bSKhKsslWy3aRVoqgqqjUloVk20o7oXg8d2as2J7B9nQnteZ/8Ar/gp/CE2+IV/4B10mWzWQXLCXjse85x/f6jB2Xghs7HP5+7fpbb7/TeffGe+H7H3z40cc3b33y3BSVZnDCClHolzE1ILiCE8utgJelBipjAS/i+dd+/sVr0IYXamoXJcwkzRRPOaMWh364+4wckWckYlVJpndf3dwZDobLRi53RuvOTrBux69udW5HScEqCcoyQY05HQ1LO3NUW84ENGFUGSgpm9MMTrGrqAQzc8tlN6SLIwlJC40/ZclyNNyEII+mixaLszSuBNV1ezQuijnOmCYM25o2fTBzXJWVBcVWkmkliC2IrwZJuAZmxYK0dS2fv+kpziDVlPWoNJLavFdyv86enb/pZ5qWeU/SOTAQ4mJotSoPFzzWVC98CsWZ6cXInOmiUonpldRa0Mog3mpe90xOSzC9lNseo4L598RjSlFYSfXc/BfrQIKlOLmsnADrplVq4XtIGqchufNgeCcWqLsZYXPINIBq3PLhY85ybmErJhYVNM7/b0SEXZJbW5ovd3ct1ANjkRtqllOVwYAVcvenCoy3ldkdfbF/uHe4a0BydF+MZpP9M27zvk+iz1U/Ro+CXsbdP9hZPcLIF5Sih319wigTRUxFhK+Rh41BmUrDOCkEGmCMDmZFAkeRBkHrc2yBi2+b6HQ6mjm/cd4ArV0+nk6o8sXVoOAME5BUJS5KqeRikUBKK2EbF5n0vN82iUm9K5qwuylmcAchORoODntMchRFWwi0PArY2qSeop0kckfK1p5qvAI7c+8Uv7X9WbOd1EPAj0zDZCHjQjzClNyKxTTu26dPGqe8hOSNk43juNxoAvaqYBxItiHxGrLW8IBJFeN22spv6dUC2wqTR099Sc4FpqNW+VxcN86ICxEfvEK7xxjpa0BFmdPmYqk/Pt6qepIJ4Czvr2p/1QxutMHjpX0+SE+zuctywjOJStHKVZ7ORbF00Wq8uWQL+QRP1eQqxHqiaUvci+qY6lM0X5THRe2i1/6/G0a5rgSQHHiWWzxdD/ZLS7pkmgOhzFZUEISF0RxPiOFgbx/qLjlvXfIQbwSqGJAY7Bl+vz6WoBgxyzKGK6luSMiSoD8cjEB2z9GTvNBYHa4yUiiCpiICUksMT8AjNvLaGTX/kuAFcP9/SfQykyVL46uA18ho+9K43Hm+Nxjh8r7b2xl/tb5QbgSfBp8Fnwej4CAYB98Ex8FJwAId/Bz8Evza+a3zR+fPzl+r0OvX1pjbQat1/v4HOH2JWQ==</latexit><latexit sha1_base64="+8IXgngcg4Tx80sHc3gtOzbENVM=">AAAHN3icfVVdjxs1FJ0WCGX4aukjLy7bSKhKsslWy3aRVoqgqqjUloVk20o7oXg8d2as2J7B9nQnteZ/8Ar/gp/CE2+IV/4B10mWzWQXLCXjse85x/f6jB2Xghs7HP5+7fpbb7/TeffGe+H7H3z40cc3b33y3BSVZnDCClHolzE1ILiCE8utgJelBipjAS/i+dd+/sVr0IYXamoXJcwkzRRPOaMWh364+4wckWckYlVJpndf3dwZDobLRi53RuvOTrBux69udW5HScEqCcoyQY05HQ1LO3NUW84ENGFUGSgpm9MMTrGrqAQzc8tlN6SLIwlJC40/ZclyNNyEII+mixaLszSuBNV1ezQuijnOmCYM25o2fTBzXJWVBcVWkmkliC2IrwZJuAZmxYK0dS2fv+kpziDVlPWoNJLavFdyv86enb/pZ5qWeU/SOTAQ4mJotSoPFzzWVC98CsWZ6cXInOmiUonpldRa0Mog3mpe90xOSzC9lNseo4L598RjSlFYSfXc/BfrQIKlOLmsnADrplVq4XtIGqchufNgeCcWqLsZYXPINIBq3PLhY85ybmErJhYVNM7/b0SEXZJbW5ovd3ct1ANjkRtqllOVwYAVcvenCoy3ldkdfbF/uHe4a0BydF+MZpP9M27zvk+iz1U/Ro+CXsbdP9hZPcLIF5Sih319wigTRUxFhK+Rh41BmUrDOCkEGmCMDmZFAkeRBkHrc2yBi2+b6HQ6mjm/cd4ArV0+nk6o8sXVoOAME5BUJS5KqeRikUBKK2EbF5n0vN82iUm9K5qwuylmcAchORoODntMchRFWwi0PArY2qSeop0kckfK1p5qvAI7c+8Uv7X9WbOd1EPAj0zDZCHjQjzClNyKxTTu26dPGqe8hOSNk43juNxoAvaqYBxItiHxGrLW8IBJFeN22spv6dUC2wqTR099Sc4FpqNW+VxcN86ICxEfvEK7xxjpa0BFmdPmYqk/Pt6qepIJ4Czvr2p/1QxutMHjpX0+SE+zuctywjOJStHKVZ7ORbF00Wq8uWQL+QRP1eQqxHqiaUvci+qY6lM0X5THRe2i1/6/G0a5rgSQHHiWWzxdD/ZLS7pkmgOhzFZUEISF0RxPiOFgbx/qLjlvXfIQbwSqGJAY7Bl+vz6WoBgxyzKGK6luSMiSoD8cjEB2z9GTvNBYHa4yUiiCpiICUksMT8AjNvLaGTX/kuAFcP9/SfQykyVL46uA18ho+9K43Hm+Nxjh8r7b2xl/tb5QbgSfBp8Fnwej4CAYB98Ex8FJwAId/Bz8Evza+a3zR+fPzl+r0OvX1pjbQat1/v4HOH2JWQ==</latexit><latexit sha1_base64="+8IXgngcg4Tx80sHc3gtOzbENVM=">AAAHN3icfVVdjxs1FJ0WCGX4aukjLy7bSKhKsslWy3aRVoqgqqjUloVk20o7oXg8d2as2J7B9nQnteZ/8Ar/gp/CE2+IV/4B10mWzWQXLCXjse85x/f6jB2Xghs7HP5+7fpbb7/TeffGe+H7H3z40cc3b33y3BSVZnDCClHolzE1ILiCE8utgJelBipjAS/i+dd+/sVr0IYXamoXJcwkzRRPOaMWh364+4wckWckYlVJpndf3dwZDobLRi53RuvOTrBux69udW5HScEqCcoyQY05HQ1LO3NUW84ENGFUGSgpm9MMTrGrqAQzc8tlN6SLIwlJC40/ZclyNNyEII+mixaLszSuBNV1ezQuijnOmCYM25o2fTBzXJWVBcVWkmkliC2IrwZJuAZmxYK0dS2fv+kpziDVlPWoNJLavFdyv86enb/pZ5qWeU/SOTAQ4mJotSoPFzzWVC98CsWZ6cXInOmiUonpldRa0Mog3mpe90xOSzC9lNseo4L598RjSlFYSfXc/BfrQIKlOLmsnADrplVq4XtIGqchufNgeCcWqLsZYXPINIBq3PLhY85ybmErJhYVNM7/b0SEXZJbW5ovd3ct1ANjkRtqllOVwYAVcvenCoy3ldkdfbF/uHe4a0BydF+MZpP9M27zvk+iz1U/Ro+CXsbdP9hZPcLIF5Sih319wigTRUxFhK+Rh41BmUrDOCkEGmCMDmZFAkeRBkHrc2yBi2+b6HQ6mjm/cd4ArV0+nk6o8sXVoOAME5BUJS5KqeRikUBKK2EbF5n0vN82iUm9K5qwuylmcAchORoODntMchRFWwi0PArY2qSeop0kckfK1p5qvAI7c+8Uv7X9WbOd1EPAj0zDZCHjQjzClNyKxTTu26dPGqe8hOSNk43juNxoAvaqYBxItiHxGrLW8IBJFeN22spv6dUC2wqTR099Sc4FpqNW+VxcN86ICxEfvEK7xxjpa0BFmdPmYqk/Pt6qepIJ4Czvr2p/1QxutMHjpX0+SE+zuctywjOJStHKVZ7ORbF00Wq8uWQL+QRP1eQqxHqiaUvci+qY6lM0X5THRe2i1/6/G0a5rgSQHHiWWzxdD/ZLS7pkmgOhzFZUEISF0RxPiOFgbx/qLjlvXfIQbwSqGJAY7Bl+vz6WoBgxyzKGK6luSMiSoD8cjEB2z9GTvNBYHa4yUiiCpiICUksMT8AjNvLaGTX/kuAFcP9/SfQykyVL46uA18ho+9K43Hm+Nxjh8r7b2xl/tb5QbgSfBp8Fnwej4CAYB98Ex8FJwAId/Bz8Evza+a3zR+fPzl+r0OvX1pjbQat1/v4HOH2JWQ==</latexit> |N| = r<latexit sha1_base64="tQEGT1dKiB0d6p4CljzChDc5oR0=">AAAHQHicfVVdb9s2FFW7zeu0j6Yr9rQXdqmBoZAdO0WWZkAAYyuKFWi3bHbaApaRUdKVRJikNJJq5BL6MXvd/sX+xf7B3oa97mmXtrNYTjYCtijynnN4L4/IqORMm8Hg9xs333r7nc67t97z3//gw49u79z5+IUuKhXDaVzwQr2KqAbOJJwaZji8KhVQEXF4Gc2/dvMvX4PSrJATsyhhJmgmWcpianDobOeT+yHHeUO+JaFado6Jun+2szvoD5aNXO0M151db91Ozu507oZJEVcCpIk51Xo6HJRmZqkyLObQ+GGloaTxnGYwxa6kAvTMLtffkC6OJCQtFP6kIctRfxOCPIouWizW0KjiVNXt0ago5jijG99va5r00cwyWVYGZLySTCtOTEFcWUjCFMSGL0hb17D5m0CyGFJF44AKLajJg5K5dQZm/qaXKVrmgaBziIHzy6HVqhycs0hRtXApFOc6iJA5U0UlEx2U1BhQUiPeKFYHOqcl6CBlJogpj9174jAlL4ygaq7/i7UvwFCcXFaOg7GTKjXwAySNVZDcezS4F3HU3YwwOWQKQDZ2+XAx5zkzsBUT8Qoa6/43IvwuyY0p9Zd7ewbqvjbIDXWcU5lBPy7E3k8VaOcvvTf84uBo/2hPg2DorghdJ3rnzOQ9l0SPyV6EZgW1jHt4uLt6+KErKEUzu/r4YcaLiPIQX0MHG4HUlYJRUnA0wAitHBcJHIcKOK0vsAUuvm2i6WQ4s27jnAFau3wyGVPpiqtAwjkmIKhMbJhSwfgigZRW3DQ21OlFv20SnTpXNH53U0zjDkJyPOgfBbFgKIq24Gh5FDC1Th1FO0nkDqWpHdVoBbb6wRS/tYNZs53UY8CPTMF4IaKCP8GU7IpFN/a7588aK52EYI0VjWW43HAM5rpgHEi2IdEastZwgHEV4Xaaym3p9QLbCuMnz11JLgQmw1b5bFQ3VvNLERe8QtunGOlqQHmZ0+ZyqT8+3ap6knFgcd5b1f66GdxojcdL+3wQjmZzl8WYZQKVwpWrHJ0NI2HD1XhzxRbiGR6vyXWI9UTTlngQ1hFVUzRfmEdFbcPX7r/rh7mqOJAcWJYbPF0PD0pDumSSA6GxqSgnCPPDOZ4Qg/7+AdRdctG65DFeDVTGQCIw5/j9uliCYkQvy+ivpLo+IUuC3qA/BNG9QI/zQmF1mMxIIQmainBIDdEsAYfYyGt32PxLghfAw/8lUctMliyNqwJeI8PtS+Nq58V+f4jL+35/d/TV+kK55X3qfeZ97g29Q2/kfeOdeKde7FnvZ+8X79fOb50/On92/lqF3ryxxtz1Wq3z9z/OTY0U</latexit><latexit sha1_base64="tQEGT1dKiB0d6p4CljzChDc5oR0=">AAAHQHicfVVdb9s2FFW7zeu0j6Yr9rQXdqmBoZAdO0WWZkAAYyuKFWi3bHbaApaRUdKVRJikNJJq5BL6MXvd/sX+xf7B3oa97mmXtrNYTjYCtijynnN4L4/IqORMm8Hg9xs333r7nc67t97z3//gw49u79z5+IUuKhXDaVzwQr2KqAbOJJwaZji8KhVQEXF4Gc2/dvMvX4PSrJATsyhhJmgmWcpianDobOeT+yHHeUO+JaFado6Jun+2szvoD5aNXO0M151db91Ozu507oZJEVcCpIk51Xo6HJRmZqkyLObQ+GGloaTxnGYwxa6kAvTMLtffkC6OJCQtFP6kIctRfxOCPIouWizW0KjiVNXt0ago5jijG99va5r00cwyWVYGZLySTCtOTEFcWUjCFMSGL0hb17D5m0CyGFJF44AKLajJg5K5dQZm/qaXKVrmgaBziIHzy6HVqhycs0hRtXApFOc6iJA5U0UlEx2U1BhQUiPeKFYHOqcl6CBlJogpj9174jAlL4ygaq7/i7UvwFCcXFaOg7GTKjXwAySNVZDcezS4F3HU3YwwOWQKQDZ2+XAx5zkzsBUT8Qoa6/43IvwuyY0p9Zd7ewbqvjbIDXWcU5lBPy7E3k8VaOcvvTf84uBo/2hPg2DorghdJ3rnzOQ9l0SPyV6EZgW1jHt4uLt6+KErKEUzu/r4YcaLiPIQX0MHG4HUlYJRUnA0wAitHBcJHIcKOK0vsAUuvm2i6WQ4s27jnAFau3wyGVPpiqtAwjkmIKhMbJhSwfgigZRW3DQ21OlFv20SnTpXNH53U0zjDkJyPOgfBbFgKIq24Gh5FDC1Th1FO0nkDqWpHdVoBbb6wRS/tYNZs53UY8CPTMF4IaKCP8GU7IpFN/a7588aK52EYI0VjWW43HAM5rpgHEi2IdEastZwgHEV4Xaaym3p9QLbCuMnz11JLgQmw1b5bFQ3VvNLERe8QtunGOlqQHmZ0+ZyqT8+3ap6knFgcd5b1f66GdxojcdL+3wQjmZzl8WYZQKVwpWrHJ0NI2HD1XhzxRbiGR6vyXWI9UTTlngQ1hFVUzRfmEdFbcPX7r/rh7mqOJAcWJYbPF0PD0pDumSSA6GxqSgnCPPDOZ4Qg/7+AdRdctG65DFeDVTGQCIw5/j9uliCYkQvy+ivpLo+IUuC3qA/BNG9QI/zQmF1mMxIIQmainBIDdEsAYfYyGt32PxLghfAw/8lUctMliyNqwJeI8PtS+Nq58V+f4jL+35/d/TV+kK55X3qfeZ97g29Q2/kfeOdeKde7FnvZ+8X79fOb50/On92/lqF3ryxxtz1Wq3z9z/OTY0U</latexit><latexit sha1_base64="tQEGT1dKiB0d6p4CljzChDc5oR0=">AAAHQHicfVVdb9s2FFW7zeu0j6Yr9rQXdqmBoZAdO0WWZkAAYyuKFWi3bHbaApaRUdKVRJikNJJq5BL6MXvd/sX+xf7B3oa97mmXtrNYTjYCtijynnN4L4/IqORMm8Hg9xs333r7nc67t97z3//gw49u79z5+IUuKhXDaVzwQr2KqAbOJJwaZji8KhVQEXF4Gc2/dvMvX4PSrJATsyhhJmgmWcpianDobOeT+yHHeUO+JaFado6Jun+2szvoD5aNXO0M151db91Ozu507oZJEVcCpIk51Xo6HJRmZqkyLObQ+GGloaTxnGYwxa6kAvTMLtffkC6OJCQtFP6kIctRfxOCPIouWizW0KjiVNXt0ago5jijG99va5r00cwyWVYGZLySTCtOTEFcWUjCFMSGL0hb17D5m0CyGFJF44AKLajJg5K5dQZm/qaXKVrmgaBziIHzy6HVqhycs0hRtXApFOc6iJA5U0UlEx2U1BhQUiPeKFYHOqcl6CBlJogpj9174jAlL4ygaq7/i7UvwFCcXFaOg7GTKjXwAySNVZDcezS4F3HU3YwwOWQKQDZ2+XAx5zkzsBUT8Qoa6/43IvwuyY0p9Zd7ewbqvjbIDXWcU5lBPy7E3k8VaOcvvTf84uBo/2hPg2DorghdJ3rnzOQ9l0SPyV6EZgW1jHt4uLt6+KErKEUzu/r4YcaLiPIQX0MHG4HUlYJRUnA0wAitHBcJHIcKOK0vsAUuvm2i6WQ4s27jnAFau3wyGVPpiqtAwjkmIKhMbJhSwfgigZRW3DQ21OlFv20SnTpXNH53U0zjDkJyPOgfBbFgKIq24Gh5FDC1Th1FO0nkDqWpHdVoBbb6wRS/tYNZs53UY8CPTMF4IaKCP8GU7IpFN/a7588aK52EYI0VjWW43HAM5rpgHEi2IdEastZwgHEV4Xaaym3p9QLbCuMnz11JLgQmw1b5bFQ3VvNLERe8QtunGOlqQHmZ0+ZyqT8+3ap6knFgcd5b1f66GdxojcdL+3wQjmZzl8WYZQKVwpWrHJ0NI2HD1XhzxRbiGR6vyXWI9UTTlngQ1hFVUzRfmEdFbcPX7r/rh7mqOJAcWJYbPF0PD0pDumSSA6GxqSgnCPPDOZ4Qg/7+AdRdctG65DFeDVTGQCIw5/j9uliCYkQvy+ivpLo+IUuC3qA/BNG9QI/zQmF1mMxIIQmainBIDdEsAYfYyGt32PxLghfAw/8lUctMliyNqwJeI8PtS+Nq58V+f4jL+35/d/TV+kK55X3qfeZ97g29Q2/kfeOdeKde7FnvZ+8X79fOb50/On92/lqF3ryxxtz1Wq3z9z/OTY0U</latexit><latexit sha1_base64="tQEGT1dKiB0d6p4CljzChDc5oR0=">AAAHQHicfVVdb9s2FFW7zeu0j6Yr9rQXdqmBoZAdO0WWZkAAYyuKFWi3bHbaApaRUdKVRJikNJJq5BL6MXvd/sX+xf7B3oa97mmXtrNYTjYCtijynnN4L4/IqORMm8Hg9xs333r7nc67t97z3//gw49u79z5+IUuKhXDaVzwQr2KqAbOJJwaZji8KhVQEXF4Gc2/dvMvX4PSrJATsyhhJmgmWcpianDobOeT+yHHeUO+JaFado6Jun+2szvoD5aNXO0M151db91Ozu507oZJEVcCpIk51Xo6HJRmZqkyLObQ+GGloaTxnGYwxa6kAvTMLtffkC6OJCQtFP6kIctRfxOCPIouWizW0KjiVNXt0ago5jijG99va5r00cwyWVYGZLySTCtOTEFcWUjCFMSGL0hb17D5m0CyGFJF44AKLajJg5K5dQZm/qaXKVrmgaBziIHzy6HVqhycs0hRtXApFOc6iJA5U0UlEx2U1BhQUiPeKFYHOqcl6CBlJogpj9174jAlL4ygaq7/i7UvwFCcXFaOg7GTKjXwAySNVZDcezS4F3HU3YwwOWQKQDZ2+XAx5zkzsBUT8Qoa6/43IvwuyY0p9Zd7ewbqvjbIDXWcU5lBPy7E3k8VaOcvvTf84uBo/2hPg2DorghdJ3rnzOQ9l0SPyV6EZgW1jHt4uLt6+KErKEUzu/r4YcaLiPIQX0MHG4HUlYJRUnA0wAitHBcJHIcKOK0vsAUuvm2i6WQ4s27jnAFau3wyGVPpiqtAwjkmIKhMbJhSwfgigZRW3DQ21OlFv20SnTpXNH53U0zjDkJyPOgfBbFgKIq24Gh5FDC1Th1FO0nkDqWpHdVoBbb6wRS/tYNZs53UY8CPTMF4IaKCP8GU7IpFN/a7588aK52EYI0VjWW43HAM5rpgHEi2IdEastZwgHEV4Xaaym3p9QLbCuMnz11JLgQmw1b5bFQ3VvNLERe8QtunGOlqQHmZ0+ZyqT8+3ap6knFgcd5b1f66GdxojcdL+3wQjmZzl8WYZQKVwpWrHJ0NI2HD1XhzxRbiGR6vyXWI9UTTlngQ1hFVUzRfmEdFbcPX7r/rh7mqOJAcWJYbPF0PD0pDumSSA6GxqSgnCPPDOZ4Qg/7+AdRdctG65DFeDVTGQCIw5/j9uliCYkQvy+ivpLo+IUuC3qA/BNG9QI/zQmF1mMxIIQmainBIDdEsAYfYyGt32PxLghfAw/8lUctMliyNqwJeI8PtS+Nq58V+f4jL+35/d/TV+kK55X3qfeZ97g29Q2/kfeOdeKde7FnvZ+8X79fOb50/On92/lqF3ryxxtz1Wq3z9z/OTY0U</latexit>
  • 16. Our Correlated Repeat Unions (CRU) model captures repeat behavior,recency bias,and correlations. 16 Setup (k = 3). Observe S1, …, S3: {a, b}, {c}, {a, c, d}. Given that S4 has 3 repeated elements. Model selects three elements from {a, b, c, d}. CRU model (p = 0.8; w1 = 0.6,w2 = 0.3 w3 = 0.1). {a, b} w3 = 0.1{c} w2 = 0.3{a, c, d} w1 = 0.6 0. N = ;.<latexit sha1_base64="koOJt4XUWyg16qZo3FixiqcvPXI=">AAAHQXicfVVdb9s2FFXbzeu0j6YtsJe9sEsNDIXt2CmyNBsCGFtRrEC7ZbPTFoiMjJKuJMIkpZFUI5fTn9nr9i/2K/YT9jbsdS+7tJzFcrIRsEWR95zDe3lEhgVn2gyHv1+7fuOttzvv3HzXf+/9Dz68tXX7zgudlyqC4yjnuXoVUg2cSTg2zHB4VSigIuTwMpx/5eZfvgalWS6nZlHATNBUsoRF1ODQ6dZHw0HwBbn/DTkkAYjCLDSY+wP/dGt7OBguG7ncGa06296qHZ3e7twN4jwqBUgTcar1yWhYmJmlyrCIQ+0HpYaCRnOawgl2JRWgZ3aZQE26OBKTJFf4k4YsR/11CPIoumixWEPDklNVtUfDPJ/jjK59v61pkkczy2RRGpBRI5mUnJicuLqQmCmIDF+Qtq5h8zc9ySJIFI16VGhBTdYrmFtnz8zf9FNFi6wn6Bwi4PxiqFmVg3MWKqoWLoX8TPdCZE5VXspY9wpqDCipEW8Uq3o6owXoXsJML6I8cu+xwxQ8N4Kquf4v1oEAQ3FyWTkOxk7LxMD3ENdWQXzv0fBeyFF3PcJkkCoAWdvlw8WcZczARkzIS6it+1+L8LskM6bQn+/sGKgG2iA3VFFGZQqDKBc7P5agncH0zuizvYPdgx0NgqEPQ7Sd6J8xk/VdEn0m+yG6FdQy7uH+dvPwA1dQim529fGDlOch5QG+Bg42BqlLBeM452iAMXo5ymM4DBRwWp1jc1x820Qn09HMuo1zBmjt8tF0QqUrrgIJZ5iAoDK2QUIF44sYElpyU9tAJ+f9tkl04lxR+911MY07CPHhcHDQiwRDUbQFR8ujgKl04ijaSSJ3IE3lqMYN2OoHJ/it7c3qzaQeA35kCiYLEeb8CaZkGxZd22+fP6utdBKC1VbUluFygwmYq4JxIN6EhCvISsMBJmWI22lKt6VXC2wqTJ48dyU5F5iOWuWzYVVbzS9EXHCDtk8x0tWA8iKj9cVSf3i6UfU45cCirN/U/qoZ3GiNx0v7fBCOZn2XxYSlApWCxlWOzgahsEEzXl+yhXiG52t8FWI1UbclHgRVSNUJmi/IwryywWv33/WDTJUcSAYszQyervt7hSFdMs2A0MiUlBOE+cEcT4jhYHcPqi45b13yGO8GKiMgIZgz/H5dLEExopdl9Buprk/IkqA/HIxAdM/RkyxXWB0mU5JLgqYiHBJDNIvBIdby2h7V/5LgBfDwf0nUMpMlS+2qgNfIaPPSuNx5sTsY4fK+290ef7m6UG56H3ufeJ96I2/fG3tfe0fesRd5P3k/e794v3Z+6/zR+bPzVxN6/doKc9drtc7f/wCI04x4</latexit><latexit sha1_base64="koOJt4XUWyg16qZo3FixiqcvPXI=">AAAHQXicfVVdb9s2FFXbzeu0j6YtsJe9sEsNDIXt2CmyNBsCGFtRrEC7ZbPTFoiMjJKuJMIkpZFUI5fTn9nr9i/2K/YT9jbsdS+7tJzFcrIRsEWR95zDe3lEhgVn2gyHv1+7fuOttzvv3HzXf+/9Dz68tXX7zgudlyqC4yjnuXoVUg2cSTg2zHB4VSigIuTwMpx/5eZfvgalWS6nZlHATNBUsoRF1ODQ6dZHw0HwBbn/DTkkAYjCLDSY+wP/dGt7OBguG7ncGa06296qHZ3e7twN4jwqBUgTcar1yWhYmJmlyrCIQ+0HpYaCRnOawgl2JRWgZ3aZQE26OBKTJFf4k4YsR/11CPIoumixWEPDklNVtUfDPJ/jjK59v61pkkczy2RRGpBRI5mUnJicuLqQmCmIDF+Qtq5h8zc9ySJIFI16VGhBTdYrmFtnz8zf9FNFi6wn6Bwi4PxiqFmVg3MWKqoWLoX8TPdCZE5VXspY9wpqDCipEW8Uq3o6owXoXsJML6I8cu+xwxQ8N4Kquf4v1oEAQ3FyWTkOxk7LxMD3ENdWQXzv0fBeyFF3PcJkkCoAWdvlw8WcZczARkzIS6it+1+L8LskM6bQn+/sGKgG2iA3VFFGZQqDKBc7P5agncH0zuizvYPdgx0NgqEPQ7Sd6J8xk/VdEn0m+yG6FdQy7uH+dvPwA1dQim529fGDlOch5QG+Bg42BqlLBeM452iAMXo5ymM4DBRwWp1jc1x820Qn09HMuo1zBmjt8tF0QqUrrgIJZ5iAoDK2QUIF44sYElpyU9tAJ+f9tkl04lxR+911MY07CPHhcHDQiwRDUbQFR8ujgKl04ijaSSJ3IE3lqMYN2OoHJ/it7c3qzaQeA35kCiYLEeb8CaZkGxZd22+fP6utdBKC1VbUluFygwmYq4JxIN6EhCvISsMBJmWI22lKt6VXC2wqTJ48dyU5F5iOWuWzYVVbzS9EXHCDtk8x0tWA8iKj9cVSf3i6UfU45cCirN/U/qoZ3GiNx0v7fBCOZn2XxYSlApWCxlWOzgahsEEzXl+yhXiG52t8FWI1UbclHgRVSNUJmi/IwryywWv33/WDTJUcSAYszQyervt7hSFdMs2A0MiUlBOE+cEcT4jhYHcPqi45b13yGO8GKiMgIZgz/H5dLEExopdl9Buprk/IkqA/HIxAdM/RkyxXWB0mU5JLgqYiHBJDNIvBIdby2h7V/5LgBfDwf0nUMpMlS+2qgNfIaPPSuNx5sTsY4fK+290ef7m6UG56H3ufeJ96I2/fG3tfe0fesRd5P3k/e794v3Z+6/zR+bPzVxN6/doKc9drtc7f/wCI04x4</latexit><latexit sha1_base64="koOJt4XUWyg16qZo3FixiqcvPXI=">AAAHQXicfVVdb9s2FFXbzeu0j6YtsJe9sEsNDIXt2CmyNBsCGFtRrEC7ZbPTFoiMjJKuJMIkpZFUI5fTn9nr9i/2K/YT9jbsdS+7tJzFcrIRsEWR95zDe3lEhgVn2gyHv1+7fuOttzvv3HzXf+/9Dz68tXX7zgudlyqC4yjnuXoVUg2cSTg2zHB4VSigIuTwMpx/5eZfvgalWS6nZlHATNBUsoRF1ODQ6dZHw0HwBbn/DTkkAYjCLDSY+wP/dGt7OBguG7ncGa06296qHZ3e7twN4jwqBUgTcar1yWhYmJmlyrCIQ+0HpYaCRnOawgl2JRWgZ3aZQE26OBKTJFf4k4YsR/11CPIoumixWEPDklNVtUfDPJ/jjK59v61pkkczy2RRGpBRI5mUnJicuLqQmCmIDF+Qtq5h8zc9ySJIFI16VGhBTdYrmFtnz8zf9FNFi6wn6Bwi4PxiqFmVg3MWKqoWLoX8TPdCZE5VXspY9wpqDCipEW8Uq3o6owXoXsJML6I8cu+xwxQ8N4Kquf4v1oEAQ3FyWTkOxk7LxMD3ENdWQXzv0fBeyFF3PcJkkCoAWdvlw8WcZczARkzIS6it+1+L8LskM6bQn+/sGKgG2iA3VFFGZQqDKBc7P5agncH0zuizvYPdgx0NgqEPQ7Sd6J8xk/VdEn0m+yG6FdQy7uH+dvPwA1dQim529fGDlOch5QG+Bg42BqlLBeM452iAMXo5ymM4DBRwWp1jc1x820Qn09HMuo1zBmjt8tF0QqUrrgIJZ5iAoDK2QUIF44sYElpyU9tAJ+f9tkl04lxR+911MY07CPHhcHDQiwRDUbQFR8ujgKl04ijaSSJ3IE3lqMYN2OoHJ/it7c3qzaQeA35kCiYLEeb8CaZkGxZd22+fP6utdBKC1VbUluFygwmYq4JxIN6EhCvISsMBJmWI22lKt6VXC2wqTJ48dyU5F5iOWuWzYVVbzS9EXHCDtk8x0tWA8iKj9cVSf3i6UfU45cCirN/U/qoZ3GiNx0v7fBCOZn2XxYSlApWCxlWOzgahsEEzXl+yhXiG52t8FWI1UbclHgRVSNUJmi/IwryywWv33/WDTJUcSAYszQyervt7hSFdMs2A0MiUlBOE+cEcT4jhYHcPqi45b13yGO8GKiMgIZgz/H5dLEExopdl9Buprk/IkqA/HIxAdM/RkyxXWB0mU5JLgqYiHBJDNIvBIdby2h7V/5LgBfDwf0nUMpMlS+2qgNfIaPPSuNx5sTsY4fK+290ef7m6UG56H3ufeJ96I2/fG3tfe0fesRd5P3k/e794v3Z+6/zR+bPzVxN6/doKc9drtc7f/wCI04x4</latexit><latexit sha1_base64="koOJt4XUWyg16qZo3FixiqcvPXI=">AAAHQXicfVVdb9s2FFXbzeu0j6YtsJe9sEsNDIXt2CmyNBsCGFtRrEC7ZbPTFoiMjJKuJMIkpZFUI5fTn9nr9i/2K/YT9jbsdS+7tJzFcrIRsEWR95zDe3lEhgVn2gyHv1+7fuOttzvv3HzXf+/9Dz68tXX7zgudlyqC4yjnuXoVUg2cSTg2zHB4VSigIuTwMpx/5eZfvgalWS6nZlHATNBUsoRF1ODQ6dZHw0HwBbn/DTkkAYjCLDSY+wP/dGt7OBguG7ncGa06296qHZ3e7twN4jwqBUgTcar1yWhYmJmlyrCIQ+0HpYaCRnOawgl2JRWgZ3aZQE26OBKTJFf4k4YsR/11CPIoumixWEPDklNVtUfDPJ/jjK59v61pkkczy2RRGpBRI5mUnJicuLqQmCmIDF+Qtq5h8zc9ySJIFI16VGhBTdYrmFtnz8zf9FNFi6wn6Bwi4PxiqFmVg3MWKqoWLoX8TPdCZE5VXspY9wpqDCipEW8Uq3o6owXoXsJML6I8cu+xwxQ8N4Kquf4v1oEAQ3FyWTkOxk7LxMD3ENdWQXzv0fBeyFF3PcJkkCoAWdvlw8WcZczARkzIS6it+1+L8LskM6bQn+/sGKgG2iA3VFFGZQqDKBc7P5agncH0zuizvYPdgx0NgqEPQ7Sd6J8xk/VdEn0m+yG6FdQy7uH+dvPwA1dQim529fGDlOch5QG+Bg42BqlLBeM452iAMXo5ymM4DBRwWp1jc1x820Qn09HMuo1zBmjt8tF0QqUrrgIJZ5iAoDK2QUIF44sYElpyU9tAJ+f9tkl04lxR+911MY07CPHhcHDQiwRDUbQFR8ujgKl04ijaSSJ3IE3lqMYN2OoHJ/it7c3qzaQeA35kCiYLEeb8CaZkGxZd22+fP6utdBKC1VbUluFygwmYq4JxIN6EhCvISsMBJmWI22lKt6VXC2wqTJ48dyU5F5iOWuWzYVVbzS9EXHCDtk8x0tWA8iKj9cVSf3i6UfU45cCirN/U/qoZ3GiNx0v7fBCOZn2XxYSlApWCxlWOzgahsEEzXl+yhXiG52t8FWI1UbclHgRVSNUJmi/IwryywWv33/WDTJUcSAYszQyervt7hSFdMs2A0MiUlBOE+cEcT4jhYHcPqi45b13yGO8GKiMgIZgz/H5dLEExopdl9Buprk/IkqA/HIxAdM/RkyxXWB0mU5JLgqYiHBJDNIvBIdby2h7V/5LgBfDwf0nUMpMlS+2qgNfIaPPSuNx5sTsY4fK+290ef7m6UG56H3ufeJ96I2/fG3tfe0fesRd5P3k/e794v3Z+6/zR+bPzVxN6/doKc9drtc7f/wCI04x4</latexit> 1. N = {a, c}.<latexit sha1_base64="/m/3pGpI42L2jFUUwxh1JPMNRRA=">AAAHQHicfVVdjxs1FJ0WCGX42lLxxIvLNhKqJtlkq2W7oJUiqCoqtbCQbFtpJ1o8njsZK7ZnsD3dpNb8GF7hX/Av+Ae8IV554jofbCa7YCkZj33POb7XZ+ykFNzYXu/3GzffePOt1tu33gnffe/9Dz7cuf3Rc1NUmsEpK0ShXybUgOAKTi23Al6WGqhMBLxIpl/7+RevQBteqJGdlzCWdKJ4xhm1OHS+83G/G39J7n1LjknsaERYXN/rhuc7u71ub9HI1U5/1dkNVu3k/HbrTpwWrJKgLBPUmLN+r7RjR7XlTEAdxpWBkrIpncAZdhWVYMZusf6atHEkJVmh8acsWYyGmxDk0XTeYHGWJpWgetYcTYpiijOmDsOmps0ejh1XZWVBsaVkVgliC+LLQlKugVkxJ01dy6evI8UZZJqyiEojqc2jkvt1Rnb6ujPRtMwjSafAQIjLoeWqPFzwRFM99ykUFyZKkHmii0qlJiqptaCVQbzVfBaZnJZgoozbiFHB/HvqMaUorKR6av6LtSvBUpxcVE6AdaMqs/ADpLXTkN592LubCNTdjLA5TDSAqt3i4WMucm5hKyYRFdTO/29EhG2SW1uaL/b2LMy6xiI3zFhO1QS6rJB7P1VgvL/MXv/zg6P9oz0DkqMNE3Sd7Fxwm3d8Eh2uOgmaFfQi7sHh7vIRxr6gFM3s6xPGE1EkVMT4GnvYAJSpNAzSQqABBmhlVqRwHGsQdLbGFrj4ponORv2x8xvnDdDY5ZPRkCpfXA0KLjABSVXq4oxKLuYpZLQStnaxydb9pklM5l1Rh+1NMYM7COlxr3sUMclRFG0h0PIoYGcm8xTNJJE7VnbmqQZLsDP3z/BbOxjX20k9AvzINAznMinEY0zJLVlM7b579rR2yktIXjtZO47LjYdgrwvGgXQbkqwgKw0PGFYJbqet/JZeL7CtMHz8zJdkLTDqN8rnklntjLgU8cFLtHuCkb4GVJQ5rS+X+uOTraqnEwGc5Z1l7a+bwY02eLw0zwfpaTZ3WQ75RKJSvHSVp3NxIl28HK+v2EI+xeM1vQ6xmqibEvfjWUL1GZovzpNi5uJX/r8dxrmuBJAc+CS3eLoeHpSWtMkoB0KZraggCAvjKZ4Qve7+AczaZN3a5BFeDVQxIAnYC/x+fSxBMWIWZQyXUu2QkAVBp9ftg2yv0cO80FgdriakUARNRQRklhiegkds5LXbr/8lwQvgwf+S6EUmC5baVwGvkf72pXG183y/28flfb+/O/hqdaHcCj4JPg0+C/rBYTAIvglOgtOABS74Ofgl+LX1W+uP1p+tv5ahN2+sMHeCRmv9/Q/4S4tY</latexit><latexit sha1_base64="/m/3pGpI42L2jFUUwxh1JPMNRRA=">AAAHQHicfVVdjxs1FJ0WCGX42lLxxIvLNhKqJtlkq2W7oJUiqCoqtbCQbFtpJ1o8njsZK7ZnsD3dpNb8GF7hX/Av+Ae8IV554jofbCa7YCkZj33POb7XZ+ykFNzYXu/3GzffePOt1tu33gnffe/9Dz7cuf3Rc1NUmsEpK0ShXybUgOAKTi23Al6WGqhMBLxIpl/7+RevQBteqJGdlzCWdKJ4xhm1OHS+83G/G39J7n1LjknsaERYXN/rhuc7u71ub9HI1U5/1dkNVu3k/HbrTpwWrJKgLBPUmLN+r7RjR7XlTEAdxpWBkrIpncAZdhWVYMZusf6atHEkJVmh8acsWYyGmxDk0XTeYHGWJpWgetYcTYpiijOmDsOmps0ejh1XZWVBsaVkVgliC+LLQlKugVkxJ01dy6evI8UZZJqyiEojqc2jkvt1Rnb6ujPRtMwjSafAQIjLoeWqPFzwRFM99ykUFyZKkHmii0qlJiqptaCVQbzVfBaZnJZgoozbiFHB/HvqMaUorKR6av6LtSvBUpxcVE6AdaMqs/ADpLXTkN592LubCNTdjLA5TDSAqt3i4WMucm5hKyYRFdTO/29EhG2SW1uaL/b2LMy6xiI3zFhO1QS6rJB7P1VgvL/MXv/zg6P9oz0DkqMNE3Sd7Fxwm3d8Eh2uOgmaFfQi7sHh7vIRxr6gFM3s6xPGE1EkVMT4GnvYAJSpNAzSQqABBmhlVqRwHGsQdLbGFrj4ponORv2x8xvnDdDY5ZPRkCpfXA0KLjABSVXq4oxKLuYpZLQStnaxydb9pklM5l1Rh+1NMYM7COlxr3sUMclRFG0h0PIoYGcm8xTNJJE7VnbmqQZLsDP3z/BbOxjX20k9AvzINAznMinEY0zJLVlM7b579rR2yktIXjtZO47LjYdgrwvGgXQbkqwgKw0PGFYJbqet/JZeL7CtMHz8zJdkLTDqN8rnklntjLgU8cFLtHuCkb4GVJQ5rS+X+uOTraqnEwGc5Z1l7a+bwY02eLw0zwfpaTZ3WQ75RKJSvHSVp3NxIl28HK+v2EI+xeM1vQ6xmqibEvfjWUL1GZovzpNi5uJX/r8dxrmuBJAc+CS3eLoeHpSWtMkoB0KZraggCAvjKZ4Qve7+AczaZN3a5BFeDVQxIAnYC/x+fSxBMWIWZQyXUu2QkAVBp9ftg2yv0cO80FgdriakUARNRQRklhiegkds5LXbr/8lwQvgwf+S6EUmC5baVwGvkf72pXG183y/28flfb+/O/hqdaHcCj4JPg0+C/rBYTAIvglOgtOABS74Ofgl+LX1W+uP1p+tv5ahN2+sMHeCRmv9/Q/4S4tY</latexit><latexit sha1_base64="/m/3pGpI42L2jFUUwxh1JPMNRRA=">AAAHQHicfVVdjxs1FJ0WCGX42lLxxIvLNhKqJtlkq2W7oJUiqCoqtbCQbFtpJ1o8njsZK7ZnsD3dpNb8GF7hX/Av+Ae8IV554jofbCa7YCkZj33POb7XZ+ykFNzYXu/3GzffePOt1tu33gnffe/9Dz7cuf3Rc1NUmsEpK0ShXybUgOAKTi23Al6WGqhMBLxIpl/7+RevQBteqJGdlzCWdKJ4xhm1OHS+83G/G39J7n1LjknsaERYXN/rhuc7u71ub9HI1U5/1dkNVu3k/HbrTpwWrJKgLBPUmLN+r7RjR7XlTEAdxpWBkrIpncAZdhWVYMZusf6atHEkJVmh8acsWYyGmxDk0XTeYHGWJpWgetYcTYpiijOmDsOmps0ejh1XZWVBsaVkVgliC+LLQlKugVkxJ01dy6evI8UZZJqyiEojqc2jkvt1Rnb6ujPRtMwjSafAQIjLoeWqPFzwRFM99ykUFyZKkHmii0qlJiqptaCVQbzVfBaZnJZgoozbiFHB/HvqMaUorKR6av6LtSvBUpxcVE6AdaMqs/ADpLXTkN592LubCNTdjLA5TDSAqt3i4WMucm5hKyYRFdTO/29EhG2SW1uaL/b2LMy6xiI3zFhO1QS6rJB7P1VgvL/MXv/zg6P9oz0DkqMNE3Sd7Fxwm3d8Eh2uOgmaFfQi7sHh7vIRxr6gFM3s6xPGE1EkVMT4GnvYAJSpNAzSQqABBmhlVqRwHGsQdLbGFrj4ponORv2x8xvnDdDY5ZPRkCpfXA0KLjABSVXq4oxKLuYpZLQStnaxydb9pklM5l1Rh+1NMYM7COlxr3sUMclRFG0h0PIoYGcm8xTNJJE7VnbmqQZLsDP3z/BbOxjX20k9AvzINAznMinEY0zJLVlM7b579rR2yktIXjtZO47LjYdgrwvGgXQbkqwgKw0PGFYJbqet/JZeL7CtMHz8zJdkLTDqN8rnklntjLgU8cFLtHuCkb4GVJQ5rS+X+uOTraqnEwGc5Z1l7a+bwY02eLw0zwfpaTZ3WQ75RKJSvHSVp3NxIl28HK+v2EI+xeM1vQ6xmqibEvfjWUL1GZovzpNi5uJX/r8dxrmuBJAc+CS3eLoeHpSWtMkoB0KZraggCAvjKZ4Qve7+AczaZN3a5BFeDVQxIAnYC/x+fSxBMWIWZQyXUu2QkAVBp9ftg2yv0cO80FgdriakUARNRQRklhiegkds5LXbr/8lwQvgwf+S6EUmC5baVwGvkf72pXG183y/28flfb+/O/hqdaHcCj4JPg0+C/rBYTAIvglOgtOABS74Ofgl+LX1W+uP1p+tv5ahN2+sMHeCRmv9/Q/4S4tY</latexit><latexit sha1_base64="/m/3pGpI42L2jFUUwxh1JPMNRRA=">AAAHQHicfVVdjxs1FJ0WCGX42lLxxIvLNhKqJtlkq2W7oJUiqCoqtbCQbFtpJ1o8njsZK7ZnsD3dpNb8GF7hX/Av+Ae8IV554jofbCa7YCkZj33POb7XZ+ykFNzYXu/3GzffePOt1tu33gnffe/9Dz7cuf3Rc1NUmsEpK0ShXybUgOAKTi23Al6WGqhMBLxIpl/7+RevQBteqJGdlzCWdKJ4xhm1OHS+83G/G39J7n1LjknsaERYXN/rhuc7u71ub9HI1U5/1dkNVu3k/HbrTpwWrJKgLBPUmLN+r7RjR7XlTEAdxpWBkrIpncAZdhWVYMZusf6atHEkJVmh8acsWYyGmxDk0XTeYHGWJpWgetYcTYpiijOmDsOmps0ejh1XZWVBsaVkVgliC+LLQlKugVkxJ01dy6evI8UZZJqyiEojqc2jkvt1Rnb6ujPRtMwjSafAQIjLoeWqPFzwRFM99ykUFyZKkHmii0qlJiqptaCVQbzVfBaZnJZgoozbiFHB/HvqMaUorKR6av6LtSvBUpxcVE6AdaMqs/ADpLXTkN592LubCNTdjLA5TDSAqt3i4WMucm5hKyYRFdTO/29EhG2SW1uaL/b2LMy6xiI3zFhO1QS6rJB7P1VgvL/MXv/zg6P9oz0DkqMNE3Sd7Fxwm3d8Eh2uOgmaFfQi7sHh7vIRxr6gFM3s6xPGE1EkVMT4GnvYAJSpNAzSQqABBmhlVqRwHGsQdLbGFrj4ponORv2x8xvnDdDY5ZPRkCpfXA0KLjABSVXq4oxKLuYpZLQStnaxydb9pklM5l1Rh+1NMYM7COlxr3sUMclRFG0h0PIoYGcm8xTNJJE7VnbmqQZLsDP3z/BbOxjX20k9AvzINAznMinEY0zJLVlM7b579rR2yktIXjtZO47LjYdgrwvGgXQbkqwgKw0PGFYJbqet/JZeL7CtMHz8zJdkLTDqN8rnklntjLgU8cFLtHuCkb4GVJQ5rS+X+uOTraqnEwGc5Z1l7a+bwY02eLw0zwfpaTZ3WQ75RKJSvHSVp3NxIl28HK+v2EI+xeM1vQ6xmqibEvfjWUL1GZovzpNi5uJX/r8dxrmuBJAc+CS3eLoeHpSWtMkoB0KZraggCAvjKZ4Qve7+AczaZN3a5BFeDVQxIAnYC/x+fSxBMWIWZQyXUu2QkAVBp9ftg2yv0cO80FgdriakUARNRQRklhiegkds5LXbr/8lwQvgwf+S6EUmC5baVwGvkf72pXG183y/28flfb+/O/hqdaHcCj4JPg0+C/rBYTAIvglOgtOABS74Ofgl+LX1W+uP1p+tv5ahN2+sMHeCRmv9/Q/4S4tY</latexit> 2. N = {a, c}.<latexit sha1_base64="UnWGOPG7NpsLB9xNGGE4KhYy81s=">AAAHQHicfVVdjxs1FJ0WCGX42lLxxIvLNhKqJtlkq2W7oJUiqCoqtbCQbFtpJ1o8njsZK7ZnsD3dpNb8GF7hX/Av+Ae8IV554jofbCa7YCkZj33POb7XZ+ykFNzYXu/3GzffePOt1tu33gnffe/9Dz7cuf3Rc1NUmsEpK0ShXybUgOAKTi23Al6WGqhMBLxIpl/7+RevQBteqJGdlzCWdKJ4xhm1OHS+8/F+N/6S3PuWHJPY0YiwuL7XDc93dnvd3qKRq53+qrMbrNrJ+e3WnTgtWCVBWSaoMWf9XmnHjmrLmYA6jCsDJWVTOoEz7CoqwYzdYv01aeNISrJC409ZshgNNyHIo+m8weIsTSpB9aw5mhTFFGdMHYZNTZs9HDuuysqCYkvJrBLEFsSXhaRcA7NiTpq6lk9fR4ozyDRlEZVGUptHJffrjOz0dWeiaZlHkk6BgRCXQ8tVebjgiaZ67lMoLkyUIPNEF5VKTVRSa0Erg3ir+SwyOS3BRBm3EaOC+ffUY0pRWEn11PwXa1eCpTi5qJwA60ZVZuEHSGunIb37sHc3Eai7GWFzmGgAVbvFw8dc5NzCVkwiKqid/9+ICNskt7Y0X+ztWZh1jUVumLGcqgl0WSH3fqrAeH+Zvf7nB0f7R3sGJEcbJug62bngNu/4JDpcdRI0K+hF3IPD3eUjjH1BKZrZ1yeMJ6JIqIjxNfawAShTaRikhUADDNDKrEjhONYg6GyNLXDxTROdjfpj5zfOG6CxyyejIVW+uBoUXGACkqrUxRmVXMxTyGglbO1ik637TZOYzLuiDtubYgZ3ENLjXvcoYpKjKNpCoOVRwM5M5imaSSJ3rOzMUw2WYGfun+G3djCut5N6BPiRaRjOZVKIx5iSW7KY2n337GntlJeQvHaydhyXGw/BXheMA+k2JFlBVhoeMKwS3E5b+S29XmBbYfj4mS/JWmDUb5TPJbPaGXEp4oOXaPcEI30NqChzWl8u9ccnW1VPJwI4yzvL2l83gxtt8Hhpng/S02zushzyiUSleOkqT+fiRLp4OV5fsYV8isdreh1iNVE3Je7Hs4TqMzRfnCfFzMWv/H87jHNdCSA58Elu8XQ9PCgtaZNRDoQyW1FBEBbGUzwhet39A5i1ybq1ySO8GqhiQBKwF/j9+liCYsQsyhgupdohIQuCTq/bB9leo4d5obE6XE1IoQiaigjILDE8BY/YyGu3X/9LghfAg/8l0YtMFiy1rwJeI/3tS+Nq5/l+t4/L+35/d/DV6kK5FXwSfBp8FvSDw2AQfBOcBKcBC1zwc/BL8Gvrt9YfrT9bfy1Db95YYe4Ejdb6+x//JYtZ</latexit><latexit sha1_base64="UnWGOPG7NpsLB9xNGGE4KhYy81s=">AAAHQHicfVVdjxs1FJ0WCGX42lLxxIvLNhKqJtlkq2W7oJUiqCoqtbCQbFtpJ1o8njsZK7ZnsD3dpNb8GF7hX/Av+Ae8IV554jofbCa7YCkZj33POb7XZ+ykFNzYXu/3GzffePOt1tu33gnffe/9Dz7cuf3Rc1NUmsEpK0ShXybUgOAKTi23Al6WGqhMBLxIpl/7+RevQBteqJGdlzCWdKJ4xhm1OHS+8/F+N/6S3PuWHJPY0YiwuL7XDc93dnvd3qKRq53+qrMbrNrJ+e3WnTgtWCVBWSaoMWf9XmnHjmrLmYA6jCsDJWVTOoEz7CoqwYzdYv01aeNISrJC409ZshgNNyHIo+m8weIsTSpB9aw5mhTFFGdMHYZNTZs9HDuuysqCYkvJrBLEFsSXhaRcA7NiTpq6lk9fR4ozyDRlEZVGUptHJffrjOz0dWeiaZlHkk6BgRCXQ8tVebjgiaZ67lMoLkyUIPNEF5VKTVRSa0Erg3ir+SwyOS3BRBm3EaOC+ffUY0pRWEn11PwXa1eCpTi5qJwA60ZVZuEHSGunIb37sHc3Eai7GWFzmGgAVbvFw8dc5NzCVkwiKqid/9+ICNskt7Y0X+ztWZh1jUVumLGcqgl0WSH3fqrAeH+Zvf7nB0f7R3sGJEcbJug62bngNu/4JDpcdRI0K+hF3IPD3eUjjH1BKZrZ1yeMJ6JIqIjxNfawAShTaRikhUADDNDKrEjhONYg6GyNLXDxTROdjfpj5zfOG6CxyyejIVW+uBoUXGACkqrUxRmVXMxTyGglbO1ik637TZOYzLuiDtubYgZ3ENLjXvcoYpKjKNpCoOVRwM5M5imaSSJ3rOzMUw2WYGfun+G3djCut5N6BPiRaRjOZVKIx5iSW7KY2n337GntlJeQvHaydhyXGw/BXheMA+k2JFlBVhoeMKwS3E5b+S29XmBbYfj4mS/JWmDUb5TPJbPaGXEp4oOXaPcEI30NqChzWl8u9ccnW1VPJwI4yzvL2l83gxtt8Hhpng/S02zushzyiUSleOkqT+fiRLp4OV5fsYV8isdreh1iNVE3Je7Hs4TqMzRfnCfFzMWv/H87jHNdCSA58Elu8XQ9PCgtaZNRDoQyW1FBEBbGUzwhet39A5i1ybq1ySO8GqhiQBKwF/j9+liCYsQsyhgupdohIQuCTq/bB9leo4d5obE6XE1IoQiaigjILDE8BY/YyGu3X/9LghfAg/8l0YtMFiy1rwJeI/3tS+Nq5/l+t4/L+35/d/DV6kK5FXwSfBp8FvSDw2AQfBOcBKcBC1zwc/BL8Gvrt9YfrT9bfy1Db95YYe4Ejdb6+x//JYtZ</latexit><latexit sha1_base64="UnWGOPG7NpsLB9xNGGE4KhYy81s=">AAAHQHicfVVdjxs1FJ0WCGX42lLxxIvLNhKqJtlkq2W7oJUiqCoqtbCQbFtpJ1o8njsZK7ZnsD3dpNb8GF7hX/Av+Ae8IV554jofbCa7YCkZj33POb7XZ+ykFNzYXu/3GzffePOt1tu33gnffe/9Dz7cuf3Rc1NUmsEpK0ShXybUgOAKTi23Al6WGqhMBLxIpl/7+RevQBteqJGdlzCWdKJ4xhm1OHS+8/F+N/6S3PuWHJPY0YiwuL7XDc93dnvd3qKRq53+qrMbrNrJ+e3WnTgtWCVBWSaoMWf9XmnHjmrLmYA6jCsDJWVTOoEz7CoqwYzdYv01aeNISrJC409ZshgNNyHIo+m8weIsTSpB9aw5mhTFFGdMHYZNTZs9HDuuysqCYkvJrBLEFsSXhaRcA7NiTpq6lk9fR4ozyDRlEZVGUptHJffrjOz0dWeiaZlHkk6BgRCXQ8tVebjgiaZ67lMoLkyUIPNEF5VKTVRSa0Erg3ir+SwyOS3BRBm3EaOC+ffUY0pRWEn11PwXa1eCpTi5qJwA60ZVZuEHSGunIb37sHc3Eai7GWFzmGgAVbvFw8dc5NzCVkwiKqid/9+ICNskt7Y0X+ztWZh1jUVumLGcqgl0WSH3fqrAeH+Zvf7nB0f7R3sGJEcbJug62bngNu/4JDpcdRI0K+hF3IPD3eUjjH1BKZrZ1yeMJ6JIqIjxNfawAShTaRikhUADDNDKrEjhONYg6GyNLXDxTROdjfpj5zfOG6CxyyejIVW+uBoUXGACkqrUxRmVXMxTyGglbO1ik637TZOYzLuiDtubYgZ3ENLjXvcoYpKjKNpCoOVRwM5M5imaSSJ3rOzMUw2WYGfun+G3djCut5N6BPiRaRjOZVKIx5iSW7KY2n337GntlJeQvHaydhyXGw/BXheMA+k2JFlBVhoeMKwS3E5b+S29XmBbYfj4mS/JWmDUb5TPJbPaGXEp4oOXaPcEI30NqChzWl8u9ccnW1VPJwI4yzvL2l83gxtt8Hhpng/S02zushzyiUSleOkqT+fiRLp4OV5fsYV8isdreh1iNVE3Je7Hs4TqMzRfnCfFzMWv/H87jHNdCSA58Elu8XQ9PCgtaZNRDoQyW1FBEBbGUzwhet39A5i1ybq1ySO8GqhiQBKwF/j9+liCYsQsyhgupdohIQuCTq/bB9leo4d5obE6XE1IoQiaigjILDE8BY/YyGu3X/9LghfAg/8l0YtMFiy1rwJeI/3tS+Nq5/l+t4/L+35/d/DV6kK5FXwSfBp8FvSDw2AQfBOcBKcBC1zwc/BL8Gvrt9YfrT9bfy1Db95YYe4Ejdb6+x//JYtZ</latexit><latexit sha1_base64="UnWGOPG7NpsLB9xNGGE4KhYy81s=">AAAHQHicfVVdjxs1FJ0WCGX42lLxxIvLNhKqJtlkq2W7oJUiqCoqtbCQbFtpJ1o8njsZK7ZnsD3dpNb8GF7hX/Av+Ae8IV554jofbCa7YCkZj33POb7XZ+ykFNzYXu/3GzffePOt1tu33gnffe/9Dz7cuf3Rc1NUmsEpK0ShXybUgOAKTi23Al6WGqhMBLxIpl/7+RevQBteqJGdlzCWdKJ4xhm1OHS+8/F+N/6S3PuWHJPY0YiwuL7XDc93dnvd3qKRq53+qrMbrNrJ+e3WnTgtWCVBWSaoMWf9XmnHjmrLmYA6jCsDJWVTOoEz7CoqwYzdYv01aeNISrJC409ZshgNNyHIo+m8weIsTSpB9aw5mhTFFGdMHYZNTZs9HDuuysqCYkvJrBLEFsSXhaRcA7NiTpq6lk9fR4ozyDRlEZVGUptHJffrjOz0dWeiaZlHkk6BgRCXQ8tVebjgiaZ67lMoLkyUIPNEF5VKTVRSa0Erg3ir+SwyOS3BRBm3EaOC+ffUY0pRWEn11PwXa1eCpTi5qJwA60ZVZuEHSGunIb37sHc3Eai7GWFzmGgAVbvFw8dc5NzCVkwiKqid/9+ICNskt7Y0X+ztWZh1jUVumLGcqgl0WSH3fqrAeH+Zvf7nB0f7R3sGJEcbJug62bngNu/4JDpcdRI0K+hF3IPD3eUjjH1BKZrZ1yeMJ6JIqIjxNfawAShTaRikhUADDNDKrEjhONYg6GyNLXDxTROdjfpj5zfOG6CxyyejIVW+uBoUXGACkqrUxRmVXMxTyGglbO1ik637TZOYzLuiDtubYgZ3ENLjXvcoYpKjKNpCoOVRwM5M5imaSSJ3rOzMUw2WYGfun+G3djCut5N6BPiRaRjOZVKIx5iSW7KY2n337GntlJeQvHaydhyXGw/BXheMA+k2JFlBVhoeMKwS3E5b+S29XmBbYfj4mS/JWmDUb5TPJbPaGXEp4oOXaPcEI30NqChzWl8u9ccnW1VPJwI4yzvL2l83gxtt8Hhpng/S02zushzyiUSleOkqT+fiRLp4OV5fsYV8isdreh1iNVE3Je7Hs4TqMzRfnCfFzMWv/H87jHNdCSA58Elu8XQ9PCgtaZNRDoQyW1FBEBbGUzwhet39A5i1ybq1ySO8GqhiQBKwF/j9+liCYsQsyhgupdohIQuCTq/bB9leo4d5obE6XE1IoQiaigjILDE8BY/YyGu3X/9LghfAg/8l0YtMFiy1rwJeI/3tS+Nq5/l+t4/L+35/d/DV6kK5FXwSfBp8FvSDw2AQfBOcBKcBC1zwc/BL8Gvrt9YfrT9bfy1Db95YYe4Ejdb6+x//JYtZ</latexit> 3. N = {a, c, b}.<latexit sha1_base64="mSDh8p6Sw4A+jd6Q91R/Xl/FxcY=">AAAHQ3icfVVdjxs1FJ0WCGX46Ja+IPHiso2Eqkk22dWyXdBKEVQVlVpYSLattBMtHs+djBXbM9ieblJr+DW8wr/gR/AbeEO8InGdZNlMdsFSMh77nnN8r8/YSSm4sb3e7zduvvHmW623b70Tvvve+x/c3rrz4XNTVJrBCStEoV8m1IDgCk4stwJelhqoTAS8SKZf+fkXr0AbXqiRnZcwlnSieMYZtTh0tvXRXjf+gtz/hhyR2NGIsIgkcX2/G55tbfe6vUUjVzv9VWc7WLXjszutu3FasEqCskxQY077vdKOHdWWMwF1GFcGSsqmdAKn2FVUghm7RQo1aeNISrJC409ZshgN1yHIo+m8weIsTSpB9aw5mhTFFGdMHYZNTZs9HDuuysqCYkvJrBLEFsRXhqRcA7NiTpq6lk9fR4ozyDRlEZVGUptHJffrjOz0dWeiaZlHkk6BgRCXQ8tVebjgiaZ67lMozk2UIPNEF5VKTVRSa0Erg3ir+SwyOS3BRBm3EaOC+ffUY0pRWEn11PwXa1eCpTi5qJwA60ZVZuF7SGunIb33sHcvEai7HmFzmGgAVbvFw8ec59zCRkwiKqid/1+LCNskt7Y0n+/sWJh1jUVumLGcqgl0WSF3fqzAeIuZnf5n+4e7hzsGJEcnJmg82TnnNu/4JDpcdRL0K+hF3N7B9vIRxr6gFP3s6xPGE1EkVMT4GnvYAJSpNAzSQqABBuhmVqRwFGsQdHaBLXDxTROdjvpj5zfOG6Cxy8ejIVW+uBoUnGMCkqrUxRmVXMxTyGglbO1ik130myYxmXdFHbbXxQzuIKRHve5hxCRHUbSFQMujgJ2ZzFM0k0TuWNmZpxoswc48OMVvbX9cbyb1CPAj0zCcy6QQjzElt2Qxtfv22dPaKS8hee1k7TguNx6CvS4YB9JNSLKCrDQ8YFgluJ228lt6vcCmwvDxM1+SC4FRv1E+l8xqZ8SliA9eot0TjPQ1oKLMaX251B+ebFQ9nQjgLO8sa3/dDG60weOleT5IT7O+y3LIJxKV4qWrPJ2LE+ni5Xh9xRbyKZ6w6XWI1UTdlHgQzxKqT9F8cZ4UMxe/8v/tMM51JYDkwCe5xdP1YL+0pE1GORDKbEUFQVgYT/GE6HV392HWJhetTR7h7UAVA5KAPcfv18cSFCNmUcZwKdUOCVkQdHrdPsj2BXqYFxqrw9WEFIqgqYiAzBLDU/CItby2+/W/JHgB7P0viV5ksmCpfRXwGulvXhpXO893u31c3ne724MvVxfKreDj4JPg06AfHASD4OvgODgJWPBT8HPwS/Br67fWH60/W38tQ2/eWGHuBo3W+vsfL+KMJg==</latexit><latexit sha1_base64="mSDh8p6Sw4A+jd6Q91R/Xl/FxcY=">AAAHQ3icfVVdjxs1FJ0WCGX46Ja+IPHiso2Eqkk22dWyXdBKEVQVlVpYSLattBMtHs+djBXbM9ieblJr+DW8wr/gR/AbeEO8InGdZNlMdsFSMh77nnN8r8/YSSm4sb3e7zduvvHmW623b70Tvvve+x/c3rrz4XNTVJrBCStEoV8m1IDgCk4stwJelhqoTAS8SKZf+fkXr0AbXqiRnZcwlnSieMYZtTh0tvXRXjf+gtz/hhyR2NGIsIgkcX2/G55tbfe6vUUjVzv9VWc7WLXjszutu3FasEqCskxQY077vdKOHdWWMwF1GFcGSsqmdAKn2FVUghm7RQo1aeNISrJC409ZshgN1yHIo+m8weIsTSpB9aw5mhTFFGdMHYZNTZs9HDuuysqCYkvJrBLEFsRXhqRcA7NiTpq6lk9fR4ozyDRlEZVGUptHJffrjOz0dWeiaZlHkk6BgRCXQ8tVebjgiaZ67lMozk2UIPNEF5VKTVRSa0Erg3ir+SwyOS3BRBm3EaOC+ffUY0pRWEn11PwXa1eCpTi5qJwA60ZVZuF7SGunIb33sHcvEai7HmFzmGgAVbvFw8ec59zCRkwiKqid/1+LCNskt7Y0n+/sWJh1jUVumLGcqgl0WSF3fqzAeIuZnf5n+4e7hzsGJEcnJmg82TnnNu/4JDpcdRL0K+hF3N7B9vIRxr6gFP3s6xPGE1EkVMT4GnvYAJSpNAzSQqABBuhmVqRwFGsQdHaBLXDxTROdjvpj5zfOG6Cxy8ejIVW+uBoUnGMCkqrUxRmVXMxTyGglbO1ik130myYxmXdFHbbXxQzuIKRHve5hxCRHUbSFQMujgJ2ZzFM0k0TuWNmZpxoswc48OMVvbX9cbyb1CPAj0zCcy6QQjzElt2Qxtfv22dPaKS8hee1k7TguNx6CvS4YB9JNSLKCrDQ8YFgluJ228lt6vcCmwvDxM1+SC4FRv1E+l8xqZ8SliA9eot0TjPQ1oKLMaX251B+ebFQ9nQjgLO8sa3/dDG60weOleT5IT7O+y3LIJxKV4qWrPJ2LE+ni5Xh9xRbyKZ6w6XWI1UTdlHgQzxKqT9F8cZ4UMxe/8v/tMM51JYDkwCe5xdP1YL+0pE1GORDKbEUFQVgYT/GE6HV392HWJhetTR7h7UAVA5KAPcfv18cSFCNmUcZwKdUOCVkQdHrdPsj2BXqYFxqrw9WEFIqgqYiAzBLDU/CItby2+/W/JHgB7P0viV5ksmCpfRXwGulvXhpXO893u31c3ne724MvVxfKreDj4JPg06AfHASD4OvgODgJWPBT8HPwS/Br67fWH60/W38tQ2/eWGHuBo3W+vsfL+KMJg==</latexit><latexit sha1_base64="mSDh8p6Sw4A+jd6Q91R/Xl/FxcY=">AAAHQ3icfVVdjxs1FJ0WCGX46Ja+IPHiso2Eqkk22dWyXdBKEVQVlVpYSLattBMtHs+djBXbM9ieblJr+DW8wr/gR/AbeEO8InGdZNlMdsFSMh77nnN8r8/YSSm4sb3e7zduvvHmW623b70Tvvve+x/c3rrz4XNTVJrBCStEoV8m1IDgCk4stwJelhqoTAS8SKZf+fkXr0AbXqiRnZcwlnSieMYZtTh0tvXRXjf+gtz/hhyR2NGIsIgkcX2/G55tbfe6vUUjVzv9VWc7WLXjszutu3FasEqCskxQY077vdKOHdWWMwF1GFcGSsqmdAKn2FVUghm7RQo1aeNISrJC409ZshgN1yHIo+m8weIsTSpB9aw5mhTFFGdMHYZNTZs9HDuuysqCYkvJrBLEFsRXhqRcA7NiTpq6lk9fR4ozyDRlEZVGUptHJffrjOz0dWeiaZlHkk6BgRCXQ8tVebjgiaZ67lMozk2UIPNEF5VKTVRSa0Erg3ir+SwyOS3BRBm3EaOC+ffUY0pRWEn11PwXa1eCpTi5qJwA60ZVZuF7SGunIb33sHcvEai7HmFzmGgAVbvFw8ec59zCRkwiKqid/1+LCNskt7Y0n+/sWJh1jUVumLGcqgl0WSF3fqzAeIuZnf5n+4e7hzsGJEcnJmg82TnnNu/4JDpcdRL0K+hF3N7B9vIRxr6gFP3s6xPGE1EkVMT4GnvYAJSpNAzSQqABBuhmVqRwFGsQdHaBLXDxTROdjvpj5zfOG6Cxy8ejIVW+uBoUnGMCkqrUxRmVXMxTyGglbO1ik130myYxmXdFHbbXxQzuIKRHve5hxCRHUbSFQMujgJ2ZzFM0k0TuWNmZpxoswc48OMVvbX9cbyb1CPAj0zCcy6QQjzElt2Qxtfv22dPaKS8hee1k7TguNx6CvS4YB9JNSLKCrDQ8YFgluJ228lt6vcCmwvDxM1+SC4FRv1E+l8xqZ8SliA9eot0TjPQ1oKLMaX251B+ebFQ9nQjgLO8sa3/dDG60weOleT5IT7O+y3LIJxKV4qWrPJ2LE+ni5Xh9xRbyKZ6w6XWI1UTdlHgQzxKqT9F8cZ4UMxe/8v/tMM51JYDkwCe5xdP1YL+0pE1GORDKbEUFQVgYT/GE6HV392HWJhetTR7h7UAVA5KAPcfv18cSFCNmUcZwKdUOCVkQdHrdPsj2BXqYFxqrw9WEFIqgqYiAzBLDU/CItby2+/W/JHgB7P0viV5ksmCpfRXwGulvXhpXO893u31c3ne724MvVxfKreDj4JPg06AfHASD4OvgODgJWPBT8HPwS/Br67fWH60/W38tQ2/eWGHuBo3W+vsfL+KMJg==</latexit><latexit sha1_base64="mSDh8p6Sw4A+jd6Q91R/Xl/FxcY=">AAAHQ3icfVVdjxs1FJ0WCGX46Ja+IPHiso2Eqkk22dWyXdBKEVQVlVpYSLattBMtHs+djBXbM9ieblJr+DW8wr/gR/AbeEO8InGdZNlMdsFSMh77nnN8r8/YSSm4sb3e7zduvvHmW623b70Tvvve+x/c3rrz4XNTVJrBCStEoV8m1IDgCk4stwJelhqoTAS8SKZf+fkXr0AbXqiRnZcwlnSieMYZtTh0tvXRXjf+gtz/hhyR2NGIsIgkcX2/G55tbfe6vUUjVzv9VWc7WLXjszutu3FasEqCskxQY077vdKOHdWWMwF1GFcGSsqmdAKn2FVUghm7RQo1aeNISrJC409ZshgN1yHIo+m8weIsTSpB9aw5mhTFFGdMHYZNTZs9HDuuysqCYkvJrBLEFsRXhqRcA7NiTpq6lk9fR4ozyDRlEZVGUptHJffrjOz0dWeiaZlHkk6BgRCXQ8tVebjgiaZ67lMozk2UIPNEF5VKTVRSa0Erg3ir+SwyOS3BRBm3EaOC+ffUY0pRWEn11PwXa1eCpTi5qJwA60ZVZuF7SGunIb33sHcvEai7HmFzmGgAVbvFw8ec59zCRkwiKqid/1+LCNskt7Y0n+/sWJh1jUVumLGcqgl0WSF3fqzAeIuZnf5n+4e7hzsGJEcnJmg82TnnNu/4JDpcdRL0K+hF3N7B9vIRxr6gFP3s6xPGE1EkVMT4GnvYAJSpNAzSQqABBuhmVqRwFGsQdHaBLXDxTROdjvpj5zfOG6Cxy8ejIVW+uBoUnGMCkqrUxRmVXMxTyGglbO1ik130myYxmXdFHbbXxQzuIKRHve5hxCRHUbSFQMujgJ2ZzFM0k0TuWNmZpxoswc48OMVvbX9cbyb1CPAj0zCcy6QQjzElt2Qxtfv22dPaKS8hee1k7TguNx6CvS4YB9JNSLKCrDQ8YFgluJ228lt6vcCmwvDxM1+SC4FRv1E+l8xqZ8SliA9eot0TjPQ1oKLMaX251B+ebFQ9nQjgLO8sa3/dDG60weOleT5IT7O+y3LIJxKV4qWrPJ2LE+ni5Xh9xRbyKZ6w6XWI1UTdlHgQzxKqT9F8cZ4UMxe/8v/tMM51JYDkwCe5xdP1YL+0pE1GORDKbEUFQVgYT/GE6HV392HWJhetTR7h7UAVA5KAPcfv18cSFCNmUcZwKdUOCVkQdHrdPsj2BXqYFxqrw9WEFIqgqYiAzBLDU/CItby2+/W/JHgB7P0viV5ksmCpfRXwGulvXhpXO893u31c3ne724MvVxfKreDj4JPg06AfHASD4OvgODgJWPBT8HPwS/Br67fWH60/W38tQ2/eWGHuBo3W+vsfL+KMJg==</latexit> 0. N = ;.<latexit sha1_base64="koOJt4XUWyg16qZo3FixiqcvPXI=">AAAHQXicfVVdb9s2FFXbzeu0j6YtsJe9sEsNDIXt2CmyNBsCGFtRrEC7ZbPTFoiMjJKuJMIkpZFUI5fTn9nr9i/2K/YT9jbsdS+7tJzFcrIRsEWR95zDe3lEhgVn2gyHv1+7fuOttzvv3HzXf+/9Dz68tXX7zgudlyqC4yjnuXoVUg2cSTg2zHB4VSigIuTwMpx/5eZfvgalWS6nZlHATNBUsoRF1ODQ6dZHw0HwBbn/DTkkAYjCLDSY+wP/dGt7OBguG7ncGa06296qHZ3e7twN4jwqBUgTcar1yWhYmJmlyrCIQ+0HpYaCRnOawgl2JRWgZ3aZQE26OBKTJFf4k4YsR/11CPIoumixWEPDklNVtUfDPJ/jjK59v61pkkczy2RRGpBRI5mUnJicuLqQmCmIDF+Qtq5h8zc9ySJIFI16VGhBTdYrmFtnz8zf9FNFi6wn6Bwi4PxiqFmVg3MWKqoWLoX8TPdCZE5VXspY9wpqDCipEW8Uq3o6owXoXsJML6I8cu+xwxQ8N4Kquf4v1oEAQ3FyWTkOxk7LxMD3ENdWQXzv0fBeyFF3PcJkkCoAWdvlw8WcZczARkzIS6it+1+L8LskM6bQn+/sGKgG2iA3VFFGZQqDKBc7P5agncH0zuizvYPdgx0NgqEPQ7Sd6J8xk/VdEn0m+yG6FdQy7uH+dvPwA1dQim529fGDlOch5QG+Bg42BqlLBeM452iAMXo5ymM4DBRwWp1jc1x820Qn09HMuo1zBmjt8tF0QqUrrgIJZ5iAoDK2QUIF44sYElpyU9tAJ+f9tkl04lxR+911MY07CPHhcHDQiwRDUbQFR8ujgKl04ijaSSJ3IE3lqMYN2OoHJ/it7c3qzaQeA35kCiYLEeb8CaZkGxZd22+fP6utdBKC1VbUluFygwmYq4JxIN6EhCvISsMBJmWI22lKt6VXC2wqTJ48dyU5F5iOWuWzYVVbzS9EXHCDtk8x0tWA8iKj9cVSf3i6UfU45cCirN/U/qoZ3GiNx0v7fBCOZn2XxYSlApWCxlWOzgahsEEzXl+yhXiG52t8FWI1UbclHgRVSNUJmi/IwryywWv33/WDTJUcSAYszQyervt7hSFdMs2A0MiUlBOE+cEcT4jhYHcPqi45b13yGO8GKiMgIZgz/H5dLEExopdl9Buprk/IkqA/HIxAdM/RkyxXWB0mU5JLgqYiHBJDNIvBIdby2h7V/5LgBfDwf0nUMpMlS+2qgNfIaPPSuNx5sTsY4fK+290ef7m6UG56H3ufeJ96I2/fG3tfe0fesRd5P3k/e794v3Z+6/zR+bPzVxN6/doKc9drtc7f/wCI04x4</latexit><latexit sha1_base64="koOJt4XUWyg16qZo3FixiqcvPXI=">AAAHQXicfVVdb9s2FFXbzeu0j6YtsJe9sEsNDIXt2CmyNBsCGFtRrEC7ZbPTFoiMjJKuJMIkpZFUI5fTn9nr9i/2K/YT9jbsdS+7tJzFcrIRsEWR95zDe3lEhgVn2gyHv1+7fuOttzvv3HzXf+/9Dz68tXX7zgudlyqC4yjnuXoVUg2cSTg2zHB4VSigIuTwMpx/5eZfvgalWS6nZlHATNBUsoRF1ODQ6dZHw0HwBbn/DTkkAYjCLDSY+wP/dGt7OBguG7ncGa06296qHZ3e7twN4jwqBUgTcar1yWhYmJmlyrCIQ+0HpYaCRnOawgl2JRWgZ3aZQE26OBKTJFf4k4YsR/11CPIoumixWEPDklNVtUfDPJ/jjK59v61pkkczy2RRGpBRI5mUnJicuLqQmCmIDF+Qtq5h8zc9ySJIFI16VGhBTdYrmFtnz8zf9FNFi6wn6Bwi4PxiqFmVg3MWKqoWLoX8TPdCZE5VXspY9wpqDCipEW8Uq3o6owXoXsJML6I8cu+xwxQ8N4Kquf4v1oEAQ3FyWTkOxk7LxMD3ENdWQXzv0fBeyFF3PcJkkCoAWdvlw8WcZczARkzIS6it+1+L8LskM6bQn+/sGKgG2iA3VFFGZQqDKBc7P5agncH0zuizvYPdgx0NgqEPQ7Sd6J8xk/VdEn0m+yG6FdQy7uH+dvPwA1dQim529fGDlOch5QG+Bg42BqlLBeM452iAMXo5ymM4DBRwWp1jc1x820Qn09HMuo1zBmjt8tF0QqUrrgIJZ5iAoDK2QUIF44sYElpyU9tAJ+f9tkl04lxR+911MY07CPHhcHDQiwRDUbQFR8ujgKl04ijaSSJ3IE3lqMYN2OoHJ/it7c3qzaQeA35kCiYLEeb8CaZkGxZd22+fP6utdBKC1VbUluFygwmYq4JxIN6EhCvISsMBJmWI22lKt6VXC2wqTJ48dyU5F5iOWuWzYVVbzS9EXHCDtk8x0tWA8iKj9cVSf3i6UfU45cCirN/U/qoZ3GiNx0v7fBCOZn2XxYSlApWCxlWOzgahsEEzXl+yhXiG52t8FWI1UbclHgRVSNUJmi/IwryywWv33/WDTJUcSAYszQyervt7hSFdMs2A0MiUlBOE+cEcT4jhYHcPqi45b13yGO8GKiMgIZgz/H5dLEExopdl9Buprk/IkqA/HIxAdM/RkyxXWB0mU5JLgqYiHBJDNIvBIdby2h7V/5LgBfDwf0nUMpMlS+2qgNfIaPPSuNx5sTsY4fK+290ef7m6UG56H3ufeJ96I2/fG3tfe0fesRd5P3k/e794v3Z+6/zR+bPzVxN6/doKc9drtc7f/wCI04x4</latexit><latexit sha1_base64="koOJt4XUWyg16qZo3FixiqcvPXI=">AAAHQXicfVVdb9s2FFXbzeu0j6YtsJe9sEsNDIXt2CmyNBsCGFtRrEC7ZbPTFoiMjJKuJMIkpZFUI5fTn9nr9i/2K/YT9jbsdS+7tJzFcrIRsEWR95zDe3lEhgVn2gyHv1+7fuOttzvv3HzXf+/9Dz68tXX7zgudlyqC4yjnuXoVUg2cSTg2zHB4VSigIuTwMpx/5eZfvgalWS6nZlHATNBUsoRF1ODQ6dZHw0HwBbn/DTkkAYjCLDSY+wP/dGt7OBguG7ncGa06296qHZ3e7twN4jwqBUgTcar1yWhYmJmlyrCIQ+0HpYaCRnOawgl2JRWgZ3aZQE26OBKTJFf4k4YsR/11CPIoumixWEPDklNVtUfDPJ/jjK59v61pkkczy2RRGpBRI5mUnJicuLqQmCmIDF+Qtq5h8zc9ySJIFI16VGhBTdYrmFtnz8zf9FNFi6wn6Bwi4PxiqFmVg3MWKqoWLoX8TPdCZE5VXspY9wpqDCipEW8Uq3o6owXoXsJML6I8cu+xwxQ8N4Kquf4v1oEAQ3FyWTkOxk7LxMD3ENdWQXzv0fBeyFF3PcJkkCoAWdvlw8WcZczARkzIS6it+1+L8LskM6bQn+/sGKgG2iA3VFFGZQqDKBc7P5agncH0zuizvYPdgx0NgqEPQ7Sd6J8xk/VdEn0m+yG6FdQy7uH+dvPwA1dQim529fGDlOch5QG+Bg42BqlLBeM452iAMXo5ymM4DBRwWp1jc1x820Qn09HMuo1zBmjt8tF0QqUrrgIJZ5iAoDK2QUIF44sYElpyU9tAJ+f9tkl04lxR+911MY07CPHhcHDQiwRDUbQFR8ujgKl04ijaSSJ3IE3lqMYN2OoHJ/it7c3qzaQeA35kCiYLEeb8CaZkGxZd22+fP6utdBKC1VbUluFygwmYq4JxIN6EhCvISsMBJmWI22lKt6VXC2wqTJ48dyU5F5iOWuWzYVVbzS9EXHCDtk8x0tWA8iKj9cVSf3i6UfU45cCirN/U/qoZ3GiNx0v7fBCOZn2XxYSlApWCxlWOzgahsEEzXl+yhXiG52t8FWI1UbclHgRVSNUJmi/IwryywWv33/WDTJUcSAYszQyervt7hSFdMs2A0MiUlBOE+cEcT4jhYHcPqi45b13yGO8GKiMgIZgz/H5dLEExopdl9Buprk/IkqA/HIxAdM/RkyxXWB0mU5JLgqYiHBJDNIvBIdby2h7V/5LgBfDwf0nUMpMlS+2qgNfIaPPSuNx5sTsY4fK+290ef7m6UG56H3ufeJ96I2/fG3tfe0fesRd5P3k/e794v3Z+6/zR+bPzVxN6/doKc9drtc7f/wCI04x4</latexit><latexit sha1_base64="koOJt4XUWyg16qZo3FixiqcvPXI=">AAAHQXicfVVdb9s2FFXbzeu0j6YtsJe9sEsNDIXt2CmyNBsCGFtRrEC7ZbPTFoiMjJKuJMIkpZFUI5fTn9nr9i/2K/YT9jbsdS+7tJzFcrIRsEWR95zDe3lEhgVn2gyHv1+7fuOttzvv3HzXf+/9Dz68tXX7zgudlyqC4yjnuXoVUg2cSTg2zHB4VSigIuTwMpx/5eZfvgalWS6nZlHATNBUsoRF1ODQ6dZHw0HwBbn/DTkkAYjCLDSY+wP/dGt7OBguG7ncGa06296qHZ3e7twN4jwqBUgTcar1yWhYmJmlyrCIQ+0HpYaCRnOawgl2JRWgZ3aZQE26OBKTJFf4k4YsR/11CPIoumixWEPDklNVtUfDPJ/jjK59v61pkkczy2RRGpBRI5mUnJicuLqQmCmIDF+Qtq5h8zc9ySJIFI16VGhBTdYrmFtnz8zf9FNFi6wn6Bwi4PxiqFmVg3MWKqoWLoX8TPdCZE5VXspY9wpqDCipEW8Uq3o6owXoXsJML6I8cu+xwxQ8N4Kquf4v1oEAQ3FyWTkOxk7LxMD3ENdWQXzv0fBeyFF3PcJkkCoAWdvlw8WcZczARkzIS6it+1+L8LskM6bQn+/sGKgG2iA3VFFGZQqDKBc7P5agncH0zuizvYPdgx0NgqEPQ7Sd6J8xk/VdEn0m+yG6FdQy7uH+dvPwA1dQim529fGDlOch5QG+Bg42BqlLBeM452iAMXo5ymM4DBRwWp1jc1x820Qn09HMuo1zBmjt8tF0QqUrrgIJZ5iAoDK2QUIF44sYElpyU9tAJ+f9tkl04lxR+911MY07CPHhcHDQiwRDUbQFR8ujgKl04ijaSSJ3IE3lqMYN2OoHJ/it7c3qzaQeA35kCiYLEeb8CaZkGxZd22+fP6utdBKC1VbUluFygwmYq4JxIN6EhCvISsMBJmWI22lKt6VXC2wqTJ48dyU5F5iOWuWzYVVbzS9EXHCDtk8x0tWA8iKj9cVSf3i6UfU45cCirN/U/qoZ3GiNx0v7fBCOZn2XxYSlApWCxlWOzgahsEEzXl+yhXiG52t8FWI1UbclHgRVSNUJmi/IwryywWv33/WDTJUcSAYszQyervt7hSFdMs2A0MiUlBOE+cEcT4jhYHcPqi45b13yGO8GKiMgIZgz/H5dLEExopdl9Buprk/IkqA/HIxAdM/RkyxXWB0mU5JLgqYiHBJDNIvBIdby2h7V/5LgBfDwf0nUMpMlS+2qgNfIaPPSuNx5sTsY4fK+290ef7m6UG56H3ufeJ96I2/fG3tfe0fesRd5P3k/e794v3Z+6/zR+bPzVxN6/doKc9drtc7f/wCI04x4</latexit> 1. N = {a, c, d}.<latexit sha1_base64="cQc0H4GWbHtVI0fEsTgfVT1qu8Q=">AAAHQ3icfVVdjxs1FJ22EMrw0W37gsSLyzYSqibZZKtlu6CVIqgqKrWwkGxbaSdaPJ47GSu2Z7A93aTW8Gt4hX/Bj+A38IZ4ReI6ybKZ7IKlZDz2Pef4Xp+xk1JwY3u9369dv/HW2613br4bvvf+Bx/e2rp954UpKs3gmBWi0K8SakBwBceWWwGvSg1UJgJeJtOv/PzL16ANL9TIzksYSzpRPOOMWhw63fqo342/IPe/IYckdjQiLCJpXN/vhqdb271ub9HI5U5/1dkOVu3o9HbrbpwWrJKgLBPUmJN+r7RjR7XlTEAdxpWBkrIpncAJdhWVYMZukUJN2jiSkqzQ+FOWLEbDdQjyaDpvsDhLk0pQPWuOJkUxxRlTh2FT02aPxo6rsrKg2FIyqwSxBfGVISnXwKyYk6au5dM3keIMMk1ZRKWR1OZRyf06Izt905loWuaRpFNgIMTF0HJVHi54oqme+xSKMxMlyDzRRaVSE5XUWtDKIN5qPotMTkswUcZtxKhg/j31mFIUVlI9Nf/F2pVgKU4uKifAulGVWfge0tppSO896t1LBOquR9gcJhpA1W7x8DFnObewEZOICmrn/9ciwjbJrS3N5zs7FmZdY5EbZiynagJdVsidHysw3mJmp//Z3sHuwY4BydGJCRpPds64zTs+iQ5XnQT9CnoR93B/e/kIY19Qin729QnjiSgSKmJ8jT1sAMpUGgZpIdAAA3QzK1I4jDUIOjvHFrj4polORv2x8xvnDdDY5aPRkCpfXA0KzjABSVXq4oxKLuYpZLQStnaxyc77TZOYzLuiDtvrYgZ3ENLDXvcgYpKjKNpCoOVRwM5M5imaSSJ3rOzMUw2WYGcenOC3tjeuN5N6DPiRaRjOZVKIJ5iSW7KY2n37/FntlJeQvHaydhyXGw/BXhWMA+kmJFlBVhoeMKwS3E5b+S29WmBTYfjkuS/JucCo3yifS2a1M+JCxAcv0e4pRvoaUFHmtL5Y6g9PN6qeTgRwlneWtb9qBjfa4PHSPB+kp1nfZTnkE4lK8dJVns7FiXTxcry+ZAv5DE/Y9CrEaqJuSjyIZwnVJ2i+OE+KmYtf+/92GOe6EkBy4JPc4um6v1da0iajHAhltqKCICyMp3hC9Lq7ezBrk/PWJo/xdqCKAUnAnuH362MJihGzKGO4lGqHhCwIOr1uH2T7HD3MC43V4WpCCkXQVERAZonhKXjEWl7b/fpfErwAHv4viV5ksmCpfRXwGulvXhqXOy92u31c3ne724MvVxfKzeDj4JPg06Af7AeD4OvgKDgOWPBT8HPwS/Br67fWH60/W38tQ69fW2HuBo3W+vsfL76MJg==</latexit><latexit sha1_base64="cQc0H4GWbHtVI0fEsTgfVT1qu8Q=">AAAHQ3icfVVdjxs1FJ22EMrw0W37gsSLyzYSqibZZKtlu6CVIqgqKrWwkGxbaSdaPJ47GSu2Z7A93aTW8Gt4hX/Bj+A38IZ4ReI6ybKZ7IKlZDz2Pef4Xp+xk1JwY3u9369dv/HW2613br4bvvf+Bx/e2rp954UpKs3gmBWi0K8SakBwBceWWwGvSg1UJgJeJtOv/PzL16ANL9TIzksYSzpRPOOMWhw63fqo342/IPe/IYckdjQiLCJpXN/vhqdb271ub9HI5U5/1dkOVu3o9HbrbpwWrJKgLBPUmJN+r7RjR7XlTEAdxpWBkrIpncAJdhWVYMZukUJN2jiSkqzQ+FOWLEbDdQjyaDpvsDhLk0pQPWuOJkUxxRlTh2FT02aPxo6rsrKg2FIyqwSxBfGVISnXwKyYk6au5dM3keIMMk1ZRKWR1OZRyf06Izt905loWuaRpFNgIMTF0HJVHi54oqme+xSKMxMlyDzRRaVSE5XUWtDKIN5qPotMTkswUcZtxKhg/j31mFIUVlI9Nf/F2pVgKU4uKifAulGVWfge0tppSO896t1LBOquR9gcJhpA1W7x8DFnObewEZOICmrn/9ciwjbJrS3N5zs7FmZdY5EbZiynagJdVsidHysw3mJmp//Z3sHuwY4BydGJCRpPds64zTs+iQ5XnQT9CnoR93B/e/kIY19Qin729QnjiSgSKmJ8jT1sAMpUGgZpIdAAA3QzK1I4jDUIOjvHFrj4polORv2x8xvnDdDY5aPRkCpfXA0KzjABSVXq4oxKLuYpZLQStnaxyc77TZOYzLuiDtvrYgZ3ENLDXvcgYpKjKNpCoOVRwM5M5imaSSJ3rOzMUw2WYGcenOC3tjeuN5N6DPiRaRjOZVKIJ5iSW7KY2n37/FntlJeQvHaydhyXGw/BXhWMA+kmJFlBVhoeMKwS3E5b+S29WmBTYfjkuS/JucCo3yifS2a1M+JCxAcv0e4pRvoaUFHmtL5Y6g9PN6qeTgRwlneWtb9qBjfa4PHSPB+kp1nfZTnkE4lK8dJVns7FiXTxcry+ZAv5DE/Y9CrEaqJuSjyIZwnVJ2i+OE+KmYtf+/92GOe6EkBy4JPc4um6v1da0iajHAhltqKCICyMp3hC9Lq7ezBrk/PWJo/xdqCKAUnAnuH362MJihGzKGO4lGqHhCwIOr1uH2T7HD3MC43V4WpCCkXQVERAZonhKXjEWl7b/fpfErwAHv4viV5ksmCpfRXwGulvXhqXOy92u31c3ne724MvVxfKzeDj4JPg06Af7AeD4OvgKDgOWPBT8HPwS/Br67fWH60/W38tQ69fW2HuBo3W+vsfL76MJg==</latexit><latexit sha1_base64="cQc0H4GWbHtVI0fEsTgfVT1qu8Q=">AAAHQ3icfVVdjxs1FJ22EMrw0W37gsSLyzYSqibZZKtlu6CVIqgqKrWwkGxbaSdaPJ47GSu2Z7A93aTW8Gt4hX/Bj+A38IZ4ReI6ybKZ7IKlZDz2Pef4Xp+xk1JwY3u9369dv/HW2613br4bvvf+Bx/e2rp954UpKs3gmBWi0K8SakBwBceWWwGvSg1UJgJeJtOv/PzL16ANL9TIzksYSzpRPOOMWhw63fqo342/IPe/IYckdjQiLCJpXN/vhqdb271ub9HI5U5/1dkOVu3o9HbrbpwWrJKgLBPUmJN+r7RjR7XlTEAdxpWBkrIpncAJdhWVYMZukUJN2jiSkqzQ+FOWLEbDdQjyaDpvsDhLk0pQPWuOJkUxxRlTh2FT02aPxo6rsrKg2FIyqwSxBfGVISnXwKyYk6au5dM3keIMMk1ZRKWR1OZRyf06Izt905loWuaRpFNgIMTF0HJVHi54oqme+xSKMxMlyDzRRaVSE5XUWtDKIN5qPotMTkswUcZtxKhg/j31mFIUVlI9Nf/F2pVgKU4uKifAulGVWfge0tppSO896t1LBOquR9gcJhpA1W7x8DFnObewEZOICmrn/9ciwjbJrS3N5zs7FmZdY5EbZiynagJdVsidHysw3mJmp//Z3sHuwY4BydGJCRpPds64zTs+iQ5XnQT9CnoR93B/e/kIY19Qin729QnjiSgSKmJ8jT1sAMpUGgZpIdAAA3QzK1I4jDUIOjvHFrj4polORv2x8xvnDdDY5aPRkCpfXA0KzjABSVXq4oxKLuYpZLQStnaxyc77TZOYzLuiDtvrYgZ3ENLDXvcgYpKjKNpCoOVRwM5M5imaSSJ3rOzMUw2WYGcenOC3tjeuN5N6DPiRaRjOZVKIJ5iSW7KY2n37/FntlJeQvHaydhyXGw/BXhWMA+kmJFlBVhoeMKwS3E5b+S29WmBTYfjkuS/JucCo3yifS2a1M+JCxAcv0e4pRvoaUFHmtL5Y6g9PN6qeTgRwlneWtb9qBjfa4PHSPB+kp1nfZTnkE4lK8dJVns7FiXTxcry+ZAv5DE/Y9CrEaqJuSjyIZwnVJ2i+OE+KmYtf+/92GOe6EkBy4JPc4um6v1da0iajHAhltqKCICyMp3hC9Lq7ezBrk/PWJo/xdqCKAUnAnuH362MJihGzKGO4lGqHhCwIOr1uH2T7HD3MC43V4WpCCkXQVERAZonhKXjEWl7b/fpfErwAHv4viV5ksmCpfRXwGulvXhqXOy92u31c3ne724MvVxfKzeDj4JPg06Af7AeD4OvgKDgOWPBT8HPwS/Br67fWH60/W38tQ69fW2HuBo3W+vsfL76MJg==</latexit><latexit sha1_base64="cQc0H4GWbHtVI0fEsTgfVT1qu8Q=">AAAHQ3icfVVdjxs1FJ22EMrw0W37gsSLyzYSqibZZKtlu6CVIqgqKrWwkGxbaSdaPJ47GSu2Z7A93aTW8Gt4hX/Bj+A38IZ4ReI6ybKZ7IKlZDz2Pef4Xp+xk1JwY3u9369dv/HW2613br4bvvf+Bx/e2rp954UpKs3gmBWi0K8SakBwBceWWwGvSg1UJgJeJtOv/PzL16ANL9TIzksYSzpRPOOMWhw63fqo342/IPe/IYckdjQiLCJpXN/vhqdb271ub9HI5U5/1dkOVu3o9HbrbpwWrJKgLBPUmJN+r7RjR7XlTEAdxpWBkrIpncAJdhWVYMZukUJN2jiSkqzQ+FOWLEbDdQjyaDpvsDhLk0pQPWuOJkUxxRlTh2FT02aPxo6rsrKg2FIyqwSxBfGVISnXwKyYk6au5dM3keIMMk1ZRKWR1OZRyf06Izt905loWuaRpFNgIMTF0HJVHi54oqme+xSKMxMlyDzRRaVSE5XUWtDKIN5qPotMTkswUcZtxKhg/j31mFIUVlI9Nf/F2pVgKU4uKifAulGVWfge0tppSO896t1LBOquR9gcJhpA1W7x8DFnObewEZOICmrn/9ciwjbJrS3N5zs7FmZdY5EbZiynagJdVsidHysw3mJmp//Z3sHuwY4BydGJCRpPds64zTs+iQ5XnQT9CnoR93B/e/kIY19Qin729QnjiSgSKmJ8jT1sAMpUGgZpIdAAA3QzK1I4jDUIOjvHFrj4polORv2x8xvnDdDY5aPRkCpfXA0KzjABSVXq4oxKLuYpZLQStnaxyc77TZOYzLuiDtvrYgZ3ENLDXvcgYpKjKNpCoOVRwM5M5imaSSJ3rOzMUw2WYGcenOC3tjeuN5N6DPiRaRjOZVKIJ5iSW7KY2n37/FntlJeQvHaydhyXGw/BXhWMA+kmJFlBVhoeMKwS3E5b+S29WmBTYfjkuS/JucCo3yifS2a1M+JCxAcv0e4pRvoaUFHmtL5Y6g9PN6qeTgRwlneWtb9qBjfa4PHSPB+kp1nfZTnkE4lK8dJVns7FiXTxcry+ZAv5DE/Y9CrEaqJuSjyIZwnVJ2i+OE+KmYtf+/92GOe6EkBy4JPc4um6v1da0iajHAhltqKCICyMp3hC9Lq7ezBrk/PWJo/xdqCKAUnAnuH362MJihGzKGO4lGqHhCwIOr1uH2T7HD3MC43V4WpCCkXQVERAZonhKXjEWl7b/fpfErwAHv4viV5ksmCpfRXwGulvXhqXOy92u31c3ne724MvVxfKzeDj4JPg06Af7AeD4OvgKDgOWPBT8HPwS/Br67fWH60/W38tQ69fW2HuBo3W+vsfL76MJg==</latexit> 0.8·0.8·0.8 0.8·0.8·0.2 0.8 + 0.2 0.2·0.8 + 0.8·0.8
  • 17. We can learn model parameters with maximum likelihood estimation. 17 1. Fix correlation probability p and learn recency weights w. ⟶ single p, vector w learned for entire dataset. 2. Grid search over p, gradient descent on w. ⟶ structure of CRU model makes it easy to compute gradients.
  • 18. The optimal correlation probability is consistent within domain but differs between domains. 18 Meanper-setlikelihood x Baseline model (flat, no structure). Similar to [Anderson+ 14] CRU model.
  • 19. Learned weights tend to decrease monotonically, which agrees with recency bias in the data. 19 100 101 102 index 10 3 10 2 10 1 Recencyweightw contact-prim-school 100 101 102 index 10 3 10 2 Recencyweightw email-Eu-core 100 101 102 index 10 3 10 2 Recencyweightw coauth-Geology 100 101 102 index 10 2 Recencyweightw tags-mathoverflow Correlation probability p.
  • 20. Asymptotic behavior depends on the recency weight model parameters. 20 Theorem. Let Wj = Pj i=1 wi. If W1 < 1, the model tips with probability 1. If W1 = 1, then every pair occurs infinitely often.<latexit sha1_base64="aOBbWA3HiGqepuD2cTVGzYijJ6s=">AAAH3HicfVXfb9s2ELa7re60H03Xhz3shV1iYChsx0qRpRlmwNiKbAFSLJvdpkDkepR0sjiTlEZStV1Cb3sb9rr/Y3/O/psdbWexnGwCbFHkfffx7r4jw5wzbbrdv+t33nn3vbuNe+97H3z40cf3dx588lJnhYrgRZTxTL0KqQbOJLwwzHB4lSugIuRwEU6/desXb0BplsmhWeQwEnQiWcIianBqvPNXIDMmY5CGnIEhexdj+0tJeiTQhRhb1vPL1zgxG7O9DgkC7zRZmgRMJmZRkq/JarTXIiYFIrIYODEs12TGTEpylYU0ZJyZBfFvw/cqeEkAt7ogOWWKZFFUKE1wmUlmgC9IlhiQHW+8s9vtdJcPuTnw14Pd2vo5Hz+4+zCIs6gQGGTEqdaXfjc3I0uVYRGH0gsKDTmNpnQClziUVIAe2WVuS9LEmZgkmcIfJmk5621C0I+ii4oXa2hYcKrm1dkwy6a4okvPq3Ka5OnIMpkXGGC0okwKTGRGXMlIzBREBjNQ5TVs+rYlWQSJolGLCi2oSVs5c/tsmenb9kTRPG0JOoUIOL+eWu3KwTkLFVULF0I2060QPU9UVshYt3JqDCipEW8Um7d0SnPQrYSZVkR55L5jh8l5ZgRVU/1fXjsCDMXFZeY4GDsssJA/QVxaBfGjp91HIUfeTQvUwkQByNIuX85mlqIItmxCXkBp3f+GhdckqTG5/mp/38C8ow36hnmUUjmBTpSJ/V8L0E77et//8vD44Hhfg2CouxA7QrSdbtsuiDaT7RAbCdTS7snR7urlBS6hFBvN5ccLJhw1zgP8DBysD1IXCvpxxlEAfWyzCJuiFyjgdH6FzXDzVRFdDv2RdYVzAqhU+Xw4oNIlV4GEGQYgqIxtkFDB+CKGhBbclDbQydW4KhKdOFWUXnOTTGMFIe51O8etSDAkRVlwlDwSmLlOnItqkOg7kGbuXPVXYKsfX2KvHY7K7aCeATaZgsFChBk/wZDsyosu7Q/Pz0orHYVgpRWlZbjdYADmNmOciLch4Rqy5nCAQRFiOU3hSno7wTbD4OS5S8kVwdCvpM+G89Jqfk3ijFdoe4qWLgeU5yktr7f68+lW1uMJBxal7VXub1vBQms8Xqrng3BuNqssBmwikClYqcq5s0EobLCaL2/IQpzh0R/fhlgvlFWKx8E8pOoSxRekYTa3wRv33/SCVBUcSApskho8XY8Oc0OaZIiHPI1MQTlBmBdM8YTodg4OYd4kV0+TPMNri8oISAhmhv3rbAmSEb1Mo7eianqELB20ux0fRPMKPUgzhdlhckIyubxWOCSGaBaDQ2zEteuX/zrBC+DJ/zpRy0iWXkqXBbxG/O1L4+bg5UHHx+39eLDb/2Z9odyrfVb7vPZFza8d1fq172vntRe1qP5pvVc/qX/XeN34rfF744+V6Z36GvOwVnkaf/4DFizBCg==</latexit><latexit sha1_base64="aOBbWA3HiGqepuD2cTVGzYijJ6s=">AAAH3HicfVXfb9s2ELa7re60H03Xhz3shV1iYChsx0qRpRlmwNiKbAFSLJvdpkDkepR0sjiTlEZStV1Cb3sb9rr/Y3/O/psdbWexnGwCbFHkfffx7r4jw5wzbbrdv+t33nn3vbuNe+97H3z40cf3dx588lJnhYrgRZTxTL0KqQbOJLwwzHB4lSugIuRwEU6/desXb0BplsmhWeQwEnQiWcIianBqvPNXIDMmY5CGnIEhexdj+0tJeiTQhRhb1vPL1zgxG7O9DgkC7zRZmgRMJmZRkq/JarTXIiYFIrIYODEs12TGTEpylYU0ZJyZBfFvw/cqeEkAt7ogOWWKZFFUKE1wmUlmgC9IlhiQHW+8s9vtdJcPuTnw14Pd2vo5Hz+4+zCIs6gQGGTEqdaXfjc3I0uVYRGH0gsKDTmNpnQClziUVIAe2WVuS9LEmZgkmcIfJmk5621C0I+ii4oXa2hYcKrm1dkwy6a4okvPq3Ka5OnIMpkXGGC0okwKTGRGXMlIzBREBjNQ5TVs+rYlWQSJolGLCi2oSVs5c/tsmenb9kTRPG0JOoUIOL+eWu3KwTkLFVULF0I2060QPU9UVshYt3JqDCipEW8Um7d0SnPQrYSZVkR55L5jh8l5ZgRVU/1fXjsCDMXFZeY4GDsssJA/QVxaBfGjp91HIUfeTQvUwkQByNIuX85mlqIItmxCXkBp3f+GhdckqTG5/mp/38C8ow36hnmUUjmBTpSJ/V8L0E77et//8vD44Hhfg2CouxA7QrSdbtsuiDaT7RAbCdTS7snR7urlBS6hFBvN5ccLJhw1zgP8DBysD1IXCvpxxlEAfWyzCJuiFyjgdH6FzXDzVRFdDv2RdYVzAqhU+Xw4oNIlV4GEGQYgqIxtkFDB+CKGhBbclDbQydW4KhKdOFWUXnOTTGMFIe51O8etSDAkRVlwlDwSmLlOnItqkOg7kGbuXPVXYKsfX2KvHY7K7aCeATaZgsFChBk/wZDsyosu7Q/Pz0orHYVgpRWlZbjdYADmNmOciLch4Rqy5nCAQRFiOU3hSno7wTbD4OS5S8kVwdCvpM+G89Jqfk3ijFdoe4qWLgeU5yktr7f68+lW1uMJBxal7VXub1vBQms8Xqrng3BuNqssBmwikClYqcq5s0EobLCaL2/IQpzh0R/fhlgvlFWKx8E8pOoSxRekYTa3wRv33/SCVBUcSApskho8XY8Oc0OaZIiHPI1MQTlBmBdM8YTodg4OYd4kV0+TPMNri8oISAhmhv3rbAmSEb1Mo7eianqELB20ux0fRPMKPUgzhdlhckIyubxWOCSGaBaDQ2zEteuX/zrBC+DJ/zpRy0iWXkqXBbxG/O1L4+bg5UHHx+39eLDb/2Z9odyrfVb7vPZFza8d1fq172vntRe1qP5pvVc/qX/XeN34rfF744+V6Z36GvOwVnkaf/4DFizBCg==</latexit><latexit sha1_base64="aOBbWA3HiGqepuD2cTVGzYijJ6s=">AAAH3HicfVXfb9s2ELa7re60H03Xhz3shV1iYChsx0qRpRlmwNiKbAFSLJvdpkDkepR0sjiTlEZStV1Cb3sb9rr/Y3/O/psdbWexnGwCbFHkfffx7r4jw5wzbbrdv+t33nn3vbuNe+97H3z40cf3dx588lJnhYrgRZTxTL0KqQbOJLwwzHB4lSugIuRwEU6/desXb0BplsmhWeQwEnQiWcIianBqvPNXIDMmY5CGnIEhexdj+0tJeiTQhRhb1vPL1zgxG7O9DgkC7zRZmgRMJmZRkq/JarTXIiYFIrIYODEs12TGTEpylYU0ZJyZBfFvw/cqeEkAt7ogOWWKZFFUKE1wmUlmgC9IlhiQHW+8s9vtdJcPuTnw14Pd2vo5Hz+4+zCIs6gQGGTEqdaXfjc3I0uVYRGH0gsKDTmNpnQClziUVIAe2WVuS9LEmZgkmcIfJmk5621C0I+ii4oXa2hYcKrm1dkwy6a4okvPq3Ka5OnIMpkXGGC0okwKTGRGXMlIzBREBjNQ5TVs+rYlWQSJolGLCi2oSVs5c/tsmenb9kTRPG0JOoUIOL+eWu3KwTkLFVULF0I2060QPU9UVshYt3JqDCipEW8Um7d0SnPQrYSZVkR55L5jh8l5ZgRVU/1fXjsCDMXFZeY4GDsssJA/QVxaBfGjp91HIUfeTQvUwkQByNIuX85mlqIItmxCXkBp3f+GhdckqTG5/mp/38C8ow36hnmUUjmBTpSJ/V8L0E77et//8vD44Hhfg2CouxA7QrSdbtsuiDaT7RAbCdTS7snR7urlBS6hFBvN5ccLJhw1zgP8DBysD1IXCvpxxlEAfWyzCJuiFyjgdH6FzXDzVRFdDv2RdYVzAqhU+Xw4oNIlV4GEGQYgqIxtkFDB+CKGhBbclDbQydW4KhKdOFWUXnOTTGMFIe51O8etSDAkRVlwlDwSmLlOnItqkOg7kGbuXPVXYKsfX2KvHY7K7aCeATaZgsFChBk/wZDsyosu7Q/Pz0orHYVgpRWlZbjdYADmNmOciLch4Rqy5nCAQRFiOU3hSno7wTbD4OS5S8kVwdCvpM+G89Jqfk3ijFdoe4qWLgeU5yktr7f68+lW1uMJBxal7VXub1vBQms8Xqrng3BuNqssBmwikClYqcq5s0EobLCaL2/IQpzh0R/fhlgvlFWKx8E8pOoSxRekYTa3wRv33/SCVBUcSApskho8XY8Oc0OaZIiHPI1MQTlBmBdM8YTodg4OYd4kV0+TPMNri8oISAhmhv3rbAmSEb1Mo7eianqELB20ux0fRPMKPUgzhdlhckIyubxWOCSGaBaDQ2zEteuX/zrBC+DJ/zpRy0iWXkqXBbxG/O1L4+bg5UHHx+39eLDb/2Z9odyrfVb7vPZFza8d1fq172vntRe1qP5pvVc/qX/XeN34rfF744+V6Z36GvOwVnkaf/4DFizBCg==</latexit><latexit sha1_base64="aOBbWA3HiGqepuD2cTVGzYijJ6s=">AAAH3HicfVXfb9s2ELa7re60H03Xhz3shV1iYChsx0qRpRlmwNiKbAFSLJvdpkDkepR0sjiTlEZStV1Cb3sb9rr/Y3/O/psdbWexnGwCbFHkfffx7r4jw5wzbbrdv+t33nn3vbuNe+97H3z40cf3dx588lJnhYrgRZTxTL0KqQbOJLwwzHB4lSugIuRwEU6/desXb0BplsmhWeQwEnQiWcIianBqvPNXIDMmY5CGnIEhexdj+0tJeiTQhRhb1vPL1zgxG7O9DgkC7zRZmgRMJmZRkq/JarTXIiYFIrIYODEs12TGTEpylYU0ZJyZBfFvw/cqeEkAt7ogOWWKZFFUKE1wmUlmgC9IlhiQHW+8s9vtdJcPuTnw14Pd2vo5Hz+4+zCIs6gQGGTEqdaXfjc3I0uVYRGH0gsKDTmNpnQClziUVIAe2WVuS9LEmZgkmcIfJmk5621C0I+ii4oXa2hYcKrm1dkwy6a4okvPq3Ka5OnIMpkXGGC0okwKTGRGXMlIzBREBjNQ5TVs+rYlWQSJolGLCi2oSVs5c/tsmenb9kTRPG0JOoUIOL+eWu3KwTkLFVULF0I2060QPU9UVshYt3JqDCipEW8Um7d0SnPQrYSZVkR55L5jh8l5ZgRVU/1fXjsCDMXFZeY4GDsssJA/QVxaBfGjp91HIUfeTQvUwkQByNIuX85mlqIItmxCXkBp3f+GhdckqTG5/mp/38C8ow36hnmUUjmBTpSJ/V8L0E77et//8vD44Hhfg2CouxA7QrSdbtsuiDaT7RAbCdTS7snR7urlBS6hFBvN5ccLJhw1zgP8DBysD1IXCvpxxlEAfWyzCJuiFyjgdH6FzXDzVRFdDv2RdYVzAqhU+Xw4oNIlV4GEGQYgqIxtkFDB+CKGhBbclDbQydW4KhKdOFWUXnOTTGMFIe51O8etSDAkRVlwlDwSmLlOnItqkOg7kGbuXPVXYKsfX2KvHY7K7aCeATaZgsFChBk/wZDsyosu7Q/Pz0orHYVgpRWlZbjdYADmNmOciLch4Rqy5nCAQRFiOU3hSno7wTbD4OS5S8kVwdCvpM+G89Jqfk3ijFdoe4qWLgeU5yktr7f68+lW1uMJBxal7VXub1vBQms8Xqrng3BuNqssBmwikClYqcq5s0EobLCaL2/IQpzh0R/fhlgvlFWKx8E8pOoSxRekYTa3wRv33/SCVBUcSApskho8XY8Oc0OaZIiHPI1MQTlBmBdM8YTodg4OYd4kV0+TPMNri8oISAhmhv3rbAmSEb1Mo7eianqELB20ux0fRPMKPUgzhdlhckIyubxWOCSGaBaDQ2zEteuX/zrBC+DJ/zpRy0iWXkqXBbxG/O1L4+bg5UHHx+39eLDb/2Z9odyrfVb7vPZFza8d1fq172vntRe1qP5pvVc/qX/XeN34rfF744+V6Z36GvOwVnkaf/4DFizBCg==</latexit> We say that the model tips if after some point, only one set appears forever more. (Similar flavor of result to single-item sequence models [Anderson+ 14].)
  • 21. Recap on Set Prediction #1. Individuals repeating interactions. 21 1. The data exhibits complex repetition patterns. 2. Correlated Repeated Unions (CRU) is a model for repeat structure. 3. Optimal correlation probabilities are consistent within domain but different across domains. 4. Optimal weights look the same across domains—fat tails. 5. Can analyze the asymptotic behavior of the model. {a, b, c}, {a, b}, {c, d, e, f}, {a, c}, {c}, {a, b, c}, {e, g, h}, {h}, … {a, b}, {a, x}, {a, y}, {a}, {a}, {a}, {z}, {a, b, x, y, z}, … {j}, {j, k, l}, {a, j}, {a}, {a, k}, {a, j, k, l}, {j, k, l}, {j, k, l}, {j, k}… Code. bit.ly/SoS-code Data. bit.ly/SoS-data
  • 22. 22 Set Prediction #2. Subset choice models. Given a slate of alternatives, how do people choose a subset of the alternatives? What to buy after browsing Amazon? How to construct a playlist on Spotify? A discrete choice model for subset selection. Benson, Kumar, & Tomkins. WSDM, 2018.
  • 23. Given some slate of alternatives, how do people make choices? 23 • If choosing just one thing (buying a car, picking a restaurant, etc.), there are many good ML techniques (logistic regression, deep nets, etc.) • If choosing a subset of the alternatives (what to buy after browsing Amazon, constructing a playlist on Spotify, etc.), there are not many tools. • We develop a simple and interpretable model for subset selection.
  • 24. Our discrete choice model for subset selection as illustrated through choosing party snacks. 24 Large set of snack options and want to choose a few. {tortilla chips, potato chips, cookies, pretzels, guacamole, celery, nut mix, hummus, meatballs, cupcakes, pigs in blankets, cupcakes, potato skins, chicken wings, taquitos, …} Model 1. Independent choices. Easy computation, but not realistic. Model 2. All subsets as options. Harder computation, but more modeling power Our model. Some“special subsets”as options + independent choices. Interpolate between computation and modeling power. healthyfoodtribe.comtoday.com
  • 25. Our model is based on a generalization of classical discrete choice and random utility maximization theory. 25 Discrete Choice Methods with Simulation,Train,2009 (https://eml.berkeley.edu/books/choice2.html) • Observe choice set C with items 1, …, c. Choose one element. • Random utility of ith item: Ui = Vi + ei Vi is base utility, ei is i.i.d. Gumbel distributed error • If choosing the item with largest random utility… • (Logistic regression assumes for feature vector x of sample) Pr[select item i | C] = eVi P j2C e Vj <latexit sha1_base64="MHw/TabkLT3RqXx2r462XmZzKDE=">AAAHeHicfVVdb9s2FFW7Lem0j6br417Yxca2wnbsFFmaFQGMpShWoMGy2U0LmF5GSVcWa5LSSKqxS+hX7df0dfsXe9ql7SyRk42AJOrynnt4Lw/JqBDc2G73/a3bH3z40cbmnY/DTz797PO7W/e+ODV5qWN4Geci168jZkBwBS8ttwJeFxqYjAS8iqZHfvzVW9CG52po5wWMJZsonvKYWTSdbR2f6BGiIbaEW5CkwRukQZ9QxFj6BPtHjTFpHBKaahY7+NWdnvGqctSU8sy9IZQrclQtzG+qqnG2td3tdBeNXO/0Vp3tYNVOzu5t3KdJHpcSlI0FM2bU6xZ27Ji2PBZQhbQ0ULB4yiYwwq5iEszYLfKuSBMtCUlzjY+yZGENr0IwjmbzWhRnWVQKpmd1a5TnUxwxVRjWOW36eOy4KkoLKl5SpqUgNie+nCThGmsn5qTOa/n0XUvxGHzZWkwayWzWKrifZ8tO37UnmhVZS7IpxCDEpWk5Kw8XPNJMz30K+blpRRh5ovNSJaZVMGtBK4N4q/msZTJWgGml3LZiJmL/n3hMIXIrmZ6a/4rakWAZDi4qJ8C6YZla+AWSymlIHjzuPogE8l71sBlMNICq3OLjfc4zlM6aTyRKqJx/X/EImySztjDf7+xYmHWMxdgwizOmJtCJc7nzewnG69Ls9L7bO9g92DEgOUoxQrXK9jm3Wdsn0eaqHaHIQS/8Hu1vLz8h9QVluAl8fUI6EXnEBMVf6mF9UKbU0E9ygQLo4xaI8wQOqQbBZhfYHCdfF9Fo2Bs7v3BeALVVPhkOmPLF1aDgHBOQTCWOpkxyMU8gZaWwfq+kF/26SEzqVVGFzatkBlcQksNu56AVS46kKAuBkkcCOzOpD1FPEmNTZWc+VH8JdubhCPfa3rhaT+op4CbTMJjLKBfPMCW3jGIq99Pxi8opTyF55WTlOE6XDsDe5IyGZB0SrSArDg8YlBEupy39kt5MsM4weHbsS3JBMOzVyueiWeWMuCTxzku0e46evgZMFBmrLqf62/O1qicTATzO2sva3zSCC23weKmfD9KHubrKcsAnEpnoUlU+nKORdHRpr67JQr7AYzm5CbEaqOoUD+ksYnqE4qNZlM8cfevfzZBmuhRAMuCTzOLpur9XWNIkwwwIi23JBEFYSKd4QnQ7u3swa5KL1iRP8UphKgYSgT3H/et9CZIRsyhjuKRqhoQsArS7nR7I5gV6kOUaq8PVhOSKoKiIgNQSwxPwiCt5bfeqf4PgBfDof4PoRSaLKJWvAl4jvfVL43rndLfTw+n9vLvd/2F1odwJvgy+Cr4JesF+0A9+DE6Cl0Ec/BG8D/4M/tr4e5Nsfr357dL19q0V5n5Qa5u7/wBGwJ7r</latexit><latexit sha1_base64="MHw/TabkLT3RqXx2r462XmZzKDE=">AAAHeHicfVVdb9s2FFW7Lem0j6br417Yxca2wnbsFFmaFQGMpShWoMGy2U0LmF5GSVcWa5LSSKqxS+hX7df0dfsXe9ql7SyRk42AJOrynnt4Lw/JqBDc2G73/a3bH3z40cbmnY/DTz797PO7W/e+ODV5qWN4Geci168jZkBwBS8ttwJeFxqYjAS8iqZHfvzVW9CG52po5wWMJZsonvKYWTSdbR2f6BGiIbaEW5CkwRukQZ9QxFj6BPtHjTFpHBKaahY7+NWdnvGqctSU8sy9IZQrclQtzG+qqnG2td3tdBeNXO/0Vp3tYNVOzu5t3KdJHpcSlI0FM2bU6xZ27Ji2PBZQhbQ0ULB4yiYwwq5iEszYLfKuSBMtCUlzjY+yZGENr0IwjmbzWhRnWVQKpmd1a5TnUxwxVRjWOW36eOy4KkoLKl5SpqUgNie+nCThGmsn5qTOa/n0XUvxGHzZWkwayWzWKrifZ8tO37UnmhVZS7IpxCDEpWk5Kw8XPNJMz30K+blpRRh5ovNSJaZVMGtBK4N4q/msZTJWgGml3LZiJmL/n3hMIXIrmZ6a/4rakWAZDi4qJ8C6YZla+AWSymlIHjzuPogE8l71sBlMNICq3OLjfc4zlM6aTyRKqJx/X/EImySztjDf7+xYmHWMxdgwizOmJtCJc7nzewnG69Ls9L7bO9g92DEgOUoxQrXK9jm3Wdsn0eaqHaHIQS/8Hu1vLz8h9QVluAl8fUI6EXnEBMVf6mF9UKbU0E9ygQLo4xaI8wQOqQbBZhfYHCdfF9Fo2Bs7v3BeALVVPhkOmPLF1aDgHBOQTCWOpkxyMU8gZaWwfq+kF/26SEzqVVGFzatkBlcQksNu56AVS46kKAuBkkcCOzOpD1FPEmNTZWc+VH8JdubhCPfa3rhaT+op4CbTMJjLKBfPMCW3jGIq99Pxi8opTyF55WTlOE6XDsDe5IyGZB0SrSArDg8YlBEupy39kt5MsM4weHbsS3JBMOzVyueiWeWMuCTxzku0e46evgZMFBmrLqf62/O1qicTATzO2sva3zSCC23weKmfD9KHubrKcsAnEpnoUlU+nKORdHRpr67JQr7AYzm5CbEaqOoUD+ksYnqE4qNZlM8cfevfzZBmuhRAMuCTzOLpur9XWNIkwwwIi23JBEFYSKd4QnQ7u3swa5KL1iRP8UphKgYSgT3H/et9CZIRsyhjuKRqhoQsArS7nR7I5gV6kOUaq8PVhOSKoKiIgNQSwxPwiCt5bfeqf4PgBfDof4PoRSaLKJWvAl4jvfVL43rndLfTw+n9vLvd/2F1odwJvgy+Cr4JesF+0A9+DE6Cl0Ec/BG8D/4M/tr4e5Nsfr357dL19q0V5n5Qa5u7/wBGwJ7r</latexit><latexit sha1_base64="MHw/TabkLT3RqXx2r462XmZzKDE=">AAAHeHicfVVdb9s2FFW7Lem0j6br417Yxca2wnbsFFmaFQGMpShWoMGy2U0LmF5GSVcWa5LSSKqxS+hX7df0dfsXe9ql7SyRk42AJOrynnt4Lw/JqBDc2G73/a3bH3z40cbmnY/DTz797PO7W/e+ODV5qWN4Geci168jZkBwBS8ttwJeFxqYjAS8iqZHfvzVW9CG52po5wWMJZsonvKYWTSdbR2f6BGiIbaEW5CkwRukQZ9QxFj6BPtHjTFpHBKaahY7+NWdnvGqctSU8sy9IZQrclQtzG+qqnG2td3tdBeNXO/0Vp3tYNVOzu5t3KdJHpcSlI0FM2bU6xZ27Ji2PBZQhbQ0ULB4yiYwwq5iEszYLfKuSBMtCUlzjY+yZGENr0IwjmbzWhRnWVQKpmd1a5TnUxwxVRjWOW36eOy4KkoLKl5SpqUgNie+nCThGmsn5qTOa/n0XUvxGHzZWkwayWzWKrifZ8tO37UnmhVZS7IpxCDEpWk5Kw8XPNJMz30K+blpRRh5ovNSJaZVMGtBK4N4q/msZTJWgGml3LZiJmL/n3hMIXIrmZ6a/4rakWAZDi4qJ8C6YZla+AWSymlIHjzuPogE8l71sBlMNICq3OLjfc4zlM6aTyRKqJx/X/EImySztjDf7+xYmHWMxdgwizOmJtCJc7nzewnG69Ls9L7bO9g92DEgOUoxQrXK9jm3Wdsn0eaqHaHIQS/8Hu1vLz8h9QVluAl8fUI6EXnEBMVf6mF9UKbU0E9ygQLo4xaI8wQOqQbBZhfYHCdfF9Fo2Bs7v3BeALVVPhkOmPLF1aDgHBOQTCWOpkxyMU8gZaWwfq+kF/26SEzqVVGFzatkBlcQksNu56AVS46kKAuBkkcCOzOpD1FPEmNTZWc+VH8JdubhCPfa3rhaT+op4CbTMJjLKBfPMCW3jGIq99Pxi8opTyF55WTlOE6XDsDe5IyGZB0SrSArDg8YlBEupy39kt5MsM4weHbsS3JBMOzVyueiWeWMuCTxzku0e46evgZMFBmrLqf62/O1qicTATzO2sva3zSCC23weKmfD9KHubrKcsAnEpnoUlU+nKORdHRpr67JQr7AYzm5CbEaqOoUD+ksYnqE4qNZlM8cfevfzZBmuhRAMuCTzOLpur9XWNIkwwwIi23JBEFYSKd4QnQ7u3swa5KL1iRP8UphKgYSgT3H/et9CZIRsyhjuKRqhoQsArS7nR7I5gV6kOUaq8PVhOSKoKiIgNQSwxPwiCt5bfeqf4PgBfDof4PoRSaLKJWvAl4jvfVL43rndLfTw+n9vLvd/2F1odwJvgy+Cr4JesF+0A9+DE6Cl0Ec/BG8D/4M/tr4e5Nsfr357dL19q0V5n5Qa5u7/wBGwJ7r</latexit><latexit sha1_base64="MHw/TabkLT3RqXx2r462XmZzKDE=">AAAHeHicfVVdb9s2FFW7Lem0j6br417Yxca2wnbsFFmaFQGMpShWoMGy2U0LmF5GSVcWa5LSSKqxS+hX7df0dfsXe9ql7SyRk42AJOrynnt4Lw/JqBDc2G73/a3bH3z40cbmnY/DTz797PO7W/e+ODV5qWN4Geci168jZkBwBS8ttwJeFxqYjAS8iqZHfvzVW9CG52po5wWMJZsonvKYWTSdbR2f6BGiIbaEW5CkwRukQZ9QxFj6BPtHjTFpHBKaahY7+NWdnvGqctSU8sy9IZQrclQtzG+qqnG2td3tdBeNXO/0Vp3tYNVOzu5t3KdJHpcSlI0FM2bU6xZ27Ji2PBZQhbQ0ULB4yiYwwq5iEszYLfKuSBMtCUlzjY+yZGENr0IwjmbzWhRnWVQKpmd1a5TnUxwxVRjWOW36eOy4KkoLKl5SpqUgNie+nCThGmsn5qTOa/n0XUvxGHzZWkwayWzWKrifZ8tO37UnmhVZS7IpxCDEpWk5Kw8XPNJMz30K+blpRRh5ovNSJaZVMGtBK4N4q/msZTJWgGml3LZiJmL/n3hMIXIrmZ6a/4rakWAZDi4qJ8C6YZla+AWSymlIHjzuPogE8l71sBlMNICq3OLjfc4zlM6aTyRKqJx/X/EImySztjDf7+xYmHWMxdgwizOmJtCJc7nzewnG69Ls9L7bO9g92DEgOUoxQrXK9jm3Wdsn0eaqHaHIQS/8Hu1vLz8h9QVluAl8fUI6EXnEBMVf6mF9UKbU0E9ygQLo4xaI8wQOqQbBZhfYHCdfF9Fo2Bs7v3BeALVVPhkOmPLF1aDgHBOQTCWOpkxyMU8gZaWwfq+kF/26SEzqVVGFzatkBlcQksNu56AVS46kKAuBkkcCOzOpD1FPEmNTZWc+VH8JdubhCPfa3rhaT+op4CbTMJjLKBfPMCW3jGIq99Pxi8opTyF55WTlOE6XDsDe5IyGZB0SrSArDg8YlBEupy39kt5MsM4weHbsS3JBMOzVyueiWeWMuCTxzku0e46evgZMFBmrLqf62/O1qicTATzO2sva3zSCC23weKmfD9KHubrKcsAnEpnoUlU+nKORdHRpr67JQr7AYzm5CbEaqOoUD+ksYnqE4qNZlM8cfevfzZBmuhRAMuCTzOLpur9XWNIkwwwIi23JBEFYSKd4QnQ7u3swa5KL1iRP8UphKgYSgT3H/et9CZIRsyhjuKRqhoQsArS7nR7I5gV6kOUaq8PVhOSKoKiIgNQSwxPwiCt5bfeqf4PgBfDof4PoRSaLKJWvAl4jvfVL43rndLfTw+n9vLvd/2F1odwJvgy+Cr4JesF+0A9+DE6Cl0Ec/BG8D/4M/tr4e5Nsfr357dL19q0V5n5Qa5u7/wBGwJ7r</latexit> Vi = T i x<latexit sha1_base64="WMg3r0ygm8YS1z2N1nlA4xcLFbY=">AAAHPXicfVXdbts2FFbbzeu0v7S93A271MBQyI6dIkszIICxFcUKtFg2O2mByM0o6UgiTFIqSTVyCb3Kbre32HPsAXY37Ha3O7SdxXKyEbBFkec73/n5REYlZ9oMBr/fuHnrvfc7H9z+0P/o408+/Wzrzt0TXVQqhuO44IV6FVENnEk4NsxweFUqoCLi8DKafev2X74FpVkhJ2ZewlTQTLKUxdTg0tnW3QcnZ4wckjACQ8/Y60n94Gxre9AfLAa5OhmuJtveahyd3encC5MirgRIE3Oq9elwUJqppcqwmEPjh5WGksYzmsEpTiUVoKd2EXxDuriSkLRQ+JOGLFb9dQj6UXTe8mINjSpOVd1ejYpihju68f02p0kfTy2TZWVAxkvKtOLEFMTVhCRMQWz4nLR5DZu9CySLIVU0DqjQgpo8KJmLMzCzd71M0TIPBJ1BDJxfLi2jcnDOIkXV3KVQnOsgQs+ZKiqZ6KCkxoCSGvFGsTrQOS1BBykzQUx57N4Thyl5YQRVM/1fXvsCW4ebi8pxMHZSpQZ+hKSxCpL7jwf3I4686xYmh0wByMYuHs7mPGcGNmwiXkFj3f+ahd8luTGl/npnx0Dd1wZ9Qx3nVGbQjwux86YC7cSld4Zf7R3sHuxoEAw1GKHkRO+cmbznkugx2YtQqaAWdo/2t5cPP3QFpahkVx8/zHgRUR7ia+hgI5C6UjBKCo4CGKGO4yKBw1ABp/UFtsDg2yI6nQyn1jXOCaDV5aPJmEpXXAUSzjEBQWViw5QKxucJpLTiprGhTi/mbZHo1Kmi8bvrZBo7CMnhoH8QxIIhKcqCo+SRwNQ6dS7aSaLvUJrauRotwVY/PMVvbW/abCb1BPAjUzCei6jgTzElu/SiG/v9i+eNlY5CsMaKxjIMNxyDuc4YF5JNSLSCrDgcYFxF2E5TuZZeT7DJMH76wpXkgmAybJXPRnVjNb8kccZLtH2Glq4GlJc5bS5D/enZRtWTjAOL896y9tftYKM1Hi/t80E4N+tdFmOWCWQKl6py7mwYCRsu15srshDP8WxNrkOsNpo2xcOwjqg6RfGFeVTUNnzr/rt+mKuKA8mBZbnB03V/rzSkSyY5EBqbinKCMD+c4Qkx6O/uQd0lF6NLnuC9QGUMBA/tc/x+nS1BMqIXZfSXVF2fkIWD3qA/BNG9QI/zQmF1mMxIIQmKinBIDdEsAYdYy2t72PzrBC+AR//rRC0yWXhpXBXwGhluXhpXJye7/SGG98Pu9uib1YVy2/vc+8L70ht6+97I+8478o692Ku9n71fvF87v3X+6PzZ+WtpevPGCnPPa43O3/8AAp+L5g==</latexit><latexit sha1_base64="WMg3r0ygm8YS1z2N1nlA4xcLFbY=">AAAHPXicfVXdbts2FFbbzeu0v7S93A271MBQyI6dIkszIICxFcUKtFg2O2mByM0o6UgiTFIqSTVyCb3Kbre32HPsAXY37Ha3O7SdxXKyEbBFkec73/n5REYlZ9oMBr/fuHnrvfc7H9z+0P/o408+/Wzrzt0TXVQqhuO44IV6FVENnEk4NsxweFUqoCLi8DKafev2X74FpVkhJ2ZewlTQTLKUxdTg0tnW3QcnZ4wckjACQ8/Y60n94Gxre9AfLAa5OhmuJtveahyd3encC5MirgRIE3Oq9elwUJqppcqwmEPjh5WGksYzmsEpTiUVoKd2EXxDuriSkLRQ+JOGLFb9dQj6UXTe8mINjSpOVd1ejYpihju68f02p0kfTy2TZWVAxkvKtOLEFMTVhCRMQWz4nLR5DZu9CySLIVU0DqjQgpo8KJmLMzCzd71M0TIPBJ1BDJxfLi2jcnDOIkXV3KVQnOsgQs+ZKiqZ6KCkxoCSGvFGsTrQOS1BBykzQUx57N4Thyl5YQRVM/1fXvsCW4ebi8pxMHZSpQZ+hKSxCpL7jwf3I4686xYmh0wByMYuHs7mPGcGNmwiXkFj3f+ahd8luTGl/npnx0Dd1wZ9Qx3nVGbQjwux86YC7cSld4Zf7R3sHuxoEAw1GKHkRO+cmbznkugx2YtQqaAWdo/2t5cPP3QFpahkVx8/zHgRUR7ia+hgI5C6UjBKCo4CGKGO4yKBw1ABp/UFtsDg2yI6nQyn1jXOCaDV5aPJmEpXXAUSzjEBQWViw5QKxucJpLTiprGhTi/mbZHo1Kmi8bvrZBo7CMnhoH8QxIIhKcqCo+SRwNQ6dS7aSaLvUJrauRotwVY/PMVvbW/abCb1BPAjUzCei6jgTzElu/SiG/v9i+eNlY5CsMaKxjIMNxyDuc4YF5JNSLSCrDgcYFxF2E5TuZZeT7DJMH76wpXkgmAybJXPRnVjNb8kccZLtH2Glq4GlJc5bS5D/enZRtWTjAOL896y9tftYKM1Hi/t80E4N+tdFmOWCWQKl6py7mwYCRsu15srshDP8WxNrkOsNpo2xcOwjqg6RfGFeVTUNnzr/rt+mKuKA8mBZbnB03V/rzSkSyY5EBqbinKCMD+c4Qkx6O/uQd0lF6NLnuC9QGUMBA/tc/x+nS1BMqIXZfSXVF2fkIWD3qA/BNG9QI/zQmF1mMxIIQmKinBIDdEsAYdYy2t72PzrBC+AR//rRC0yWXhpXBXwGhluXhpXJye7/SGG98Pu9uib1YVy2/vc+8L70ht6+97I+8478o692Ku9n71fvF87v3X+6PzZ+WtpevPGCnPPa43O3/8AAp+L5g==</latexit><latexit sha1_base64="WMg3r0ygm8YS1z2N1nlA4xcLFbY=">AAAHPXicfVXdbts2FFbbzeu0v7S93A271MBQyI6dIkszIICxFcUKtFg2O2mByM0o6UgiTFIqSTVyCb3Kbre32HPsAXY37Ha3O7SdxXKyEbBFkec73/n5REYlZ9oMBr/fuHnrvfc7H9z+0P/o408+/Wzrzt0TXVQqhuO44IV6FVENnEk4NsxweFUqoCLi8DKafev2X74FpVkhJ2ZewlTQTLKUxdTg0tnW3QcnZ4wckjACQ8/Y60n94Gxre9AfLAa5OhmuJtveahyd3encC5MirgRIE3Oq9elwUJqppcqwmEPjh5WGksYzmsEpTiUVoKd2EXxDuriSkLRQ+JOGLFb9dQj6UXTe8mINjSpOVd1ejYpihju68f02p0kfTy2TZWVAxkvKtOLEFMTVhCRMQWz4nLR5DZu9CySLIVU0DqjQgpo8KJmLMzCzd71M0TIPBJ1BDJxfLi2jcnDOIkXV3KVQnOsgQs+ZKiqZ6KCkxoCSGvFGsTrQOS1BBykzQUx57N4Thyl5YQRVM/1fXvsCW4ebi8pxMHZSpQZ+hKSxCpL7jwf3I4686xYmh0wByMYuHs7mPGcGNmwiXkFj3f+ahd8luTGl/npnx0Dd1wZ9Qx3nVGbQjwux86YC7cSld4Zf7R3sHuxoEAw1GKHkRO+cmbznkugx2YtQqaAWdo/2t5cPP3QFpahkVx8/zHgRUR7ia+hgI5C6UjBKCo4CGKGO4yKBw1ABp/UFtsDg2yI6nQyn1jXOCaDV5aPJmEpXXAUSzjEBQWViw5QKxucJpLTiprGhTi/mbZHo1Kmi8bvrZBo7CMnhoH8QxIIhKcqCo+SRwNQ6dS7aSaLvUJrauRotwVY/PMVvbW/abCb1BPAjUzCei6jgTzElu/SiG/v9i+eNlY5CsMaKxjIMNxyDuc4YF5JNSLSCrDgcYFxF2E5TuZZeT7DJMH76wpXkgmAybJXPRnVjNb8kccZLtH2Glq4GlJc5bS5D/enZRtWTjAOL896y9tftYKM1Hi/t80E4N+tdFmOWCWQKl6py7mwYCRsu15srshDP8WxNrkOsNpo2xcOwjqg6RfGFeVTUNnzr/rt+mKuKA8mBZbnB03V/rzSkSyY5EBqbinKCMD+c4Qkx6O/uQd0lF6NLnuC9QGUMBA/tc/x+nS1BMqIXZfSXVF2fkIWD3qA/BNG9QI/zQmF1mMxIIQmKinBIDdEsAYdYy2t72PzrBC+AR//rRC0yWXhpXBXwGhluXhpXJye7/SGG98Pu9uib1YVy2/vc+8L70ht6+97I+8478o692Ku9n71fvF87v3X+6PzZ+WtpevPGCnPPa43O3/8AAp+L5g==</latexit><latexit sha1_base64="WMg3r0ygm8YS1z2N1nlA4xcLFbY=">AAAHPXicfVXdbts2FFbbzeu0v7S93A271MBQyI6dIkszIICxFcUKtFg2O2mByM0o6UgiTFIqSTVyCb3Kbre32HPsAXY37Ha3O7SdxXKyEbBFkec73/n5REYlZ9oMBr/fuHnrvfc7H9z+0P/o408+/Wzrzt0TXVQqhuO44IV6FVENnEk4NsxweFUqoCLi8DKafev2X74FpVkhJ2ZewlTQTLKUxdTg0tnW3QcnZ4wckjACQ8/Y60n94Gxre9AfLAa5OhmuJtveahyd3encC5MirgRIE3Oq9elwUJqppcqwmEPjh5WGksYzmsEpTiUVoKd2EXxDuriSkLRQ+JOGLFb9dQj6UXTe8mINjSpOVd1ejYpihju68f02p0kfTy2TZWVAxkvKtOLEFMTVhCRMQWz4nLR5DZu9CySLIVU0DqjQgpo8KJmLMzCzd71M0TIPBJ1BDJxfLi2jcnDOIkXV3KVQnOsgQs+ZKiqZ6KCkxoCSGvFGsTrQOS1BBykzQUx57N4Thyl5YQRVM/1fXvsCW4ebi8pxMHZSpQZ+hKSxCpL7jwf3I4686xYmh0wByMYuHs7mPGcGNmwiXkFj3f+ahd8luTGl/npnx0Dd1wZ9Qx3nVGbQjwux86YC7cSld4Zf7R3sHuxoEAw1GKHkRO+cmbznkugx2YtQqaAWdo/2t5cPP3QFpahkVx8/zHgRUR7ia+hgI5C6UjBKCo4CGKGO4yKBw1ABp/UFtsDg2yI6nQyn1jXOCaDV5aPJmEpXXAUSzjEBQWViw5QKxucJpLTiprGhTi/mbZHo1Kmi8bvrZBo7CMnhoH8QxIIhKcqCo+SRwNQ6dS7aSaLvUJrauRotwVY/PMVvbW/abCb1BPAjUzCei6jgTzElu/SiG/v9i+eNlY5CsMaKxjIMNxyDuc4YF5JNSLSCrDgcYFxF2E5TuZZeT7DJMH76wpXkgmAybJXPRnVjNb8kccZLtH2Glq4GlJc5bS5D/enZRtWTjAOL896y9tftYKM1Hi/t80E4N+tdFmOWCWQKl6py7mwYCRsu15srshDP8WxNrkOsNpo2xcOwjqg6RfGFeVTUNnzr/rt+mKuKA8mBZbnB03V/rzSkSyY5EBqbinKCMD+c4Qkx6O/uQd0lF6NLnuC9QGUMBA/tc/x+nS1BMqIXZfSXVF2fkIWD3qA/BNG9QI/zQmF1mMxIIQmKinBIDdEsAYdYy2t72PzrBC+AR//rRC0yWXhpXBXwGhluXhpXJye7/SGG98Pu9uib1YVy2/vc+8L70ht6+97I+8478o692Ku9n71fvF87v3X+6PzZ+WtpevPGCnPPa43O3/8AAp+L5g==</latexit>
  • 26. A basic subset choice choice model could assume set utility is additive in the elements. 26 • Observe choice set C with items 1, …, c. Choose two elements. (repeats allowed) • Random utility of (i, j) pair: Uij = Vi + Vj + eij Vi is base utility, eij i.i.d. Gumbel distributed error • If choosing the set with largest random utility… Pr[select set {i, j} | C] = e Vi+Vj P {k,l}⇢C eVk+Vl <latexit sha1_base64="k8hNq795y+cv+adMlMxth/n2hx8=">AAAHlXicfVVdb9s2FFW6rem0r3R92MNe2CUGhk527BRZmhUBgiUIVqBFszlJC4ReRklXFmNS0kiqsUvwP+51f2Sv26XtLJaTTYAtirznHN7DSzKuBNem2/1z5d4HH350f/XBx+Enn372+RdrD78802WtEjhNSlGqtzHTIHgBp4YbAW8rBUzGAt7EowM//uYdKM3L4sRMKhhINix4xhNmsOti7fJYnSMaEkM0GLJBLY8uqdvA1nOKQEOfY/tgY0A29gjNFEss/GrPLjj5jpxdXDpnqa7lhaV2FBFBHcHP2DMduGncaBonnNsIL9bWu53u9CG3G715Yz2YP8cXD+8/ommZ1BIKkwim9XmvW5mBZcrwRIALaa2hYsmIDeEcmwWToAd2aoojLexJSVYq/BWGTHvDRQjyKDZpsFjD4lowNW72xmU5whHtwrCpabJnA8uLqjZQJDPJrBbElMR7TVKu0FgxIU1dw0fvo4In4O2MmNSSmTyquJ9nZEbv20PFqjySbAQJCHHTNZuVhwseK6YmPoXySkcxMg9VWRepjipmDKhCI94oPo50zirQUcZNlDCR+O/UYypRGsnUSP8Xa0eCYTg4dU6AsSd1ZuAXSJ1VkD5+1n0cC9RdjDA5DBVA4ez05WOucm5gKSYWNTjr/xciwhbJjan0D5ubBsYdbZAbxknOiiF0klJu/l6D9kWrN3vfb+9u7W5qkBxLNMZSlu0rbvK2T6LNi3aMOwDUNO7pzvrsFVJvKMMd4v0J6VCUMRMUP6mH7UOhawX7aSmwAPZxfyRlCntUgWDja2yJk28W0flJb2D9wvkCaKzy8UmfFd5cBQVcYQKSFamlGZNcTFLIWC2M3z3ZdbtZJDrzVeHC1qKYxhWEdK/b2Y0SyVEUy0JgyaOAGevMUzSTRG5amLGn2p+BrX5yjntte+CWkzoE3GQK+hMZl+IIU7IzFu3s61cvnS28hOTOSmc5Tpf2wdwVjB3pMiSeQ+YaHtDHcwIPrNov6d0Cywr9o1fekmuBk17DPhuPndXiRsQHz9D2BUZ6D5iocuZupvrbiyXX06EAnuTtmfd3jeBCazxemueD9DSLqyz7fChRic6qytNZGktLZ/3uVlnIl3hmp3ch5gOuKfGEjmOmzrH4aB6XY0vf+f9WSHNVCyA58GFu8HTd2a4MaZGTHAhLTM0EQVhIR3hCdDtb2zBukeunRQ7xvmFFAiQGc4X718cSFCN6amM4k2qFhEwJ2t1OD2TrGt3PS4Xu8GJIyoJgUREBGV4rPAWPWMhrvef+JcEL4On/kqhpJlMW513Aa6S3fGncbpxtdXo4vZ+31vd/nF8oD4Kvg2+Cb4NesBPsBz8Fx8FpkAR/BH8Ff68Eq1+t7q0erh7NQu+tzDGPgsaz+vofdD+nOw==</latexit><latexit sha1_base64="k8hNq795y+cv+adMlMxth/n2hx8=">AAAHlXicfVVdb9s2FFW6rem0r3R92MNe2CUGhk527BRZmhUBgiUIVqBFszlJC4ReRklXFmNS0kiqsUvwP+51f2Sv26XtLJaTTYAtirznHN7DSzKuBNem2/1z5d4HH350f/XBx+Enn372+RdrD78802WtEjhNSlGqtzHTIHgBp4YbAW8rBUzGAt7EowM//uYdKM3L4sRMKhhINix4xhNmsOti7fJYnSMaEkM0GLJBLY8uqdvA1nOKQEOfY/tgY0A29gjNFEss/GrPLjj5jpxdXDpnqa7lhaV2FBFBHcHP2DMduGncaBonnNsIL9bWu53u9CG3G715Yz2YP8cXD+8/ommZ1BIKkwim9XmvW5mBZcrwRIALaa2hYsmIDeEcmwWToAd2aoojLexJSVYq/BWGTHvDRQjyKDZpsFjD4lowNW72xmU5whHtwrCpabJnA8uLqjZQJDPJrBbElMR7TVKu0FgxIU1dw0fvo4In4O2MmNSSmTyquJ9nZEbv20PFqjySbAQJCHHTNZuVhwseK6YmPoXySkcxMg9VWRepjipmDKhCI94oPo50zirQUcZNlDCR+O/UYypRGsnUSP8Xa0eCYTg4dU6AsSd1ZuAXSJ1VkD5+1n0cC9RdjDA5DBVA4ez05WOucm5gKSYWNTjr/xciwhbJjan0D5ubBsYdbZAbxknOiiF0klJu/l6D9kWrN3vfb+9u7W5qkBxLNMZSlu0rbvK2T6LNi3aMOwDUNO7pzvrsFVJvKMMd4v0J6VCUMRMUP6mH7UOhawX7aSmwAPZxfyRlCntUgWDja2yJk28W0flJb2D9wvkCaKzy8UmfFd5cBQVcYQKSFamlGZNcTFLIWC2M3z3ZdbtZJDrzVeHC1qKYxhWEdK/b2Y0SyVEUy0JgyaOAGevMUzSTRG5amLGn2p+BrX5yjntte+CWkzoE3GQK+hMZl+IIU7IzFu3s61cvnS28hOTOSmc5Tpf2wdwVjB3pMiSeQ+YaHtDHcwIPrNov6d0Cywr9o1fekmuBk17DPhuPndXiRsQHz9D2BUZ6D5iocuZupvrbiyXX06EAnuTtmfd3jeBCazxemueD9DSLqyz7fChRic6qytNZGktLZ/3uVlnIl3hmp3ch5gOuKfGEjmOmzrH4aB6XY0vf+f9WSHNVCyA58GFu8HTd2a4MaZGTHAhLTM0EQVhIR3hCdDtb2zBukeunRQ7xvmFFAiQGc4X718cSFCN6amM4k2qFhEwJ2t1OD2TrGt3PS4Xu8GJIyoJgUREBGV4rPAWPWMhrvef+JcEL4On/kqhpJlMW513Aa6S3fGncbpxtdXo4vZ+31vd/nF8oD4Kvg2+Cb4NesBPsBz8Fx8FpkAR/BH8Ff68Eq1+t7q0erh7NQu+tzDGPgsaz+vofdD+nOw==</latexit><latexit sha1_base64="k8hNq795y+cv+adMlMxth/n2hx8=">AAAHlXicfVVdb9s2FFW6rem0r3R92MNe2CUGhk527BRZmhUBgiUIVqBFszlJC4ReRklXFmNS0kiqsUvwP+51f2Sv26XtLJaTTYAtirznHN7DSzKuBNem2/1z5d4HH350f/XBx+Enn372+RdrD78802WtEjhNSlGqtzHTIHgBp4YbAW8rBUzGAt7EowM//uYdKM3L4sRMKhhINix4xhNmsOti7fJYnSMaEkM0GLJBLY8uqdvA1nOKQEOfY/tgY0A29gjNFEss/GrPLjj5jpxdXDpnqa7lhaV2FBFBHcHP2DMduGncaBonnNsIL9bWu53u9CG3G715Yz2YP8cXD+8/ommZ1BIKkwim9XmvW5mBZcrwRIALaa2hYsmIDeEcmwWToAd2aoojLexJSVYq/BWGTHvDRQjyKDZpsFjD4lowNW72xmU5whHtwrCpabJnA8uLqjZQJDPJrBbElMR7TVKu0FgxIU1dw0fvo4In4O2MmNSSmTyquJ9nZEbv20PFqjySbAQJCHHTNZuVhwseK6YmPoXySkcxMg9VWRepjipmDKhCI94oPo50zirQUcZNlDCR+O/UYypRGsnUSP8Xa0eCYTg4dU6AsSd1ZuAXSJ1VkD5+1n0cC9RdjDA5DBVA4ez05WOucm5gKSYWNTjr/xciwhbJjan0D5ubBsYdbZAbxknOiiF0klJu/l6D9kWrN3vfb+9u7W5qkBxLNMZSlu0rbvK2T6LNi3aMOwDUNO7pzvrsFVJvKMMd4v0J6VCUMRMUP6mH7UOhawX7aSmwAPZxfyRlCntUgWDja2yJk28W0flJb2D9wvkCaKzy8UmfFd5cBQVcYQKSFamlGZNcTFLIWC2M3z3ZdbtZJDrzVeHC1qKYxhWEdK/b2Y0SyVEUy0JgyaOAGevMUzSTRG5amLGn2p+BrX5yjntte+CWkzoE3GQK+hMZl+IIU7IzFu3s61cvnS28hOTOSmc5Tpf2wdwVjB3pMiSeQ+YaHtDHcwIPrNov6d0Cywr9o1fekmuBk17DPhuPndXiRsQHz9D2BUZ6D5iocuZupvrbiyXX06EAnuTtmfd3jeBCazxemueD9DSLqyz7fChRic6qytNZGktLZ/3uVlnIl3hmp3ch5gOuKfGEjmOmzrH4aB6XY0vf+f9WSHNVCyA58GFu8HTd2a4MaZGTHAhLTM0EQVhIR3hCdDtb2zBukeunRQ7xvmFFAiQGc4X718cSFCN6amM4k2qFhEwJ2t1OD2TrGt3PS4Xu8GJIyoJgUREBGV4rPAWPWMhrvef+JcEL4On/kqhpJlMW513Aa6S3fGncbpxtdXo4vZ+31vd/nF8oD4Kvg2+Cb4NesBPsBz8Fx8FpkAR/BH8Ff68Eq1+t7q0erh7NQu+tzDGPgsaz+vofdD+nOw==</latexit><latexit sha1_base64="k8hNq795y+cv+adMlMxth/n2hx8=">AAAHlXicfVVdb9s2FFW6rem0r3R92MNe2CUGhk527BRZmhUBgiUIVqBFszlJC4ReRklXFmNS0kiqsUvwP+51f2Sv26XtLJaTTYAtirznHN7DSzKuBNem2/1z5d4HH350f/XBx+Enn372+RdrD78802WtEjhNSlGqtzHTIHgBp4YbAW8rBUzGAt7EowM//uYdKM3L4sRMKhhINix4xhNmsOti7fJYnSMaEkM0GLJBLY8uqdvA1nOKQEOfY/tgY0A29gjNFEss/GrPLjj5jpxdXDpnqa7lhaV2FBFBHcHP2DMduGncaBonnNsIL9bWu53u9CG3G715Yz2YP8cXD+8/ommZ1BIKkwim9XmvW5mBZcrwRIALaa2hYsmIDeEcmwWToAd2aoojLexJSVYq/BWGTHvDRQjyKDZpsFjD4lowNW72xmU5whHtwrCpabJnA8uLqjZQJDPJrBbElMR7TVKu0FgxIU1dw0fvo4In4O2MmNSSmTyquJ9nZEbv20PFqjySbAQJCHHTNZuVhwseK6YmPoXySkcxMg9VWRepjipmDKhCI94oPo50zirQUcZNlDCR+O/UYypRGsnUSP8Xa0eCYTg4dU6AsSd1ZuAXSJ1VkD5+1n0cC9RdjDA5DBVA4ez05WOucm5gKSYWNTjr/xciwhbJjan0D5ubBsYdbZAbxknOiiF0klJu/l6D9kWrN3vfb+9u7W5qkBxLNMZSlu0rbvK2T6LNi3aMOwDUNO7pzvrsFVJvKMMd4v0J6VCUMRMUP6mH7UOhawX7aSmwAPZxfyRlCntUgWDja2yJk28W0flJb2D9wvkCaKzy8UmfFd5cBQVcYQKSFamlGZNcTFLIWC2M3z3ZdbtZJDrzVeHC1qKYxhWEdK/b2Y0SyVEUy0JgyaOAGevMUzSTRG5amLGn2p+BrX5yjntte+CWkzoE3GQK+hMZl+IIU7IzFu3s61cvnS28hOTOSmc5Tpf2wdwVjB3pMiSeQ+YaHtDHcwIPrNov6d0Cywr9o1fekmuBk17DPhuPndXiRsQHz9D2BUZ6D5iocuZupvrbiyXX06EAnuTtmfd3jeBCazxemueD9DSLqyz7fChRic6qytNZGktLZ/3uVlnIl3hmp3ch5gOuKfGEjmOmzrH4aB6XY0vf+f9WSHNVCyA58GFu8HTd2a4MaZGTHAhLTM0EQVhIR3hCdDtb2zBukeunRQ7xvmFFAiQGc4X718cSFCN6amM4k2qFhEwJ2t1OD2TrGt3PS4Xu8GJIyoJgUREBGV4rPAWPWMhrvef+JcEL4On/kqhpJlMW513Aa6S3fGncbpxtdXo4vZ+31vd/nF8oD4Kvg2+Cb4NesBPsBz8Fx8FpkAR/BH8Ff68Eq1+t7q0erh7NQu+tzDGPgsaz+vofdD+nOw==</latexit> Pr[select set {i, j} | C, j] = eVi P k2C eVk <latexit sha1_base64="ZaJhcD7ScvxQtNfQTogu245TRXE=">AAAHg3icfVVdb9s2FFW7te60j6br417YxQaGTnbsdFmaFQEMpChaoMWy2UkDmF5GSVcWa1LSSKqxS+iv7X/sfa/bb9il7SyWk42AJOrynnt4Dy/JsBBcm273j1u3P/r4zt3GvU/8Tz/7/Iv7Ww++PNV5qSI4iXKRq7OQaRA8gxPDjYCzQgGToYC34fTIjb99D0rzPBuaeQFjySYZT3jEDJrOt86O1QjREBmiwZAmtTx4R6sm9p5RBBr6DPtHzYA03zXHpHlIaKJYZOEXe3rOq8pSXcpzOyWUZ+SoWpinVdX0z7e2u53uopHrnd6qs+2t2vH5g7sPaZxHpYTMRIJpPep1CzO2TBkeCah8WmooWDRlExhhN2MS9NguJKhICy0xSXKFT2bIwuqvQzCOYvNaFGtYWAqmZnVrmOdTHNGV79c5TfJ0bHlWlAayaEmZlIKYnDhlScwVyijmpM5r+PRDkPEInG4Bk1oykwYFd/MMzPRDe6JYkQaSTSECIa5My1k5uOChYmruUsgvdBBi5InKyyzWQcGMAZVpxBvFZ4FOWQE6SLgJIiYi9x87TCFyI5ma6v+K2pFgGA4ulBNg7LBMDPwMcWUVxI+edh+FAnnXPUwKEwWQVXbxcT4XKTew4ROKEirr3msefoukxhT6h50dA7OONhgbZlHKsgl0olzu/FaCdiWqd3rf7x3sHuxokBwLMsTCle0LbtK2S6LNs3aI9Q5q4fdkf3v58akTlOF+cPr4dCLykAmKv9TB+pDpUkE/zgUWQB93Q5THcEgVCDa7xOY4+XoRjYa9sXUL5wqgtsrHwwHLnLgKMrjABCTLYksTJrmYx5CwUhi3WZLLfr1IdOKqovJb62QaVxDiw27nIIgkR1IsC4EljwRmphMXop4kxqaZmblQ/SXY6scj3Gt742ozqeeAm0zBYC7DXLzAlOwyiq7sj29eVzZzFJJXVlaW43TpAMxNzmiINyHhCrLicIBBGeJymtIt6c0EmwyDF2+cJJcEw15NPhvOKqvFFYlzXqLtK/R0GjBRpKy6muqvrzZUjycCeJS2l9rfNIILrfF4qZ8P0oVZX2U54BOJTHRZVS6cpaG0dGmvrpWFfI0ndHwTYjVQ1Ske01nI1AiLj6ZhPrP0vXu3fJqqUgBJgU9Sg6fr/l5hSIsMUyAsMiUTBGE+neIJ0e3s7sGsRS5bizzH24VlEZAQzAXuX+dLkIzohYz+kqrlE7II0O52eiBbl+hBmitUh2cTkmcEi4oISPAS4TE4xFpe273q3yB4ATz53yBqkckiSuVUwGukt3lpXO+c7nZ6OL2fdrf7L1cXyj3vK+9r7xuv5+17fe+ld+ydeJH3u/en95f3d+NO49vGbuO7pevtWyvMQ6/WGof/AOdZoU0=</latexit><latexit sha1_base64="ZaJhcD7ScvxQtNfQTogu245TRXE=">AAAHg3icfVVdb9s2FFW7te60j6br417YxQaGTnbsdFmaFQEMpChaoMWy2UkDmF5GSVcWa1LSSKqxS+iv7X/sfa/bb9il7SyWk42AJOrynnt4Dy/JsBBcm273j1u3P/r4zt3GvU/8Tz/7/Iv7Ww++PNV5qSI4iXKRq7OQaRA8gxPDjYCzQgGToYC34fTIjb99D0rzPBuaeQFjySYZT3jEDJrOt86O1QjREBmiwZAmtTx4R6sm9p5RBBr6DPtHzYA03zXHpHlIaKJYZOEXe3rOq8pSXcpzOyWUZ+SoWpinVdX0z7e2u53uopHrnd6qs+2t2vH5g7sPaZxHpYTMRIJpPep1CzO2TBkeCah8WmooWDRlExhhN2MS9NguJKhICy0xSXKFT2bIwuqvQzCOYvNaFGtYWAqmZnVrmOdTHNGV79c5TfJ0bHlWlAayaEmZlIKYnDhlScwVyijmpM5r+PRDkPEInG4Bk1oykwYFd/MMzPRDe6JYkQaSTSECIa5My1k5uOChYmruUsgvdBBi5InKyyzWQcGMAZVpxBvFZ4FOWQE6SLgJIiYi9x87TCFyI5ma6v+K2pFgGA4ulBNg7LBMDPwMcWUVxI+edh+FAnnXPUwKEwWQVXbxcT4XKTew4ROKEirr3msefoukxhT6h50dA7OONhgbZlHKsgl0olzu/FaCdiWqd3rf7x3sHuxokBwLMsTCle0LbtK2S6LNs3aI9Q5q4fdkf3v58akTlOF+cPr4dCLykAmKv9TB+pDpUkE/zgUWQB93Q5THcEgVCDa7xOY4+XoRjYa9sXUL5wqgtsrHwwHLnLgKMrjABCTLYksTJrmYx5CwUhi3WZLLfr1IdOKqovJb62QaVxDiw27nIIgkR1IsC4EljwRmphMXop4kxqaZmblQ/SXY6scj3Gt742ozqeeAm0zBYC7DXLzAlOwyiq7sj29eVzZzFJJXVlaW43TpAMxNzmiINyHhCrLicIBBGeJymtIt6c0EmwyDF2+cJJcEw15NPhvOKqvFFYlzXqLtK/R0GjBRpKy6muqvrzZUjycCeJS2l9rfNIILrfF4qZ8P0oVZX2U54BOJTHRZVS6cpaG0dGmvrpWFfI0ndHwTYjVQ1Ske01nI1AiLj6ZhPrP0vXu3fJqqUgBJgU9Sg6fr/l5hSIsMUyAsMiUTBGE+neIJ0e3s7sGsRS5bizzH24VlEZAQzAXuX+dLkIzohYz+kqrlE7II0O52eiBbl+hBmitUh2cTkmcEi4oISPAS4TE4xFpe273q3yB4ATz53yBqkckiSuVUwGukt3lpXO+c7nZ6OL2fdrf7L1cXyj3vK+9r7xuv5+17fe+ld+ydeJH3u/en95f3d+NO49vGbuO7pevtWyvMQ6/WGof/AOdZoU0=</latexit><latexit sha1_base64="ZaJhcD7ScvxQtNfQTogu245TRXE=">AAAHg3icfVVdb9s2FFW7te60j6br417YxQaGTnbsdFmaFQEMpChaoMWy2UkDmF5GSVcWa1LSSKqxS+iv7X/sfa/bb9il7SyWk42AJOrynnt4Dy/JsBBcm273j1u3P/r4zt3GvU/8Tz/7/Iv7Ww++PNV5qSI4iXKRq7OQaRA8gxPDjYCzQgGToYC34fTIjb99D0rzPBuaeQFjySYZT3jEDJrOt86O1QjREBmiwZAmtTx4R6sm9p5RBBr6DPtHzYA03zXHpHlIaKJYZOEXe3rOq8pSXcpzOyWUZ+SoWpinVdX0z7e2u53uopHrnd6qs+2t2vH5g7sPaZxHpYTMRIJpPep1CzO2TBkeCah8WmooWDRlExhhN2MS9NguJKhICy0xSXKFT2bIwuqvQzCOYvNaFGtYWAqmZnVrmOdTHNGV79c5TfJ0bHlWlAayaEmZlIKYnDhlScwVyijmpM5r+PRDkPEInG4Bk1oykwYFd/MMzPRDe6JYkQaSTSECIa5My1k5uOChYmruUsgvdBBi5InKyyzWQcGMAZVpxBvFZ4FOWQE6SLgJIiYi9x87TCFyI5ma6v+K2pFgGA4ulBNg7LBMDPwMcWUVxI+edh+FAnnXPUwKEwWQVXbxcT4XKTew4ROKEirr3msefoukxhT6h50dA7OONhgbZlHKsgl0olzu/FaCdiWqd3rf7x3sHuxokBwLMsTCle0LbtK2S6LNs3aI9Q5q4fdkf3v58akTlOF+cPr4dCLykAmKv9TB+pDpUkE/zgUWQB93Q5THcEgVCDa7xOY4+XoRjYa9sXUL5wqgtsrHwwHLnLgKMrjABCTLYksTJrmYx5CwUhi3WZLLfr1IdOKqovJb62QaVxDiw27nIIgkR1IsC4EljwRmphMXop4kxqaZmblQ/SXY6scj3Gt742ozqeeAm0zBYC7DXLzAlOwyiq7sj29eVzZzFJJXVlaW43TpAMxNzmiINyHhCrLicIBBGeJymtIt6c0EmwyDF2+cJJcEw15NPhvOKqvFFYlzXqLtK/R0GjBRpKy6muqvrzZUjycCeJS2l9rfNIILrfF4qZ8P0oVZX2U54BOJTHRZVS6cpaG0dGmvrpWFfI0ndHwTYjVQ1Ske01nI1AiLj6ZhPrP0vXu3fJqqUgBJgU9Sg6fr/l5hSIsMUyAsMiUTBGE+neIJ0e3s7sGsRS5bizzH24VlEZAQzAXuX+dLkIzohYz+kqrlE7II0O52eiBbl+hBmitUh2cTkmcEi4oISPAS4TE4xFpe273q3yB4ATz53yBqkckiSuVUwGukt3lpXO+c7nZ6OL2fdrf7L1cXyj3vK+9r7xuv5+17fe+ld+ydeJH3u/en95f3d+NO49vGbuO7pevtWyvMQ6/WGof/AOdZoU0=</latexit><latexit sha1_base64="ZaJhcD7ScvxQtNfQTogu245TRXE=">AAAHg3icfVVdb9s2FFW7te60j6br417YxQaGTnbsdFmaFQEMpChaoMWy2UkDmF5GSVcWa1LSSKqxS+iv7X/sfa/bb9il7SyWk42AJOrynnt4Dy/JsBBcm273j1u3P/r4zt3GvU/8Tz/7/Iv7Ww++PNV5qSI4iXKRq7OQaRA8gxPDjYCzQgGToYC34fTIjb99D0rzPBuaeQFjySYZT3jEDJrOt86O1QjREBmiwZAmtTx4R6sm9p5RBBr6DPtHzYA03zXHpHlIaKJYZOEXe3rOq8pSXcpzOyWUZ+SoWpinVdX0z7e2u53uopHrnd6qs+2t2vH5g7sPaZxHpYTMRIJpPep1CzO2TBkeCah8WmooWDRlExhhN2MS9NguJKhICy0xSXKFT2bIwuqvQzCOYvNaFGtYWAqmZnVrmOdTHNGV79c5TfJ0bHlWlAayaEmZlIKYnDhlScwVyijmpM5r+PRDkPEInG4Bk1oykwYFd/MMzPRDe6JYkQaSTSECIa5My1k5uOChYmruUsgvdBBi5InKyyzWQcGMAZVpxBvFZ4FOWQE6SLgJIiYi9x87TCFyI5ma6v+K2pFgGA4ulBNg7LBMDPwMcWUVxI+edh+FAnnXPUwKEwWQVXbxcT4XKTew4ROKEirr3msefoukxhT6h50dA7OONhgbZlHKsgl0olzu/FaCdiWqd3rf7x3sHuxokBwLMsTCle0LbtK2S6LNs3aI9Q5q4fdkf3v58akTlOF+cPr4dCLykAmKv9TB+pDpUkE/zgUWQB93Q5THcEgVCDa7xOY4+XoRjYa9sXUL5wqgtsrHwwHLnLgKMrjABCTLYksTJrmYx5CwUhi3WZLLfr1IdOKqovJb62QaVxDiw27nIIgkR1IsC4EljwRmphMXop4kxqaZmblQ/SXY6scj3Gt742ozqeeAm0zBYC7DXLzAlOwyiq7sj29eVzZzFJJXVlaW43TpAMxNzmiINyHhCrLicIBBGeJymtIt6c0EmwyDF2+cJJcEw15NPhvOKqvFFYlzXqLtK/R0GjBRpKy6muqvrzZUjycCeJS2l9rfNIILrfF4qZ8P0oVZX2U54BOJTHRZVS6cpaG0dGmvrpWFfI0ndHwTYjVQ1Ske01nI1AiLj6ZhPrP0vXu3fJqqUgBJgU9Sg6fr/l5hSIsMUyAsMiUTBGE+neIJ0e3s7sGsRS5bizzH24VlEZAQzAXuX+dLkIzohYz+kqrlE7II0O52eiBbl+hBmitUh2cTkmcEi4oISPAS4TE4xFpe273q3yB4ATz53yBqkckiSuVUwGukt3lpXO+c7nZ6OL2fdrf7L1cXyj3vK+9r7xuv5+17fe+ld+ydeJH3u/en95f3d+NO49vGbuO7pevtWyvMQ6/WGof/AOdZoU0=</latexit> Observation. Probability of selecting i, given j, is the same for all j.