1. Volunteer Computing
P2P-Tuple Architecture
Evaluation
Future
.
.
P2P-Tuple: Towards a Robust Volunteer
Computing Platform
.
.. .
.
Emmanouil Dimogerontakis
FIB UPC
March 13, 2012
. . . . . .
1 / 27

2. Volunteer Computing
P2P-Tuple Architecture Importance of VC
Evaluation VC Infrastructures
Future
.
. . Volunteer Computing
1
Importance of VC
VC Infrastructures
.
. . P2P-Tuple Architecture
2
Overview
Peer Design
.
. . Evaluation
3
Simulation
Results
.
. . Future
4
. . . . . .
2 / 27

3. Volunteer Computing
P2P-Tuple Architecture Importance of VC
Evaluation VC Infrastructures
Future
. Grid-y for Science
. . . . . .
3 / 27

4. Volunteer Computing
P2P-Tuple Architecture Importance of VC
Evaluation VC Infrastructures
Future
. BOINC
. . . . . .
4 / 27

5. Volunteer Computing
P2P-Tuple Architecture Importance of VC
Evaluation VC Infrastructures
Future
. P2P-Tuple Contribution
. . . . . .
5 / 27

6. Volunteer Computing
P2P-Tuple Architecture Overview
Evaluation Peer Design
Future
.
. . Volunteer Computing
1
Importance of VC
VC Infrastructures
.
. . P2P-Tuple Architecture
2
Overview
Peer Design
.
. . Evaluation
3
Simulation
Results
.
. . Future
4
. . . . . .
6 / 27

7. Volunteer Computing
P2P-Tuple Architecture Overview
Evaluation Peer Design
Future
. Base technologies
. . . . . .
7 / 27

8. Volunteer Computing
P2P-Tuple Architecture Overview
Evaluation Peer Design
Future
. Base technologies
. . . . . .
8 / 27

9. Volunteer Computing
P2P-Tuple Architecture Overview
Evaluation Peer Design
Future
. Base technologies
. . . . . .
9 / 27

10. Volunteer Computing
P2P-Tuple Architecture Overview
Evaluation Peer Design
Future
. Overall Operation
Step 1: Peers join the overlay and a SCRIBE group.
Step 2: Group owners submit their task to the Tuple Space using a
client program.
(Tasks can also be pipelined)
Step 3: Peers periodically broadcasts task notification
message.
Step 4: Peers in the same group start pulling jobs related to that
task.
Step 5: Notified peers spread the word.
Step 6: Once the job is finished the result is put encoded back on
the Tuple Space.
. . . . . .
10 / 27

11. Volunteer Computing
P2P-Tuple Architecture Overview
Evaluation Peer Design
Future
. Peer Design
. . . . . .
11 / 27

12. Volunteer Computing
P2P-Tuple Architecture Overview
Evaluation Peer Design
Future
. Peer Daemon
. . . . . .
12 / 27

13. Volunteer Computing
P2P-Tuple Architecture Overview
Evaluation Peer Design
Future
. Job Executor Daemon
. . . . . .
13 / 27

14. Volunteer Computing
P2P-Tuple Architecture Overview
Evaluation Peer Design
Future
. Measures to Achieve Fault Tolerance
Measure: Provide high availability, face high churn rate, remain
reliable.
Effect: Redundancy of data, Replication, use of Erasure Code.
. . . . . .
14 / 27

15. Volunteer Computing
P2P-Tuple Architecture Overview
Evaluation Peer Design
Future
. Measures to Achieve Fault Tolerance
Measure: Provide high availability, face high churn rate, remain
reliable.
Effect: Redundancy of data, Replication, use of Erasure Code.
Measure: Loss of data from high churn rate
Effect: Communicating Mirrored Replicas of stored objects.
. . . . . .
15 / 27

16. Volunteer Computing
P2P-Tuple Architecture Overview
Evaluation Peer Design
Future
. Measures to Achieve Fault Tolerance
Measure: Provide high availability, face high churn rate, remain
reliable.
Effect: Redundancy of data, Replication, use of Erasure Code.
Measure: Loss of data from high churn rate
Effect: Communicating Mirrored Replicas of stored objects.
Measure: Untrusted peers, possible low job completion probability.
Effect: Job Duplication using a randomized job scheduling scheme.
. . . . . .
16 / 27

17. Volunteer Computing
P2P-Tuple Architecture Overview
Evaluation Peer Design
Future
. Measures to Achieve Fault Tolerance
Measure: Provide high availability, face high churn rate, remain
reliable.
Effect: Redundancy of data, Replication, use of Erasure Code.
Measure: Loss of data from high churn rate
Effect: Communicating Mirrored Replicas of stored objects.
Measure: Untrusted peers, possible low job completion probability.
Effect: Job Duplication using a randomized job scheduling scheme.
Measure: Disconnecting Client Application.
Effect: Checkpoints.
. . . . . .
17 / 27

18. Volunteer Computing
P2P-Tuple Architecture Simulation
Evaluation Results
Future
.
. . Volunteer Computing
1
Importance of VC
VC Infrastructures
.
. . P2P-Tuple Architecture
2
Overview
Peer Design
.
. . Evaluation
3
Simulation
Results
.
. . Future
4
. . . . . .
18 / 27

19. Volunteer Computing
P2P-Tuple Architecture Simulation
Evaluation Results
Future
. Impact of mirrors
.
Result .
..
Using 1 or 2 mirrors extends the duration of the data availability.
.
.. .
.
. . . . . .
19 / 27

20. Volunteer Computing
P2P-Tuple Architecture Simulation
Evaluation Results
Future
. Impact of Redundancy Level
.
Result .
..
The increase of the duration of data availability is proportionate to
the increase of Redundancy level.
.
.. .
.
. . . . . .
20 / 27

21. Volunteer Computing
P2P-Tuple Architecture Simulation
Evaluation Results
Future
. Behavior in high churn environment
.
Result .
..
In a high churn rate environment the availability decreases easily.
.
.. .
.
. . . . . .
21 / 27

22. Volunteer Computing
P2P-Tuple Architecture Simulation
Evaluation Results
Future
. Results
A Volunteer Computing infrastructure:
Decentralized
Fault Tolerant
. . . . . .
22 / 27

23. Volunteer Computing
P2P-Tuple Architecture Simulation
Evaluation Results
Future
. Results
A Volunteer Computing infrastructure:
Decentralized
Fault Tolerant
that provides:
High Availability
Reliability
. . . . . .
23 / 27

24. Volunteer Computing
P2P-Tuple Architecture
Evaluation
Future
.
. . Volunteer Computing
1
Importance of VC
VC Infrastructures
.
. . P2P-Tuple Architecture
2
Overview
Peer Design
.
. . Evaluation
3
Simulation
Results
.
. . Future
4
. . . . . .
24 / 27

25. Volunteer Computing
P2P-Tuple Architecture
Evaluation
Future
. Future
Optimizing current infrastructures and ensure system stability
”MPI-like” support
”MapReduce-like” support
. . . . . .
25 / 27

26. Volunteer Computing
P2P-Tuple Architecture
Evaluation
Future
. . . . . .
26 / 27

27. Volunteer Computing
P2P-Tuple Architecture
Evaluation
Future
. Bibliography & Useful Links
Lei Ni, Aaron Harwood, P2P-Tuple: Towards a Robust
Volunteer Computing Platform. International Conference on
Parallel and Distributed Computing, Applications and
Technologies, 2009.
Hao Ning, Robust Overlay networks for Volunteer Computing.
Master thesis on Chalmers University of Technology, 2010.
http://ww2.cs.mu.oz.au/~lni/p2ptuple/.
http://www.freepastry.org
. . . . . .
27 / 27