Group7 presentation

•

0 recomendaciones•403 vistas

Julia Proskurnia

Tecnología Empresariales

Large-Scale Decentralized
Storage Systems used by
Volunteer Computing
Final Presentation

G7: Arinto, Diego, Enkhjin, Iuliia

Outline
● Problem Definition
● Volunteer Computing (VC)
● Decentralized Storage Systems
(DSS)
● Systems Review
● State-of-the-Art DSS used by VC
● Conclusions

Problem Definition

● Decentralized Storage Systems

● Volunteer Computing

● DSS + VC = ?

Volunteer Computing
● Group of computing resources
● Voluntary share the resource
● Incentive volunteers!!
● Trust between peers
● Example:
○ SETI@home
○ Storage@home
○ Folding@home
● However, data is centrally stored

Decentralized Storage
Systems Review
Focus Criteria:
AV = availability
SC = scalability
ECO = eventual consistency
P = performance
SE = security

Decentralized Storage
Systems Review
System Description Focus
Large scale persistent P2P storage system SE
Farsite
P2P storage system based on Dhash table ECO, AV
Ivy
logs
P2P DHT-based storage system that used ECO
OverNet
XOR-based metrics for routing
Large scale persistent P2P storage system SC, SE, AV
PAST
Highly scalable P2P storage system based on SC, ECO
Pastis
trust
Big, distributed, fault tolerant hashtable AV
Voldemort
Globally persistent DSS for any-file-anywhere SC, SE
OceanStore

Decentralized Storage
Systems Review
System Description Focus
SC, AV, P
Glacier Highly durable DSS for archiving, no remote write

P2P storage system. Automatically manage its AV, SC
Total Recall
availability in dynamic changing environment
DSS with no point of failure to store structured SC, AV, ECO
Cassandra
data
SC, AV
Riak Dynamo-inspired NOSQL storage system.
P, AV, ECO
Dynamo Large scale DSS developed by Amazon

Secure DSS and BitTorrent-like file swarming SE, AV
Attic
techniques to serve data and manage load.
P, ECO
Squirrel Decentralized Web Cache

State-of-The-Art DSS-
Characteristics
● Read and Write Access
● Fault Tolerance and Replication Techniques
● Availability and Symmetry
● Video/Images

● Incentives

State-of-The-Art DSS-
Suggestions for Incentives
Incentives based on amount of storage
dedicated, computing resources volunteered:

● Credit based system
● Printable Certificates
● Government tax break, possible in countries
with significant amount of nodes

State-of-The-Art DSS-
Challenges
● Providing the right Incentive

● Security

● Integration into current VC environment

Conclusions
● VC data storage/distribution issues.
● Survey on DSS
○ Classification

● Integration VC systems - DSS
○ Identify characteristics
○ Valid and Useful / Define state-art
○ Challenges

Work Effort

Arinto Murdopo = 100%
Diego Montero = 100%
Enkhjin Bayarsaikhan = 100%
Iuliia Proskurnia = 100%

Más contenido relacionado

Similar a Group7 presentation

Anshul Pundir - Senior Software Engineer, Docker Anusha Ragunathan - Senior Software Engineer, Docker Inc In this talk, we will discuss storage concepts related to containers on the Docker platform with the perspective of what is important throughout the lifecycle of an application., We will focus on application provisioning: creating persistent volumes and policies for stateful data and management: replication and failover scenarios, backup/restore, monitoring etc. Through this talk, we will cover the latest storage features and also some of the current and future direction of container storage. Key concepts covered about running stateful applications: - Persistent Volumes - Provisioning (Static vs Topology-aware) - Data Availability (failover with scheduler policies) - Data Protection (using Backup/Restore) - Monitoring (using Prometheus/Grafana dashboards) We will look at each of the characteristics in detail with demos.

DCEU 18: Provisioning and Managing Storage for Docker Containers

Docker, Inc.

FalconStor NSS Presentation

rpsprowl

NAVER Ceph Storage on ssd for Container

Jangseon Ryu

Yair Hershko - Building Software Defined Storage Cloud Using OpenStack

Cloud Native Day Tel Aviv

OpenEBS Technical Workshop - KubeCon San Diego 2019

MayaData Inc

VMworld 2014: Software-Defined Data Center through Hyper-Converged Infrastruc...

VMworld

OSDC 2015: John Spray | The Ceph Storage System

NETWAYS

Speed up Digital Transformation with Openstack Cloud & Software Defined Storage

Matthew Sheppard

Decentralized Storage Systems

dgr8vj

110629 nexenta- andy bennett

Strelia Technology Services

Storage-Backup-Resume

Manu Mohan

Technological change is finally coming to storage, and it will wipe away the architecture we've come to know over the last few decades. Say goodbye to the "do it all" Fibre Channel SAN storage array and get ready for converged infrastructure, distributed storage, alternative attachments like PCIe, and top-of-rack flash! In this session, Stephen Foskett will explain why this change is inevitable and how it will shake out. You won't recognize what's coming, but it will be faster, cheaper, and more integrated than ever! Delivered at

It's the End of Data Storage As We Know It (And I Feel Fine)

Stephen Foskett

Ceph is designed around the assumption that all components of the system (disks, hosts, networks) can fail, and has traditionally leveraged replication to provide data durability and reliability. The CRUSH placement algorithm is used to allow failure domains to be defined across hosts, racks, rows, or datacenters, depending on the deployment scale and requirements. Recent releases have added support for erasure coding, which can provide much higher data durability and lower storage overheads. However, in practice erasure codes have different performance characteristics than traditional replication and, under some workloads, come at some expense. At the same time, we have introduced a storage tiering infrastructure and cache pools that allow alternate hardware backends (like high-end flash) to be leveraged for active data sets while cold data are transparently migrated to slower backends. The combination of these two features enables a surprisingly broad range of new applications and deployment configurations. This talk will cover a few Ceph fundamentals, discuss the new tiering and erasure coding features, and then discuss a variety of ways that the new capabilities can be leveraged.

Storage tiering and erasure coding in Ceph (SCaLE13x)

Sage Weil

인메모리 클러스터링 아키텍처

Jaehong Cheon

SoftLayer Storage Services Overview (for Interop Las Vegas 2015)

Michael Fork

Building highly efficient cloud infrastructure, and lessons learned from real deployments: The session will cover how to build converged cloud solution based on industry standard components and open source software, to deliver the best cost/performance, lowest $/GB storage, and lowest $/VM, and the right balance of compute, network, and storage resources. This is based on the speaker experience of working with multiple OpenStack based cloud providers, integrators, and internal implementation of OpenStack private cloud in Mellanox The session will also discuss various software defined storage (SDS) and commercial options, what’s the benefit of one vs the other, how to efficiently combine SSD & HDD, and expiriance with BigData and Hadoop applications, will cover latest innovations in the space of high-performance networking and storage (VXLAN in hardware, DPDK/NFV, Cinder acceleration, Ceph over RDMA, ..) , and will go over a concrete for high-density, high-perform

Deploying Efficient OpenStack Clouds, Yaron Haviv

Cloud Native Day Tel Aviv

SoftLayer Storage Services Overview

Michael Fork

Equinix Big Data Platform and Cassandra - A view into the journey

Praveen Kumar

Ai tour 2019 Mejores Practicas en Entornos de Produccion Big Data Open Source...

nnakasone

NoSQL databases like Cassandra and Couchbase are quickly becoming key components of the modern IT infrastructure. But this modernization creates new challenges – especially for storage. Storage in the broad sense. In-memory databases perform well when there is enough memory available. However, when data sets get too large and they need to access storage, application performance degrades dramatically. Moreover, even if enough memory is available, persistent client requests can bring the servers to their knees. Join Storage Switzerland and Plexistor where you will learn: 1. What is Cassandra and Couchbase? 2. Why organizations are adopting them? 3. What are the storage challenges they create? 4. How organizations attempt to workaround these challenges. 5. How to design a solution to these challenges instead of a workaround.

Webinar: Overcoming the Storage Challenges Cassandra and Couchbase Create

Storage Switzerland

Más de Julia Proskurnia

In recent years the need for distributed data storage has led the way to design new systems in a large-scale environment. The growth of unbounded stream of data, the necessity to store and analyze it in real time, reliably, scalably and fast are the reasons for appearance of such systems in financial sector, stock exchange Nasdaq OMX especially. Futhermore, internally designed totally ordered reliable message bus is used in Nasdaq OMX for almost all internal subsystems. Theoretical and practical extensive studies on reliable totally ordered multicast were made in academia and it was proven to serve as a fundamental block in construction of distributed fault-tolerant applications. In this work, we are leveraging NOMX low-latency reliable totally ordered message bus with a capacity of at least 2 million messages per second to build high performance distributed data store. The data operations consistency can be easily achieved by using the messaging bus as it forwards all messages in reliable total order fashion. Moreover, relying on the reliable totally ordered messaging, active in-memory replication support for fault tolerance and load balancing is integrated. Consequently, the prototype was developed using pro- duction environment requirements to demonstrate its feasibility. Experimental results show a great scalability, and performace serving around 400,000 insert operations per second over 6 data nodes that can be served with 100 microseconds latency. Latency for single record read operations are bound to sub-half millisecond, while data ranges are retrieved with sub-100 Mbps capacity from one node. Moreover, performance improvements under a greater number of data store nodes are shown for both writes and reads. It is con- cluded that uniform totally ordered sequenced input data can be used in real time for large-scale distributed data storage to maintain strong consistency, fault-tolernace and high performance.

Thesis finalpresentation

Julia Proskurnia

Pregel

Julia Proskurnia

Last.fm under the BFS "attack"

Julia Proskurnia

ZooKeeper - wait free protocol for coordinating processes

Julia Proskurnia

Planet Lab

Julia Proskurnia

Fluidanimate:PARSEC Application Analysis

Julia Proskurnia

Más de Julia Proskurnia (6)

Thesis finalpresentation

Pregel

Last.fm under the BFS "attack"

ZooKeeper - wait free protocol for coordinating processes

Planet Lab

Fluidanimate:PARSEC Application Analysis

Último

[BuildWithAI] Introduction to Gemini.pdf

Sandro Moreira

EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER

MadyBayot

Scaling API-first – The story of a global engineering organization Ian Reasor, Senior Computer Scientist - Adobe Radu Cotescu, Senior Computer Scientist - Adobe Apidays New York 2024: The API Economy in the AI Era (April 30 & May 1, 2024) ------ Check out our conferences at https://www.apidays.global/ Do you want to sponsor or talk at one of our conferences? https://apidays.typeform.com/to/ILJeAaV8 Learn more on APIscene, the global media made by the community for the community: https://www.apiscene.io Explore the API ecosystem with the API Landscape: https://apilandscape.apiscene.io/

Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe

apidays

Elevate Developer Efficiency & build GenAI Application with Amazon Q

Bhuvaneswari Subramani

Effective data discovery is crucial for maintaining compliance and mitigating risks in today's rapidly evolving privacy landscape. However, traditional manual approaches often struggle to keep pace with the growing volume and complexity of data. Join us for an insightful webinar where industry leaders from TrustArc and Privya will share their expertise on leveraging AI-powered solutions to revolutionize data discovery. You'll learn how to: - Effortlessly maintain a comprehensive, up-to-date data inventory - Harness code scanning insights to gain complete visibility into data flows leveraging the advantages of code scanning over DB scanning - Simplify compliance by leveraging Privya's integration with TrustArc - Implement proven strategies to mitigate third-party risks Our panel of experts will discuss real-world case studies and share practical strategies for overcoming common data discovery challenges. They'll also explore the latest trends and innovations in AI-driven data management, and how these technologies can help organizations stay ahead of the curve in an ever-changing privacy landscape.

TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery

TrustArc

AWS Community Day CPH - Three problems of Terraform

Andrey Devyatkin

Dubai, known for its towering skyscrapers, luxurious lifestyle, and relentless pursuit of innovation, often finds itself in the global spotlight. However, amidst the glitz and glamour, the emirate faces its own set of challenges, including the occasional threat of flooding. In recent years, Dubai has experienced sporadic but significant floods, disrupting normalcy and posing unique challenges to its infrastructure. Among the critical nodes in this bustling metropolis is the Dubai International Airport, a vital hub connecting the world. This article delves into the intersection of Dubai flood events and the resilience demonstrated by the Dubai International Airport in the face of such challenges.

Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf

Orbitshub

Retrieval augmented generation (RAG) is the most popular style of large language model application to emerge from 2023. The most basic style of RAG works by vectorizing your data and injecting it into a vector database like Milvus for retrieval to augment the text output generated by an LLM. This is just the beginning. One of the ways that we can extend RAG, and extend AI, is through multilingual use cases. Typical RAG is done in English using embedding models that are trained in English. In this talk, we’ll explore how RAG could work in languages other than English. We’ll explore French, Chinese, and Polish.

Introduction to Multilingual Retrieval Augmented Generation (RAG)

Zilliz

Following the popularity of "Cloud Revolution: Exploring the New Wave of Serverless Spatial Data," we're thrilled to announce this much-anticipated encore webinar. In this sequel, we'll dive deeper into the Cloud-Native realm by uncovering practical applications and FME support for these new formats, including COGs, COPC, FlatGeoBuf, GeoParquet, STAC, and ZARR. Building on the foundation laid by industry leaders Michelle Roby of Radiant Earth and Chris Holmes of Planet in the first webinar, this second part offers an in-depth look at the real-world application and behind-the-scenes dynamics of these cutting-edge formats. We will spotlight specific use-cases and workflows, showcasing their efficiency and relevance in practical scenarios. Discover the vast possibilities each format holds, highlighted through detailed discussions and demonstrations. Our expert speakers will dissect the key aspects and provide critical takeaways for effective use, ensuring attendees leave with a thorough understanding of how to apply these formats in their own projects. Elevate your understanding of how FME supports these cutting-edge technologies, enhancing your ability to manage, share, and analyze spatial data. Whether you're building on knowledge from our initial session or are new to the serverless spatial data landscape, this webinar is your gateway to mastering cloud-native formats in your workflows.

Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME

Safe Software

💥 You’re lucky! We’ve found two different (lead) developers that are willing to share their valuable lessons learned about using UiPath Document Understanding! Based on recent implementations in appealing use cases at Partou and SPIE. Don’t expect fancy videos or slide decks, but real and practical experiences that will help you with your own implementations. 📕 Topics that will be addressed: • Training the ML-model by humans: do or don't? • Rule-based versus AI extractors • Tips for finding use cases • How to start 👨‍🏫👨‍💻 Speakers: o Dion Morskieft, RPA Product Owner @Partou o Jack Klein-Schiphorst, Automation Developer @Tacstone Technology

DEV meet-up UiPath Document Understanding May 7 2024 Amsterdam

UiPathCommunity

The value of a flexible API Management solution for Open Banking Steve Melan, Manager for IT Innovation and Architecture - State's and Saving's Bank of Luxembourg Apidays New York 2024: The API Economy in the AI Era (April 30 & May 1, 2024) ------ Check out our conferences at https://www.apidays.global/ Do you want to sponsor or talk at one of our conferences? https://apidays.typeform.com/to/ILJeAaV8 Learn more on APIscene, the global media made by the community for the community: https://www.apiscene.io Explore the API ecosystem with the API Landscape: https://apilandscape.apiscene.io/

Apidays New York 2024 - The value of a flexible API Management solution for O...

apidays

Join our latest Connector Corner webinar to discover how UiPath Integration Service revolutionizes API-centric automation in a 'Quote to Cash' process—and how that automation empowers businesses to accelerate revenue generation. A comprehensive demo will explore connecting systems, GenAI, and people, through powerful pre-built connectors designed to speed process cycle times. Speakers: James Dickson, Senior Software Engineer Charlie Greenberg, Host, Product Marketing Manager

Connector Corner: Accelerate revenue generation using UiPath API-centric busi...

DianaGray10

Keynote 2: APIs in 2030: The Risk of Technological Sleepwalk Paolo Malinverno, Growth Advisor - The Business of Technology Apidays New York 2024: The API Economy in the AI Era (April 30 & May 1, 2024) ------ Check out our conferences at https://www.apidays.global/ Do you want to sponsor or talk at one of our conferences? https://apidays.typeform.com/to/ILJeAaV8 Learn more on APIscene, the global media made by the community for the community: https://www.apiscene.io Explore the API ecosystem with the API Landscape: https://apilandscape.apiscene.io/

Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...

apidays

Understanding the FAA Part 107 License ..

Christopher Logan Kennedy

CNIC Information System with Pakdata Cf In Pakistan

danishmna97

Webinar Recording: https://www.panagenda.com/webinars/why-teams-call-analytics-is-critical-to-your-entire-business Nothing is as frustrating and noticeable as being in an important call and being unable to see or hear the other person. Not surprising then, that issues with Teams calls are among the most common problems users call their helpdesk for. Having in depth insight into everything relevant going on at the user’s device, local network, ISP and Microsoft itself during the call is crucial for good Microsoft Teams Call quality support. To ensure a quick and adequate solution and to ensure your users get the most out of their Microsoft 365. But did you know that ‘bad calls’ are also an excellent indicator of other problems arising? Precisely because it is so noticeable!? Like the canary in the mine, bad calls can be early indicators of problems. Problems that might otherwise not have been noticed for a while but can have a big impact on productivity and satisfaction. Join this session by Christoph Adler to learn how true Microsoft Teams call quality analytics helped other organizations troubleshoot bad calls and identify and fix problems that impacted Teams calls or the use of Microsoft365 in general. See what it can do to keep your users happy and productive! In this session we will cover - Why CQD data alone is not enough to troubleshoot call problems - The importance of attributing call problems to the right call participant - What call quality analytics can do to help you quickly find, fix-, and prevent problems - Why having retrospective detailed insights matters - Real life examples of how others have used Microsoft Teams call quality monitoring to problem shoot problems with their ISP, network, device health and more.

Why Teams call analytics are critical to your entire business

panagenda

💉💊+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHABI}}+971581248768 +971581248768 Mtp-Kit (500MG) Prices » Dubai [(+971581248768**)] Abortion Pills For Sale In Dubai, UAE, Mifepristone and Misoprostol Tablets Available In Dubai, UAE CONTACT DR.Maya Whatsapp +971581248768 We Have Abortion Pills / Cytotec Tablets /Mifegest Kit Available in Dubai, Sharjah, Abudhabi, Ajman, Alain, Fujairah, Ras Al Khaimah, Umm Al Quwain, UAE, Buy cytotec in Dubai +971581248768''''Abortion Pills near me DUBAI | ABU DHABI|UAE. Price of Misoprostol, Cytotec” +971581248768' Dr.DEEM ''BUY ABORTION PILLS MIFEGEST KIT, MISOPROTONE, CYTOTEC PILLS IN DUBAI, ABU DHABI,UAE'' Contact me now via What's App…… abortion Pills Cytotec also available Oman Qatar Doha Saudi Arabia Bahrain Above all, Cytotec Abortion Pills are Available In Dubai / UAE, you will be very happy to do abortion in Dubai we are providing cytotec 200mg abortion pill in Dubai, UAE. Medication abortion offers an alternative to Surgical Abortion for women in the early weeks of pregnancy. We only offer abortion pills from 1 week-6 Months. We then advise you to use surgery if its beyond 6 months. Our Abu Dhabi, Ajman, Al Ain, Dubai, Fujairah, Ras Al Khaimah (RAK), Sharjah, Umm Al Quwain (UAQ) United Arab Emirates Abortion Clinic provides the safest and most advanced techniques for providing non-surgical, medical and surgical abortion methods for early through late second trimester, including the Abortion By Pill Procedure (RU 486, Mifeprex, Mifepristone, early options French Abortion Pill), Tamoxifen, Methotrexate and Cytotec (Misoprostol). The Abu Dhabi, United Arab Emirates Abortion Clinic performs Same Day Abortion Procedure using medications that are taken on the first day of the office visit and will cause the abortion to occur generally within 4 to 6 hours (as early as 30 minutes) for patients who are 3 to 12 weeks pregnant. When Mifepristone and Misoprostol are used, 50% of patients complete in 4 to 6 hours; 75% to 80% in 12 hours; and 90% in 24 hours. We use a regimen that allows for completion without the need for surgery 99% of the time. All advanced second trimester and late term pregnancies at our Tampa clinic (17 to 24 weeks or greater) can be completed within 24 hours or less 99% of the time without the need surgery. The procedure is completed with minimal to no complications. Our Women's Health Center located in Abu Dhabi, United Arab Emirates, uses the latest medications for medical abortions (RU-486, Mifeprex, Mifegyne, Mifepristone, early options French abortion pill), Methotrexate and Cytotec (Misoprostol). The safety standards of our Abu Dhabi, United Arab Emirates Abortion Doctors remain unparalleled. They consistently maintain the lowest complication rates throughout the nation. Our Physicians and staff are always available to answer questions and care for women in one of the most difficult times in their lives. The decision to have an abortion at the Abortion Cl

+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...

?#DUbAI#??##{{(☎️+971_581248768%)**%*]'#abortion pills for sale in dubai@

Whatsapp Number Escorts Call girls 8617370543 Available 24x7 Mcleodganj Call Girls Service Offer Genuine VIP Model Escorts Call Girls in Your Budget. Mcleodganj Call Girls Service Provide Real Call Girls Number. Make Your Sexual Pleasure Memorable with Our Mcleodganj Call Girls at Affordable Price. Top VIP Escorts Call Girls, High Profile Independent Escorts Call Girls, Housewife Women Escorts Call Girl, College Girls Escorts Call Girls, Russian Escorts Call girls Service in Your Budget.

Mcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot Model

Deepika Singh

The microservices honeymoon is over. When starting a new project or revamping a legacy monolith, teams started looking for alternatives to microservices. The Modular Monolith, or 'Modulith', is an architecture that reaps the benefits of (vertical) functional decoupling without the high costs associated with separate deployments. This talk will delve into the advantages and challenges of this progressive architecture, beginning with exploring the concept of a 'module', its internal structure, public API, and inter-module communication patterns. Supported by spring-modulith, the talk provides practical guidance on addressing the main challenges of a Modultith Architecture: finding and guarding module boundaries, data decoupling, and integration module-testing. You should not miss this talk if you are a software architect or tech lead seeking practical, scalable solutions. About the author With two decades of experience, Victor is a Java Champion working as a trainer for top companies in Europe. Five thousands developers in 120 companies attended his workshops, so he gets to debate every week the challenges that various projects struggle with. In return, Victor summarizes key points from these workshops in conference talks and online meetups for the European Software Crafters, the world’s largest developer community around architecture, refactoring, and testing. Discover how Victor can help you on victorrentea.ro : company training catalog, consultancy and YouTube playlists.

Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024

Victor Rentea

Following the popularity of “Cloud Revolution: Exploring the New Wave of Serverless Spatial Data,” we’re thrilled to announce this much-anticipated encore webinar. In this sequel, we’ll dive deeper into the Cloud-Native realm by uncovering practical applications and FME support for these new formats, including COGs, COPC, FlatGeoBuf, GeoParquet, STAC, and ZARR. Building on the foundation laid by industry leaders Michelle Roby of Radiant Earth and Chris Holmes of Planet in the first webinar, this second part offers an in-depth look at the real-world application and behind-the-scenes dynamics of these cutting-edge formats. We will spotlight specific use-cases and workflows, showcasing their efficiency and relevance in practical scenarios. Discover the vast possibilities each format holds, highlighted through detailed discussions and demonstrations. Our expert speakers will dissect the key aspects and provide critical takeaways for effective use, ensuring attendees leave with a thorough understanding of how to apply these formats in their own projects. Elevate your understanding of how FME supports these cutting-edge technologies, enhancing your ability to manage, share, and analyze spatial data. Whether you’re building on knowledge from our initial session or are new to the serverless spatial data landscape, this webinar is your gateway to mastering cloud-native formats in your workflows.

Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME

Safe Software

Group7 presentation

1. Large-Scale Decentralized Storage Systems used by Volunteer Computing Final Presentation G7: Arinto, Diego, Enkhjin, Iuliia

2. Outline ● Problem Definition ● Volunteer Computing (VC) ● Decentralized Storage Systems (DSS) ● Systems Review ● State-of-the-Art DSS used by VC ● Conclusions

3. Problem Definition ● Decentralized Storage Systems ● Volunteer Computing ● DSS + VC = ?

4. Problem Definition

5. Problem Definition

6. Volunteer Computing ● Group of computing resources ● Voluntary share the resource ● Incentive volunteers!! ● Trust between peers ● Example: ○ SETI@home ○ Storage@home ○ Folding@home ● However, data is centrally stored

7. Volunteer Computing BOINC example

8. Decentralized Storage Systems

9. Decentralized Storage Systems Review Focus Criteria: AV = availability SC = scalability ECO = eventual consistency P = performance SE = security

10. Decentralized Storage Systems Review System Description Focus Large scale persistent P2P storage system SE Farsite P2P storage system based on Dhash table ECO, AV Ivy logs P2P DHT-based storage system that used ECO OverNet XOR-based metrics for routing Large scale persistent P2P storage system SC, SE, AV PAST Highly scalable P2P storage system based on SC, ECO Pastis trust Big, distributed, fault tolerant hashtable AV Voldemort Globally persistent DSS for any-file-anywhere SC, SE OceanStore

11. Decentralized Storage Systems Review System Description Focus SC, AV, P Glacier Highly durable DSS for archiving, no remote write P2P storage system. Automatically manage its AV, SC Total Recall availability in dynamic changing environment DSS with no point of failure to store structured SC, AV, ECO Cassandra data SC, AV Riak Dynamo-inspired NOSQL storage system. P, AV, ECO Dynamo Large scale DSS developed by Amazon Secure DSS and BitTorrent-like file swarming SE, AV Attic techniques to serve data and manage load. P, ECO Squirrel Decentralized Web Cache

12. State-of-The-Art DSS- Characteristics ● Read and Write Access ● Fault Tolerance and Replication Techniques ● Availability and Symmetry ● Video/Images ● Incentives

13. State-of-The-Art DSS- Characteristics

14. State-of-The-Art DSS- Suggestions for Incentives Incentives based on amount of storage dedicated, computing resources volunteered: ● Credit based system ● Printable Certificates ● Government tax break, possible in countries with significant amount of nodes

15. State-of-The-Art DSS- Challenges ● Providing the right Incentive ● Security ● Integration into current VC environment

16. Conclusions ● VC data storage/distribution issues. ● Survey on DSS ○ Classification ● Integration VC systems - DSS ○ Identify characteristics ○ Valid and Useful / Define state-art ○ Challenges

17. Work Effort Arinto Murdopo = 100% Diego Montero = 100% Enkhjin Bayarsaikhan = 100% Iuliia Proskurnia = 100%

18. Questions ...???

Group7 presentation

Recomendados

Recomendados

Más contenido relacionado

Similar a Group7 presentation

Similar a Group7 presentation (20)

Más de Julia Proskurnia

Más de Julia Proskurnia (6)

Último

Último (20)

Group7 presentation