1. ꧁𓀨꧂ - Application Research Group - https://arg.protocol.ai
Encode Filecoin Club
Build With Filecoin
Application Research Group
Estuary
(@aresearchgroup)
2. ꧁𓀨꧂ - Application Research Group - https://arg.protocol.ai
What is the A.R.G.
We explore building applications
on top of the amazing
technologies
In the Filecoin ecosystem.
➟ Cake (me)
➟ Why
➟ Chris
➟ Elijah
➟ Ecosystem collaborations
➟ Protocol Labs
➟ Maybe you? (We’re hiring)
3.
4. ꧁𓀨꧂ - Application Research Group - https://arg.protocol.ai
ENCODE
HACKATHON
12-week hackathon
starting on October 5th,
together with Encode
➟ Prizes
➟ Mentorship opportunities
5. ꧁𓀨꧂ - Application Research Group - https://arg.protocol.ai
https://github.com/
application-research
Websites
Tour
6. ꧁𓀨꧂ - Application Research Group - https://arg.protocol.ai
Filecoin Application Development
➟ Things are getting easier.
➟ We have been working on an end-to-end example of how to build on Filecoin
exclusively…
7. ꧁𓀨꧂ - Application Research Group - https://arg.protocol.ai
https://estuary.tech
Estuary
8. ꧁𓀨꧂ - Application Research Group - https://arg.protocol.ai
What is Estuary?
➟ Thinking Model: A story for the most reliable way to upload public data to the Filecoin
Network.
To date, we hope others take what we are learning and improve on it!
➟ 3 parts:
(1) A hosted example of a Estuary Node (has its own LibP2P Stack)
(2) A website that anyone can use.
(3) A documentation platform to discuss and iterate with the community.
➟ A familiar place: Supports the IPFS pinning standard over HTTP
Check out our documentation.
➟ Improving the Filecoin Storage Deal Experience: Reliably makes deals against the
Filecoin Network at 6x replication.
We have the horsepower to make a ton of storage deals :-)
9. ꧁𓀨꧂ - Application Research Group - https://arg.protocol.ai
We are running an Estuary Node at https://
estuary.tech
➟ Use any language you want to interface with our hosted API.
➟ We configured it to be invite only, we could change this in the future.
If you don’t want to get an invite, check out the very cool web3.storage.
➟ Testing optimal performance, instructions, and integrations.
➟ Some day you will be able to run your own.
10. ꧁𓀨꧂ - Application Research Group - https://arg.protocol.ai
The data for https://estuary.tech
➟ 8,000,000+ files
➟ 12,000+ deals successful on the Filecoin network
➟ 20.00+ TiB total pinned content addresses
➟ 94.62+ TiB total sealed storage
➟ 100+ miners that we curated
Working on eventually working with 600+ that we have curated through https://file.app
➟ One power user with 2,000,000+ files, and another power user with 8TiB+ of data
Still testing the ceiling.
11. ꧁𓀨꧂ - Application Research Group - https://arg.protocol.ai
https://estuary.tech
Feature
Tour
12. ꧁𓀨꧂ - Application Research Group - https://arg.protocol.ai
Put
commands
everywhere
➟ There are commands for
everything all over our
documentation and
marketing pages.
13. ꧁𓀨꧂ - Application Research Group - https://arg.protocol.ai
Put
commands
everywhere
➟ See how we handle
retrieval with one click.
14. ꧁𓀨꧂ - Application Research Group - https://arg.protocol.ai
Verify
➟ If you uploaded data
through https://estuary.tech
you can use this simple public
form to check.
https://estuary.tech/verify-cid?
cid=QmVrrF7DTnbqKvWR7P7
ihJKp4N5fKmBX29m5CHbW9
WLep9
15. ꧁𓀨꧂ - Application Research Group - https://arg.protocol.ai
Verify
➟ Of course if you’re
logged in you can also see
this same information on
the dashboard, for every
storage deal that we have
made.
16. ꧁𓀨꧂ - Application Research Group - https://arg.protocol.ai
Know your
providers
➟ [FUTURE] We can expand
on this, add more details
such as location, compliance,
and safeguards.
➟ Details like this are what
create trust for long term
storage of valuable datasets
and off chain NFT assets.
17. ꧁𓀨꧂ - Application Research Group - https://arg.protocol.ai
A receipt for every
storage deal
➟ Every time a deal is finished
with a provider you get a receipt.
➟ You get to know exactly when
it will finish, and our Estuary
Node will use its funds to renew it
automatically.
➟ If you’re a node operator, you
can make either the client pay, or
you can pay for it just like us.
18. ꧁𓀨꧂ - Application Research Group - https://arg.protocol.ai
Upload via
CID
➟ Aside from the upload
technique you saw from
the beginning of the video,
you can use an existing
CID thats pinned to an
IPFS node to make storage
deals.
19. ꧁𓀨꧂ - Application Research Group - https://arg.protocol.ai
Upload via API
➟ Our documentation is
editable! You can upload
files from the docs itself.
➟ Or just copy and paste
the CURL command and
do it from the command
line.
20. ꧁𓀨꧂ - Application Research Group - https://arg.protocol.ai
Public
performance
analytics
➟ We like sharing all our
data in public as we learn.
➟ Nothing is kept secret,
even our failures.
21. ꧁𓀨꧂ - Application Research Group - https://arg.protocol.ai
Public
performance
analytics
➟ We would hope each
Estuary Node in the future
publishes how many deals
they were able to get on chain.
➟ We list every provider we
use too, so people know who
we work with.
22. ꧁𓀨꧂ - Application Research Group - https://arg.protocol.ai
Smart batching
➟ When users upload a lot
of small files, we are testing
automated batching so that
miners don’t get a lot of
small deals.
➟ We also apply padding to
files that are very small,
and we’re experimenting
with the best way to do this.
23. ꧁𓀨꧂ - Application Research Group - https://arg.protocol.ai
Provider
profiles
➟ Great tool for debugging.
➟ Helps us build a better
relationship with the
provider.
24. ꧁𓀨꧂ - Application Research Group - https://arg.protocol.ai
Provider logs
➟ Everyone looks at the
same information.
➟ Skips a meeting with
your providers, you can
just debug it all from the
same starting point.
25. ꧁𓀨꧂ - Application Research Group - https://arg.protocol.ai
Estuary Node
Management
TOOLS FOR
NETWORK
OPERATORS
26. ꧁𓀨꧂ - Application Research Group - https://arg.protocol.ai
Estuary as a Filecoin/IPFS Node you run
➟ We are stress testing the capability of our node today.
Whatever we achieve, we will provide the steps for you to do the same.
➟ Horizontal scaling with Shuttles (Cool new invention, more later)
➟ Blockstore storage capacity, and potentially inventing new techniques to store
more data on a single node.
➟ Write fast and read fast.
➟ Built in Filecoin address support so you can run your own verified address and
make deals on your own.
27. ꧁𓀨꧂ - Application Research Group - https://arg.protocol.ai
Curate your
preferred
providers
➟ As a network operator
you decide which providers
to work with.
28. ꧁𓀨꧂ - Application Research Group - https://arg.protocol.ai
Manage your
preferred
providers
➟ You can disable providers
and give them reasons they
can see on their profiles.
➟ Miners can always check
their suspension status with
you and work with you to fix
it.
29. ꧁𓀨꧂ - Application Research Group - https://arg.protocol.ai
Manage your
Filecoin
address
➟ You don’t have to verify
your Filecoin address if you
want to pay for deals up front.
➟ (1) address for holding
funds, (2) another address to
hold in escrow for Filecoin
deals.
30. ꧁𓀨꧂ - Application Research Group - https://arg.protocol.ai
Create shuttles
closer to your
clients
➟ Shuttles are an invention that
allow us to take data from a data
center closer to clients.
➟ Node operators can create
shuttles to help upload large
amounts of data easier
➟ A great option for those who
don’t want to be stuck with
offline deals.
31. ꧁𓀨꧂ - Application Research Group - https://arg.protocol.ai
User
debugging
➟ Network operators can
debug problems for clients
by impersonating them.
➟ Great for understanding
what is going on with your
most important users, and
catching edge case bugs.
32. ꧁𓀨꧂ - Application Research Group - https://arg.protocol.ai
Invite anyone
you want
➟ You can make your
Estuary node open to
everyone
➟ Or you can make your
Estuary as a service invite
only.
33. ꧁𓀨꧂ - Application Research Group - https://arg.protocol.ai
View hardware
and system
analytics
➟ Always know what is
happening on your Estuary
Node.
➟ Your Estuary node will
keep track of your
performance and give you
reliable numbers.
34. ꧁𓀨꧂ - Application Research Group - https://arg.protocol.ai
Reach out to me on twitter @wwwjim if you
have any questions or need help.
We’re hiring!
Thank you!