FluidDB NYC Python presentation

•

1 recomendación•655 vistas

Terry Jones

Slides from a presentation on FluidDB by Terry Jones on April 20, 2010 to the NYC Python Meetup.

Tecnología

FluidDB
Terry Jones

terry@ﬂuidinfo.com
@terrycojones

The physical world
is writable

(in some sense)

And we (programmers)
have looked after our
own needs pretty well

Making a problem disappear
1
2
4
8
16
32
64
128
256
512
1024 +
?????

Making a problem disappear
1 1
2 10
4 100
8 1000
16 10000
32 100000
64 1000000
128 10000000
256 100000000
512 1000000000
1024 + 10000000000 +
????? 11111111111

Representation
VIII
XVII
XLIV
LXXX
XCVI
CCLV

Representation
VIII
XVII
XLIV
LXXX
XCVI
CCLV +
D

FluidDB

Make working with information more natural
Make the (computational) world writable
A single global shared database
The database with the heart of a wiki?

Python libs

Fluid Object Mapper (FOM), by Ali Afshar
fdb.py, by Nicholas Radcliffe
txFluidDB (Twisted!), by Tristan Seligmann
FluidDB Explorer, by Pier Parent

A FluidDB object
t witter.com/friends/jack
t witter.com/users/screen_name hmason
t witter.com/users/status_count 4191
terrycojones/met
terrycojones/people/works-at-bitly
ﬂuiddb/about “t witter.com:uid:765548”
sally/comment “badass coder”
jamie/rating 7

FluidDB is mainly Python

Twisted (http:/ wistedmatrix.com)
/t
AMQP (txAMQP, RabbitMQ)
Thrift (txThrift)
Pyjamas (for Tickery)
txJSONRPC (Tickery)

More info
Private alpha sign up:
http://ﬂuidinfo.com/accounts/new
Then mail api@ﬂuidinfo.com
Blog: http://blogs.ﬂuidinfo.com/ﬂuidDB
Docs: http://doc.ﬂuidinfo.com/ﬂuidDB

Information model
Objects with tags (with values)
Objects have no owners
A permissions system on tags
Tags organized into namespaces
A simple query language

Queries
Numeric: tag value (=, <, etc.)
Set contents: tag contains “great”
Exclusion: price > 20 except rating < 3
Tag presence: has tag
Grouping/logic: (...), and, or
Textual: tag text match (coming!)

Permissions

For each action on a namespace or tag:
There’s a policy: ‘open’ or ‘closed’
And a (perhaps empty) list of exceptions

API

HTTP / REST based
JSON arguments & replies
A dozen client-side libraries (Python,
Perl, Ruby, .Net, Java, etc)
Other APIs planned (XMPP, Thrift)

Más contenido relacionado

La actualidad más candente

For research institutes, data libraries, and data archives, RDF data validation according to predefined constraints is a much sought-after feature, particularly as this is taken for granted in the XML world. Based on our work in the DCMI RDF Application Profiles Task Group and in cooperation with the W3C Data Shapes Working Group, we identified and published by today 81 types of constraints that are required by various stakeholders for data applications. In this paper, in collaboration with several domain experts we formulate 115 constraints on three different vocabularies (DDI-RDF, QB, and SKOS) and classify them according to (1) the severity of an occurring violation and (2) the complexity of the constraint expression in common constraint languages. We evaluate the data quality of 15,694 data sets (4.26 billion triples) of research data for the social, behavioral, and economic sciences obtained from 33 SPARQL endpoints. Based on the results, we formulate several findings to direct the further development of constraint languages.

2016.02 - Validating RDF Data Quality using Constraints to Direct the Develop...

Dr.-Ing. Thomas Hartmann

Thinking in documents

César Rodas

Metadata provides a foundation for the cross-channel experiences we consume in the dawn of the 21st century by enabling consistency, context and interoperability. While Metadata is key to many of the User Experience methods we use – from triggering Content Strategy workflows to enabling faceted search through groups, sorts and filters, it remains a mystery to many of us. This session is a crash course on Metadata in the 21st century for UX Designers. We'll look at recent developments in the field, and build an understanding of how Metadata enables the exchange of information between parties, channels, systems and platforms through semantic, syntax and lexical specifications. Attendees will understand how Metadata fits into UX methods and tools they already know – using an ontology to support a mental model for example. This session is a must for all UX Designers looking to build meaningful cross-channel experiences in an increasingly interlinked world.

Better Cross-Channel Experiences With Metadata - Information Architecture Sum...

aungstad

Two graph data models : RDF and Property Graphs

andyseaborne

總之來講講 Search

Andy Dai

2013 CrossRef Workshops Boot Camp Introduction Patricia Feeney

Crossref

Semantic Web introduction

Graphity

Non-Framework MVC sites with PHP

César Rodas

RDF Data Model

Jose Emilio Labra Gayo

La actualidad más candente (9)

2016.02 - Validating RDF Data Quality using Constraints to Direct the Develop...

Thinking in documents

Better Cross-Channel Experiences With Metadata - Information Architecture Sum...

Two graph data models : RDF and Property Graphs

總之來講講 Search

2013 CrossRef Workshops Boot Camp Introduction Patricia Feeney

Semantic Web introduction

Non-Framework MVC sites with PHP

RDF Data Model

Similar a FluidDB NYC Python presentation

Scaling Out With Hadoop And HBase

Age Mooij

The Elephant in the Library - Integrating Hadoop

cneudecker

Small, Medium and Big Data

Pierre De Wilde

Flink Forward Europe 2019 - Berlin

David Morin

High level introduction to Linux Containers. Presented at Interop Las Vegas 2015. Frames the discussion with an introduction to intermodal shipping containers, the innovation around logistics and purpose built infrastructure and the impact. Walk through features of the Linux kernel which provide isolation and limitation and packaging applications as filesystem images. Finish talking about the emerging purpose built infrastructure for managing container deployments.

container crash course

Andrew Shafer

Drive the business with your KPIs. That is what we aimed to do at OVH. As a 18 years old company and quite big cloud provider, we encountered several issues during this long journey to setup change data capture and data driven culture. Getting data from thousands of tables into one place, keep it all up to date was not possible without a strong streaming engine like Apache Flink. We will present you our current production pipeline with its pros and cons. From the data collection made directly with binary logs of the databases, to continuous writing into Apache Hive in a Kerberized cloud-based Apache Hadoop cluster. We will describe how we handle schema transcription, events lifecycle, stream partitioning, sort of the events with the use of watermarks and windows aggregation - all of this in a transaction way until the data availability on user side. Finally we will introduce our production infrastructure based on cloud only, its operation and monitoring.

OVH-Change Data Capture in production with Apache Flink - Meetup Rennes 2019-...

Yann Pauly

Rennes Meetup 2019-09-26 - Change data capture in production

David Morin

BigchainDB: A Scalable Blockchain Database, In Python

Trent McConaghy

BigchainDB: A Scalable Blockchain Database, In Python

BigchainDB

Trent McConaghy- BigchainDB

PyData

Talk at West Coast Association of Shared Resource Directors

Deepak Singh

Functional Programming with Immutable Data Structures

elliando dias

PyLadies Seattle - Lessons in Interactive Visualizations

Amanda Casari

Toronto TCP1P Meetup Genetic Social-AI Blockchain Innovations

Stefan Ianta

Discover what exists with Ontology2

Paul Houle

The Digital Library from Information Superhighway to the Semiotic Web

Martin Kalfatovic

Wikisym Deep Hypertext slides

Victor Grishchenko

Spiders, Chatbots, and the Future of Metadata: A look inside the BNC BiblioSh...

BookNet Canada

Libraries collect books, magazines and newspapers. Yes, that's what they always did. But today, the amount of digital information resources is growing at dizzying speed. Facing the demand of digital information resources available 24/7, there has been a significant shift regarding a library's core responsibilities. Today's libraries are curating large digital collections, indexing millions of full-text documents, preserving Terabytes of data for future generations, and at the same time exploring innovative ways of providing access to their collections. This is exactly where Hadoop comes into play. Libraries have to process a rapidly increasing amount of data as part of their day-to-day business and computing tasks like file format migration, text recognition, linguistic processing, etc., require significant computing resources. Many data processing scenarios emerge where Hadoop might become an essential part of the digital library's ecosystem. Hadoop is sometimes referred to as a hammer where you have to throw away everything that is not a nail. To remain in that metaphor: we will present some actual use cases for Hadoop in libraries, how we determine what are the nails in a library and what not, and some initial results.

The Elephant in the Library

DataWorks Summit

Big Data vs Data Warehousing

Thomas Kejser

Último

Accelerating FinTech Innovation: Unleashing API Economy and GenAI Vasa Krishnan, Chief Technology Officer - FinResults Apidays New York 2024: The API Economy in the AI Era (April 30 & May 1, 2024) ------ Check out our conferences at https://www.apidays.global/ Do you want to sponsor or talk at one of our conferences? https://apidays.typeform.com/to/ILJeAaV8 Learn more on APIscene, the global media made by the community for the community: https://www.apiscene.io Explore the API ecosystem with the API Landscape: https://apilandscape.apiscene.io/

Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...

apidays

Strategies for Landing an Oracle DBA Job as a Fresher

Remote DBA Services

AXA XL - Insurer Innovation Award Americas 2024

The Digital Insurer

2024: Domino Containers - The Next Step. News from the Domino Container commu...

Martijn de Jong

ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke

Product Anonymous

presentation ICT roal in 21st century education

jfdjdjcjdnsjd

Whatsapp Number Escorts Call girls 8617370543 Available 24x7 Navi Mumbai Call Girls Service Offer Genuine VIP Model Escorts Call Girls in Your Budget. Navi Mumbai Call Girls Service Provide Real Call Girls Number. Make Your Sexual Pleasure Memorable with Our Navi Mumbai Call Girls at Affordable Price. Top VIP Escorts Call Girls, High Profile Independent Escorts Call Girls, Housewife Women Escorts Call Girl, College Girls Escorts Call Girls, Russian Escorts Call girls Service in Your Budget.

Navi Mumbai Call Girls 🥰 8617370543 Service Offer VIP Hot Model

Deepika Singh

Automating Google Workspace (GWS) & more with Apps Script

wesley chun

This presentations targets students or working professionals. You may know Google for search, YouTube, Android, Chrome, and Gmail, but did you know Google has many developer tools, platforms & APIs? This comprehensive yet still high-level overview outlines the most impactful tools for where to run your code, store & analyze your data. It will also inspire you as to what's possible. This talk is 50 minutes in length.

Powerful Google developer tools for immediate impact! (2023-24 C)

wesley chun

The Good, the Bad and the Governed - Why is governance a dirty word? David O'Neill, Chief Operating Officer - APIContext Apidays New York 2024: The API Economy in the AI Era (April 30 & May 1, 2024) ------ Check out our conferences at https://www.apidays.global/ Do you want to sponsor or talk at one of our conferences? https://apidays.typeform.com/to/ILJeAaV8 Learn more on APIscene, the global media made by the community for the community: https://www.apiscene.io Explore the API ecosystem with the API Landscape: https://apilandscape.apiscene.io/

Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...

apidays

Webinar Recording: https://www.panagenda.com/webinars/why-teams-call-analytics-is-critical-to-your-entire-business Nothing is as frustrating and noticeable as being in an important call and being unable to see or hear the other person. Not surprising then, that issues with Teams calls are among the most common problems users call their helpdesk for. Having in depth insight into everything relevant going on at the user’s device, local network, ISP and Microsoft itself during the call is crucial for good Microsoft Teams Call quality support. To ensure a quick and adequate solution and to ensure your users get the most out of their Microsoft 365. But did you know that ‘bad calls’ are also an excellent indicator of other problems arising? Precisely because it is so noticeable!? Like the canary in the mine, bad calls can be early indicators of problems. Problems that might otherwise not have been noticed for a while but can have a big impact on productivity and satisfaction. Join this session by Christoph Adler to learn how true Microsoft Teams call quality analytics helped other organizations troubleshoot bad calls and identify and fix problems that impacted Teams calls or the use of Microsoft365 in general. See what it can do to keep your users happy and productive! In this session we will cover - Why CQD data alone is not enough to troubleshoot call problems - The importance of attributing call problems to the right call participant - What call quality analytics can do to help you quickly find, fix-, and prevent problems - Why having retrospective detailed insights matters - Real life examples of how others have used Microsoft Teams call quality monitoring to problem shoot problems with their ISP, network, device health and more.

Why Teams call analytics are critical to your entire business

panagenda

Building Digital Trust in a Digital Economy Veronica Tan, Director - Cyber Security Agency of Singapore Apidays Singapore 2024: Connecting Customers, Business and Technology (April 17 & 18, 2024) ------ Check out our conferences at https://www.apidays.global/ Do you want to sponsor or talk at one of our conferences? https://apidays.typeform.com/to/ILJeAaV8 Learn more on APIscene, the global media made by the community for the community: https://www.apiscene.io Explore the API ecosystem with the API Landscape: https://apilandscape.apiscene.io/

Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...

apidays

MySQL Webinar, presented on the 25th of April, 2024. Summary: MySQL solutions enable the deployment of diverse Database Architectures tailored to specific needs, including High Availability, Disaster Recovery, and Read Scale-Out. With MySQL Shell's AdminAPI, administrators can seamlessly set up, manage, and monitor these solutions, ensuring efficiency and ease of use in their administration. MySQL Router, on the other hand, provides transparent routing from the application traffic to the backend servers in the architectures, requiring minimal configuration. Completely built in-house and supported by Oracle, these solutions have been adopted by enterprises of all sizes for their business-critical applications. In this presentation, we'll delve into various database architecture solutions to help you choose the right one based on your business requirements. Focusing on technical details and the latest features to maximize the potential of these solutions.

Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...

Miguel Araújo

Manulife - Insurer Transformation Award 2024

The Digital Insurer

Join our latest Connector Corner webinar to discover how UiPath Integration Service revolutionizes API-centric automation in a 'Quote to Cash' process—and how that automation empowers businesses to accelerate revenue generation. A comprehensive demo will explore connecting systems, GenAI, and people, through powerful pre-built connectors designed to speed process cycle times. Speakers: James Dickson, Senior Software Engineer Charlie Greenberg, Host, Product Marketing Manager

Connector Corner: Accelerate revenue generation using UiPath API-centric busi...

DianaGray10

As privacy and data protection regulations evolve rapidly, organizations operating in multiple jurisdictions face mounting challenges to ensure compliance and safeguard customer data. With state-specific privacy laws coming up in multiple states this year, it is essential to understand what their unique data protection regulations will require clearly. How will data privacy evolve in the US in 2024? How to stay compliant? Our panellists will guide you through the intricacies of these states' specific data privacy laws, clarifying complex legal frameworks and compliance requirements. This webinar will review: - The essential aspects of each state's privacy landscape and the latest updates - Common compliance challenges faced by organizations operating in multiple states and best practices to achieve regulatory adherence - Valuable insights into potential changes to existing regulations and prepare your organization for the evolving landscape

TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments

TrustArc

Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood

Juan lago vázquez

FWD Group - Insurer Innovation Award 2024

The Digital Insurer

GenAI Risks & Security Meetup 01052024.pdf

lior mazor

Abhishek Deb(1), Mr Abdul Kalam(2) M. Des (UX) , School of Design, DIT University , Dehradun. This paper explores the future potential of AI-enabled smartphone processors, aiming to investigate the advancements, capabilities, and implications of integrating artificial intelligence (AI) into smartphone technology. The research study goals consist of evaluating the development of AI in mobile phone processors, analyzing the existing state as well as abilities of AI-enabled cpus determining future patterns as well as chances together with reviewing obstacles as well as factors to consider for more growth.

Exploring the Future Potential of AI-Enabled Smartphone Processors

debabhi2

FluidDB NYC Python presentation

1. FluidDB Terry Jones terry@ﬂuidinfo.com @terrycojones

2. Information

3. The physical world is writable (in some sense)

8. Our brains are writable

9. And we (programmers) have looked after our own needs pretty well

10. A magic trick

11. Making a problem disappear 1 2 4 8 16 32 64 128 256 512 1024 + ?????

12. Making a problem disappear 1 1 2 10 4 100 8 1000 16 10000 32 100000 64 1000000 128 10000000 256 100000000 512 1000000000 1024 + 10000000000 + ????? 11111111111

13. Representation VIII XVII XLIV LXXX XCVI CCLV

14. Representation VIII XVII XLIV LXXX XCVI CCLV +

15. Representation VIII XVII XLIV LXXX XCVI CCLV + D

16. Representation VIII XVII XLIV LXXX XCVI CCLV + D

17. FluidDB Make working with information more natural Make the (computational) world writable A single global shared database The database with the heart of a wiki?

18. A FluidDB app: Tickery

19. Python libs Fluid Object Mapper (FOM), by Ali Afshar fdb.py, by Nicholas Radcliffe txFluidDB (Twisted!), by Tristan Seligmann FluidDB Explorer, by Pier Parent

20. A FluidDB object t witter.com/friends/jack t witter.com/users/screen_name hmason t witter.com/users/status_count 4191 terrycojones/met terrycojones/people/works-at-bitly ﬂuiddb/about “t witter.com:uid:765548” sally/comment “badass coder” jamie/rating 7

21. FluidDB is mainly Python Twisted (http:/ wistedmatrix.com) /t AMQP (txAMQP, RabbitMQ) Thrift (txThrift) Pyjamas (for Tickery) txJSONRPC (Tickery)

22. More info Private alpha sign up: http://fluidinfo.com/accounts/new Then mail api@fluidinfo.com Blog: http://blogs.fluidinfo.com/fluidDB Docs: http://doc.fluidinfo.com/fluidDB

23. Information model Objects with tags (with values) Objects have no owners A permissions system on tags Tags organized into namespaces A simple query language

24. Queries Numeric: tag value (=, <, etc.) Set contents: tag contains “great” Exclusion: price > 20 except rating < 3 Tag presence: has tag Grouping/logic: (...), and, or Textual: tag text match (coming!)

25. Permissions For each action on a namespace or tag: There’s a policy: ‘open’ or ‘closed’ And a (perhaps empty) list of exceptions

26. API HTTP / REST based JSON arguments & replies A dozen client-side libraries (Python, Perl, Ruby, .Net, Java, etc) Other APIs planned (XMPP, Thrift)

FluidDB NYC Python presentation

Recomendados

Recomendados

Más contenido relacionado

La actualidad más candente

La actualidad más candente (9)

Similar a FluidDB NYC Python presentation

Similar a FluidDB NYC Python presentation (20)

Último

Último (20)

FluidDB NYC Python presentation