SF ElasticSearch Meetup - How HipChat Scaled to 1B Messages

Presentation of the paper "Aligning Web Services with the Semantic Web to Create a Global Read-Write Graph of Data" gave at the 9th IEEE European Conference on Web Services (ECOWS 2011) in Lugano, Switzerland. Despite significant research and development efforts, the vision of the Semantic Web yielding to a Web of Data has not yet become reality. Even though initiatives such as Linking Open Data gained traction recently, the Web of Data is still clearly outpaced by the growth of the traditional, document-based Web. Instead of releasing data in the form of RDF, many publishers choose to publish their data in the form of Web services. The reasons for this are manifold. Given that RESTful Web services closely resemble the document-based Web, they are not only perceived as less complex and disruptive, but also provide read-write interfaces to the underlying data. In contrast, the current Semantic Web is essentially read-only which clearly inhibits net-working effects and engagement of the crowd. On the other hand, the prevalent use of proprietary schemas to represent the data published by Web services inhibits generic browsers or crawlers to access and understand this data; the consequence are islands of data instead of a global graph of data forming the envisioned Semantic Web. We thus propose a novel approach to integrate Web services into the Web of Data by introducing an algorithm to translate SPARQL queries to HTTP requests. The aim is to create a global read-write graph of data and to standardize the mashup development process. We try to keep the approach as familiar and simple as possible to lower the entry barrier and foster the adoption of our approach. Thus, we based our proposal on SEREDASj, a semantic description language for RESTful data services, for making proprietary JSON service schemas accessible.

Aligning Web Services with the Semantic Web to Create a Global Read-Write Gra...

MongoDB Europe 2016 - ETL for Pros – Getting Data Into MongoDB The Right Way

A Semantic Description Language for RESTful Data Services to Combat Semaphobia

Audio available: https://www.liferay.com/web/events-symposium-north-america/recap Liferay makes it easy to integrate your application with powerful search engines. However, it may be hard to diagnose why your most important content isn't showing up the way you need it to. This session will recap the key concepts for indexing and querying with Liferay Search, and present a number of techniques to guarantee your documents will be found with best possible relevance. André de Oliveira joined Liferay in early 2014 as a senior engineer and leads the Search Infrastructure team. He's been a Java developer and architect for the last 15 years. Ever since discovering Elasticsearch, he's vowed never to write another SQL WHERE clause again.

Liferay Search: Best Practices to Dramatically Improve Relevance - Liferay Sy...

André Ricardo Barreto de Oliveira

Mongo db datatypes

zarigatongy

03. ElasticSearch : Data In, Data Out

OpenThink Labs

Mongo at Sailthru (MongoNYC 2011)

ibwhite

01 ElasticSearch : Getting Started

OpenThink Labs

Introduction to Elasticsearch

Luiz Messias

The core Search frameworks in Liferay 7 have been significantly retooled to benefit not only from Liferay's new modular architecture, but also from one of the most innovative players in the market: Elasticsearch, which replaces Lucene as the default search engine in Portal. This session will cover topics like clustering and scalability, unveil improvements (both Elasticsearch and Solr) like aggregations, filters, geolocation, "more like this" and other new query types, and also hot new features for the Enterprise like out-of-the-box Marvel cluster monitoring and Shield security. André "Arbo" Oliveira joined Liferay in early 2014 as a senior engineer and leads the Search Infrastructure team. He's been writing code for a living for 22 years, 14 of them as a Java developer and architect. Ever since discovering Elasticsearch, he's vowed never to write another SQL WHERE clause again.

Harnessing The Power of Search - Liferay DEVCON 2015, Darmstadt, Germany

André Ricardo Barreto de Oliveira

Elastic search 검색

HyeonSeok Choi

CouchDB Open Source Bridge

Chris Anderson

Web enabled systems are now an integral part of everything we interact with, from microelectronics to voice enabled hardware, from text messages and phone calls to email, and really we’re just limited by our imaginations as to what we can connect. As we explore vast new realms of communication over mixed digital media, we have to ask ourselves how we protect our critical data within potential unsecure environments. Going beyond that, how do we protect some of our more critical data, payment information, in this same realm. As we look at a multitude of different environments, we’ll be exploring how to secure user identity and payment information through the communication channels, covering topics like: * Securing identity and payment data through voice commands or text. * Tokenization and encryption security. * Techniques for triggering secure transactions from communications media. At the end of the session, we’ll have a stronger understanding of proper techniques for working with new communication media sources, and see how we can apply fundamental security precepts in potentially insecure environments.

Secure Payments Over Mixed Communication Media

Jonathan LeBlanc

JSON-LD for RESTful services

Log file analysis by Peter Nikolow

Anton Shulke

From russia final_bluehat10

F _

Building Next-Generation Web APIs with JSON-LD and Hydra

Building a Social Network with MongoDB

Fred Chu

DevTalks Cluj - Open-Source Technologies for Analyzing Text

Steffen Wenz

What's hot (20)

Building Your First App with MongoDB

Aligning Web Services with the Semantic Web to Create a Global Read-Write Gra...

MongoDB Europe 2016 - ETL for Pros – Getting Data Into MongoDB The Right Way

A Semantic Description Language for RESTful Data Services to Combat Semaphobia

Liferay Search: Best Practices to Dramatically Improve Relevance - Liferay Sy...

Mongo db datatypes

03. ElasticSearch : Data In, Data Out

Mongo at Sailthru (MongoNYC 2011)

01 ElasticSearch : Getting Started

Introduction to Elasticsearch

Harnessing The Power of Search - Liferay DEVCON 2015, Darmstadt, Germany

Elastic search 검색

CouchDB Open Source Bridge

Secure Payments Over Mixed Communication Media

JSON-LD for RESTful services

Log file analysis by Peter Nikolow

From russia final_bluehat10

Building Next-Generation Web APIs with JSON-LD and Hydra

Building a Social Network with MongoDB

DevTalks Cluj - Open-Source Technologies for Analyzing Text

Similar to SF ElasticSearch Meetup - How HipChat Scaled to 1B Messages

Mongo db presentation

Julie Sommerville

Data exchange formats

Przemysław Kamiński

Montreal Elasticsearch Meetup

Loïc Bertron

Scala in hulu's data platform

Prasan Samtani

MongoDB In Production At Sailthru

ibwhite

Dynamic Apps with WebSockets and MQTT - IBM Impact 2014

Bryan Boyd

Document Model for High Speed Spark Processing

NoSQL & MongoDB

Shuai Liu

MongoDB全機能解説2

Takahiro Inoue

Operational Intelligence with MongoDB Webinar

Zwei jahrebigdata

Joerg Blumtritt

Couchbase

Lorraine JUG

Example-driven Web API Specification Discovery

Javier Canovas

Automatic discovery of Web API Specifications: an example-driven approach

Jordi Cabot

CouchDB Mobile - From Couch to 5K in 1 Hour

Peter Friese

Building a Cross Channel Content Delivery Platform with MongoDB

Sonya Liberman leads the Personalization team @ Outbrain's Recommendations group, developing large-scale machine learning algorithms for Outbrain's content recommendations platform serving tens of billions real-time recommendations a day. She specializes in Information Retrieval, Machine Learning, and Computational Linguistics. Before joining Outbrain, she led the Research and Algorithms @ ConvertMedia (acquired by Taboola). She holds an MSc in Computer Science and a BSc in Computer Science and Computational Biology. This invited talk was given at the Recommender Systems Workshop 2017, University of Haifa.

Handle complex POST/PATCH requests in RESTful API

fightmaster

Looking at Content Recommendations through a Search Lens - Extended Version

Sonya Liberman

Nicholas Brown, Director of Software Architecture, Vivint Four years ago Vivint set out to mainstream the Smart Home industry with a new purpose-built platform. Within a year, this platform would need to be ready for the integration of millions of devices. Performance was a must. But, perhaps even more importantly, it would need to offer unprecedented extensibility to meet the needs of a nascent industry with little tolerance for rigidity, still being defined even four years later. MongoDB would provide the backbone of this ground-breaking IoT Platform. Today, we will explore the challenges Vivint faced in design and scale, and what we learned (the hard way) about building an IoT platform. https://www.mongodb.com/

Building and Scaling the Internet of Things with MongoDB at Vivint

Beyond the Basics 2: Aggregation Framework

Similar to SF ElasticSearch Meetup - How HipChat Scaled to 1B Messages (20)

Mongo db presentation

Data exchange formats

Montreal Elasticsearch Meetup

Scala in hulu's data platform

MongoDB In Production At Sailthru

Dynamic Apps with WebSockets and MQTT - IBM Impact 2014

Document Model for High Speed Spark Processing

NoSQL & MongoDB

MongoDB全機能解説2

Operational Intelligence with MongoDB Webinar

Zwei jahrebigdata

Couchbase

Example-driven Web API Specification Discovery

Automatic discovery of Web API Specifications: an example-driven approach

CouchDB Mobile - From Couch to 5K in 1 Hour

Building a Cross Channel Content Delivery Platform with MongoDB

Handle complex POST/PATCH requests in RESTful API

Looking at Content Recommendations through a Search Lens - Extended Version

Building and Scaling the Internet of Things with MongoDB at Vivint

Beyond the Basics 2: Aggregation Framework

More from Atlassian

International Women's Day 2020

10 emerging trends that will unbreak your workplace in 2020

Ever wondered what Atlassian engineers do in their 20% time? Join Forge engineering lead Tim Pettersen on a lightning tour of how Forge is being used inside Atlassian. Attendees will get a rare view into some of the apps, tools, and tweaks we’ve built internally on top of Forge in the spirit of dogfooding and innovation. Come along and be inspired with some great ideas for improving and automating your own teams' workflows!

Forge App Showcase

Race out of the gate with Forge UI: a new way of building UI extensions for Atlassian products. In this session, Forge UI Developer Experience lead Peter Gleeson will demonstrate how build an Editor macro from scratch! Attendees will learn about Forge foundational concepts such as the FaaS dev loop, Forge CLI, and how to construct UIs from Forge UI components. This session provides a great introduction to the Forge platform for any developer looking to get productive with editor apps and Forge UI.

Let's Build an Editor Macro with Forge UI

In the words of Jeff Atwood: “JavaScript is the lingua franca of the web”. It’s also the first language we’ve chosen to support in Forge. In this session, Forge engineer Shorya Raj will walk through the Node.js isolate based runtime you’ll be using to write apps for Forge. Attendees will learn about the unique features of the Forge JavaScript Runtime, such as automatic authentication and tenant context management. Shorya will also cover the differences between the Runtime, conventional browser, and Node.js APIs. Developers or attendees with some programming experience will get the most out of this session.

Meet the Forge Runtime

UI extensibility is an integral part of Atlassian's ecosystem story. In cloud, traditionally this has been accomplished with the humble iframe. In this session you will learn about Forge UI, an additional and innovative way to build visual apps for Atlassian products. Join Product Manager Simon Kubica and Senior Developer Michael Oates from the Forge team in exploring the underlying concepts and technology powering Forge UI, and learn how it will unlock exciting new opportunities in our ecosystem.

Forge UI: A New Way to Customize the Atlassian User Experience

The Forge platform contains some powerful primitives for binding functions to Atlassian events and webhooks emitted by third-party SaaS systems. Join Platform Services Engineer Tomek Sroka as he gets hands-on with Forge Product Triggers and Web Triggers to build a powerful integration with surprisingly little code. Attendees will walk away with a good understanding of the Forge dev loop and some tips and tricks for improving their own team’s workflows.

Take Action with Forge Triggers

Observability is a critical component of any Cloud development platform, and we have some exciting logging, monitoring, and debugging features planned for the Forge toolchain. In this lightning talk, Senior Developer James Hazelwood from Forge infrastructure team will give an overview of Forge logging and tunnelling features, explain how different environment types effect observability, and share some expert tips and tricks for detecting and troubleshooting issues in your Forge apps.

Observability and Troubleshooting in Forge

Security and trust have become increasingly important requirements for our customers in Cloud. We’re working to make it easier for you to build and maintain secure apps for Atlassian products. In this session, Engineering Team Lead Dugald Morrow and Principal Product Manager Joël Kalmanowicz will explain how security and trust have been baked into the Forge framework and the benefits the platform can offer you and your users. Learn how much less work it can be to build trusted apps customers will love on Forge by going deep on the safeguards we’re putting in place. Developers or attendees with some software security experience will get the most out of this session.

Trusted by Default: The Forge Security & Privacy Model

Creating apps with Forge and its UI frontend components is now easier than ever. Join Senior Designer Allard van Helbergen and Product Manager Josephine Lee as they walk through the story of designing Forge UI. What is a declarative UI and why did we choose this paradigm? What are all the considerations that go into defining the set of components to build apps with? And how do you make ‘creating apps’ simple? Walk away understanding the foundations of Forge, how all the different components work together, and where Forge UI is headed in the future.

Designing Forge UI: A Story of Designing an App UI System

After a day of learning about the exciting features of Forge, get ready for a peek under the hood to discover how it’s all implemented. Join Forge Architect Patrick Streule as he goes deep on topics such as Forge FaaS infrastructure, the internal workings of tenant isolation, and automatic authentication. Attendees will also get a glimpse of some features we’re looking at building into the future of Forge, such as a serverless data store for apps and more!

Forge: Under the Hood

How do you stay on top of your work when it is scattered across multiple Atlassian products? "If only there was a single place where I could see all my activity..." - sounds familiar? We are going to provide you an insight into what lead to the creation of a new Activity API. Following last year’s Atlas Camp announcement from our CTO Sri Viswanath, Atlassian is moving onto GraphQL - new Activity API is one the first pieces of the GraphQL Atlassian Platform and is the technology behind start.atlassian.com. Join Sergey Meshkov, Senior Developer, who will provide you a sneak peek of the new GraphQL Activity API as it will soon be available to our vendors.

Access to User Activities - Activity Platform APIs

Our designers work  3x quicker  with the Atlassian Vendor Sketch Plugin — and now we’re unleashing these superpowers to the Atlassian Ecosystem. If you mockup screens for code or marketing, we’ll help you drag and drop your way to an Atlaskit design in less than 10 minutes. And if you’re a designer, you’ll want to hear about our pixel-perfect component library and suite of seamless Sketch integrations. Join Atlassian’s resident Sketch aficionado, Huw Evans, to learn about:  Sketch Components: If it’s in Atlaskit, it’s now in Sketch. And introducing the Symbol Palette, the quickest way to find the right component for the job.  Product Templates: Spark inspiration by building your designs inside realistic screens from Jira & Confluence — or craft hero images for your Marketplace listing!  Color and Text Styles: Heard of N75? H400? If those mean nothing to you, we’ll run through how to make your users feel at home by using Atlassian colors & typography, right inside Sketch.  Data Suppliers: Say goodbye to Lorem Ipsum. Learn how to use Sketch Data Suppliers to generate realistic copy using live data from Jira, Confluence and Bitbucket. Bonus: How we used AI to create people who don’t exist! ‍♀️ It's All Open Source: How we made it really easy to customise the Atlassian Vendor Sketch Plugin for your team's needs.

Design Your Next App with the Atlassian Vendor Sketch Plugin

You’d never knowingly ship something to your customers that didn’t deliver value, would you? Would you still stand your ground if you were under pressure to get a team of developers working on something? You probably know that one of Atlassian’s most well-known values is “Don’t f*** the customer”, so learn what happened when a lean product team decided to tear up the roadmap because they were brave enough to admit they didn’t understand their customers well enough. Join Janel Blattler, as she shares how her team used research to unveil a new plan in just a few weeks. You’ll be able to practice some techniques and walk away with a bucket load of inspiration. Come along if you’d like to run research, but worry that you don’t have enough time or lack the skills to do so – you don’t need to be a researcher on your team. This session is for you if you’re looking for ways to drive customer empathy closer in the team, or you’d like to up your game and discover some new techniques for delivering lean research with actionable insights.

Tear Up Your Roadmap and Get Out of the Building

When it comes to designing apps and new features, we just can't get enough of metrics. In an age where we can collect data from almost anything, how can we cut through the noise and focus on the right metrics to measure the success and failures of the apps that we’re building? Join Atlassian Product Manager Josephine Lee as she delves through what exactly makes a good metric. Throughout the talk, we’ll walk through real Atlassian examples of good and bad metrics. By exploring a framework for measurement, we’ll cover detailed features that showcase how best to measure and choose the right set of success, supportive, and counter metrics. You'll walk away with tips and learnings from Atlassian’s approach to measuring success, and learn how to use data and metrics to inspire action in your apps.

Nailing Measurement: a Framework for Measuring Metrics that Matter

Color-blind people are using your apps. 1 in 12 men is color blind. And for women, this is 1 in 200. Building apps that work well for color blind people is not difficult. Some simple techniques help us with the design of our interface. And some tools help us see what color blind people see. In this talk, Maarten Arts of Avisi will look at common varieties of color blindness. We will look at apps through the eyes of a color-blind person. And we will discover what color-blind people struggle with. Regardless of whether you're a designer or developer, this talk will equip you with the skills and the tools you need to make sure that your app works for color-blind people.

Building Apps With Color Blind Users in Mind

The words we choose have the power to include or alienate our users. The reality is that for many, English is spoken as a second language. And unless you're going to localize your product for those major non-English speaking markets, you'll need to thoughtfully create content that is accessible to a larger audience. But how do we create products that maintain a sense of personality without isolating a wide audience of non-native speakers? Join Atlassian Content Designer, Roana Bilia, as she walks you through why thoughtful, inclusive content, is key to creating well-designed user experiences. You'll walk away with foundational principles for good UX copy when optimizing your product UI, a few quick wins that you as creators and developers can incorporate into your next products, as well as a set of mistakes to avoid that companies—including Atlassian—have made, which prioritized native speakers but isolated non-native speakers.

Creating Inclusive Experiences: Balancing Personality and Accessibility in UX...

We hear it all the time, and we get it. Diversity and inclusion are important! But isn't it an HR problem? HR may be able to help with diversity but inclusion or creating an inclusive environment is everyone's responsibility. So how do we create an inclusive environment that celebrates diversity and engages and supports everyone? Isabel Nyo will be sharing best practices and lessons she has learned along the way. She will also be sharing her experience as a minority, a female technical leader, in the technology industry.

Beyond Diversity: A Guide to Building Balanced Teams

In September 2018, K15t took its mission to go self-managed to the next-level when the entire company worked together to decide on the Next Big Thing™ to build for Atlassian users and present it at Summit in Las Vegas. In this session, Anshuman Dash, an intern turned software engineer, turned product manager, shares his journey of professional self-discovery. In under five months, he joins a freshly assembled, self-managed team in building a new Atlassian Marketplace app. Dash will give a quick intro to what it means for a team to be self-managed. Then, he'll share his observations and experiences on the team, as well as the best-practices, patterns, and processes K15t has discovered along the way. Whether you are a new team with a kick-ass product idea or a big company figuring out ways to scale, this talk will provide you with practical tips and ideas your team can try out!

The Road(map) to Las Vegas - The Story of an Emerging Self-Managed Team

Designing for the enterprise comes with a unique set of challenges; ensuring readability and accessibility at scale, meeting the needs of multi-layered organizations, and building a trust when your software - used by dozens of thousands of employees - is considered mission-critical. At Atlassian, we've spent countless hours digging deep into our enterprise customer's needs and we've gathered a vast repository of insights. In this talk, Pawel Wodkowski, a senior designer on Jira Server, will share all that we've learned from our research (while not being shy about busting some of those wild admin myths!). You'll get a crash course in what it means to design for scale the Atlassian way.

Building Apps With Enterprise in Mind