Apache Pulsar and Github

•

0 recomendaciones•242 vistas

StreamNative

Apache Pulsar and Github, shared by Xiaolong Ran at Github meetup in Beijing

Datos y análisis

Xiaolong Ran @wolfstudy
Go In Apache Pulsar
Apache Pulsar committer

01 Pulsar && Github 02 Apache Pulsar 概括
03 Go Client In Pulsar 04 Q && A
Go in Apache
Pulsar

Introduction to
Apache Pulsar Community In Github
01

A brief history of Apache Pulsar
2010
Apache BookKeeper
2011
Hedwig / SNP
2013
Yahoo!
Cloud Messaging
2016
Open Source
2017
Enter
ASF
2018
Top Level
Apache Project
2019
100+ Adopters
10+ Meetups
…

Apache Pulsar Users (China) http://pulsar.apache.org/en/powered-by/

Apache Pulsar Users (global) http://pulsar.apache.org/en/powered-by/

Apache Pulsar Community
• 180+ contributors, 30+ committers, 24+ PMC
• 4000+ commits
• 1100+ forks, 4500+ stars
• 1000+ active members on Slack
• 1000+ active members on WeChat

Tiered Storage
•Infinite Stream: 以流的⽅式永远保存原始
数据
•分区的容量不再受限
•充分利⽤云存储或者现有的廉价存储
（e.g.HDFS）
•数据统⼀表征：客户端不需要关⼼数据究竟
存储在哪⾥

CGO Is Not Go
• Go 最初的定位（下⼀代的 C 语⾔）
• 混合编程（C && Go）
• CGO 是⼀种⼯具，不是对 Go 语⾔的扩展
• 不⽀持交叉编译

性能损耗
• Go 的内存模型与 C 的不⼀致
• ⼤量的 runtime.cgocall() <go tool objdump>
• 阻塞可能导致 M 的数量陡增
• 内存管理的⽅式不同

使⽤ CGO 的感悟
• ⼀定要严格控制边界
• 谨慎使⽤指针
• 注意类型转换
• 尽量减少 C 的调⽤
• 注意内存在哪⾥分配

How to join Apache Pulsar Community
• Mailing lists:
dev@pulsar.apache.org
users@pulsar.apache.org
• Github:
https://github.com/apache/pulsar
https://github.com/apache/pulsar-translation
• Slack:
https://apache-pulsar.slack.com/
https://apache-pulsar.herokuapp.com/
• WeChat
回复：进群

How to join Apache Pulsar community
Global
• Comm
• Content
• Video
• slides
• Meetup
China
https://streamnative.io/

Más contenido relacionado

La actualidad más candente

Cloud lunch and learn real-time streaming in azureTimothy Spann

Kafka & Hadoop - for NYC Kafka MeetupGwen (Chen) Shapira

Elastic Data Processing with Apache Flink and Apache PulsarStreamNative

Apache Pulsar: A borderless communityStreamNative

Kafka on Pulsar StreamNative

Integrating Apache Pulsar with Big Data EcosystemStreamNative

Kafka and Spark Streamingdatamantra

Apache Pulsar Community-JenniferStreamNative

How Orange Financial combat financial frauds over 50M transactions a day usin...JinfengHuang3

Apache Pulsar at Yahoo! JapanStreamNative

fluentd -- the missing log collectorMuga Nishizawa

Getting Pulsar Spinning_Addison HighamStreamNative

Building a FaaS with pulsarStreamNative

Matt Franklin - Apache Software (Geekfest)W2O Group

Introducing HerdDB - a distributed JVM embeddable database built upon Apache ...StreamNative

What's new in apache pulsar 2.4.0StreamNative

Interactive querying of streams using Apache Pulsar_Jerry pengStreamNative

Hail hydrate! from stream to lake using open sourceTimothy Spann

Lessons from managing a Pulsar cluster (Nutanix)StreamNative

Introduction Apache KafkaJoe Stein

La actualidad más candente (20)

Cloud lunch and learn real-time streaming in azure

Kafka & Hadoop - for NYC Kafka Meetup

Elastic Data Processing with Apache Flink and Apache Pulsar

Apache Pulsar: A borderless community

Kafka on Pulsar

Integrating Apache Pulsar with Big Data Ecosystem

Kafka and Spark Streaming

Apache Pulsar Community-Jennifer

How Orange Financial combat financial frauds over 50M transactions a day usin...

Apache Pulsar at Yahoo! Japan

fluentd -- the missing log collector

Getting Pulsar Spinning_Addison Higham

Building a FaaS with pulsar

Matt Franklin - Apache Software (Geekfest)

Introducing HerdDB - a distributed JVM embeddable database built upon Apache ...

What's new in apache pulsar 2.4.0

Interactive querying of streams using Apache Pulsar_Jerry peng

Hail hydrate! from stream to lake using open source

Lessons from managing a Pulsar cluster (Nutanix)

Introduction Apache Kafka

Similar a Apache Pulsar and Github

Real time cloud native open source streaming of any data to apache solrTimothy Spann

Introducing Apache Kafka and why it is important to Oracle, Java and IT profe...Lucas Jellema

Sql bits apache nifi 101 Introduction and best practicesTimothy Spann

Introduction to Apache NiFi And StormJungtaek Lim

7 Apache Process Cloudstack Developer DayKimihiko Kitase

What is Kafka & why is it Important? (UKOUG Tech17, Birmingham, UK - December...Lucas Jellema

Deep Dive into Building Streaming Applications with Apache Pulsar Timothy Spann

Building an Event Streaming Architecture with Apache PulsarScyllaDB

Using FLiP with InfluxDB for EdgeAI IoT at Scale 2022Timothy Spann

Using FLiP with influxdb for edgeai iot at scale 2022Timothy Spann

pulsar-platformatory-meetup-2.pptxShivji Kumar Jha

Building Streaming Applications with Apache Storm 1.1Hugo Louro

Big mountain data and dev conference apache pulsar with mqtt for edge compu...Timothy Spann

Using Apache NiFi with Apache Pulsar for Fast Data On-RampTimothy Spann

How Tencent Applies Apache Pulsar to Apache InLong - Pulsar Summit Asia 2021StreamNative

Kubernetes and AWS Lambda can play nicely togetherEdward Wilde

Pass data community summit - 2021 - Real-Time Streaming in Azure with Apache ...Timothy Spann

Data minutes #2 Apache Pulsar with MQTT for Edge Computing Lightning - 2022Timothy Spann

Data science online camp using the flipn stack for edge ai (flink, nifi, pu...Timothy Spann

Real time stock processing with apache nifi, apache flink and apache kafkaTimothy Spann

Similar a Apache Pulsar and Github (20)

Real time cloud native open source streaming of any data to apache solr

Introducing Apache Kafka and why it is important to Oracle, Java and IT profe...

Sql bits apache nifi 101 Introduction and best practices

Introduction to Apache NiFi And Storm

7 Apache Process Cloudstack Developer Day

What is Kafka & why is it Important? (UKOUG Tech17, Birmingham, UK - December...

Deep Dive into Building Streaming Applications with Apache Pulsar

Building an Event Streaming Architecture with Apache Pulsar

Using FLiP with InfluxDB for EdgeAI IoT at Scale 2022

Using FLiP with influxdb for edgeai iot at scale 2022

pulsar-platformatory-meetup-2.pptx

Building Streaming Applications with Apache Storm 1.1

Big mountain data and dev conference apache pulsar with mqtt for edge compu...

Using Apache NiFi with Apache Pulsar for Fast Data On-Ramp

How Tencent Applies Apache Pulsar to Apache InLong - Pulsar Summit Asia 2021

Kubernetes and AWS Lambda can play nicely together

Pass data community summit - 2021 - Real-Time Streaming in Azure with Apache ...

Data minutes #2 Apache Pulsar with MQTT for Edge Computing Lightning - 2022

Data science online camp using the flipn stack for edge ai (flink, nifi, pu...

Real time stock processing with apache nifi, apache flink and apache kafka

Más de StreamNative

Is Using KoP (Kafka-on-Pulsar) a Good Idea? - Pulsar Summit SF 2022StreamNative

Building an Asynchronous Application Framework with Python and Pulsar - Pulsa...StreamNative

Blue-green deploys with Pulsar & Envoy in an event-driven microservice ecosys...StreamNative

Distributed Database Design Decisions to Support High Performance Event Strea...StreamNative

Simplify Pulsar Functions Development with SQL - Pulsar Summit SF 2022StreamNative

Towards a ZooKeeper-less Pulsar, etcd, etcd, etcd. - Pulsar Summit SF 2022StreamNative

Validating Apache Pulsar’s Behavior under Failure Conditions - Pulsar Summit ...StreamNative

Cross the Streams! Creating Streaming Data Pipelines with Apache Flink + Apac...StreamNative

Message Redelivery: An Unexpected Journey - Pulsar Summit SF 2022StreamNative

Unlocking the Power of Lakehouse Architectures with Apache Pulsar and Apache ...StreamNative

Understanding Broker Load Balancing - Pulsar Summit SF 2022StreamNative

Building an Asynchronous Application Framework with Python and Pulsar - Pulsa...StreamNative

Pulsar's Journey in Yahoo!: On-prem, Cloud and Hybrid - Pulsar Summit SF 2022StreamNative

Event-Driven Applications Done Right - Pulsar Summit SF 2022StreamNative

Pulsar @ Scale. 200M RPM and 1K instances - Pulsar Summit SF 2022StreamNative

Data Democracy: Journey to User-Facing Analytics - Pulsar Summit SF 2022StreamNative

Beam + Pulsar: Powerful Stream Processing at Scale - Pulsar Summit SF 2022StreamNative

Welcome and Opening Remarks - Pulsar Summit SF 2022StreamNative

Log System As Backbone – How We Built the World’s Most Advanced Vector Databa...StreamNative

MoP(MQTT on Pulsar) - a Powerful Tool for Apache Pulsar in IoT - Pulsar Summi...StreamNative

Más de StreamNative (20)

Is Using KoP (Kafka-on-Pulsar) a Good Idea? - Pulsar Summit SF 2022

Building an Asynchronous Application Framework with Python and Pulsar - Pulsa...

Blue-green deploys with Pulsar & Envoy in an event-driven microservice ecosys...

Distributed Database Design Decisions to Support High Performance Event Strea...

Simplify Pulsar Functions Development with SQL - Pulsar Summit SF 2022

Towards a ZooKeeper-less Pulsar, etcd, etcd, etcd. - Pulsar Summit SF 2022

Validating Apache Pulsar’s Behavior under Failure Conditions - Pulsar Summit ...

Cross the Streams! Creating Streaming Data Pipelines with Apache Flink + Apac...

Message Redelivery: An Unexpected Journey - Pulsar Summit SF 2022

Unlocking the Power of Lakehouse Architectures with Apache Pulsar and Apache ...

Understanding Broker Load Balancing - Pulsar Summit SF 2022

Building an Asynchronous Application Framework with Python and Pulsar - Pulsa...

Pulsar's Journey in Yahoo!: On-prem, Cloud and Hybrid - Pulsar Summit SF 2022

Event-Driven Applications Done Right - Pulsar Summit SF 2022

Pulsar @ Scale. 200M RPM and 1K instances - Pulsar Summit SF 2022

Data Democracy: Journey to User-Facing Analytics - Pulsar Summit SF 2022

Beam + Pulsar: Powerful Stream Processing at Scale - Pulsar Summit SF 2022

Welcome and Opening Remarks - Pulsar Summit SF 2022

Log System As Backbone – How We Built the World’s Most Advanced Vector Databa...

MoP(MQTT on Pulsar) - a Powerful Tool for Apache Pulsar in IoT - Pulsar Summi...

Último

RadioAdProWritingCinderellabyButleri.pdfgstagge

INTERNSHIP ON PURBASHA COMPOSITE TEX LTDRafezzaman

2006_GasProcessing_HB (1).pdf HYDROCARBON PROCESSINGmarianagonzalez07

Identifying Appropriate Test Statistics Involving Population MeanMYRABACSAFRA2

Call Girls In Dwarka 9654467111 Escorts ServiceSapana Sha

Top 5 Best Data Analytics Courses In Queensdataanalyticsqueen03

Kantar AI Summit- Under Embargo till Wednesday, 24th April 2024, 4 PM, IST.pdfSocial Samosa

DBA Basics: Getting Started with Performance Tuning.pdfJohn Sterrett

E-Commerce Order PredictionShraddha Kamble.pptxBoston Institute of Analytics

Call Us ➥97111√47426🤳Call Girls in Aerocity (Delhi NCR)jennyeacort

Heart Disease Classification Report: A Data Analysis ProjectBoston Institute of Analytics

办理学位证纽约大学毕业证(NYU毕业证书）原版一比一fhwihughh

1:1定制(UQ毕业证）昆士兰大学毕业证成绩单修改留信学历认证原版一模一样vhwb25kk

20240419 - Measurecamp Amsterdam - SAM.pdfHuman37

Consent & Privacy Signals on Google *Pixels* - MeasureCamp Amsterdam 2024thyngster

Defining Constituents, Data Vizzes and Telling a Data StoryJeremy Anderson

Deep Generative Learning for All - The Gen AI Hype (Spring 2024)Universitat Politècnica de Catalunya

Beautiful Sapna Vip Call Girls Hauz Khas 9711199012 Call /Whatsappssapnasaifi408

EMERCE - 2024 - AMSTERDAM - CROSS-PLATFORM TRACKING WITH GOOGLE ANALYTICS.pptxthyngster

ASML's Taxonomy Adventure by Daniel Cantervoginip

Apache Pulsar and Github

1. Xiaolong Ran @wolfstudy Go In Apache Pulsar Apache Pulsar committer

2. 01 Pulsar && Github 02 Apache Pulsar 概括 03 Go Client In Pulsar 04 Q && A Go in Apache Pulsar

3. Introduction to Apache Pulsar Community In Github 01

4. A brief history of Apache Pulsar 2010 Apache BookKeeper 2011 Hedwig / SNP 2013 Yahoo! Cloud Messaging 2016 Open Source 2017 Enter ASF 2018 Top Level Apache Project 2019 100+ Adopters 10+ Meetups …

5. Apache Pulsar Users (China) http://pulsar.apache.org/en/powered-by/

6. Apache Pulsar Users (global) http://pulsar.apache.org/en/powered-by/

7. Apache Pulsar Community • 180+ contributors, 30+ committers, 24+ PMC • 4000+ commits • 1100+ forks, 4500+ stars • 1000+ active members on Slack • 1000+ active members on WeChat

8. Apache Pulsar Contributions

9. Apache Pulsar PR / Issues

10. Apache Pulsar Git clones

11. Visitors of Apache Pulsar Community

12. Apache Pulasr 概括 02

13. What is Apache Pulsar

14. Apache Pulsar

15. Flexible Messaging

16. Multi Tenancy

17. Geo-Replication

18. Cloud-native Architecture

19. Cloud-native Architecture

20. Segment Centric Storage

21. Tiered Storage •Infinite Stream: 以流的⽅式永远保存原始数据 •分区的容量不再受限 •充分利⽤云存储或者现有的廉价存储（e.g.HDFS） •数据统⼀表征：客户端不需要关⼼数据究竟存储在哪⾥

22. Pulsar Functions

23. Go Client In Apache Pulasr 03

24. CGO Is Not Go • Go 最初的定位（下⼀代的 C 语⾔） • 混合编程（C && Go） • CGO 是⼀种⼯具，不是对 Go 语⾔的扩展 • 不⽀持交叉编译

25. 性能损耗 • Go 的内存模型与 C 的不⼀致 • ⼤量的 runtime.cgocall() <go tool objdump> • 阻塞可能导致 M 的数量陡增 • 内存管理的⽅式不同

26. 使⽤ CGO 的感悟 • ⼀定要严格控制边界 • 谨慎使⽤指针 • 注意类型转换 • 尽量减少 C 的调⽤ • 注意内存在哪⾥分配

27. How to join Apache Pulsar Community • Mailing lists: dev@pulsar.apache.org users@pulsar.apache.org • Github: https://github.com/apache/pulsar https://github.com/apache/pulsar-translation • Slack: https://apache-pulsar.slack.com/ https://apache-pulsar.herokuapp.com/ • WeChat 回复：进群

28. How to join Apache Pulsar community Global • Comm • Content • Video • slides • Meetup China https://streamnative.io/

29. Thank You Q && A

Apache Pulsar and Github

Recomendados

Recomendados

Más contenido relacionado

La actualidad más candente

La actualidad más candente (20)

Similar a Apache Pulsar and Github

Similar a Apache Pulsar and Github (20)

Más de StreamNative

Más de StreamNative (20)

Último

Último (20)

Apache Pulsar and Github