SlideShare a Scribd company logo
1 of 5
BDE Team Review
Apr.2, 2013
Big Data Engineering Team
Schubert Zhang
(内部资料,不公开)
• 此处省略8页 …
2
Our Lessons
• 思考 – 试错 – 学习 – 成长
o 从实践中得到的lessons效果更好,并容易牢记
• Learn by Doing(从实践和做事中学习和提
升) + 闲暇时对薄弱的专题做系统性地补习
(读好书/读好代码)
o 目前信息Input太多,Weibo/Blogs/News/技术评论等太多,光
看这些虽然可扩大视野,但得不到大的实质的提升,偶尔也会让
自己越来越不踏实
o 寻找心灵踏实的方法 (1) Do, (2) 系统学习/深入理解原理
• 快速交付,快速反馈
o 没有100%完美
o 作为一名工程师,总是喜欢100%解决掉客户的问题,但有时客户
没有这么高的期望,只要你往前走一步,他就已经很满意了,重
要的是快速行动快速反馈。 -- from Sina WeiBo
o 在开发和现场工作中
o 从简单开始做起
3
Our Lessons
• 做好自己的产品和工作,将自己发挥得尽量好就可以了,不过分在意对手的看法和对手
的情况
• 思考,在脑子中理清思路。如果所有逻辑在脑子中是流程并通顺的,就不会出大问题。
o thinking before debugging is extremely important: “当你的程序运行异常时,不要使用debug工具,用你的大脑。”代码出现问
题后,先思考非常重要,思考为什么会出现这样的问题,而不是一味的加打印,用调试工具;出现问题后,好好仔仔细细读读自己写
的代码也非常有必要。
o thinking before mimicing and reworking is also extremely important:对设计实现和重构依然有效
o http://www.informit.com/articles/article.aspx?p=1941206, Shared by Anty
o http://www.aqee.net/want-to-write-some-code-get-away-from-your-computer/ “远离计算机能迫使你在大脑里周全的思考
所有的问题”
o http://www.charlespetzold.com/etc/DoesVisualStudioRotTheMind.html
• 程序中多做统计点并经常查看这些统计情况
o 多日常关键操作点进行统计
o 对异常情况进行统计
o 让程序可以及方便地打印出历史统计,并可以将历史统计清零
o 是Log的有效并高效的补充,非常适用于系统监控和定位问题 (甚至可以在生产系统中关键统计展示到Ganglia)
• Stay Simple
4
Our Lessons
• 善于借鉴和集成使用已有的程序、代
码、工具等
o Leveraging Open Source and Communities
o 分享知识 (文章、代码、观点)
5
• 讲给别人听,写给别人看
o 表达清楚易懂
o “如果你不能简单说清楚,那么就是你还没有完全明
白”——有人说是爱因斯坦说的,不知真假
o http://tumblr.austinkleon.com/post/1262929388
o http://gigix.thoughtworkers.org/2013/3/28/why-
programmers-should-write-articles

More Related Content

Viewers also liked

HBase Coprocessor Introduction
HBase Coprocessor IntroductionHBase Coprocessor Introduction
HBase Coprocessor IntroductionSchubert Zhang
 
DaStor/Cassandra report for CDR solution
DaStor/Cassandra report for CDR solutionDaStor/Cassandra report for CDR solution
DaStor/Cassandra report for CDR solutionSchubert Zhang
 
Hadoop大数据实践经验
Hadoop大数据实践经验Hadoop大数据实践经验
Hadoop大数据实践经验Schubert Zhang
 
Introduction To HBase
Introduction To HBaseIntroduction To HBase
Introduction To HBaseAnil Gupta
 
HBase Vs Cassandra Vs MongoDB - Choosing the right NoSQL database
HBase Vs Cassandra Vs MongoDB - Choosing the right NoSQL databaseHBase Vs Cassandra Vs MongoDB - Choosing the right NoSQL database
HBase Vs Cassandra Vs MongoDB - Choosing the right NoSQL databaseEdureka!
 
Engineering practices in big data storage and processing
Engineering practices in big data storage and processingEngineering practices in big data storage and processing
Engineering practices in big data storage and processingSchubert Zhang
 

Viewers also liked (8)

Career Advice
Career AdviceCareer Advice
Career Advice
 
HBase Coprocessor Introduction
HBase Coprocessor IntroductionHBase Coprocessor Introduction
HBase Coprocessor Introduction
 
DaStor/Cassandra report for CDR solution
DaStor/Cassandra report for CDR solutionDaStor/Cassandra report for CDR solution
DaStor/Cassandra report for CDR solution
 
Hadoop大数据实践经验
Hadoop大数据实践经验Hadoop大数据实践经验
Hadoop大数据实践经验
 
HiveServer2
HiveServer2HiveServer2
HiveServer2
 
Introduction To HBase
Introduction To HBaseIntroduction To HBase
Introduction To HBase
 
HBase Vs Cassandra Vs MongoDB - Choosing the right NoSQL database
HBase Vs Cassandra Vs MongoDB - Choosing the right NoSQL databaseHBase Vs Cassandra Vs MongoDB - Choosing the right NoSQL database
HBase Vs Cassandra Vs MongoDB - Choosing the right NoSQL database
 
Engineering practices in big data storage and processing
Engineering practices in big data storage and processingEngineering practices in big data storage and processing
Engineering practices in big data storage and processing
 

More from Schubert Zhang

Engineering Culture and Infrastructure
Engineering Culture and InfrastructureEngineering Culture and Infrastructure
Engineering Culture and InfrastructureSchubert Zhang
 
Simple practices in performance monitoring and evaluation
Simple practices in performance monitoring and evaluationSimple practices in performance monitoring and evaluation
Simple practices in performance monitoring and evaluationSchubert Zhang
 
Ganglia轻度使用指南
Ganglia轻度使用指南Ganglia轻度使用指南
Ganglia轻度使用指南Schubert Zhang
 
Learning from google megastore (Part-1)
Learning from google megastore (Part-1)Learning from google megastore (Part-1)
Learning from google megastore (Part-1)Schubert Zhang
 
Hanborq optimizations on hadoop map reduce 20120221a
Hanborq optimizations on hadoop map reduce 20120221aHanborq optimizations on hadoop map reduce 20120221a
Hanborq optimizations on hadoop map reduce 20120221aSchubert Zhang
 
Cassandra Compression and Performance Evaluation
Cassandra Compression and Performance EvaluationCassandra Compression and Performance Evaluation
Cassandra Compression and Performance EvaluationSchubert Zhang
 
The World of Structured Storage System
The World of Structured Storage SystemThe World of Structured Storage System
The World of Structured Storage SystemSchubert Zhang
 
Distributed Filesystems Review
Distributed Filesystems ReviewDistributed Filesystems Review
Distributed Filesystems ReviewSchubert Zhang
 
Red Hat Global File System (GFS)
Red Hat Global File System (GFS)Red Hat Global File System (GFS)
Red Hat Global File System (GFS)Schubert Zhang
 
无线信息传媒的技术分析和商业模式
无线信息传媒的技术分析和商业模式无线信息传媒的技术分析和商业模式
无线信息传媒的技术分析和商业模式Schubert Zhang
 
Case Study - How Rackspace Query Terabytes Of Data
Case Study - How Rackspace Query Terabytes Of DataCase Study - How Rackspace Query Terabytes Of Data
Case Study - How Rackspace Query Terabytes Of DataSchubert Zhang
 
HFile: A Block-Indexed File Format to Store Sorted Key-Value Pairs
HFile: A Block-Indexed File Format to Store Sorted Key-Value PairsHFile: A Block-Indexed File Format to Store Sorted Key-Value Pairs
HFile: A Block-Indexed File Format to Store Sorted Key-Value PairsSchubert Zhang
 

More from Schubert Zhang (16)

Blockchain in Action
Blockchain in ActionBlockchain in Action
Blockchain in Action
 
科普区块链
科普区块链科普区块链
科普区块链
 
Engineering Culture and Infrastructure
Engineering Culture and InfrastructureEngineering Culture and Infrastructure
Engineering Culture and Infrastructure
 
Simple practices in performance monitoring and evaluation
Simple practices in performance monitoring and evaluationSimple practices in performance monitoring and evaluation
Simple practices in performance monitoring and evaluation
 
Ganglia轻度使用指南
Ganglia轻度使用指南Ganglia轻度使用指南
Ganglia轻度使用指南
 
Big data and cloud
Big data and cloudBig data and cloud
Big data and cloud
 
Learning from google megastore (Part-1)
Learning from google megastore (Part-1)Learning from google megastore (Part-1)
Learning from google megastore (Part-1)
 
Hanborq optimizations on hadoop map reduce 20120221a
Hanborq optimizations on hadoop map reduce 20120221aHanborq optimizations on hadoop map reduce 20120221a
Hanborq optimizations on hadoop map reduce 20120221a
 
Cassandra Compression and Performance Evaluation
Cassandra Compression and Performance EvaluationCassandra Compression and Performance Evaluation
Cassandra Compression and Performance Evaluation
 
The World of Structured Storage System
The World of Structured Storage SystemThe World of Structured Storage System
The World of Structured Storage System
 
Distributed Filesystems Review
Distributed Filesystems ReviewDistributed Filesystems Review
Distributed Filesystems Review
 
Red Hat Global File System (GFS)
Red Hat Global File System (GFS)Red Hat Global File System (GFS)
Red Hat Global File System (GFS)
 
pNFS Introduction
pNFS IntroductionpNFS Introduction
pNFS Introduction
 
无线信息传媒的技术分析和商业模式
无线信息传媒的技术分析和商业模式无线信息传媒的技术分析和商业模式
无线信息传媒的技术分析和商业模式
 
Case Study - How Rackspace Query Terabytes Of Data
Case Study - How Rackspace Query Terabytes Of DataCase Study - How Rackspace Query Terabytes Of Data
Case Study - How Rackspace Query Terabytes Of Data
 
HFile: A Block-Indexed File Format to Store Sorted Key-Value Pairs
HFile: A Block-Indexed File Format to Store Sorted Key-Value PairsHFile: A Block-Indexed File Format to Store Sorted Key-Value Pairs
HFile: A Block-Indexed File Format to Store Sorted Key-Value Pairs
 

Big Data Engineering Team review 20130403

  • 1. BDE Team Review Apr.2, 2013 Big Data Engineering Team Schubert Zhang
  • 3. Our Lessons • 思考 – 试错 – 学习 – 成长 o 从实践中得到的lessons效果更好,并容易牢记 • Learn by Doing(从实践和做事中学习和提 升) + 闲暇时对薄弱的专题做系统性地补习 (读好书/读好代码) o 目前信息Input太多,Weibo/Blogs/News/技术评论等太多,光 看这些虽然可扩大视野,但得不到大的实质的提升,偶尔也会让 自己越来越不踏实 o 寻找心灵踏实的方法 (1) Do, (2) 系统学习/深入理解原理 • 快速交付,快速反馈 o 没有100%完美 o 作为一名工程师,总是喜欢100%解决掉客户的问题,但有时客户 没有这么高的期望,只要你往前走一步,他就已经很满意了,重 要的是快速行动快速反馈。 -- from Sina WeiBo o 在开发和现场工作中 o 从简单开始做起 3
  • 4. Our Lessons • 做好自己的产品和工作,将自己发挥得尽量好就可以了,不过分在意对手的看法和对手 的情况 • 思考,在脑子中理清思路。如果所有逻辑在脑子中是流程并通顺的,就不会出大问题。 o thinking before debugging is extremely important: “当你的程序运行异常时,不要使用debug工具,用你的大脑。”代码出现问 题后,先思考非常重要,思考为什么会出现这样的问题,而不是一味的加打印,用调试工具;出现问题后,好好仔仔细细读读自己写 的代码也非常有必要。 o thinking before mimicing and reworking is also extremely important:对设计实现和重构依然有效 o http://www.informit.com/articles/article.aspx?p=1941206, Shared by Anty o http://www.aqee.net/want-to-write-some-code-get-away-from-your-computer/ “远离计算机能迫使你在大脑里周全的思考 所有的问题” o http://www.charlespetzold.com/etc/DoesVisualStudioRotTheMind.html • 程序中多做统计点并经常查看这些统计情况 o 多日常关键操作点进行统计 o 对异常情况进行统计 o 让程序可以及方便地打印出历史统计,并可以将历史统计清零 o 是Log的有效并高效的补充,非常适用于系统监控和定位问题 (甚至可以在生产系统中关键统计展示到Ganglia) • Stay Simple 4
  • 5. Our Lessons • 善于借鉴和集成使用已有的程序、代 码、工具等 o Leveraging Open Source and Communities o 分享知识 (文章、代码、观点) 5 • 讲给别人听,写给别人看 o 表达清楚易懂 o “如果你不能简单说清楚,那么就是你还没有完全明 白”——有人说是爱因斯坦说的,不知真假 o http://tumblr.austinkleon.com/post/1262929388 o http://gigix.thoughtworkers.org/2013/3/28/why- programmers-should-write-articles