Recomendados
Más contenido relacionado
La actualidad más candente
La actualidad más candente (20)
Destacado
Destacado (20)
Similar a 新浪微博开放平台Redis实战
Similar a 新浪微博开放平台Redis实战 (20)
Más de mysqlops
Más de mysqlops (20)
Último
Último (20)
新浪微博开放平台Redis实战
- 1. Redis @ http://weibo.com/tangfl http://fulin.org
- 2. • Redis • Redis • • redis • redis •
- 3. Redis • in memory (database?) • data can dump to disk • many useful data structure • FAST both read and write • we start use from 2.0, now 2.4
- 4. =feed+ +
- 5. =feed+ + • feed • •
- 6. =feed+ +
- 7. =feed+ + • • •
- 8. =feed+ +
- 9. =feed+ + • • • @ • @ •
- 10. =feed+ +
- 11. =feed+ + • • • @ • @ •
- 12. =feed+ +
- 13. =feed+ + • • • @ • @ •
- 14. =feed+ +
- 15. =feed+ + • • • @ • @ •
- 16. =feed+ +
- 17. =feed+ + •feed • mysql • mc
- 18. =feed+ + •
- 19. =feed+ + • mysql: relation.following • fromuid, touid, addtime • addtime desc select * from following where fromuid=? order by • addtime desc select * from following where touid=? order by • fromuid, touid
- 20. =feed+ + • mysql: relation.following relation.follower • fromuid, touid, addtime • addtime desc select * from following where fromuid=? order by • desc select * from follower where touid=? order by addtime •
- 21. =feed+ + • • • • •
- 22. =feed+ + • ta • ta • ta •
- 23. =feed+ + • • c/java • • •
- 24. =feed+ + • redis • hash : • key : user id • fields : friends ids • value : add time
- 25. =feed+ + • redis • hash : • hset fromuid.following touid addtime • hset touid.follower fromuid addtime • hgetAll fromuid. following • hgetAll touid.follower ? • 11,704,598 @Wed Sep 7 21:46:33 CST 2011
- 26. =feed+ + • hash: get one or get all • hash-max-zip-size • 64 -> 256 1/3 • cpu • hgetAll cost too much cpu • add mc • high delay
- 27. =feed+ +
- 28. =feed+ + • • cache ? waste too much mem • storage ? • rdb may lost data • aof r/w too slow, recover too slow • all data in mem, waste money • HA : master slave ? NO WAY • memory fragment
- 29. =feed+ +
- 30. =feed+ + • • mysql binlog >> queue >> Java Processor >> redis • mysql binlog >> trigger >> redis
- 31. =feed+ + • • redis@weibo for now: • TB • growing fast
- 32. =feed+ + • •@ mysql modified + innodb • following list of a user in one column • still under dev
- 33. =feed+ + •
- 34. =feed+ + • • • •@ • •
- 35. =feed+ +
- 36. =feed+ + • • • @ • • • js
- 37. =feed+ + • mc + queue + mysql • mysql • mc mysql • mc
- 38. =feed+ + • • • • •
- 39. =feed+ + • redis • • k-v , 100 byte per k-v • mc • • hash , hget pipeline slow
- 40. =feed+ + • • rdb ? may lost data • aof ? grow too fast (4G/day) • bgsave/bgrewriteaof influence parent
- 41. =feed+ +
- 42. =feed+ + • redis rolling • • • • key
- 43. =feed+ + • • rediscounter @ • array , not linked list • malloc all mem when start • hash key to position • write disk: asyn & slow down • add position to aof file
- 44. =feed+ + • • rediscounter + innodb • auto roll cold data to disk
- 45. =feed+ + • • @TimYang • @XiaoJunHong • • redis (delay) - mc (throughput) - java hash map
- 46. • • cache • storage
- 47. • • • • + •
- 48. • • • / • •
- 49. • • • rdb or aof • •
- 50. • • • rehash
- 51. • HA / Cluster • Redis • Jedis • • •
- 52. • CPU • Redis • hset with big hash-max-zip-size • hgetAll • mc
- 53. • • • • •
- 54. Thanks PS. We are hiring ! contact me via @
- 55. Q &A @ http://weibo.com/tangfl http://fulin.org