Handling Data in Mega Scale Web Systems

Vineet Gupta | GM – Software Engineering | Directi http://www.vineetgupta.com Licensed under Creative Commons Attribution Sharealike Noncommercial Intelligent People. Uncommon Ideas.

[object Object],[object Object],[object Object],[object Object],Source: http://highscalability.com/digg-architecture

[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],Source: http://www.royans.net/arch/2007/10/25/scaling-technorati-100-million-blogs-indexed-everyday/

[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],Source: http://mysqldba.blogspot.com/2008/04/mysql-uc-2007-presentation-file.html

[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],Source: http://highscalability.com/ebay-architecture/

[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],Source: http://highscalability.com/google-architecture/

[object Object],[object Object],[object Object],[object Object],[object Object]

Host App Server DB Server RAM CPU CPU CPU RAM RAM

Sunfire X4640 M2 8 x 6-core 2.6 GHz $ 27k to $ 170k PowerEdge R200 Dual core 2.8 GHz Around $ 550

[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

T1, T2, T3, T4 App Layer T1, T2, T3, T4 T1, T2, T3, T4 T1, T2, T3, T4 T1, T2, T3, T4 ,[object Object],[object Object]

[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Master App Layer Slave Slave Slave Slave ,[object Object],[object Object],[object Object]

Master App Layer Master Slave Slave Slave ,[object Object],[object Object],[object Object]

Write Read Write Read Write Read Write Read Write Read Write Read Write Read ,[object Object],[object Object],[object Object],[object Object]

[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

T3 App Layer T4 T5 T2 T1 ,[object Object],[object Object]

T3 App Layer T4 T5 T2 T1 First million rows T3 T4 T5 T2 T1 Second million rows T3 T4 T5 T2 T1 Third million rows

Source: http://citeseerx.ist.psu.edu/viewdoc/summary?doi=10.1.1.20.1495

[object Object],[object Object],[object Object],Emp # Emp Name Mgr # Mgr Name Emp Phone Mgr Phone 47 Joe 13 Sam 5-1234 6-9876 18 Sally 38 Harry 3-3123 5-6782 91 Pete 13 Sam 2-1112 6-9876 66 Mary 02 Betty 5-7349 4-0101 Classic problem with de-normalization Can’t update Sam’s phone # since there are many copies De-normalization is OK if you aren’t going to update! Source: http://blogs.msdn.com/pathelland/

[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

[object Object],[object Object],[object Object]

[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Intelligent People. Uncommon Ideas. Licensed under Creative Commons Attribution Sharealike Noncommercial

Handling Data in Mega Scale Web Systems

Recomendados

Recomendados

Más contenido relacionado

La actualidad más candente

La actualidad más candente (19)

Destacado

Destacado (11)

Similar a Handling Data in Mega Scale Web Systems

Similar a Handling Data in Mega Scale Web Systems (20)

Último

Último (20)

Handling Data in Mega Scale Web Systems