Graphical Data Exploration
•
1 like•1,201 views
Slides from the Innovation Enterprise conference on data visualization. The talk focusses on exploratory data analysis and and the power of graphics. Towards the end, the talk goes into keeping data exploration a realtime process by sampling data that would put CPUs under pressure for a long time. The slides are meant to be additional to the verbal presentation, so the slides may be a bit hard to follow.
Recommended
Recommended
More Related Content
Similar to Graphical Data Exploration
Similar to Graphical Data Exploration (20)
More from Eli Bressert
Recently uploaded
Recently uploaded (20)
Graphical Data Exploration
- 1. Graphical Data Exploration Eli Bressert @astrobiased Stitch Fix / Data Labs
- 4. 1. obtain data 2. explore 3. do research/create data product 4. fine tune project and release 5. rinse and repeat
- 5. 1. obtain data 2.explore 3. do research/create data product 4. fine tune project and release 5. rinse and repeat
- 6. basic statistics simple graphics formulate hypotheses assess best models & approaches
- 10. 10 8.04 8 6.95 13 7.58 9 8.81 11 8.33 14 9.96 6 7.24 4 4.26 12 10.84 7 4.82 5 5.68 10 9.14 8 8.14 13 8.74 9 8.77 11 9.26 14 8.1 6 6.13 4 3.1 12 9.13 7 7.26 5 4.74 10 7.46 8 6.77 13 12.74 9 7.11 11 7.81 14 8.84 6 6.08 4 5.39 12 8.15 7 6.42 5 5.73 8 6.58 8 5.76 8 7.71 8 8.84 8 8.47 8 7.04 8 5.25 19 12.5 8 5.56 8 7.91 8 6.89 I II III IV
- 11. import seaborn as sns #awsm package from scipy.optimize import curve_fit def func(x, a, b): return a + b * x df = sns.load_dataset(“anscombe") df.x.mean() df.y.mean() df.x.var() df.y.var() df.x.corr(tmp.y)) popt, pcov = curve_fit(func, tmp.x, tmp.y)
- 12. Mean x: 9.0 Mean y: 7.5 Variance x: 11.00 Variance y: 4.13 Correlation between x and y: 0.816 Linear regression coefficients: y = 3.00 + 0.50x http://goo.gl/Zuw4Qe
- 13. 2 4 6 8 10 12 14 y dataVet I dataVet II 2 4 6 8 10 12 14 16 18 20 x 2 4 6 8 10 12 14 y dataVet III 2 4 6 8 10 12 14 16 18 20 x dataVet IV dataVet I II III IV
- 14. complexity
- 15. “Now if the function of man is an activity of soul in accordance with, or not without, rational principle, and if we say a so-and-so and a good so-and-so have a function which is the same in kind, e.g. a lyre-player and a good lyre- player, and so without qualification in all cases, eminence in respect of excellence being added to the function (for the function of a lyre-player is to play the lyre, and that of a good lyre-player is to do so well): if this is the case, [and we state the function of man to be a certain kind of life, and this to be an activity or actions of the soul implying a rational principle, and the function of a man to be the good and noble performance of these, and if any action is well performed when it is performed in accordance with the appropriate excellence: if this is the case,] human good turns out to be activity of soul in conformity with excellence, and if there are more than one excellence, in conformity with the best and most complete.” Nicomachean Ethics, Aristotle
- 16. ಠ_ಠ
- 17. What did it all mean?
- 18. What did it all mean? Virtue
- 19. overly complex graphics is analogous to a run-on sentence
- 20. 0 50 100 150 200 250 0 50 100 150 200 250 −1.700 −0.908 −0.116 0.676 1.468
- 21. (╯°□°)╯︵ ┻━┻
- 22. simplicity
- 23. Feature 1 Feature 2 Feature 3 Feature 4 Feature 5 Feature 6 Feature 7 Feature 8 Feature 9 Feature 10 Feature 11 Feature 12 Feature 13 Feature 14 Feature 15 Feature 16 Feature 17 Feature 18 Feature 19 Feature 20 Feature 21 Feature 22 Feature 23 Feature 24
- 24. Feature1 Feature2 Feature3 Feature4 Feature5 Feature6 Feature7 Feature8 Feature9 Feature10 Feature11 Feature12 Feature13 Feature14 Feature15 Feature16 Feature17 Feature18 Feature19 Feature20 Feature21 Feature22 Feature23 Feature 2 Feature 3 Feature 4 Feature 5 Feature 6 Feature 7 Feature 8 Feature 9 Feature 10 Feature 11 Feature 12 Feature 13 Feature 14 Feature 15 Feature 16 Feature 17 Feature 18 Feature 19 Feature 20 Feature 21 Feature 22 Feature 23 Feature 24 −1.0 −0.8 −0.6 −0.4 −0.2 0.0 0.2 0.4 0.6 0.8 1.0
- 25. −4 −2 0 2 4 6 3C1 −4 −3 −2 −1 0 1 2 3 4 5 3C2
- 27. JavaScript SVG Canvas D3.js Vega Lyra Vegalite Voyager Polestar Credit: Jeff Heer
- 28. JavaScript SVG Canvas D3.js Vega Lyra Vegalite Voyager Polestar Credit: Jeff Heer
- 31. EDA results will affect all that follows
- 33. processing speed
- 35. bigger data
- 37. You have two options
- 38. design your data sample plan and execute hit the big red button and wait for the process to finish
- 40. attention span
- 41. ?
- 42. time cost
- 43. hit red button design and sample explore, hypothesize, model explore, hypothesize, model time
- 44. hit red button design and sample explore, hypothesize, model explore, hypothesize, model time
- 46. ?