Investigating data scientists

Investigating Data Scientists
Bob. E. Hayes, PhD
bob@businessoverbroadway.com
@bobehayes

2Copyright © 2015 Business Over Broadway and AnalyticsWeek
Who I am
Scientist /
Blogger
Author
Consultant

Business Over Broadway
Solve problems, primarily business problems,
through the use of the scientific method
Founder
Using data and analytics to help make decisions that
are based on fact, not hyperbole.
AnalyticsWeek
Help businesses optimize their data/analytics
Chief Research Officer
Improving talent/technology recruitment, facilitating
deeper community engagement with the power of
online/offline channels and advancing knowledge
through research
What I do

What is the role of a data scientist?
Quotes from the article: What is the role of a data scientist in the insight economy?

Data Science Study
• Invited data professionals via:
– AnalyticsWeek Newsletter
– Blog post
– Analytics.Club
• 600+ completed surveys
– Self-assessment rating of proficiency of 25 skills across
five skill areas:
• Business, Technology, Programming, Math & Modeling,
Statistics
– 9 additional questions
– Overall satisfaction with work outcome

Data Science Skills Assessed
Area Skills*
Business
1.Product design and development
2.Project management
3.Business development
4.Budgeting
5.Governance & Compliance (e.g., security)
Technology
6.Managing unstructured data (e.g., noSQL)
7.Managing structured data (e.g., SQL, JSON, XML)
8.Natural Language Processing (NLP) and text mining
9.Machine Learning (e.g., decision trees, neural nets, Support Vector Machine, clustering)
10.Big and Distributed Data (e.g., Hadoop, Map/Reduce, Spark)
Math &
Modeling
11.Optimization (e.g., linear, integer, convex, global)
12.Math (e.g., linear algebra, real analysis, calculus)
13.Graphical Models (e.g., social networks)
14.Algorithms (e.g., computational complexity, Computer Science theory) and Simulations (e.g., discrete, agent-based, continuous)
15.Bayesian Statistics (e.g., Markov Chain Monte Carlo)
Programming
16.Systems Administration (e.g., UNIX) and Design
17.Database Administration (MySQL, NOSQL)
18.Cloud Management
19.Back-End Programming (e.g., JAVA/Rails/Objective C)
20.Front-End Programming (e.g., JavaScript, HTML, CSS)
Statistics
21.Data Management (e.g., recoding, de-duplicating, Integrating disparate data sources, Web scraping)
22.Data Mining (e.g. R, Python, SPSS, SAS) and Visualization (e.g., graphics, mapping, web-based data visualization) tools
23.Statistics and statistical modeling (e.g., general linear model, ANOVA, MANOVA, Spatio-temporal, Geographical Information System (GIS))
24.Science/Scientific Method (e.g., experimental design, research design)
25.Communication (e.g., sharing results, writing/publishing, presentations, blogging)
* List of skills adapted from Analyzing the Analyzers by Harlan D. Harris, Sean Patrick Murphy and Marck Vaisman

Proficiency Ratings*
Proficiency
Level
Scale
Value
Description
Don't know 0 You possess no knowledge
Fundamental
Awareness
20
You have a common knowledge or an understanding of basic
techniques and concepts.
Novice 40
You have the level of experience gained in a classroom and/or
experimental scenarios or as a trainee on-the-job. You are expected
to need help when performing this skill.
Intermediate 60
You are able to successfully complete tasks in this competency as
requested. Help from an expert may be required from time to time, but
you can usually perform the skill independently.
Advanced 80
You can perform the actions associated with this skill without
assistance. You are certainly recognized within your immediate
organization as "a person to ask" when difficult questions arise
regarding this skill.
Expert 100
You are known as an expert in this area. You can provide guidance,
troubleshoot and answer questions related to this area of expertise
and the field where the skill is used.
* Rating scale is based on a proficiency rating scale used by NIH. Respondent instructions: You will be asked about your
proficiency for a variety of skills. Please use the following scale when indicating your level of proficiency for each skill.

Sample

Proficiency varies across skills

Job Roles in Data Science
*Researcher (e.g., researcher, scientist, statistician); Business Management (e.g., leader, business person,
entrepreneur); Creative (e.g., jack of all trades, artist, hacker); Developer (e.g., developer, engineer)

Proficiency varies by job role – 1st Look

Proficiency varies by job role – 2nd Look

Structure of Data Science Skills
* Factor analysis is based on proficiency ratings of 621 data professionals. Reliability (Cronbach’s alpha for each of the
three Skills areas (based on items that loaded on the respective factors) were: .87 (Business); .92 (Tech / Prog); .92
(Math / Stats)
Factor Analysis of Data Skills
• Data reduction technique
• Examines the statistical relationships (e.g.,
correlations) among a large set of
variables and tries to explain these
correlations using a smaller number of
variables (factors)
• Elements (or factor loadings) of the factor
pattern matrix represent the strength of
relationship between the variables and
each of the underlying factors
• Tells us two things:
1. number of underlying factors that
describe the initial set of variables
2. which variables are best
represented by each factor

Structure of Data Science Skills
* Factor analysis is based on proficiency ratings of 621 data professionals. Reliability (Cronbach’s alpha for each of the
three Skills areas (based on items that loaded on the respective factors) were: .87 (Business); .92 (Tech / Prog); .92
(Math / Stats)
Plot the factor loadings
for the 25 data skills into
a 3-dimensional space
Three Distinct Skill Sets
• Business
• Technology / Programming
• Math / Statistics

The Structure of Data Science Skills

Proficiency varies by job role – 3rd
Look

Proficiency varies by job role – 4th
Look
*Researcher (e.g., researcher, scientist, statistician) n = 133; Business Management (e.g., leader, business person,
entrepreneur) n = 86; Creative (e.g., jack of all trades, artist, hacker) n = 30; Developer (e.g., developer, engineer) n = 54

Top Data Science Skills by Job Role

Satisfaction with Work Outcome
*Researcher (e.g., researcher, scientist, statistician); Business Management (e.g., leader, business person,
entrepreneur); Creative (e.g., jack of all trades, artist, hacker); Developer (e.g., developer, engineer)

In Search of the Data Scientist
Unicorn

Data Science as a Team Sport
Impact of Business Expert

Impact of Technology / Programming Expert

Impact of Math & Modeling / Statistics Expert

Getting Insight from Data: The Scientific Method

Scientific Method and Data Science Skills

Skill Proficiency Drives Satisfaction with Work
Outcome

What skills are linked to project
success?

Importance of Data Science Skills by Job
Role

Impact of Data Mining and Viz Tools

EXPERT
PROFICIENCY
NO
PROFICIENCY
Skill-Based Approach to Improve the Practice of Data Science
IMPROVE /
INVEST
DIVEST
DON’T
OVERINVEST
STAY THE
COURSE
SKILL ESSENTIAL TO
PROJECT OUTCOME
SKILL NOT ESSENTIAL
TO PROJECT OUTCOMECopyright 2015 Business Over Broadway

35Copyright © 2015 Business Over Broadway and AnalyticsWeek-.10
.00
.10
.20
.30
.40
.50
.60
0 20 40 60 80 100
Business Management
EXPERTNONE
Skill-Based Method to Improve Data Science
Data Mining and
Viz Tools
Big and distributed data
Business Management
Science / Scientific Method
Statistics / Statistical Modeling
Machine Learning
Bayesian Statistics
Unstructured data
Optimization
Algorithms
NOT ESSENTIAL
ESSENTIAL
Copyright 2015 Business Over Broadway

EXPERTNONE
Systems Administration
Developer
Data Mining and Viz Tools
NOT ESSENTIAL
ESSENTIAL

EXPERTNONE
Business Development
Creative
Optimization
Math
Data Mining
and Viz Tools
Graphical Models
NOT ESSENTIAL
ESSENTIAL

ImpactonSatisfactionwithOutcome
Proficiency
EXPERTNONE
NOT ESSENTIAL
ESSENTIAL
Big and distributed data
Bayesian Statistics
Researcher
Data Management
Machine Learning
AlgorithmsProduct Design

Lack of Gender Diversity

Lack of Gender Diversity – Other Science
Roles

Job Roles in Data Science by Gender

Highest Level of Education Attained

Gender Comparison of Proficiency across Skills

Advice for Data Scientists
• Take the Data Science Skills Survey at: http://pxl.me/awrds3
• Be specific when talking about “data scientists”
• There are different types – defined by what they do and the skills
they possess
• Work with other data professionals who have
complementary skills. Teamwork is key to success.
• Learn to use data mining and visualization tools
• R, Python, SPSS, SAS, graphics, mapping, web-based data
visualization
• Be an advocate for women in the field of data science

Bob E. Hayes, Ph.D.
Email: bob@analyticsweek.com and bob@businessoverbroadway.com
Web: www.analyticsweek.com and www.businessoverbroadway.com
Blog: www.businessoverbroadway.com/blog
Twitter: www.twitter.com/bobehayes

Investigating data scientists

Recomendados

Recomendados

Más contenido relacionado

Similar a Investigating data scientists

Similar a Investigating data scientists (20)

Más de Business Over Broadway

Más de Business Over Broadway (16)

Último

Último (20)

Investigating data scientists

Notas del editor