© Copyright 2015 EMC Corporation. All rights reserved. 1

© Copyright 2015 EMC Corporation. All rights reserved.
1
DATA SCIENCE — НАУКА О ТОМ,
КАК ЗАСТАВИТЬ ДАННЫЕ
РАБОТАТЬ НА ВАС
IVAN KHVOSTISHKOV — EMC R&D CENTER
© Copyright 2015 EMC Corporation. All rights reserved.
2
FOUR “V” OF BIG DATA
Volume
Velocity
Big Data
Variety
© Copyright 2015 EMC Corporation. All rights reserved.
Variability
DATA SCIENCE VS. BUSINESS INTELLIGENCE
Business
value
Data
Science
High
Business
Intelligence
Low
Past
© Copyright 2015 EMC Corporation. All rights reserved.
Future
Time
DATA SCIENCE VS. BUSINESS INTELLIGENCE
Business
value
Real-Time
Non real-time
Very long time
DS
EDW
DS
High
Low
Millis
© Copyright 2015 EMC Corporation. All rights reserved.
Hours
Time
INDUSTRY VERTICALS
EXAMPLES
Health Care
Public
Services
Life Sciences
IT
Infrastructure
Online
Services
…
© Copyright 2015 EMC Corporation. All rights reserved.
NIT: SCIENTIFIC AND TECHNICAL PROJECT
Saint Petersburg
Moscow
Astana
Almaty
Data Size
Public data: 1 TB
Articles: 5 000 000
Comments: 100 000 000
Private data: 70 TB
© Copyright 2015 EMC Corporation. All rights reserved.
QUALITY ANALYSIS SYSTEM
PROBLEM STATEMENT
World Wide Web
Kazakhstan Government Services
and Information Online
Sentiment
Relevance
© Copyright 2015 EMC Corporation. All rights reserved.
EXAMPLE DATA FLOW
Resource 1
Resource 2
Hive
import
Resource 3
Resource 4
Resource 5
© Copyright 2015 EMC Corporation. All rights reserved.
Solr
import
EMC2
parsers
NIT
parsers
Model execution
BI
Dashboard
Results
dump
© Copyright 2015 EMC Corporation. All rights reserved.
DATA SCIENTIST
Quantitative
Curious &
Creative
Technical
Data
Scientist
Skeptical
© Copyright 2015 EMC Corporation. All rights reserved.
Communicative
& Collaborative
DATA ANALYTICS LIFECYCLE
Discovery
Operationalize
Data
Preparation
Communicate
Results
Model
Planning
Model Building
© Copyright 2015 EMC Corporation. All rights reserved.
BACKUP
© Copyright 2015 EMC Corporation. All rights reserved.
THANK YOU
[email protected]
Principal Solutions Engineer
EMC R&D Center (Skolkovo)
© Copyright 2015 EMC Corporation. All rights reserved.
DATA SCIENCE VS. BUSINESS INTELLIGENCE
© Copyright 2015 EMC Corporation. All rights reserved.