SlideShare a Scribd company logo

Double Your Hadoop Performance with Hortonworks SmartSense

•
•
DataWorks Summit/Hadoop Summit
DataWorks Summit/Hadoop Summit

This document compares the performance of Hive and Spark when running the BigBench benchmark. It outlines the structure and use cases of the BigBench benchmark, which aims to cover common Big Data analytical properties. It then describes sequential performance tests of Hive+Tez and Spark on queries from the benchmark using a HDInsight PaaS cluster, finding variations in performance between the systems. Concurrency tests are also run by executing multiple query streams in parallel to analyze throughput.

1 of 28
Download to read offline
UsingBigBenchtocompareUsingBigBenchtocompare HiveandSparkHiveandSpark NicolasPoggi,AlejandroNicolasPoggi,AlejandroMonteroMontero April2017
Outline 1.IntrotoBSCandALOJA 2.BigBench 3.Sequen;altests 1.Datascales 4.Concurrencytests 5.Summary 2
Barcelona Supercompu.ng Center (BSC) •Spanishna*onalsupercompu*ngcenter22yearshistoryin: •ComputerArchitecture,networkinganddistributedsystems research •BasedatBarcelonaTechUniversity(UPC) •Largeongoinglifesciencecomputa*onalprojects •Prominentbodyofresearchac*vityaroundHadoopHadoop •2008-2013:SLAAdap*veScheduler,Accelerators,Locality Awareness,PerformanceManagement.7publica*ons7publica*ons •2013-Present:CCost-efficientupcomingBigDataarchitectures (ALOJAALOJA)8+8+publica*onspublica*ons
ALOJA: towards cost-effec2ve Big Data •Researchprojectforautoma1ngcharacteriza1onand op1miza1onofBigDataBigDatadeployments •OpensourceBenchmarking-to-Insightspla?ormandtools •LargestBigDatapublicrepository(70,000+jobs) •Communitycollabora1onwithindustryandacademia hJp://aloja.bsc.eshJp://aloja.bsc.es BigDataBenchmarkingOnlineRepositoryWeb/ML Analytics
BenchmarkingandBigBench
Theneedforanewbenchmarkstandard •Abenchmarkcapturesthesolu3ontoaproblemandguidedecision making •Databaserelatedbenchmarksstandards •Transac3onal(OLTP):TPCCandE •DecisionSupport(DSS/OLAP):TPCHandDS •AndforBigDataanaly3csproper3es? •3Vs,ML,M/R •Benchmarkuses: •Systemtuninganddebugging •SpreadandbroadBigDataecosystem •Setcommonrules •Vendorcomparison •Transparencyacrosstheindustry 6
WhatisBigBench(TPCx-BB1)? •End-to-endapplica/onlevelbenchmark •resultofmanyyearsofcollabora/on •industryandacademia •CoversmostBigDataAnaly/calproper/es(3Vs) •Basedonaretailercompany(extensionofTPC-DS) 7[1]:http://www.tpc.org/tpc_documents_current_versions/pdf/tpcx-bb_v1.2.0.pdf BigBenchhistory
BigBenchusecasesandprocessoverview •3030businessusescasesbusinessusescasescovering: •MerchandisingMerchandising, •PricingOp9miza9onPricingOp9miza9on •ProductReturnProductReturn •CustomersCustomers... •Implementa9onresultedin: •14Declara9veDeclara9vequeries(SQL) •7QuerieswithNaturalLanguageProcessingNaturalLanguageProcessing •4Querieswithdatapreprocessingwith MapReducejobsMapReducejobs. •5QuerieswithMachineLearningMachineLearningpost processing. 8
BigBenchv1.2–ReferenceImplementa7on HDFS HiveMetastore MapReduceTezSpark Y ar n HiveSparkSQL MahoutMLCustomSparkMLlibMachine Learning SQL Engine TableMetastore Execution Engine Filesyste m Benchmarkedsystems: •Hive+MapReduce+Mahout •Hive+MapReduce+ Spark_MLlib •Hive+Tez+Mahout •Hive+Tez+Spark_MLlib •SparkSQL+Mahout •SparkSQL+Spark_MLlib •Spark2SQL+Mahout Workinprogress: •Hive2 •Spark2SQL+Spark_MLlib
Thecluster(I)–HDInsightPaaS 10 ModelD4v2 #Headnodes2 #Workingnodes4 #Zookeepernodes3 CPU Intel(R)Xeon(R)CPUE5- 2673v3 8x2,4GHzcores RAM28GB HDFSRemote SoftwareHortonWorksData Platform2.5 Non-conditionalmapjoinconversionwithsmalltableslesserthan319MB Softwareconfiguration Mapper/Reduccer/Tez memory 1536MB Mapper/Reduccer/Tez HeapSpace 1024MB Mapper/Reduccer/Tez Cores 1 HiveMapJoinsYes Sparkexecutors4 Sparkexecutormemory4608MB SparkexecutorCores3
Sequen&alruns(power) Queries1-30 Averageofthreeexecu&osof100GBScaleFactor11
BigBenchworkload–powertest 12 LoadtoHive Metastore Data GenerationQuery1HDFS Hive Query2 ….Query30
PureQL 13Averageofthreeexecutionsusing100GBScaleFactor
Query12CPUbehavior 14 Te z Spark 1.6.2 Spark 2.0.2 Averageofthreeexecutionsusing100GBScaleFactor
CustomReducers 15Averageofthreeexecutionsusing100GBScaleFactor
Query2CPUbehavior 16 Te z Spark 1.6.2 Spark 2.0.2 Averageofthreeexecutionsusing100GBScaleFactor
NaturalLanguageProcessing 17Averageofthreeexecutionsusing100GBScaleFactor
Query27CPUbehavior 18 Te z Spark 1.6.2 Spark 2.0.2 Averageofthreeexecutionsusing100GBScaleFactor
MachineLearning 19Averageofthreeexecutionsusing100GBScaleFactor
Query5CPUbehavior 20 Tez+ Mahout Tez+ Spark_MLlib Averageofthreeexecutionsusing100GBScaleFactor
21 Aggregated Results Averageofthreeexecutionsusing100GBScaleFactor
Scaling from 1GB to 1TB Logscales22
Concurrencyruns(throughput) 2,4,8parallelstreams 23
BigBenchworkload–Throughputtest 24 Query15Query21 ….Query16 Query12Query18 ….Query22 Query16Query30 ….Query29 LoadData Data GenerationHDFS Hive
Thecluster(II)–HDInsightPaaS 25 ModelHDInsightD4v3 #Headnodes2 #Workingnodes7 #Zookeepernodes3 CPU Intel(R)Xeon(R)CPUE5- 2673v3 8x2,4GHzcores RAM28GB 55GB(Headnode) HDFSRemote SoftwareHortonWorksData Platform2.5 Softwareconfiguration Mapper/Reduccer/Tez memory 1536MB Mapper/Reduccer/Tez HeapSpace 1024MB Mapper/Reduccer/Tez Cores 1 HiveMapJoinsYes Sparkexecutors9 Sparkexecutormemory4608MB SparkexecutorCores3 Non-conditionalmapjoinconversionwithsmalltableslesserthan319MB
SparkvsHive+Tezinthroughputtests 26
27
28

More Related Content

What's hot

Tiger graph 2021 corporate overview [read only]
Tiger graph 2021 corporate overview [read only]Tiger graph 2021 corporate overview [read only]
Tiger graph 2021 corporate overview [read only]
ercan5
 
Big data -_14._maerz_mitarbeiterforschung_kundenevent_v2.pptx__schreibgeschue...
Big data -_14._maerz_mitarbeiterforschung_kundenevent_v2.pptx__schreibgeschue...Big data -_14._maerz_mitarbeiterforschung_kundenevent_v2.pptx__schreibgeschue...
Big data -_14._maerz_mitarbeiterforschung_kundenevent_v2.pptx__schreibgeschue...
Aravindharamanan S
 
Three Dimensions of Data as a Service
Three Dimensions of Data as a ServiceThree Dimensions of Data as a Service
Three Dimensions of Data as a Service
Denodo
 
Enabling a Bimodal IT Framework for Advanced Analytics with Data Virtualization
Enabling a Bimodal IT Framework for Advanced Analytics with Data VirtualizationEnabling a Bimodal IT Framework for Advanced Analytics with Data Virtualization
Enabling a Bimodal IT Framework for Advanced Analytics with Data Virtualization
Denodo
 
Analyst Keynote: Forrester: Data Fabric Strategy is Vital for Business Innova...
Analyst Keynote: Forrester: Data Fabric Strategy is Vital for Business Innova...Analyst Keynote: Forrester: Data Fabric Strategy is Vital for Business Innova...
Analyst Keynote: Forrester: Data Fabric Strategy is Vital for Business Innova...
Denodo
 
NIIT and Denodo: Business Continuity Planning in the times of the Covid-19 Pa...
NIIT and Denodo: Business Continuity Planning in the times of the Covid-19 Pa...NIIT and Denodo: Business Continuity Planning in the times of the Covid-19 Pa...
NIIT and Denodo: Business Continuity Planning in the times of the Covid-19 Pa...
Denodo
 
Advanced Analytics for Any Data at Real-Time Speed
Advanced Analytics for Any Data at Real-Time SpeedAdvanced Analytics for Any Data at Real-Time Speed
Advanced Analytics for Any Data at Real-Time Speed
danpotterdwch
 
Security and governance
Security and governanceSecurity and governance
Security and governance
DataWorks Summit
 
Rick Mutsaers Informatica
Rick Mutsaers InformaticaRick Mutsaers Informatica
Rick Mutsaers Informatica
BigDataExpo
 
Powering the Intelligent Edge: HPE's Strategy and Direction for IoT & Big Data
Powering the Intelligent Edge: HPE's Strategy and Direction for IoT & Big DataPowering the Intelligent Edge: HPE's Strategy and Direction for IoT & Big Data
Powering the Intelligent Edge: HPE's Strategy and Direction for IoT & Big Data
DataWorks Summit
 
Data sciences and marketing analytics
Data sciences and marketing analyticsData sciences and marketing analytics
Data sciences and marketing analytics
MJ Xavier
 
Beyond the Data Lake - Matthias Korn, Technical Consultant at Data Virtuality
Beyond the Data Lake - Matthias Korn, Technical Consultant at Data VirtualityBeyond the Data Lake - Matthias Korn, Technical Consultant at Data Virtuality
Beyond the Data Lake - Matthias Korn, Technical Consultant at Data Virtuality
Dataconomy Media
 
doolyk_rev_p_001.compressed
doolyk_rev_p_001.compresseddoolyk_rev_p_001.compressed
doolyk_rev_p_001.compressed
Doolytics
 
From Science to Data: Following a principled path to Data Science
From Science to Data: Following a principled path to Data ScienceFrom Science to Data: Following a principled path to Data Science
From Science to Data: Following a principled path to Data Science
Institute of Contemporary Sciences
 
"Social innovation with (big) data" - Maurice Fransen, Analytics Lead Public ...
"Social innovation with (big) data" - Maurice Fransen, Analytics Lead Public ..."Social innovation with (big) data" - Maurice Fransen, Analytics Lead Public ...
"Social innovation with (big) data" - Maurice Fransen, Analytics Lead Public ...
Dataconomy Media
 
The Year of the Graph
The Year of the GraphThe Year of the Graph
The Year of the Graph
Cambridge Semantics
 
Using a Semantic and Graph-based Data Catalog in a Modern Data Fabric
Using a Semantic and Graph-based Data Catalog in a Modern Data FabricUsing a Semantic and Graph-based Data Catalog in a Modern Data Fabric
Using a Semantic and Graph-based Data Catalog in a Modern Data Fabric
Cambridge Semantics
 
Importance of Big Data Analytics
Importance of Big Data AnalyticsImportance of Big Data Analytics
Importance of Big Data Analytics
Impetus Technologies
 
How an intelligence lab can accelerate your business - Big Data Expo 2019
How an intelligence lab can accelerate your business - Big Data Expo 2019How an intelligence lab can accelerate your business - Big Data Expo 2019
How an intelligence lab can accelerate your business - Big Data Expo 2019
webwinkelvakdag
 
Reinventing Payments at HSBC with a Unified Platform for Data and AI in the C...
Reinventing Payments at HSBC with a Unified Platform for Data and AI in the C...Reinventing Payments at HSBC with a Unified Platform for Data and AI in the C...
Reinventing Payments at HSBC with a Unified Platform for Data and AI in the C...
Databricks
 

What's hot (20)

Tiger graph 2021 corporate overview [read only]
Tiger graph 2021 corporate overview [read only]Tiger graph 2021 corporate overview [read only]
Tiger graph 2021 corporate overview [read only]
 
Big data -_14._maerz_mitarbeiterforschung_kundenevent_v2.pptx__schreibgeschue...
Big data -_14._maerz_mitarbeiterforschung_kundenevent_v2.pptx__schreibgeschue...Big data -_14._maerz_mitarbeiterforschung_kundenevent_v2.pptx__schreibgeschue...
Big data -_14._maerz_mitarbeiterforschung_kundenevent_v2.pptx__schreibgeschue...
 
Three Dimensions of Data as a Service
Three Dimensions of Data as a ServiceThree Dimensions of Data as a Service
Three Dimensions of Data as a Service
 
Enabling a Bimodal IT Framework for Advanced Analytics with Data Virtualization
Enabling a Bimodal IT Framework for Advanced Analytics with Data VirtualizationEnabling a Bimodal IT Framework for Advanced Analytics with Data Virtualization
Enabling a Bimodal IT Framework for Advanced Analytics with Data Virtualization
 
Analyst Keynote: Forrester: Data Fabric Strategy is Vital for Business Innova...
Analyst Keynote: Forrester: Data Fabric Strategy is Vital for Business Innova...Analyst Keynote: Forrester: Data Fabric Strategy is Vital for Business Innova...
Analyst Keynote: Forrester: Data Fabric Strategy is Vital for Business Innova...
 
NIIT and Denodo: Business Continuity Planning in the times of the Covid-19 Pa...
NIIT and Denodo: Business Continuity Planning in the times of the Covid-19 Pa...NIIT and Denodo: Business Continuity Planning in the times of the Covid-19 Pa...
NIIT and Denodo: Business Continuity Planning in the times of the Covid-19 Pa...
 
Advanced Analytics for Any Data at Real-Time Speed
Advanced Analytics for Any Data at Real-Time SpeedAdvanced Analytics for Any Data at Real-Time Speed
Advanced Analytics for Any Data at Real-Time Speed
 
Security and governance
Security and governanceSecurity and governance
Security and governance
 
Rick Mutsaers Informatica
Rick Mutsaers InformaticaRick Mutsaers Informatica
Rick Mutsaers Informatica
 
Powering the Intelligent Edge: HPE's Strategy and Direction for IoT & Big Data
Powering the Intelligent Edge: HPE's Strategy and Direction for IoT & Big DataPowering the Intelligent Edge: HPE's Strategy and Direction for IoT & Big Data
Powering the Intelligent Edge: HPE's Strategy and Direction for IoT & Big Data
 
Data sciences and marketing analytics
Data sciences and marketing analyticsData sciences and marketing analytics
Data sciences and marketing analytics
 
Beyond the Data Lake - Matthias Korn, Technical Consultant at Data Virtuality
Beyond the Data Lake - Matthias Korn, Technical Consultant at Data VirtualityBeyond the Data Lake - Matthias Korn, Technical Consultant at Data Virtuality
Beyond the Data Lake - Matthias Korn, Technical Consultant at Data Virtuality
 
doolyk_rev_p_001.compressed
doolyk_rev_p_001.compresseddoolyk_rev_p_001.compressed
doolyk_rev_p_001.compressed
 
From Science to Data: Following a principled path to Data Science
From Science to Data: Following a principled path to Data ScienceFrom Science to Data: Following a principled path to Data Science
From Science to Data: Following a principled path to Data Science
 
"Social innovation with (big) data" - Maurice Fransen, Analytics Lead Public ...
"Social innovation with (big) data" - Maurice Fransen, Analytics Lead Public ..."Social innovation with (big) data" - Maurice Fransen, Analytics Lead Public ...
"Social innovation with (big) data" - Maurice Fransen, Analytics Lead Public ...
 
The Year of the Graph
The Year of the GraphThe Year of the Graph
The Year of the Graph
 
Using a Semantic and Graph-based Data Catalog in a Modern Data Fabric
Using a Semantic and Graph-based Data Catalog in a Modern Data FabricUsing a Semantic and Graph-based Data Catalog in a Modern Data Fabric
Using a Semantic and Graph-based Data Catalog in a Modern Data Fabric
 
Importance of Big Data Analytics
Importance of Big Data AnalyticsImportance of Big Data Analytics
Importance of Big Data Analytics
 
How an intelligence lab can accelerate your business - Big Data Expo 2019
How an intelligence lab can accelerate your business - Big Data Expo 2019How an intelligence lab can accelerate your business - Big Data Expo 2019
How an intelligence lab can accelerate your business - Big Data Expo 2019
 
Reinventing Payments at HSBC with a Unified Platform for Data and AI in the C...
Reinventing Payments at HSBC with a Unified Platform for Data and AI in the C...Reinventing Payments at HSBC with a Unified Platform for Data and AI in the C...
Reinventing Payments at HSBC with a Unified Platform for Data and AI in the C...
 

Similar to Double Your Hadoop Performance with Hortonworks SmartSense

NextGEOSS: The Next Generation European Data Hub and Cloud Platform for Earth...
NextGEOSS: The Next Generation European Data Hub and Cloud Platform for Earth...NextGEOSS: The Next Generation European Data Hub and Cloud Platform for Earth...
NextGEOSS: The Next Generation European Data Hub and Cloud Platform for Earth...
Wolfgang Ksoll
 
EUBraBIGSEA Major Goals
EUBraBIGSEA Major GoalsEUBraBIGSEA Major Goals
EUBraBIGSEA Major Goals
EUBra BIGSEA
 
Sens log – way to standardize vgi data collection
Sens log – way to standardize vgi data collectionSens log – way to standardize vgi data collection
Sens log – way to standardize vgi data collection
WirelessInfo
 
BDVe Webinar Series: DataBench – Benchmarking Big Data. Arne Berre. Tue, Oct ...
BDVe Webinar Series: DataBench – Benchmarking Big Data. Arne Berre. Tue, Oct ...BDVe Webinar Series: DataBench – Benchmarking Big Data. Arne Berre. Tue, Oct ...
BDVe Webinar Series: DataBench – Benchmarking Big Data. Arne Berre. Tue, Oct ...
Big Data Value Association
 
RDA Europe 4.0 - Kick-Off Spanish Node - BSC presentation
RDA Europe 4.0 - Kick-Off Spanish Node - BSC presentationRDA Europe 4.0 - Kick-Off Spanish Node - BSC presentation
RDA Europe 4.0 - Kick-Off Spanish Node - BSC presentation
Research Data Alliance
 
Big Data Technical Benchmarking, Arne Berre, BDVe Webinar series, 09/10/2018
Big Data Technical Benchmarking, Arne Berre, BDVe Webinar series, 09/10/2018 Big Data Technical Benchmarking, Arne Berre, BDVe Webinar series, 09/10/2018
Big Data Technical Benchmarking, Arne Berre, BDVe Webinar series, 09/10/2018
DataBench
 
BSC presentation for Festibity Sponsors
BSC presentation for Festibity SponsorsBSC presentation for Festibity Sponsors
BSC presentation for Festibity Sponsors
Festibity
 
EUBraBIGSEA Final results
EUBraBIGSEA Final resultsEUBraBIGSEA Final results
EUBraBIGSEA Final results
ATMOSPHERE .
 
ArchiInspection Project: Integrated Non Destructive Testing, A Building Infor...
ArchiInspection Project: Integrated Non Destructive Testing, A Building Infor...ArchiInspection Project: Integrated Non Destructive Testing, A Building Infor...
ArchiInspection Project: Integrated Non Destructive Testing, A Building Infor...
Farid Mokhtar Noriega
 
Design phase kick-off event and Ceremony
Design phase kick-off event and CeremonyDesign phase kick-off event and Ceremony
Design phase kick-off event and Ceremony
Archiver
 
Solving advanced research problems with real time open data from satellites a...
Solving advanced research problems with real time open data from satellites a...Solving advanced research problems with real time open data from satellites a...
Solving advanced research problems with real time open data from satellites a...
Wolfgang Ksoll
 
OpenNebula Conf 2014 | OpenNebula at Cenatic - Jose Angel Diaz Diaz
OpenNebula Conf 2014 | OpenNebula at Cenatic - Jose Angel Diaz DiazOpenNebula Conf 2014 | OpenNebula at Cenatic - Jose Angel Diaz Diaz
OpenNebula Conf 2014 | OpenNebula at Cenatic - Jose Angel Diaz Diaz
NETWAYS
 
OpenNebulaConf 2014 - OpenNebula at Cenatic - Jose Angel Diaz Diaz
OpenNebulaConf 2014 - OpenNebula at Cenatic - Jose Angel Diaz DiazOpenNebulaConf 2014 - OpenNebula at Cenatic - Jose Angel Diaz Diaz
OpenNebulaConf 2014 - OpenNebula at Cenatic - Jose Angel Diaz Diaz
OpenNebula Project
 
Show and Tell - Data and Digitalisation, Digital Twins.pdf
Show and Tell - Data and Digitalisation, Digital Twins.pdfShow and Tell - Data and Digitalisation, Digital Twins.pdf
Show and Tell - Data and Digitalisation, Digital Twins.pdf
SIFOfgem
 
noProj.aa1.ro » M&ES4DE/DD-IT&C+A
noProj.aa1.ro » M&ES4DE/DD-IT&C+AnoProj.aa1.ro » M&ES4DE/DD-IT&C+A
noProj.aa1.ro » M&ES4DE/DD-IT&C+A
Ionel Gabriel Niculescu
 
Resume
ResumeResume
Resume
avinash kumar
 
Gradiant - Technology Offer in Business Analytics
Gradiant - Technology Offer in Business AnalyticsGradiant - Technology Offer in Business Analytics
Gradiant - Technology Offer in Business Analytics
Marcos Álvarez-Díaz
 
BDE SC6 workshop - introduction 2016
BDE SC6 workshop - introduction 2016BDE SC6 workshop - introduction 2016
BDE SC6 workshop - introduction 2016
BigData_Europe
 
IC-SDV 2018: Harald Jenny (CENTREDOC) When Artificial Intelligence Joins Inte...
IC-SDV 2018: Harald Jenny (CENTREDOC) When Artificial Intelligence Joins Inte...IC-SDV 2018: Harald Jenny (CENTREDOC) When Artificial Intelligence Joins Inte...
IC-SDV 2018: Harald Jenny (CENTREDOC) When Artificial Intelligence Joins Inte...
Dr. Haxel Consult
 
Mohan C R CV
Mohan C R CVMohan C R CV
Mohan C R CV
MOHAN C R
 

Similar to Double Your Hadoop Performance with Hortonworks SmartSense (20)

NextGEOSS: The Next Generation European Data Hub and Cloud Platform for Earth...
NextGEOSS: The Next Generation European Data Hub and Cloud Platform for Earth...NextGEOSS: The Next Generation European Data Hub and Cloud Platform for Earth...
NextGEOSS: The Next Generation European Data Hub and Cloud Platform for Earth...
 
EUBraBIGSEA Major Goals
EUBraBIGSEA Major GoalsEUBraBIGSEA Major Goals
EUBraBIGSEA Major Goals
 
Sens log – way to standardize vgi data collection
Sens log – way to standardize vgi data collectionSens log – way to standardize vgi data collection
Sens log – way to standardize vgi data collection
 
BDVe Webinar Series: DataBench – Benchmarking Big Data. Arne Berre. Tue, Oct ...
BDVe Webinar Series: DataBench – Benchmarking Big Data. Arne Berre. Tue, Oct ...BDVe Webinar Series: DataBench – Benchmarking Big Data. Arne Berre. Tue, Oct ...
BDVe Webinar Series: DataBench – Benchmarking Big Data. Arne Berre. Tue, Oct ...
 
RDA Europe 4.0 - Kick-Off Spanish Node - BSC presentation
RDA Europe 4.0 - Kick-Off Spanish Node - BSC presentationRDA Europe 4.0 - Kick-Off Spanish Node - BSC presentation
RDA Europe 4.0 - Kick-Off Spanish Node - BSC presentation
 
Big Data Technical Benchmarking, Arne Berre, BDVe Webinar series, 09/10/2018
Big Data Technical Benchmarking, Arne Berre, BDVe Webinar series, 09/10/2018 Big Data Technical Benchmarking, Arne Berre, BDVe Webinar series, 09/10/2018
Big Data Technical Benchmarking, Arne Berre, BDVe Webinar series, 09/10/2018
 
BSC presentation for Festibity Sponsors
BSC presentation for Festibity SponsorsBSC presentation for Festibity Sponsors
BSC presentation for Festibity Sponsors
 
EUBraBIGSEA Final results
EUBraBIGSEA Final resultsEUBraBIGSEA Final results
EUBraBIGSEA Final results
 
ArchiInspection Project: Integrated Non Destructive Testing, A Building Infor...
ArchiInspection Project: Integrated Non Destructive Testing, A Building Infor...ArchiInspection Project: Integrated Non Destructive Testing, A Building Infor...
ArchiInspection Project: Integrated Non Destructive Testing, A Building Infor...
 
Design phase kick-off event and Ceremony
Design phase kick-off event and CeremonyDesign phase kick-off event and Ceremony
Design phase kick-off event and Ceremony
 
Solving advanced research problems with real time open data from satellites a...
Solving advanced research problems with real time open data from satellites a...Solving advanced research problems with real time open data from satellites a...
Solving advanced research problems with real time open data from satellites a...
 
OpenNebula Conf 2014 | OpenNebula at Cenatic - Jose Angel Diaz Diaz
OpenNebula Conf 2014 | OpenNebula at Cenatic - Jose Angel Diaz DiazOpenNebula Conf 2014 | OpenNebula at Cenatic - Jose Angel Diaz Diaz
OpenNebula Conf 2014 | OpenNebula at Cenatic - Jose Angel Diaz Diaz
 
OpenNebulaConf 2014 - OpenNebula at Cenatic - Jose Angel Diaz Diaz
OpenNebulaConf 2014 - OpenNebula at Cenatic - Jose Angel Diaz DiazOpenNebulaConf 2014 - OpenNebula at Cenatic - Jose Angel Diaz Diaz
OpenNebulaConf 2014 - OpenNebula at Cenatic - Jose Angel Diaz Diaz
 
Show and Tell - Data and Digitalisation, Digital Twins.pdf
Show and Tell - Data and Digitalisation, Digital Twins.pdfShow and Tell - Data and Digitalisation, Digital Twins.pdf
Show and Tell - Data and Digitalisation, Digital Twins.pdf
 
noProj.aa1.ro » M&ES4DE/DD-IT&C+A
noProj.aa1.ro » M&ES4DE/DD-IT&C+AnoProj.aa1.ro » M&ES4DE/DD-IT&C+A
noProj.aa1.ro » M&ES4DE/DD-IT&C+A
 
Resume
ResumeResume
Resume
 
Gradiant - Technology Offer in Business Analytics
Gradiant - Technology Offer in Business AnalyticsGradiant - Technology Offer in Business Analytics
Gradiant - Technology Offer in Business Analytics
 
BDE SC6 workshop - introduction 2016
BDE SC6 workshop - introduction 2016BDE SC6 workshop - introduction 2016
BDE SC6 workshop - introduction 2016
 
IC-SDV 2018: Harald Jenny (CENTREDOC) When Artificial Intelligence Joins Inte...
IC-SDV 2018: Harald Jenny (CENTREDOC) When Artificial Intelligence Joins Inte...IC-SDV 2018: Harald Jenny (CENTREDOC) When Artificial Intelligence Joins Inte...
IC-SDV 2018: Harald Jenny (CENTREDOC) When Artificial Intelligence Joins Inte...
 
Mohan C R CV
Mohan C R CVMohan C R CV
Mohan C R CV
 

More from DataWorks Summit/Hadoop Summit

Running Apache Spark & Apache Zeppelin in Production
Running Apache Spark & Apache Zeppelin in ProductionRunning Apache Spark & Apache Zeppelin in Production
Running Apache Spark & Apache Zeppelin in Production
DataWorks Summit/Hadoop Summit
 
State of Security: Apache Spark & Apache Zeppelin
State of Security: Apache Spark & Apache ZeppelinState of Security: Apache Spark & Apache Zeppelin
State of Security: Apache Spark & Apache Zeppelin
DataWorks Summit/Hadoop Summit
 
Unleashing the Power of Apache Atlas with Apache Ranger
Unleashing the Power of Apache Atlas with Apache RangerUnleashing the Power of Apache Atlas with Apache Ranger
Unleashing the Power of Apache Atlas with Apache Ranger
DataWorks Summit/Hadoop Summit
 
Enabling Digital Diagnostics with a Data Science Platform
Enabling Digital Diagnostics with a Data Science PlatformEnabling Digital Diagnostics with a Data Science Platform
Enabling Digital Diagnostics with a Data Science Platform
DataWorks Summit/Hadoop Summit
 
Revolutionize Text Mining with Spark and Zeppelin
Revolutionize Text Mining with Spark and ZeppelinRevolutionize Text Mining with Spark and Zeppelin
Revolutionize Text Mining with Spark and Zeppelin
DataWorks Summit/Hadoop Summit
 
Hadoop Crash Course
Hadoop Crash CourseHadoop Crash Course
Hadoop Crash Course
DataWorks Summit/Hadoop Summit
 
Data Science Crash Course
Data Science Crash CourseData Science Crash Course
Data Science Crash Course
DataWorks Summit/Hadoop Summit
 
Apache Spark Crash Course
Apache Spark Crash CourseApache Spark Crash Course
Apache Spark Crash Course
DataWorks Summit/Hadoop Summit
 
Dataflow with Apache NiFi
Dataflow with Apache NiFiDataflow with Apache NiFi
Dataflow with Apache NiFi
DataWorks Summit/Hadoop Summit
 
Schema Registry - Set you Data Free
Schema Registry - Set you Data FreeSchema Registry - Set you Data Free
Schema Registry - Set you Data Free
DataWorks Summit/Hadoop Summit
 
Building a Large-Scale, Adaptive Recommendation Engine with Apache Flink and ...
Building a Large-Scale, Adaptive Recommendation Engine with Apache Flink and ...Building a Large-Scale, Adaptive Recommendation Engine with Apache Flink and ...
Building a Large-Scale, Adaptive Recommendation Engine with Apache Flink and ...
DataWorks Summit/Hadoop Summit
 
Real-Time Anomaly Detection using LSTM Auto-Encoders with Deep Learning4J on ...
Real-Time Anomaly Detection using LSTM Auto-Encoders with Deep Learning4J on ...Real-Time Anomaly Detection using LSTM Auto-Encoders with Deep Learning4J on ...
Real-Time Anomaly Detection using LSTM Auto-Encoders with Deep Learning4J on ...
DataWorks Summit/Hadoop Summit
 
Mool - Automated Log Analysis using Data Science and ML
Mool - Automated Log Analysis using Data Science and MLMool - Automated Log Analysis using Data Science and ML
Mool - Automated Log Analysis using Data Science and ML
DataWorks Summit/Hadoop Summit
 
How Hadoop Makes the Natixis Pack More Efficient
How Hadoop Makes the Natixis Pack More Efficient How Hadoop Makes the Natixis Pack More Efficient
How Hadoop Makes the Natixis Pack More Efficient
DataWorks Summit/Hadoop Summit
 
HBase in Practice
HBase in Practice HBase in Practice
HBase in Practice
DataWorks Summit/Hadoop Summit
 
The Challenge of Driving Business Value from the Analytics of Things (AOT)
The Challenge of Driving Business Value from the Analytics of Things (AOT)The Challenge of Driving Business Value from the Analytics of Things (AOT)
The Challenge of Driving Business Value from the Analytics of Things (AOT)
DataWorks Summit/Hadoop Summit
 
Breaking the 1 Million OPS/SEC Barrier in HOPS Hadoop
Breaking the 1 Million OPS/SEC Barrier in HOPS HadoopBreaking the 1 Million OPS/SEC Barrier in HOPS Hadoop
Breaking the 1 Million OPS/SEC Barrier in HOPS Hadoop
DataWorks Summit/Hadoop Summit
 
From Regulatory Process Verification to Predictive Maintenance and Beyond wit...
From Regulatory Process Verification to Predictive Maintenance and Beyond wit...From Regulatory Process Verification to Predictive Maintenance and Beyond wit...
From Regulatory Process Verification to Predictive Maintenance and Beyond wit...
DataWorks Summit/Hadoop Summit
 
Backup and Disaster Recovery in Hadoop
Backup and Disaster Recovery in Hadoop Backup and Disaster Recovery in Hadoop
Backup and Disaster Recovery in Hadoop
DataWorks Summit/Hadoop Summit
 
Scaling HDFS to Manage Billions of Files with Distributed Storage Schemes
Scaling HDFS to Manage Billions of Files with Distributed Storage SchemesScaling HDFS to Manage Billions of Files with Distributed Storage Schemes
Scaling HDFS to Manage Billions of Files with Distributed Storage Schemes
DataWorks Summit/Hadoop Summit
 

More from DataWorks Summit/Hadoop Summit (20)

Running Apache Spark & Apache Zeppelin in Production
Running Apache Spark & Apache Zeppelin in ProductionRunning Apache Spark & Apache Zeppelin in Production
Running Apache Spark & Apache Zeppelin in Production
 
State of Security: Apache Spark & Apache Zeppelin
State of Security: Apache Spark & Apache ZeppelinState of Security: Apache Spark & Apache Zeppelin
State of Security: Apache Spark & Apache Zeppelin
 
Unleashing the Power of Apache Atlas with Apache Ranger
Unleashing the Power of Apache Atlas with Apache RangerUnleashing the Power of Apache Atlas with Apache Ranger
Unleashing the Power of Apache Atlas with Apache Ranger
 
Enabling Digital Diagnostics with a Data Science Platform
Enabling Digital Diagnostics with a Data Science PlatformEnabling Digital Diagnostics with a Data Science Platform
Enabling Digital Diagnostics with a Data Science Platform
 
Revolutionize Text Mining with Spark and Zeppelin
Revolutionize Text Mining with Spark and ZeppelinRevolutionize Text Mining with Spark and Zeppelin
Revolutionize Text Mining with Spark and Zeppelin
 
Hadoop Crash Course
Hadoop Crash CourseHadoop Crash Course
Hadoop Crash Course
 
Data Science Crash Course
Data Science Crash CourseData Science Crash Course
Data Science Crash Course
 
Apache Spark Crash Course
Apache Spark Crash CourseApache Spark Crash Course
Apache Spark Crash Course
 
Dataflow with Apache NiFi
Dataflow with Apache NiFiDataflow with Apache NiFi
Dataflow with Apache NiFi
 
Schema Registry - Set you Data Free
Schema Registry - Set you Data FreeSchema Registry - Set you Data Free
Schema Registry - Set you Data Free
 
Building a Large-Scale, Adaptive Recommendation Engine with Apache Flink and ...
Building a Large-Scale, Adaptive Recommendation Engine with Apache Flink and ...Building a Large-Scale, Adaptive Recommendation Engine with Apache Flink and ...
Building a Large-Scale, Adaptive Recommendation Engine with Apache Flink and ...
 
Real-Time Anomaly Detection using LSTM Auto-Encoders with Deep Learning4J on ...
Real-Time Anomaly Detection using LSTM Auto-Encoders with Deep Learning4J on ...Real-Time Anomaly Detection using LSTM Auto-Encoders with Deep Learning4J on ...
Real-Time Anomaly Detection using LSTM Auto-Encoders with Deep Learning4J on ...
 
Mool - Automated Log Analysis using Data Science and ML
Mool - Automated Log Analysis using Data Science and MLMool - Automated Log Analysis using Data Science and ML
Mool - Automated Log Analysis using Data Science and ML
 
How Hadoop Makes the Natixis Pack More Efficient
How Hadoop Makes the Natixis Pack More Efficient How Hadoop Makes the Natixis Pack More Efficient
How Hadoop Makes the Natixis Pack More Efficient
 
HBase in Practice
HBase in Practice HBase in Practice
HBase in Practice
 
The Challenge of Driving Business Value from the Analytics of Things (AOT)
The Challenge of Driving Business Value from the Analytics of Things (AOT)The Challenge of Driving Business Value from the Analytics of Things (AOT)
The Challenge of Driving Business Value from the Analytics of Things (AOT)
 
Breaking the 1 Million OPS/SEC Barrier in HOPS Hadoop
Breaking the 1 Million OPS/SEC Barrier in HOPS HadoopBreaking the 1 Million OPS/SEC Barrier in HOPS Hadoop
Breaking the 1 Million OPS/SEC Barrier in HOPS Hadoop
 
From Regulatory Process Verification to Predictive Maintenance and Beyond wit...
From Regulatory Process Verification to Predictive Maintenance and Beyond wit...From Regulatory Process Verification to Predictive Maintenance and Beyond wit...
From Regulatory Process Verification to Predictive Maintenance and Beyond wit...
 
Backup and Disaster Recovery in Hadoop
Backup and Disaster Recovery in Hadoop Backup and Disaster Recovery in Hadoop
Backup and Disaster Recovery in Hadoop
 
Scaling HDFS to Manage Billions of Files with Distributed Storage Schemes
Scaling HDFS to Manage Billions of Files with Distributed Storage SchemesScaling HDFS to Manage Billions of Files with Distributed Storage Schemes
Scaling HDFS to Manage Billions of Files with Distributed Storage Schemes
 

Recently uploaded

Demystifying Neural Networks And Building Cybersecurity Applications
Demystifying Neural Networks And Building Cybersecurity ApplicationsDemystifying Neural Networks And Building Cybersecurity Applications
Demystifying Neural Networks And Building Cybersecurity Applications
Priyanka Aash
 
Indian Privacy law & Infosec for Startups
Indian Privacy law & Infosec for StartupsIndian Privacy law & Infosec for Startups
Indian Privacy law & Infosec for Startups
AMol NAik
 
TrustArc Webinar - Innovating with TRUSTe Responsible AI Certification
TrustArc Webinar - Innovating with TRUSTe Responsible AI CertificationTrustArc Webinar - Innovating with TRUSTe Responsible AI Certification
TrustArc Webinar - Innovating with TRUSTe Responsible AI Certification
TrustArc
 
"Hands-on development experience using wasm Blazor", Furdak Vladyslav.pptx
"Hands-on development experience using wasm Blazor", Furdak Vladyslav.pptx"Hands-on development experience using wasm Blazor", Furdak Vladyslav.pptx
"Hands-on development experience using wasm Blazor", Furdak Vladyslav.pptx
Fwdays
 
Keynote : Presentation on SASE Technology
Keynote : Presentation on SASE TechnologyKeynote : Presentation on SASE Technology
Keynote : Presentation on SASE Technology
Priyanka Aash
 
What's New in Teams Calling, Meetings, Devices June 2024
What's New in Teams Calling, Meetings, Devices June 2024What's New in Teams Calling, Meetings, Devices June 2024
What's New in Teams Calling, Meetings, Devices June 2024
Stephanie Beckett
 
Generative AI Reasoning Tech Talk - July 2024
Generative AI Reasoning Tech Talk - July 2024Generative AI Reasoning Tech Talk - July 2024
Generative AI Reasoning Tech Talk - July 2024
siddu769252
 
History and Introduction for Generative AI ( GenAI )
History and Introduction for Generative AI ( GenAI )History and Introduction for Generative AI ( GenAI )
History and Introduction for Generative AI ( GenAI )
Badri_Bady
 
FIDO Munich Seminar: FIDO Tech Principles.pptx
FIDO Munich Seminar: FIDO Tech Principles.pptxFIDO Munich Seminar: FIDO Tech Principles.pptx
FIDO Munich Seminar: FIDO Tech Principles.pptx
FIDO Alliance
 
FIDO Munich Seminar Blueprint for In-Vehicle Payment Standard.pptx
FIDO Munich Seminar Blueprint for In-Vehicle Payment Standard.pptxFIDO Munich Seminar Blueprint for In-Vehicle Payment Standard.pptx
FIDO Munich Seminar Blueprint for In-Vehicle Payment Standard.pptx
FIDO Alliance
 
It's your unstructured data: How to get your GenAI app to production (and spe...
It's your unstructured data: How to get your GenAI app to production (and spe...It's your unstructured data: How to get your GenAI app to production (and spe...
It's your unstructured data: How to get your GenAI app to production (and spe...
Zilliz
 
DefCamp_2016_Chemerkin_Yury_--_publish.pdf
DefCamp_2016_Chemerkin_Yury_--_publish.pdfDefCamp_2016_Chemerkin_Yury_--_publish.pdf
DefCamp_2016_Chemerkin_Yury_--_publish.pdf
Yury Chemerkin
 
Keynote : AI & Future Of Offensive Security
Keynote : AI & Future Of Offensive SecurityKeynote : AI & Future Of Offensive Security
Keynote : AI & Future Of Offensive Security
Priyanka Aash
 
Cracking AI Black Box - Strategies for Customer-centric Enterprise Excellence
Cracking AI Black Box - Strategies for Customer-centric Enterprise ExcellenceCracking AI Black Box - Strategies for Customer-centric Enterprise Excellence
Cracking AI Black Box - Strategies for Customer-centric Enterprise Excellence
Quentin Reul
 
FIDO Munich Seminar: Securing Smart Car.pptx
FIDO Munich Seminar: Securing Smart Car.pptxFIDO Munich Seminar: Securing Smart Car.pptx
FIDO Munich Seminar: Securing Smart Car.pptx
FIDO Alliance
 
Perth MuleSoft Meetup July 2024
Perth MuleSoft Meetup July 2024Perth MuleSoft Meetup July 2024
Perth MuleSoft Meetup July 2024
Michael Price
 
Increase Quality with User Access Policies - July 2024
Increase Quality with User Access Policies - July 2024Increase Quality with User Access Policies - July 2024
Increase Quality with User Access Policies - July 2024
Peter Caitens
 
Discovery Series - Zero to Hero - Task Mining Session 1
Discovery Series - Zero to Hero - Task Mining Session 1Discovery Series - Zero to Hero - Task Mining Session 1
Discovery Series - Zero to Hero - Task Mining Session 1
DianaGray10
 
FIDO Munich Seminar Introduction to FIDO.pptx
FIDO Munich Seminar Introduction to FIDO.pptxFIDO Munich Seminar Introduction to FIDO.pptx
FIDO Munich Seminar Introduction to FIDO.pptx
FIDO Alliance
 
Generative AI technology is a fascinating field that focuses on creating comp...
Generative AI technology is a fascinating field that focuses on creating comp...Generative AI technology is a fascinating field that focuses on creating comp...
Generative AI technology is a fascinating field that focuses on creating comp...
Nohoax Kanont
 

Recently uploaded (20)

Demystifying Neural Networks And Building Cybersecurity Applications
Demystifying Neural Networks And Building Cybersecurity ApplicationsDemystifying Neural Networks And Building Cybersecurity Applications
Demystifying Neural Networks And Building Cybersecurity Applications
 
Indian Privacy law & Infosec for Startups
Indian Privacy law & Infosec for StartupsIndian Privacy law & Infosec for Startups
Indian Privacy law & Infosec for Startups
 
TrustArc Webinar - Innovating with TRUSTe Responsible AI Certification
TrustArc Webinar - Innovating with TRUSTe Responsible AI CertificationTrustArc Webinar - Innovating with TRUSTe Responsible AI Certification
TrustArc Webinar - Innovating with TRUSTe Responsible AI Certification
 
"Hands-on development experience using wasm Blazor", Furdak Vladyslav.pptx
"Hands-on development experience using wasm Blazor", Furdak Vladyslav.pptx"Hands-on development experience using wasm Blazor", Furdak Vladyslav.pptx
"Hands-on development experience using wasm Blazor", Furdak Vladyslav.pptx
 
Keynote : Presentation on SASE Technology
Keynote : Presentation on SASE TechnologyKeynote : Presentation on SASE Technology
Keynote : Presentation on SASE Technology
 
What's New in Teams Calling, Meetings, Devices June 2024
What's New in Teams Calling, Meetings, Devices June 2024What's New in Teams Calling, Meetings, Devices June 2024
What's New in Teams Calling, Meetings, Devices June 2024
 
Generative AI Reasoning Tech Talk - July 2024
Generative AI Reasoning Tech Talk - July 2024Generative AI Reasoning Tech Talk - July 2024
Generative AI Reasoning Tech Talk - July 2024
 
History and Introduction for Generative AI ( GenAI )
History and Introduction for Generative AI ( GenAI )History and Introduction for Generative AI ( GenAI )
History and Introduction for Generative AI ( GenAI )
 
FIDO Munich Seminar: FIDO Tech Principles.pptx
FIDO Munich Seminar: FIDO Tech Principles.pptxFIDO Munich Seminar: FIDO Tech Principles.pptx
FIDO Munich Seminar: FIDO Tech Principles.pptx
 
FIDO Munich Seminar Blueprint for In-Vehicle Payment Standard.pptx
FIDO Munich Seminar Blueprint for In-Vehicle Payment Standard.pptxFIDO Munich Seminar Blueprint for In-Vehicle Payment Standard.pptx
FIDO Munich Seminar Blueprint for In-Vehicle Payment Standard.pptx
 
It's your unstructured data: How to get your GenAI app to production (and spe...
It's your unstructured data: How to get your GenAI app to production (and spe...It's your unstructured data: How to get your GenAI app to production (and spe...
It's your unstructured data: How to get your GenAI app to production (and spe...
 
DefCamp_2016_Chemerkin_Yury_--_publish.pdf
DefCamp_2016_Chemerkin_Yury_--_publish.pdfDefCamp_2016_Chemerkin_Yury_--_publish.pdf
DefCamp_2016_Chemerkin_Yury_--_publish.pdf
 
Keynote : AI & Future Of Offensive Security
Keynote : AI & Future Of Offensive SecurityKeynote : AI & Future Of Offensive Security
Keynote : AI & Future Of Offensive Security
 
Cracking AI Black Box - Strategies for Customer-centric Enterprise Excellence
Cracking AI Black Box - Strategies for Customer-centric Enterprise ExcellenceCracking AI Black Box - Strategies for Customer-centric Enterprise Excellence
Cracking AI Black Box - Strategies for Customer-centric Enterprise Excellence
 
FIDO Munich Seminar: Securing Smart Car.pptx
FIDO Munich Seminar: Securing Smart Car.pptxFIDO Munich Seminar: Securing Smart Car.pptx
FIDO Munich Seminar: Securing Smart Car.pptx
 
Perth MuleSoft Meetup July 2024
Perth MuleSoft Meetup July 2024Perth MuleSoft Meetup July 2024
Perth MuleSoft Meetup July 2024
 
Increase Quality with User Access Policies - July 2024
Increase Quality with User Access Policies - July 2024Increase Quality with User Access Policies - July 2024
Increase Quality with User Access Policies - July 2024
 
Discovery Series - Zero to Hero - Task Mining Session 1
Discovery Series - Zero to Hero - Task Mining Session 1Discovery Series - Zero to Hero - Task Mining Session 1
Discovery Series - Zero to Hero - Task Mining Session 1
 
FIDO Munich Seminar Introduction to FIDO.pptx
FIDO Munich Seminar Introduction to FIDO.pptxFIDO Munich Seminar Introduction to FIDO.pptx
FIDO Munich Seminar Introduction to FIDO.pptx
 
Generative AI technology is a fascinating field that focuses on creating comp...
Generative AI technology is a fascinating field that focuses on creating comp...Generative AI technology is a fascinating field that focuses on creating comp...
Generative AI technology is a fascinating field that focuses on creating comp...
 

Double Your Hadoop Performance with Hortonworks SmartSense