More Related Content
What's hot
What's hot (20)
Similar to HBaseConAsia2018 Keynote 2: Recent Development of HBase in Alibaba and Cloud
Similar to HBaseConAsia2018 Keynote 2: Recent Development of HBase in Alibaba and Cloud (20)
More from Michael Stack
More from Michael Stack (20)
Recently uploaded
Recently uploaded (13)
HBaseConAsia2018 Keynote 2: Recent Development of HBase in Alibaba and Cloud
- 1. New Journey of HBase in Alibaba and Cloud Chunhui Shen and Long Cao August 17,2018 八年磨一剑，HBase在阿里巴巴和云上的新征程
- 2. Content AliHB-Introduction of Alibaba HBase History，Tech Overview，Open Source，Core Scenarios 01 Recent Key Challenge & Improvements GC Trouble，Separation of Computing & Storage，Cold- Hot Data，Diagnostic System， Migration & Backup 02 03 HBase Ecosystem & Multi-model DB & Cloud KV，Tabular，SQL，Graph，Time Series，Geospatial ， Search， Mixed Workloads，Cloud
- 3. AliHB-Introduction of Alibaba HBase01
- 4. HBase History in Alibaba • Why HBase – Began using since 2010 – Active community – Hadoop ecosystem – Facebook successful case – Google famous paper: Big Table Our Choice in 2010 Open Source Commercial Develop New Big Data Store System Cassandra MySQL、Oracle Data Burst • Used Version – 0.20->0.90->0.92->0.94->0.98->1.1->2.0 • The earliest case in 2010-2011 – Search Store – Taobao History Order – Alipay Risk Management • Internal branch AliHB
- 5. Overview of AliHB 5 • Performance • High-Performance Data Structure、Lock-Free、 Group IO • Feature • SQL、Secondary Index • Multi-Tenants、Cold-Hot Separation、Async API • Stability • High Availability Architecture • Faster MTTR • Verification in Double 11 Shopping Day • Efficient Maintenance • Effective Monitoring • Full Path Trace • No-pause migration • 12000+ Nodes，100+ Clusters ，200+ Million OPS，100+ PB Data • 20+ BU，6000+ Users， 100+ Production Changes per Day
- 6. Open Source and Community 6 • Contributing to open source since 2011 • 3 PMC, 6 Committers in Alibaba • Sponsor the Chinese HBase Technology Community • Already Organized 2 HBase Meetup • At least one HBase Related tech article one day • Tens of thousands of readers now, and more are coming • Hosting HBase Con Asia 2018 • Promote the use of HBase through several conference talks • Hope more people to join in HBase Community
- 7. Core Scenarios in Alibaba 7 Ali-HBase 旺旺(IM) Alipay Bills Cainiao Logistics Log Monitor, Log, Tracking, IoT Data…Message, Orders, Feeds … AI Storage Ant Intelligent Security Intelligent Customer Service Recommendation Search, BI Report…
- 8. Recent Key Challenge & Improvements02
- 9. GC Trouble 9 Frequent Slow Request Very Slow Request Service Unavailable GC Problems Under100GB Memory
- 10. GC Trouble 10 Only for offline application Rewriting with C++ Exploring a Thorough Solution
- 11. GC Trouble 11 Type Pause Time Frequency YGC 100ms+ Once per 5 Secs CMS 100~500ms Once per 5 Mins FGC 20s-180s Once per 7~60 Days Type Pause Time Frequency YGC 5ms Once per 5 Secs CMS 100ms Once per 5 Hours FGC N/A N/A CCSMap BucketCacheV2 Allocation and reclaim the major memory by hbase itself, rather than JVM ZenGC New GC algorithm in AJDK Try best to reuse object(In Core Path) when programming
- 12. GC Trouble New BucketCache in HBase-2.0 CCSMap in HBase-3.0
- 13. Separation of Computing & Storage 13 Localized Deployment – Low IO latency with Short-Circuit Read – Unbalanced storage space, especially between clusters – Difficult to increase the usage ratio of CPU and Disk (both), especially when lots of scenarios – Cluster scaling is slow because of datanode decommission
- 14. Separation of Computing & Storage 14 Shared-Storage Deployment – Big shared storage, more balanced – Compute node can scale independently – Storage node can scale independently – Auto-scaling become feasible – Based on load statistics, smart schedule between clusters – Share compute resources with other applications
- 15. Heterogeneous Cold-Hot Storage 15 • HBase has the capability to hold all the data of whole life cycle • But in most cases, like monitor, trace, order, logistics • The recently generated data is often accessed, but occupy very little storage space • The history data is rarely visited, but occupy a lot of storage space • Common solution • Cold storage system for history data • Hot storage system for recent data • Move the data from hot storage system to cold storage system periodically
- 16. Heterogeneous Cold-Hot Storage 16 • Easy To Use • Auto Tiered • Heterogeneous • Read Optimization
- 17. Diagnostic System 17 “Request Rush?” — Monitor “Big Region?” — Web UI “Full Disk?” — df “Bad Disk？” — tsar,demsg …… 12000+ Nodes，100+ Clusters ，6000+ Users HBase Diagnostic Center 1. The unified entrance of trouble shooting 2. Experience/Solution => Function of Diagnostic System
- 18. Diagnostic System 18 2 One extra server for all No Agent Adding rule dynamically Runtime information Check all components Only 10 seconds for a diagnosis6
- 19. Diagnostic System 19 Compaction Stuck Balance Abnormal Table Abnormal Region Offline Replication Delay Too many files High Meta Load Multi Assign …… HBase ZK Unavailable Block Miss NameNode Abnormal Full capacity of datanode Inconsistent state between two namenodes Too much Xceivers Disk not mounted …… ZK/HDFS Insufficient disk space Slow Disk Bad Disk Too much TCP error Slow ping CPU hang Load too high Port is unreachable …… Hardware 50+ Rules 80%+ Accuracy Shared on Apsara HBase
- 21. Migration & Backup 21 Independent with HBase • almost no impact to service • easy to upgrade • support multi versions • support the non-hbase target Second-level RPO Minute-level RTO
- 22. HBase Ecosystem & Multi-model DB & Cloud03
- 23. Popularity changes per DB category
- 24. Ranking scores per category in percent
- 25. Data size per day
- 26. All in one RelationalKey Value Doucument Graph Time Series Geospatial Tabular NoSQL
- 27. All in one RelationalKey Value Doucument Graph Time Series Geospatial Tabular NoSQL HBase HBase Phoenix/AntsDB HBase JanusGraph OpenTSDB GeoMesa
- 28. 28 Multi-model - Native Or Layer Neo4j InfluxDB CockroachDB PG HBase Ecosystem DataStax CosmosDB Multi-model KVIndex KVIndex Storage Multi-model
- 29. HBase Meet Cloud – Benefits Cloud Native New Hardware Flexibility Cost Savings (TCO) RDMA Flash GPU Non-volatile memory Fast Add/Remove Resource Insight Fix bugs in time Self-driven End up paying for features Flexibility self-driven Reduce human ……
- 30. 30 Multi-model - Native Or Layer Neo4j InfluxDB CockroachDB PG HBase Ecosystem DataStax CosmosDB Multi-model KVIndex KVIndex Storage Multi-model
- 31. ApsaraDB HBase Platform – Cloud Native HBase (KV、Tabular 、Doucument) Solr/ES (Full Text Index) Hot data on SSD SQL Phoenix Graph JanusGraph Time Series OpenTSDB Geospatial GeoMesa Spark Cold data on HDD and use EC like OSS Warm data on SSD&HDD Remote Read/Write use RDMA and 25G network
- 32. 32 ApsaraDB HBase Platform Advantage Item ApsaraDB HBase (ALiyun Product) https://cn.aliyun.com/product/hbase Apache HBase (Sofeware) Basic High availability 99.9% ~ 99.99% N/A Data reliability 99.999999999% N/A Online Ability Multi-master clustering Multi-master clustering，Multi-AZ/Regon NO GC FGC NO，YGC 5ms GC 20s~100s，YGC 100ms+ Reduce Cost Storage Cost Cut by 50%+ on share cloud disk，Total 3 Copy Maybe on Cloud Disk，Total 9 Copy Support Cold Storage Support OSS，Cut by 70% at less read NO Multi-model DB Multi-model DB KV，Tabular，SQL，Graph，Time Series，Geospatial Full Text index， Search KV，Tabular Enterprise Characteristics Disaster recovery Backup and Restore NO，maybe3.0 Security user/password，ACL Kerberos，ACL Analytics Spark on HBase ，More optimization Spark on HBase Version upgrade Automatic upgrade N/A Self-driven Database control system 15min Create a DB/Monitor Online add storage and node/Elastic Power in future N/A Diagnostic Big request ，Big Table merge，Hot Region …… NO
- 34. 欢迎加入 杭州、硅谷、深圳、北京
- 35. 谢谢观看 Thanks