分享

有没有人 玩过Hbase的mob

Helios 2016-12-1 14:44:30 发表于 疑问解答 [显示全部楼层] 回帖奖励 阅读模式 关闭右栏 4 8764
官方版本2.0支持   但没release  我擦    故 没戏


CDH版本 yum 安装了个 hbase-master    竟然又不支持  不知道搞什么鬼。。。

CDH下载了他们的tar包, 启动    竟然又支持mob   我也是日了狗。。。。。


问题来了:  express版和enterprise版本  有没有功能区别(CM不谈), 我直接用他们的tar包生产  需不要license   我擦。。。

已有(4)人评论

跳转到指定楼层
Helios 发表于 2016-12-1 14:45:19
洗洗更健康
回复

使用道具 举报

nextuser 发表于 2016-12-1 15:17:38

express版免费,不需要license enterprise版本收费。


下面是
CDH 的Cloudera Manager免费与收费版的对比表

  
CDH 特性
  
免费版
付费版
Deployment, Configuration & Management
系统管理

  
Automated Deployment &Hadoop Readiness Checks
自动化部署及快速检查
•
•
Install the complete CDH stack in minutes and ensure  optimal settings
安装完整的CDH及优化配置
Service Management
服务管理
•
•
Configure and manage all CDH services, including Impala  and Search, from a central interface
提供统一的界面管理与配置全部的CDH服务,包括cloudera  impala及cloudera search
Security Management
安全
•
•
Configure and manage security across the cluster –  including Kerberos authentication and role-based (administrator and  read-only) administration
跨群集的安全管理与配置(包括Kerberos认证及基于角色的管理)
Resource Management
资源管理
•
•
Allocate cluster resources by workload or by  user/group/application to eliminate contention and ensure Quality-of-Service  (QoS)
根据工作量分配资源,或根据/user/group/application文件消除争用,保证QoS
High Availability
HA
•
•
Easily configure and manage High Availability for  various services like HDFS, MapReduce, Oozie, YARN, HBase
为多种服务配置HA:HDFS,MapReduce,Oozie,YARN,Hbase
Client Configuration Management
管理客户端配置
•
•
Centrally configure all client access to the cluster
集中配置连接到群集的客户端
Node Templating
节点模板
•
•
Easily deploy and expand heterogeneous clusters by  creating templates for node roles
通过为节点角色创造模板,来部署和扩展不同的群集
Comprehensive Workflows
全面的工作流
•
•
Perform end-to-end tasks such as start/stop/restart  clusters, services and roles, add/delete hosts, decommission nodes etc.
执行端到端的任务,如群集、服务、角色级别的启停,增删主机,解除节点等。
Multi-Cluster Management
多群集管理
•
•
Manage multiple CDH clusters from a single instance of  Cloudera Manager
一个Manager管理多个CDH群集


Monitor
Service, Host & Activity Monitoring
服务、主机、活动的监控
•
•
Get a consolidated, real-time view of the state of all  services, hosts and activities running in the cluster
对服务、主机、活动的统一的实时的监控
Events & Alerts
事件和警报
•
•
Create, aggregate and receive alerts on relevant Hadoop  events pertaining to system health, log messages, user actions and activities  Set thresholds and create custom alerts for metrics collected by CM
创建、合计、接收Hadoop相关的系统健康、日志信息、用户动作和活动的警报。设置阈值并创建用户警报。
Diagnose
Global Time Control
全程控制
•
•
Correlate all views along a configurable timeline to  simplify diagnosis
通过可配置的时间线串联所有视图,简化诊断。
Proactive Health Checks
健康预检
•
•
Monitor dozens of service performance metrics and get  alerts you when you approach critical thresholds
监控服务性能,当达到阈值时向用户报警。
Heatmaps
热度图
•
•
Visualize health status and metrics across the cluster  to quickly identify problem nodes and take action
图形化展示群集的健康状态,便于发现故障节点并修复。
Customizable Charts
可定制的图表
•
•
Report and visualize on key time-series metrics about  services, roles and hosts
按照时间顺序提供服务、角色和主机的形象报告。
Intelligent Log Management
智能日志管理
•
•
Gather, view and search Hadoop logs collected from  across the cluster
可以收集、观察和查询从群集中获得的Hadoop日志。
Integrate
Comprehensive API
广泛的API
•
•
Easily integrate Cloudera Manager with your existing  enterprise-wide management and monitoring tools
可以简单的将CM与现有的企业范围的管理和监控工具集成起来。
3rd Party Application Management
对第三方应用的管理
•
•
Deploy, manage and monitor services for 3rd party  applications running on the cluster (e.g. data integration tools,  math/machine learning applications, non-CDH services etc.)
部署、管理和监控运行在群集上的第三方应用服务。
Advanced Management Features (Enabled by Subscription)
Operational Report & Quota Management
操作报告和配额管理

  
•
Visualize current and historical disk usage; set user  and group-based quotas; and track MapReduce, Impala, YARN and HBase usage
1.当前及历史磁盘用量展示
  2.基于用户和组的配额设置
  3.跟踪MapReduce、Impala、YARN和Hbase的用量
Configuration History & Rollbacks
记录配置历史及回滚

  
•
Maintain a trail of all actions and a complete record  of configuration changes, including the ability to roll back to previous  states
保留所有活动及配置变化的痕迹档案,包含回滚到之前状态的能力。
Rolling Updates
滚动升级

  
•
Stage service updates and restarts to portions of the  cluster sequentially to minimize downtime when upgrading or updating your  cluster
分阶段升级和重启群集各部分,最小化宕机时间。
AD Kerberos Integration
AD与Kerberos的集成

  
•
Integrate directly with Active Directory to get started  easily with Kerberos
直接与AD集成,可以方便的与Kerberos一起工作
Kerberos Wizard
Kerberos向导

  
•
Easily configure Kerberos and trigger automated  workflows to secure clusters
方便配置Kerberos,可以自动触发工作流来保证群集安全。
Hadoop SSL Related Configs
Hadoop SSL相关配置

  
•
Simplify configs and eliminates need for safety valves
简化配置并减少安全阀的需求
LDAP/SAML Integration
LDAP/SAML的集成

  
•
Integrate user credentials with Active Directory and  enable single sign-on (SSO) capabilities
集成了基于AD的用户验证,并提供了SSO能力。
SNMP Support
对SNMP的支持

  
•
Send Hadoop-specific events and alerts to global  monitoring tools as SNMP traps
以SNMP 异常报告的方式向全局监控工具发送Hadoop特定的事件和告警。(参见文末  注1)
Scheduled Diagnostics
cloudera技术诊断的支持

  
•
Take a snapshot of the cluster state and automatically  send it to Cloudera support to assist with optimization and issue resolution
优化和解决问题时,收集群集状态快照并自动发送至cloudera支持。
Automated Backup & Disaster Recovery
自动化备份和灾难恢复

  
•
Centrally configure and manage snapshotting and  replication workflows for HDFS, Hive and HBase
集中配置和管理快照,复制HDFS、Hive、HBase工作流。







回复

使用道具 举报

sstutu 发表于 2016-12-1 15:23:08
支持的,部分内容如下:

Storing Medium Objects (MOBs) in HBase
Data comes in many sizes, and saving all of your data in HBase, including binary data such as images and documents, is convenient. HBase can technically handle binary objects with cells that are up to 10MB in size. However, HBase's normal read and write paths are optimized for values smaller than 100KB in size. When HBase deals with large numbers of values up to 10MB, referred to here as medium objects, or MOBs, performance is degraded due to write amplification caused by splits and compactions.

Traditionally, the way to solve this problem has been to store objects larger than 100KB directly in HDFS, and store references to their locations in HBase. CDH 5.4 introduces optimizations for storing objects up to 10MB in size, termed medium objects or MOBs, directly in HBase, using the work done in HBASE-11339.

To take advantage of MOB, you need to use HFile version 3. Optionally, you can configure the MOB file reader's cache settings for each RegionServer, then configure specific columns to hold MOB data. Client code does not need to change to take advantage of HBase MOB support. The feature is transparent to the client.
cdh官网
url:https://www.cloudera.com/documen ... dmin_hbase_mob.html
回复

使用道具 举报

Helios 发表于 2016-12-1 15:31:32
javascript:void(0)
回复

使用道具 举报

您需要登录后才可以回帖 登录 | 立即注册

本版积分规则

关闭

推荐上一条 /2 下一条