NEOGX 发表于 2015-7-30 14:30
恩，看到了。谢谢。
不过官网似乎已经写的很清楚了，这个是写入hbase的，没有hbase环境，恐怕写入不了
...

我想也是吧。谢了。

hongqianli 发表于 2015-7-30 13:31
你应该没有用过hbasesink吧

恩，看到了。谢谢。
不过官网似乎已经写的很清楚了，这个是写入hbase的，没有hbase环境，恐怕写入不了





This sink writes data to HBase. The Hbase configuration is picked up from the first hbase-site.xml encountered in the classpath. A class implementing HbaseEventSerializer which is specified by the configuration is used to convert the events into HBase puts and/or increments. These puts and increments are then written to HBase. This sink provides the same consistency guarantees as HBase, which is currently row-wise atomicity. In the event of Hbase failing to write certain events, the sink will replay all events in that transaction.

The HBaseSink supports writing data to secure HBase. To write to secure HBase, the user the agent is running as must have write permissions to the table the sink is configured to write to. The principal and keytab to use to authenticate against the KDC can be specified in the configuration. The hbase-site.xml in the Flume agent’s classpath must have authentication set to kerberos (For details on how to do this, please refer to HBase documentation).

For convenience, two serializers are provided with Flume. The SimpleHbaseEventSerializer (org.apache.flume.sink.hbase.SimpleHbaseEventSerializer) writes the event body as-is to HBase, and optionally increments a column in Hbase. This is primarily an example implementation. The RegexHbaseEventSerializer (org.apache.flume.sink.hbase.RegexHbaseEventSerializer) breaks the event body based on the given regex and writes each part into different columns.

The type is the FQCN: org.apache.flume.sink.hbase.HBaseSink.

hongqianli 发表于 2015-7-30 11:52
你看我发的配置啊，没用自定义，那是原生的。。。
angen01.sinks.k1.serializer=org.apache.flume.sink. ...

没有发现那，楼主在官网能找到这个类型的？

NEOGX 发表于 2015-7-30 11:48
hbase sink是你们自定义的吧，你们谁写的谁知道用哪些包

你看我发的配置啊，没用自定义，那是原生的。。。
angen01.sinks.k1.serializer=org.apache.flume.sink.hbase.RegexHbaseEventSerializer

hongqianli 发表于 2015-7-30 11:41
这位兄台有实践过吗

hbase sink是你们自定义的吧，你们谁写的谁知道用哪些包

hongqianli 发表于 2015-7-30 11:22
我的目的是在一台非hadoop节点的机器上运行flume的hbasesink，不知道还需要添加哪一些包。麻烦指点一下

只是知道你是需要这个环境的， 不清楚可以先全部加入，然后一个个T除

NEOGX 发表于 2015-7-30 11:11
可以的，但是需要具有hbase相关包或则有这个环境

我的目的是在一台非hadoop节点的机器上运行flume的hbasesink，不知道还需要添加哪一些包。麻烦指点一下