kafkaChannel和kafkaSink如何配合使用？

如题，现在采用tcpsyslogsource+kafkaChannel+kafkaSink结构，应该如何配置使用？

根据官网，楼主配置似乎有些问题，但是尚不确定，下面仅供楼主参考
Kafka Channel

The events are stored in a Kafka cluster (must be installed separately). Kafka provides high availability and replication, so in case an agent or a kafka broker crashes, the events are immediately available to other sinks

The Kafka channel can be used for multiple scenarios: * With Flume source and sink - it provides a reliable and highly available channel for events * With Flume source and interceptor but no sink - it allows writing Flume events into a Kafka topic, for use by other apps * With Flume sink, but no source - it is a low-latency, fault tolerant way to send events from Kafka to Flume sources such as HDFS, HBase or Solr

多种场景：
1.提供一个channel和 Flume source但是没有sink
2.允许写flume events 到Kafka topic，但是没有source
3.它是一个低延迟，容错的方式发送events 从Kafka到Flume sources比如 HDFS, HBase 或则Solr

根据上文似乎kafkaChannel和kafkaSink不能并存。

NEOGX 发表于 2015-6-8 18:45
根据上文似乎kafkaChannel和kafkaSink不能并存。

嗯，我觉得也是，kafkachannel应该是配合别的sink来使用的。

NEOGX 发表于 2015-6-8 18:42
根据官网，楼主配置似乎有些问题，但是尚不确定，下面仅供楼主参考
Kafka Channel

With Flume source and sink - it provides a reliable and highly available channel for events
提供用于连接source和sink的可用的channel

个人观点：
kafka channel是一个断层的组件，即：要么连接一个source，并把数据发送到kafka topic上，要么连接kafka，消费kafka数据，传送到Flume sink组件如hdfs,hbase.
官方文档：
With Flume sink, but no source
- it is a low-latency, fault tolerant way to send events from Kafka to Flume sources such as HDFS, HBase or Solr
个人认为这里Flume sources可能是笔误，应该是Flume sink