flume 环境部署

1. 下载解压

2. 设置环境变量

3. 修改配置

conf/flume-env.sh.template   复制一份flume-env.sh,然后修改下JAVA_HOME即可

4. 例子

# Define a memory channel called ch1 on agent1
agent1.channels.ch1.type = memory
agent1.channels.ch1.capacity = 1000
agent1.channels.ch1.transactionCapacity = 100
 
# Define an Avro source called avro-source1 on agent1 and tell it
# to bind to 0.0.0.0:41414. Connect it to channel ch1.
agent1.sources.avro-source1.channels = ch1
agent1.sources.avro-source1.type = netcat
agent1.sources.avro-source1.bind = localhost
agent1.sources.avro-source1.port = 41414
 
# Define a logger sink that simply logs all events it receives
# and connect it to the other end of the same channel.
agent1.sinks.log-sink1.channel = ch1
agent1.sinks.log-sink1.type = logger
 
# Finally, now that we've defined all of our components, tell
# agent1 which ones we want to activate.
agent1.channels = ch1
agent1.sources = avro-source1
agent1.sinks = log-sink1

保存到conf/sample.conf

5. 运行

bin/flume-ng agent --conf $FLUME_HOME/conf --conf-file $FLUME_HOME/conf/sample.conf --name agent1 -Dflume.root.logger=INFO,console

 

6. 测试

telnet localhost 41414

http://www.waitingfy.com/archives/4172

4172

Leave a Reply

Name and Email Address are required fields.
Your email will not be published or shared with third parties.