Tag Archives: flume

ETL component flume startup error [How to Solve]

An error is reported when flume starts

1.Flume couldn’t write to HDFS after it was started, so I hit the wall. As a result, I ignored the previous opening problem:

Error: Info: including HBase libraries found via (/ opt/HBase/bin/HBase) for HBase access
error: the main class org.apache.flume.tools.getjavaproperty cannot be found or loaded

2. After searching online for half an hour, I finally found a solution:

Modify the configuration file hbas-env.sh of HBase to:

Export HBase_ Classpath =/opt/HBase/conf comments

Replace with: export Java_ CLASSPATH=.:$JAVA_ HOME/lib/dt.jar:$JAVA_ HOME/lib/tools.jar

[Solved] Flume startup error: org.apache.flume.FlumeException: Failed to set up server socket

Run flume-ng agent -c conf -f conf/load_balancer_server.conf -n a1 -Dflume.root.logger=DEBUG,console, error:

org.apache.flume.FlumeException: Failed to set up server socket
at org.apache.flume.source.AvroSource.start(AvroSource.java:248)
at org.apache.flume.source.EventDrivenSourceRunner.start(EventDrivenSourceRunner.java:44)
at org.apache.flume.lifecycle.LifecycleSupervisor$MonitorRunnable.run(LifecycleSupervisor.java:249)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.jboss.netty.channel.ChannelException: Failed to bind to: node03/192.168.8.120:52020
at org.jboss.netty.bootstrap.ServerBootstrap.bind(ServerBootstrap.java:272)
at org.apache.avro.ipc.NettyServer.<init>(NettyServer.java:106)
at org.apache.flume.source.AvroSource.start(AvroSource.java:243)
… 9 more
Caused by: java.net.BindException: Address already in use

Reason: The last flume process has not been closed.
Execute jps to see 4191 Application, which is the process of flume. The reason is that when closing flume, I used Ctrl+Z, so I closed flume in the foreground, but the background process was not closed.

Solution: kill -9 4191. Also, next time, try to use Ctrl+C to close flume.