Flume starts Failed to commit transaction.Transaction rolled back.

execute bin/flume-ng agent-c conf/-f conf/flume.conf-n ecoll-Dflume.root.logger=info,console
error

org.apache.flume.sink.hbase.HBaseSink [SinkRunner-PollingRunner-DefaultSinkProcessor] ERROR  - Failed to commit transaction.Transaction rolled back.
org.apache.hadoop.hbase.client.RetriesExhaustedWithDetailsException: Failed 3 actions: org.apache.hadoop.hbase.regionserver.NoSuchColumnFamilyException: Column family info does not exist in region errorLog,,1525067385914.bc5460e41a7971382461c5fc4fe54f5f. in table "errorLog", {NAME => "f", BLOOMFILTER => "ROW", VERSIONS => "1", IN_MEMORY => "false", KEEP_DELETED_CELLS => "FALSE", DATA_BLOCK_ENCODING => "NONE", TTL => "FOREVER", COMPRESSION => "NONE", MIN_VERSIONS => "0", BLOCKCACHE => "true", BLOCKSIZE => "65536", REPLICATION_SCOPE => "0"}, {NAME => "i", BLOOMFILTER => "ROW", VERSIONS => "1", IN_MEMORY => "false", KEEP_DELETED_CELLS => "FALSE", DATA_BLOCK_ENCODING => "NONE", TTL => "FOREVER", COMPRESSION => "NONE", MIN_VERSIONS => "0", BLOCKCACHE => "true", BLOCKSIZE => "65536", REPLICATION_SCOPE => "0"}
    at org.apache.hadoop.hbase.regionserver.RSRpcServices.doBatchOp(RSRpcServices.java:765)
    at org.apache.hadoop.hbase.regionserver.RSRpcServices.doNonAtomicRegionMutation(RSRpcServices.java:720)
    at org.apache.hadoop.hbase.regionserver.RSRpcServices.multi(RSRpcServices.java:2168)
Mar.07,2021
  • Log collection and parsing

    as a beginner to big data, I first learned log collection (mainly flume), searched the relevant log collection architecture scheme. If it is flume, most of them recommend and support flume + kafka, as a beginner. I don t quite understand, one is a distr...

    Mar.25,2021
  • How Flume converts logs to json? through some kind of mapping

    Can convert logs to json using rules directly through the configuration file? if it doesn t work, can I use a custom script to input it as a log and output as a json conversion? did not find this information, ask for help, thank you! ...

    Apr.11,2021
Menu