hdfs - How to write data to HA Hadoop QJM using Apache FLUME? -


how flume identify active namenode data written hdfs? without high availability hadoop have namenode ip configured in flume.conf data directed hdfs. whereas in our case, flume should identify active , standby namenodes , thereby data should directed active one.

afaik not possible in direct way. hdfs sink configuration has room 1 namenode.

nevertheless, think can configure 2 hdfs sinks (and 2 channels), each 1 pointing namenode. source put copy of each event in both channels due default replicating channel selector. so, each sink try persist data itself; 1 pointing standby namenode not persist until active 1 falls down , standby becomes active.

hth!


Comments

Post a Comment

Popular posts from this blog

IF statement in MySQL trigger -

this query code in mysql trigger. if 1=2 select 'yes'; else select 'no'; end if; but has following error: if '1'='2' select 'yes' error code: 1064. have error in sql syntax; check manual corresponds mysql server version right syntax use near 'if '1'='2' select 'yes'' @ line 1 0.000 sec what solution?
Read more

c++ - What does MSC in "// appease MSC" comments mean? -

i run across // appease msc in c++ comments, e.g. here : const int& array::operator[](int offset) const { int mysize = getitssize(); if (offset >= 0 && offset < getitssize()) return ptype[offset]; throw xboundary(); return ptype[offset]; // appease msc! } what msc stand ? the author means microsoft's compiler, more formally known msvc.
Read more

android - MPAndroidChart - How to add Annotations or images to the chart -

i working latest mpandroidchart library , looking way add annotations or images clickable. example: once data reaches value event occurs want able display user - there multiple events can occur annotations (not sure if right word) or image added @ point in chart. any pointers welcome. check documentation of yaxis . focus on setspacetop(...) , setaxismaxvalue(...) methods. for background: bar-shadow , disable calling: barchart.setdrawbarshadow(false) or change color: bardataset.setbarshadowcolor(int color)
Read more