hadoop - Error while using Revolution R to convert a csv file to an xdf using rxImport function -


i trying take csv file cloudera , convert xdf

i have tried following:

inputfile <- file.path("/user/...")  #create column classes data set columnclasses <- c("character", "character", "character",                     "character", "character", "character",                     "character", "character", "character",                     "character", "character", "numeric", "character"                    )  names(columnclasses) <- paste("v", seq(1:13), sep = "")  ##convert input csv file rxtextdata object textdata <- rxtextdata(file = inputfile,                          filesystem = hdfsfs,                          colclasses = columnclasses                          )  ##set chunk size chunk.size <- 250000  ##create output file location newxdf <- rxxdfdata("/user/...", filesystem = hdfsfs)  rximport(indata = inputfile,      outdata = newxdf,      rowsperread = chunk.size,      overwrite = true,      numrows = -1)

when run following error:

error in rxuhandleclusterjobtryfailure(retobject, hpcserverjob, autocleanup,  :    error completing job on cluster: error in rxexecindatahadoop(callinfo, matchcall) :    data source not have hdfs file system type.

note: have looked @ textdata using functions rxgetinfo , looks fine.

any insights why i'm getting error?

update: typo in rximport function.

actually ran:

rximport(indata = textdata,      outdata = newxdf,      rowsperread = chunk.size,      overwrite = true,      numrows = -1)

and got following error:

error in rxuhandleclusterjobtryfailure(retobject, hpcserverjob, autocleanup,  :    error completing job on cluster: error in rxcall("rx_importdatasource", params) :

Comments

Post a Comment

Popular posts from this blog

android - MPAndroidChart - How to add Annotations or images to the chart -

i working latest mpandroidchart library , looking way add annotations or images clickable. example: once data reaches value event occurs want able display user - there multiple events can occur annotations (not sure if right word) or image added @ point in chart. any pointers welcome. check documentation of yaxis . focus on setspacetop(...) , setaxismaxvalue(...) methods. for background: bar-shadow , disable calling: barchart.setdrawbarshadow(false) or change color: bardataset.setbarshadowcolor(int color)
Read more

javascript - Add class to another page attribute using URL id - Jquery -

i have attached id url. ex: when click link 1 , has #tab-2 id , takes me landing page. in landing page have find element has #tab-2 id have add class .active . i tried no luck. please 1 correct code. thanks js fiddle link html <div class="menu"> <ul> <li><a href="http://jsfiddle.net/gscyoa0j/1/#tab-2">link 1</a></li> <li><a href="http://jsfiddle.net/gscyoa0j/1/#tab-44">link 2</a></li> <li><a href="http://jsfiddle.net/gscyoa0j/1/#tab-74">link 3</a></li> </ul> </div> landing page <div class="tab"> <ul> <li><a id="tab-2" class="active" >link 1 content</a></li> <li><a id="tab-44" >link 2 content</a></li> <li><a id="tab-74" >link 3 content</a></l...
Read more

firefox - Where is 'webgl.osmesalib' parameter? -

i'm trying webgl running on firefox (v37.0.2) via software acceleration mesa. tried following steps have been stated in article: http://www.binarytides.com/enable-webgl-firefox-ubuntu/ however, unable find parameter named ' webgl.osmesalib ' in about:config section? has been removed (or renamed)? if yes, how should instruct firefox use mesa's software acceleration webgl? looks support osmesa removed in favour llvmpipe.
Read more