Message Boards Message Boards

How to Install HadoopLink?

GROUPS:

Hello, I am trying to use the HadoopLink package for the first time, and running into a few challenges. I am hoping someone out there is using this successfully, and might have some tips for a smooth installation in the current version of mathematica (10.2 at the time of writing this).

I have downloaded the open-source project and I am following along with HadoopLink installation instructions on GitHub.

I have unpacked the .zip and placed the HadoopLink folder (and only that folder, not the entire unpacked project) into my $User/Libarary/Mathematica/Applications folder, and loaded the package using:

<< HadoopLink`

But when I proceed to the next step, and execute this code...

link = OpenHadoopLink[
   "fs.default.name" -> "hdfs://hadoopheadlx.wolfram.com:8020",
   "mapred.job.tracker" -> "hadoopheadlx.wolfram.com:8021"];

DFSFileNames[link]

Mathematica output spews a bunch of Java exceptions (attached). Anybody have more detailed instructions on setting up HadoopLink? Maybe I should have put the entire project folder into the /Applications folder instead. I will try that now...

Attachments:
POSTED BY: Caitlin Ramsey
Answer
3 years ago

Group Abstract Group Abstract