Skip to content

Tag: hadoop

Duplicate “values” for some key in map-reduce java program

I am new in mapreduce and hadoop (hadoop 3.2.3 and java 8). I am trying to separate some lines based on a symbol in a line. Example: “q1,a,q0,” should be return (‘a’,”q1,a,q0,”) as (key, value). My dataset contains ten(10) lines , five(5) for key ‘a’ and five for key ‘b’. I expect to get 5 line for each key but

java_home is not read by hadoop

I installed java8 with brew install –cask adoptopenjdk/openjdk/adoptopenjdk8 but i think i messed things up, when i type echo $JAVA_HOME it gives /usr/bin/java when i type java -version it gives java version “1.8.0_311” Java(TM) SE Runtime Environment (build 1.8.0_311-b11) Java HotSpot(TM) 64-Bit Server VM (build 25.311-b11, mixed mode) when i type /usr/libexec/java_home it gives /Library/Internet Plug-Ins/JavaAppletPlugin.plugin/Contents/Home when i try to