返回文章列表

Run MapReduce WordCount Example

2017-06-21
1 分鐘
HadoopMapReduce

1. Prepare WordCounting File

準備一個用於 word counting 的文字檔案。本範例使用 The Hunger Games 三部曲的內容。從 The Hunger Game 下載檔案並存到可存取的位置。

2. Create a New Folder in HDFS

$ /usr/local/hadoop/bin/hadoop fs -mkdir /wordcount

3. Copy File from Local to HDFS Folder

$ /usr/local/hadoop/bin/hadoop fs -copyFromLocal /TheHungerGames.txt /wordcount

驗證複製成功:

$ /usr/local/hadoop/bin/hadoop fs -cat /wordcount/TheHungerGames.txt

也可以透過瀏覽器確認。

4. Execute mapreduce-examples.jar

$ /usr/local/hadoop/bin/hadoop jar /usr/local/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.6.0.jar wordcount /wordcount /output

5. Download Results

執行成功後,下載並檢視輸出結果。

原文發表於 Medium

Command Palette

Search for a command to run...