配置Spark History Server
1. 在Spark的conf目录下/usr/local/spark-1.6.0-bin-hadoop2.6/conf，将spark-defaults.conf.template改名为spark-defaults.conf
mv spark-defaults.conf.template spark-defaults.conf
2. 对spark-defaults.conf 配置
spark.eventLog.enabled true
spark.eventLog.dir hdfs://Master:9000/historyserverforSpark
spark.history.ui.port 18080
spark.history.fs.logDirectory hdfs://Master:9000/historyserverforSpark
3.启动history-server
[root@master sbin]# ./start-history-server.sh
4.成功
[root@master sbin]# jps
2691 DataNode
3459 Master
5444 HistoryServer
2836 SecondaryNameNode
2600 NameNode
3512 Worker
5641 Jps
[root@master sbin]#
5.在web浏览器中查看http://192.168.2.100:18080/ 显示页面
1.6.0 History Server
Event log direct
