在Spark on Yarn的部署模式中，每次提交application，都会往HDFS中存放一个spark的二进制包，这一方面影响性能，另一方面占用HDFS的存储空间，
可以在spark-default.conf文件中添加如下配置，将spark的二进制包告诉Spark，已经上传
spark.yarn.jar hdfs://hadoop.master:8020/spark_lib_jars/spark-assembly-1.2.0-hadoop2.4.0
在运行spark程序前，需要将spark的jar文件上传至HDFS中
这个设置解决了在http://bit1129.iteye.com/blog/2174677中测试yarn client和yarn cluster两种方式提交作业时，spaspark jar提交了两次
参考：http://www.cnblogs.com/luogankun/p/4191796.html
相关推荐
赠送jar包：hadoop-yarn-client-2.6.5.jar； 赠送原API文档：hadoop-yarn-client-2.6.5-javadoc.jar； 赠送源代码：hadoop-yarn-client-2.6.5-sources.jar； 赠送Maven依赖信息文件：hadoop-yarn-client-2.6.5.pom；...
赠送jar包：hadoop-yarn-api-2.5.1.jar； 赠送原API文档：hadoop-yarn-api-2.5.1-javadoc.jar； 赠送源代码：hadoop-yarn-api-2.5.1-sources.jar； 赠送Maven依赖信息文件：hadoop-yarn-api-2.5.1.pom； 包含翻译后...
赠送jar包：hadoop-yarn-common-2.6.5.jar 赠送原API文档：hadoop-yarn-common-2.6.5-javadoc.jar 赠送源代码：hadoop-yarn-common-2.6.5-sources.jar 包含翻译后的API文档：hadoop-yarn-common-2.6.5-javadoc-...
赠送jar包：hadoop-yarn-server-resourcemanager-2.6.0.jar； 赠送原API文档：hadoop-yarn-server-resourcemanager-2.6.0-javadoc.jar； 赠送源代码：hadoop-yarn-server-resourcemanager-2.6.0-sources.jar； 赠送...
spark-assembly-1.3.0-hadoop2.5.0-cdh5.3.0.jar的下载地址和提取码
SPARK2_ON_YARN-2.4.0 jar包下载
赠送jar包：hadoop-yarn-server-common-2.6.5.jar； 赠送原API文档：hadoop-yarn-server-common-2.6.5-javadoc.jar； 赠送源代码：hadoop-yarn-server-common-2.6.5-sources.jar； 赠送Maven依赖信息文件：hadoop-...
赠送jar包：hadoop-yarn-server-web-proxy-2.6.0.jar； 赠送原API文档：hadoop-yarn-server-web-proxy-2.6.0-javadoc.jar； 赠送源代码：hadoop-yarn-server-web-proxy-2.6.0-sources.jar； 赠送Maven依赖信息文件：...
赠送jar包：hadoop-yarn-api-2.7.3.jar； 赠送原API文档：hadoop-yarn-api-2.7.3-javadoc.jar； 赠送源代码：hadoop-yarn-api-2.7.3-sources.jar； 赠送Maven依赖信息文件：hadoop-yarn-api-2.7.3.pom； 包含翻译后...
hadoop2.7.4安装包补丁包，解决yarn定时调度启动问题！！
赠送jar包：hadoop-yarn-server-applicationhistoryservice-2.6.0.jar； 赠送原API文档：hadoop-yarn-server-applicationhistoryservice-2.6.0-javadoc.jar； 赠送源代码：hadoop-yarn-server-...
赠送jar包：hadoop-yarn-common-2.5.1.jar； 赠送原API文档：hadoop-yarn-common-2.5.1-javadoc.jar； 赠送源代码：hadoop-yarn-common-2.5.1-sources.jar； 包含翻译后的API文档：hadoop-yarn-common-2.5.1-...
hadoop-annotations-3.1.1.jar hadoop-common-3.1.1.jar hadoop-mapreduce-client-core-3.1.1.jar hadoop-yarn-api-3.1.1.jar hadoop-auth-3.1.1.jar hadoop-hdfs-3.1.1.jar hadoop-mapreduce-client-hs-3.1.1.jar ...
timelineservice jar包
赠送jar包：hadoop-yarn-server-common-2.5.1.jar； 赠送原API文档：hadoop-yarn-server-common-2.5.1-javadoc.jar； 赠送源代码：hadoop-yarn-server-common-2.5.1-sources.jar； 赠送Maven依赖信息文件：hadoop-...
赠送jar包：hadoop-yarn-api-2.5.1.jar； 赠送原API文档：hadoop-yarn-api-2.5.1-javadoc.jar； 赠送源代码：hadoop-yarn-api-2.5.1-sources.jar； 包含翻译后的API文档：hadoop-yarn-api-2.5.1-javadoc-API文档-...
赠送jar包：hadoop-yarn-server-common-2.7.3.jar； 赠送原API文档：hadoop-yarn-server-common-2.7.3-javadoc.jar； 赠送源代码：hadoop-yarn-server-common-2.7.3-sources.jar； 赠送Maven依赖信息文件：hadoop-...
赠送jar包：hadoop-yarn-server-common-2.5.1.jar； 赠送原API文档：hadoop-yarn-server-common-2.5.1-javadoc.jar； 赠送源代码：hadoop-yarn-server-common-2.5.1-sources.jar； 赠送Maven依赖信息文件：hadoop-...
赠送jar包：hadoop-yarn-client-2.7.3.jar； 赠送原API文档：hadoop-yarn-client-2.7.3-javadoc.jar； 赠送源代码：hadoop-yarn-client-2.7.3-sources.jar； 赠送Maven依赖信息文件：hadoop-yarn-client-2.7.3.pom；...
赠送jar包：hadoop-yarn-client-2.6.5.jar； 赠送原API文档：hadoop-yarn-client-2.6.5-javadoc.jar； 赠送源代码：hadoop-yarn-client-2.6.5-sources.jar； 赠送Maven依赖信息文件：hadoop-yarn-client-2.6.5.pom；...