# encoding:utf-8
__author__ = 'jwang'
import os
cmd_list = []
spark_submit = '/usr/local/datacenter/spark/bin/spark-submit'
cmd_list.append(spark_submit)
cmd_list.append('--class')
cmd_list.append('com.xx.xx.RBK')
cmd_list.append('--master')
cmd_list.append('yarn')
cmd_list.append('--name')
cmd_list.append('XXRBK')
cmd_list.append('--executor-memory')
cmd_list.append('3g')
cmd_list.append('--driver-memory')
cmd_list.append('3g')
cmd_list.append('--executor-cores')
cmd_list.append('16')
cmd_list.append('xxxx.jar')
params = []
params.append('"xx"')
params.append('"rule"')
cmd_list.extend(params)
exec_cmd = ' '.join(cmd_list)
#''
print 'start to execute ::: ' + exec_cmd
os.system(exec_cmd)
os._exit(0)
分享到:
相关推荐
Spark for Python Developers aims to combine the elegance and flexibility of Python with the power and versatility of Apache Spark. Spark is written in Scala and runs on the Java virtual machine. It is...
code, code code!!! spark for python developer
spark_python_ml_examples, Spark 2.0 python 机器学习示例 Spark python-机器学习示例这个库是 Apache Spark 示例系列的一部分,旨在演示如何用Spark支持的不同编程语言实现机器学习解决方案的实现。 Java是唯一未...
1、该资源内项目代码经过严格调试,下载即用确保可以运行! 2、该资源适合计算机相关专业(如计科、人工智能、大数据、数学、电子信息等)正在做课程...基于Spark、Python Flask和MovieLens dataset的在线电影推荐系统
To begin with, you will learn the most effective way to install the Python development environment powered by Spark, Blaze, and Bookeh. You will then find out how to connect with data stores such as ...
Frank Kane's Taming Big Data with Apache Spark and Python English | 2017 | ISBN-10: 1787287947 | 296 pages | AZW3/PDF/EPUB (conv) | 6.12 Mb Key Features Understand how Spark can be distributed across...
spark程序开发,运用python语言,英文原版,绝对值得拥有和学习!!!
由简入深的机器学习参考文档, 里面有大量的实际项目的源代码, 包括Spark, Python, 和同用的机器学习算法。 Professional tutorial on all industry standard machine leaning algorithm and rich source code in ...
Spark_for_PythonSpark_for_PythonSpark_for_PythonSpark_for_PythonSpark_for_PythonSpark_for_PythonSpark_for_Python
A Real-world examples to help you analyze large datasets with Apache Spark
Big Data with Apache Spark and Python 英文mobi 本资源转载自网络,如有侵权,请联系上传者或csdn删除 本资源转载自网络,如有侵权,请联系上传者或csdn删除
面向熟悉Python语言的想学习Spark的开发者,内容非常丰富
Big Data, MapReduce, Hadoop, and Spark with Python: Master Big Data Analytics and Data Wrangling with MapReduce Fundamentals using Hadoop, Spark, and Python by LazyProgrammer English | 15 Aug 2016 | ...
dpark, 在 python 中,Spark的python 克隆,一个MapReduce相似的框架 DPark DPark是Spark的python 克隆,类似于支持迭代计算的MapReduce(R) 计算框架。单词计数( wc.py )的示例:import dparkfile = dpark.textFi
Spark编程基础(Python版).rar
本文来自csdn,本文简单介绍了Python+spark的配置运行及实例介绍,希望对您的学习有所启迪。0.1配置可参考:0.2有关spark说明:spark不兼容Python3.6安装注意版本可下载:anaconda4.21.1数据student.txt1.2代码1.3...
Set up real-time streaming and batch data intensive infrastructure using Spark and Python Deliver insightful visualizations in a web app using Spark (PySpark) Inject live data using Spark Streaming ...
Big Data with Apache Spark and Python 英文无水印pdf pdf所有页面使用FoxitReader和PDF-XChangeViewer测试都可以打开 本资源转载自网络,如有侵权,请联系上传者或csdn删除 本资源转载自网络,如有侵权,请...
Learning Apache Spark with Python Learning Apache Spark with Python