:~/opt/spark-
2.1.0-bin-hadoop2
.7$ spark-submit
--helpUsage: spark-submit [options]
file> [app arguments] Usage: spark-submit--kill [submission ID] --master [spark://...]Usage: spark-submit--status [submission ID] --master [spark://...]Usage: spark-submitrun-example [options] example-class[example args] Options:--master MASTER_URL spark://host:port, mesos://host:port, yarn, or local.--deploy-mode DEPLOY_MODE Whether to launch the driver program locally ("client") orononeoftheworker machines insidethecluster ("cluster") (Default: client).--class CLASS_NAME Your application‘s main class (for Java / Scala apps).--name NAME A name of your application.--jars JARS Comma-separated list of local jars to include on the driverandexecutor classpaths.--packages Comma-separated list of maven coordinates of jars to includeonthedriverandexecutor classpaths. Will searchthelocalmaven repo,thenmaven centralandany additional remote repositoriesgivenby--repositories. The format for thecoordinates should be groupId:artifactId:version.--exclude-packages Comma-separated list of groupId:artifactId, to exclude whileresolvingthedependencies providedin--packages to avoiddependency conflicts.--repositories Comma-separated list of additional remote repositories tosearchforthemaven coordinatesgivenwith--packages.--py-files PY_FILES Comma-separated list of .zip, .egg, or .py files to placeonthePYTHONPATHforPython apps.--files FILES Comma-separated list of files to be placed in the workingdirectoryofeach executor.--conf PROP=VALUE Arbitrary Spark configuration property.--properties-file FILE Path to a file from which to load extra properties. If notspecified, this will lookforconf/spark-defaults.conf.--driver-memory MEM Memory for driver (e.g. 1000M, 2G) (Default: 1024M).--driver-java-options Extra Java options to pass to the driver.--driver-library-path Extra library path entries to pass to the driver.--driver-class-path Extra class path entries to pass to the driver. Note thatjars addedwith--jars are automatically included in theclasspath.--executor-memory MEM Memory per executor (e.g. 1000M, 2G) (Default: 1G).--proxy-user NAME User to impersonate when submitting the application.This argumentdoesnotworkwith--principal / --keytab.--help, -h Show this help message and exit.--verbose, -v Print additional debug output.--version, Print the version of current Spark.Spark standalonewithcluster deploy mode only:--driver-cores NUM Cores for driver (Default: 1).Spark standaloneorMesoswithcluster deploy mode only:--supervise If given, restarts the driver on failure.--kill SUBMISSION_ID If given, kills the driver specified.--status SUBMISSION_ID If given, requests the status of the driver specified.Spark standaloneandMesos only:--total-executor-cores NUM Total cores for all executors.Spark standaloneandYARN only:--executor-cores NUM Number of cores per executor. (Default: 1 in YARN mode,orall available coresontheworkerinstandalone mode) YARN-only:--driver-cores NUM Number of cores used by the driver, only in cluster mode(Default:1).--queue QUEUE_NAME The YARN queue to submit to (Default: "default").--num-executors NUM Number of executors to launch (Default: 2).If dynamic allocationisenabled,theinitialnumberofexecutors will beatleast NUM.--archives ARCHIVES Comma separated list of archives to be extracted into theworking directoryofeach executor.--principal PRINCIPAL Principal to be used to login to KDC, while running onsecure HDFS.--keytab KEYTAB The full path to the file that contains the keytab for theprincipal specifiedabove. This keytab will be copiedtothenoderunningtheApplication Master viatheSecure Distributed Cache,forrenewingthelogin ticketsandthedelegation tokens periodically.来源: http://www.bubuko.com/infodetail-1947786.html