This repository was archived by the owner on Jan 9, 2020. It is now read-only.
File tree Expand file tree Collapse file tree 1 file changed +3
-4
lines changed
Expand file tree Collapse file tree 1 file changed +3
-4
lines changed Original file line number Diff line number Diff line change @@ -5,7 +5,7 @@ title: Running Spark on Kubernetes
55* This will become a table of contents (this text will be scraped).
66{: toc }
77
8- Spark can run on clusters managed by [ Kubernetes] ( https://kubernetes.io ) . This feature makes use of the new experimental native
8+ Spark can run on clusters managed by [ Kubernetes] ( https://kubernetes.io ) . This feature makes use of native
99Kubernetes scheduler that has been added to Spark.
1010
1111# Prerequisites
@@ -71,15 +71,14 @@ To launch Spark Pi in cluster mode,
7171
7272{% highlight bash %}
7373$ bin/spark-submit \
74+ --master k8s://https://<k8s-apiserver-host >:<k8s-apiserver-port > \
7475 --deploy-mode cluster \
7576 --class org.apache.spark.examples.SparkPi \
76- --master k8s://https://<k8s-apiserver-host >:<k8s-apiserver-port > \
77- --conf spark.kubernetes.namespace=default \
7877 --conf spark.executor.instances=5 \
7978 --conf spark.app.name=spark-pi \
8079 --conf spark.kubernetes.driver.docker.image=<driver-image > \
8180 --conf spark.kubernetes.executor.docker.image=<executor-image > \
82- local:///opt/spark /examples/jars/spark-examples_2.11-2.3.0 .jar
81+ local:///path/to /examples.jar
8382{% endhighlight %}
8483
8584The Spark master, specified either via passing the ` --master ` command line argument to ` spark-submit ` or by setting
You can’t perform that action at this time.
0 commit comments