Skip to content

Commit 95ea4ce

Browse files
gerashegalovHyukjinKwon
authored andcommitted
[MINOR][DOCS][CONNECT] Replace pyspark with pyspark-client in the Connect overview
### What changes were proposed in this pull request? Spark Connect Overview doc should reference the non-JVM pyspark-client pip package instead of `pyspark[connect]` which includes a complete SPARK_HOME with JVM jars ### Why are the changes needed? Spark Connect Overview is a top search result and should encourage using a package with the minimum footprint. ### Does this PR introduce _any_ user-facing change? No ### How was this patch tested? Previewed the doc on Github ### Was this patch authored or co-authored using generative AI tooling? No Closes #52901 from gerashegalov/patch-1. Authored-by: Gera Shegalov <[email protected]> Signed-off-by: Hyukjin Kwon <[email protected]> (cherry picked from commit 2f04e78) Signed-off-by: Hyukjin Kwon <[email protected]>
1 parent a404945 commit 95ea4ce

File tree

1 file changed

+2
-2
lines changed

1 file changed

+2
-2
lines changed

docs/spark-connect-overview.md

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -284,11 +284,11 @@ The connection may also be programmatically created using _SparkSession#builder_
284284

285285
<div data-lang="python" markdown="1">
286286

287-
First, install PySpark with `pip install pyspark[connect]=={{site.SPARK_VERSION_SHORT}}` or if building a packaged PySpark application/library,
287+
First, install PySpark with `pip install pyspark-client=={{site.SPARK_VERSION_SHORT}}` or if building a packaged PySpark application/library,
288288
add it your setup.py file as:
289289
{% highlight python %}
290290
install_requires=[
291-
'pyspark[connect]=={{site.SPARK_VERSION_SHORT}}'
291+
'pyspark-client=={{site.SPARK_VERSION_SHORT}}'
292292
]
293293
{% endhighlight %}
294294

0 commit comments

Comments
 (0)