Skip to content

Commit 7b44a6f

Browse files
committed
added sample docker file for custom spark image
1 parent 18c8ca2 commit 7b44a6f

File tree

2 files changed

+18
-1
lines changed

2 files changed

+18
-1
lines changed
Lines changed: 17 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,17 @@
1+
# Use the official Spark image as the base image
2+
FROM bitnami/spark:3.5.3
3+
USER root
4+
# Install the required Python packages
5+
RUN pip install fastavro \
6+
pyspark \
7+
azure-eventhub==5.10.1 \
8+
azure-storage-blob==12.14.1 \
9+
azure-eventhub-checkpointstoreblob-aio \
10+
azure-mgmt-resource \
11+
azure-mgmt-datalake-store \
12+
azure-datalake-store \
13+
avro \
14+
avro-python3
15+
USER 1001
16+
# Set the entrypoint to the Spark entrypoint
17+
ENTRYPOINT ["/opt/bitnami/scripts/spark/entrypoint.sh"]

docs/index.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,4 +1,4 @@
1-
### **Deploying Apache Spark on Azure Kubernetes Service (AKS)**
1+
### **Running Apache Spark on Azure Kubernetes Service (AKS)**
22

33
---
44

0 commit comments

Comments
 (0)