Run Google Dataproc Locally with Docker
local.cloud- Category
- Developer Tools
- Rank
- No. 3075Tools index
- Type
- TOOL
- Date
About
The author provides Docker images that package Dataproc component versions, including Hadoop and Spark, so developers and AI agents can run a Dataproc environment locally. Google does not publish an official image for this, so dev and CI testing otherwise requires starting a real cluster. A self-test command runs from the image, and images exist for several Dataproc versions.
Tags
dataprocdockersparkhadoopgcptesting
Comments (0)
No comments yet
Editorially curated, with community endorsements as a secondary signal. Corrections welcome.