Run Jupyter notebook with spark in docker
Install spark to run locally
docker run -p 8888:8888 -p 4041:4041 jupyter/all-spark-notebook
The auth token is logged in the terminal. Copy it.
In host browse to localhost:8888
. Use the token to authenticate in the interface.
Create new spylon-kernel
notebook and write scala code.
Spark WebUI is running on port 4041