Spark Installation Issue

Q&A DQ Courses
, ,
#1

Screen Link: https://app.dataquest.io/m/127/project%3A-spark-installation-and-jupyter-notebook-integration/4/pyspark-shell

I’m working through pyspark installation. I have installed Java and Spark on my computer, and unzipped the tar file.

Despite searching extensively across stack overflow and reviewing the apache spark documentation, I cannot get pyspark to launch. I have included a screenshot below of the output from running the bin\pyspark command.

image
image845×105 5.39 KB

I’m really stuck as to what I need to do to rectify this. I’ve appended the spark location to a path environment variable, and set the SPARK_HOME to the respective location also. Any suggestions/guidance would be really appreciated!

Thanks,
George

2 Likes
#2

@boormang: have not ventured into spark or installing it myself so I’m bumping up this topic in case any of the other volunteers have experience with this but missed it.

1 Like
#3

Hi boormang

Please refer to this article. I personally found it quite helpful.

Thanks.

2 Likes
#4

Hi!

Not sure if anyone here needs help with this still but I personally found this link helpful. Use the commands listed in the Anaconda command prompt.

Hope it helps!

1 Like