It was a sunny day. I started to setup my Spark Evironment. After reading a lot of online tutorials about how to config Spark1.X on Intellij Idea, I found it would be very easy. But something unexpected may happen any time. I still met some troubles as the Spark2.X has some differences from Spark1.X. That is why I want to write this blog to specify how to setup Spark2.X on Intellij Idea. There are five elements required:

Recently, I start to touch the Docker technology as I had a idea with some of my friends that we want to run Spark on Docker. The reason that this blog written in English is that I run Docker on Ubuntu and there is no chinese input method installed.