Spark 1.1 was released a few weeks ago, and I've been curious about using it from a standalone Python script. While Spark has Java and Scala bindings, the Python one appeals to me most--I'd really like to be able to use Spark from within a standalone Python script, and then step through it in PyCharm, which is the IDE I really enjoy. Here's how to do that on Mac OS X 10.9

more ...