通过 pyspark 脚本运行加载镶木地板表时出现以下错误。通过 pyspark shell 测试时没有问题
交互模式工作正常：
df_writer = pyspark.sql.DataFrameWriter(df)
df_writer.saveAsTable('test', format='parquet', mode='overwrite',path='xyz/test_table.parquet')
脚本模式抛出错误：
/opt/mapr/spark/spark-2.0.1//bin/spark-submit --jars /opt/mapr/spark/spark-2.0.1/-2.0.1/jars/commons-csv-1.2.jar /home/mapr/scripts/pyspark_load.py
17/02/17 14:57:06 WARN Utils: Service 'SparkUI' could not bind on port 4040. Attempting port 4041.
Traceback (most recent call last):
File "/home/mapr/scripts/2_pyspark_load.py", line 23, in <module>
df_writer = pyspark.sql.DataFrameWriter(df)
NameError: name 'pyspark' is not defined