小编Asm*_*Ali的帖子

cancerdetector@cluster-cancerdetector-m:~/SparkBWA/build$ spark-submit --class SparkBWA --master yarn-cluster --deploy-mode cluster --conf spark.yarn.jar=hdfs:///user/spark/spark-assembly.jar --driver-memory 1500m --executor-memory 1500m --executor-cores 1 --archives ./bwa.zip --verbose ./SparkBWA.jar -algorithm mem -reads paired -index /Data/HumanBase/hg38 -partitions 32 ERR000589_1.filt.fastq ERR000589_2.filt.fastqhb Output_ERR000589
    Using properties file: /usr/lib/spark/conf/spark-defaults.conf
    Adding default property: spark.executor.extraJavaOptions=-Xbootclasspath/p:/usr/local/share/google/alpn/alpn-boot-8.1.7.v20160121.jar
    Adding default property: spark.history.fs.logDirectory=hdfs://cluster-cancerdetector-m/user/spark/eventlog
    Adding default property: spark.eventLog.enabled=true
    Adding default property: spark.driver.maxResultSize=1920m
    Adding default property: spark.shuffle.service.enabled=true
    Adding default property: spark.yarn.historyServer.address=cluster-cancerdetector-m:18080
    Adding default property: spark.sql.parquet.cacheMetadata=false
    Adding default property: spark.driver.memory=3840m
    Adding default property: spark.dynamicAllocation.maxExecutors=10000
    Adding default property: spark.scheduler.minRegisteredResourcesRatio=0.0
    Adding default property: spark.yarn.am.memoryOverhead=558
    Adding …