我一直在寻找高低,以解决这个问题,我似乎无法调试问题!
所以,这就是我所拥有的.
我通过自制软件(Mac OSX Mavericks)1.55.0安装了boost.
其他boost库工作正常,但boost::filesystem似乎无法与实际文件系统交互.
这是我如何链接它(使用QT)
macx: LIBS += -L$$PWD/../../../../../usr/local/Cellar/boost/1.55.0_1/lib/ -lboost_system-mt
macx: LIBS += -L$$PWD/../../../../../usr/local/Cellar/boost/1.55.0_1/lib/ -lboost_filesystem-mt
INCLUDEPATH += $$PWD/../../../../../usr/local/Cellar/boost/1.55.0_1/include
DEPENDPATH += $$PWD/../../../../../usr/local/Cellar/boost/1.55.0_1/include
macx: PRE_TARGETDEPS += $$PWD/../../../../../usr/local/Cellar/boost/1.55.0_1/lib/libboost_filesystem.a
macx: PRE_TARGETDEPS += $$PWD/../../../../../usr/local/Cellar/boost/1.55.0_1/lib/libboost_system.a
请注意,这是由qt creator通过Add Library界面自动生成的.
这是我正在运行的代码永远不会有效.(意思是总是false)
namespace fs = boost::filesystem;
boost::system::error_code c;
fs::path path("/path/to/some/dir"); // Have tried '.' '/' './' '/usr' Everything!
bool isDir = boost::filesystem::is_directory(path, c);
if(!isDir) {
std::cout << "Error Response: " << c << std::endl;
ui->directoryEdit->setStyleSheet("background-color: red;");
}
else {
std::cout << "Is a …我目前正在处理 Spark 结构化流作业，似乎在每个批处理间隔中我都会收到警告：
WARN HDFSBackedStateStoreProvider: The state for version N doesn't exist in loadedMaps. Reading snapshot file and delta files if needed...Note that this is normal for the first batch of starting query.- 每批次 N 都会递增。
我在本地模式（禁用检查点）和在 YARN (EMR) 上运行时看到日志中充斥着这种情况。
问题是：可以安全地忽略这一点吗？打开调试日志记录 HDFSBackedStateStoreProvider 表明需要花时间读取快照和增量文件，因此我有些担心。
这是我看似最小的 SparkConf
val sparkConf: SparkConf = {
val conf = new SparkConf()
.setAppName("Structured Streaming")
.set("spark.sql.autoBroadcastJoinThreshold", "-1")
.set("spark.speculation", "false")
if (App.isLocal)
conf
.set("spark.cassandra.output.consistency.level", "LOCAL_ONE")
.setMaster("local[*]")
else
conf
.set("spark.cassandra.connection.host", PropertyLoader.getProperty("cassandra.contactPoints"))
.set("spark.cassandra.connection.local_dc", PropertyLoader.getProperty("cassandra.localDC"))
.set("spark.cassandra.connection.ssl.enabled", "true")
.set("spark.cassandra.connection.ssl.trustStore.path", PropertyLoader.truststorePath)
.set("spark.cassandra.connection.ssl.trustStore.password", PropertyLoader.getProperty("cassandra.truststorePassword")) …