使用表流,我尝试使用 foreachBatch 写入流
df.writestream
.format("delta")
.foreachBatch(WriteStreamToDelta)
...
Run Code Online (Sandbox Code Playgroud)
WriteStreamToDelta 看起来像
def WriteStreamToDelta(microDF, batch_id):
microDFWrangled = microDF."some_transformations"
print(microDFWrangled.count()) <-- How do I achieve the equivalence of this?
microDFWrangled.writeStream...
Run Code Online (Sandbox Code Playgroud)
我想查看其中的行数