天蓝色数据工厂-超时接收器端

bar*_*uri 2 timeout azure azure-data-factory

我尝试将大表转换为天蓝色的 SQL Server。\n虽然小表已完成,但大表尚未完成,并且落在超时接收器一侧。\n附加了错误。\n而 sql 服务器未完成\xe2\x80 \x99t 指定了任何超时,但它仍然无法工作。

\n

sql 数据库是 800 DTU。

\n

如果这是问题的话,我如何增加接收器端的超时。

\n

数据工厂不应该保存连接并在失败时重试吗?

\n
errors:\n{\n    "dataRead": 1372864152,\n    "dataWritten": 1372864152,\n    "sourcePeakConnections": 1,\n    "sinkPeakConnections": 2,\n    "rowsRead": 2205634,\n    "rowsCopied": 2205634,\n    "copyDuration": 8010,\n    "throughput": 167.377,\n    "errors": [\n        {\n            "Code": 11000,\n            "Message": "Failure happened on \'Sink\' side. \'Type=Microsoft.DataTransfer.Common.Shared.HybridDeliveryException,Message=Timeouts in SQL write operation.,Source=Microsoft.DataTransfer.ClientLibrary,\'\'Type=System.Data.SqlClient.SqlException,Message=Execution Timeout Expired.  The timeout period elapsed prior to completion of the operation or the server is not responding.,Source=.Net SqlClient Data Provider,SqlErrorNumber=-2,Class=11,ErrorCode=-2146232060,State=0,Errors=[{Class=11,Number=-2,State=0,Message=Execution Timeout Expired.  The timeout period elapsed prior to completion of the operation or the server is not responding.,},],\'\'Type=System.ComponentModel.Win32Exception,Message=The wait operation timed out,Source=,\'",\n            "EventType": 0,\n            "Category": 5,\n            "Data": {\n                "FailureInitiator": "Sink"\n            },\n            "MsgId": null,\n            "ExceptionType": null,\n            "Source": null,\n            "StackTrace": null,\n            "InnerEventInfos": []\n        }\n    ],\n    "effectiveIntegrationRuntime": "XXX",\n    "billingReference": {\n        "activityType": "DataMovement",\n        "billableDuration": [\n            {\n                "meterType": "SelfhostedIR",\n                "duration": 2.0166666666666666,\n                "unit": "Hours"\n            }\n        ]\n    },\n    "usedParallelCopies": 1,\n    "executionDetails": [\n        {\n            "source": {\n                "type": "SqlServer"\n            },\n            "sink": {\n                "type": "SqlServer"\n            },\n            "status": "Failed",\n            "start": "2020-08-03T17:16:58.8388528Z",\n            "duration": 8010,\n            "usedParallelCopies": 1,\n            "profile": {\n                "queue": {\n                    "status": "Completed",\n                    "duration": 810\n                },\n                "preCopyScript": {\n                    "status": "Completed",\n                    "duration": 0\n                },\n                "transfer": {\n                    "status": "Completed",\n                    "duration": 7200,\n                    "details": {\n                        "readingFromSource": {\n                            "type": "SqlServer",\n                            "workingDuration": 7156,\n                            "timeToFirstByte": 0\n                        },\n                        "writingToSink": {\n                            "type": "SqlServer"\n                        }\n                    }\n                }\n            },\n            "detailedDurations": {\n                "queuingDuration": 810,\n                "preCopyScriptDuration": 0,\n                "timeToFirstByte": 0,\n                "transferDuration": 7200\n            }\n        }\n    ],\n    "dataConsistencyVerification": {\n        "VerificationResult": "NotVerified"\n    },\n    "durationInQueue": {\n        "integrationRuntimeQueue": 810\n    }\n}\n
Run Code Online (Sandbox Code Playgroud)\n

Leo*_*Yue 5

请尝试在接收器端设置写入批量超时:

\n
    \n
  1. 批量插入操作在超时之前\n完成的等待时间。允许的值为timespan。例如 \xe2\x80\x9c00:30:00\xe2\x80\x9d\n(30 分钟)。
  2. \n
\n

在此输入图像描述

\n

参考:Azure SQL 数据库作为接收器

\n