我正在为我的公司制作一系列Powershell脚本,用于与Box.com之间传输数据.我无法弄清楚的一件事就是上传文件.Box API需要上传的多部分POST操作,我在SO上看到了一些答案,表明我应该能够在Powershell中做到这一点(比如这个).但我似乎无法让它发挥作用.
这是我现在的代码:
Function Post-File {
Param(
[Parameter(Mandatory=$True,Position=1)]
[string]$SourcePath,
[Parameter(Mandatory=$False,Position=2)]
[string]$FolderId = ############
)
#Variables for building URIs
$baseUrl = "https://upload.box.com/api/2.0/files/content"
#Set Authorization for API requests
$headers = @{}
$AccessToken = Refresh-Tokens #A reference to another function that definitely works
$headers.Add("Authorization", "Bearer $AccessToken")
#Set POST content
$body = @{}
$body.Add("filename", [IO.File]::ReadAllBytes($SourcePath))
$body.Add("parent_id", $FolderId)
#Upload the file
Invoke-RestMethod -Uri $baseUrl -Method Post -Headers $headers -ContentType "multipart/form-data" -Body $body
}
Run Code Online (Sandbox Code Playgroud)
这是我回复的回复:
{
"type":"error",
"status":400,
"code":"invalid_request_parameters",
"help_url":"http://developers.box.com/docs/#errors",
"message":"Invalid input parameters in …
Run Code Online (Sandbox Code Playgroud) 我有一个在MapReduce模式下运行的Pig脚本,它一直收到一个我无法修复的持久性错误.该脚本生成多个MapReduce应用程序; 运行几个小时后,其中一个应用程序注册为SUCCEEDED但返回以下诊断消息:
成功提交后我们崩溃了.恢复.
导致失败的步骤是尝试在大约100GB的数据集上执行RANK,从前一个脚本中分割出大约1000个mapreduce输出文件.但是我也收到了试图进行大型HASH_JOIN操作的其他脚本的相同错误.
挖掘日志,我发现以下内容,这似乎也表明作业已成功但随后收到错误:
INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1523471594178_0475_m_001006_0 TaskAttempt Transitioned from COMMIT_PENDING to SUCCESS_CONTAINER_CLEANUP
INFO [ContainerLauncher #6] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Processing the event EventType: CONTAINER_REMOTE_CLEANUP for container container_e15_1523471594178_0475_01_001013 taskAttempt attempt_1523471594178_0475_m_001006_0
INFO [ContainerLauncher #6] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: KILLING attempt_1523471594178_0475_m_001006_0
INFO [ContainerLauncher #6] org.apache.hadoop.yarn.client.api.impl.ContainerManagementProtocolProxy: Opening proxy : my.server.name:45454
INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1523471594178_0475_m_001006_0 TaskAttempt Transitioned from SUCCESS_CONTAINER_CLEANUP to SUCCEEDED
INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: Task succeeded with attempt attempt_1523471594178_0475_m_001006_0
INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: task_1523471594178_0475_m_001006 Task Transitioned from RUNNING to SUCCEEDED
INFO …
Run Code Online (Sandbox Code Playgroud) 例:
SQL数据库
Firstname Age
Paul 14
Andrea 15
John 18
Mary 20
Run Code Online (Sandbox Code Playgroud)
我想从"Age"列中获取值,并将其全部添加.(我是SQL命令的新手),所以我的输出将是67.这甚至可能吗?
apache-pig ×1
box-api ×1
database ×1
hadoop ×1
hadoop-yarn ×1
mapreduce ×1
powershell ×1
rest ×1
sql ×1
sql-server ×1