小编Jef*_*erg的帖子

使用Powershell将文件上传到Box.com

我正在为我的公司制作一系列Powershell脚本,用于与Box.com之间传输数据.我无法弄清楚的一件事就是上传文件.Box API需要上传的多部分POST操作,我在SO上看到了一些答案,表明我应该能够在Powershell中做到这一点(比如这个).但我似乎无法让它发挥作用.

这是我现在的代码:

Function Post-File {
    Param(
            [Parameter(Mandatory=$True,Position=1)]
            [string]$SourcePath,
            [Parameter(Mandatory=$False,Position=2)]            
            [string]$FolderId = ############
    )

    #Variables for building URIs
    $baseUrl = "https://upload.box.com/api/2.0/files/content"

    #Set Authorization for API requests
    $headers = @{}
    $AccessToken = Refresh-Tokens #A reference to another function that definitely works
    $headers.Add("Authorization", "Bearer $AccessToken")

    #Set POST content
    $body = @{}
    $body.Add("filename",  [IO.File]::ReadAllBytes($SourcePath))
    $body.Add("parent_id", $FolderId)

    #Upload the file
    Invoke-RestMethod -Uri $baseUrl -Method Post -Headers $headers -ContentType "multipart/form-data" -Body $body
}
Run Code Online (Sandbox Code Playgroud)

这是我回复的回复:

{
 "type":"error",
 "status":400,
 "code":"invalid_request_parameters",
 "help_url":"http://developers.box.com/docs/#errors",
 "message":"Invalid input parameters in …
Run Code Online (Sandbox Code Playgroud)

rest powershell box-api

5
推荐指数
1
解决办法
8898
查看次数

尝试提交时,成功的任务会生成mapreduce.counters.LimitExceededException

我有一个在MapReduce模式下运行的Pig脚本,它一直收到一个我无法修复的持久性错误.该脚本生成多个MapReduce应用程序; 运行几个小时后,其中一个应用程序注册为SUCCEEDED但返回以下诊断消息:

成功提交后我们崩溃了.恢复.

导致失败的步骤是尝试在大约100GB的数据集上执行RANK,从前一个脚本中分割出大约1000个mapreduce输出文件.但是我也收到了试图进行大型HASH_JOIN操作的其他脚本的相同错误.

挖掘日志,我发现以下内容,这似乎也表明作业已成功但随后收到错误:

INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1523471594178_0475_m_001006_0 TaskAttempt Transitioned from COMMIT_PENDING to SUCCESS_CONTAINER_CLEANUP
INFO [ContainerLauncher #6] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Processing the event EventType: CONTAINER_REMOTE_CLEANUP for container container_e15_1523471594178_0475_01_001013 taskAttempt attempt_1523471594178_0475_m_001006_0
INFO [ContainerLauncher #6] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: KILLING attempt_1523471594178_0475_m_001006_0
INFO [ContainerLauncher #6] org.apache.hadoop.yarn.client.api.impl.ContainerManagementProtocolProxy: Opening proxy : my.server.name:45454
INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1523471594178_0475_m_001006_0 TaskAttempt Transitioned from SUCCESS_CONTAINER_CLEANUP to SUCCEEDED
INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: Task succeeded with attempt attempt_1523471594178_0475_m_001006_0
INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: task_1523471594178_0475_m_001006 Task Transitioned from RUNNING to SUCCEEDED
INFO …
Run Code Online (Sandbox Code Playgroud)

hadoop mapreduce apache-pig hadoop-yarn

5
推荐指数
1
解决办法
265
查看次数

如何从列名中获取所有值?

例:

SQL数据库

    Firstname   Age
    Paul        14
    Andrea      15
    John        18
    Mary        20
Run Code Online (Sandbox Code Playgroud)

我想从"Age"列中获取值,并将其全部添加.(我是SQL命令的新手),所以我的输出将是67.这甚至可能吗?

sql database sql-server

-2
推荐指数
1
解决办法
279
查看次数