我想在同一行回应两个变量.
我想将2015-03-04.01.Abhi_Ram.txt存储在变量FILENAME中,将10存储在变量COUNT中并同时回显它们.
Sample.txt的
2015-03-04.01.Abhi_Ram.txt 10
2015-03-04.02.Abhi_Ram.txt 70
以下是我提出的代码:
for line in `hadoop fs -cat sample.txt`
do
VAR="${line}"
FILENAME=`echo ${VAR}|awk '{print $1}'`
COUNT=`echo ${VAR}|awk '{print $2}'`
COUNT_DT=`date "+%Y-%m-%d %H:%M:%S"`
echo db"|"Abhi_Ram"|"record_count"|"${FILENAME}"||"${COUNT}"||"${COUNT_DT} >> output.txt
done
I want the output as:
Run Code Online (Sandbox Code Playgroud)
db | Abhi_Ram | record_count | 2015-03-04.01.Abhi_Ram.txt || 10 || timestamp db | Abhi_Ram | record_count | 2015-03-04.02.Abhi_Ram.txt || 70 || timestamp
I'm getting the output as:
Run Code Online (Sandbox Code Playgroud)
db | Abhi_Ram | record_count | 2015-03-04.01.Abhi_Ram.txt |||| timestamp
db | Abhi_Ram | record_count | …
我需要编写自定义UDF来从Hbase表进行数据查找.
注意:我已经用HIVE进行了单元测试.它似乎工作.
但是当我使用相同的UDF Beeline时,它失败了.默认情况下,Cloudera限制模拟并仅允许hive用户在Beeline中运行查询.在作业启动时,YarnChild正在设置以下委托令牌.
我想添加令牌(Kind:HBASE_AUTH_TOKEN)来处理Hbase.
Kind: mapreduce.job
Kind: HDFS_DELEGATION_TOKEN
Kind: kms-dt
Run Code Online (Sandbox Code Playgroud)
我研究并发现了HbaseStorageHandler如何使用委托令牌(即HBASE_AUTH_TOKEN)用于Hbase.所以我使用了相同的功能集,但它也没有用.
来自HbasestorageHandler的函数(获取令牌到Job):
private void addHBaseDelegationToken(Configuration conf, JobConf jconf) throws IOException {
if (User.isHBaseSecurityEnabled(conf)) {
try {
logger.info("isHbaseSecurityEnabled :True ");
User e = User.getCurrent();
logger.info("isHbaseSecurityEnabled :User ==> " + e.toString());
Token authToken = getAuthToken(conf, e);
logger.info("isHbaseSecurityEnabled :AuthToken==> "+authToken.toString());
Job job = new Job(conf);
if(authToken == null) {
UserGroupInformation ugi = UserGroupInformation.getLoginUser();
ugi.setAuthenticationMethod(UserGroupInformation.AuthenticationMethod.KERBEROS);
e.obtainAuthTokenForJob(jconf);
} else {
logger.info("authToken is not null"+authToken.toString());
job.getCredentials().addToken(authToken.getService(), authToken);
}
logger.info("obtained Token /....");
} catch …Run Code Online (Sandbox Code Playgroud) 我是HTML5应用程序开发的新手.我习惯于Windows Phone App Development.Is WindowsPhone支持Sencha Touch Framework.我在Visual Studio 2010中看到了用于开发HTML5应用程序的Phonegap插件.但是我无法在Visual中找到任何用于Sencha的插件Studio.And我很困惑哪个框架可供选择进行开发.欢迎您提出建议.谢谢