我目前正在使用SHA1来缩短网址:
Digest::SHA1.hexdigest("salt-" + url)
Run Code Online (Sandbox Code Playgroud)
仅使用SHA1的前8个字符作为唯一标识符是多么安全,就像GitHub明显提交的一样?
我想写一个Kiba Etl脚本,它有一个从CSV到目标CSV的源,带有一个转换规则列表,其中第二个转换器是一个聚合,其中的操作如选择名称,sum(euro)group by name
Kiba ETL脚本文件
source CsvSource, 'users.csv', col_sep: ';', headers: true, header_converters: :symbol
transform VerifyFieldsPresence, [:name, :euro]
transform AggregateFields, { sum: :euro, group_by: :name}
transform RenameField,from: :euro, to: :total_amount
destination CsvDestination, 'result.csv', [:name, :total_amount]
Run Code Online (Sandbox Code Playgroud)
users.csv
date;euro;name
7/3/2015;10;Jack
7/3/2015;85;Jill
8/3/2015;6;Jack
8/3/2015;12;Jill
9/3/2015;99;Mack
Run Code Online (Sandbox Code Playgroud)
result.csv(预期结果)
total_amount;name
16;Jack
97;Jill
99;Mack
Run Code Online (Sandbox Code Playgroud)
由于etl变换器一次在一行上一个接一个地执行,但我的第二个变换器行为依赖于我无法在传递给transform方法的类中访问它的整个行集合.
transform AggregateFields, { sum: :euro, group_by: :name }
Run Code Online (Sandbox Code Playgroud)
有没有可能使用kiba gem实现这种行为,
谢谢你提前
我是Elasticsearch的新手,并尝试用它来分析Suricata IPS的数据.头插件告诉我这个:yellow (131 of 262) unassigned shards
也得到这个:
$ curl -XGET http://127.0.0.1:9200/_cluster/health?pretty
{
"cluster_name" : "elasticsearch_brew",
"status" : "yellow",
"timed_out" : false,
"number_of_nodes" : 1,
"number_of_data_nodes" : 1,
"active_primary_shards" : 131,
"active_shards" : 131,
"relocating_shards" : 0,
"initializing_shards" : 0,
"unassigned_shards" : 131,
"number_of_pending_tasks" : 0,
"number_of_in_flight_fetch" : 0
}
Run Code Online (Sandbox Code Playgroud)
如何摆脱那些未分配的碎片?还有Kibana不时地告诉我这个:
Error: Bad Gateway
at respond (https://www.server.kibana/index.js?_b=:85279:15)
at checkRespForFailure (https://www.server.kibana/index.js?_b=:85247:7)
at https://www.server.kibana/index.js?_b=:83885:7
at wrappedErrback (https://www.server.kibana/index.js?_b=:20902:78)
at wrappedErrback (https://www.server.kibana/index.js?_b=:20902:78)
at wrappedErrback (https://www.server.kibana/index.js?_b=:20902:78)
at https://www.server.kibana/index.js?_b=:21035:76
at Scope.$eval (https://www.server.kibana/index.js?_b=:22022:28)
at Scope.$digest (https://www.server.kibana/index.js?_b=:21834:31) …Run Code Online (Sandbox Code Playgroud)