Nic*_*ick 4 hive presto hiveql
我有一个以下格式的表:
IDX IDY Time Text
idx1 idy1 t1 text1
idx1 idy2 t2 text2
idx1 idy2 t3 text3
idx1 idy1 t4 text4
idx2 idy3 t5 text5
idx2 idy3 t6 text6
idx2 idy1 t7 text7
idx2 idy3 t8 text8
Run Code Online (Sandbox Code Playgroud)
我想看到的是这样的:
idx1 text1
idx1 text2, text3
idx1 text4
idx2 text5, text6
idx2 text7
idx2 text8
Run Code Online (Sandbox Code Playgroud)
所以在最后阶段,我可以:
text1
text2, text3
text4
==SEPERATOR==
text5, text6
text7
text8
Run Code Online (Sandbox Code Playgroud)
如何在 Hive 或 Presto 中执行此操作?谢谢。
蜂巢
这是基本查询,如果您愿意,可以从这里获取
select IDX
,IDY
,min(time) as from_time
,max(time) as to_time
,concat_ws(',',collect_list (Text)) as text
from (select *
,row_number () over
(
partition by IDX
order by Time
) as rn
,row_number () over
(
partition by IDX,IDY
order by Time
) as rn_IDY
from mytable
) t
group by IDX,IDY
,rn - rn_IDY
order by IDX,from_time
Run Code Online (Sandbox Code Playgroud)
+------+------+-----------+---------+-------------+
| idx | idy | from_time | to_time | text |
+------+------+-----------+---------+-------------+
| idx1 | idy1 | t1 | t1 | text1 |
| idx1 | idy2 | t2 | t3 | text2,text3 |
| idx1 | idy1 | t4 | t4 | text4 |
| idx2 | idy3 | t5 | t6 | text5,text6 |
| idx2 | idy1 | t7 | t7 | text7 |
| idx2 | idy3 | t8 | t8 | text8 |
+------+------+-----------+---------+-------------+
Run Code Online (Sandbox Code Playgroud)
急板
select array_join(array_agg (Text),',') as text
from (select *
,row_number () over
(
partition by IDX
order by Time
) as rn
,row_number () over
(
partition by IDX,IDY
order by Time
) as rn_IDY
from mytable
) t
group by IDX,IDY
,rn - rn_IDY
order by IDX,min(time)
;
Run Code Online (Sandbox Code Playgroud)
+-------------+
| text |
+-------------+
| text1 |
| text2,text3 |
| text4 |
| text5,text6 |
| text7 |
| text8 |
+-------------+
Run Code Online (Sandbox Code Playgroud)
| 归档时间: |
|
| 查看次数: |
9988 次 |
| 最近记录: |