聚合重复字段的唯一值

buk*_*zor 1 sql google-bigquery google-cloud-platform bigquery-standard-sql

我的表中有一个重复的字段。我想运行一个聚合查询并接收与我的查询匹配的唯一值数组。我已经尝试了这个查询的几种不同的变体:

with t as (select * from unnest([
    STRUCT("foo" as name, ["red", "blue"] as color)
  , STRUCT("foo", ["blue"])
  , STRUCT("foo", NULL)
  , STRUCT("foo", ["green"])
  , STRUCT("bar", ["orange", "black"])
  , STRUCT("bar", ["black", "white"])
]))
select
    (select color from unnest(array_concat_agg(color))) as color
from t
group by name
Run Code Online (Sandbox Code Playgroud)

想要的结果是:

name  | color
=====================================
foo   | ["red", "blue", "green"]
bar   | ["orange", "black", "white"]
Run Code Online (Sandbox Code Playgroud)

这个特定的查询给出了Aggregate function ARRAY_CONCAT_AGG not allowed in UNNEST at [10:31],但我在文档中没有找到这个错误,我找不到一个直观的原因为什么会出现这样的限制,也找不到我如何修复这个错误。

我正在做的事情是否本质上需要额外级别的嵌套查询?

Mik*_*ant 9

下面是 BigQuery 标准 SQL

#standardSQL
SELECT name, ARRAY_AGG(DISTINCT color) color
FROM `project.dataset.your_table`, UNNEST(color) color
GROUP BY name
Run Code Online (Sandbox Code Playgroud)

您可以使用问题中的虚拟数据进行测试,进行上述操作

#standardSQL
WITH `project.dataset.your_table` AS (
  SELECT * FROM UNNEST([
    STRUCT("foo" AS name, ["red", "blue"] AS color)
  , STRUCT("foo", ["blue"])
  , STRUCT("foo", NULL)
  , STRUCT("foo", ["green"])
  , STRUCT("bar", ["orange", "black"])
  , STRUCT("bar", ["black", "white"])
]))
SELECT name, ARRAY_AGG(DISTINCT color) color
FROM `project.dataset.your_table`, UNNEST(color) color
GROUP BY name
Run Code Online (Sandbox Code Playgroud)

结果为

Row name    color    
1   bar     orange   
            white    
            black    
2   foo     red  
            blue     
            green    
Run Code Online (Sandbox Code Playgroud)