小编bri*_*isk的帖子

我已经配置了像"/ v1 /"这样的休息路径,并且在servlet中配置了端点,如'/ test /'.

现在我从java类"Test"中删除了"/ v1".

org.glassfish.jersey.internal.Errors logErrors
WARNING: The following warnings have been detected: WARNING: The (sub)resource method test in com.abc.services.Test contains empty path annotation.

进行此更改后,我收到了上述警告.如何处理此警告？

我希望这个"/ v1"删除10个其余路径的更改.所以任何人都帮助我在没有警告的情况下跑步

我正在使用配置单元(带外部表)来处理存储在amazon S3上的数据.

我的数据分区如下:

                       DIR   s3://test.com/2014-03-01/
                       DIR   s3://test.com/2014-03-02/
                       DIR   s3://test.com/2014-03-03/
                       DIR   s3://test.com/2014-03-04/
                       DIR   s3://test.com/2014-03-05/

s3://test.com/2014-03-05/ip-foo-request-2014-03-05_04-20_00-49.log
s3://test.com/2014-03-05/ip-foo-request-2014-03-05_06-26_19-56.log
s3://test.com/2014-03-05/ip-foo-request-2014-03-05_15-20_12-53.log
s3://test.com/2014-03-05/ip-foo-request-2014-03-05_22-54_27-19.log

如何使用配置单元创建分区表？

   CREATE EXTERNAL TABLE test (
    foo string,
    time string,
    bar string
    )  PARTITIONED BY (? string)
    ROW FORMAT DELIMITED
    FIELDS TERMINATED BY '\t'
    LOCATION 's3://test.com/';

有人可以回答这个问题吗？谢谢!

我已将蜂巢版本从0.20更新为0.13.1.

我正在使用下表和查询从S3中提取json.

表:

    > CREATE EXTERNAL TABLE in_app_logs (
    > event string,
    > app_id string,
    > idfa string,
    > idfv string
    > )ROW FORMAT DELIMITED
    > FIELDS TERMINATED BY '\t'
    > LOCATION 's3://test/in_app_logs/ds=2015-04-20/'; 

我的查询看起来像版本0.20的下面,它与旧版本一起工作正常.

    SELECT
       get_json_object(in_app_logs.event, '$.ev') as event_type,
       get_json_object(in_app_logs.event, '$.global.app_id') as app_id,
       get_json_object(in_app_logs.event, '$.global.ios.idfa') as idfa,
       get_json_object(in_app_logs.event, '$.global.ios.idfv') as idfv
    FROM in_app_logs;

在新版本中,它已更改为json_tuple.我在更新版本中尝试过此查询.得到了错误.

SELECT b.event_type, c.app_id, d.idfa, d.idfv
FROM in_app_logs a
LATERAL VIEW json_tuple(a.event, 'ev') b as event_type,
LATERAL VIEW json_tuple(a.event.global, 'app_id') c as app_id,
LATERAL …

我正在尝试使用配置单元进行子查询选择.

在foos表中有以下列:

foo1,
foo2,
foo3_input

是我想要的

select foo1, foo2, foo3 from foos;

是我将要执行的

select foo1, foo2, foo3_input from foos;

对于连续的每个foo3,我想执行以下查询

foo3 = select bar1 from bars where (foo3_input) between val1 and val2;

有没有可能的方法来构建此查询？

我能够连接elasticsearch。但是，我无法在 5601 上访问 kibana。有人可以帮忙解决这个问题吗？提前致谢。

在 kibana.yml 文件中，我修改了 server.host 参数以指向我的域。

• 弹性搜索版本：7.7.0
• Kibana 版本：kibana-7.7.0-1.x86_64
• 操作系统：Centos 7
• JAVA版本：11

kibana.yml

server.port: 5601
server.host: "my_domain"
elasticsearch.hosts: ["http://my_domain:9200"]

Kibana 日志

{"type":"log","@timestamp":"2020-06-02T14:08:03Z","tags":["warning","plugins-discovery"],"pid":2844,"message":"Expect plugin \"id\" in camelCase, but found: apm_oss"}
{"type":"log","@timestamp":"2020-06-02T14:08:03Z","tags":["warning","plugins-discovery"],"pid":2844,"message":"Expect plugin \"id\" in camelCase, but found: file_upload"}
{"type":"log","@timestamp":"2020-06-02T14:08:03Z","tags":["warning","plugins-discovery"],"pid":2844,"message":"Expect plugin \"id\" in camelCase, but found: triggers_actions_ui"}
{"type":"log","@timestamp":"2020-06-02T14:08:09Z","tags":["info","plugins-service"],"pid":2844,"message":"Plugin \"infra\" has been disabled since some of its direct or transitive dependencies are missing or disabled."}
{"type":"log","@timestamp":"2020-06-02T14:08:27Z","tags":["warning","plugins-discovery"],"pid":2941,"message":"Expect plugin \"id\" in camelCase, but found: apm_oss"}
{"type":"log","@timestamp":"2020-06-02T14:08:27Z","tags":["warning","plugins-discovery"],"pid":2941,"message":"Expect plugin \"id\" in camelCase, …

是否可以使用 Python 语言编写 Elasticsearch 插件。任何人都可以就此提供您的意见。

CREATE EXTERNAL TABLE old_events
(day STRING, foo STRING, count STRING, internal_id STRING)
PARTITIONED BY (ds string)
ROW FORMAT DELIMITED
FIELDS TERMINATED BY '\t'
LOCATION '${INPUT}';

CREATE EXTERNAL TABLE events
(internal_id, foo STRING, count STRING)
PARTITIONED BY (ds string)
ROW FORMAT DELIMITED
FIELDS TERMINATED BY '\t'
LOCATION '${OUTPUT}';

INSERT OVERWRITE TABLE events
SELECT e2.internal_id, e2.foo, count(e1.foo)
FROM old_events e2
LEFT OUTER JOIN old_events e1
ON e1.foo = e2.foo
WHERE e1.event = 'event1'
AND e2.event = 'event2'
AND ds = date_sub('${DAY}',1)
GROUP …

我收到以下错误:

  File "/home/ec2-user/test/test_stats.py", line 43, in get_test_ids_for_id
    cursor.execute("""select test_id from test_logs where id = %s """, (id))
  File "/home/ec2-user/.etl/lib/python2.7/site-packages/MySQLdb/cursors.py", line 187, in execute
    query = query % tuple([db.literal(item) for item in args])
TypeError: 'int' object is not iterable

这是我的代码部分,我遇到了麻烦:

def get_test_ids_for_id(prod_mysql_conn, id):
    cursor = prod_mysql_conn.cursor()
    cursor.execute("""select test_id from test_logs where id = %s """, (id))
    rows = cursor.fetchall()
    test_ids = []
    for row in rows:
      test_ids.append(row[0])
    return test_ids

我使用AWS-EMR来运行我的Hive查询,并且在运行hive版本0.13.1时出现性能问题.

较新版本的hive运行10行数据大约需要5分钟.但230804行的相同脚本需要2天才能运行.我该怎么做才能分析并解决问题？

样本数据:

表格1:

hive> describe foo;
OK
orderno    string
Time taken: 0.101 seconds, Fetched: 1 row(s)

table1的示例数据:

hive>select * from foo;        
OK
1826203307
1826207803
1826179498
1826179657

表2:

hive> describe de_geo_ip_logs;
OK
id          bigint                                      
startorderno        bigint                                      
endorderno          bigint                                      
itemcode                int                                         
Time taken: 0.047 seconds, Fetched: 4 row(s)

表2的样本数据:

hive> select * from bar;

127698025   417880320   417880575   306
127698025   3038626048  3038626303  584
127698025   3038626304  3038626431  269
127698025   3038626560  3038626815  163

我的查询:

SELECT b.itemcode
FROM foo a,  bar b
WHERE …

如何使用python截断域"com"旁边的以下URL.即你只是tube.com

    youtube.com/video/AiL6nL
    yahoo.com/video/Hhj9B2
    youtube.com/video/MpVHQ
    google.com/video/PGuTN
    youtube.com/video/VU34MI

有可能像这样截断吗？

我正在寻找一个简单的upsert（更新/插入）。

我在其中要为书本表插入行的表，但是下次我要插入行时，我不想再次为该表插入数据，只是想用必需的列更新（如果不存在则退出该列，然后创建新行） 。

如何在Mysql-python中执行此操作？

cursor.execute("""INSERT INTO books (book_code,book_name,created_at,updated_at) VALUES (%s,%s,%s,%s)""", (book_code,book_name,curr_time,curr_time,))

我试图看看是否foo包含"非活动"或用户是否尝试键入"非活动"一词的部分.

有没有更简单的方法来实现这一目标？

if (foo.equals("inactive") || foo.equals("inactiv")
                || foo.equals("inacti") || foo.equals("inact")
                || foo.equals("inac") || fofoo.equals("ina")
                || foo.equals("in") || foo.equals("nactive")
                || foo.equals("nactiv") || foo.equals("nacti")
                || foo.equals("nact") || foo.equals("nac")
                || foo.equals("na") || foo.equals("n")) {