this is my data
{"timestamp":"2021-08-01 15:31:56,895","msg":" INFO
org.apache.hadoop.hive.metastore.HiveMetaStore: [pool-9-thread-97]: 88:
get_table : db=hivetest tbl=chinese_part"}
{"timestamp":"2021-08-02 15:31:56,895","msg":" INFO
org.apache.hadoop.hive.metastore.HiveMetaStore: [pool-9-thread-97]: 88:
get_table : db=hivetest tbl=chinese_part"}
{"timestamp":"2021-08-03 15:31:56,895","msg":" INFO
org.apache.hadoop.hive.metastore.HiveMetaStore: [pool-9-thread-97]: 88:
get_table : db=hivetest tbl=chinese_part"}
{"timestamp":"2021-08-04 15:31:56,895","msg":" INFO
org.apache.hadoop.hive.metastore.HiveMetaStore: [pool-9-thread-97]: 88:
get_table : db=hivetest tbl=chinese_part"}
{"timestamp":"2021-08-05 15:31:56,895","msg":" INFO
org.apache.hadoop.hive.metastore.HiveMetaStore: [pool-9-thread-97]: 88:
get_table : db=hivetest tbl=chinese_part"}
{"timestamp":"2021-08-06 15:31:56,895","msg":" INFO
org.apache.hadoop.hive.metastore.HiveMetaStore: [pool-9-thread-97]: 88:
get_table : db=hivetest tbl=chinese_part"}
nc -lk 6666
env.socketTextStream("127.0.0.1", 6666)
.map(line => {.......})
.assignAscendingTimestamps(_.times) //事务时间
.keyBy(k => (k.db, k.tbl))
.window(SlidingEventTimeWindows.of(Time.days(3), Time.days(1)))
.reduce((x, y) => {TableCall(x.db, x.tbl, x.conuts + 1, y.times)})
.print()
when does app to print
when I input data of 2021-08-03 15:31:56,895, app doesn't print
I input
{"timestamp":"2021-08-04 15:31:56,895","msg":" INFO
org.apache.hadoop.hive.metastore.HiveMetaStore: [pool-9-thread-97]: 88:
get_table : db=hivetest tbl=chinese_part"}
{"timestamp":"2021-08-05 15:31:56,895","msg":" INFO
org.apache.hadoop.hive.metastore.HiveMetaStore: [pool-9-thread-97]: 88:
get_table : db=hivetest tbl=chinese_part"}
{"timestamp":"2021-08-06 15:31:56,895","msg":" INFO
org.apache.hadoop.hive.metastore.HiveMetaStore: [pool-9-thread-97]: 88:
get_table : db=hivetest tbl=chinese_part"}
app aslo doesn't print
I don't know when does app to print
swith to jdbc I have the same problem
igyu
