Hi,
I wanted to read all json files from hdfs with partition folder.
public static void main(String[] args) {
StreamExecutionEnvironment env =
StreamExecutionEnvironment.getExecutionEnvironment();
//path
//hdfs://localhost:8020/data/ingestion/ingestion.raw.product/2018/12/05/23
DataStream
Hi,
I have two data sources one is for order data and another one is for
invoice data, these two data i am pushing into kafka topic in json form. I
wanted to delay order data for 5 mins because invoice data comes only after
order data is generated. So, for that i have written a flink program which
p_trans\":\"20181130099000\"}"
);
return orderRecords;
}
private static List createInvoiceRecords() {
ListinvoiceRecords=new ArrayList<>();
invoiceRecords.add(
"{\"order_id\":312,\"invoice_status\":1,\"tstamp_trans\":\"20181130090300\"}"
);
invoiceRecords.add(
"{\"order_id\":318,\"invoice_status\":1,\"tstamp_trans\":\"20181130099000\"}"
);
invoiceRecords.add(
"{\"order_id\":317,\"invoice_status\":1,\"tstamp_trans\":\"20181130096300\"}"
);
invoiceRecords.add(
"{\"order_id\":311,\"invoice_status\":1,\"tstamp_trans\":\"20181130050300\"}"
);
return invoiceRecords;
}
If I'm excluding Kafka as data source and these collections as data source
then thing's working fine.
Thank you,
Rakesh Kumar
