Thanks Till, your solution worked perfectly.

Arpith

On Wed, Feb 17, 2021 at 12:53 AM Arvid Heise <[email protected]> wrote:

> Hi Arpith,
>
> The operator test harness is more meant for use cases where you implement
> your own operator (quite advanced).
>
> If you just want to test your AsyncFunction, I'd strongly recommend
> building a small ITCase like [1] and then you don't have to fiddle with
> these things anymore. The tests run very fast and test much more than the
> operator harness, which just simulates the execution somewhat.
>
> [1]
> https://github.com/apache/flink/blob/c202f5134a17dd652eb072d00d5fca894936cdaf/flink-tests/src/test/java/org/apache/flink/api/connector/source/lib/NumberSequenceSourceITCase.java#L41-L41
>
> On Tue, Feb 16, 2021 at 1:47 PM Till Rohrmann <[email protected]>
> wrote:
>
>> Hi Arpith,
>>
>> looking at the definition of the GetMetadataAsyncProcess function you
>> need to specify the TypeSerializer for a Tuple1<Map<String, List<String>>>.
>> What you could try in order to not create the serializer manually is to use:
>>
>> TypeInformation.of(new TypeHint<Tuple1<Map<String,
>> List<String>>>>(){}).createSerializer(new ExecutionConfig())
>>
>> This should hopefully create the correct serializer.
>>
>> Cheers,
>> Till
>>
>>
>>
>> On Tue, Feb 16, 2021 at 11:33 AM Arpith techy <[email protected]>
>> wrote:
>>
>>> Hi,
>>>
>>> I tried mocking the Async operator which takes Tuple1, Tuple3 as Input &
>>> Output but while creating a test harness I couldn't find the right
>>> TupleSerializer. Can anyone help me on this?
>>>
>>>
>>> public class GetMetadataAsyncProcess extends 
>>> RichAsyncFunction<Tuple1<Map<String, List<String>>>, Tuple3<Map<String, 
>>> List<String>>, Map<String, String>, List<Map<String, Integer>>>> {
>>>
>>> ...
>>>
>>> }
>>>
>>>
>>> private OneInputStreamOperatorTestHarness 
>>> createTestHarness(GetMetadataAsyncProcess asyncFunction, long timeout, int 
>>> capacity, AsyncDataStream.OutputMode mode) throws Exception {
>>>    OneInputStreamOperatorTestHarness 
>>> tuple1OUTOneInputStreamOperatorTestHarness = new 
>>> OneInputStreamOperatorTestHarness<>
>>>       (new AsyncWaitOperator<>(asyncFunction, timeout, capacity, mode), 
>>> <TYPESERIALISER_TO_FILL?>);
>>>    return tuple1OUTOneInputStreamOperatorTestHarness;
>>> }
>>>
>>>
>>> Creating a harness without passing TypeSerializer results in the
>>> following error.
>>>
>>> java.lang.NullPointerException
>>>     at java.util.Objects.requireNonNull(Objects.java:203)
>>>     at 
>>> org.apache.flink.streaming.runtime.streamrecord.StreamElementSerializer.<init>(StreamElementSerializer.java:64)
>>>     at 
>>> org.apache.flink.streaming.api.operators.async.AsyncWaitOperator.setup(AsyncWaitOperator.java:138)
>>>     at 
>>> org.apache.flink.streaming.util.AbstractStreamOperatorTestHarness.setup(AbstractStreamOperatorTestHarness.java:284)
>>>     at 
>>> org.apache.flink.streaming.util.AbstractStreamOperatorTestHarness.setup(AbstractStreamOperatorTestHarness.java:273)
>>>     at 
>>> org.apache.flink.streaming.util.AbstractStreamOperatorTestHarness.initializeState(AbstractStreamOperatorTestHarness.java:389)
>>>     at 
>>> org.apache.flink.streaming.util.AbstractStreamOperatorTestHarness.initializeState(AbstractStreamOperatorTestHarness.java:296)
>>>     at 
>>> org.apache.flink.streaming.util.AbstractStreamOperatorTestHarness.initializeEmptyState(AbstractStreamOperatorTestHarness.java:304)
>>>     at 
>>> org.apache.flink.streaming.util.AbstractStreamOperatorTestHarness.open(AbstractStreamOperatorTestHarness.java:479)
>>>     at 
>>> GetMetadataAsyncProcessTest.testRichAsyncFunction(GetMetadataAsyncProcessTest.java:40)
>>>     
>>>

Reply via email to