Hi Ankit,

Thanks for providing the trace log. I will look into it and update if I
found anything.

Lidi Zheng

On Fri, Nov 9, 2018 at 3:04 PM <[email protected]> wrote:

> here is server log; i killed server at the end by cntrl+c
>
> I1109 15:02:26.154260194   13636 ev_epoll1_linux.cc:116]     grpc epoll
> fd: 3
> D1109 15:02:26.154434159   13636 ev_posix.cc:169]            Using polling
> engine: epoll1
> D1109 15:02:26.154530558   13636 dns_resolver.cc:338]        Using native
> dns resolver
> I1109 15:02:26.155007186   13636 init.cc:153]
> grpc_init(void)
> I1109 15:02:26.155213454   13636 completion_queue.cc:474]
> grpc_completion_queue_create_internal(completion_type=0, polling_type=0)
> I1109 15:02:26.155388910   13636 init.cc:153]
> grpc_init(void)
> I1109 15:02:26.155498555   13636 server.cc:994]
> grpc_server_create((nil), (nil))
> I1109 15:02:26.155608844   13636 server.cc:979]
> grpc_server_register_completion_queue(server=0x10423b0, cq=0x10e4590,
> reserved=(nil))
> I1109 15:02:26.156318834   13636 server_chttp2.cc:34]
> grpc_server_add_insecure_http2_port(server=0x10423b0, addr=[::]:50051)
> I1109 15:02:26.156495695   13636 socket_utils_common_posix.cc:310]
> TCP_USER_TIMEOUT not supported for this platform
> I1109 15:02:26.156648253   13636 init.cc:153]
> grpc_init(void)
> I1109 15:02:26.156761086   13636 completion_queue.cc:474]
> grpc_completion_queue_create_internal(completion_type=0, polling_type=1)
> I1109 15:02:26.156907935   13636 server.cc:979]
> grpc_server_register_completion_queue(server=0x10423b0, cq=0x10b5210,
> reserved=(nil))
> I1109 15:02:26.157128476   13636 server.cc:1089]
>  grpc_server_start(server=0x10423b0)
> I1109 15:02:26.157323173   13636 completion_queue.cc:956]
> grpc_completion_queue_next(cq=0x10b5210, deadline=gpr_timespec { tv_sec:
> 1541804546, tv_nsec: 157310009, clock_type: 1 }, reserved=(nil))
> I1109 15:02:26.158580160   13636 init.cc:153]
> grpc_init(void)
> I1109 15:02:26.158879985   13636 init.cc:153]
> grpc_init(void)
> I1109 15:02:26.159027389   13636 call_details.cc:31]
>  grpc_call_details_init(cd=0x7fdfe3e076d0)
> I1109 15:02:26.159205197   13636 metadata_array.cc:29]
>  grpc_metadata_array_init(array=0x7fdfe3dd52f0)
> I1109 15:02:26.159393998   13636 server.cc:1417]
>  grpc_server_request_call(server=0x10423b0, call=0x7fdfe3dc85e0,
> details=0x7fdfe3e076d0, initial_metadata=0x7fdfe3dd52f0,
> cq_bound_to_call=0x10e4590, cq_for_notification=0x10e4590,
> tag=0x7fdfe3dd52c0)
> I1109 15:02:26.159928640   13641 completion_queue.cc:956]
> grpc_completion_queue_next(cq=0x10e4590, deadline=gpr_timespec { tv_sec:
> 1541804546, tv_nsec: 359917975, clock_type: 1 }, reserved=(nil))
> I1109 15:02:26.360656578   13641 completion_queue.cc:956]
> grpc_completion_queue_next(cq=0x10e4590, deadline=gpr_timespec { tv_sec:
> 1541804546, tv_nsec: 560638312, clock_type: 1 }, reserved=(nil))
> I1109 15:02:26.561583802   13641 completion_queue.cc:956]
> grpc_completion_queue_next(cq=0x10e4590, deadline=gpr_timespec { tv_sec:
> 1541804546, tv_nsec: 761562116, clock_type: 1 }, reserved=(nil))
> I1109 15:02:26.763345769   13641 completion_queue.cc:956]
> grpc_completion_queue_next(cq=0x10e4590, deadline=gpr_timespec { tv_sec:
> 1541804546, tv_nsec: 963336198, clock_type: 1 }, reserved=(nil))
> I1109 15:02:26.965018149   13641 completion_queue.cc:956]
> grpc_completion_queue_next(cq=0x10e4590, deadline=gpr_timespec { tv_sec:
> 1541804547, tv_nsec: 165008451, clock_type: 1 }, reserved=(nil))
> I1109 15:02:27.165804716   13641 completion_queue.cc:956]
> grpc_completion_queue_next(cq=0x10e4590, deadline=gpr_timespec { tv_sec:
> 1541804547, tv_nsec: 365797710, clock_type: 1 }, reserved=(nil))
> I1109 15:02:27.367464272   13641 completion_queue.cc:956]
> grpc_completion_queue_next(cq=0x10e4590, deadline=gpr_timespec { tv_sec:
> 1541804547, tv_nsec: 567454529, clock_type: 1 }, reserved=(nil))
> I1109 15:02:27.569251508   13641 completion_queue.cc:956]
> grpc_completion_queue_next(cq=0x10e4590, deadline=gpr_timespec { tv_sec:
> 1541804547, tv_nsec: 769241829, clock_type: 1 }, reserved=(nil))
> I1109 15:02:27.771057300   13641 completion_queue.cc:956]
> grpc_completion_queue_next(cq=0x10e4590, deadline=gpr_timespec { tv_sec:
> 1541804547, tv_nsec: 971047705, clock_type: 1 }, reserved=(nil))
> I1109 15:02:27.971863679   13641 completion_queue.cc:956]
> grpc_completion_queue_next(cq=0x10e4590, deadline=gpr_timespec { tv_sec:
> 1541804548, tv_nsec: 171853865, clock_type: 1 }, reserved=(nil))
> I1109 15:02:28.172670779   13641 completion_queue.cc:956]
> grpc_completion_queue_next(cq=0x10e4590, deadline=gpr_timespec { tv_sec:
> 1541804548, tv_nsec: 372661066, clock_type: 1 }, reserved=(nil))
> I1109 15:02:28.374448318   13641 completion_queue.cc:956]
> grpc_completion_queue_next(cq=0x10e4590, deadline=gpr_timespec { tv_sec:
> 1541804548, tv_nsec: 574438418, clock_type: 1 }, reserved=(nil))
> I1109 15:02:28.576239230   13641 completion_queue.cc:956]
> grpc_completion_queue_next(cq=0x10e4590, deadline=gpr_timespec { tv_sec:
> 1541804548, tv_nsec: 776229414, clock_type: 1 }, reserved=(nil))
> I1109 15:02:28.777999303   13641 completion_queue.cc:956]
> grpc_completion_queue_next(cq=0x10e4590, deadline=gpr_timespec { tv_sec:
> 1541804548, tv_nsec: 977989615, clock_type: 1 }, reserved=(nil))
> I1109 15:02:28.978823786   13641 completion_queue.cc:956]
> grpc_completion_queue_next(cq=0x10e4590, deadline=gpr_timespec { tv_sec:
> 1541804549, tv_nsec: 178814027, clock_type: 1 }, reserved=(nil))
> I1109 15:02:29.179625639   13641 completion_queue.cc:956]
> grpc_completion_queue_next(cq=0x10e4590, deadline=gpr_timespec { tv_sec:
> 1541804549, tv_nsec: 379618664, clock_type: 1 }, reserved=(nil))
> I1109 15:02:29.381323942   13641 completion_queue.cc:956]
> grpc_completion_queue_next(cq=0x10e4590, deadline=gpr_timespec { tv_sec:
> 1541804549, tv_nsec: 581314314, clock_type: 1 }, reserved=(nil))
> I1109 15:02:29.583042183   13641 completion_queue.cc:956]
> grpc_completion_queue_next(cq=0x10e4590, deadline=gpr_timespec { tv_sec:
> 1541804549, tv_nsec: 783032618, clock_type: 1 }, reserved=(nil))
> I1109 15:02:29.783814207   13641 completion_queue.cc:956]
> grpc_completion_queue_next(cq=0x10e4590, deadline=gpr_timespec { tv_sec:
> 1541804549, tv_nsec: 983804709, clock_type: 1 }, reserved=(nil))
> I1109 15:02:29.984460463   13641 completion_queue.cc:956]
> grpc_completion_queue_next(cq=0x10e4590, deadline=gpr_timespec { tv_sec:
> 1541804550, tv_nsec: 184453477, clock_type: 1 }, reserved=(nil))
> I1109 15:02:30.186100300   13641 completion_queue.cc:956]
> grpc_completion_queue_next(cq=0x10e4590, deadline=gpr_timespec { tv_sec:
> 1541804550, tv_nsec: 386090576, clock_type: 1 }, reserved=(nil))
> I1109 15:02:30.386811208   13641 completion_queue.cc:956]
> grpc_completion_queue_next(cq=0x10e4590, deadline=gpr_timespec { tv_sec:
> 1541804550, tv_nsec: 586801471, clock_type: 1 }, reserved=(nil))
> I1109 15:02:30.587600940   13641 completion_queue.cc:956]
> grpc_completion_queue_next(cq=0x10e4590, deadline=gpr_timespec { tv_sec:
> 1541804550, tv_nsec: 787591288, clock_type: 1 }, reserved=(nil))
> I1109 15:02:30.789383471   13641 completion_queue.cc:956]
> grpc_completion_queue_next(cq=0x10e4590, deadline=gpr_timespec { tv_sec:
> 1541804550, tv_nsec: 989373774, clock_type: 1 }, reserved=(nil))
> I1109 15:02:30.991083179   13641 completion_queue.cc:956]
> grpc_completion_queue_next(cq=0x10e4590, deadline=gpr_timespec { tv_sec:
> 1541804551, tv_nsec: 191073378, clock_type: 1 }, reserved=(nil))
> I1109 15:02:31.191883048   13641 completion_queue.cc:956]
> grpc_completion_queue_next(cq=0x10e4590, deadline=gpr_timespec { tv_sec:
> 1541804551, tv_nsec: 391873315, clock_type: 1 }, reserved=(nil))
> I1109 15:02:31.392702102   13641 completion_queue.cc:956]
> grpc_completion_queue_next(cq=0x10e4590, deadline=gpr_timespec { tv_sec:
> 1541804551, tv_nsec: 592690574, clock_type: 1 }, reserved=(nil))
> I1109 15:02:31.594502801   13641 completion_queue.cc:956]
> grpc_completion_queue_next(cq=0x10e4590, deadline=gpr_timespec { tv_sec:
> 1541804551, tv_nsec: 794492990, clock_type: 1 }, reserved=(nil))
> I1109 15:02:31.796204742   13641 completion_queue.cc:956]
> grpc_completion_queue_next(cq=0x10e4590, deadline=gpr_timespec { tv_sec:
> 1541804551, tv_nsec: 996195133, clock_type: 1 }, reserved=(nil))
> I1109 15:02:31.997994614   13641 completion_queue.cc:956]
> grpc_completion_queue_next(cq=0x10e4590, deadline=gpr_timespec { tv_sec:
> 1541804552, tv_nsec: 197985041, clock_type: 1 }, reserved=(nil))
> I1109 15:02:32.198715744   13641 completion_queue.cc:956]
> grpc_completion_queue_next(cq=0x10e4590, deadline=gpr_timespec { tv_sec:
> 1541804552, tv_nsec: 398708689, clock_type: 1 }, reserved=(nil))
> I1109 15:02:32.400364488   13641 completion_queue.cc:956]
> grpc_completion_queue_next(cq=0x10e4590, deadline=gpr_timespec { tv_sec:
> 1541804552, tv_nsec: 600354769, clock_type: 1 }, reserved=(nil))
> I1109 15:02:32.602133164   13641 completion_queue.cc:956]
> grpc_completion_queue_next(cq=0x10e4590, deadline=gpr_timespec { tv_sec:
> 1541804552, tv_nsec: 802123429, clock_type: 1 }, reserved=(nil))
> I1109 15:02:32.802914210   13641 completion_queue.cc:956]
> grpc_completion_queue_next(cq=0x10e4590, deadline=gpr_timespec { tv_sec:
> 1541804553, tv_nsec: 2904515, clock_type: 1 }, reserved=(nil))
> I1109 15:02:33.003742371   13641 completion_queue.cc:956]
> grpc_completion_queue_next(cq=0x10e4590, deadline=gpr_timespec { tv_sec:
> 1541804553, tv_nsec: 203732851, clock_type: 1 }, reserved=(nil))
> I1109 15:02:33.022217664   13636 server.cc:1253]
>  grpc_server_shutdown_and_notify(server=0x10423b0, cq=0x10e4590,
> tag=0x7fdfe3e27b90)
> I1109 15:02:33.022602437   13636 completion_queue.cc:692]
> cq_end_op_for_next(cq=0x10e4590, tag=0x7fdfe3dd52c0,
> error={"created":"@1541804553.022579805","description":"Server
> Shutdown","file":"src/core/lib/surface/server.cc","file_line":1291},
> done=0x7fdfe5ba0100, done_arg=0x1168a10, storage=0x1168a48)
> I1109 15:02:33.022879659   13636 completion_queue.cc:692]
> cq_end_op_for_next(cq=0x10e4590, tag=0x7fdfe3e27b90, error="No Error",
> done=0x7fdfe5ba21a0, done_arg=0x10423b0, storage=0xf8e340)
> I1109 15:02:33.022918327   13641 completion_queue.cc:1056]
>  RETURN_EVENT[0x10e4590]: OP_COMPLETE: tag:0x7fdfe3dd52c0 ERROR
> I1109 15:02:33.023368555   13641 metadata_array.cc:34]
>  grpc_metadata_array_destroy(array=0x7fdfe3dd52f0)
> I1109 15:02:33.023879476   13641 init.cc:158]
> grpc_shutdown(void)
> I1109 15:02:33.024085587   13641 call_details.cc:38]
>  grpc_call_details_destroy(cd=0x7fdfe3e076d0)
> I1109 15:02:33.024102496   13646 server.cc:1312]
>  grpc_server_cancel_all_calls(server=0x10423b0)
> I1109 15:02:33.024347567   13641 init.cc:158]
> grpc_shutdown(void)
> I1109 15:02:33.024829900   13641 completion_queue.cc:956]
> grpc_completion_queue_next(cq=0x10e4590, deadline=gpr_timespec { tv_sec:
> 1541804553, tv_nsec: 224825311, clock_type: 1 }, reserved=(nil))
> I1109 15:02:33.024919689   13636 server.cc:1312]
>  grpc_server_cancel_all_calls(server=0x10423b0)
> I1109 15:02:33.025075494   13641 completion_queue.cc:1056]
>  RETURN_EVENT[0x10e4590]: OP_COMPLETE: tag:0x7fdfe3e27b90 OK
> I1109 15:02:33.025697917   13636 server.cc:1327]
>  grpc_server_destroy(server=0x10423b0)
> I1109 15:02:33.025983722   13636 init.cc:158]
> grpc_shutdown(void)
> I1109 15:02:33.026198861   13636 completion_queue.cc:1382]
>  grpc_completion_queue_shutdown(cq=0x10b5210)
> I1109 15:02:33.026450399   13636 completion_queue.cc:956]
> grpc_completion_queue_next(cq=0x10b5210, deadline=gpr_timespec { tv_sec:
> 9223372036854775807, tv_nsec: 0, clock_type: 1 }, reserved=(nil))
> I1109 15:02:33.026690807   13636 completion_queue.cc:1056]
>  RETURN_EVENT[0x10b5210]: QUEUE_SHUTDOWN
> I1109 15:02:33.026937828   13636 completion_queue.cc:1388]
>  grpc_completion_queue_destroy(cq=0x10b5210)
> I1109 15:02:33.027185446   13636 completion_queue.cc:1382]
>  grpc_completion_queue_shutdown(cq=0x10b5210)
> I1109 15:02:33.027445231   13636 init.cc:158]
> grpc_shutdown(void)
> I1109 15:02:33.027693717   13636 completion_queue.cc:1382]
>  grpc_completion_queue_shutdown(cq=0x10e4590)
> I1109 15:02:33.027948928   13636 completion_queue.cc:956]
> grpc_completion_queue_next(cq=0x10e4590, deadline=gpr_timespec { tv_sec:
> 9223372036854775807, tv_nsec: 0, clock_type: 1 }, reserved=(nil))
> I1109 15:02:33.028242936   13636 completion_queue.cc:1056]
>  RETURN_EVENT[0x10e4590]: QUEUE_SHUTDOWN
> I1109 15:02:33.028485199   13636 completion_queue.cc:1388]
>  grpc_completion_queue_destroy(cq=0x10e4590)
> I1109 15:02:33.028706949   13636 completion_queue.cc:1382]
>  grpc_completion_queue_shutdown(cq=0x10e4590)
> I1109 15:02:33.028956902   13636 init.cc:158]
> grpc_shutdown(void)
>
>
> On Friday, November 9, 2018 at 2:57:44 PM UTC-8, [email protected]
> wrote:
>>
>> Hi Lidi
>>
>> here is the log from client side
>>
>> I1109 14:55:12.420854517   13623 ev_epoll1_linux.cc:116]     grpc epoll
>> fd: 3
>> D1109 14:55:12.420880472   13623 ev_posix.cc:169]            Using
>> polling engine: epoll1
>> D1109 14:55:12.421021052   13623 dns_resolver.cc:338]        Using native
>> dns resolver
>> I1109 14:55:12.421063056   13623 init.cc:153]
>> grpc_init(void)
>> I1109 14:55:12.421084744   13623 channel_create.cc:93]
>>  grpc_insecure_channel_create(target=localhost:50051, args=0x7f7ea7310f20,
>> reserved=(nil))
>> I1109 14:55:12.421114130   13623 completion_queue.cc:474]
>> grpc_completion_queue_create_internal(completion_type=0, polling_type=0)
>> I1109 14:55:12.421117020   13623 completion_queue.cc:474]
>> grpc_completion_queue_create_internal(completion_type=0, polling_type=0)
>> I1109 14:55:12.421185398   13623 completion_queue.cc:474]
>> grpc_completion_queue_create_internal(completion_type=0, polling_type=0)
>> I1109 14:55:12.421216138   13623 metadata_array.cc:29]
>>  grpc_metadata_array_init(array=0x7f7ea7957bc8)
>> I1109 14:55:12.421219223   13623 metadata_array.cc:29]
>>  grpc_metadata_array_init(array=0x7f7ea72c30c0)
>> I1109 14:55:12.421222059   13623 call.cc:1883]
>>  grpc_call_start_batch(call=0xf55bb0, ops=0xeeab10, nops=6,
>> tag=0x7f7ea7310ef0, reserved=(nil))
>> I1109 14:55:12.421226029   13623 call.cc:1488]               ops[0]:
>> SEND_INITIAL_METADATA(nil)
>> I1109 14:55:12.421228617   13623 call.cc:1488]               ops[1]:
>> SEND_MESSAGE ptr=0xd88d20
>> I1109 14:55:12.421230879   13623 call.cc:1488]               ops[2]:
>> SEND_CLOSE_FROM_CLIENT
>> I1109 14:55:12.421233318   13623 call.cc:1488]               ops[3]:
>> RECV_INITIAL_METADATA ptr=0x7f7ea7957bc8
>> I1109 14:55:12.421235738   13623 call.cc:1488]               ops[4]:
>> RECV_MESSAGE ptr=0x7f7ea72a1820
>> I1109 14:55:12.421239091   13623 call.cc:1488]               ops[5]:
>> RECV_STATUS_ON_CLIENT metadata=0x7f7ea72c30c0 status=0x7f7ea72c30d8
>> details=0x7f7ea72c30e0
>> I1109 14:55:12.421251240   13623 call.cc:598]
>> OP[client-channel:0xf56540]:  SEND_INITIAL_METADATA{key=3a 70 61 74 68
>> ':path' value=2f 68 65 6c 6c 6f 77 6f 72 6c 64 2e 47 72 65 65 74 65 72 2f
>> 53 61 79 48 65 6c 6c 6f '/helloworld.Greeter/SayHello'}
>> SEND_MESSAGE:flags=0x00000000:len=5 SEND_TRAILING_METADATA{}
>> RECV_INITIAL_METADATA RECV_MESSAGE RECV_TRAILING_METADATA
>> D1109 14:55:12.421255825   13623 dns_resolver.cc:279]        Start
>> resolving.
>> I1109 14:55:12.421271461   13623 completion_queue.cc:956]
>> grpc_completion_queue_next(cq=0xd8e220, deadline=gpr_timespec { tv_sec:
>> 1541804112, tv_nsec: 621269667, clock_type: 1 }, reserved=(nil))
>> I1109 14:55:12.423570682   13625 connectivity_state.cc:92]   CONWATCH:
>> 0x7f7e98002ce8 pick_first: get IDLE
>> I1109 14:55:12.423604043   13625 connectivity_state.cc:116]  CONWATCH:
>> 0x7f7e98002ce8 pick_first: from IDLE [cur=IDLE] notify=0x7f7e98002388
>> I1109 14:55:12.423618199   13625 connectivity_state.cc:164]  SET:
>> 0xf27bc8 client_channel: IDLE --> IDLE [resolver_result] error=(nil) "No
>> Error"
>> I1109 14:55:12.423629677   13625 connectivity_state.cc:92]   CONWATCH:
>> 0x7f7e98003c18 subchannel: get IDLE
>> I1109 14:55:12.423638866   13625 connectivity_state.cc:116]  CONWATCH:
>> 0x7f7e98003c18 subchannel: from IDLE [cur=IDLE] notify=0x7f7e98003308
>> I1109 14:55:12.423649626   13625 connectivity_state.cc:164]  SET:
>> 0x7f7e98003c18 subchannel: IDLE --> CONNECTING [connecting] error=(nil) "No
>> Error"
>> I1109 14:55:12.423658089   13625 connectivity_state.cc:190]  NOTIFY:
>> 0x7f7e98003c18 subchannel: 0x7f7e98003308
>> I1109 14:55:12.423736694   13625 socket_utils_common_posix.cc:310]
>> TCP_USER_TIMEOUT not supported for this platform
>> I1109 14:55:12.423819670   13625 connectivity_state.cc:164]  SET:
>> 0x7f7e98002ce8 pick_first: IDLE --> CONNECTING [connecting_changed]
>> error=(nil) "No Error"
>> I1109 14:55:12.423830816   13625 connectivity_state.cc:190]  NOTIFY:
>> 0x7f7e98002ce8 pick_first: 0x7f7e98002388
>> I1109 14:55:12.423840274   13625 connectivity_state.cc:116]  CONWATCH:
>> 0x7f7e98003c18 subchannel: from CONNECTING [cur=CONNECTING]
>> notify=0x7f7e98003308
>> I1109 14:55:12.423851528   13625 connectivity_state.cc:164]  SET:
>> 0xf27bc8 client_channel: IDLE --> CONNECTING [lb_changed] error=(nil) "No
>> Error"
>> I1109 14:55:12.423895462   13625 connectivity_state.cc:116]  CONWATCH:
>> 0x7f7e98002ce8 pick_first: from CONNECTING [cur=CONNECTING]
>> notify=0x7f7e98002948
>> I1109 14:55:12.424229996   13623 http_connect_handshaker.cc:300]
>> Connecting to server localhost:50051 via HTTP proxy ipv4:10.19.8.225:912
>> I1109 14:55:12.425315940   13623 chttp2_transport.cc:850]    W:0xf5a630
>> CLIENT state IDLE -> WRITING [TRANSPORT_FLOW_CONTROL]
>> I1109 14:55:12.425345412   13623 chttp2_transport.cc:850]    W:0xf5a630
>> CLIENT state WRITING -> WRITING+MORE [INITIAL_WRITE]
>> I1109 14:55:12.425390982   13623 subchannel.cc:656]          New
>> connected subchannel at 0xeea6b0 for subchannel 0x7f7e98003b40
>> I1109 14:55:12.425407600   13623 chttp2_transport.cc:1864]
>>  perform_transport_op[t=0xf5a630]:
>> ON_CONNECTIVITY_STATE_CHANGE:p=0xecac40:from=READY BIND_POLLSET_SET
>> I1109 14:55:12.425419326   13623 connectivity_state.cc:164]  SET:
>> 0x7f7e98003c18 subchannel: CONNECTING --> READY [connected] error=(nil) "No
>> Error"
>> I1109 14:55:12.425428450   13623 connectivity_state.cc:190]  NOTIFY:
>> 0x7f7e98003c18 subchannel: 0x7f7e98003308
>> I1109 14:55:12.425443587   13623 connectivity_state.cc:116]  CONWATCH:
>> 0xf5a8d0 client_transport: from READY [cur=READY] notify=0xecac40
>> I1109 14:55:12.425457519   13623 writing.cc:110]             CLIENT: Ping
>> sent [0xee1ad0]: 2/2
>> I1109 14:55:12.425466796   13623 chttp2_transport.cc:850]    W:0xf5a630
>> CLIENT state WRITING+MORE -> WRITING [begin write in current thread]
>> I1109 14:55:12.425498045   13623 chttp2_transport.cc:2595]   ipv4:
>> 10.19.8.225:912: Start BDP ping err="No Error"
>> I1109 14:55:12.425509771   13623 chttp2_transport.cc:850]    W:0xf5a630
>> CLIENT state WRITING -> IDLE [finish writing]
>> I1109 14:55:12.425535718   13623 connectivity_state.cc:164]  SET:
>> 0x7f7e98002ce8 pick_first: CONNECTING --> READY [subchannel_ready]
>> error=(nil) "No Error"
>> I1109 14:55:12.425544979   13623 connectivity_state.cc:190]  NOTIFY:
>> 0x7f7e98002ce8 pick_first: 0x7f7e98002948
>> I1109 14:55:12.425554966   13623 connectivity_state.cc:116]  CONWATCH:
>> 0x7f7e98003c18 subchannel: from READY [cur=READY] notify=0xe90f28
>> I1109 14:55:12.425566109   13623 connectivity_state.cc:164]  SET:
>> 0xf27bc8 client_channel: CONNECTING --> READY [lb_changed] error=(nil) "No
>> Error"
>> I1109 14:55:12.425575387   13623 connectivity_state.cc:116]  CONWATCH:
>> 0x7f7e98002ce8 pick_first: from READY [cur=READY] notify=0xf0e738
>> I1109 14:55:12.425613783   13623 subchannel.cc:753]
>> OP[authority:0xf5e090]:  SEND_INITIAL_METADATA{key=3a 70 61 74 68 ':path'
>> value=2f 68 65 6c 6c 6f 77 6f 72 6c 64 2e 47 72 65 65 74 65 72 2f 53 61 79
>> 48 65 6c 6c 6f '/helloworld.Greeter/SayHello'}
>> SEND_MESSAGE:flags=0x00000000:len=5 SEND_TRAILING_METADATA{}
>> RECV_INITIAL_METADATA RECV_MESSAGE RECV_TRAILING_METADATA
>> I1109 14:55:12.425647150   13623 channel_stack.cc:225]
>>  OP[message_size:0xf5e0a8]:  SEND_INITIAL_METADATA{key=3a 61 75 74 68 6f 72
>> 69 74 79 ':authority' value=6c 6f 63 61 6c 68 6f 73 74 3a 35 30 30 35 31
>> 'localhost:50051', key=3a 70 61 74 68 ':path' value=2f 68 65 6c 6c 6f 77 6f
>> 72 6c 64 2e 47 72 65 65 74 65 72 2f 53 61 79 48 65 6c 6c 6f
>> '/helloworld.Greeter/SayHello'} SEND_MESSAGE:flags=0x00000000:len=5
>> SEND_TRAILING_METADATA{} RECV_INITIAL_METADATA RECV_MESSAGE
>> RECV_TRAILING_METADATA
>> I1109 14:55:12.425682336   13623 channel_stack.cc:225]
>>  OP[http-client:0xf5e0c0]:  SEND_INITIAL_METADATA{key=3a 61 75 74 68 6f 72
>> 69 74 79 ':authority' value=6c 6f 63 61 6c 68 6f 73 74 3a 35 30 30 35 31
>> 'localhost:50051', key=3a 70 61 74 68 ':path' value=2f 68 65 6c 6c 6f 77 6f
>> 72 6c 64 2e 47 72 65 65 74 65 72 2f 53 61 79 48 65 6c 6c 6f
>> '/helloworld.Greeter/SayHello'} SEND_MESSAGE:flags=0x00000000:len=5
>> SEND_TRAILING_METADATA{} RECV_INITIAL_METADATA RECV_MESSAGE
>> RECV_TRAILING_METADATA
>> I1109 14:55:12.425720210   13623 channel_stack.cc:225]
>>  OP[message_compress:0xf5e0d8]:  SEND_INITIAL_METADATA{key=3a 73 63 68 65
>> 6d 65 ':scheme' value=68 74 74 70 'http', key=3a 6d 65 74 68 6f 64
>> ':method' value=50 4f 53 54 'POST', key=3a 61 75 74 68 6f 72 69 74 79
>> ':authority' value=6c 6f 63 61 6c 68 6f 73 74 3a 35 30 30 35 31
>> 'localhost:50051', key=3a 70 61 74 68 ':path' value=2f 68 65 6c 6c 6f 77 6f
>> 72 6c 64 2e 47 72 65 65 74 65 72 2f 53 61 79 48 65 6c 6c 6f
>> '/helloworld.Greeter/SayHello', key=74 65 'te' value=74 72 61 69 6c 65 72
>> 73 'trailers', key=63 6f 6e 74 65 6e 74 2d 74 79 70 65 'content-type'
>> value=61 70 70 6c 69 63 61 74 69 6f 6e 2f 67 72 70 63 'application/grpc',
>> key=75 73 65 72 2d 61 67 65 6e 74 'user-agent' value=67 72 70 63 2d 70 79
>> 74 68 6f 6e 2f 31 2e 31 36 2e 30 20 67 72 70 63 2d 63 2f 36 2e 30 2e 30 20
>> 28 6d 61 6e 79 6c 69 6e 75 78 3b 20 63 68 74 74 70 32 3b 20 67 61 6f 29
>> 'grpc-python/1.16.0 grpc-c/6.0.0 (manylinux; chttp2; gao)'}
>> SEND_MESSAGE:flags=0x00000000:len=5 SEND_TRAILING_METADATA{}
>> RECV_INITIAL_METADATA RECV_MESSAGE RECV_TRAILING_METADATA
>> I1109 14:55:12.425778942   13623 channel_stack.cc:225]
>>  OP[connected:0xf5e0f0]:  SEND_INITIAL_METADATA{key=3a 73 63 68 65 6d 65
>> ':scheme' value=68 74 74 70 'http', key=3a 6d 65 74 68 6f 64 ':method'
>> value=50 4f 53 54 'POST', key=3a 61 75 74 68 6f 72 69 74 79 ':authority'
>> value=6c 6f 63 61 6c 68 6f 73 74 3a 35 30 30 35 31 'localhost:50051',
>> key=3a 70 61 74 68 ':path' value=2f 68 65 6c 6c 6f 77 6f 72 6c 64 2e 47 72
>> 65 65 74 65 72 2f 53 61 79 48 65 6c 6c 6f '/helloworld.Greeter/SayHello',
>> key=74 65 'te' value=74 72 61 69 6c 65 72 73 'trailers', key=63 6f 6e 74 65
>> 6e 74 2d 74 79 70 65 'content-type' value=61 70 70 6c 69 63 61 74 69 6f 6e
>> 2f 67 72 70 63 'application/grpc', key=75 73 65 72 2d 61 67 65 6e 74
>> 'user-agent' value=67 72 70 63 2d 70 79 74 68 6f 6e 2f 31 2e 31 36 2e 30 20
>> 67 72 70 63 2d 63 2f 36 2e 30 2e 30 20 28 6d 61 6e 79 6c 69 6e 75 78 3b 20
>> 63 68 74 74 70 32 3b 20 67 61 6f 29 'grpc-python/1.16.0 grpc-c/6.0.0
>> (manylinux; chttp2; gao)', key=67 72 70 63 2d 61 63 63 65 70 74 2d 65 6e 63
>> 6f 64 69 6e 67 'grpc-accept-encoding' value=69 64 65 6e 74 69 74 79 2c 64
>> 65 66 6c 61 74 65 2c 67 7a 69 70 'identity,deflate,gzip', key=61 63 63 65
>> 70 74 2d 65 6e 63 6f 64 69 6e 67 'accept-encoding' value=69 64 65 6e 74 69
>> 74 79 2c 67 7a 69 70 'identity,gzip'} SEND_MESSAGE:flags=0x00000000:len=5
>> SEND_TRAILING_METADATA{} RECV_INITIAL_METADATA RECV_MESSAGE
>> RECV_TRAILING_METADATA
>> I1109 14:55:12.425826521   13623 chttp2_transport.cc:1700]
>>  perform_stream_op[s=0xf5eac8]:  SEND_INITIAL_METADATA{key=3a 73 63 68 65
>> 6d 65 ':scheme' value=68 74 74 70 'http', key=3a 6d 65 74 68 6f 64
>> ':method' value=50 4f 53 54 'POST', key=3a 61 75 74 68 6f 72 69 74 79
>> ':authority' value=6c 6f 63 61 6c 68 6f 73 74 3a 35 30 30 35 31
>> 'localhost:50051', key=3a 70 61 74 68 ':path' value=2f 68 65 6c 6c 6f 77 6f
>> 72 6c 64 2e 47 72 65 65 74 65 72 2f 53 61 79 48 65 6c 6c 6f
>> '/helloworld.Greeter/SayHello', key=74 65 'te' value=74 72 61 69 6c 65 72
>> 73 'trailers', key=63 6f 6e 74 65 6e 74 2d 74 79 70 65 'content-type'
>> value=61 70 70 6c 69 63 61 74 69 6f 6e 2f 67 72 70 63 'application/grpc',
>> key=75 73 65 72 2d 61 67 65 6e 74 'user-agent' value=67 72 70 63 2d 70 79
>> 74 68 6f 6e 2f 31 2e 31 36 2e 30 20 67 72 70 63 2d 63 2f 36 2e 30 2e 30 20
>> 28 6d 61 6e 79 6c 69 6e 75 78 3b 20 63 68 74 74 70 32 3b 20 67 61 6f 29
>> 'grpc-python/1.16.0 grpc-c/6.0.0 (manylinux; chttp2; gao)', key=67 72 70 63
>> 2d 61 63 63 65 70 74 2d 65 6e 63 6f 64 69 6e 67 'grpc-accept-encoding'
>> value=69 64 65 6e 74 69 74 79 2c 64 65 66 6c 61 74 65 2c 67 7a 69 70
>> 'identity,deflate,gzip', key=61 63 63 65 70 74 2d 65 6e 63 6f 64 69 6e 67
>> 'accept-encoding' value=69 64 65 6e 74 69 74 79 2c 67 7a 69 70
>> 'identity,gzip'} SEND_MESSAGE:flags=0x00000000:len=5
>> SEND_TRAILING_METADATA{} RECV_INITIAL_METADATA RECV_MESSAGE
>> RECV_TRAILING_METADATA
>> I1109 14:55:12.425875363   13623 chttp2_transport.cc:1396]
>>  perform_stream_op_locked:  SEND_INITIAL_METADATA{key=3a 73 63 68 65 6d 65
>> ':scheme' value=68 74 74 70 'http', key=3a 6d 65 74 68 6f 64 ':method'
>> value=50 4f 53 54 'POST', key=3a 61 75 74 68 6f 72 69 74 79 ':authority'
>> value=6c 6f 63 61 6c 68 6f 73 74 3a 35 30 30 35 31 'localhost:50051',
>> key=3a 70 61 74 68 ':path' value=2f 68 65 6c 6c 6f 77 6f 72 6c 64 2e 47 72
>> 65 65 74 65 72 2f 53 61 79 48 65 6c 6c 6f '/helloworld.Greeter/SayHello',
>> key=74 65 'te' value=74 72 61 69 6c 65 72 73 'trailers', key=63 6f 6e 74 65
>> 6e 74 2d 74 79 70 65 'content-type' value=61 70 70 6c 69 63 61 74 69 6f 6e
>> 2f 67 72 70 63 'application/grpc', key=75 73 65 72 2d 61 67 65 6e 74
>> 'user-agent' value=67 72 70 63 2d 70 79 74 68 6f 6e 2f 31 2e 31 36 2e 30 20
>> 67 72 70 63 2d 63 2f 36 2e 30 2e 30 20 28 6d 61 6e 79 6c 69 6e 75 78 3b 20
>> 63 68 74 74 70 32 3b 20 67 61 6f 29 'grpc-python/1.16.0 grpc-c/6.0.0
>> (manylinux; chttp2; gao)', key=67 72 70 63 2d 61 63 63 65 70 74 2d 65 6e 63
>> 6f 64 69 6e 67 'grpc-accept-encoding' value=69 64 65 6e 74 69 74 79 2c 64
>> 65 66 6c 61 74 65 2c 67 7a 69 70 'identity,deflate,gzip', key=61 63 63 65
>> 70 74 2d 65 6e 63 6f 64 69 6e 67 'accept-encoding' value=69 64 65 6e 74 69
>> 74 79 2c 67 7a 69 70 'identity,gzip'} SEND_MESSAGE:flags=0x00000000:len=5
>> SEND_TRAILING_METADATA{} RECV_INITIAL_METADATA RECV_MESSAGE
>> RECV_TRAILING_METADATA; on_complete = 0xf5e888
>> I1109 14:55:12.425896318   13623 chttp2_transport.cc:1374]
>>  HTTP:0:HDR:CLI: :scheme: http
>> I1109 14:55:12.425902141   13623 chttp2_transport.cc:1374]
>>  HTTP:0:HDR:CLI: :method: POST
>> I1109 14:55:12.425907939   13623 chttp2_transport.cc:1374]
>>  HTTP:0:HDR:CLI: :authority: localhost:50051
>> I1109 14:55:12.425913740   13623 chttp2_transport.cc:1374]
>>  HTTP:0:HDR:CLI: :path: /helloworld.Greeter/SayHello
>> I1109 14:55:12.425919573   13623 chttp2_transport.cc:1374]
>>  HTTP:0:HDR:CLI: te: trailers
>> I1109 14:55:12.425925178   13623 chttp2_transport.cc:1374]
>>  HTTP:0:HDR:CLI: content-type: application/grpc
>> I1109 14:55:12.425931151   13623 chttp2_transport.cc:1374]
>>  HTTP:0:HDR:CLI: user-agent: grpc-python/1.16.0 grpc-c/6.0.0 (manylinux;
>> chttp2; gao)
>> I1109 14:55:12.425937362   13623 chttp2_transport.cc:1374]
>>  HTTP:0:HDR:CLI: grpc-accept-encoding: identity,deflate,gzip
>> I1109 14:55:12.425943256   13623 chttp2_transport.cc:1374]
>>  HTTP:0:HDR:CLI: accept-encoding: identity,gzip
>> I1109 14:55:12.425949493   13623 chttp2_transport.cc:1185]   HTTP:CLI:
>> Allocating new grpc_chttp2_stream 0xf5eac8 to id 1
>> I1109 14:55:12.425956500   13623 chttp2_transport.cc:850]    W:0xf5a630
>> CLIENT state IDLE -> WRITING [START_NEW_STREAM]
>> I1109 14:55:12.425963933   13623 chttp2_transport.cc:850]    W:0xf5a630
>> CLIENT state WRITING -> WRITING+MORE [SEND_MESSAGE]
>> I1109 14:55:12.425973447   13623 chttp2_transport.cc:1247]
>>  complete_closure_step: t=0xf5a630 0xf5e888 refs=3 flags=0x0001
>> desc=op->on_complete err="No Error" write_state=WRITING+MORE
>> I1109 14:55:12.425980632   13623 writing.cc:413]             W:0xf5a630
>> CLIENT[1] im-(sent,send)=(0,1) announce=5
>> I1109 14:55:12.425988729   13623 hpack_encoder.cc:477]       Encode:
>> ':authority: localhost:50051', elem_interned=1 [1], k_interned=1,
>> v_interned=1
>> I1109 14:55:12.425997061   13623 hpack_encoder.cc:477]       Encode:
>> ':path: /helloworld.Greeter/SayHello', elem_interned=0 [2], k_interned=1,
>> v_interned=0
>> I1109 14:55:12.426004138   13623 hpack_encoder.cc:477]       Encode: 'te:
>> trailers', elem_interned=1 [3], k_interned=1, v_interned=1
>> I1109 14:55:12.426011291   13623 hpack_encoder.cc:477]       Encode:
>> 'content-type: application/grpc', elem_interned=1 [3], k_interned=1,
>> v_interned=1
>> I1109 14:55:12.426019468   13623 hpack_encoder.cc:477]       Encode:
>> 'user-agent: grpc-python/1.16.0 grpc-c/6.0.0 (manylinux; chttp2; gao)',
>> elem_interned=1 [1], k_interned=1, v_interned=1
>> I1109 14:55:12.426027416   13623 hpack_encoder.cc:477]       Encode:
>> 'grpc-accept-encoding: identity,deflate,gzip', elem_interned=1 [3],
>> k_interned=1, v_interned=1
>> I1109 14:55:12.426033930   13623 hpack_encoder.cc:477]       Encode:
>> 'accept-encoding: identity,gzip', elem_interned=1 [3], k_interned=1,
>> v_interned=1
>> I1109 14:55:12.426043560   13623 chttp2_transport.cc:1247]
>>  complete_closure_step: t=0xf5a630 0xf5e888 refs=2 flags=0x0001
>> desc=send_initial_metadata_finished err="No Error" write_state=WRITING+MORE
>> I1109 14:55:12.426053497   13623 chttp2_transport.cc:1247]
>>  complete_closure_step: t=0xf5a630 0xf5e888 refs=1 flags=0x0001
>> desc=send_trailing_metadata_finished err="No Error" write_state=WRITING+MORE
>> I1109 14:55:12.426060803   13623 chttp2_transport.cc:1247]
>>  complete_closure_step: t=0xf5a630 0xf5e888 refs=0 flags=0x0001
>> desc=on_write_finished_cb err="No Error" write_state=WRITING+MORE
>> I1109 14:55:12.426072262   13623 chttp2_transport.cc:850]    W:0xf5a630
>> CLIENT state WRITING+MORE -> WRITING [begin write in current thread]
>> I1109 14:55:12.426095561   13623 chttp2_transport.cc:850]    W:0xf5a630
>> CLIENT state WRITING -> IDLE [finish writing]
>> I1109 14:55:12.426698337   13623 chttp2_transport.cc:850]    W:0xf5a630
>> CLIENT state IDLE -> WRITING [RST_STREAM]
>> D1109 14:55:12.426748033   13623 call.cc:700]
>> set_final_status CLI
>> D1109 14:55:12.426774713   13623 call.cc:701]
>> {"created":"@1541804112.426745675","description":"Error received from
>> peer","file":"src/core/lib/surface/call.cc","file_line":1017,"grpc_message":"Socket
>> closed","grpc_status":14}
>> I1109 14:55:12.426791551   13623 completion_queue.cc:692]
>> cq_end_op_for_next(cq=0xd8e220, tag=0x7f7ea7310ef0, error="No Error",
>> done=0x7f7ea90a8c20, done_arg=0xf56ac0, storage=0xf56ac8)
>> I1109 14:55:12.426837069   13623 chttp2_transport.cc:2608]   ipv4:
>> 10.19.8.225:912: Complete BDP ping
>> err={"created":"@1541804112.426689641","description":"Endpoint read
>> failed","file":"src/core/ext/transport/chttp2/transport/chttp2_transport.cc","file_line":2509,"occurred_during_write":0,"referenced_errors":[{"created":"@1541804112.426684410","description":"Socket
>> closed","fd":6,"file":"src/core/lib/iomgr/tcp_posix.cc","file_line":465,"grpc_status":14,"target_address":"ipv4:
>> 10.19.8.225:912"}]}
>> I1109 14:55:12.426853313   13623 chttp2_transport.cc:850]    W:0xf5a630
>> CLIENT state WRITING -> WRITING [begin write in current thread]
>> I1109 14:55:12.426889006   13623 chttp2_transport.cc:850]    W:0xf5a630
>> CLIENT state WRITING -> IDLE [finish writing]
>> I1109 14:55:12.426898997   13623 chttp2_transport.cc:2788]   set
>> connectivity_state=4
>> I1109 14:55:12.426933812   13623 connectivity_state.cc:164]  SET:
>> 0xf5a8d0 client_transport: READY --> SHUTDOWN [close_transport]
>> error=0xf23d90 {"created":"@1541804112.426738905","description":"Delayed
>> close due to in-progress
>> write","file":"src/core/ext/transport/chttp2/transport/chttp2_transport.cc","file_line":618,"referenced_errors":[{"created":"@1541804112.426689641","description":"Endpoint
>> read
>> failed","file":"src/core/ext/transport/chttp2/transport/chttp2_transport.cc","file_line":2509,"occurred_during_write":0,"referenced_errors":[{"created":"@1541804112.426684410","description":"Socket
>> closed","fd":6,"file":"src/core/lib/iomgr/tcp_posix.cc","file_line":465,"grpc_status":14,"target_address":"ipv4:
>> 10.19.8.225:912"}]}]}
>> I1109 14:55:12.426949521   13623 connectivity_state.cc:190]  NOTIFY:
>> 0xf5a8d0 client_transport: 0xecac40
>> I1109 14:55:12.426980066   13623 connectivity_state.cc:164]  SET:
>> 0x7f7e98003c18 subchannel: READY --> TRANSIENT_FAILURE [reflect_child]
>> error=0xf23d90 {"created":"@1541804112.426738905","description":"Delayed
>> close due to in-progress
>> write","file":"src/core/ext/transport/chttp2/transport/chttp2_transport.cc","file_line":618,"referenced_errors":[{"created":"@1541804112.426689641","description":"Endpoint
>> read
>> failed","file":"src/core/ext/transport/chttp2/transport/chttp2_transport.cc","file_line":2509,"occurred_during_write":0,"referenced_errors":[{"created":"@1541804112.426684410","description":"Socket
>> closed","fd":6,"file":"src/core/lib/iomgr/tcp_posix.cc","file_line":465,"grpc_status":14,"target_address":"ipv4:
>> 10.19.8.225:912"}]}]}
>> I1109 14:55:12.426996120   13623 connectivity_state.cc:190]  NOTIFY:
>> 0x7f7e98003c18 subchannel: 0xe90f28
>> I1109 14:55:12.427008600   13623 connectivity_state.cc:164]  SET:
>> 0x7f7e98002ce8 pick_first: READY --> IDLE [selected_changed+reresolve]
>> error=(nil) "No Error"
>> I1109 14:55:12.427017454   13623 connectivity_state.cc:190]  NOTIFY:
>> 0x7f7e98002ce8 pick_first: 0xf0e738
>> I1109 14:55:12.427028419   13623 connectivity_state.cc:164]  SET:
>> 0xf27bc8 client_channel: READY --> IDLE [lb_changed] error=(nil) "No Error"
>> I1109 14:55:12.427037989   13623 connectivity_state.cc:116]  CONWATCH:
>> 0x7f7e98002ce8 pick_first: from IDLE [cur=IDLE] notify=0xdbc978
>> D1109 14:55:12.427062543   13623 dns_resolver.cc:259]        In cooldown
>> from last resolution (from 6 ms ago). Will resolve again in 994 ms
>> I1109 14:55:12.427087329   13623 completion_queue.cc:1056]
>>  RETURN_EVENT[0xd8e220]: OP_COMPLETE: tag:0x7f7ea7310ef0 OK
>> I1109 14:55:12.427133354   13623 metadata_array.cc:34]
>>  grpc_metadata_array_destroy(array=0x7f7ea7957bc8)
>> I1109 14:55:12.427145778   13623 metadata_array.cc:34]
>>  grpc_metadata_array_destroy(array=0x7f7ea72c30c0)
>> I1109 14:55:12.427187143   13623 call.cc:546]
>> grpc_call_unref(c=0xf55bb0)
>> I1109 14:55:12.427237829   13623 completion_queue.cc:1382]
>>  grpc_completion_queue_shutdown(cq=0xd8e220)
>> I1109 14:55:12.427248475   13623 completion_queue.cc:1388]
>>  grpc_completion_queue_destroy(cq=0xd8e220)
>> I1109 14:55:12.427255960   13623 completion_queue.cc:1382]
>>  grpc_completion_queue_shutdown(cq=0xd8e220)
>> I1109 14:55:12.427450951   13623 completion_queue.cc:1382]
>>  grpc_completion_queue_shutdown(cq=0xcd1580)
>> I1109 14:55:12.427464337   13623 completion_queue.cc:1388]
>>  grpc_completion_queue_destroy(cq=0xcd1580)
>> I1109 14:55:12.427484418   13623 completion_queue.cc:1382]
>>  grpc_completion_queue_shutdown(cq=0xcd1580)
>> I1109 14:55:12.427490161   13623 completion_queue.cc:1382]
>>  grpc_completion_queue_shutdown(cq=0xdd1900)
>> I1109 14:55:12.427495477   13623 completion_queue.cc:1388]
>>  grpc_completion_queue_destroy(cq=0xdd1900)
>> I1109 14:55:12.427500346   13623 completion_queue.cc:1382]
>>  grpc_completion_queue_shutdown(cq=0xdd1900)
>> I1109 14:55:12.427506256   13623 channel.cc:455]
>>  grpc_channel_destroy(channel=0xf27a80)
>> I1109 14:55:12.427521291   13623 connectivity_state.cc:164]  SET:
>> 0xf27bc8 client_channel: IDLE --> SHUTDOWN [disconnect] error=0xecac40
>> {"created":"@1541804112.427510983","description":"Channel
>> Destroyed","file":"src/core/lib/surface/channel.cc","file_line":457}
>> I1109 14:55:12.427538912   13623 connectivity_state.cc:164]  SET:
>> 0x7f7e98002ce8 pick_first: IDLE --> SHUTDOWN [shutdown] error=0xede490
>> {"created":"@1541804112.427530960","description":"Channel
>> shutdown","file":"src/core/ext/filters/client_channel/lb_policy/pick_first/pick_first.cc","file_line":192}
>> I1109 14:55:12.427545722   13623 connectivity_state.cc:190]  NOTIFY:
>> 0x7f7e98002ce8 pick_first: 0xdbc978
>> I1109 14:55:12.427568046   13623 init.cc:158]
>> grpc_shutdown(void)
>> Traceback (most recent call last):
>>   File "greeter_client.py", line 35, in <module>
>>     run()
>>   File "greeter_client.py", line 30, in run
>>     response = stub.SayHello(helloworld_pb2.HelloRequest(name='you'))
>>   File "/usr/local/lib/python2.7/dist-packages/grpc/_channel.py", line
>> 533, in __call__
>>     return _end_unary_response_blocking(state, call, False, None)
>>   File "/usr/local/lib/python2.7/dist-packages/grpc/_channel.py", line
>> 467, in _end_unary_response_blocking
>>     raise _Rendezvous(state, None, None, deadline)
>> grpc._channel._Rendezvous: <_Rendezvous of RPC that terminated with:
>> status = StatusCode.UNAVAILABLE
>> details = "Socket closed"
>> debug_error_string =
>> "{"created":"@1541804112.426745675","description":"Error received from
>> peer","file":"src/core/lib/surface/call.cc","file_line":1017,"grpc_message":"Socket
>> closed","grpc_status":14}"
>> >
>>
>>
>> On Friday, November 9, 2018 at 1:44:18 PM UTC-8, [email protected] wrote:
>>>
>>> Hi Ankit,
>>>
>>> To define variables in separate line, you need to export them to the
>>> whole environment like this:
>>>
>>> $ export GRPC_VERBOSITY=DEBUG
>>> $
>>> export 
>>> GRPC_TRACE=api,channel,call_error,connectivity_state,http,server_channel
>>>
>>> Then you can run the examples:
>>>
>>> $ python greeter_client.py
>>> $ python greeter_server.py
>>>
>>> The debug logs will go out through standard error output, which will
>>> print on your terminal.
>>>
>>> Lidi Zheng
>>>
>>> On Friday, November 9, 2018 at 1:40:23 PM UTC-8, [email protected]
>>> wrote:
>>>>
>>>> Hi Lidi
>>>>
>>>> how do i get debug logs? what location they are saved at?
>>>> I have done following and  i dont see any extra information on stdout
>>>>
>>>> #server side terminal
>>>> root@fmx216:~/gRPC/grpc/examples/python/helloworld#
>>>> GRPC_VERBOSITY=DEBUG
>>>> root@fmx216:~/gRPC/grpc/examples/python/helloworld#
>>>> GRPC_TRACE=api,channel,call_error,connectivity_state,http,server_channel
>>>> root@fmx216:~/gRPC/grpc/examples/python/helloworld# python
>>>> greeter_server.py
>>>>
>>>> #client side terminal
>>>> root@fmx216:~/gRPC/grpc/examples/python/helloworld#
>>>> GRPC_VERBOSITY=DEBUG
>>>> root@fmx216:~/gRPC/grpc/examples/python/helloworld#
>>>> GRPC_TRACE=api,channel,call_error,connectivity_state,http,server_channel
>>>> root@fmx216:~/gRPC/grpc/examples/python/helloworld# python
>>>> greeter_client.py
>>>> Traceback (most recent call last):
>>>>   File "greeter_client.py", line 35, in <module>
>>>>     run()
>>>>   File "greeter_client.py", line 30, in run
>>>>     response = stub.SayHello(helloworld_pb2.HelloRequest(name='you'))
>>>>   File "/usr/local/lib/python2.7/dist-packages/grpc/_channel.py", line
>>>> 533, in __call__
>>>>     return _end_unary_response_blocking(state, call, False, None)
>>>>   File "/usr/local/lib/python2.7/dist-packages/grpc/_channel.py", line
>>>> 467, in _end_unary_response_blocking
>>>>     raise _Rendezvous(state, None, None, deadline)
>>>> grpc._channel._Rendezvous: <_Rendezvous of RPC that terminated with:
>>>>         status = StatusCode.UNAVAILABLE
>>>>         details = "Socket closed"
>>>>         debug_error_string =
>>>> "{"created":"@1541799229.437917379","description":"Error received from
>>>> peer","file":"src/core/lib/surface/call.cc","file_line":1017,"grpc_message":"Socket
>>>> closed","grpc_status":14}"
>>>> >
>>>> root@fmx216:~/gRPC/grpc/examples/python/helloworld#
>>>>
>>>> thanks
>>>> Ankit
>>>>
>>>> On Friday, November 9, 2018 at 11:52:45 AM UTC-8, [email protected]
>>>> wrote:
>>>>>
>>>>> Hi Ankit,
>>>>>
>>>>> There is one more thing I would like to try. Can you provide the
>>>>> detailed tracing log for the example server and client?
>>>>> The trace and debug logs can be turned on by setting environment
>>>>> variables.
>>>>>
>>>>> $ GRPC_VERBOSITY=DEBUG 
>>>>> GRPC_TRACE=api,channel,call_error,connectivity_state,http,server_channel
>>>>> python greeter_server.py
>>>>> $ GRPC_VERBOSITY=DEBUG 
>>>>> GRPC_TRACE=api,channel,call_error,connectivity_state,http,server_channel
>>>>> python greeter_client.py
>>>>>
>>>>> Thank you for helping us solve this issue.
>>>>>
>>>>> Lidi Zheng
>>>>>
>>>>> On Friday, November 9, 2018 at 10:00:33 AM UTC-8, [email protected]
>>>>> wrote:
>>>>>>
>>>>>> Hi Lidi
>>>>>>
>>>>>> $ python -m SimpleHTTPServer 8000
>>>>>> $ curl  <http://localhost:8000/>
>>>>>>
>>>>> --
> You received this message because you are subscribed to the Google Groups "
> grpc.io" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to [email protected].
> To post to this group, send email to [email protected].
> Visit this group at https://groups.google.com/group/grpc-io.
> To view this discussion on the web visit
> https://groups.google.com/d/msgid/grpc-io/06e2c008-27d7-48ac-9f65-a976cc8c450e%40googlegroups.com
> <https://groups.google.com/d/msgid/grpc-io/06e2c008-27d7-48ac-9f65-a976cc8c450e%40googlegroups.com?utm_medium=email&utm_source=footer>
> .
> For more options, visit https://groups.google.com/d/optout.
>

-- 
You received this message because you are subscribed to the Google Groups 
"grpc.io" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to [email protected].
To post to this group, send email to [email protected].
Visit this group at https://groups.google.com/group/grpc-io.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/grpc-io/CAMC1%3DjfMj7nKLyLh_1eQhFek1EOuweVWMUTB3ZBZt23nww955g%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.

Reply via email to