SAMZA-1581 is the ticket On Thu, Feb 1, 2018 at 5:20 PM, Yi Pan <nickpa...@gmail.com> wrote:
> Hi, Srujun, > > Sorry to reply late. I am glad that you figured it out. The issue you > reported seems to be a bug that we set the default for metrics serde in one > case and not in the other one. I will open a ticket to track the > investigation. > > Thanks a lot for reporting the issue! > > -Yi > > On Tue, Jan 30, 2018 at 2:38 PM, Srujun Thanmay Gupta < > sgupt...@illinois.edu> wrote: > >> Hi, >> >> Thank you Yi, what you mentioned seemed to be the issue. Configuring the >> metrics serdes fixed the metrics output. The reason I had not added them >> initially was because the wikipedia-application.properties file in the >> hello-samza example here: ( >> https://github.com/apache/samza-hello-samza/blob/master/src/ >> main/config/wikipedia-application.properties >> ) >> does not have them configured. >> >> Using that configuration for the wikipedia-application demo did not >> produce >> metrics. But, surprisingly, not configuring the serdes for the >> wikipedia-feed demo either (which uses the low-level API) worked fine, >> which is why I was wondering if metrics is configured differently when >> using the high-level API. I've linked the two demos below, with the >> .properties files used for each and the DEBUG logs generated. >> >> https://github.com/srujun/srujun.github.io/tree/master/files >> /samza/wikipedia-feed >> (metrics works as expected, emitting JSON-encoded messages to >> kafka.metrics) >> https://github.com/srujun/srujun.github.io/tree/master/files >> /samza/wikipedia-application >> (metrics not working unless serdes are also configured) >> >> From what I can see, there are metrics serialization errors in the >> wikipedia-application logs, as expected. But no such issue for >> wikipedia-feed, even though no serde was configured. Is there some other >> issue here? >> >> Thank you again. >> >> On Fri, Jan 26, 2018 at 11:00 PM, Yi Pan <nickpa...@gmail.com> wrote: >> >> > Hi, Srujun, >> > >> > I noticed that you did not configure the metrics serde as stated here: >> > http://samza.apache.org/learn/documentation/0.14/container/metrics.html >> . >> > Could that be the reason? >> > >> > -Yi >> > >> > On Fri, Jan 26, 2018 at 7:58 PM, Jagadish Venkatraman < >> > jagadish1...@gmail.com> wrote: >> > >> > > Can you turn on DEBUG logging for the MetricsSnapshotReporter class >> and >> > > re-attach the logs? I cannot observe any obvious red-flag from your >> logs. >> > > >> > > On Fri, Jan 26, 2018 at 7:13 PM, Srujun Thanmay Gupta < >> > > sgupt...@illinois.edu >> > > > wrote: >> > > >> > > > Hello Yi, >> > > > >> > > > The logs are less than 100KB each, I'm not sure if that's too large >> for >> > > the >> > > > mailing list system. I've uploaded the log files to the links >> below, in >> > > > case others would like to look at them too. >> > > > >> > > > http://srujun.com/files/samza/wikipedia-application_samza- >> > > container-0.log >> > > > http://srujun.com/files/samza/wikipedia-application_samza- >> > > > job-coordinator.log >> > > > http://srujun.com/files/samza/wikipedia-feed_samza-container-0.log >> > > > http://srujun.com/files/samza/wikipedia-feed_samza-job-coord >> inator.log >> > > > >> > > > Thank you for your help! >> > > > >> > > > -- >> > > > Srujun Thanmay Gupta >> > > > >> > > >> > > >> > > >> > > -- >> > > Jagadish V, >> > > Graduate Student, >> > > Department of Computer Science, >> > > Stanford University >> > > >> > >> >> >> >> -- >> Srujun Thanmay Gupta >> > >
