Re: [DISCUSS] move away from python doctests

2018-08-31 Thread Hyukjin Kwon
--- > *From:* Imran Rashid > *Sent:* Wednesday, August 29, 2018 1:42 PM > *To:* ice.xell...@gmail.com > *Cc:* dev > *Subject:* Re: [DISCUSS] move away from python doctests > > (Also, maybe there are already good unit tests, and I just don't know > where

Re: [DISCUSS] move away from python doctests

2018-08-30 Thread Felix Cheung
. From: Imran Rashid Sent: Wednesday, August 29, 2018 1:42 PM To: ice.xell...@gmail.com Cc: dev Subject: Re: [DISCUSS] move away from python doctests (Also, maybe there are already good unit tests, and I just don't know where to find them, as Bryan Cutler pointed out for the bit of

Re: [DISCUSS] move away from python doctests

2018-08-29 Thread Maciej Szymkiewicz
Hi Imran, On Wed, 29 Aug 2018 at 22:26, Imran Rashid wrote: > Hi Li, > > yes that makes perfect sense. That more-or-less is the same as my view, > though I framed it differently. I guess in that case, I'm really asking: > > Can pyspark changes please be accompanied by more unit tests, and not

Re: [DISCUSS] move away from python doctests

2018-08-29 Thread Imran Rashid
(Also, maybe there are already good unit tests, and I just don't know where to find them, as Bryan Cutler pointed out for the bit of code I was originally asking about.) On Wed, Aug 29, 2018 at 3:26 PM Imran Rashid wrote: > Hi Li, > > yes that makes perfect sense. That more-or-less is the same

Re: [DISCUSS] move away from python doctests

2018-08-29 Thread Imran Rashid
Hi Li, yes that makes perfect sense. That more-or-less is the same as my view, though I framed it differently. I guess in that case, I'm really asking: Can pyspark changes please be accompanied by more unit tests, and not assume we're getting coverage from doctests? Imran On Wed, Aug 29, 2018

Re: [DISCUSS] move away from python doctests

2018-08-29 Thread Li Jin
Hi Imran, My understanding is that doctests and unittests are orthogonal - doctests are used to make sure docstring examples are correct and are not meant to replace unittests. Functionalities are covered by unit tests to ensure correctness and doctests are used to test the docstring, not the func