Hi Holger, Yes, that section is about bit-by-bit reproducibility, and identical hashsum is expected. Let's call it "Bit-by-Bit reproducible".
I updated that section to make the definition of "reproducible" explicit. And the strongest one is discussed by default. However, I'm not sure whether "bit-by-bit" is easy to break by some obscure reasons in a complex system (e.g. float point precision problems, time stamps hidden in the stored model). And I've never tried to compared my neural nets with hashsums... I compare curves and digits instead ... I need some time to think about it, verify, and refine the definition. On 2019-05-22 08:49, Holger Levsen wrote: > On Tue, May 21, 2019 at 07:53:34PM -0700, Mo Zhou wrote: >> I wrote a dedicated section about reproducibility: >> https://salsa.debian.org/lumin/deeplearning-policy#neural-network-reproducibility > > nice, very! > > Though you dont specify what 'reproducible' means. Given your last line > in this email (see below) it sounds like you mean 'bit by bit identical > results' but that's not clear in the above URL. > > Still, very nice and easy to add! > >> Everyone likes reproducible bits. > > :))
