Re: Bits from /me: A humble draft policy on "deep learning v.s. freedom"
Hi Holger,
Yes, that section is about bit-by-bit reproducibility,
and identical hashsum is expected. Let's call it
"Bit-by-Bit reproducible".
I updated that section to make the definition
of "reproducible" explicit. And the strongest one
is discussed by default.
However, I'm not sure whether "bit-by-bit" is
easy to break by some obscure reasons in a complex
system (e.g. float point precision problems, time
stamps hidden in the stored model). And I've never
tried to compared my neural nets with hashsums...
I compare curves and digits instead ...
I need some time to think about it, verify, and
refine the definition.
On 2019-05-22 08:49, Holger Levsen wrote:
> On Tue, May 21, 2019 at 07:53:34PM -0700, Mo Zhou wrote:
>> I wrote a dedicated section about reproducibility:
>> https://salsa.debian.org/lumin/deeplearning-policy#neural-network-reproducibility
>
> nice, very!
>
> Though you dont specify what 'reproducible' means. Given your last line
> in this email (see below) it sounds like you mean 'bit by bit identical
> results' but that's not clear in the above URL.
>
> Still, very nice and easy to add!
>
>> Everyone likes reproducible bits.
>
> :))
Reply to: