Pawel Jakub Dawidek <[email protected]> writes: > Also, compression can definiately increase entropy per byte, but IMHO it > can also lose some entropy overall. With lossless compression you don't > lose data, but I don't believe you can say that you don't lose entropy.
By definition (both the definition of entropy in this context and the definition of lossless data compression), the amount of entropy in the output is exactly the same as in the input. If the output is actually smaller than the input (which is not necessarily the case, but is safe to assume when the input is ascii text), then clearly the amount of entropy per byte has increased. DES -- Dag-Erling Smørgrav - [email protected] _______________________________________________ [email protected] mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-rc To unsubscribe, send any mail to "[email protected]"
