I think there is another use of debian/copyright beyond just documenting what ends up in the binaries. I think that if I read debian/copyright in a source package, I should expect to understand the licenses I need to comply with when dealing with the source package.
So for example if the package requires GPL-3 code during its build, and by policy I don't want to deal with GPL-3 I should know I have a problem only from reading debian/copyright. So I think you need to talk about more than just binaries. --Sam