Hey All, I had a quick comment on ARROW-783 that Wes responded to and I wanted to elevate the conversation here for a moment.
My suggestion there was that we should disallow zero-length batches. Wes thought that should be an application level concern. I wanted to see what others thought. My general perspective is that zero-length batches are meaningless and better to disallow than make every application have special handling for them. In the jira Wes noted that they have to deal with zero-length dataframes. Despite that, I don't think there is a requirement that there should be a 1:1 mapping between arrow record batches and dataframes. If someone wants to communicate empty things, no need for them to use Arrow. What do others think?