, 2015 11:14 PM
To: hdfs-dev
Subject: Re: Block creation in HDFS
Hi,
Thanks Vinay for your response. I dont need blocks of variable size. But
setting only the block size probably wont help in my case. Let me give an
example to explain what I am trying to do.
Let say the main file has 12 integers 1
Hi,
Thanks Vinay for your response. I dont need blocks of variable size. But
setting only the block size probably wont help in my case. Let me give an
example to explain what I am trying to do.
Let say the main file has 12 integers 1 to 12. The block size is such that
each block will have 3 integ
Hi abhishek,
Is Your partitions of same sizes? If yes, then you can set that as block
size.
If not you can use the latest feature.. variable block size.
To verify your use case.
You can close the current block after each partition data is written and
append to new block for new partition data.
Thi
