HTTPFile: more reasonable chunk size for big files
commit4c1f1924271dc828bb5eb22461b2b02390b11f6f
authorEric Wong <normalperson@yhbt.net>
Wed, 3 Sep 2008 22:24:13 +0000 (3 15:24 -0700)
committerEric Wong <normalperson@yhbt.net>
Tue, 9 Sep 2008 01:59:22 +0000 (8 18:59 -0700)
tree584dddf6dd78d1a9b73105e01027ca4f0659513b
parent5939e0855ff1e84021cbfd4a72a6b6d9827a25df
HTTPFile: more reasonable chunk size for big files

16M for a chunk is a huge amount of memory to slurp at once.
64K is much more reasonable and chunk sizes above this lead
to dimishing returns in performance.
lib/mogilefs/httpfile.rb