fast-import: Stream very large blobs directly to pack
commit5eef828bc03649ba11acc05c983d72823c27f0bb
authorShawn O. Pearce <spearce@spearce.org>
Mon, 1 Feb 2010 17:27:35 +0000 (1 09:27 -0800)
committerJunio C Hamano <gitster@pobox.com>
Mon, 1 Feb 2010 20:09:47 +0000 (1 12:09 -0800)
tree2554847a2c6f7853bf2b9b8226de1ccca67ce828
parent63d04a78043c61c52ae437fa6106e7029b466bbf
fast-import: Stream very large blobs directly to pack

If a blob is larger than the configured big-file-threshold, instead
of reading it into a single buffer obtained from malloc, stream it
onto the end of the current pack file.  Streaming the larger objects
into the pack avoids the 4+ GiB memory footprint that occurs when
fast-import is processing 2+ GiB blobs.

Signed-off-by: Shawn O. Pearce <spearce@spearce.org>
Signed-off-by: Junio C Hamano <gitster@pobox.com>
Documentation/config.txt
Documentation/git-fast-import.txt
fast-import.c
t/t5705-clone-2gb.sh
t/t9300-fast-import.sh