source-backend: simplify and increase concurrency
commit964c965da4ea9ffec259ee5666d3addf5dea5989
authorMichael Stapelberg <michael@stapelberg.de>
Thu, 24 Oct 2013 19:37:05 +0000 (24 21:37 +0200)
committerMichael Stapelberg <michael@stapelberg.de>
Thu, 24 Oct 2013 19:37:05 +0000 (24 21:37 +0200)
tree1c0d92e38ce8b3d9857daaa16ec8b0bd3454bc9c
parent5203d796e7c2884de1ca48ac550e88feec193a12
source-backend: simplify and increase concurrency

Instead of trying to come up with some magic formula for how many
Goroutines make sense, we now exploit the fact that Goroutines are cheap
and rely on the Go runtime scheduler to make the best of the situation.

Additionally, this change should hide storage latency as good as
possible since all IO is being started at the same time.
cmd/source-backend/source-backend.go