Alex Feinberg [Fri, 11 Mar 2011 02:19:46 +0000 (10 18:19 -0800)]
Merge branch 'master' into bdb-417
Roshan Sumbaly [Wed, 2 Mar 2011 04:44:17 +0000 (1 20:44 -0800)]
Updated Thrift to 0.5.0 + Added the thrift file of MockMessage for others to understand
Roshan Sumbaly [Wed, 2 Mar 2011 04:06:46 +0000 (1 20:06 -0800)]
Updated Avro to 1.4.0 + Fixed all the serializers
Alex Feinberg [Sun, 27 Feb 2011 02:34:06 +0000 (26 18:34 -0800)]
Merge branch 'master' of github.com:voldemort/voldemort
Roshan Sumbaly [Sat, 26 Feb 2011 02:55:26 +0000 (25 18:55 -0800)]
Merge remote branch 'voldemort/master'
Roshan Sumbaly [Sat, 26 Feb 2011 01:31:36 +0000 (25 17:31 -0800)]
Issue 335 - Cluster generator utility should create host's node ID XML elements in the same order as the provided hosts file
Roshan Sumbaly [Sat, 26 Feb 2011 01:31:36 +0000 (25 17:31 -0800)]
Issue 335 - Cluster generator utility should create host's node ID XML elements in the same order as the provided hosts file
Roshan Sumbaly [Sat, 26 Feb 2011 01:22:49 +0000 (25 17:22 -0800)]
Merge remote branch 'origin/master'
Roshan Sumbaly [Sat, 26 Feb 2011 01:13:40 +0000 (25 17:13 -0800)]
Merge branch 'master' of https://github.com/acrosa/voldemort
Alejandro Crosa [Fri, 25 Feb 2011 23:17:09 +0000 (25 15:17 -0800)]
moved to ruby directory
Roshan Sumbaly [Fri, 25 Feb 2011 22:17:13 +0000 (25 14:17 -0800)]
Merge remote branch 'voldemort/master'
Alejandro Crosa [Fri, 25 Feb 2011 20:58:22 +0000 (25 12:58 -0800)]
put the client inside a folder that contains the language name
Alejandro Crosa [Fri, 25 Feb 2011 20:52:29 +0000 (25 12:52 -0800)]
Added voldemort-rb to be bundled with default install
Alex Feinberg [Mon, 21 Feb 2011 04:27:35 +0000 (20 20:27 -0800)]
Expose additional bdb lock tuning parameters: number of lock tables, fair locks
Alex Feinberg [Sat, 19 Feb 2011 03:53:32 +0000 (18 19:53 -0800)]
Fix issue 330: ConsistentHandoffStrategy shouldn't route hints to the origin node
Roshan Sumbaly [Sat, 19 Feb 2011 00:58:25 +0000 (18 16:58 -0800)]
Merge remote branch 'upstream/master' into rebalance
Alex Feinberg [Fri, 18 Feb 2011 23:58:30 +0000 (18 15:58 -0800)]
Merge branch 'master' of https://github.com/barak/voldemort into barak-master
Harold Lee [Fri, 18 Feb 2011 23:26:13 +0000 (18 15:26 -0800)]
Add Ant tasks to measure the code coverage of the unit tests using the Cobertura
library (http://cobertura.sourceforge.net/). A nice introductory article can be
found at http://www.ibm.com/developerworks/java/library/j-cobertura/
The results are reported both in HTML format for humans, and in an XML format
suitable for other tools, such as the Cobertura plugin for the Hudson continuous
integration server.
To view the report, run "ant coverage" and then view the
dist/coverage/html/index.html file in your browser.
Roshan Sumbaly [Fri, 18 Feb 2011 18:45:59 +0000 (18 10:45 -0800)]
Added another small check in the Grandfather test which checks individual nodes for keys
Roshan Sumbaly [Thu, 17 Feb 2011 05:23:22 +0000 (16 21:23 -0800)]
Add better error descriptions when zone-count-* and zone-replication-factor are set incorrectly
Barak A. Pearlmutter [Wed, 16 Feb 2011 15:59:03 +0000 (16 15:59 +0000)]
correct some spelling errors (docs/purpose.txt)
Roshan Sumbaly [Wed, 16 Feb 2011 02:09:21 +0000 (15 18:09 -0800)]
Fixed the Cluster .equals() since it didn't take zone into consideration
Alex Feinberg [Wed, 16 Feb 2011 02:06:25 +0000 (15 18:06 -0800)]
Make node id tuneable, handle case when iterator is losed before we visit all the keys
Alex Feinberg [Tue, 15 Feb 2011 22:51:30 +0000 (15 14:51 -0800)]
Crudely increment timeout for entropy detection
Alex Feinberg [Mon, 14 Feb 2011 21:31:47 +0000 (14 13:31 -0800)]
Merge branch 'issue-256-jive'
Roshan Sumbaly [Mon, 14 Feb 2011 18:43:47 +0000 (14 10:43 -0800)]
Decreasing default max connections per node to 10
Roshan Sumbaly [Mon, 14 Feb 2011 00:32:12 +0000 (13 16:32 -0800)]
Ignore the old checksum files (*checkSum.*). Read only from the .metadata folder
Roshan Sumbaly [Sun, 13 Feb 2011 21:58:18 +0000 (13 13:58 -0800)]
Added missing read modification lock around iterators in RO store
Roshan Sumbaly [Sat, 12 Feb 2011 01:02:27 +0000 (11 17:02 -0800)]
Added 'description' to stores metadata - Issue 331
Alex Feinberg [Fri, 11 Feb 2011 19:08:41 +0000 (11 11:08 -0800)]
Revert "Remove the Voldemort cluster viewer"
This reverts commit
7bdb04f082b9d72454b4331741e393d76fb8dd86.
Roshan Sumbaly [Fri, 11 Feb 2011 05:09:00 +0000 (10 21:09 -0800)]
Change the size of RO-key-bucket size from upper 4 bytes of md5(key) to 8 bytes - Decreases collisions dramatically
Roshan Sumbaly [Fri, 11 Feb 2011 01:13:05 +0000 (10 17:13 -0800)]
Disabled speculative execution for reducers ( to get rid of check sum errors ) + Added more debug monitoring
Roshan Sumbaly [Thu, 10 Feb 2011 00:15:38 +0000 (9 16:15 -0800)]
Added more monitoring for the read-only store - Printing the checksums
Roshan Sumbaly [Wed, 9 Feb 2011 02:36:26 +0000 (8 18:36 -0800)]
Close checksum file stream correctly in store builder job
Roshan Sumbaly [Tue, 8 Feb 2011 22:47:10 +0000 (8 14:47 -0800)]
Added all the Voldemort admin shell capability to client shell
Roshan Sumbaly [Tue, 8 Feb 2011 22:32:02 +0000 (8 14:32 -0800)]
Removed Voldemort Admin shell - The admin tool has all the functions - Closing Issue 290
Roshan Sumbaly [Tue, 8 Feb 2011 22:12:01 +0000 (8 14:12 -0800)]
Made read only storage format configurable for the performance test
Roshan Sumbaly [Tue, 8 Feb 2011 21:25:28 +0000 (8 13:25 -0800)]
Added more unit tests to Hdfs fetcher - RO
Roshan Sumbaly [Tue, 8 Feb 2011 19:19:12 +0000 (8 11:19 -0800)]
Deleted common directory in contrib - Not used at all
Roshan Sumbaly [Tue, 8 Feb 2011 18:53:46 +0000 (8 10:53 -0800)]
Migrated all hadoop related scripts to ./contrib/bin - Issue 290
Roshan Sumbaly [Tue, 8 Feb 2011 18:43:54 +0000 (8 10:43 -0800)]
Remove the Voldemort cluster viewer
Roshan Sumbaly [Tue, 8 Feb 2011 18:41:14 +0000 (8 10:41 -0800)]
Better monitoring in HdfsFetcher
Alex Feinberg [Tue, 8 Feb 2011 08:01:00 +0000 (8 00:01 -0800)]
Issue-256: Nodes marked down erroneously by ThresholdFailureDetector
Roshan Sumbaly [Tue, 8 Feb 2011 00:32:35 +0000 (7 16:32 -0800)]
Merge remote branch 'upstream/master'
Roshan Sumbaly [Mon, 7 Feb 2011 17:56:06 +0000 (7 09:56 -0800)]
Merge remote branch 'upstream/master'
Roshan Sumbaly [Mon, 7 Feb 2011 17:55:52 +0000 (7 09:55 -0800)]
Merge remote branch 'origin/master'
Roshan Sumbaly [Mon, 7 Feb 2011 17:54:34 +0000 (7 09:54 -0800)]
Increase the required reads and writes params in Grandfathering test
Alex Feinberg [Fri, 4 Feb 2011 22:24:47 +0000 (4 14:24 -0800)]
Simplify assertWithBackoff
Roshan Sumbaly [Thu, 3 Feb 2011 17:54:25 +0000 (3 09:54 -0800)]
Modified the Entropy tool to use the metadata files explicitly instead of using the bootstrap url to get it
Roshan Sumbaly [Thu, 3 Feb 2011 17:54:25 +0000 (3 09:54 -0800)]
Modified the Entropy tool to use the metadata files explicitly instead of using the bootstrap url to get it
Alex Feinberg [Wed, 2 Feb 2011 03:36:49 +0000 (1 19:36 -0800)]
Merge branch 'master' of https://github.com/jtraupman-li/voldemort into jtraupman-li-master
Jonathan Traupman [Wed, 2 Feb 2011 03:30:10 +0000 (1 19:30 -0800)]
add check for missing store
Jonathan Traupman [Wed, 2 Feb 2011 03:16:36 +0000 (1 19:16 -0800)]
add some handling for malformed JSON, change metadata bootstrap to only parse store that we're trying to connect to
Roshan Sumbaly [Tue, 1 Feb 2011 18:45:10 +0000 (1 10:45 -0800)]
Modified entropy detection tool to query individual nodes
Roshan Sumbaly [Tue, 1 Feb 2011 18:54:42 +0000 (1 10:54 -0800)]
Bump up the repair job frequency to 24 hours
Roshan Sumbaly [Tue, 1 Feb 2011 18:45:10 +0000 (1 10:45 -0800)]
Modified entropy detection tool to query individual nodes
Roshan Sumbaly [Tue, 1 Feb 2011 05:34:23 +0000 (31 21:34 -0800)]
a) Moved checksum from *checkSum file to .metadata file
b) More monitoring for collisions in builder job
Alex Feinberg [Tue, 1 Feb 2011 00:14:10 +0000 (31 16:14 -0800)]
Add cluster.xml conversion tool to complement migrate partitions functionality
Roshan Sumbaly [Fri, 28 Jan 2011 18:34:21 +0000 (28 10:34 -0800)]
No forceful interruption of a running scheduled task
Alex Feinberg [Tue, 25 Jan 2011 01:55:28 +0000 (24 17:55 -0800)]
Disable repair job by default, add separate settings to enable/disable slop pusher job.
Alex Feinberg [Fri, 21 Jan 2011 01:36:11 +0000 (20 17:36 -0800)]
Merge branch 'master' of github.com:afeinberg/voldemort
Alex Feinberg [Thu, 20 Jan 2011 21:01:49 +0000 (20 13:01 -0800)]
Add config parameter for bdb cleaner lookahead cache size
Roshan Sumbaly [Wed, 19 Jan 2011 01:10:31 +0000 (18 17:10 -0800)]
Issue 324 - Voldemort admin tool's write binary entries had a OOM bug
Roshan Sumbaly [Wed, 19 Jan 2011 00:45:41 +0000 (18 16:45 -0800)]
Merge remote branch 'origin/read-only'
Alex Feinberg [Wed, 19 Jan 2011 00:40:09 +0000 (18 16:40 -0800)]
Deal with possibility of a StoreClient being lazy in some corner cases.
Roshan Sumbaly [Wed, 19 Jan 2011 00:12:15 +0000 (18 16:12 -0800)]
Added temp directory parameter to list of compulsory params for the hadoop builder jobs
Alex Feinberg [Wed, 19 Jan 2011 00:05:14 +0000 (18 16:05 -0800)]
Disable lazy for ClientShell
Roshan Sumbaly [Tue, 18 Jan 2011 23:07:20 +0000 (18 15:07 -0800)]
Fixed the read-only iterator to now read buckets
Alex Feinberg [Tue, 18 Jan 2011 21:26:55 +0000 (18 13:26 -0800)]
Merge branch 'v313patch' of https://github.com/jghoman/voldemort into jghoman-v313patch
Roshan Sumbaly [Tue, 18 Jan 2011 21:12:23 +0000 (18 13:12 -0800)]
Fixed bug in Hadoop job where-in the number of key-values were not being written correctly. Also fixed the corresponding json store builder.
We also need to adapt the search strategy to understand this new change in key size.
Roshan Sumbaly [Tue, 18 Jan 2011 07:04:55 +0000 (17 23:04 -0800)]
Rewriting key iterator based storage format for read-only stores. We now have smaller buckets ( 4 bytes compared to previous 16 byte md5 ) in our index files and allow collisions.
This is an intermediate checkin with changes to (a) json based builder - used by unit tests (b) changes to the both the hadoop jobs. The iterator ( which used to work till the last check-in ) is now broken.
Alex Feinberg [Mon, 17 Jan 2011 21:54:31 +0000 (17 13:54 -0800)]
Upgrade bdb-je to 4.1.7
Roshan Sumbaly [Mon, 17 Jan 2011 02:42:07 +0000 (16 18:42 -0800)]
Added reset method to checksum
Alex Feinberg [Sun, 16 Jan 2011 07:34:13 +0000 (15 23:34 -0800)]
Upgrade Krati to 0.3.6
Roshan Sumbaly [Fri, 14 Jan 2011 20:44:28 +0000 (14 12:44 -0800)]
Fixed a bug in the read-only store iterator + unit test
Roshan Sumbaly [Fri, 14 Jan 2011 17:38:01 +0000 (14 09:38 -0800)]
Added iterators for ro-stores only if v2 is used
Roshan Sumbaly [Fri, 14 Jan 2011 03:00:24 +0000 (13 19:00 -0800)]
Merge remote branch 'upstream/master' into read-only
Roshan Sumbaly [Fri, 14 Jan 2011 02:59:02 +0000 (13 18:59 -0800)]
Added another read-only store version which now stores the key as well in the data
Alex Feinberg [Thu, 13 Jan 2011 01:09:10 +0000 (12 17:09 -0800)]
Add unit test for bootstrapAll() method in CachingStoreClientFactory
Alex Feinberg [Wed, 12 Jan 2011 23:37:49 +0000 (12 15:37 -0800)]
Remove more generics related warnings.
Alex Feinberg [Wed, 12 Jan 2011 23:34:38 +0000 (12 15:34 -0800)]
Removed Eclipse warnings in CachingStoreClientFactory
Alex Feinberg [Wed, 12 Jan 2011 20:20:34 +0000 (12 12:20 -0800)]
Make CachingStoreClientFactory JMX managed, add ability to rebootstrap all clients.
Alex Feinberg [Wed, 12 Jan 2011 18:18:22 +0000 (12 10:18 -0800)]
Add metadata stress test, general cleanup
Alex Feinberg [Thu, 6 Jan 2011 00:40:40 +0000 (5 16:40 -0800)]
Close sockets on timeouts
Alex Feinberg [Thu, 6 Jan 2011 05:31:58 +0000 (5 21:31 -0800)]
Implement Jay's suggestions: avoid cache leaks, other code cleanup
Alex Feinberg [Wed, 5 Jan 2011 19:33:56 +0000 (5 11:33 -0800)]
Make all unit tests in voldemort.client pass with and without lazyness
Alex Feinberg [Wed, 5 Jan 2011 02:24:50 +0000 (4 18:24 -0800)]
Make SocketStoreClientFactory wrap getStoreClient with LazyStoreClient by default
Alex Feinberg [Wed, 5 Jan 2011 02:07:55 +0000 (4 18:07 -0800)]
Add configuration for lazyness
Alex Feinberg [Tue, 4 Jan 2011 21:30:20 +0000 (4 13:30 -0800)]
Create a lazy wrapper for StoreClient
Alex Feinberg [Thu, 30 Dec 2010 07:17:15 +0000 (29 23:17 -0800)]
Implement caching StoreClientFactory, which required adding equals/hashCode to the InconsistencyResolvers
Alex Feinberg [Wed, 12 Jan 2011 01:58:12 +0000 (11 17:58 -0800)]
Enable repair job.
Roshan Sumbaly [Tue, 11 Jan 2011 21:49:03 +0000 (11 13:49 -0800)]
Issue 250 : Throughputs reported by JMX was set to -1 by default. Ends up spoiling all monitoring systems
Roshan Sumbaly [Tue, 11 Jan 2011 21:24:11 +0000 (11 13:24 -0800)]
Modified JMX hook in Client to have per store based results
Roshan Sumbaly [Tue, 11 Jan 2011 19:14:16 +0000 (11 11:14 -0800)]
Issue 312 - Large connection timeouts values can lead to artificially long delays in establishing a connection
Roshan Sumbaly [Tue, 11 Jan 2011 18:56:34 +0000 (11 10:56 -0800)]
Issue 290 : Removing some shell scripts which are not used
Roshan Sumbaly [Tue, 11 Jan 2011 02:40:24 +0000 (10 18:40 -0800)]
Increase the number of threads in migrate partitions tool
Roshan Sumbaly [Tue, 11 Jan 2011 02:13:36 +0000 (10 18:13 -0800)]
Better Entropy Detection + New JMX hook in SchedulerService
Roshan Sumbaly [Sun, 9 Jan 2011 09:20:19 +0000 (9 01:20 -0800)]
Removing sysout from the Admin client unit tests
Roshan Sumbaly [Sun, 9 Jan 2011 09:12:37 +0000 (9 01:12 -0800)]
Mixed a minor bug in RebalanceUtils + Admin Client unit test for fetching read-only store partitions
Roshan Sumbaly [Sun, 9 Jan 2011 03:00:56 +0000 (8 19:00 -0800)]
Cleaning up integration grandfather test