aboutsummaryrefslogtreecommitdiff
path: root/go/storage
AgeCommit message (Collapse)AuthorFilesLines
2016-06-02directory structure change to work with glideChris Lu29-3246/+0
glide has its own requirements. My previous workaround caused me some code checkin errors. Need to fix this.
2016-05-27fix concurrent write mapChris Lu1-1/+13
fix https://github.com/chrislusf/seaweedfs/issues/311
2016-05-13properly release memoryChris Lu3-4/+5
fix https://github.com/chrislusf/seaweedfs/issues/301
2016-05-09close current needle map when switchingChris Lu1-0/+1
2016-04-26just refactoringChris Lu2-20/+36
2016-04-26separate into 2 files, no logic changeChris Lu2-36/+44
2016-04-17correct cache: fix racing conditionchrislusf2-9/+7
2016-04-15adjust to real case cache sizechrislusf1-2/+2
2016-04-15add []byte caching and poolingchrislusf3-32/+80
fixes https://github.com/chrislusf/seaweedfs/issues/211
2016-04-14pooling []bytechrislusf3-4/+36
reduce the number of requests to make([]byte)
2016-04-10clearer error messagechrislusf1-17/+11
2016-04-10storage: faster ParseKeyHashJianfei Wang1-11/+18
2016-04-10storage: add test for ParseKeyHashJianfei Wang2-1/+46
2016-04-10Revert "Merge pull request #284 from thinxer/binary"chrislusf10-119/+69
This reverts commit 3523ad523929870aa8d4a7741ee8e152cfd40489, reversing changes made to 5d100994b1b9c6679113c8dd73f97aff85397f02.
2016-04-10storage: do not copy sync.Mutex by valueJianfei Wang1-4/+4
2016-04-09replace util/bytes.go with binary.BigEndianJianfei Wang9-69/+74
2016-04-09storage: add test for ParseKeyHashJianfei Wang2-1/+46
2016-04-08Revert "Merge pull request #281 from thinxer/binary"chrislusf9-59/+61
This reverts commit a87fe8ffcec7a5210bf97301e2951eea51a0a0ec, reversing changes made to 6876bfa68524d4fc0a961f89dc29e53fbc654ea5.
2016-04-06replace util/bytes.go with binary.BigEndianJianfei Wang9-61/+59
2016-04-01use klauspost/crc32 instead of hash/crc32Alexandr Razumov1-1/+1
2015-12-14format changeschrislusf2-7/+9
2015-12-02Delete all chunks when delete a ChunkManifesttnextday2-61/+3
LoadChunkManifest can uncompress buffer move compress.go from storage to operation because of import cycle MakeFile add cross complete command
2015-12-02complete submit chunked filetnextday1-1/+1
2015-12-01rename FlagChunkedFile to FlagChunkManifesttnextday2-6/+6
2015-12-01update ChunkedFile to seekable reader, so we can use io.* to read datatnextday2-8/+13
2015-11-29add chunk file helper to support large filetnextday1-0/+9
2015-08-18fix extract collection name from .dat fileTimur Nurutdinov1-1/+3
2015-07-17fix ttl change detectionchrislusf1-1/+1
https://github.com/chrislusf/seaweedfs/issues/166
2015-07-11fix wrong logicchrislusf1-1/+1
2015-07-11add loggingchrislusf1-0/+1
2015-07-10skip isFileUnchanged checking since ttl always changechrislusf1-0/+3
skip checking since ttl always change. Fixing https://github.com/chrislusf/seaweedfs/issues/166
2015-07-08Avoid nil case when fixing datachrislusf1-1/+1
2015-06-23In case lastNode==0, need to set it to -1chrislusf1-2/+2
Fix https://github.com/chrislusf/seaweedfs/issues/156
2015-05-26Add "weed backup" command.chrislusf8-124/+357
This is a pre-cursor for asynchronous replication.
2015-05-25Add Key String() functionchrislusf1-0/+6
2015-05-23Rename variableschrislusf2-10/+10
2015-05-23Add commentschrislusf1-0/+1
2015-05-22Fix looking for master nodes.chrislusf1-2/+6
2015-05-14More debug information for connecting to masterchrislusf1-0/+4
2015-05-08Textual changes.chrislusf1-1/+1
2015-05-08Increase compact revision during each compactionchrislusf1-0/+1
2015-05-08Add compact revision in volume super blockchrislusf1-0/+5
2015-04-21unittest: TestSortVolumeInfosyanyiwu1-0/+23
2015-04-21Sort VolumeInfos by VolumeId in Store.Status();yanyiwu2-1/+25
Ordered VolumeInfos is more Human-readable, especially when there is a lot of volumes.
2015-04-19Prepend prefix "0" for odd number of hex characters.chrislusf1-0/+3
2015-04-16Change all chrislusf/weed-fs links to point to chrislu/seaweedfsStuart P. Bentley16-27/+27
2015-04-14Add error checking for file reads.chrislusf1-1/+5
2015-03-29remove verbose logging.chrislusf1-1/+0
2015-03-29Add boltdb for volume needle mapchrislusf6-46/+246
boltdb is fairly slow to write, about 6 minutes for recreating index for 1553934 files. Boltdb loads 1,553,934 x 16 = 24,862,944bytes from disk, and generate the boltdb as large as 134,217,728 bytes in 6 minutes. To compare, for leveldb, it recreates index in leveldb as large as 27,188,148 bytes in 8 seconds. For in memory version, it loads the index in To test the memory consumption, the leveldb or boltdb index are created. And the server is restarted. Using the benchmark tool to read lots of files. There are 7 volumes in benchmark collection, each with about 1553K files. For leveldb, the memory starts at 142,884KB, and stays at 179,340KB. For boltdb, the memory starts at 73,756KB, and stays at 144,564KB. For in-memory, the memory starts at 368,152KB, and stays at 448,032KB.
2015-03-27removing unused fileschrislusf2-407/+0