aboutsummaryrefslogtreecommitdiff
path: root/weed-fs/src/pkg
AgeCommit message (Collapse)AuthorFilesLines
2013-02-10re-organize code directory structureChris Lu42-3531/+0
2013-02-06Issue 15: Stress test corrupts volumeChris Lu1-0/+17
Checked in for GThomas(tgulacsi78) I've also met with partial writes (pipe closed on localhost), and also met with real corruption: after some partial write, the data size in needle header was read as some huuuuge number, which resulted in memory panic. Please consider the attached patch for ensuring full writes (seeks back to the beginning on needle append error). Hope this helps. Tested with a small tmpfs, lot of "no space left on device" :) (sudo umount -lf /tmp/weed; mkdir -p /tmp/weed && sudo mount -o size=128M,mode=4777 -t tmpfs tmpfs /tmp/weed && bin/weed master -mdir=/tmp/weed -debug=true & bin/weed volume -dir=/tmp/weed -debug=true) GThomas
2013-01-22ensure file name does not contain any "/"Chris Lu1-0/+2
2013-01-20re-factoring volume file scanning codeChris Lu6-81/+110
add export function fix bugs on deleted byte counting
2013-01-20adding visit function for the NeedleMapChris Lu2-14/+22
2013-01-20better error handling, check in for Gulácsi TamásChris Lu4-73/+138
2013-01-17go fmt for all source codesChris Lu30-419/+404
2013-01-17cosmetics changeChris Lu1-8/+11
2013-01-17Revert "sort writables to be able to skew write probability to lesser ids ↵Chris Lu1-35/+5
(older volumes)" This reverts commit ce7394f3bfe50b6dcb7ff1682bd7e5e1b5574da2.
2013-01-17Revert "add error return for (Un)GzipData"Chris Lu2-20/+32
This reverts commit 824371035109225128f8942b64a817838a7c0c25.
2013-01-17Revert "add cmd/dump - a dumper"Chris Lu31-458/+396
This reverts commit 5d2a1e8d4845e7a7f1dccd962bb0ee6a5f9d6081.
2013-01-17Revert "add CdbMap"Chris Lu4-195/+32
This reverts commit bf0ccf346198a65e0321b3cedfb25ef5dad73e2a.
2013-01-17Revert "add Frozen attribute to VolumeInfo"Chris Lu5-47/+5
This reverts commit dd685fdd8d8ac6d28dce0d25b72115e3315a30a8.
2013-01-17Revert "add "freeze" subcommand to volume"Chris Lu5-123/+9
This reverts commit f262fed19784ad85d7cfef985f3dfcc09bd7180c.
2013-01-17Revert "fix errors with frozen volume loading"Chris Lu3-20/+4
This reverts commit 92ffba2ab9561c066ec12379f2288f2a3ea1d9c5.
2013-01-14fix errors with frozen volume loadingTamás Gulácsi3-4/+20
2013-01-14add "freeze" subcommand to volumeTamás Gulácsi5-9/+123
2013-01-13add Frozen attribute to VolumeInfoTamás Gulácsi5-5/+47
2013-01-12add CdbMapTamás Gulácsi4-32/+195
2013-01-05add cmd/dump - a dumperTamás Gulácsi31-396/+458
Walk needed to be added to NeedleMap and CompactMap, to be able to add WalkKeys and WalkValues to volume. This is needed for iterating through all the stored needles in a volume - this was dump's purpose.
2013-01-04add error return for (Un)GzipDataTamás Gulácsi2-32/+20
2013-01-04sort writables to be able to skew write probability to lesser ids (older ↵Tamás Gulácsi1-5/+35
volumes)
2013-01-04master can redirect GET/DELETE/POST requests to volume servers. SoChris Lu2-3/+3
clients does not always need to remember the volume server locations. This is good for low~medium sized web site traffic.
2013-01-02compare read file size with in-memory file sizeChris Lu2-1/+14
2012-12-22properly handle quick volume server restartChris Lu3-6/+23
2012-12-22Default more not to gzip since gzip can be done on client side.Chris Lu1-38/+58
2012-12-22use bits in needle.Flags to mark hasName and hasMimeChris Lu2-22/+37
2012-12-22add store metadata:file name, mime type, is_gzippedChris Lu3-8/+35
add support to upload .gz file directly
2012-12-21parallel logic for read and writeChris Lu1-11/+13
2012-12-21fix write errorChris Lu1-1/+1
2012-12-21can read/write files in format version 2Chris Lu5-15/+90
2012-12-21refactoringChris Lu3-50/+70
2012-12-20refactor for reading super blockChris Lu2-33/+44
2012-12-20refactor a bitChris Lu4-54/+73
2012-12-17reading/setting/reporting correct volume versionChris Lu5-7/+11
2012-12-17ensure only compatible volume versions are writableChris Lu3-3/+8
2012-12-17better log messageChris Lu1-2/+3
2012-12-03reporting volume size as early as possibleChris Lu4-37/+69
2012-12-03correctly count volumes, to ensure proper capacity managementChris Lu3-6/+22
2012-12-03ensure properly make volume unwritable. Previously passing volumeInfoChris Lu4-9/+12
reference, causing make wrong volumes unwritable!
2012-11-26added proper log messagesChris Lu1-0/+1
2012-11-23fix compilation errorChris Lu1-1/+0
2012-11-23remove log messageChris Lu1-1/+1
2012-11-23add command line option to control garbage thresholdChris Lu2-10/+10
2012-11-23periodically compact volumesChris Lu8-69/+189
2012-11-21add version typeChris Lu2-11/+17
2012-11-20cleaner code, better error handlingChris Lu1-11/+31
2012-11-20adjust formattingChris Lu1-6/+6
2012-11-20adding exception handling for this caseChris Lu1-4/+9
2012-11-13add warning messageChris Lu1-0/+1