aboutsummaryrefslogtreecommitdiff
AgeCommit message (Collapse)AuthorFilesLines
2022-08-213.233.23chrislu2-3/+3
2022-08-21the statistical methord for fileCount should stay same (#3477)Guo Lei1-1/+1
the statistical methord for fileCount between should stay same They all equal to the entry count in .idx file. relate to commit(c7892bc)
2022-08-21remove same file copying rage limitationchrislu1-25/+22
2022-08-21Implement copy_file_range syscall in FUSE (#3475)Patrick Schmidt4-21/+128
See the man page of copy_file_range: https://man7.org/linux/man-pages/man2/copy_file_range.2.html
2022-08-21filer: do not always save files in "/etc" folder to filer storechrislu2-4/+2
fix https://github.com/seaweedfs/seaweedfs/issues/3476
2022-08-21fix compilationchrislu1-1/+1
2022-08-21EC: with multiple volume locations, the ec rebuilding may failchrislu1-20/+33
2022-08-21EC: after ec encoding, the source ec shards may fail to purge if the volume ↵chrislu1-37/+49
server has multiple disk locations related to https://github.com/seaweedfs/seaweedfs/issues/3459
2022-08-21align memory for atomic read/writechrislu1-2/+2
2022-08-21Avoid race conditions with current filer address (#3474)Patrick Schmidt2-14/+20
When multiple filer requests are in-flight and the current filer disappears and a new one is selected by the first goroutine, then there can be a lot of race conditions while retrieving the current filer. Therefore, load/save the current filer index atomically.
2022-08-21Fix hanging reads in chunk cacher (#3473)Patrick Schmidt1-33/+34
Sometimes when an unexpected error occurs the cacher would set an error and return. However, it would not broadcast the condition signal in that case, therefore leaving the goroutine that runs readChunkAt stuck forever. I figured that the condition is unnecessary because readChunkAt is acquiring a lock that is still held by the cacher goroutine anyway. Callees of startCaching have to wait for a WaitGroup which makes sure that readChunkAt can't acquire the lock before startCaching. This way readChunkAt can execute normally and check for the error.
2022-08-21minorchrislu1-5/+5
2022-08-21refactoringchrislu1-3/+3
2022-08-21Fix FUSE server buffer leaks in file gaps (#3472)Patrick Schmidt2-35/+94
* Fix FUSE server buffer leaks in file gaps This change zeros read buffers when encountering file gaps during file/chunk reads in FUSE mounts. It prevents leaking internal buffers of the FUSE server which could otherwise reveal metadata, directory listings, file contents and other data related to FUSE API calls. The issue was that buffers are reused, but when a file gap was found the buffer was not zeroed accordingly and the existing data of the buffer was kept and returned. * Move zero logic into its own method
2022-08-20volume: file counter should be all fileschrislu1-3/+2
address https://github.com/seaweedfs/seaweedfs/pull/3388#issuecomment-1220466228
2022-08-20retry for all errorschrislu1-2/+2
2022-08-20adjust logchrislu1-1/+1
2022-08-20refactoringchrislu1-56/+20
2022-08-20adjust typechrislu1-2/+1
2022-08-20use util.Retry to retrychrislu1-10/+9
2022-08-20webdav: retryable data chunk uploadchrislu1-50/+23
2022-08-20filer: retryable data chunk uploadchrislu1-18/+30
2022-08-20filer sink: retryable data chunk uploadingchrislu1-52/+29
2022-08-20mount: retryable data chunk uploadingchrislu1-49/+28
2022-08-20filer.copy: retryable file part uploadchrislu1-43/+26
2022-08-20add fileId to UploadWithRetry return resultchrislu2-5/+3
2022-08-20filer.copy: retryable uploadchrislu2-48/+95
2022-08-20remove unused collection and replication from upload resultchrislu8-38/+23
2022-08-20cleaner codechrislu1-19/+19
2022-08-20remove unused codechrislu1-7/+0
2022-08-19filer.backup: backup small files if the file is saved in filer ↵chrislu6-1/+34
(saveToFilerLimit > 0) fix https://github.com/seaweedfs/seaweedfs/issues/3468
2022-08-19Filer if-modified-since check doesn't fire on "exact" #3467chrislu1-1/+1
fix https://github.com/seaweedfs/seaweedfs/issues/3467
2022-08-19filer: retryable when error is not foundchrislu2-2/+6
2022-08-18minorchrislu1-1/+3
2022-08-18fix naming typo (#3465)Eric Yang1-2/+2
Co-authored-by: root <root@HQ-10MSTD3EY.roblox.local>
2022-08-18Merge branch 'master' of https://github.com/seaweedfs/seaweedfschrislu1-3/+3
2022-08-18s3: remove deleted collection during metrics reportingchrislu1-5/+5
fix https://github.com/seaweedfs/seaweedfs/issues/3453
2022-08-18fix redundant type from array (#3462)Guo Lei1-3/+3
2022-08-18s3: fix regression on HEAD directory operationchrislu1-0/+12
2022-08-18fix testschrislu4-14/+15
2022-08-17fix building for unmaintainedchrislu1-0/+1
2022-08-17also migrate jsonpbchrislu15-85/+47
2022-08-17move proto packagechrislu49-53/+53
2022-08-17volume: fix metrics for volume request timechrislu1-2/+2
2022-08-15fix(filer.sync): offset may be set to 0 (#3451)qzh1-0/+3
* fix(filer.sync): initializing the offset is related to the path * fix(filer.sync): the offset maybe to be set to 0. Co-authored-by: zhihao.qu <zhihao.qu@ly.com>
2022-08-15fix(filer.sync): initializing the offset is related to the path (#3450)qzh1-4/+4
Co-authored-by: zhihao.qu <zhihao.qu@ly.com>
2022-08-153.223.22chrislu2-3/+3
2022-08-15Revert "Refactor for Sync method (#3426)"chrislu4-69/+7
This reverts commit 670cb759f82815461bc854569542582da51a6199. with the pr weed/storage () - (master) > go test -count=1 ./... ok github.com/seaweedfs/seaweedfs/weed/storage 18.486s ? github.com/seaweedfs/seaweedfs/weed/storage/backend [no test files] ok github.com/seaweedfs/seaweedfs/weed/storage/backend/memory_map 0.025s ? github.com/seaweedfs/seaweedfs/weed/storage/backend/s3_backend [no test files] ok github.com/seaweedfs/seaweedfs/weed/storage/erasure_coding 0.864s ? github.com/seaweedfs/seaweedfs/weed/storage/idx [no test files] ok github.com/seaweedfs/seaweedfs/weed/storage/needle 0.110s ok github.com/seaweedfs/seaweedfs/weed/storage/needle_map 24.414s ok github.com/seaweedfs/seaweedfs/weed/storage/super_block 0.203s ? github.com/seaweedfs/seaweedfs/weed/storage/types [no test files] ? github.com/seaweedfs/seaweedfs/weed/storage/volume_info [no test files] weed/storage () - (master) > weed/storage () - (master) > without the pr weed/storage () - (master) > weed/storage () - (master) > go test -count=1 ./... ok github.com/seaweedfs/seaweedfs/weed/storage 1.617s ? github.com/seaweedfs/seaweedfs/weed/storage/backend [no test files] ok github.com/seaweedfs/seaweedfs/weed/storage/backend/memory_map 0.026s ? github.com/seaweedfs/seaweedfs/weed/storage/backend/s3_backend [no test files] ok github.com/seaweedfs/seaweedfs/weed/storage/erasure_coding 0.906s ? github.com/seaweedfs/seaweedfs/weed/storage/idx [no test files] ok github.com/seaweedfs/seaweedfs/weed/storage/needle 0.202s ok github.com/seaweedfs/seaweedfs/weed/storage/needle_map 24.533s ok github.com/seaweedfs/seaweedfs/weed/storage/super_block 0.280s ? github.com/seaweedfs/seaweedfs/weed/storage/types [no test files] ? github.com/seaweedfs/seaweedfs/weed/storage/volume_info [no test files]
2022-08-15Merge branch 'master' of https://github.com/seaweedfs/seaweedfschrislu4-21/+91
2022-08-15less verbose logchrislu1-1/+2