aboutsummaryrefslogtreecommitdiff
path: root/weed/storage/volume_loading.go
AgeCommit message (Collapse)AuthorFilesLines
2025-10-24Volume Server: Unexpected Deletion of Remote Tier Data (#7377)Chris Lu1-0/+13
* [Admin UI] Login not possible due to securecookie error * avoid 404 favicon * Update weed/admin/dash/auth_middleware.go Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com> * address comments * avoid variable over shadowing * log session save error * When jwt.signing.read.key is enabled in security.toml, the volume server requires JWT tokens for all read operations. * reuse fileId * refactor * fix deleting remote tier * simplify the fix * Update weed/storage/volume_loading.go Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com> * Update weed/storage/volume_loading.go Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com> * Update weed/storage/volume_loading.go Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com> * fix --------- Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com> Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
2025-07-16convert error fromating to %w everywhere (#6995)Chris Lu1-1/+1
2025-06-19pass volume version when creating a volumechrislu1-4/+4
2025-01-23show error if backend is mis-configuredchrislu1-1/+3
related to https://github.com/seaweedfs/seaweedfs/discussions/6472
2024-09-19[volume] remove truncate idx file if size not healthy (#6043)Konstantin Lebedev1-1/+1
2024-09-05persist readonly state to volume info (#5977)Bruce1-0/+5
2024-09-04Skip volume data integrity check for volume which has remote file (#5976)Bruce1-3/+11
2024-04-17rename VolumeServerVolumeGauge (#5504)steve.wei1-1/+1
2023-10-03Revert "Revert "Revert "Add disk type to prometheus metrics" (#4777)""chrislu1-1/+1
This reverts commit 567d78892860f87c207beb56a3323b4b9e90dfc9.
2023-10-03Revert "fix compilation"chrislu1-0/+3
This reverts commit 451ec6504d07812b074555a1fbb2a831bfa8e5e3.
2023-10-03fix compilationchrislu1-3/+0
2023-10-02Revert "Revert "Add disk type to prometheus metrics" (#4777)"chrislu1-1/+1
This reverts commit 9215ba24be0aec0c5804927cc73613560e57cbc0.
2022-11-14Lazy loading (#3958)Guo Lei1-8/+9
* types packages is imported more than onece * lazy-loading * fix bugs * fix bugs * fix unit tests * fix test error * rename function * unload ldb after initial startup * Don't load ldb when starting volume server if ldbtimeout is set. * remove uncessary unloadldb * Update weed/command/server.go Co-authored-by: Chris Lu <chrislusf@users.noreply.github.com> * Update weed/command/volume.go Co-authored-by: Chris Lu <chrislusf@users.noreply.github.com> Co-authored-by: guol-fnst <goul-fnst@fujitsu.com> Co-authored-by: Chris Lu <chrislusf@users.noreply.github.com>
2022-10-14avoid load volume file with BytesOffset mismatch (#3841)Konstantin Lebedev1-1/+5
* avoid load volume file with BytesOffset mismatch https://github.com/seaweedfs/seaweedfs/issues/2966 * set BytesOffset if has not VolumeInfoFile * typos fail => failed * exit if bytesOffset mismatch
2022-08-23optimiz commitig compact (#3388)Guo Lei1-12/+32
* optimiz vacuuming volume * fix bugx * rename parameters * fix conflict * change copyDataBasedOnIndexFile to an instance method * close needlemap * optimiz commiting Vacuum volume for leveldb index * fix bugs * fix leveldb loading bugs * refactor * fix leveldb loading bug * add leveldb recovery * add test case for levelDB * modify test case to cover all the new branches * use one tmpNm instead of two instances * refactor * refactor * move setWatermark to the end * add test for watermark and updating leveldb * fix error logic * refactor, add test * check nil before close needlemapeer add test case fix metric bug * add tests, fix bugs * adjust log level remove wrong test case refactor * avoid duplicate updating metric for leveldb index
2022-07-29move to https://github.com/seaweedfs/seaweedfschrislu1-6/+6
2021-12-05volume: fix loading old volume formatchrislu1-0/+3
fix https://github.com/chrislusf/seaweedfs/issues/2487
2021-03-01skip network error when remote volumes startChris Lu1-0/+5
2021-03-01add logs for remote file loadingChris Lu1-0/+1
2021-03-01add vif file versions in case loading superblock failsChris Lu1-2/+2
2021-02-11volume: fail fast if idx files are missingChris Lu1-0/+4
fix https://github.com/chrislusf/seaweedfs/issues/1796
2021-02-07renaming NeedleMapType to NeedleMapKindbingoohuang1-2/+2
2020-12-22go fmtChris Lu1-4/+4
2020-12-04volume: ensure the volume dat and idx files are always closedChris Lu1-0/+18
fix https://github.com/chrislusf/seaweedfs/issues/1646
2020-11-27volume: add "-dir.idx" option for separate index storageChris Lu1-30/+35
fix https://github.com/chrislusf/seaweedfs/issues/1265
2020-10-28volume: automatically trim out unreachable entriesChris Lu1-1/+1
2020-07-03refactoringChris Lu1-1/+1
2020-04-11refactoringChris Lu1-1/+1
2020-04-11rename functionChris Lu1-1/+1
2020-03-17volume: compaction can cause readonly volumesChris Lu1-1/+1
address https://github.com/chrislusf/seaweedfs/issues/1233
2020-01-08saving .vif files correctlyChris Lu1-3/+6
2019-12-28endure creating .vif filesChris Lu1-1/+3
2019-12-28go fmtChris Lu1-1/+0
2019-12-28load volume info from .vif file, use superblock as a backupChris Lu1-19/+2
2019-12-28refactoring: separating .vif from tier file loadingChris Lu1-2/+6
2019-12-28rename volume tier info to volume infoChris Lu1-1/+1
2019-12-24compaction changed to .idx based deletionChris Lu1-1/+1
2019-12-24rename .sdb to .sdxChris Lu1-1/+1
2019-12-23shell: add ec.decode commandChris Lu1-2/+3
2019-12-19refactoring variable nameChris Lu1-31/+30
2019-12-19volume: add deletion capability for previously readonly volumesChris Lu1-5/+5
2019-12-18tiered volume is read onlyChris Lu1-0/+1
2019-12-18volume: use sorted index map for readonly volumesChris Lu1-37/+44
2019-12-02tiered storage: can copy to s3, read from s3Chris Lu1-2/+5
master not aware tiered volume yet, file assigning is not working yet
2019-11-09refactor memory mapped file into backend storageChris Lu1-3/+3
2019-10-29adjust NewDiskFile() paramatersChris Lu1-1/+1
2019-10-29changed from os.file to backend.DataStorageBackendChris Lu1-3/+7
2019-10-21adjust parameter namesChris Lu1-1/+1
2019-10-14Merge pull request #10 from chrislusf/masterjoeslay1-0/+3
merge seaweed master
2019-10-09volume: return error if superblock is not initializedChris Lu1-0/+3
fix https://github.com/chrislusf/seaweedfs/issues/1079