aboutsummaryrefslogtreecommitdiff
path: root/weed/storage
AgeCommit message (Collapse)AuthorFilesLines
2025-07-16convert error fromating to %w everywhere (#6995)Chris Lu13-35/+35
2025-07-10[Enhancement] support fix for remote files with command fix (#6961)chalet1-0/+5
2025-07-01ensure deleted entries are deletedchrislu1-1/+1
fix https://github.com/seaweedfs/seaweedfs/issues/6936
2025-06-30fix testschrislu1-69/+21
2025-06-30fix disk space calculationchrislu2-3/+119
2025-06-26update s3 session cache key (#6923)chalet1-1/+2
2025-06-19pass volume version when creating a volumechrislu11-27/+29
2025-06-16refactoringchrislu6-10/+14
2025-06-16add version to volume protochrislu1-0/+2
2025-06-11refactorchrislu2-27/+26
2025-06-11refactorchrislu3-35/+46
2025-06-11refactoringchrislu2-14/+28
2025-06-08refactororigin/refactor-volume-writechrislu2-76/+15
2025-06-07add a readme file for volume needle data layoutchrislu1-0/+160
2025-06-06refactorchrislu5-34/+21
2025-06-06fix testschrislu1-3/+5
2025-06-06Fix dumb typo in 08556257 (#6844)Lisandro Pin1-1/+1
2025-06-06refactoringchrislu4-72/+54
2025-06-06a bit refactoringchrislu1-12/+17
2025-06-06refactor needle write for different versionschrislu6-127/+519
2025-06-05New `needle_map.CompactMap()` implementation for reduced memory usage (#6842)Lisandro Pin7-439/+1298
* Rework `needle_map.CompactMap()` to maximize memory efficiency. * Use a memory-efficient structure for `CompactMap` needle value entries. This slightly complicates the code, but makes a **massive** difference in memory efficiency - preliminary results show a ~30% reduction in heap usage, with no measurable performance impact otherwise. * Clean up type for `CompactMap` chunk IDs. * Add a small comment description for `CompactMap()`. * Add the old version of `CompactMap()` for comparison purposes.
2025-06-05the isFsync parameter is essentially IsAsyncWrite and it needs to be turned ↵chrislu1-1/+1
off if s.isStopping https://github.com/seaweedfs/seaweedfs/commit/d8c574a5ef1a811f9a0d447097d9edfcc0c1d84c#r159132764
2025-06-03change version directorychrislu1-4/+3
2025-06-02Merge branch 'master' of https://github.com/seaweedfs/seaweedfs3.89Chris Lu2-15/+39
2025-06-023.89Chris Lu1-6/+10
2025-06-02fix insert beyond look back window (#6838)Chris Lu2-12/+39
2025-06-02Minor fix for the `CompactMap()` performance test. (#6836)Lisandro Pin1-2/+2
Per-entry memory usage is based on `TotalAllocs`, which is incorrect - that value is a cummulative of heap usage, which doesn't decrease when objects are freeed. `Allocs` is instead an accurate represeentation of actual memory usage at the time metrics are reported.
2025-06-01revert part of d8c574a5ef1a811f9a0d447097d9edfcc0c1d84c (#6829)Chris Lu1-1/+1
2025-05-28Further improve memory usage of `needle_map.CompactMap()`. (#6825)Lisandro Pin2-36/+40
2025-05-23Rewrite `needle_map.CompactMap()` for more efficient memory usage (#6813)Lisandro Pin2-88/+83
2025-05-15correctly report volume with input/output error to master (#6790)dongxufeng3-15/+21
* correctly capture io error and report to master * code fix * check io error by error.Is --------- Co-authored-by: dongxu_feng <dongxu_feng@intsig.net>
2025-05-14fix fsync logicchrislu2-2/+2
2025-05-09Fix update of `SeaweedFS_volumeServer_volumes` gauge metrics when EC shards ↵Lisandro Pin2-3/+11
are unmounted (#6776)
2025-05-09Use the correct constant when computing the offset in ↵Quentin D.1-4/+3
SearchNeedleFromSortedIndex (#6771) NeedleHeaderSize happen to have the same size as NeedleMapEntrySize, except when running the 5 bytes offset variant of Seaweedfs, because it does not contain OffsetSize. This causes ECX corruption on deletes, due to the drifting offset computation (offset is always computed on a basis of 16 bytes per record instead of 17 bytes) Signed-off-by: Quentin Devos <4972091+Okhoshi@users.noreply.github.com>
2025-04-02Fix volume ttl (#6683)bwlfhu2-8/+63
2025-03-31chore(deps): bump gocloud.dev from 0.40.0 to 0.41.0 (#6679)dependabot[bot]1-1/+1
* chore(deps): bump gocloud.dev from 0.40.0 to 0.41.0 Bumps [gocloud.dev](https://github.com/google/go-cloud) from 0.40.0 to 0.41.0. - [Release notes](https://github.com/google/go-cloud/releases) - [Commits](https://github.com/google/go-cloud/compare/v0.40.0...v0.41.0) --- updated-dependencies: - dependency-name: gocloud.dev dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> * fix error * fix printing errors * Update go.mod --------- Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: chrislu <chris.lu@gmail.com>
2025-03-07chore: make function comment match function name (#6607)NinaLua1-1/+1
2025-02-24added re-generating and writing the Volume UUID if it is empty (#6568)Aleksey Kosov1-8/+15
2025-01-29`ec.encode`: Display a warning on EC balancing if no replica placement ↵Lisandro Pin2-0/+33
settings are found. (#6487)
2025-01-23show error if backend is mis-configuredchrislu2-2/+8
related to https://github.com/seaweedfs/seaweedfs/discussions/6472
2025-01-22cloud tier: support for Alibaba Cloud OSS (#6466)ludwigxia2-5/+10
2024-12-19go fmtchrislu1-1/+1
2024-12-19adjust importchrislu1-2/+1
2024-12-19"golang.org/x/exp/slices" => "slices" and go fmtchrislu3-4/+4
2024-12-15Update disk_location_ec.go (#6359)coffeecloudgit1-0/+4
Add lock for l.ecVolumes
2024-12-15Update store.go (#6358)coffeecloudgit1-8/+21
Add lock for location.ecVolumes And single delete
2024-12-10[shell] use constant for hdd of type (#6337)Konstantin Lebedev2-3/+5
use constant for hdd of type
2024-12-05adjust error messagechrislu1-1/+3
2024-11-23fix EcVolumes sorting in volume UI (#6275)Trim211-3/+4
* Update store_ec.go * fix: EcVolume sorting not work * use stdlib * revert
2024-11-21fix compilationchrislu1-2/+3