aboutsummaryrefslogtreecommitdiff
AgeCommit message (Collapse)AuthorFilesLines
2025-01-01Update LICENSE, fix copyright license year (#6405)Jason N. White1-1/+1
2024-12-31worm grace period and retention time support (#6404)Guang Jiong Lou14-706/+830
Signed-off-by: lou <alex1988@outlook.com>
2024-12-30chore(deps): bump golang.org/x/image from 0.21.0 to 0.23.0 (#6399)dependabot[bot]2-3/+3
Bumps [golang.org/x/image](https://github.com/golang/image) from 0.21.0 to 0.23.0. - [Commits](https://github.com/golang/image/compare/v0.21.0...v0.23.0) --- updated-dependencies: - dependency-name: golang.org/x/image dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-12-30chore(deps): bump github.com/linxGnu/grocksdb from 1.9.7 to 1.9.8 (#6398)dependabot[bot]2-3/+3
Bumps [github.com/linxGnu/grocksdb](https://github.com/linxGnu/grocksdb) from 1.9.7 to 1.9.8. - [Release notes](https://github.com/linxGnu/grocksdb/releases) - [Commits](https://github.com/linxGnu/grocksdb/compare/v1.9.7...v1.9.8) --- updated-dependencies: - dependency-name: github.com/linxGnu/grocksdb dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-12-30chore(deps): bump github.com/parquet-go/parquet-go from ↵dependabot[bot]2-3/+3
0.23.1-0.20241011155651-6446d1d0d2fe to 0.24.0 (#6400) chore(deps): bump github.com/parquet-go/parquet-go Bumps [github.com/parquet-go/parquet-go](https://github.com/parquet-go/parquet-go) from 0.23.1-0.20241011155651-6446d1d0d2fe to 0.24.0. - [Release notes](https://github.com/parquet-go/parquet-go/releases) - [Changelog](https://github.com/parquet-go/parquet-go/blob/main/CHANGELOG.md) - [Commits](https://github.com/parquet-go/parquet-go/commits/v0.24.0) --- updated-dependencies: - dependency-name: github.com/parquet-go/parquet-go dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-12-30chore(deps): bump golang.org/x/net from 0.32.0 to 0.33.0 (#6401)dependabot[bot]2-3/+3
Bumps [golang.org/x/net](https://github.com/golang/net) from 0.32.0 to 0.33.0. - [Commits](https://github.com/golang/net/compare/v0.32.0...v0.33.0) --- updated-dependencies: - dependency-name: golang.org/x/net dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-12-30chore(deps): bump github.com/aws/aws-sdk-go-v2/credentials from 1.17.46 to ↵dependabot[bot]2-16/+15
1.17.48 (#6402) chore(deps): bump github.com/aws/aws-sdk-go-v2/credentials Bumps [github.com/aws/aws-sdk-go-v2/credentials](https://github.com/aws/aws-sdk-go-v2) from 1.17.46 to 1.17.48. - [Release notes](https://github.com/aws/aws-sdk-go-v2/releases) - [Commits](https://github.com/aws/aws-sdk-go-v2/compare/credentials/v1.17.46...credentials/v1.17.48) --- updated-dependencies: - dependency-name: github.com/aws/aws-sdk-go-v2/credentials dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-12-26use same time format in volume volume UI and filter UI (#6395)Trim211-1/+1
use same time format in volume server UI with filter UI
2024-12-24chore(deps): bump google.golang.org/grpc from 1.67.2 to 1.69.2 (#6391)dependabot[bot]2-32/+30
Bumps [google.golang.org/grpc](https://github.com/grpc/grpc-go) from 1.67.2 to 1.69.2. - [Release notes](https://github.com/grpc/grpc-go/releases) - [Commits](https://github.com/grpc/grpc-go/compare/v1.67.2...v1.69.2) --- updated-dependencies: - dependency-name: google.golang.org/grpc dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-12-24Replace bolt dependency with bbolt (#6387)Eric Long2-2/+7
There are some dependencies that still depends on the unmaintained bolt after https://github.com/seaweedfs/seaweedfs/pull/3554. Replace it so that we can have one less dependency, and build on newer architecture like RISC-V. Two lines of `replace` are required because Go refuses to replace `github.com/boltdb/bolt` with `go.etcd.io/bbolt` when the latter is also present in the dependency tree. Replace it again with `github.com/etcd-io/bbolt` solves the issue.
2024-12-24chore(deps): bump modernc.org/mathutil from 1.6.0 to 1.7.0 (#6389)dependabot[bot]2-3/+3
Bumps [modernc.org/mathutil](https://gitlab.com/cznic/mathutil) from 1.6.0 to 1.7.0. - [Commits](https://gitlab.com/cznic/mathutil/compare/v1.6.0...v1.7.0) --- updated-dependencies: - dependency-name: modernc.org/mathutil dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-12-24chore(deps): bump github.com/aws/aws-sdk-go-v2/service/s3 from 1.71.0 to ↵dependabot[bot]2-24/+24
1.71.1 (#6390) chore(deps): bump github.com/aws/aws-sdk-go-v2/service/s3 Bumps [github.com/aws/aws-sdk-go-v2/service/s3](https://github.com/aws/aws-sdk-go-v2) from 1.71.0 to 1.71.1. - [Release notes](https://github.com/aws/aws-sdk-go-v2/releases) - [Commits](https://github.com/aws/aws-sdk-go-v2/compare/service/s3/v1.71.0...service/s3/v1.71.1) --- updated-dependencies: - dependency-name: github.com/aws/aws-sdk-go-v2/service/s3 dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-12-24chore(deps): bump modernc.org/sqlite from 1.34.1 to 1.34.4 (#6392)dependabot[bot]2-3/+3
Bumps [modernc.org/sqlite](https://gitlab.com/cznic/sqlite) from 1.34.1 to 1.34.4. - [Commits](https://gitlab.com/cznic/sqlite/compare/v1.34.1...v1.34.4) --- updated-dependencies: - dependency-name: modernc.org/sqlite dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-12-24chore(deps): bump google.golang.org/protobuf from 1.35.2 to 1.36.1 (#6393)dependabot[bot]2-3/+3
Bumps google.golang.org/protobuf from 1.35.2 to 1.36.1. --- updated-dependencies: - dependency-name: google.golang.org/protobuf dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-12-20skip error while executing volume.fix.replication (#6382)dsd1-5/+11
2024-12-19fix compilationchrislu1-3/+0
2024-12-19go fmtchrislu1-1/+1
2024-12-19adjust importchrislu1-2/+1
2024-12-19"golang.org/x/exp/slices" => "slices" and go fmtchrislu44-71/+70
2024-12-19Fix for DeleteMultipleObjectsHandler wrongly deleting parent folders (#6380)Warren Hodgkinson1-2/+7
What problem are we solving? Fix: #6379 How are we solving the problem? We check for the AllowEmptyFolders option prior to cascade deleting parent folders in S3 DeleteMultipleObjectsHandler. How is the PR tested? We ran SeaweedFS in a Kubernetes Cluster with a joint Filer and S3 server in one container, with leveldb2 as the filer storage, and AllowEmptyFolders set to true. When using the Distribution Registry as the S3 client, it calls the DeleteMultipleObjectsHandler as part of the artifact upload process (uploads to a temp location, then performs a copy and delete). Without this fix, the deletion cascade deleted parent folder until the entire contents of the bucket were gone. With this fix, the existing content of the bucket remained, and the newly uploaded content was added. Checks [ ] I have added unit tests if possible. [ ] I will add related wiki document changes and link to this PR after merging. Co-authored-by: Chris Lu <chrislusf@users.noreply.github.com>
2024-12-19Fix volume replica parallelization within `ec.encode`. (#6377)Lisandro Pin1-5/+3
See 826edd5d.
2024-12-18Allow configuring the maximum number of concurrent tasks for EC ↵Lisandro Pin3-49/+52
parallelization. (#6376) Follow-up to b0210df0.
2024-12-18Parallelize volume replica operations within `ec.encode`. (#6374)Lisandro Pin2-8/+21
2024-12-18[shell] feat:stop vacuum immediately once volume.vacuum.disable was executed ↵dsd4-10/+25
(#6375) stop vacuum immediately once volume.vacuum.disable was executed Co-authored-by: dsd <dsd2019@foxmail.com>
2024-12-17Rework `shell.EcBalance()`'s waitgroup code into a standalone type. (#6373)Lisandro Pin1-54/+61
Rework `shell.EcBalance()`'s waitgroup with errors code into a standalone type. We'll re-use this for other EC jobs - for example, volume creation. Also fixes potential concurrency issues when collecting error results.
2024-12-16mount metacache add ttl (#6360)zemul4-16/+30
* fix:mount deadlock * fix * feat: metaCache ttl * Update weed/command/mount.go Co-authored-by: Chris Lu <chrislusf@users.noreply.github.com> * fix InodeEntry --------- Co-authored-by: zemul <zhouzemiao@ihuman.com> Co-authored-by: Chris Lu <chrislusf@users.noreply.github.com>
2024-12-16chore(deps): bump docker/setup-buildx-action from 3.7.1 to 3.8.0 (#6369)dependabot[bot]7-7/+7
Bumps [docker/setup-buildx-action](https://github.com/docker/setup-buildx-action) from 3.7.1 to 3.8.0. - [Release notes](https://github.com/docker/setup-buildx-action/releases) - [Commits](https://github.com/docker/setup-buildx-action/compare/c47758b77c9736f4b2ef4073d4d51994fabfe349...6524bf65af31da8d45b59e8c27de4bd072b392f5) --- updated-dependencies: - dependency-name: docker/setup-buildx-action dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-12-16chore(deps): bump golang.org/x/crypto from 0.30.0 to 0.31.0 (#6370)dependabot[bot]2-3/+3
Bumps [golang.org/x/crypto](https://github.com/golang/crypto) from 0.30.0 to 0.31.0. - [Commits](https://github.com/golang/crypto/compare/v0.30.0...v0.31.0) --- updated-dependencies: - dependency-name: golang.org/x/crypto dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-12-16chore(deps): bump wangyoucao577/go-release-action from 1.52 to 1.53 (#6368)dependabot[bot]7-16/+16
Bumps [wangyoucao577/go-release-action](https://github.com/wangyoucao577/go-release-action) from 1.52 to 1.53. - [Release notes](https://github.com/wangyoucao577/go-release-action/releases) - [Commits](https://github.com/wangyoucao577/go-release-action/compare/2aa2977ad6a4534f9179e22bd0ff146a1e1d3466...481a2c1a0f1be199722e3e9b74d7199acafc30a8) --- updated-dependencies: - dependency-name: wangyoucao577/go-release-action dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-12-16chore(deps): bump helm/kind-action from 1.10.0 to 1.11.0 (#6367)dependabot[bot]1-1/+1
Bumps [helm/kind-action](https://github.com/helm/kind-action) from 1.10.0 to 1.11.0. - [Release notes](https://github.com/helm/kind-action/releases) - [Commits](https://github.com/helm/kind-action/compare/v1.10.0...v1.11.0) --- updated-dependencies: - dependency-name: helm/kind-action dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-12-16chore(deps): bump cloud.google.com/go/storage from 1.45.0 to 1.48.0 (#6366)dependabot[bot]2-6/+8
Bumps [cloud.google.com/go/storage](https://github.com/googleapis/google-cloud-go) from 1.45.0 to 1.48.0. - [Release notes](https://github.com/googleapis/google-cloud-go/releases) - [Changelog](https://github.com/googleapis/google-cloud-go/blob/main/CHANGES.md) - [Commits](https://github.com/googleapis/google-cloud-go/compare/pubsub/v1.45.0...spanner/v1.48.0) --- updated-dependencies: - dependency-name: cloud.google.com/go/storage dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-12-16chore(deps): bump github.com/schollz/progressbar/v3 from 3.16.0 to 3.17.1 ↵dependabot[bot]2-3/+3
(#6365) chore(deps): bump github.com/schollz/progressbar/v3 Bumps [github.com/schollz/progressbar/v3](https://github.com/schollz/progressbar) from 3.16.0 to 3.17.1. - [Release notes](https://github.com/schollz/progressbar/releases) - [Commits](https://github.com/schollz/progressbar/compare/v3.16.0...v3.17.1) --- updated-dependencies: - dependency-name: github.com/schollz/progressbar/v3 dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-12-16chore(deps): bump go.mongodb.org/mongo-driver from 1.16.0 to 1.17.1 (#6364)dependabot[bot]2-7/+6
Bumps [go.mongodb.org/mongo-driver](https://github.com/mongodb/mongo-go-driver) from 1.16.0 to 1.17.1. - [Release notes](https://github.com/mongodb/mongo-go-driver/releases) - [Commits](https://github.com/mongodb/mongo-go-driver/compare/v1.16.0...v1.17.1) --- updated-dependencies: - dependency-name: go.mongodb.org/mongo-driver dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-12-16chore(deps): bump github.com/getsentry/sentry-go from 0.29.1 to 0.30.0 (#6363)dependabot[bot]2-3/+3
Bumps [github.com/getsentry/sentry-go](https://github.com/getsentry/sentry-go) from 0.29.1 to 0.30.0. - [Release notes](https://github.com/getsentry/sentry-go/releases) - [Changelog](https://github.com/getsentry/sentry-go/blob/master/CHANGELOG.md) - [Commits](https://github.com/getsentry/sentry-go/compare/v0.29.1...v0.30.0) --- updated-dependencies: - dependency-name: github.com/getsentry/sentry-go dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-12-16chore(deps): bump github.com/fclairamb/ftpserverlib from 0.24.1 to 0.25.0 ↵dependabot[bot]2-3/+3
(#6362) chore(deps): bump github.com/fclairamb/ftpserverlib Bumps [github.com/fclairamb/ftpserverlib](https://github.com/fclairamb/ftpserverlib) from 0.24.1 to 0.25.0. - [Release notes](https://github.com/fclairamb/ftpserverlib/releases) - [Commits](https://github.com/fclairamb/ftpserverlib/compare/v0.24.1...v0.25.0) --- updated-dependencies: - dependency-name: github.com/fclairamb/ftpserverlib dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-12-15Update disk_location_ec.go (#6359)coffeecloudgit1-0/+4
Add lock for l.ecVolumes
2024-12-15Update store.go (#6358)coffeecloudgit1-8/+21
Add lock for location.ecVolumes And single delete
2024-12-15Parallelize EC shards balancing within racks (#6354)Lisandro Pin1-5/+5
Parallelize EC shards balancing within racks.
2024-12-13Parallelize EC shards balancing across racks. (#6352)Lisandro Pin1-5/+6
2024-12-13Parallelize EC balancing for racks. (#6351)Lisandro Pin1-15/+15
2024-12-13fix: filer may crash by bucketLastActiveTsNs concurrency access. (#6350)zouyixiong1-0/+7
2024-12-13[shell] only apply the balancing for writable volumes (#6346)Konstantin Lebedev2-13/+26
2024-12-12fix: record and delete bucket metrics after inactive (#6349)zouyixiong2-8/+47
2024-12-12Begin implementing EC balancing parallelization support. (#6342)Lisandro Pin3-12/+58
* Begin implementing EC balancing parallelization support. Impacts both `ec.encode` and `ec.balance`, * Nit: improve type naming. * Make the goroutine workgroup handler for `EcBalance()` a bit smarter/error-proof. * Nit: unify naming for `ecBalancer` wait group methods with the rest of the module. * Fix concurrency bug. * Fix whitespace after Gitlab automerge. * Delete stray TODO.
2024-12-12Limit EC re-balancing for `ec.encode` to relevant collections when a volume ↵Lisandro Pin3-5/+76
ID argument is provided. (#6347) Limit EC re-balancing for `ec.encode` to relevant collections when a volume ID is provided.
2024-12-12Delete legacy balancing code for `ec.encode`. (#6344)Lisandro Pin2-146/+0
2024-12-11[shell] volume.list show only writable volumes (#6338)Konstantin Lebedev1-6/+13
* show only writable volumes * fix import
2024-12-11volume.list avoid output empty data center and rack and disk info (#6341)Konstantin Lebedev1-15/+46
2024-12-10Unify the re-balancing logic for `ec.encode` with `ec.balance`. (#6339)Lisandro Pin6-136/+156
Among others, this enables recent changes related to topology aware re-balancing at EC encoding time.
2024-12-10[shell] use constant for hdd of type (#6337)Konstantin Lebedev5-7/+11
use constant for hdd of type