aboutsummaryrefslogtreecommitdiff
AgeCommit message (Collapse)AuthorFilesLines
2025-05-22WIPorigin/changing-to-zapchrislu337-2184/+2692
2025-05-14fix fsync logicchrislu2-2/+2
2025-05-13Nit: unify the default `--maxParallelization` value for `weed shell` ↵Lisandro Pin3-2/+7
commands supporting this option (#6788)
2025-05-12Move `shell.ErrorWaitGroup` into a common file, to cleanly reuse across ↵Lisandro Pin2-56/+66
`weed shell` commands. (#6780) Move `shell.ErrorWaitGroup` into a dedicated common file, to cleanly reuse across `weed shell` commands.
2025-05-12chore(deps): bump github.com/redis/go-redis/v9 from 9.7.3 to 9.8.0 (#6781)dependabot[bot]2-3/+3
Bumps [github.com/redis/go-redis/v9](https://github.com/redis/go-redis) from 9.7.3 to 9.8.0. - [Release notes](https://github.com/redis/go-redis/releases) - [Changelog](https://github.com/redis/go-redis/blob/master/CHANGELOG.md) - [Commits](https://github.com/redis/go-redis/compare/v9.7.3...v9.8.0) --- updated-dependencies: - dependency-name: github.com/redis/go-redis/v9 dependency-version: 9.8.0 dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2025-05-12chore(deps): bump golang.org/x/tools from 0.31.0 to 0.33.0 (#6782)dependabot[bot]2-21/+21
Bumps [golang.org/x/tools](https://github.com/golang/tools) from 0.31.0 to 0.33.0. - [Release notes](https://github.com/golang/tools/releases) - [Commits](https://github.com/golang/tools/compare/v0.31.0...v0.33.0) --- updated-dependencies: - dependency-name: golang.org/x/tools dependency-version: 0.33.0 dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2025-05-12chore(deps): bump github.com/ydb-platform/ydb-go-sdk/v3 from 3.106.1 to ↵dependabot[bot]2-5/+6
3.108.3 (#6783) chore(deps): bump github.com/ydb-platform/ydb-go-sdk/v3 Bumps [github.com/ydb-platform/ydb-go-sdk/v3](https://github.com/ydb-platform/ydb-go-sdk) from 3.106.1 to 3.108.3. - [Release notes](https://github.com/ydb-platform/ydb-go-sdk/releases) - [Changelog](https://github.com/ydb-platform/ydb-go-sdk/blob/master/CHANGELOG.md) - [Commits](https://github.com/ydb-platform/ydb-go-sdk/compare/v3.106.1...v3.108.3) --- updated-dependencies: - dependency-name: github.com/ydb-platform/ydb-go-sdk/v3 dependency-version: 3.108.3 dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2025-05-12chore(deps): bump actions/dependency-review-action from 4.6.0 to 4.7.0 (#6784)dependabot[bot]1-1/+1
Bumps [actions/dependency-review-action](https://github.com/actions/dependency-review-action) from 4.6.0 to 4.7.0. - [Release notes](https://github.com/actions/dependency-review-action/releases) - [Commits](https://github.com/actions/dependency-review-action/compare/ce3cf9537a52e8119d91fd484ab5b8a807627bf8...38ecb5b593bf0eb19e335c03f97670f792489a8b) --- updated-dependencies: - dependency-name: actions/dependency-review-action dependency-version: 4.7.0 dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2025-05-12fix: ydb filer bugs (#6778)SmoothDenis1-20/+72
* fix: ydb filer bugs * fix(ydb): correct DeleteEntry log argument types * fix(ydb): bucket creation & deletion logic
2025-05-11Add prefix listing in mongodb_store.go (#6777)Kuzmin Anton1-7/+16
2025-05-09Fix update of `SeaweedFS_volumeServer_volumes` gauge metrics when EC shards ↵Lisandro Pin2-3/+11
are unmounted (#6776)
2025-05-09feature: added ssl support for HCFS (#6699) (#6775)orthoxerox9-98/+243
2025-05-09Improve safety for weed shell's `ec.encode`. (#6773)Lisandro Pin2-35/+63
Improve safety for weed shells `ec.encode`. The current process for `ec.encode` is: 1. EC shards for a volume are generated and added to a single server 2. The original volume is deleted 3. EC shards get re-balanced across the entire topology It is then possible to lose data between #2 and #3, if the underlying volume storage/server/rack/DC happens to fail, for whatever reason. As a fix, this MR reworks `ec.encode` so: * Newly created EC shards are spread across all locations for the source volume. * Source volumes are deleted only after EC shards are converted and balanced.
2025-05-09Use the correct constant when computing the offset in ↵Quentin D.1-4/+3
SearchNeedleFromSortedIndex (#6771) NeedleHeaderSize happen to have the same size as NeedleMapEntrySize, except when running the 5 bytes offset variant of Seaweedfs, because it does not contain OffsetSize. This causes ECX corruption on deletes, due to the drifting offset computation (offset is always computed on a basis of 16 bytes per record instead of 17 bytes) Signed-off-by: Quentin Devos <4972091+Okhoshi@users.noreply.github.com>
2025-05-08Improve parallelization for `ec.encode` (#6769)Lisandro Pin1-34/+61
Improve parallelization for `ec.encode`. Instead of processing one volume at at time, perform all EC conversion steps (mark readonly -> generate EC shards -> delete volume -> remount) in parallel for all of them. This should substantially improve performance when EC encoding entire collections.
2025-05-07load configuration before get max_file_name_length (#6766)Bruce Zou1-13/+15
2025-05-05chore(deps): bump github.com/go-sql-driver/mysql from 1.9.1 to 1.9.2 (#6720)dependabot[bot]2-3/+3
Bumps [github.com/go-sql-driver/mysql](https://github.com/go-sql-driver/mysql) from 1.9.1 to 1.9.2. - [Release notes](https://github.com/go-sql-driver/mysql/releases) - [Changelog](https://github.com/go-sql-driver/mysql/blob/master/CHANGELOG.md) - [Commits](https://github.com/go-sql-driver/mysql/compare/v1.9.1...v1.9.2) --- updated-dependencies: - dependency-name: github.com/go-sql-driver/mysql dependency-version: 1.9.2 dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2025-05-05fix: remove blocking match label (#6760)Manuel Leonhardt1-1/+0
matchLabels are immutable. Thus, matching against the version, which changes with every release, blocks Helm upgrades. To resolve this, the label is removed. See [1] where this was similarly done. [1] https://github.com/seaweedfs/seaweedfs/pull/6090
2025-05-05Add SFTP Server Support (#6753)Mohamed Sekour28-103/+2997
* Add SFTP Server Support Signed-off-by: Mohamed Sekour <mohamed.sekour@exfo.com> * fix s3 tests and helm lint Signed-off-by: Mohamed Sekour <mohamed.sekour@exfo.com> * increase helm chart version * adjust version --------- Signed-off-by: Mohamed Sekour <mohamed.sekour@exfo.com> Co-authored-by: chrislu <chris.lu@gmail.com>
2025-05-05Addendum to issue #6733 (#6756)ARibster1-1/+4
add s3.ip.bind command line parameter to filer
2025-05-05chore(deps): bump github.com/aws/aws-sdk-go-v2/config from 1.29.13 to ↵dependabot[bot]2-9/+9
1.29.14 (#6757) chore(deps): bump github.com/aws/aws-sdk-go-v2/config Bumps [github.com/aws/aws-sdk-go-v2/config](https://github.com/aws/aws-sdk-go-v2) from 1.29.13 to 1.29.14. - [Release notes](https://github.com/aws/aws-sdk-go-v2/releases) - [Changelog](https://github.com/aws/aws-sdk-go-v2/blob/main/changelog-template.json) - [Commits](https://github.com/aws/aws-sdk-go-v2/compare/config/v1.29.13...config/v1.29.14) --- updated-dependencies: - dependency-name: github.com/aws/aws-sdk-go-v2/config dependency-version: 1.29.14 dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2025-05-05chore(deps): bump github.com/prometheus/procfs from 0.16.0 to 0.16.1 (#6758)dependabot[bot]2-3/+3
Bumps [github.com/prometheus/procfs](https://github.com/prometheus/procfs) from 0.16.0 to 0.16.1. - [Release notes](https://github.com/prometheus/procfs/releases) - [Commits](https://github.com/prometheus/procfs/compare/v0.16.0...v0.16.1) --- updated-dependencies: - dependency-name: github.com/prometheus/procfs dependency-version: 0.16.1 dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2025-05-05chore(deps): bump actions/dependency-review-action from 4.3.2 to 4.6.0 (#6759)dependabot[bot]1-1/+1
Bumps [actions/dependency-review-action](https://github.com/actions/dependency-review-action) from 4.3.2 to 4.6.0. - [Release notes](https://github.com/actions/dependency-review-action/releases) - [Commits](https://github.com/actions/dependency-review-action/compare/0c155c5e8556a497adf53f2c18edabf945ed8e70...ce3cf9537a52e8119d91fd484ab5b8a807627bf8) --- updated-dependencies: - dependency-name: actions/dependency-review-action dependency-version: 4.6.0 dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2025-05-043.873.87chrislu2-3/+3
2025-05-04adds tls exampleschrislu1-0/+24
related to https://github.com/seaweedfs/seaweedfs/pull/6738
2025-05-04feat(redis): add mTLS support for Redis connection initialization (#6738)Jade Devin Cabatlao2-12/+102
* feat(redis): add mTLS support for Redis connection initialization - Enhanced the Redis2Store initialization to support mutual TLS (mTLS) by adding configuration options for CA certificate, client certificate, and client key paths. - Updated the Redis client setup to use TLS configuration when mTLS is enabled, ensuring secure connections to the Redis server. * feat(redis): extend Redis3Store initialization to support mTLS - Added configuration options for enabling mutual TLS (mTLS) in Redis3Store. - Implemented logic to load client certificates and CA certificates for secure Redis connections. - Updated the Redis client setup to utilize TLS configuration when mTLS is enabled. --------- Co-authored-by: Chris Lu <chrislusf@users.noreply.github.com>
2025-05-01chore(deps): bump github.com/go-jose/go-jose/v4 from 4.0.4 to 4.0.5 (#6750)dependabot[bot]2-3/+3
Bumps [github.com/go-jose/go-jose/v4](https://github.com/go-jose/go-jose) from 4.0.4 to 4.0.5. - [Release notes](https://github.com/go-jose/go-jose/releases) - [Changelog](https://github.com/go-jose/go-jose/blob/main/CHANGELOG.md) - [Commits](https://github.com/go-jose/go-jose/compare/v4.0.4...v4.0.5) --- updated-dependencies: - dependency-name: github.com/go-jose/go-jose/v4 dependency-version: 4.0.5 dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2025-05-01chore(deps): bump google.golang.org/api from 0.228.0 to 0.230.0 (#6742)dependabot[bot]2-39/+44
Bumps [google.golang.org/api](https://github.com/googleapis/google-api-go-client) from 0.228.0 to 0.230.0. - [Release notes](https://github.com/googleapis/google-api-go-client/releases) - [Changelog](https://github.com/googleapis/google-api-go-client/blob/main/CHANGES.md) - [Commits](https://github.com/googleapis/google-api-go-client/compare/v0.228.0...v0.230.0) --- updated-dependencies: - dependency-name: google.golang.org/api dependency-version: 0.230.0 dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2025-05-01chore(deps): bump docker/build-push-action from 6.15.0 to 6.16.0 (#6743)dependabot[bot]7-7/+7
Bumps [docker/build-push-action](https://github.com/docker/build-push-action) from 6.15.0 to 6.16.0. - [Release notes](https://github.com/docker/build-push-action/releases) - [Commits](https://github.com/docker/build-push-action/compare/471d1dc4e07e5cdedd4c2171150001c434f0b7a4...14487ce63c7a62a4a324b0bfb37086795e31c6c1) --- updated-dependencies: - dependency-name: docker/build-push-action dependency-version: 6.16.0 dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2025-05-01fix: S3 Feature: please add s3.idleTimeout command line parameter #6746 (#6747)ARibster3-2/+7
ildeTimeout command line parameter for s3
2025-05-01bump depdency-review-action 4.3.0 -> 4.3.2 (#6732)Taehyung Lim1-1/+1
2025-05-01[s3] refactor duplicate put-object code paths (#6727)Taehyung Lim3-42/+38
2025-05-01[s3] add tests for s3 over https using aws-cli (#6731)Taehyung Lim1-0/+79
* [s3] add tests for s3 over https using aws-cli * fix typo
2025-04-28fix #6733 add s3.ip.bind command line parameter (#6741)ARibster1-1/+4
2025-04-27fix: volume.list volume info output not in order (#6737)NyaMisty1-1/+1
2025-04-23golang up version to 1.24 (#6724)Konstantin Lebedev3-3/+3
2025-04-23[s3] use chunkedReader in PutObjectPartHandler to handle aws-chunked ↵Taehyung Lim1-1/+1
encoding (#6725)
2025-04-23[s3] fix checksum algorithm CRC64NVMe (#6722)Konstantin Lebedev3-5/+8
2025-04-16Fix implementation of `master_pb.CollectionList` RPC call (#6715)Lisandro Pin2-5/+87
2025-04-14chore(deps): bump gocloud.dev/pubsub/natspubsub from 0.40.0 to 0.41.0 (#6707)3.86dependabot[bot]2-12/+12
Bumps [gocloud.dev/pubsub/natspubsub](https://github.com/google/go-cloud) from 0.40.0 to 0.41.0. - [Release notes](https://github.com/google/go-cloud/releases) - [Commits](https://github.com/google/go-cloud/compare/v0.40.0...v0.41.0) --- updated-dependencies: - dependency-name: gocloud.dev/pubsub/natspubsub dependency-version: 0.41.0 dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2025-04-14chore(deps): bump github.com/ydb-platform/ydb-go-sdk/v3 from 3.104.1 to ↵dependabot[bot]2-3/+3
3.106.1 (#6705) chore(deps): bump github.com/ydb-platform/ydb-go-sdk/v3 Bumps [github.com/ydb-platform/ydb-go-sdk/v3](https://github.com/ydb-platform/ydb-go-sdk) from 3.104.1 to 3.106.1. - [Release notes](https://github.com/ydb-platform/ydb-go-sdk/releases) - [Changelog](https://github.com/ydb-platform/ydb-go-sdk/blob/master/CHANGELOG.md) - [Commits](https://github.com/ydb-platform/ydb-go-sdk/compare/v3.104.1...v3.106.1) --- updated-dependencies: - dependency-name: github.com/ydb-platform/ydb-go-sdk/v3 dependency-version: 3.106.1 dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2025-04-14chore(deps): bump cloud.google.com/go/pubsub from 1.48.1 to 1.49.0 (#6706)dependabot[bot]2-3/+3
Bumps [cloud.google.com/go/pubsub](https://github.com/googleapis/google-cloud-go) from 1.48.1 to 1.49.0. - [Release notes](https://github.com/googleapis/google-cloud-go/releases) - [Changelog](https://github.com/googleapis/google-cloud-go/blob/main/CHANGES.md) - [Commits](https://github.com/googleapis/google-cloud-go/compare/pubsub/v1.48.1...pubsub/v1.49.0) --- updated-dependencies: - dependency-name: cloud.google.com/go/pubsub dependency-version: 1.49.0 dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2025-04-14chore(deps): bump google.golang.org/grpc from 1.71.0 to 1.71.1 (#6708)dependabot[bot]2-3/+3
Bumps [google.golang.org/grpc](https://github.com/grpc/grpc-go) from 1.71.0 to 1.71.1. - [Release notes](https://github.com/grpc/grpc-go/releases) - [Commits](https://github.com/grpc/grpc-go/compare/v1.71.0...v1.71.1) --- updated-dependencies: - dependency-name: google.golang.org/grpc dependency-version: 1.71.1 dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2025-04-08* Fix s3 auth failed with X-Forwarded-Host and X-Forwarded-Port (#6698)zuzuviewer1-3/+3
2025-04-08chore(deps): bump github.com/aws/aws-sdk-go-v2/config from 1.29.12 to ↵dependabot[bot]2-15/+15
1.29.13 (#6692) chore(deps): bump github.com/aws/aws-sdk-go-v2/config Bumps [github.com/aws/aws-sdk-go-v2/config](https://github.com/aws/aws-sdk-go-v2) from 1.29.12 to 1.29.13. - [Release notes](https://github.com/aws/aws-sdk-go-v2/releases) - [Changelog](https://github.com/aws/aws-sdk-go-v2/blob/main/changelog-template.json) - [Commits](https://github.com/aws/aws-sdk-go-v2/compare/config/v1.29.12...config/v1.29.13) --- updated-dependencies: - dependency-name: github.com/aws/aws-sdk-go-v2/config dependency-version: 1.29.13 dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: Chris Lu <chrislusf@users.noreply.github.com>
2025-04-07chore(deps): bump golang.org/x/tools from 0.30.0 to 0.31.0 (#6691)dependabot[bot]0-0/+0
Bumps [golang.org/x/tools](https://github.com/golang/tools) from 0.30.0 to 0.31.0. - [Release notes](https://github.com/golang/tools/releases) - [Commits](https://github.com/golang/tools/compare/v0.30.0...v0.31.0) --- updated-dependencies: - dependency-name: golang.org/x/tools dependency-version: 0.31.0 dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: Chris Lu <chrislusf@users.noreply.github.com>
2025-04-07chore(deps): bump github.com/spf13/viper from 1.19.0 to 1.20.1 (#6690)dependabot[bot]2-34/+21
Bumps [github.com/spf13/viper](https://github.com/spf13/viper) from 1.19.0 to 1.20.1. - [Release notes](https://github.com/spf13/viper/releases) - [Commits](https://github.com/spf13/viper/compare/v1.19.0...v1.20.1) --- updated-dependencies: - dependency-name: github.com/spf13/viper dependency-version: 1.20.1 dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: Chris Lu <chrislusf@users.noreply.github.com>
2025-04-07chore(deps): bump golang.org/x/sync from 0.12.0 to 0.13.0 (#6693)dependabot[bot]2-3/+3
Bumps [golang.org/x/sync](https://github.com/golang/sync) from 0.12.0 to 0.13.0. - [Commits](https://github.com/golang/sync/compare/v0.12.0...v0.13.0) --- updated-dependencies: - dependency-name: golang.org/x/sync dependency-version: 0.13.0 dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: Chris Lu <chrislusf@users.noreply.github.com>
2025-04-07Revert "[filer] void panic if s3opt.tlsCACertificate is nill" (#6694)Konstantin Lebedev2-2/+1
Revert "[filer] void panic if s3opt.tlsCACertificate is nill (#6685)" This reverts commit 4dca59ed276f90fea1f79cf72cdeb23371f39ba8.
2025-04-07[filer] void panic if s3opt.tlsCACertificate is nill (#6685)Konstantin Lebedev2-1/+2
* fix issues/6684 * add s3.cacert.file option for filer
generated by cgit v1.2.3 (git 2.25.1) at 2025-12-20 20:40:43 +0000