aboutsummaryrefslogtreecommitdiff
AgeCommit message (Collapse)AuthorFilesLines
2025-02-12implement s3 streaming-unsigned-payload-trailer (#6539)Tom Crasset4-47/+392
* implement s3 streaming-unsigned-payload-trailer * chore: remove print
2025-02-10`ec.encode`: Explictly mount EC shards after volume conversion. (#6528)Lisandro Pin1-2/+12
This guarantees EC shards are immediately available after encoding, even if not affected by subsequent re-balancing.
2025-02-10chore(deps): bump github.com/aws/aws-sdk-go-v2/service/s3 from 1.75.2 to ↵dependabot[bot]2-21/+21
1.76.0 (#6535) chore(deps): bump github.com/aws/aws-sdk-go-v2/service/s3 Bumps [github.com/aws/aws-sdk-go-v2/service/s3](https://github.com/aws/aws-sdk-go-v2) from 1.75.2 to 1.76.0. - [Release notes](https://github.com/aws/aws-sdk-go-v2/releases) - [Changelog](https://github.com/aws/aws-sdk-go-v2/blob/main/changelog-template.json) - [Commits](https://github.com/aws/aws-sdk-go-v2/compare/service/s3/v1.75.2...service/s3/v1.76.0) --- updated-dependencies: - dependency-name: github.com/aws/aws-sdk-go-v2/service/s3 dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2025-02-10chore(deps): bump github.com/aws/aws-sdk-go-v2 from 1.36.0 to 1.36.1 (#6538)dependabot[bot]2-3/+3
Bumps [github.com/aws/aws-sdk-go-v2](https://github.com/aws/aws-sdk-go-v2) from 1.36.0 to 1.36.1. - [Release notes](https://github.com/aws/aws-sdk-go-v2/releases) - [Changelog](https://github.com/aws/aws-sdk-go-v2/blob/main/changelog-template.json) - [Commits](https://github.com/aws/aws-sdk-go-v2/compare/v1.36.0...v1.36.1) --- updated-dependencies: - dependency-name: github.com/aws/aws-sdk-go-v2 dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2025-02-10chore(deps): bump modernc.org/strutil from 1.2.0 to 1.2.1 (#6537)dependabot[bot]2-3/+3
Bumps [modernc.org/strutil](https://gitlab.com/cznic/strutil) from 1.2.0 to 1.2.1. - [Commits](https://gitlab.com/cznic/strutil/compare/v1.2.0...v1.2.1) --- updated-dependencies: - dependency-name: modernc.org/strutil dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2025-02-10chore(deps): bump golang.org/x/sync from 0.10.0 to 0.11.0 (#6536)dependabot[bot]2-3/+3
Bumps [golang.org/x/sync](https://github.com/golang/sync) from 0.10.0 to 0.11.0. - [Commits](https://github.com/golang/sync/compare/v0.10.0...v0.11.0) --- updated-dependencies: - dependency-name: golang.org/x/sync dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2025-02-10chore(deps): bump google.golang.org/protobuf from 1.36.4 to 1.36.5 (#6534)dependabot[bot]2-3/+3
Bumps google.golang.org/protobuf from 1.36.4 to 1.36.5. --- updated-dependencies: - dependency-name: google.golang.org/protobuf dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2025-02-10chore(deps): bump docker/setup-buildx-action from 3.8.0 to 3.9.0 (#6533)dependabot[bot]7-7/+7
Bumps [docker/setup-buildx-action](https://github.com/docker/setup-buildx-action) from 3.8.0 to 3.9.0. - [Release notes](https://github.com/docker/setup-buildx-action/releases) - [Commits](https://github.com/docker/setup-buildx-action/compare/6524bf65af31da8d45b59e8c27de4bd072b392f5...f7ce87c1d6bead3e36075b2ce75da1f6cc28aaca) --- updated-dependencies: - dependency-name: docker/setup-buildx-action dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2025-02-10chore(deps): bump docker/setup-qemu-action from 3.3.0 to 3.4.0 (#6532)dependabot[bot]7-7/+7
Bumps [docker/setup-qemu-action](https://github.com/docker/setup-qemu-action) from 3.3.0 to 3.4.0. - [Release notes](https://github.com/docker/setup-qemu-action/releases) - [Commits](https://github.com/docker/setup-qemu-action/compare/53851d14592bedcffcf25ea515637cff71ef929a...4574d27a4764455b42196d70a065bc6853246a25) --- updated-dependencies: - dependency-name: docker/setup-qemu-action dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2025-02-07omit http and https ports when using X-Forwarded-Port (#6527)Tom Crasset1-1/+1
2025-02-07add s3 signature tests and prepare implementation of ↵Tom Crasset7-8/+208
STREAMING-UNSIGNED-PAYLOAD-TRAILER (#6525) * add tests for s3 signature * add test for newSignV4ChunkedReader.Read() * add glog import
2025-02-07Nit: remove missing newlines on `weed shell` commands output. (#6524)Lisandro Pin2-2/+2
Nit: remove missing newlines on `weed` commands output.
2025-02-07fix: record and delete bucket metrics after inactive (#6523)zouyixiong5-3/+14
Co-authored-by: XYZ <XYZ>
2025-02-06fix: bucket-hook fails with gnu wget (#6521)Ethan Mosbaugh1-1/+1
2025-02-06Remove warning on EC balancing if no replica placement settings are found. ↵Lisandro Pin1-3/+0
(#6516) Effectively undoes c9399a68; with ff8bd862, a replica placement type `000` will no longer break shards re-balancing. Co-authored-by: Chris Lu <chrislusf@users.noreply.github.com>
2025-02-06use X-Forwarded-Host and X-Forwarded-Port to determine correct host for AWS ↵Tom Crasset1-6/+21
signature (#6514)
2025-02-04Nit: fix missing newline on EC balancing warnings regarding replica settings ↵Lisandro Pin1-1/+1
(#6509) Nit: fix missing newline on EC balancing warnings regarding replica settings. See 79136812.
2025-02-04use golang:1.23 image3.84chrislu3-3/+3
2025-02-033.84chrislu2-3/+3
2025-02-03Revert "Add content length to filer's requests (#6489)"chrislu1-1/+0
This reverts commit 9f42ce3f01468317870c0c37f3a0ebf986a504f9.
2025-02-03chore(deps): bump cloud.google.com/go/pubsub from 1.45.3 to 1.47.0 (#6501)dependabot[bot]2-75/+80
* chore(deps): bump cloud.google.com/go/pubsub from 1.45.3 to 1.47.0 Bumps [cloud.google.com/go/pubsub](https://github.com/googleapis/google-cloud-go) from 1.45.3 to 1.47.0. - [Release notes](https://github.com/googleapis/google-cloud-go/releases) - [Changelog](https://github.com/googleapis/google-cloud-go/blob/main/CHANGES.md) - [Commits](https://github.com/googleapis/google-cloud-go/compare/pubsub/v1.45.3...pubsub/v1.47.0) --- updated-dependencies: - dependency-name: cloud.google.com/go/pubsub dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> * go mod tidy --------- Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: chrislu <chris.lu@gmail.com>
2025-02-03chore(deps): bump github.com/aws/aws-sdk-go-v2/service/s3 from 1.72.0 to ↵dependabot[bot]2-27/+27
1.75.2 (#6503) chore(deps): bump github.com/aws/aws-sdk-go-v2/service/s3 Bumps [github.com/aws/aws-sdk-go-v2/service/s3](https://github.com/aws/aws-sdk-go-v2) from 1.72.0 to 1.75.2. - [Release notes](https://github.com/aws/aws-sdk-go-v2/releases) - [Changelog](https://github.com/aws/aws-sdk-go-v2/blob/main/changelog-template.json) - [Commits](https://github.com/aws/aws-sdk-go-v2/compare/service/s3/v1.72.0...service/s3/v1.75.2) --- updated-dependencies: - dependency-name: github.com/aws/aws-sdk-go-v2/service/s3 dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2025-02-03chore(deps): bump golang.org/x/tools from 0.27.0 to 0.29.0 (#6502)dependabot[bot]2-3/+3
Bumps [golang.org/x/tools](https://github.com/golang/tools) from 0.27.0 to 0.29.0. - [Release notes](https://github.com/golang/tools/releases) - [Commits](https://github.com/golang/tools/compare/v0.27.0...v0.29.0) --- updated-dependencies: - dependency-name: golang.org/x/tools dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2025-02-03chore(deps): bump github.com/schollz/progressbar/v3 from 3.17.1 to 3.18.0 ↵dependabot[bot]2-3/+3
(#6504) chore(deps): bump github.com/schollz/progressbar/v3 Bumps [github.com/schollz/progressbar/v3](https://github.com/schollz/progressbar) from 3.17.1 to 3.18.0. - [Release notes](https://github.com/schollz/progressbar/releases) - [Commits](https://github.com/schollz/progressbar/compare/v3.17.1...v3.18.0) --- updated-dependencies: - dependency-name: github.com/schollz/progressbar/v3 dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2025-02-03chore(deps): bump github.com/aws/aws-sdk-go-v2 from 1.34.0 to 1.36.0 (#6505)dependabot[bot]2-3/+3
Bumps [github.com/aws/aws-sdk-go-v2](https://github.com/aws/aws-sdk-go-v2) from 1.34.0 to 1.36.0. - [Release notes](https://github.com/aws/aws-sdk-go-v2/releases) - [Changelog](https://github.com/aws/aws-sdk-go-v2/blob/main/changelog-template.json) - [Commits](https://github.com/aws/aws-sdk-go-v2/compare/v1.34.0...v1.36.0) --- updated-dependencies: - dependency-name: github.com/aws/aws-sdk-go-v2 dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2025-02-013.833.83chrislu2-3/+3
2025-02-01adjust fixchrislu2-4/+7
fix https://github.com/seaweedfs/seaweedfs/issues/6497
2025-02-01ensure correct auto bucket creationchrislu1-0/+7
fix https://github.com/seaweedfs/seaweedfs/issues/6497
2025-01-30Remove rate limit semaphore on master's leader selection logic. (#6494)Lisandro Pin1-5/+0
This was introduced by 054374c7 (2024-03-12) and serves no practical purpose, yet it caps the maximum QPS master servers can handle.
2025-01-30Improve EC shards balancing logic regarding replica placement settings. (#6491)Lisandro Pin2-6/+6
The replica placement type specifies numebr of _replicas_ on the same/different rack; that means we can have one EC shard copy on each, even if the replica setting is zero. This PR reworks replica placement parsing for EC rebalancing, so we check allow (replica placement + 1) when selecting racks and nodes to balance EC shards into.
2025-01-29verify if bucket exists in GetBucketLocationHandler (#6485)Tom Crasset1-0/+7
2025-01-29Add content length to filer's requests (#6489)Hadi Zamani1-0/+1
2025-01-29`ec.balance`: Allow EC balancing without collections. (#6488)Lisandro Pin1-4/+4
2025-01-29`ec.encode`: Display a warning on EC balancing if no replica placement ↵Lisandro Pin3-10/+51
settings are found. (#6487)
2025-01-28fix from ensure() before actual deletion, within the b2 client librarychrislu1-1/+8
fix https://github.com/seaweedfs/seaweedfs/issues/6483
2025-01-28return error on invalid action in PutUserPolicy (#6482)Tom Crasset2-0/+26
2025-01-27chore(deps): bump go.etcd.io/etcd/client/v3 from 3.5.17 to 3.5.18 (#6476)dependabot[bot]2-9/+9
Bumps [go.etcd.io/etcd/client/v3](https://github.com/etcd-io/etcd) from 3.5.17 to 3.5.18. - [Release notes](https://github.com/etcd-io/etcd/releases) - [Commits](https://github.com/etcd-io/etcd/compare/v3.5.17...v3.5.18) --- updated-dependencies: - dependency-name: go.etcd.io/etcd/client/v3 dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2025-01-27chore(deps): bump github.com/aws/aws-sdk-go-v2 from 1.33.0 to 1.34.0 (#6478)dependabot[bot]2-6/+6
Bumps [github.com/aws/aws-sdk-go-v2](https://github.com/aws/aws-sdk-go-v2) from 1.33.0 to 1.34.0. - [Release notes](https://github.com/aws/aws-sdk-go-v2/releases) - [Changelog](https://github.com/aws/aws-sdk-go-v2/blob/main/changelog-template.json) - [Commits](https://github.com/aws/aws-sdk-go-v2/compare/v1.33.0...v1.34.0) --- updated-dependencies: - dependency-name: github.com/aws/aws-sdk-go-v2 dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2025-01-27chore(deps): bump docker/build-push-action from 6.12.0 to 6.13.0 (#6481)dependabot[bot]7-7/+7
Bumps [docker/build-push-action](https://github.com/docker/build-push-action) from 6.12.0 to 6.13.0. - [Release notes](https://github.com/docker/build-push-action/releases) - [Commits](https://github.com/docker/build-push-action/compare/67a2d409c0a876cbe6b11854e3e25193efe4e62d...ca877d9245402d1537745e0e356eab47c3520991) --- updated-dependencies: - dependency-name: docker/build-push-action dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2025-01-27chore(deps): bump modernc.org/sqlite from 1.34.4 to 1.34.5 (#6480)dependabot[bot]2-10/+3
Bumps [modernc.org/sqlite](https://gitlab.com/cznic/sqlite) from 1.34.4 to 1.34.5. - [Commits](https://gitlab.com/cznic/sqlite/compare/v1.34.4...v1.34.5) --- updated-dependencies: - dependency-name: modernc.org/sqlite dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2025-01-27chore(deps): bump go.mongodb.org/mongo-driver from 1.17.1 to 1.17.2 (#6479)dependabot[bot]2-3/+3
Bumps [go.mongodb.org/mongo-driver](https://github.com/mongodb/mongo-go-driver) from 1.17.1 to 1.17.2. - [Release notes](https://github.com/mongodb/mongo-go-driver/releases) - [Commits](https://github.com/mongodb/mongo-go-driver/compare/v1.17.1...v1.17.2) --- updated-dependencies: - dependency-name: go.mongodb.org/mongo-driver dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2025-01-27chore(deps): bump google.golang.org/api from 0.216.0 to 0.218.0 (#6477)dependabot[bot]2-30/+30
Bumps [google.golang.org/api](https://github.com/googleapis/google-api-go-client) from 0.216.0 to 0.218.0. - [Release notes](https://github.com/googleapis/google-api-go-client/releases) - [Changelog](https://github.com/googleapis/google-api-go-client/blob/main/CHANGES.md) - [Commits](https://github.com/googleapis/google-api-go-client/compare/v0.216.0...v0.218.0) --- updated-dependencies: - dependency-name: google.golang.org/api dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2025-01-25Add metrics for uploaded and deleted s3 objects (#6475)Hadi Zamani4-1/+24
2025-01-23show error if backend is mis-configuredchrislu2-2/+8
related to https://github.com/seaweedfs/seaweedfs/discussions/6472
2025-01-23Update README.md - space for label creation (#6471)Marc MAURICE1-1/+1
2025-01-22filer store YDB: fix upsert with TTL (#6469)MaratKarimov1-1/+1
2025-01-22cloud tier: support for Alibaba Cloud OSS (#6466)ludwigxia3-5/+22
2025-01-203.823.82chrislu2-3/+3
2025-01-20Add message queue agent (#6463)Chris Lu57-1574/+3814
* scaffold message queue agent * adjust proto, add mq_agent * add agent client implementation * remove unused function * agent publish server implementation * adding agent
2025-01-20Add JWT authentication to fs.mergeVolumes command (#6461)Hadi Zamani1-1/+12
Add jwt authentication to fs.mergeVolumes command