aboutsummaryrefslogtreecommitdiff
path: root/weed/s3api
AgeCommit message (Collapse)AuthorFilesLines
2024-09-17refactorchrislu1-2/+1
2024-09-09more consistent server header for s3 apischrislu1-1/+2
2024-09-04[s3] reducing the number of metrics for 403 (#5961)Konstantin Lebedev1-4/+1
reducing the number of metrics
2024-08-21also use `/healthz` for most consistent health checkchrislu1-1/+2
2024-08-18Dont try lazy decode content in proxyToFiler if no accept-encoding provided ↵Oleg Salionov1-0/+1
(#5907)
2024-08-09added access-control-expose-headers to put request (#5876)Kamran Sarwar1-0/+1
2024-07-20get, set and add path confchrislu1-1/+5
2024-07-16Added tls for http clients (#5766)vadimartynov5-15/+17
* Added global http client * Added Do func for global http client * Changed the code to use the global http client * Fix http client in volume uploader * Fixed pkg name * Fixed http util funcs * Fixed http client for bench_filer_upload * Fixed http client for stress_filer_upload * Fixed http client for filer_server_handlers_proxy * Fixed http client for command_fs_merge_volumes * Fixed http client for command_fs_merge_volumes and command_volume_fsck * Fixed http client for s3api_server * Added init global client for main funcs * Rename global_client to client * Changed: - fixed NewHttpClient; - added CheckIsHttpsClientEnabled func - updated security.toml in scaffold * Reduce the visibility of some functions in the util/http/client pkg * Added the loadSecurityConfig function * Use util.LoadSecurityConfiguration() in NewHttpClient func
2024-07-10[s3] revert skip deletion error, since the error file was not found is ↵Konstantin Lebedev1-5/+7
already skipped on the side of the grpc function (#5760) * revert skip deletion error, since the error file was not found is already skipped on the side of the grpc function * fix response error * fix test_lifecycle_get * Revert "fix test_lifecycle_get" This reverts commit 8f991bdcf93d9a13c7787988173713ad1a263bae.
2024-07-08simplifychrislu1-5/+2
2024-07-08Fix S3 deletion in deep folders, and names with empty spaceschrislu1-2/+3
fix https://github.com/seaweedfs/seaweedfs/issues/5748
2024-07-04add s3test for sql (#5718)Konstantin Lebedev9-365/+939
* add s3test for sql * fix test test_bucket_listv2_delimiter_basic for s3 * fix action s3tests * regen s3 api xsd * rm minor s3 test test_bucket_listv2_fetchowner_defaultempty * add docs * without xmlns
2024-07-01refactor all methods strings to const (#5726)Konstantin Lebedev4-59/+59
2024-06-04fix(s3api): make post api upload object default return 204 (#5648)Lê Hoàng Nam1-1/+3
2024-05-17added s3 iam DeleteBucket permission management (#5599)Riccardo Bertossa6-14/+36
2024-05-07also delete parent folder if emptychrislu1-1/+1
fix https://github.com/seaweedfs/seaweedfs/issues/5567
2024-04-29AllowEmptyFolder checks during object deletionchrislu2-10/+30
2024-04-29split filechrislu3-359/+387
2024-04-29rename fileschrislu7-0/+0
2024-04-27[s3] Put bucket lifecycle configuration (#5510)Konstantin Lebedev2-10/+145
2024-04-14[s3] fix s3 test_multipart_get_part (#5476)Konstantin Lebedev3-5/+23
* try fix s3 test_multipart_get_part * add passed s3 tests * fix SeaweedFSUploadId * rm spaces * convert part request to range * add passed s3 tests of multipart
2024-04-08chore: fix function names in comment (#5478)clonefetch3-3/+3
2024-04-07[s3] add s3 pass test_multipart_upload_size_too_small (#5475)Konstantin Lebedev1-6/+22
* add s3 pass test_multipart_upload_size_too_small * refactor metric names * return ErrNoSuchUpload if empty parts * fix test
2024-04-07[s3] add s3 pass test_multipart_upload (#5474)Konstantin Lebedev2-17/+41
add s3 pass test_multipart_upload
2024-04-06[s3] fix s3 test_multipart_resend_first_finishes_last (#5471)Konstantin Lebedev2-146/+84
* try fix s3 test https://github.com/seaweedfs/seaweedfs/pull/5466 * add error handler metrics * refactor * refactor multipartExt * delete bad entry parts
2024-04-04fix: correctly form partNumber from new entry.Name format in ↵Nikita Borzykh1-1/+7
"listObjectParts" (#5470)
2024-04-02fix completed multiupload lost data (#5460)skycope3-31/+66
If there are putObjectPart requests with the same uploadId during completeMultiPart, it can result in data loss. putObjectPart requests might be due to timeout retries. Co-authored-by: Yang Wang <yangwang@weride.ai>
2024-04-01fix: ensure complete gRPC stream consumption in doListFilerEntries to ↵Nikita Borzykh1-1/+1
prevent context canceled errors. (#5441)
2024-03-22fix s3api: delimeter properly takes prefixes into account (#5411)adasauce1-5/+9
2024-03-07[filer.backup] add param uploader_part_size for S3sink (#5352)Konstantin Lebedev1-0/+1
* fix: install cronie * chore: refactor configure S3Sink * chore: refactor cinfig * add filer-backup compose file * fix: X-Amz-Meta-Mtime and resolve with comments * fix: attr mtime * fix: MaxUploadPartst is reduced to the maximum allowable * fix: env and force set max MaxUploadParts * fix: env WEED_SINK_S3_UPLOADER_PART_SIZE_MB
2024-03-06feat: add support for S3 ListObjects and ListObjectsV2 (#5350)adasauce1-23/+44
2024-02-19refactor: put the auth outside (#5313)7y-92-8/+2
2024-02-19fix: only admin auth can delete S3 bucket (#5312)7y-91-1/+1
2024-02-05Add s3 postpolicy support header (#5280)sxlehua1-0/+13
* Add s3 postpolicy support header * optimized code
2024-02-03Adapt S3 POST ContentType (#5275)sxlehua1-9/+20
2024-01-10chore: add status code for request_total metrics (#5188)Konstantin Lebedev1-19/+1
2024-01-03Fix missing VersionConfiguration node in get-bucket-versioning response (#5162)Konstantin Lebedev1-4/+5
* fix: s3 response for get bucket version https://github.com/seaweedfs/seaweedfs/issues/5155 * fix: s3 response for get bucket version https://github.com/seaweedfs/seaweedfs/issues/5155
2023-12-22Merge branch 'master' of https://github.com/seaweedfs/seaweedfschrislu2-5/+37
2023-12-22minorchrislu1-1/+1
2023-12-20Set allowed origins in config (#5109)jerebear122-5/+37
* Add a way to use a JWT in an HTTP only cookie If a JWT is not included in the Authorization header or a query string, attempt to get a JWT from an HTTP only cookie. * Added a way to specify allowed origins header from config * Removed unecessary log * Check list of domains from config or command flag * Handle default wildcard and change name of config value to cors
2023-11-13s3 api add not implemented response for PutBucketVersioningKonstantin Lebedev2-0/+7
2023-11-13s3 api add default response for GetBucketVersioningKonstantin Lebedev2-0/+20
2023-10-19fixchrislu1-1/+1
2023-10-18[s3] do reload s3 static config (#4923)Konstantin Lebedev1-0/+11
* do reload s3 config * print error on reload s3 config * print success msg * Update weed/s3api/s3api_server.go --------- Co-authored-by: Konstantin Lebedev <9497591+kmlebedev@users.noreply.github.co> Co-authored-by: Chris Lu <chrislusf@users.noreply.github.com>
2023-10-13disconnect from old subscriberschrislu1-3/+2
2023-10-05handle wrapped errorschrislu1-1/+2
2023-10-05minorchrislu1-1/+5
2023-10-01RetryForever => RetryUntilchrislu1-1/+1
2023-09-25Revert "Revert "Merge branch 'master' of ↵chrislu2-4/+4
https://github.com/seaweedfs/seaweedfs"" This reverts commit 8cb42c39
2023-09-25[s3acl] Step1: move s3account.AccountManager into to iam.S3ApiConfiguration ↵Konstantin Lebedev11-191/+238
(#4859) * move s3account.AccountManager into to iam.S3ApiConfiguration and switch to Interface https://github.com/seaweedfs/seaweedfs/issues/4519 * fix: test bucket acl default and adjust the variable names * fix: s3 api config test --------- Co-authored-by: Konstantin Lebedev <9497591+kmlebedev@users.noreply.github.co> Co-authored-by: Chris Lu <chrislusf@users.noreply.github.com>