aboutsummaryrefslogtreecommitdiff
AgeCommit message (Collapse)AuthorFilesLines
2022-02-10initial setupchrislu6-0/+175
2022-02-09Merge pull request #2654 from ↵Chris Lu1-1/+1
chrislusf/dependabot/maven/other/java/hdfs3/org.apache.hadoop-hadoop-common-3.1.4 Bump hadoop-common from 3.1.1 to 3.1.4 in /other/java/hdfs3
2022-02-09Merge pull request #2655 from ↵Chris Lu1-1/+1
chrislusf/dependabot/maven/other/java/hdfs-over-ftp/org.apache.hadoop-hadoop-common-3.2.2 Bump hadoop-common from 3.2.1 to 3.2.2 in /other/java/hdfs-over-ftp
2022-02-09Merge pull request #2656 from ↵Chris Lu1-1/+1
chrislusf/dependabot/maven/other/java/hdfs2/org.apache.hadoop-hadoop-common-2.10.1 Bump hadoop-common from 2.9.2 to 2.10.1 in /other/java/hdfs2
2022-02-09Merge pull request #2657 from ↵Chris Lu1-1/+1
chrislusf/dependabot/maven/other/java/examples/org.apache.hadoop-hadoop-common-2.10.1 Bump hadoop-common from 2.9.2 to 2.10.1 in /other/java/examples
2022-02-09Bump hadoop-common from 2.9.2 to 2.10.1 in /other/java/examplesdependabot[bot]1-1/+1
Bumps hadoop-common from 2.9.2 to 2.10.1. --- updated-dependencies: - dependency-name: org.apache.hadoop:hadoop-common dependency-type: direct:production ... Signed-off-by: dependabot[bot] <support@github.com>
2022-02-09Bump hadoop-common from 2.9.2 to 2.10.1 in /other/java/hdfs2dependabot[bot]1-1/+1
Bumps hadoop-common from 2.9.2 to 2.10.1. --- updated-dependencies: - dependency-name: org.apache.hadoop:hadoop-common dependency-type: direct:production ... Signed-off-by: dependabot[bot] <support@github.com>
2022-02-09Bump hadoop-common from 3.2.1 to 3.2.2 in /other/java/hdfs-over-ftpdependabot[bot]1-1/+1
Bumps hadoop-common from 3.2.1 to 3.2.2. --- updated-dependencies: - dependency-name: org.apache.hadoop:hadoop-common dependency-type: direct:production ... Signed-off-by: dependabot[bot] <support@github.com>
2022-02-09Bump hadoop-common from 3.1.1 to 3.1.4 in /other/java/hdfs3dependabot[bot]1-1/+1
Bumps hadoop-common from 3.1.1 to 3.1.4. --- updated-dependencies: - dependency-name: org.apache.hadoop:hadoop-common dependency-type: direct:production ... Signed-off-by: dependabot[bot] <support@github.com>
2022-02-09rocksdb: PORTABLE=1chrislu1-1/+1
2022-02-09add filer.toml for rocksdb to docker image for rocksdbchrislu2-2/+5
2022-02-08ec.encode: calculate free ec slots based on (maxVolumeCount-volumeCount)chrislu1-1/+1
fix https://github.com/chrislusf/seaweedfs/issues/2642
2022-02-08test checking ec distributionchrislu2-0/+33
2022-02-08use embed txtchrislu2-806/+807
2022-02-08volume.tier.move: avoid double countingchrislu1-21/+16
related to https://github.com/chrislusf/seaweedfs/issues/2637
2022-02-08Merge branch 'master' of https://github.com/chrislusf/seaweedfschrislu1-1/+1
2022-02-08volume.balance: add delay during tight loopchrislu16-17/+22
fix https://github.com/chrislusf/seaweedfs/issues/2637
2022-02-08Merge pull request #2646 from kmlebedev/graceTimeoutChris Lu1-1/+1
graceful stop cluster http server default timeout 60 sec
2022-02-08graceful stop cluster http server default timeout 60 secKonstantin Lebedev1-1/+1
https://github.com/chrislusf/seaweedfs/issues/2630
2022-02-07Merge branch 'master' of https://github.com/chrislusf/seaweedfschrislu2-20/+64
2022-02-07filer read empty file may cause OOM in some caseschrislu5-16/+10
fix https://github.com/chrislusf/seaweedfs/issues/2641
2022-02-07Merge pull request #2645 from guol-fnst/fix_PrecedenceChris Lu2-20/+64
fix preconditions
2022-02-08fix preconditions according to ↵root2-20/+64
https://tools.ietf.org/id/draft-ietf-httpbis-p4-conditional-26.html#preconditions
2022-02-07Merge branch 'master' of https://github.com/chrislusf/seaweedfschrislu2-0/+12
2022-02-07s3: avoid nil responsechrislu1-2/+2
fix https://github.com/chrislusf/seaweedfs/issues/2636
2022-02-07Merge pull request #2644 from kmlebedev/vacum_fsyncChris Lu1-0/+9
updated needle with fsync
2022-02-08updated needle with fsyncKonstantin Lebedev1-0/+9
2022-02-07Merge pull request #2643 from kmlebedev/graceful_volume_stopChris Lu1-0/+3
2022-02-07skips compact if store is stoppingKonstantin Lebedev1-0/+3
2022-02-07filer.sync: fix replicating partially updated filechrislu2-1/+16
Run two servers with volumes and fillers: server -dir=Server1alpha -master.port=11000 -filer -filer.port=11001 -volume.port=11002 server -dir=Server1sigma -master.port=11006 -filer -filer.port=11007 -volume.port=11008 Run Active-Passive filler.sync: filer.sync -a localhost:11007 -b localhost:11001 -isActivePassive Upload file to 11007 port: curl -F file=@/Desktop/9.xml "http://localhost:11007/testFacebook/" If we request a file on two servers now, everything will be correct, even if we add data to the file and upload it again: curl "http://localhost:11007/testFacebook/9.xml" EQUALS curl "http://localhost:11001/testFacebook/9.xml" However, if we change the already existing data in the file (for example, we change the first line in the file, reducing its length), then this file on the second server will not be valid and will not be equivalent to the first file Снимок экрана 2022-02-07 в 14 21 11 This problem occurs on line 202 in the filer_sink.go file. In particular, this is due to incorrect mapping of chunk names in the DoMinusChunks function. The names of deletedChunks do not match the chunks of existingEntry.Chunks, since the first chunks come from another server and have a different addressing (name) compared to the addressing on the server where the file is being overwritten. Deleted chunks are not actually deleted on the server to which the file is replicated.
2022-02-04move error to a separate filechrislu5-24/+55
This file contains metric names for all errors The naming convention is ErrorSomeThing = "error.some.thing"
2022-02-04Merge pull request #2634 from kmlebedev/errorMetricsChris Lu3-0/+18
error metrics for filer and store
2022-02-04Merge pull request #2632 from lapshin-vitaly/s3api_errorsChris Lu2-2/+12
add s3api error for copy in file, not directory
2022-02-04add util packagechrislu1-0/+1
2022-02-04change to util.WriteFilechrislu5-6/+7
2022-02-04sync call to write file, avoid vif loading errorchrislu2-1/+18
fix https://github.com/chrislusf/seaweedfs/issues/2633
2022-02-04Merge pull request #2635 from zerospiel/rearrange_handlersChris Lu1-33/+55
2022-02-04weed/s3api: rearrange s3 methods handlers to ensure correct methods requestingzerospiel1-33/+55
Otherwise current calls for some methods (i.e. GetObjectAcl) ends up with wrong method selection (i.e. GetObject). Added generic comment rule of traversing methods
2022-02-04fix metric namesKonstantin Lebedev1-3/+3
2022-02-04error metrics for filer and storeKonstantin Lebedev3-0/+18
2022-02-04add s3api error for copy in file, not directoryLapshinn Vitaly2-2/+12
2022-02-03s3: listObjectParts return ErrNoSuchUpload if does not existchrislu1-0/+4
ubuntu@prod-master-1:~$ aws --endpoint http://10.244.15.66:8333 s3api abort-multipart-upload --bucket prod-cache --key multipart-test --upload-id 5347f936-6adc-43de-8e5c-1fd137c3b2bc ubuntu@prod-master-1:~$ aws --endpoint http://10.244.15.66:8333 s3api list-parts --bucket prod-cache --key multipart-test --upload-id 5347f936-6adc-43de-8e5c-1fd137c3b2bc { "Initiator": null, "Owner": null, "StorageClass": "STANDARD" } If we abort a multipart upload, it appears that records are left behind. We should get a 404 NoSuchKey error.
2022-02-03Merge pull request #2631 from zerospiel/bucket_handlersChris Lu6-22/+107
2022-02-03weed/s3api: added new bucket handlers for more compatibility with AWS S3zerospiel6-22/+107
Protocol Otherwise any requests to the underlying handlers results in calls to ListObjects (v1) that may intensively load gateway and volume servers. Added the following handlers with default responses: - GetBucketLocation - GetBucketRequestPayment Added the following handlers with NotFound and NotImplemented responses: - PutBucketAcl - GetBucketPolicy - PutBucketPolicy - DeleteBucketPolicy - GetBucketCors - PutBucketCors - DeleteBucketCors
2022-02-01[volume.check.disk] fix wrong logic to comparechrislu1-2/+2
fix https://github.com/chrislusf/seaweedfs/issues/2626 minuend - subtrahend
2022-01-302.882.88chrislu2-3/+3
2022-01-30edge case: old entry was not replicated to remote storagechrislu1-1/+1
2022-01-28adjust volume count even when not applying the changeschrislu1-25/+27
2022-01-28Merge pull request #2618 from divanikus/masterChris Lu1-41/+88
2022-01-27remove max connection agechrislu1-3/+2
following https://github.com/grpc/grpc-go/issues/3170#issuecomment-552517779