aboutsummaryrefslogtreecommitdiff
path: root/weed/shell
AgeCommit message (Collapse)AuthorFilesLines
2023-09-25fix(ec): volumes created by foreign collection due to bug in ec balance (#4864)Tobias Gurtzick1-6/+10
* fix(ec): ignore 0 byte data files refers to parts of #4861 Signed-off-by: Tobias Gurtzick <magic@wizardtales.com> * fix(ec): ignore volumes not from the current collection during balance fixes #4861 Signed-off-by: Tobias Gurtzick <magic@wizardtales.com> --------- Signed-off-by: Tobias Gurtzick <magic@wizardtales.com>
2023-09-25Revert "Revert "Merge branch 'master' of ↵chrislu8-35/+36
https://github.com/seaweedfs/seaweedfs"" This reverts commit 8cb42c39
2023-09-24create topic and report topicorigin/subchrislu1-13/+16
2023-09-24do create topicchrislu1-1/+3
2023-09-24add CreateTopic APIchrislu2-2/+100
2023-09-18Revert "Merge branch 'master' of https://github.com/seaweedfs/seaweedfs"chrislu8-36/+35
This reverts commit 2e5aa06026750c99ea283181974d2ccfe5eb0468, reversing changes made to 4d414f54a224142f3f4d934f4af3b5dceb6fec6b.
2023-09-18Bump github.com/rclone/rclone from 1.63.1 to 1.64.0 (#4850)dependabot[bot]8-35/+36
* Bump github.com/rclone/rclone from 1.63.1 to 1.64.0 Bumps [github.com/rclone/rclone](https://github.com/rclone/rclone) from 1.63.1 to 1.64.0. - [Release notes](https://github.com/rclone/rclone/releases) - [Changelog](https://github.com/rclone/rclone/blob/master/RELEASE.md) - [Commits](https://github.com/rclone/rclone/compare/v1.63.1...v1.64.0) --- updated-dependencies: - dependency-name: github.com/rclone/rclone dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> * API changes * go mod --------- Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: Chris Lu <chrislusf@users.noreply.github.com> Co-authored-by: chrislu <chris.lu@gmail.com>
2023-08-24Implement SRV lookups for filer (#4767)Nico D'Cotta1-1/+1
2023-08-19Fix s3.clean.uploads (#4766)SmsS41-9/+6
2023-08-08added an error messagechrislu1-0/+2
2023-08-01minor (#4723)wusong1-2/+2
2023-07-06clone volume locations in case they are changedchrislu4-5/+5
fix https://github.com/seaweedfs/seaweedfs/issues/4642
2023-06-19minorchrislu1-1/+1
2023-06-19remove unused cluster node leaderchrislu1-3/+0
2023-06-14avoid data race read volume.IsEmpty (#4574)柏杰1-1/+2
* avoid data race read volume.IsEmpty - avoid phantom read isEmpty for onlyEmpty - use `v.DataBackend.GetStat()` in v.dataFileAccessLock scope * add Destroy(onlyEmpty: true) test * add Destroy(onlyEmpty: false) test * remove unused `IsEmpty()` * change literal `8` to `SuperBlockSize`
2023-06-12Delete volume is empty (#4561)Konstantin Lebedev7-9/+12
* use onlyEmpty for deleteVolume https://github.com/seaweedfs/seaweedfs/issues/4559 * fix IsEmpty * fix test --------- Co-authored-by: Konstantin Lebedev <9497591+kmlebedev@users.noreply.github.co>
2023-06-06fix: deletes newly created volumes (#4551)Konstantin Lebedev1-1/+1
https://github.com/seaweedfs/seaweedfs/issues/4531 Co-authored-by: Konstantin Lebedev <9497591+kmlebedev@users.noreply.github.co>
2023-05-19support swift (#4480)mervynzhang1-0/+1
2023-05-16Use filerGroup for s3 buckets collection prefix (#4465)SmsS44-3/+10
* Use filerGroup for s3 buckets collection prefix * Fix templates * Remove flags * Remove s3CollectionPrefix
2023-05-04fix shell volume.balance bug (#4447)themarkchen2-24/+93
2023-04-22reset local file content if remote file is updatedchrislu1-0/+3
fix https://github.com/seaweedfs/seaweedfs/issues/4289
2023-04-10adjusted regex to be from 1 to 255 for the value (#4377)Matt1-2/+2
* compatibility patch for csi driver * added namespace to all component parameters * added namespace to all component parameters * dereference in range * added namespace to values.yml defaults * added namespace to s3 component * added helm chart to github pages * added helm chart to github pages * added helm chart to github pages * added helm chart to github pages * added helm chart to github pages * push on all tags * push on all tags * push on all tags * push on all tags * push on all tags * changed helm directory structure * update charts location * fixed dereference * updated permissions * updated permissions * match current action schema * added helm chart liniting CI * modified chart list changed * fixed nodejs warning * standardized a few defaults * added chart dirs * lowerd period seconds for volume startup to test chart lint changes * lowerd period seconds for volume startup to test chart lint changes * test * changed back * adjustment * debug ls statment * removed change detection * remvoed change detection * always lint the charts * added missing ) * fixed typo * added spaces in front of all comments * pdated values.yaml * pdated values.yaml * don't validate maintainers for now * update helm_ci.yml * update helm_ci.yml * update helm_ci.yml * update helm_ci.yml * update helm_ci.yml * - adds helm chart lint on changes - adds test helm chart install on k8s * updated helm chart readme.md * added artifact hub * added artifact hub * added ttl validation * adjusted regex to be from 1 to 255 for the value * added better error message * fixed regex
2023-04-04File Path Configuration TTL Validation (#4376)Matt1-1/+12
* compatibility patch for csi driver * added namespace to all component parameters * added namespace to all component parameters * dereference in range * added namespace to values.yml defaults * added namespace to s3 component * added helm chart to github pages * added helm chart to github pages * added helm chart to github pages * added helm chart to github pages * added helm chart to github pages * push on all tags * push on all tags * push on all tags * push on all tags * push on all tags * changed helm directory structure * update charts location * fixed dereference * updated permissions * updated permissions * match current action schema * added helm chart liniting CI * modified chart list changed * fixed nodejs warning * standardized a few defaults * added chart dirs * lowerd period seconds for volume startup to test chart lint changes * lowerd period seconds for volume startup to test chart lint changes * test * changed back * adjustment * debug ls statment * removed change detection * remvoed change detection * always lint the charts * added missing ) * fixed typo * added spaces in front of all comments * pdated values.yaml * pdated values.yaml * don't validate maintainers for now * update helm_ci.yml * update helm_ci.yml * update helm_ci.yml * update helm_ci.yml * update helm_ci.yml * - adds helm chart lint on changes - adds test helm chart install on k8s * updated helm chart readme.md * added artifact hub * added artifact hub * added ttl validation
2023-03-26adjust namechrislu1-1/+1
2023-03-19cleaning variableschrislu2-0/+9
2023-03-19Fs.verify.concurrency (#4293)Konstantin Lebedev1-20/+59
* init * refactor * refactor print msg * param just concurrency * fix race * next fix race * reset variables before each run * clean --------- Co-authored-by: Konstantin Lebedev <9497591+kmlebedev@users.noreply.github.co> Co-authored-by: Chris Lu <chrislusf@users.noreply.github.com>
2023-03-14fix namingchrislu1-1/+1
fix https://github.com/seaweedfs/seaweedfs/issues/4305
2023-03-13fix testschrislu1-1/+6
2023-03-13shell script unclean variables (#4298)Konstantin Lebedev1-17/+12
2023-03-02 fix chunk.ModifiedTsNs (#4264)zemul1-0/+1
* fix * fix mtime s > ns --------- Co-authored-by: zemul <zhouzemiao@ihuman.com>
2023-02-22volume.fix.replication: adjust the retry checking timeschrislu1-1/+1
2023-02-21Updated the deprecated ioutil dependency (#4239)Zachary Walters1-3/+2
2023-02-10avoid infinite loopchrislu1-1/+1
fix https://github.com/seaweedfs/seaweedfs/issues/4195#issuecomment-1426100904
2023-02-10adjust textchrislu1-1/+1
2023-02-10add line returnchrislu1-1/+1
2023-02-10fix compilationchrislu1-0/+1
2023-02-10add some error messages for argschrislu1-0/+6
related to https://github.com/seaweedfs/seaweedfs/issues/4115
2023-02-09do not move cloud tier volumeschrislu1-0/+4
fix https://github.com/seaweedfs/seaweedfs/issues/4195
2023-02-09fix bug when vid not foundchrislu1-1/+1
fix https://github.com/seaweedfs/seaweedfs/issues/4193
2023-02-07refactoringchrislu2-57/+3
2023-02-07ADHOC: s3 bucket name verification (#4189)Eric Yang2-0/+59
* ADHOC: s3 bucket name verification * add test
2023-02-05adding support for B2 region (#4177)Muhammad Hallaj bin Subery1-0/+1
Co-authored-by: Muhammad Hallaj bin Subery <hallaj@tuta.io>
2023-01-29skipping manifest chunk volume id changechrislu1-0/+4
2023-01-29add fs.meta.changeVolumeIdchrislu1-0/+121
2023-01-28fix index (#4158)Guo Lei1-1/+1
2023-01-20grpc connection to filer add sw-client-id headerchrislu3-6/+6
2023-01-12sort chunks by offsetchrislu1-0/+6
2023-01-10cluster.ps add filer meta sync progresschrislu1-0/+21
2023-01-02more solid weed mount (#4089)Chris Lu2-2/+2
* compare chunks by timestamp * fix slab clearing error * fix test compilation * move oldest chunk to sealed, instead of by fullness * lock on fh.entryViewCache * remove verbose logs * revert slat clearing * less logs * less logs * track write and read by timestamp * remove useless logic * add entry lock on file handle release * use mem chunk only, swap file chunk has problems * comment out code that maybe used later * add debug mode to compare data read and write * more efficient readResolvedChunks with linked list * small optimization * fix test compilation * minor fix on writer * add SeparateGarbageChunks * group chunks into sections * turn off debug mode * fix tests * fix tests * tmp enable swap file chunk * Revert "tmp enable swap file chunk" This reverts commit 985137ec472924e4815f258189f6ca9f2168a0a7. * simple refactoring * simple refactoring * do not re-use swap file chunk. Sealed chunks should not be re-used. * comment out debugging facilities * either mem chunk or swap file chunk is fine now * remove orderedMutex as *semaphore.Weighted not found impactful * optimize size calculation for changing large files * optimize performance to avoid going through the long list of chunks * still problems with swap file chunk * rename * tiny optimization * swap file chunk save only successfully read data * fix * enable both mem and swap file chunk * resolve chunks with range * rename * fix chunk interval list * also change file handle chunk group when adding chunks * pick in-active chunk with time-decayed counter * fix compilation * avoid nil with empty fh.entry * refactoring * rename * rename * refactor visible intervals to *list.List * refactor chunkViews to *list.List * add IntervalList for generic interval list * change visible interval to use IntervalList in generics * cahnge chunkViews to *IntervalList[*ChunkView] * use NewFileChunkSection to create * rename variables * refactor * fix renaming leftover * renaming * renaming * add insert interval * interval list adds lock * incrementally add chunks to readers Fixes: 1. set start and stop offset for the value object 2. clone the value object 3. use pointer instead of copy-by-value when passing to interval.Value 4. use insert interval since adding chunk could be out of order * fix tests compilation * fix tests compilation
2022-12-29add more help message, in case of misunderstanding (#4092)Guo Lei2-2/+2