aboutsummaryrefslogtreecommitdiff
path: root/weed/shell
AgeCommit message (Collapse)AuthorFilesLines
2023-02-07ADHOC: s3 bucket name verification (#4189)Eric Yang2-0/+59
* ADHOC: s3 bucket name verification * add test
2023-02-05adding support for B2 region (#4177)Muhammad Hallaj bin Subery1-0/+1
Co-authored-by: Muhammad Hallaj bin Subery <hallaj@tuta.io>
2023-01-29skipping manifest chunk volume id changechrislu1-0/+4
2023-01-29add fs.meta.changeVolumeIdchrislu1-0/+121
2023-01-28fix index (#4158)Guo Lei1-1/+1
2023-01-20grpc connection to filer add sw-client-id headerchrislu3-6/+6
2023-01-12sort chunks by offsetchrislu1-0/+6
2023-01-10cluster.ps add filer meta sync progresschrislu1-0/+21
2023-01-02more solid weed mount (#4089)Chris Lu2-2/+2
* compare chunks by timestamp * fix slab clearing error * fix test compilation * move oldest chunk to sealed, instead of by fullness * lock on fh.entryViewCache * remove verbose logs * revert slat clearing * less logs * less logs * track write and read by timestamp * remove useless logic * add entry lock on file handle release * use mem chunk only, swap file chunk has problems * comment out code that maybe used later * add debug mode to compare data read and write * more efficient readResolvedChunks with linked list * small optimization * fix test compilation * minor fix on writer * add SeparateGarbageChunks * group chunks into sections * turn off debug mode * fix tests * fix tests * tmp enable swap file chunk * Revert "tmp enable swap file chunk" This reverts commit 985137ec472924e4815f258189f6ca9f2168a0a7. * simple refactoring * simple refactoring * do not re-use swap file chunk. Sealed chunks should not be re-used. * comment out debugging facilities * either mem chunk or swap file chunk is fine now * remove orderedMutex as *semaphore.Weighted not found impactful * optimize size calculation for changing large files * optimize performance to avoid going through the long list of chunks * still problems with swap file chunk * rename * tiny optimization * swap file chunk save only successfully read data * fix * enable both mem and swap file chunk * resolve chunks with range * rename * fix chunk interval list * also change file handle chunk group when adding chunks * pick in-active chunk with time-decayed counter * fix compilation * avoid nil with empty fh.entry * refactoring * rename * rename * refactor visible intervals to *list.List * refactor chunkViews to *list.List * add IntervalList for generic interval list * change visible interval to use IntervalList in generics * cahnge chunkViews to *IntervalList[*ChunkView] * use NewFileChunkSection to create * rename variables * refactor * fix renaming leftover * renaming * renaming * add insert interval * interval list adds lock * incrementally add chunks to readers Fixes: 1. set start and stop offset for the value object 2. clone the value object 3. use pointer instead of copy-by-value when passing to interval.Value 4. use insert interval since adding chunk could be out of order * fix tests compilation * fix tests compilation
2022-12-29add more help message, in case of misunderstanding (#4092)Guo Lei2-2/+2
2022-12-28support enable/disable vacuum (#4087)Guo Lei2-0/+82
* stop vacuum * suspend/resume vacuum * remove unused code * rename * rename param
2022-12-21fs.verify needles status of file (#4060)Konstantin Lebedev1-0/+177
* fs.verify needles status of file * fix parse args * refactor logging * set modifyTimeAgoAtSec
2022-11-30volume.list show volumes only from the specified dc/rack/dn (#4024)Konstantin Lebedev1-0/+15
2022-11-20ADHOC: fix fs.meta.save typo (#3993)Eric Yang1-1/+1
Co-authored-by: root <root@HQ-10MSTD3EY.roblox.local>
2022-11-15refactor filer_pb.Entry and filer.Entry to use GetChunks()chrislu5-6/+6
for later locking on reading chunks
2022-10-31[volume.fsck] collect ids without cut off time for finding missing data from ↵Konstantin Lebedev1-5/+5
volumes (#3934) collect all file ids from the file without cut off time for finding missing data from volumes
2022-10-31[volume.fsck] param volumeId is comma separated the volume id (#3933)Konstantin Lebedev1-7/+19
volume.fsck param volumeId is comma separated the volume id Co-authored-by: Chris Lu <chrislusf@users.noreply.github.com>
2022-10-31[volume.fsck] check needles status from volume server (#3926)Konstantin Lebedev2-23/+38
check needles status from volume server
2022-10-30[volume.chek.disk] sync of deletions the fix (#3923)Konstantin Lebedev2-14/+46
* sync of deletions the fix * avoid return if only partiallyDeletedNeedles * refactor sync deletions
2022-10-28Merge branch 'master' of https://github.com/seaweedfs/seaweedfschrislu2-6/+40
2022-10-28refactor filer proto chunk variable from mtime to modified_ts_nschrislu1-1/+1
2022-10-28[voluche.chek.disk] needles older than the cutoff time are not missing yet ↵Konstantin Lebedev2-6/+40
(#3922) needles older than the cutoff time are not missing yet https://github.com/seaweedfs/seaweedfs/issues/3919
2022-10-25avoid fix missing of deleted needles (#3909)Konstantin Lebedev1-1/+1
2022-10-24ADHOC: volume fsck using append at ns (#3906)Eric Yang1-16/+4
* ADHOC: volume fsck using append at ns * nit * nit Co-authored-by: root <root@HQ-10MSTD3EY.roblox.local>
2022-10-24keep system log datachrislu1-7/+3
2022-10-24adjust help messagechrislu1-1/+1
2022-10-16shell: volume.tier.upload clean up replicated copieschrislu1-5/+18
fix https://github.com/seaweedfs/seaweedfs/issues/3804
2022-10-15[volume.fsck] hotfix apply purging and add option verifyNeedle #3860 (#3861)Konstantin Lebedev2-9/+36
* fix apply purging and add verifyNeedle * common readSourceNeedleBlob * use consts
2022-10-13Volume fsck by volume (#3851)Konstantin Lebedev1-279/+241
* refactor * refactor args verbose and writer * refactor readFilerFileIdFile * fix filter by collectMtime * skip system log collection
2022-10-13remove unused ReadNeedleBlobRequest.needle_idchrislu1-1/+0
fix https://github.com/seaweedfs/seaweedfs/issues/3853
2022-10-09tests add parsing ec shard infochrislu2-0/+107635
2022-10-09include ec shard for capacityByFreeVolumeCountchrislu1-1/+5
2022-10-09move volume: find target volume server by exiting/max ratiochrislu1-2/+7
2022-10-09refactorchrislu1-2/+4
2022-10-09parsing ec volumeschrislu1-0/+24
2022-10-09Merge branch 'master' of https://github.com/seaweedfs/seaweedfschrislu1-1/+5
2022-10-09refactor to change capacity data typechrislu2-13/+9
2022-10-06show raft leader via shell (#3796)Konstantin Lebedev1-1/+5
2022-09-29ADHOC: filter deleted files from idx file binary search (#3763)Eric Yang1-3/+15
* ADHOC: filter deleted files from idx file binary search * remove unwanted check Co-authored-by: root <root@HQ-10MSTD3EY.roblox.local>
2022-09-27fs.meta.load load any dirs with prefix "important" (#3747)Konstantin Lebedev1-1/+15
* fs.meta.load load any dirs with prefix "important" * replace dirPattern to dirPrefix * help dirPrefix
2022-09-27skip truncation on errorchrislu1-2/+3
fix https://github.com/seaweedfs/seaweedfs/issues/3746
2022-09-16refactor(shell): readability improvements (#3704)Ryan Russell5-5/+5
Signed-off-by: Ryan Russell <git@ryanrussell.org> Signed-off-by: Ryan Russell <git@ryanrussell.org>
2022-09-14go fmtchrislu4-91/+111
2022-09-14refactor(command_ec_rebuild): `rebultErr` -> `rebuildErr` (#3679)Ryan Russell1-3/+3
Signed-off-by: Ryan Russell <git@ryanrussell.org> Signed-off-by: Ryan Russell <git@ryanrussell.org>
2022-09-14refactor(shell): `Decending` -> `Descending` (#3675)Ryan Russell4-5/+5
Signed-off-by: Ryan Russell <git@ryanrussell.org> Signed-off-by: Ryan Russell <git@ryanrussell.org>
2022-09-14refactor(command_ec_decode): `exisitngEcIndexBits` -> `existingEcInde… (#3674)Ryan Russell1-4/+4
refactor(command_ec_decode): `exisitngEcIndexBits` -> `existingEcIndexBits` Signed-off-by: Ryan Russell <git@ryanrussell.org> Signed-off-by: Ryan Russell <git@ryanrussell.org>
2022-09-14refactor(command_fs_rm): `entiries` -> `entries` (#3670)Ryan Russell1-4/+4
Signed-off-by: Ryan Russell <git@ryanrussell.org> Signed-off-by: Ryan Russell <git@ryanrussell.org>
2022-09-14refactor: `Directory` readability (#3665)Ryan Russell1-2/+2
2022-09-14refactor(socket mount): Update socket mount pattern to `/tmp/seaweedf… (#3662)Ryan Russell1-1/+1
2022-09-10Merge branch 'master' of https://github.com/seaweedfs/seaweedfschrislu1-15/+40