aboutsummaryrefslogtreecommitdiff
path: root/weed/server
AgeCommit message (Collapse)AuthorFilesLines
2023-02-06volume:fix return if Replicate write error (#4188)Neo1-0/+1
2023-02-01fix null content type caused exception in hdfs clientchrislu1-0/+2
fix https://github.com/seaweedfs/seaweedfs/issues/4170
2023-01-31 make directory lister trigger if mime type is httpd/unix-directory (#4169)a1-1/+3
2023-01-20grpc connection to filer add sw-client-id headerchrislu4-4/+4
2023-01-16use one readerCache for the whole filechrislu1-3/+6
2023-01-09use time.NewTicker instead of time.Tick. (#4119)Guo Lei1-4/+4
2023-01-06Add image cropping. (#4117)monchickey1-6/+47
2023-01-03batch delete EC needleschrislu1-18/+46
fix https://github.com/seaweedfs/seaweedfs/issues/4107
2023-01-02more solid weed mount (#4089)Chris Lu4-19/+19
* compare chunks by timestamp * fix slab clearing error * fix test compilation * move oldest chunk to sealed, instead of by fullness * lock on fh.entryViewCache * remove verbose logs * revert slat clearing * less logs * less logs * track write and read by timestamp * remove useless logic * add entry lock on file handle release * use mem chunk only, swap file chunk has problems * comment out code that maybe used later * add debug mode to compare data read and write * more efficient readResolvedChunks with linked list * small optimization * fix test compilation * minor fix on writer * add SeparateGarbageChunks * group chunks into sections * turn off debug mode * fix tests * fix tests * tmp enable swap file chunk * Revert "tmp enable swap file chunk" This reverts commit 985137ec472924e4815f258189f6ca9f2168a0a7. * simple refactoring * simple refactoring * do not re-use swap file chunk. Sealed chunks should not be re-used. * comment out debugging facilities * either mem chunk or swap file chunk is fine now * remove orderedMutex as *semaphore.Weighted not found impactful * optimize size calculation for changing large files * optimize performance to avoid going through the long list of chunks * still problems with swap file chunk * rename * tiny optimization * swap file chunk save only successfully read data * fix * enable both mem and swap file chunk * resolve chunks with range * rename * fix chunk interval list * also change file handle chunk group when adding chunks * pick in-active chunk with time-decayed counter * fix compilation * avoid nil with empty fh.entry * refactoring * rename * rename * refactor visible intervals to *list.List * refactor chunkViews to *list.List * add IntervalList for generic interval list * change visible interval to use IntervalList in generics * cahnge chunkViews to *IntervalList[*ChunkView] * use NewFileChunkSection to create * rename variables * refactor * fix renaming leftover * renaming * renaming * add insert interval * interval list adds lock * incrementally add chunks to readers Fixes: 1. set start and stop offset for the value object 2. clone the value object 3. use pointer instead of copy-by-value when passing to interval.Value 4. use insert interval since adding chunk could be out of order * fix tests compilation * fix tests compilation
2022-12-28support enable/disable vacuum (#4087)Guo Lei1-1/+16
* stop vacuum * suspend/resume vacuum * remove unused code * rename * rename param
2022-12-17add -filer.path to webdav command (#4061)lfhy1-2/+10
2022-12-11volume server logs add url infochrislu1-1/+1
debug https://github.com/seaweedfs/seaweedfs/issues/3964
2022-12-10Merge branch 'master' of https://github.com/seaweedfs/seaweedfschrislu2-1/+2
2022-12-10add chunk etag when downloading from remote storagechrislu2-1/+7
fix https://github.com/seaweedfs/seaweedfs/issues/3987
2022-12-08Fix hardlink counting (#4042)wusong1-0/+1
Signed-off-by: wusong <wangwusong@virtaitech.com> Signed-off-by: wusong <wangwusong@virtaitech.com> Co-authored-by: wusong <wangwusong@virtaitech.com>
2022-12-07[filer] Fix uri escape during renaming (#4039)Jiffs Maverick1-1/+1
2022-11-23fix: Lost Content-Encoding metadata (#4010)famosss1-0/+4
2022-11-15refactor filer_pb.Entry and filer.Entry to use GetChunks()chrislu7-17/+17
for later locking on reading chunks
2022-11-14Lazy loading (#3958)Guo Lei2-2/+7
* types packages is imported more than onece * lazy-loading * fix bugs * fix bugs * fix unit tests * fix test error * rename function * unload ldb after initial startup * Don't load ldb when starting volume server if ldbtimeout is set. * remove uncessary unloadldb * Update weed/command/server.go Co-authored-by: Chris Lu <chrislusf@users.noreply.github.com> * Update weed/command/volume.go Co-authored-by: Chris Lu <chrislusf@users.noreply.github.com> Co-authored-by: guol-fnst <goul-fnst@fujitsu.com> Co-authored-by: Chris Lu <chrislusf@users.noreply.github.com>
2022-11-13file name escape urichrislu1-2/+2
fix https://github.com/seaweedfs/seaweedfs/issues/3969
2022-10-28refactor filer proto chunk variable from mtime to modified_ts_nschrislu1-4/+4
2022-10-24ADHOC: volume fsck using append at ns (#3906)Eric Yang1-0/+1
* ADHOC: volume fsck using append at ns * nit * nit Co-authored-by: root <root@HQ-10MSTD3EY.roblox.local>
2022-10-19add md5 header when UploadData to replication in ReplicatedWrite (#3881)liubaojiang1-1/+1
2022-10-16shell: volume.move handles volume moved to cloud tierchrislu1-18/+28
fix https://github.com/seaweedfs/seaweedfs/issues/3803
2022-10-14avoid load volume file with BytesOffset mismatch (#3841)Konstantin Lebedev2-4/+4
* avoid load volume file with BytesOffset mismatch https://github.com/seaweedfs/seaweedfs/issues/2966 * set BytesOffset if has not VolumeInfoFile * typos fail => failed * exit if bytesOffset mismatch
2022-10-13vacuum metrics and force sync dst files (#3832)Konstantin Lebedev1-4/+17
2022-10-12filer: get directory metadata (#3833)zemul1-2/+7
2022-10-11split `ExtAcpKey` to `ExtAmzOwnerKey` and `ExtAmzAclKey` to avoid unn… (#3824)LHHDZ1-4/+10
split `ExtAcpKey` to `ExtAmzOwnerKey` and `ExtAmzAclKey` to avoid unnecessary `json.Unmarshal()` call Signed-off-by: changlin.shi <changlin.shi@ly.com> Signed-off-by: changlin.shi <changlin.shi@ly.com>
2022-10-07metric shows who is currently blocking the cluster or not (#3799)Konstantin Lebedev2-0/+5
* master_admin_lock Shows whether cluster is locked now or not https://github.com/seaweedfs/seaweedfs/issues/3452 * fix metric MasterAdminLock
2022-10-07configure raft metrics (#3798)Konstantin Lebedev1-0/+16
2022-10-06master server graceful stop (#3797)Konstantin Lebedev1-11/+26
2022-10-06show raft leader via shell (#3796)Konstantin Lebedev1-0/+2
2022-09-29s3: sync bucket info from filer (#3759)LHHDZ1-0/+7
2022-09-28[volume] Add new volumes to HUP(reload) signal (#3755)Konstantin Lebedev1-0/+5
Add new volumes to HUP(reload) signal
2022-09-27Allow CORS on Filer (#3750)jerebear121-11/+24
Adjusted filer response headers
2022-09-20grpc: watch metadata changes by directorychrislu1-0/+11
2022-09-18adjust logschrislu1-1/+1
2022-09-17volume server: rename readBufferSize to readBufferSizeMBchrislu2-4/+4
2022-09-16mute log filer: no entry is found in filer store (#3707)Konstantin Lebedev1-0/+2
2022-09-16volume: add "readBufSize" option to customize read optimization (#3702)famosss2-2/+6
* simplify a bit * feat: volume: add "readBufSize" option to customize read optimization * refactor : redbufSIze -> readBufferSize * simplify a bit * simplify a bit
2022-09-15refactor(raft_hashicorp): `timeSpeep` -> `timeSleep` (#3694)Ryan Russell1-3/+3
Signed-off-by: Ryan Russell <git@ryanrussell.org> Signed-off-by: Ryan Russell <git@ryanrussell.org>
2022-09-15refactor(master_grpc_server_cluster): `seletedSet` -> `selectedSet` (#3693)Ryan Russell1-4/+4
Signed-off-by: Ryan Russell <git@ryanrussell.org> Signed-off-by: Ryan Russell <git@ryanrussell.org>
2022-09-15Merge branch 'master' of https://github.com/seaweedfs/seaweedfschrislu1-3/+3
2022-09-15volume: add "hasSlowRead" option to customize read optimizationchrislu2-0/+4
2022-09-15refactor(volume_grpc_client_to_master): `grpcConection` -> `grpcConne… (#3690)Ryan Russell1-3/+3
refactor(volume_grpc_client_to_master): `grpcConection` -> `grpcConnection` Signed-off-by: Ryan Russell <git@ryanrussell.org> Signed-off-by: Ryan Russell <git@ryanrussell.org>
2022-09-14go fmtchrislu1-8/+8
2022-09-14master: implement grpc VolumeMarkWritablechrislu2-19/+69
fix https://github.com/seaweedfs/seaweedfs/issues/3657
2022-09-14refactor(webdav_server): `modifiledTime` -> `modifiedTime` (#3676)Ryan Russell1-5/+5
Signed-off-by: Ryan Russell <git@ryanrussell.org> Signed-off-by: Ryan Russell <git@ryanrussell.org>
2022-09-14refactor(server): `suppported` -> `supported` (#3677)Ryan Russell2-2/+2
Signed-off-by: Ryan Russell <git@ryanrussell.org> Signed-off-by: Ryan Russell <git@ryanrussell.org>
2022-09-14rename variablechrislu1-4/+4