aboutsummaryrefslogtreecommitdiff
path: root/weed/filer
AgeCommit message (Collapse)AuthorFilesLines
2025-06-19ydb filer improvements (#6890)SmoothDenis5-151/+216
* fix(ydb): table creation with params * fix(ydb): migrate to new query client & prevent creation table-bucket on get request * fix(ydb): use new query client with kv req * fix(ydb): use directory in every query * fix(ydb): del unused import * fix(ydb): tests & default const usage
2025-06-16filer store: fix nil for mongodb (#6886)Chris Lu1-6/+14
fix https://github.com/seaweedfs/seaweedfs/issues/6885
2025-06-11fix rocksdb enumerate (#6858)Bruce Zou2-11/+86
2025-05-29Fix TTL Behavior for Directories in Path-Specific Configuration (#6827)FQHSLycopene1-0/+4
2025-05-28Add context with request (#6824)Aleksey Kosov13-71/+79
2025-05-22Fix mysql tls enable (#6807)bwlfhu1-3/+41
2025-05-22added context to filer_client method calls (#6808)Aleksey Kosov1-5/+6
Co-authored-by: akosov <a.kosov@kryptonite.ru>
2025-05-12fix: ydb filer bugs (#6778)SmoothDenis1-20/+72
* fix: ydb filer bugs * fix(ydb): correct DeleteEntry log argument types * fix(ydb): bucket creation & deletion logic
2025-05-11Add prefix listing in mongodb_store.go (#6777)Kuzmin Anton1-7/+16
2025-05-04feat(redis): add mTLS support for Redis connection initialization (#6738)Jade Devin Cabatlao2-12/+102
* feat(redis): add mTLS support for Redis connection initialization - Enhanced the Redis2Store initialization to support mutual TLS (mTLS) by adding configuration options for CA certificate, client certificate, and client key paths. - Updated the Redis client setup to use TLS configuration when mTLS is enabled, ensuring secure connections to the Redis server. * feat(redis): extend Redis3Store initialization to support mTLS - Added configuration options for enabling mutual TLS (mTLS) in Redis3Store. - Implemented logic to load client certificates and CA certificates for secure Redis connections. - Updated the Redis client setup to utilize TLS configuration when mTLS is enabled. --------- Co-authored-by: Chris Lu <chrislusf@users.noreply.github.com>
2025-03-29Tarantool filer store (#6669)MaratKarimov6-2/+470
Co-authored-by: Marat Karimov <m.karimov@digitalms.ru>
2025-03-21added a check for the nil value when requesting FindEntry. (#6651)Aleksey Kosov1-2/+3
Co-authored-by: akosov <a.kosov@kryptonite.ru>
2025-02-26update redis support statuschrislu2-0/+9
2025-02-26Update README.txtchrislu1-14/+1
2025-02-26add cassandra2 (#6582)Chris Lu3-0/+299
2025-02-21prevent reading wrong datachrislu1-0/+3
fix https://github.com/seaweedfs/seaweedfs/issues/6565
2025-02-17Cassandra loss dir (#6559)Aleksey Kosov1-1/+1
removed initialization of the local err Co-authored-by: akosov <a.kosov@kryptonite.ru>
2025-02-17stop retry when all nodes have tried it (#6551)Numblgw1-0/+6
Co-authored-by: liguowei <liguowei@xinye.com>
2025-02-01adjust fixchrislu1-4/+6
fix https://github.com/seaweedfs/seaweedfs/issues/6497
2025-02-01ensure correct auto bucket creationchrislu1-0/+7
fix https://github.com/seaweedfs/seaweedfs/issues/6497
2025-01-22filer store YDB: fix upsert with TTL (#6469)MaratKarimov1-1/+1
2024-12-31worm grace period and retention time support (#6404)Guang Jiong Lou2-5/+14
Signed-off-by: lou <alex1988@outlook.com>
2024-12-19"golang.org/x/exp/slices" => "slices" and go fmtchrislu9-11/+10
2024-11-21format errorchrislu2-7/+7
2024-11-05remove dup code for section.reader access (#6169)Bruce1-6/+2
2024-11-05fix testschrislu1-4/+4
2024-11-05remove case when read request is out side of the file sizechrislu1-5/+4
2024-11-05fix FUSE mount on macchrislu1-1/+4
2024-11-04merge current message queue code changes (#6201)Chris Lu2-2/+7
* listing files to convert to parquet * write parquet files * save logs into parquet files * pass by value * compact logs into parquet format * can skip existing files * refactor * refactor * fix compilation * when no partition found * refactor * add untested parquet file read * rename package * refactor * rename files * remove unused * add merged log read func * parquet wants to know the file size * rewind by time * pass in stop ts * add stop ts * adjust log * minor * adjust log * skip .parquet files when reading message logs * skip non message files * Update subscriber_record.go * send messages * skip message data with only ts * skip non log files * update parquet-go package * ensure a valid record type * add new field to a record type * Update read_parquet_to_log.go * fix parquet file name generation * separating reading parquet and logs * add key field * add skipped logs * use in memory cache * refactor * refactor * refactor * refactor, and change compact log * refactor * rename * refactor * fix format * prefix v to version directory
2024-10-31Fix 6181/6182 (#6183)Bruce1-6/+20
* set larger buf size for LogBuffer * jump to next day when no more entry found * Update weed/filer/filer_notify_read.go --------- Co-authored-by: Chris Lu <chrislusf@users.noreply.github.com>
2024-09-27[filer] avoid 500 if table doesn't exist (#6075)Konstantin Lebedev1-0/+3
2024-09-16improve worm support (#5983)Guang Jiong Lou1-2/+4
* improve worm support Signed-off-by: lou <alex1988@outlook.com> * worm mode in filer Signed-off-by: lou <alex1988@outlook.com> * update after review Signed-off-by: lou <alex1988@outlook.com> * update after review Signed-off-by: lou <alex1988@outlook.com> * move to fs configure Signed-off-by: lou <alex1988@outlook.com> * remove flag Signed-off-by: lou <alex1988@outlook.com> * update after review Signed-off-by: lou <alex1988@outlook.com> * support worm hardlink Signed-off-by: lou <alex1988@outlook.com> * update after review Signed-off-by: lou <alex1988@outlook.com> * typo Signed-off-by: lou <alex1988@outlook.com> * sync filer conf Signed-off-by: lou <alex1988@outlook.com> --------- Signed-off-by: lou <alex1988@outlook.com>
2024-09-16fix invalid file read (#6024)Guang Jiong Lou1-0/+4
2024-09-14fix file read crash (#6021)Bruce2-2/+4
2024-09-13changing FindEntry error handling in cassandra store (#6015)Aleksey Kosov1-5/+3
2024-09-11Feature limit caching to prescribed number of bytes per file (#6009)Eugeniy E. Mikhailov3-2/+15
* feature: we can check if a fileId is already in the cache We using this to protect cache from adding the same needle to the cache over and over. * fuse mount: Do not start dowloader if needle is already in the cache * added maxFilePartSizeInCache property to ChunkCache If file very large only first maxFilePartSizeInCache bytes are going to be put to the cache (subject to the needle size constrains). * feature: for large files put in cache no more than prescribed number of bytes Before this patch only the first needle of a large file was intended for caching. This patch uses maximum prescribed amount of bytes to be put in cache. This allows to bypass default 2MB maximum for a file part stored in the cache. * added dummy mock methods to satisfy interfaces of ChunkCache
2024-09-10weed mount cachingchrislu1-2/+2
2024-09-10remove unusedchrislu1-2/+0
2024-09-10adjust loggingchrislu1-1/+1
2024-09-09bug fixed to filer store elastic deleteEntry (#5988)zouyixiong1-2/+10
2024-09-04Revert "weed mount, weed dav add option to force cache"chrislu2-6/+3
This reverts commit 7367b976b05bfa69158a60f205dec970c48f50f0.
2024-09-04weed mount, weed dav add option to force cachechrislu2-3/+6
2024-08-01rename functionschrislu1-1/+1
2024-08-01conditional deletechrislu1-1/+4
2024-07-26fix delete chunk failed if volumeSever specified grpc.port (#5820)wyang1-2/+4
Co-authored-by: Yang Wang <yangwang@weride.ai>
2024-07-20get, set and add path confchrislu1-1/+19
2024-07-17refactoringchrislu2-45/+1
2024-07-16Added tls for http clients (#5766)vadimartynov4-7/+15
* Added global http client * Added Do func for global http client * Changed the code to use the global http client * Fix http client in volume uploader * Fixed pkg name * Fixed http util funcs * Fixed http client for bench_filer_upload * Fixed http client for stress_filer_upload * Fixed http client for filer_server_handlers_proxy * Fixed http client for command_fs_merge_volumes * Fixed http client for command_fs_merge_volumes and command_volume_fsck * Fixed http client for s3api_server * Added init global client for main funcs * Rename global_client to client * Changed: - fixed NewHttpClient; - added CheckIsHttpsClientEnabled func - updated security.toml in scaffold * Reduce the visibility of some functions in the util/http/client pkg * Added the loadSecurityConfig function * Use util.LoadSecurityConfiguration() in NewHttpClient func
2024-07-16Fix mmap write fail (#5791)wusong1-1/+4
* [mount] fix GetAttr blocks count Signed-off-by: wang wusong <wangwusong@virtaitech.com> * [mount] fix mmap read Signed-off-by: wang wusong <wangwusong@virtaitech.com> --------- Signed-off-by: wang wusong <wangwusong@virtaitech.com> Co-authored-by: wang wusong <wangwusong@virtaitech.com>
2024-07-11small refactoringchrislu1-2/+2