aboutsummaryrefslogtreecommitdiff
path: root/weed/mount/page_writer
AgeCommit message (Collapse)AuthorFilesLines
2025-03-31skip logschrislu1-1/+1
2024-11-21ReadAt may return io.EOF t end of filechrislu1-1/+5
related to https://github.com/seaweedfs/seaweedfs/issues/6219
2024-05-20go fmtchrislu2-2/+2
2024-04-11log possible racing conditionchrislu2-12/+12
fix https://github.com/seaweedfs/seaweedfs/issues/5412
2023-11-17Waiting for writes to complete with acquired locks may lead to deadlock, ↵Viktor Kuzmin1-2/+5
fixes #4952
2023-01-31memchunk save content twice (#4174)wusong1-7/+3
2023-01-16use one readerCache for the whole filechrislu1-1/+4
2023-01-15use memory chunks only for sequential writeschrislu1-1/+2
2023-01-13allow random writes for mem chunkchrislu1-2/+1
2023-01-12merge chunks during upload (#4130)Chris Lu2-3/+26
* merge chunks during upload * fix test
2023-01-03add back previous chunk upload selection algochrislu4-5/+35
2023-01-02more solid weed mount (#4089)Chris Lu9-143/+263
* compare chunks by timestamp * fix slab clearing error * fix test compilation * move oldest chunk to sealed, instead of by fullness * lock on fh.entryViewCache * remove verbose logs * revert slat clearing * less logs * less logs * track write and read by timestamp * remove useless logic * add entry lock on file handle release * use mem chunk only, swap file chunk has problems * comment out code that maybe used later * add debug mode to compare data read and write * more efficient readResolvedChunks with linked list * small optimization * fix test compilation * minor fix on writer * add SeparateGarbageChunks * group chunks into sections * turn off debug mode * fix tests * fix tests * tmp enable swap file chunk * Revert "tmp enable swap file chunk" This reverts commit 985137ec472924e4815f258189f6ca9f2168a0a7. * simple refactoring * simple refactoring * do not re-use swap file chunk. Sealed chunks should not be re-used. * comment out debugging facilities * either mem chunk or swap file chunk is fine now * remove orderedMutex as *semaphore.Weighted not found impactful * optimize size calculation for changing large files * optimize performance to avoid going through the long list of chunks * still problems with swap file chunk * rename * tiny optimization * swap file chunk save only successfully read data * fix * enable both mem and swap file chunk * resolve chunks with range * rename * fix chunk interval list * also change file handle chunk group when adding chunks * pick in-active chunk with time-decayed counter * fix compilation * avoid nil with empty fh.entry * refactoring * rename * rename * refactor visible intervals to *list.List * refactor chunkViews to *list.List * add IntervalList for generic interval list * change visible interval to use IntervalList in generics * cahnge chunkViews to *IntervalList[*ChunkView] * use NewFileChunkSection to create * rename variables * refactor * fix renaming leftover * renaming * renaming * add insert interval * interval list adds lock * incrementally add chunks to readers Fixes: 1. set start and stop offset for the value object 2. clone the value object 3. use pointer instead of copy-by-value when passing to interval.Value 4. use insert interval since adding chunk could be out of order * fix tests compilation * fix tests compilation
2022-12-21lock and unlock chunks for readchrislu1-0/+4
2022-12-21remove duplicated logic of removing from writableChunkschrislu1-3/+1
2022-12-20unlock before submitting the uploading jobschrislu1-1/+5
2022-12-19mount: adjust locking for upload pipelinechrislu2-39/+31
2022-08-21mount: add locking to prevent nil pointerchrislu2-0/+38
fix https://github.com/seaweedfs/seaweedfs/issues/3479
2022-08-21minorchrislu1-1/+3
2022-08-20remove unused collection and replication from upload resultchrislu1-1/+0
2022-08-10ensure memory is alignedchrislu1-2/+2
fix https://github.com/seaweedfs/seaweedfs/issues/3427
2022-07-29move to https://github.com/seaweedfs/seaweedfschrislu4-8/+8
2022-04-05prevent concurrent access during shutdownchrislu1-0/+3
2022-04-03avoid concurrent access to map objectchrislu1-5/+12
fix https://github.com/chrislusf/seaweedfs/issues/2866
2022-03-13refactorchrislu1-13/+13
2022-03-13write to disk during random writes, limiting total disk spaces usedchrislu4-11/+20
2022-03-09add back writes to swap file when too many in memory chunks are used.chrislu3-9/+21
2022-03-07ensure releasing file handlechrislu1-0/+3
2022-03-07remove debug messagechrislu1-1/+1
2022-02-13support readchrislu9-0/+692