aboutsummaryrefslogtreecommitdiff
path: root/weed/storage/needle_map_memory.go
AgeCommit message (Collapse)AuthorFilesLines
2025-10-16Fix uncleanable orphans issue with `volume.fsck -forcePurging` (#7332)Jaehoon Kim1-1/+1
- Modified `needle_map_memory.go` to include needles with size=0 during needle map loading - Updated `volume_write.go` to handle size=0 needles in delete operations
2024-05-12fix: recreate index include deleted files (#5579)Konstantin Lebedev1-2/+2
* fix: recreate index include deleted files https://github.com/seaweedfs/seaweedfs/issues/5508 * fix: counting the number of files * fix: log
2022-11-14Lazy loading (#3958)Guo Lei1-1/+1
* types packages is imported more than onece * lazy-loading * fix bugs * fix bugs * fix unit tests * fix test error * rename function * unload ldb after initial startup * Don't load ldb when starting volume server if ldbtimeout is set. * remove uncessary unloadldb * Update weed/command/server.go Co-authored-by: Chris Lu <chrislusf@users.noreply.github.com> * Update weed/command/volume.go Co-authored-by: Chris Lu <chrislusf@users.noreply.github.com> Co-authored-by: guol-fnst <goul-fnst@fujitsu.com> Co-authored-by: Chris Lu <chrislusf@users.noreply.github.com>
2022-10-11Optimiz leveldb metric (#3830)Guo Lei1-4/+0
* optimiz updating mapmetric for leveldb * import loading leveldb * add comments
2022-08-23optimiz commitig compact (#3388)Guo Lei1-0/+54
* optimiz vacuuming volume * fix bugx * rename parameters * fix conflict * change copyDataBasedOnIndexFile to an instance method * close needlemap * optimiz commiting Vacuum volume for leveldb index * fix bugs * fix leveldb loading bugs * refactor * fix leveldb loading bug * add leveldb recovery * add test case for levelDB * modify test case to cover all the new branches * use one tmpNm instead of two instances * refactor * refactor * move setWatermark to the end * add test for watermark and updating leveldb * fix error logic * refactor, add test * check nil before close needlemapeer add test case fix metric bug * add tests, fix bugs * adjust log level remove wrong test case refactor * avoid duplicate updating metric for leveldb index
2022-08-21the statistical methord for fileCount should stay same (#3477)Guo Lei1-1/+1
the statistical methord for fileCount between should stay same They all equal to the entry count in .idx file. relate to commit(c7892bc)
2022-07-29move to https://github.com/seaweedfs/seaweedfschrislu1-4/+4
2022-07-20rename parameter and reuse functionsguol-fnst1-1/+1
rename milestone to watermark
2021-02-20skip seek() when index file writesChris Lu1-0/+5
2020-09-12do not idx file formatChris Lu1-14/+5
revert c9ab8d05fa9b425352ce978b5c5b5b0d71d787ad
2020-09-12go fmtChris Lu1-1/+1
2020-09-10fixes for reading deleted fidChris Lu1-5/+14
2020-08-18refactoringChris Lu1-2/+2
2020-08-18refactoring to typed SizeChris Lu1-2/+2
Go is amazing with refactoring!
2020-02-04sync before closing index fileChris Lu1-0/+4
merge from https://github.com/stlpmo-jn/seaweedfs/commit/0181f87d9142852f981541cb05689df9fc9ef6a0
2019-12-24compaction changed to .idx based deletionChris Lu1-2/+0
2019-12-24change btree map to in memory level dbChris Lu1-13/+0
2019-05-21volume: load ec shards during heartbeats to masterChris Lu1-38/+2
2019-05-04adjust memory layout to avoid possible nil pointerChris Lu1-2/+1
2019-04-19fix needle map entry sizeChris Lu1-3/+3
2019-04-18refactoringChris Lu1-5/+5
2019-04-14fix race detector found problemsChris Lu1-4/+2
2019-04-08refactor Offset into a struct of bytesChris Lu1-2/+2
2018-07-21go fmtChris Lu1-1/+1
2018-07-08refactoring: add type for needle id, offsetChris Lu1-16/+18
later the type size can possibly be adjusted
2018-07-07use constant NeedleIndexSize instead of the number 16Chris Lu1-3/+3
2018-05-27go fmtChris Lu1-1/+1
2018-05-23maybe speed up a little when loading indexChris Lu1-3/+3
2017-05-26add btree for volume indexChris Lu1-11/+29
2017-01-18fix byte counter on loading index fileChris Lu1-5/+5
fix https://github.com/chrislusf/seaweedfs/issues/441
2017-01-06keep track of total data file sizeChris Lu1-3/+3
2016-11-11concurrent loading volume霍晓栋1-1/+1
2016-06-02directory structure change to work with glideChris Lu1-0/+106
glide has its own requirements. My previous workaround caused me some code checkin errors. Need to fix this.