Comments (7)
ql2023
commented on June 16, 2024
tracker.conf 配置
store_path = 2
reserved_storage_space = 2g
存储从
/mapper/vg_lv_1 7.0G 5.9G 1.1G 85% /nfs1
/mapper/vg_lv_2 15G 5.9G 9.1G 40% /nfs2
/mapper/vg_lv_3 8.0G 5.9G 2.1G 74% /nfs3
写到
/mapper/vg_lv_1 7.0G 5.9G 1.1G 85% /nfs1
/mapper/vg_lv_2 15G 15G 176M 99% /nfs2
/mapper/vg_lv_3 8.0G 5.9G 2.1G 74% /nfs3
最后
i=10 id=group1/M01/00/04/wKglnGVkS8-AdNvVEdsfwJtJqy0929.mp4
i=11 id=group1/M01/00/04/wKglnGVkS9OAAaMoEdsfwJtJqy0893.mp4
close socket[192.168.37.156:23000] error ,emsg:Connection reset by peer: socket write error
java.net.SocketException: Connection reset by peer: socket write error
from fastdfs.
ql2023
commented on June 16, 2024
tracker.conf配置
store_path = 2
reserved_storage_space = 20%
第一次测试：
存储从
/mapper/vg_lv_1 7.0G 5.9G 7.0G 1% /nfs1
/mapper/vg_lv_2 15G 5.9G 15.0G 1% /nfs2
/mapper/vg_lv_3 8.0G 5.9G 8.0G 1% /nfs3
写到
/mapper/vg_lv_1 7.0G 5.9G 7.0G 1% /nfs1
/mapper/vg_lv_2 15G 5.9G 7.5G 51% /nfs2
/mapper/vg_lv_3 8.0G 5.9G 8.0G 1% /nfs3
所有文件写入到M01中，
第二次测试：
/mapper/vg_lv_1 7.0G 5.9G 7.0G 1% /nfs1
/mapper/vg_lv_2 15G 5.9G 7.5G 51% /nfs2
/mapper/vg_lv_3 8.0G 5.9G 8.0G 1% /nfs3
----
/mapper/vg_lv_1 7.0G 5.9G 7.0G 1% /nfs1
/mapper/vg_lv_2 15G 5.9G 6.6G 57% /nfs2
/mapper/vg_lv_3 8.0G 5.9G 6.9G 4% /nfs3
----
/mapper/vg_lv_1 7.0G 5.9G 7.0G 1% /nfs1
/mapper/vg_lv_2 15G 5.9G 6.6G 57% /nfs2
/mapper/vg_lv_3 8.0G 5.9G 2.4G 71% /nfs3
先写了M01，之后写了M02，M01没有到达20%阈值（57%）
第三次测试：
/mapper/vg_lv_1 7.0G 5.9G 7.0G 1% /nfs1
/mapper/vg_lv_2 15G 5.9G 6.6G 57% /nfs2
/mapper/vg_lv_3 8.0G 5.9G 2.4G 71% /nfs3
---
/mapper/vg_lv_1 7.0G 5.9G 6.5G 9% /nfs1
/mapper/vg_lv_2 15G 5.9G 1.6G 90% /nfs2
/mapper/vg_lv_3 8.0G 5.9G 147M 99% /nfs3
先写了部分M00，然后M01，最后M02（写到最后异常）：
error ,emsg:Connection reset by peer: socket write error
from fastdfs.
happyfish100
commented on June 16, 2024
reserved_storage_space 配置为具体的预留空间，是总的预留空间。
上述例子中，预留空间2G会分摊到 单个存储路径，即单个存储路径的预留空间为 2GB / 3 = 682 MB。
from fastdfs.
happyfish100
commented on June 16, 2024
另外，storage server报告磁盘空间的时间间隔（配置项 stat_report_interval）默认为 300秒，配置示例中配置为 60秒，可以酌情调小一些。
from fastdfs.
ql2023
commented on June 16, 2024
再找时间测试一下。
from fastdfs.
ql2023
commented on June 16, 2024
比例配置是否有总体限制?
tracker_server.conf 配置 5%：
reserved_storage_space = 5%
实际磁盘使用空间：
容量 已用 可用 已用%
7.3T 7.3T 34G 100%
7.3T 7.3T 34G 100%
16T 15T 632G 96%
16T 15T 780G 96%
5.9T 4.9T 994G 84%
16T 15T 421G 98%
16T 15T 376G 98%
5.9T 4.9T 1004G 84%
总容量：约93.4T，剩余可用约：4275G。
实际上不管tracker_server.conf配置store_path=0还是store_path=2，都无法上传文件。从配置5%的阈值看，上面的6个path仍有两个84%的未达到5%的阈值。
使用java-client，简单的获取StorageServer也报 errno=28：
StorageServer storageServer = trackerClient.getStoreStorage(trackerServer);org.csource.fastdfs.TrackerClient#getStoreStorage(org.csource.fastdfs.TrackerServer)
from fastdfs.
happyfish100
commented on June 16, 2024
比例配置是否有总体限制? tracker_server.conf 配置 5%：
reserved_storage_space = 5%实际磁盘使用空间：
容量 已用 可用 已用% 7.3T 7.3T 34G 100% 7.3T 7.3T 34G 100% 16T 15T 632G 96% 16T 15T 780G 96% 5.9T 4.9T 994G 84% 16T 15T 421G 98% 16T 15T 376G 98% 5.9T 4.9T 1004G 84%总容量：约93.4T，剩余可用约：4275G。 实际上不管tracker_server.conf配置store_path=0还是store_path=2，都无法上传文件。从配置5%的阈值看，上面的6个path仍有两个84%的未达到5%的阈值。
使用java-client，简单的获取StorageServer也报 errno=28：
StorageServer storageServer = trackerClient.getStoreStorage(trackerServer);org.csource.fastdfs.TrackerClient#getStoreStorage(org.csource.fastdfs.TrackerServer)
是的，目前是按总体空间使用情况计算的。
from fastdfs.
Related Issues (20)
- storage启动是提示tracker内网IPv6（fe80开头）地址无效的参数Invalid argument HOT 4
- V5.11版本storage同步异常导致程序异常退出问题 HOT 6
- appender型文件是否不支持文件聚合 HOT 4
- FastDFS 上传文件上传成功后 用返回的地址去下载后发现并不是上传的文件 HOT 1
- Use of undefined constant FDFS_FILE_ID_SEPERATOR HOT 4
- 防盗链小需求 HOT 2
- ipv6环境下，tracker选主会出现失败的情况 HOT 3
- fgrep: warning: fgrep is obsolescent; use grep -F
- can't create connection to xx.xx.xx:0 HOT 3
- 上传文件的时候，偶尔出现乱码的返回的情况，看代码就是个基本的对象FileUploadResponse
- 大量文件导入到fastdfs的问题
- nginx访问storage的文件有两点疑问，帮忙看看
- 低版本的storage可以把数据同步到高版本的storage上吗？ HOT 1
- 使用libfastcommon-1.0.72版本, storage启动是提示tracker内网IPv6（fe80开头）地址无效的参数Invalid argument HOT 3
- make.sh error: 'ConnectionInfo' {aka 'struct <anonymous>'} has no member named 'af' on version 6.12.0 HOT 1
- ./make.sh报错，错误：‘SFGlobalVariables’没有名为‘min_buff_size’的成员 HOT 2
- store_path_count大于42时，store_path路径一次自动创建最多创建到42，并且storage启动不成功，这个时候双tracker下第二台的storage启动失败 HOT 3
- DefaultFastFileStorageClient.getStorageNode(String groupName)获取的storage节点的port=0 HOT 3
- 使用sdk连接fastdfs上传文件报错 file: sf_nio.h line 134, client ip , pkg length: **** > max pkg size: *** HOT 1
- 获取的storage节点的port=0 HOT 4
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from fastdfs.