Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

使用taosdump工具导入数据,TD集群磁盘IO性能提升不上去 #26447

Open
aggaadfr opened this issue Jul 5, 2024 · 1 comment
Open
Labels
bug Something isn't working

Comments

@aggaadfr
Copy link

aggaadfr commented Jul 5, 2024

问题描述
在使用taosdump导入一个1T数据文件时,导入时出现内存溢出和 Out of memory in rpc queue 报错。

操作步骤
1、使用官方提供的taosdump工具��数据库数据导出到本地磁盘
image

2、删除并增大数据库的vgroups个数后,重新将数据导入。
nohup taosdump -i /data2/databack/wlpt -c /etc/taos -h bigdata5 -P 6030 -T 8 > /data2/databack/insetData.log &

发现问题
1、各个TD节点使用内存不断升高,最后会导致 Out of memory in rpc queue,taosd重启
image

2、磁盘IO性能提升不上去,每台服务器的IO性能都不到10%
image

服务器性能:

  • OS: [e.g. Ubuntu22.04]
  • Memory=256G, CPU=64, current Disk Space=64T
  • TDengine Version [e.g. 3.2.3.0] 和 [e.g. 3.3.2.0]
  • 集群数量=10台
@aggaadfr aggaadfr added the bug Something isn't working label Jul 5, 2024
@yu285
Copy link
Contributor

yu285 commented Jul 22, 2024

可以加我们微信a15652223354看下

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
2 participants