Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
问题描述 在使用taosdump导入一个1T数据文件时,导入时出现内存溢出和 Out of memory in rpc queue 报错。
操作步骤 1、使用官方提供的taosdump工具��数据库数据导出到本地磁盘
2、删除并增大数据库的vgroups个数后,重新将数据导入。 nohup taosdump -i /data2/databack/wlpt -c /etc/taos -h bigdata5 -P 6030 -T 8 > /data2/databack/insetData.log &
发现问题 1、各个TD节点使用内存不断升高,最后会导致 Out of memory in rpc queue,taosd重启
2、磁盘IO性能提升不上去,每台服务器的IO性能都不到10%
服务器性能:
The text was updated successfully, but these errors were encountered:
可以加我们微信a15652223354看下
问题描述
在使用taosdump导入一个1T数据文件时,导入时出现内存溢出和 Out of memory in rpc queue 报错。
操作步骤
![image](https://cdn.statically.io/img/private-user-images.githubusercontent.com/47689601/346103875-3c2db51d-9620-4f33-bf99-312d8e8668c3.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MjE5NDQ1OTMsIm5iZiI6MTcyMTk0NDI5MywicGF0aCI6Ii80NzY4OTYwMS8zNDYxMDM4NzUtM2MyZGI1MWQtOTYyMC00ZjMzLWJmOTktMzEyZDhlODY2OGMzLnBuZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNDA3MjUlMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjQwNzI1VDIxNTEzM1omWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPWNmZjVmMGZkZjcyNzY4OWVlMzYwMGZiMjUxMWI5ZmZjMzhkNGY0ZDkxZWJhZTc2YTdkMmZkNmIwYmM0YmU5YmMmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0JmFjdG9yX2lkPTAma2V5X2lkPTAmcmVwb19pZD0wIn0.x_anjec9b0ZETnwKi2aEbTQGdHJb2ZeAS-F4JUPXUZE)
1、使用官方提供的taosdump工具��数据库数据导出到本地磁盘
2、删除并增大数据库的vgroups个数后,重新将数据导入。
nohup taosdump -i /data2/databack/wlpt -c /etc/taos -h bigdata5 -P 6030 -T 8 > /data2/databack/insetData.log &
发现问题
![image](https://cdn.statically.io/img/private-user-images.githubusercontent.com/47689601/346105589-5e17ac92-d660-4b89-bdd4-4ecba4910ee3.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MjE5NDQ1OTMsIm5iZiI6MTcyMTk0NDI5MywicGF0aCI6Ii80NzY4OTYwMS8zNDYxMDU1ODktNWUxN2FjOTItZDY2MC00Yjg5LWJkZDQtNGVjYmE0OTEwZWUzLnBuZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNDA3MjUlMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjQwNzI1VDIxNTEzM1omWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPTIyZmNkODQyZjVhMmEzZWYwMjY2NzRhMjMxN2NhMDBhMmU0OGUxN2M3ZmI5MDc2MTQyMzhiZTMxZGVkYmRmMjQmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0JmFjdG9yX2lkPTAma2V5X2lkPTAmcmVwb19pZD0wIn0.e0DWWraMB9ljXdfn6OrcWzuaaRAXh5ErcF1ayAJV37M)
1、各个TD节点使用内存不断升高,最后会导致 Out of memory in rpc queue,taosd重启
2、磁盘IO性能提升不上去,每台服务器的IO性能都不到10%
![image](https://cdn.statically.io/img/private-user-images.githubusercontent.com/47689601/346105394-4fc77a8b-26f5-46db-8915-c8a112b2a7d2.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MjE5NDQ1OTMsIm5iZiI6MTcyMTk0NDI5MywicGF0aCI6Ii80NzY4OTYwMS8zNDYxMDUzOTQtNGZjNzdhOGItMjZmNS00NmRiLTg5MTUtYzhhMTEyYjJhN2QyLnBuZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNDA3MjUlMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjQwNzI1VDIxNTEzM1omWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPThhYmJiNzQyYWZjZTlmYTY4MThiOWI1Y2JmNWIwZGIzZDM1NDQyNzRjMjJhZWViZjJjZWFiNjMzOGI4NmFlZDcmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0JmFjdG9yX2lkPTAma2V5X2lkPTAmcmVwb19pZD0wIn0.dg2Xch1mKFqJDwKDLU4A9wceRe3lbI36ElmwDFQtQls)
服务器性能:
The text was updated successfully, but these errors were encountered: