Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

严重的cpu内存泄漏 #68282

Open
chenghaoDong666 opened this issue Sep 18, 2024 · 3 comments
Open

严重的cpu内存泄漏 #68282

chenghaoDong666 opened this issue Sep 18, 2024 · 3 comments
Assignees

Comments

@chenghaoDong666
Copy link

bug描述 Describe the Bug

image
上图是一段blip2实现的itm构建负样本的代码,训练过程过程中存在严重的cpu内存泄漏问题,自己已经debug完毕,已确定是将挑选出来的负样本添加到列表时出现内存泄漏(保真可复现),但是我理解的是这个列表最后应该自动释放掉,不应该内存泄漏,怀疑paddle框架有问题

其他补充信息 Additional Supplementary Information

python 3.7 paddlepaddle版本paddlepaddle_gpu-2.4.0.post112-cp37-cp37m-linux_x86_64

@chenghaoDong666
Copy link
Author

image
看错了 应该是paddle.multinomial的问题
image

@chenghaoDong666
Copy link
Author

image
模型cpu内存溢出后报错

@yuanlehome
Copy link
Contributor

2.4版本能复现,2.6版本无此问题,升级2.6版本后再次验证下~

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants