Symfony task - memory leak

那年仲夏 提交于 2019-12-19 11:17:53

问题


I wrote a symfony task to fill a database of sample data. Here's a sample piece of code:

gc_enable();
Propel::disableInstancePooling();

public function test()
{
    for($i = 0; $i < 10000; $i++) {
        $this->doIt($i);
    }
}

public function doIt($i)
{
    $user = new User();
    $user->setUsername('user' . $i . "@example.com");
    $user->setPassword('test');
    $user->setFirstName('firstname' . $i);
    $user->setLastName('surname' . rand(0, 1000));

    $user->save();
    $user->clearAllReferences(true);
    $user = null;
    gc_collect_cycles();
}

How can I limit the use of memory?


回答1:


You have some good tips in an other thread on SO.

And here is a really good blog post about memory leak using propel. It's in french, but it's really interesting.

And, if you are working on big data (such as mass import) you should also took a look at pcntl_fork (see this gist). pcntl_fork doesn't work on Windows. I used this method to deal with big import and it's really fast and don't eat all your memory.




回答2:


This is final code. It could work inf amount of time at same memory usage level. Thx everybody.

public function test()
{
    for($i = 0; $i < 10000; $i++) {
        $this->doIt($i);
    }
}

public function doIt($i)
{
    gc_enable();
    Propel::disableInstancePooling();

    $user = new User();
    $user->setUsername('user' . $i . "@example.com");
    $user->setPassword('test');
    $user->setFirstName('firstname' . $i);
    $user->setLastName('surname' . rand(0, 1000));

    $user->save();
    $this->delete($user);
}

public function delete($obj)
{
    $obj->clearAllReferences(true);
    unset($obj);
    // redundant
    // gc_collect_cycles();
}



回答3:


symfony CLI tasks require quite a lot of PHP memory, especially on Windows. If the Propel task is failing, I would recommend a permanent change to the php.ini file setting on memory allocation to at least 256M. I know this seems high, but you should only ever need these tasks on a development machine.



来源:https://stackoverflow.com/questions/11332864/symfony-task-memory-leak

易学教程内所有资源均来自网络或用户发布的内容,如有违反法律规定的内容欢迎反馈
该文章没有解决你所遇到的问题?点击提问,说说你的问题,让更多的人一起探讨吧!