xbo*_*nez 5 php memory-leaks out-of-memory
我正在从命令行运行下面的PHP代码.问题是,它的内存消耗远远超过应有的内存消耗.在我的生活中,我无法弄清楚记忆消耗的地方.
for ($i=0;$i<100;$i++)
{
$classObject = $classObjects[$i];
echo $i . " : " . memory_get_usage(true) . "\n";
$classDOM = $scraper->scrapeClassInfo($classObject,$termMap,$subjectMap);
unset($classDOM);
}
Run Code Online (Sandbox Code Playgroud)
据我所知,我的脚本消耗的内存应该在循环的每次迭代后保持或多或少不变.$scraper->scrapeClassInfo()当其成员超出范围时,应释放所消耗的任何内存.
这是我得到的输出文件.为了简洁起见,我将显示输出的每10行:
0 : 5767168
10 : 12058624
20 : 18350080
30 : 24903680
40 : 30932992
50 : 37748736
60 : 43778048
70 : 49807360
80 : 55836672
90 : 62914560
97 : 66846720
Fatal error: Allowed memory size of 67108864 bytes exhausted (tried to allocate 44 bytes) in /home/content/60/8349160/html/drexel/simple_html_dom.php on line 1255
Run Code Online (Sandbox Code Playgroud)
最后,据我所知,$scraper->scrapeClassInfo()正在做的事情不应该是真正的罪魁祸首,但以防万一,这里是代码:
function scrapeClassInfo($class,$termMap,$subjectMap)
{
$ckfile = tempnam ("/tmp", "CURLCOOKIE");
$ckfile2 = tempnam ("/tmp", "CURLCOOKIE2");
$ckfile3 = tempnam ("/tmp", "CURLCOOKIE3");
$termpage = $termMap[$class['termcode']];
$subjectpage = $subjectMap[$class['subjectcode']];
$classpage = $class['classlink'];
//hit the main page and get cookie
$ch = curl_init();
curl_setopt($ch, CURLOPT_COOKIEJAR, $ckfile);
curl_setopt($ch, CURLOPT_RETURNTRANSFER, true);
curl_setopt($ch, CURLOPT_URL, $this->mainURL);
curl_setopt($ch, CURLOPT_SSL_VERIFYPEER, false);
curl_exec($ch);
curl_close($ch);
//hit the term page and get cookie
$ch = curl_init();
curl_setopt($ch, CURLOPT_COOKIEFILE, $ckfile);
curl_setopt($ch, CURLOPT_COOKIEJAR, $ckfile2);
curl_setopt($ch, CURLOPT_RETURNTRANSFER, true);
curl_setopt($ch, CURLOPT_URL, $termpage);
curl_setopt($ch, CURLOPT_SSL_VERIFYPEER, false);
curl_exec($ch);
curl_close($ch);
//hit the subject page and get cookie
$ch = curl_init();
curl_setopt($ch, CURLOPT_COOKIEJAR, $ckfile3);
curl_setopt($ch, CURLOPT_COOKIEFILE, $ckfile2);
curl_setopt($ch, CURLOPT_RETURNTRANSFER, true);
curl_setopt($ch, CURLOPT_URL, $subjectpage);
curl_setopt($ch, CURLOPT_SSL_VERIFYPEER, false);
curl_exec($ch);
curl_close($ch);
//hit the class page and scrape
$ch = curl_init();
curl_setopt($ch, CURLOPT_COOKIEFILE, $ckfile3);
curl_setopt($ch, CURLOPT_RETURNTRANSFER, true);
curl_setopt($ch, CURLOPT_URL, $classpage);
curl_setopt($ch, CURLOPT_SSL_VERIFYPEER, false);
$result = curl_exec($ch);
curl_close($ch);
return str_get_html($result);
}
Run Code Online (Sandbox Code Playgroud)
在最后一行中调用的方法str_get_html()是Simple HTML DOM Parser的成员
如果重要,这就是我调用脚本的方式:
/usr/local/php5/bin/php index.php 2>&1 1>output
好吧,想通了。显然,5.3 之前的所有 PHP 版本都会遇到这个错误。设置CURLOPT_RETURNTRANSFER为true会导致大量内存泄漏。
我再次运行该脚本,这次调用 php 5.3 二进制文件:
/web/cgi-bin/php5_3 index.php 2>&1 1>output
Run Code Online (Sandbox Code Playgroud)
输出文件如下:
0 : 6291456
10 : 9437184
20 : 10747904
30 : 11534336
40 : 11534336
50 : 11534336
60 : 11534336
70 : 11534336
80 : 11534336
90 : 11534336
99 : 11534336
152.74998211861 sec
Run Code Online (Sandbox Code Playgroud)
现在我要说的就是这个!完全恒定的内存占用。