PHP Script - Efficient use of execution time

From: Adam (dohertywa_at_hotmail.com)
Date: 02/28/05 

Date: 27 Feb 2005 19:43:46 -0800

Hi,

I am working on a project that requires me to parse 52,005,167 rows in
a MySQL table. I am using a series of PHP scripts for each test I
would like to run on the data. For example I have one test that is to
look for fields with consecutive values. If a row is found to have
more than 4 fields containing consecutive values I would like to
remove the row from the table.

I understand that this will take a good deal of time to process, which
is not a problem. What I am wondering is, should I disable the
maximum script execution time?

Currently I am running these tests in blocks of 10,000 rows at a time.
 I would like to just run a test and let it run from start to finish.

Any comments?

TIA to for any help.
Adam

Relevant Pages

  • Re: newbie question about mysql/php
    ... simple php scripts and phpinfoworks fine. ... When you ran phpinfo() did you see a group of information for MySQL? ... If not did you do any modification in the PHP.ini and Apache2.conf for MySQL to run with them? ... If you make any changes to php.ini or apache2 config then restart your Apache2 server. ...
    (comp.lang.php)
  • Re: newbie question about mysql/php
    ... simple php scripts and phpinfoworks fine. ... When you ran phpinfo() did you see a group of information for MySQL? ... If not did you do any modification in the PHP.ini and Apache2.conf for MySQL to run with them? ... If you make any changes to php.ini or apache2 config then restart your Apache2 server. ...
    (comp.lang.php)
  • Re: stress testing tool (scripts) for web server or MySQL written in PHP
    ... I am looking for PHP scripts which can be used as create many connections to a web server or MySQL back end for stress testing. ... Normally a benchmarking program would be better written in a compiled language, so as to be able to pump requests out as quickly as possible. ...
    (comp.lang.php)
  • Re: HTTP Error 500 when calling mysql_connect from php script
    ... I have installed PHP and MySql 5.0 on Win XP. ... Database created ok. ... PHP scripts runs ok. ... But when I am trying some mysql calls in the script I get an "Error 500" from explorer. ...
    (comp.lang.php)
  • Re: Mysql5/PHP5 installed from ports on FBSD 6
    ... Well, Keith, Riemer is right - those values for MYSQL_INCLUDE and MYSQL_LIBS ... start or would give and error about not being able to load the mysql module.. ... did you initialize the MySQL database ... |->> copy over a small test db and some php scripts to the new server, ...
    (freebsd-isp)