Re: faster search engine for fulltext search

If these queries work so slow, I am wondering how slow it will work when the
database will have a million records.

See fulltext docs at mysql.com, my point still was paginate and use LIMIT (or DB's equivalent) so your perl only has to process an array of a few records instaead of all.

IE

for( @array_fo_20_records ) {
display_record($_);
}

Is much faster (and way less memory intensive) than:

for( @array_with_2000000_records ) {
next if record_is_not_part_of_the_20_I_want($_);
display_record($_);
}

The database engine's implementation of a given query and index system is totally database dependant and has nothing to do with the language you're using to do the queries.

Seems there was an indexing and search module on cpan but I coudol be wrong, I'd have to do a search.

You can always index your Database with a tool like Htdig and do your searches with that...
.

Relevant Pages

  • PostgreSQL and Customer Database
    ... I've been working on both SQL and Perl for a while now, ... get them all onto an SQL database, and be able to keep track of sales, as ... the database available to customers and potential customers, ...
    (perl.beginners)
  • Ways of ensuring integers in the database are seen as numbers in perl?
    ... I'd like my database returned integers to look like integers to Perl but they currently don't until I add 0 to them. ... The reason for this is that adding 0 to a Perl scalar seems to persuade Perl the scalar is an integer. ... $num as returned from database: ...
    (perl.dbi.users)
  • Re: How to access MS Access from Perl?
    ... if you were to later migrate to MS SQL Server or Oracle ... minimize your load on the database server's compiled procedure cache. ... On the other hand, if startup time for your perl script is an issue, and ... slightly preferable to the bulkier DBI + DBD::ODBC. ...
    (comp.lang.perl)
  • Re: Attempted Simultaneous Access causes "Could not lock file"
    ... storing it in my MSAccess database. ... I just wrote another test perl program and pasted in the massive SELECT ... >> I can have multiple perl programs writing to the database, ... > It probably needs exclusive access to the entire Table if it's modifying ...
    (microsoft.public.access.tablesdbdesign)
  • Re: LAMP - Program Design with Perl
    ... > information and queries the MySQL database. ... > Maybe there are Perl modules to faciliate this kind of task? ... so I think it worthwhile to second Anno's suggestion on this method (eg. ... Aside from the hint about dispatch tables, ...
    (comp.lang.perl.misc)