Re: newbie needs help improving performace of tokenizer

>On my machine the Lisp code takes around 7 seconds to just read the
>file into an array and another 7 seconds to run the scanner on the
>file. This is using SBCL 0.9.0 I also tried CMUCL - it was about 1
>second faster for reading the file into memory and also 1 second
>faster for tokenizing the input.

>On the same machine the C code takes around 0.2 seconds.

Did you compile the CMUCL code?

(compile-file "test.lisp")
(load "test.x86f")
(time (doit-1))