Maximum List size (item number) limit?

Kriston-Vizi Janos <kriston@xxxxxxxxxxxxxxxxxxxxxxx> · Wed, 11 Jan 2006 20:27:31 +0900

Dear Mr. Kern, and Members,
Thank you very much for the fast answer, my question became 
over-simplified.
My source code is appended below. It uses two text files (L.txt and 
GC.txt) as input and merges them. Please find these two files here:

http://kristonvizi.hu/L.txt

http://kristonvizi.hu/GC.txt
Both L.txt and GC.txt contains 3000 rows. When running, the code stops 
with error message:
'The debugged program raised the exception IndexError "list index out of 
range"

File: /home/kvjanos/file.py, Line: 91'
And I noticed that all the lists that should contain 3000 items, 
contains less as follows:

NIR_mean_l = 1000 items

NIR_stdev_l = 1000 items

R_mean_l = 1000 items

R_stdev_l = 1000 items

G_mean_l = 999 items

G_stdev_l = 999 items

area_l = 999 items
NIR_mean_gc = 1000 items
NIR_stdev_gc = 1000 items
R_mean_gc = 1000 items
R_stdev_gc = 1000 items
G_mean_gc = 999 items
G_stdev_gc = 999 items
area_gc = 999 items
This is why I thought it is a limit in list items number.
Code that's failing:
#*******************************************
import string,sys,os,sets
# Open L, GC txt files and create merged file

inp_file_l = open('/home/kvjanos/L/L.txt')     
inp_file_gc = open('/home/kvjanos/GC/GC.txt') 
out_file = open('/home/kvjanos/L_GC_merged/merged.txt', 'w')
# Define L lists
NIR_mean_l = []
NIR_stdev_l =[]
R_mean_l = []
R_stdev_l =[]
G_mean_l = []
G_stdev_l =[]
area_l = []
# Define GC lists
NIR_mean_gc = []
NIR_stdev_gc =[]
R_mean_gc = []
R_stdev_gc =[]
G_mean_gc = []
G_stdev_gc =[]
area_gc = []

# Processing L file

line_no_l =0    # Input L file line number

type_l = 1  # Input L file row type: 1 (row n),2 (row n+1) or 3 (row n+2)

# Append L values to lists.

for line in inp_file_l.xreadlines():

   line_no_l = line_no_l + 1

   if line_no_l == 1:  # To skip the header row

       continue           
   data_l = []   # An L row           
   data_l = line.split()

   if type_l == 1:      
       NIR_mean_l.append(data_l[2])  # Append 3rd item of the row to 
the list

       NIR_stdev_l.append(data_l[3])  # Append 4th item of the row to 
the list       
       type_l = 2  # Change to row n+1

   else:

       if type_l == 2:

           R_mean_l.append(data_l[2])

           R_stdev_l.append(data_l[3])

           type_l = 3

       else:

           G_mean_l.append(data_l[2])

           G_stdev_l.append(data_l[3])      
           area_l.append(data_l[1])            
           type_l = 1

inp_file_l.close()

# Processing GC file, the same way as L file above
line_no_gc =0
type_gc = 1
for line in inp_file_gc.xreadlines():

   line_no_gc = line_no_gc+ 1

   if line_no_gc== 1:

       continue       
   data_gc = []

   data_gc = line.split()

   if type_gc== 1:      
       NIR_mean_gc.append(data_gc[2])

       NIR_stdev_gc.append(data_gc[3])          
       type_gc= 2

   else:

       if type_gc== 2:

           R_mean_gc.append(data_gc[2])

           R_stdev_gc.append(data_gc[3])

           type_gc= 3

       else:

           G_mean_gc.append(data_gc[2])

           G_stdev_gc.append(data_gc[3])

           area_gc.append(data_gc[1])

           type_gc= 1

inp_file_gc.close()
#############################
# Create output rows from lists
for i in range(len(NIR_mean_l)): # Process all input rows
   # Filters L rows by 'area_l' values

   area_l_rossz = string.atof(area_l[i])

   if area_l_rossz < 10000:   
       continue

   elif area_l_rossz > 100000:

       continue

   # Filters GC rows by 'area_gc' values       
   area_gc_rossz = string.atof(area_gc[i])

   if area_gc_rossz < 10000:  
       continue

   elif area_gc_rossz > 200000:   
       continue

# Create output line and write out

   newline = []

   newline.append(str(i+1))

   # L

   newline.append(NIR_mean_l[i])

   newline.append(NIR_stdev_l[i])

   newline.append(R_mean_l[i])

   newline.append(R_stdev_l[i])

   newline.append(G_mean_l[i])

   newline.append(G_stdev_l[i])

   newline.append(area_l[i])

   # GC

   newline.append(NIR_mean_gc[i])

   newline.append(NIR_stdev_gc[i])

   newline.append(R_mean_gc[i])

   newline.append(R_stdev_gc[i])

   newline.append(G_mean_gc[i])

   newline.append(G_stdev_gc[i])

   newline.append(area_gc[i])

   outline =  string.join(newline,'\t') + '\n'

   out_file.writelines(outline)

out_file.close()

#*******************************************
Thnx again,
Janos

Kriston-Vizi Janos wrote:

>/ Dear Members,

/>/ 
/>/ Is there any possibility to use more than 999 items in a list?

/

Yes. Of course.
>/ Cannot 
/>/ append more than 999 items. 
/

Post the code that's failing for you and the error message it generates.
And please read http://www.catb.org/~esr/faqs/smart-questions.html <http://www.catb.org/%7Eesr/faqs/smart-questions.html> . It will
help us help you.
>/ The same problem with 'array' type. Is it a 
/>/ result of a default setting maybe?

/

No.
--
Robert Kern
robert.kern at gmail.com <http://mail.python.org/mailman/listinfo/python-list>
"In the fields of hell where the grass grows high
 Are the graves of dreams allowed to die."
  -- Richard Harter

.

Maximum List size (item number) limit?

Relevant Pages