windows error: The program issued a command but the command length is incorrect about pyvips HOT 10 CLOSED

Hello @HackersSpirit,

Sorry, I don't think this will be possible. Windows has a hard limit of 2000 open files per process, and you can't change it. 15 * 153 is 2295, so you won't be able to open all of your input images. You will need to assemble the image in sections, or change your platform.

You seem to be failing earlier, which is strange. Perhaps you are opening other files elsewhere? You would need to post a sample program for me to test.

from pyvips.

@jcupitt : thanks for the clear explanation on the windows side.
Can you please elaborate on assembling the images in a section part

from pyvips.

Just assemble the first 1000 to a temporary file, then the second, then the third. Finally, join the three parts.

from pyvips.

@jcupitt : Just for clarification.
I have to create 3 files consisting name of 1000 images each and then join them.
Also joining them in separate files won't create any issues :)

from pyvips.

I don't know any details about what you are doing, but that's the general idea, yes. You'll need to experiment a bit.

from pyvips.

@jcupitt : OK thanks 👍

from pyvips.

#Program Starts
import os
import pyvips
# natsort helps with sorting the list logically
from natsort import natsorted

source = r"C:\\Users\\thermo\\Desktop\\ScanSample\\input\\"
output = r"C:\\Users\\thermo\\Desktop\\ScanSample\\output\\"
save_to = output + 'final' + '.tif'

# define list of pictures we are going to get from folder
list_of_pictures = []
# get the
for x in os.listdir(source):
    list_of_pictures.append(source + x)

# list_of_pictures now contains all the images from folder including full path
# since os.listdir will not guarantee proper order of files we use natsorted to do it
list_of_pictures = natsorted(list_of_pictures)

array_images = []
image = None
# lets create array of the images for joining, using sequential so it use less ram
for i in list_of_pictures:
    tile = pyvips.Image.new_from_file(i, access="sequential")
    array_images.append(tile)

# Join them, across is how many pictures there be next to each other, so i just counted all pictures in array with len
out = pyvips.Image.arrayjoin(array_images, across=len(list_of_pictures))
# write it out to file....
out.write_to_file(save_to, Q=95, compression="lzw", bigtiff=True)
#Program Completes

Hi @jcupitt : Here is one of the sample program which reads the imarges and join them.
The program returns the above error when number of file exceed.

Can you please provide sample of what you have mentioned in the comment above:
Just assemble the first 1000 to a temporary file, then the second, then the third. Finally, join the three parts.

from pyvips.

Run the program to insert the first 1000 images and save the result to a temporary file in TIFF format.

Now run a second program that loads the TIFF from above as the background, then inserts another 1000 images on top and saves to s second temporary file.

Finally, run the program again, loading the second temporary as a background and pasting the final 1000 images on top. Save that to your output file and delete the two temporary files.

from pyvips.

Thanks for the clarifying the steps. 👍
One more thing instead of running the above process sequentially can we run it parallely and finally merge temp images one by one.

from pyvips.

Maybe. It depends if your images overlap.

from pyvips.