[Question] Each .tiff file takes around 60-80 secs on --gpu-mode on RTX 4080 with 16 GB VRAM. Is this normal?

[forandoe]

Happy to be educated here. Just noticed that the processing with gpu-mode is quite slow.
This could be fully expected. Any thoughts on the processing times?

I can provide some stats on the file sizes etc., but it doesn't seem to be much different either way.
I tried ollama as well, the conversion time is pretty much similar.

[linear]

PLG-177

[emannuell]

I'm having the same problem with slow processing of PDF files. Model requires 118 GB of VRAM. If the model is fully loaded in GPU, processing should be faster i think... But 118Gb of VRAM is not cheap