When reading articles about Gemini 2.0 Flash doing much better than GPT-4o for PDF OCR, it was very surprising to me as 4o is a much larger model. At first, I just did a direct switch out of 4o for gemini in our code, but was getting really bad results. So I got curious why everyone else was saying it’s great. After digging deeper and spending some time, I realized it all likely comes down to the image resolution and how chatgpt handles image inputs.
I dig into the results in this medium article:
https://medium.com/@abasiri/why-openai-models-struggle-with-pdfs-and-why-gemini-fairs-much-better-ad7b75e2336d