A benchmark of seven document parsing APIs found Mistral OCR was the fastest with a 4.2s median latency, but had the lowest accuracy at 0.884 and tended to hallucinate values for empty fields.

{
  "signal_id": "ced210e7-e5a3-5877-a9a4-821a3d81f2e3",
  "signal_type": "reddit-company",
  "signal_subtype": "customerFeedback",
  "detected_at": "2026-09-21T13:03:34+00:00",
  "company": {
    "name": "Mistral AI",
    "domain": "mistral.ai"
  },
  "data": {
    "nsfw": false,
    "stage": "none",
    "awards": 0,
    "timing": "completed",
    "topics": [
      "document parsing",
      "api",
      "benchmark",
      "speed",
      "accuracy"
    ],
    "post_id": "1wmc7n2",
    "summary": "A benchmark of seven document parsing APIs found Mistral OCR was the fastest with a 4.2s median latency, but had the lowest accuracy at 0.884 and tended to hallucinate values for empty fields.",
    "category": "features",
    "comments": [
      {
        "url": "https://www.reddit.com/r/Rag/comments/1wmc7n2/comment/pb666vx/",
        "depth": 0,
        "score": 2,
        "author": "grilledCheeseFish",
        "excerpt": "Would be curious to check out the code!",
        "posted_at": "2026-09-21T14:37:04.000Z",
        "author_url": "https://www.reddit.com/user/grilledCheeseFish/"
      },
      {
        "url": "https://www.reddit.com/r/Rag/comments/1wmc7n2/comment/pb6o5q4/",
        "depth": 0,
        "score": 2,
        "author": "Tururuts",
        "excerpt": "Hey ! May I check your code ? As someone working with tables extraction and textract, im highly interested in other methods. I feel that out of the box textract do a great job, however, im kinda stuck on how should I check for errors or even make corrections",
        "posted_at": "2026-09-21T15:53:16.000Z",
        "author_url": "https://www.reddit.com/user/Tururuts/"
      },
      {
        "url": "https://www.reddit.com/r/Rag/comments/1wmc7n2/comment/pb5q3zo/",
        "depth": 0,
        "score": 1,
        "author": "Such-War1955",
        "excerpt": "I would 😀, simply to see how our own setup based on NuExtract 3 and Qwen VL 30B holds up when I run your corpus on it.\n\n Thanks!",
        "posted_at": "2026-09-21T13:22:41.000Z",
        "author_url": "https://www.reddit.com/user/Such-War1955/"
      },
      {
        "url": "https://www.reddit.com/r/Rag/comments/1wmc7n2/comment/pb5tm7x/",
        "depth": 0,
        "score": 1,
        "author": "DorkyMcDorky",
        "excerpt": "You need a couple magnitudes more than 11 PDFs to make a generalization. You might just have shitty PDFs.",
        "posted_at": "2026-09-21T13:39:35.000Z",
        "author_url": "https://www.reddit.com/user/DorkyMcDorky/"
      },
      {
        "url": "https://www.reddit.com/r/Rag/comments/1wmc7n2/comment/pb63luq/",
        "depth": 0,
        "score": 1,
        "author": "Potential-Wrangler58",
        "excerpt": "I challenge you to use anyformat, its thought for more complex documents than the typical tool. BTW you can use the free credits in the platform for this. Happy to know your result with it :)",
        "posted_at": "2026-09-21T14:25:33.000Z",
        "author_url": "https://www.reddit.com/user/Potential-Wrangler58/"
      },
      {
        "url": "https://www.reddit.com/r/Rag/comments/1wmc7n2/comment/pb9xfbf/",
        "depth": 0,
        "score": 1,
        "author": "patbhakta",
        "excerpt": "do you have a link for the PDF, would like to test it on my setup.",
        "posted_at": "2026-09-22T00:44:00.000Z",
        "author_url": "https://www.reddit.com/user/patbhakta/"
      },
      {
        "url": "https://www.reddit.com/r/Rag/comments/1wmc7n2/comment/pbb22fx/",
        "depth": 0,
        "score": 1,
        "author": "Numerous_Season4741",
        "excerpt": "How are you matching rows for row F1, and does field accuracy include the table cells?\n\n I'd test the scorer with all rows present but quantity and unit price swapped between columns. It should flag those wrong assignments even though no rows are missing.\n\n If row F1 only measures coverage, I'd show cell-content accuracy beside it. GriTS is a useful reference for evaluating table structure and cel",
        "posted_at": "2026-09-22T04:45:50.000Z",
        "author_url": "https://www.reddit.com/user/Numerous_Season4741/"
      },
      {
        "url": "https://www.reddit.com/r/Rag/comments/1wmc7n2/comment/pbklozq/",
        "depth": 0,
        "score": 1,
        "author": "ProtectionOk80",
        "excerpt": "Try GoodMem.ai",
        "posted_at": "2026-09-23T14:24:36.000Z",
        "author_url": "https://www.reddit.com/user/ProtectionOk80/"
      }
    ],
    "evidence": [
      "[post] Mistral was the fastest.",
      "[post] Mistral and Textract would sometimes see an empty field and grab some other value from the document instead.",
      "[post] Mistral OCR\n\nField accuracy\n\n0.884\n\nRow F1\n\n0.99\n\nHallucinations\n\n3\n\nMissing\n\n3\n\nMedian latency\n\n4.2s"
    ],
    "virality": "somewhat_high",
    "post_date": "2026-09-21T13:03:34.000Z",
    "post_kind": "text",
    "post_text": "I got tired of document parsing comparisons that basically compare pricing pages, so I actually called the APIs.\n\nI took 11 documents from public datasets, including invoices, a photographed receipt, contracts, a French bank statement, a noisy scanned form, a handwritten cheque, and a medical EOB.\n\n35 pages total. 119 API calls.\n\nEvery provider got the same PDF, same JSON schema, same extraction instructions, same timeout, and the normal/default mode. I also deliberately included fields where the correct answer was null to see which systems would guess anyway.\n\nHere’s where things landed:\n\nProvider\n\nField accuracy\n\nRow F1\n\nHallucinations\n\nMissing\n\nMedian latency\n\nClaude\n\n0.991\n\n0.99\n\n0\n\n2\n\n6.4s\n\nGPT\n\n0.982\n\n0.99\n\n0\n\n2\n\n10.1s\n\nReducto\n\n0.982\n\n0.99\n\n0\n\n4\n\n10.1s\n\nExtend\n\n0.962\n\n1.00\n\n0\n\n2\n\n22.1s\n\nTextract\n\n0.936\n\n0.99\n\n2\n\n1\n\n14.4s\n\nLlamaExtract\n\n0.903\n\n0.99\n\n3\n\n3\n\n22.5s\n\nMistral OCR\n\n0.884\n\n0.99\n\n3\n\n3\n\n4.2s\n\nThere wasn’t really one winner here, which was probably the most useful part of the test.\n\nClaude had the best raw field accuracy. GPT was the cheapest per correct field. Mistral was the fastest. Extend was the only one that got 1.00 row F1, so it didn’t miss a single table row in this run. It also had zero hallucinations, though Claude, GPT, and Reducto did too.\n\nHere's some random stuff I noticed while going through the failures.\n\nMistral and Textract would sometimes see an...",
    "sentiment": "mixed",
    "subreddit": "Rag",
    "post_flair": [
      "Discussion"
    ],
    "post_title": "I benchmarked 7 document parsing APIs on the same 11 PDFs. None of them were good at everything.",
    "prominence": "core",
    "source_url": "https://www.reddit.com/r/Rag/comments/1wmc7n2/i_benchmarked_7_document_parsing_apis_on_the_same/",
    "entity_role": "vendor",
    "post_author": "latentnoise_",
    "upvote_ratio": 1,
    "mention_count": 3,
    "mention_surge": true,
    "subreddit_url": "https://www.reddit.com/r/Rag/",
    "total_upvotes": 24,
    "comments_total": 19,
    "total_comments": 19,
    "other_companies": [
      {
        "name": "Anthropic",
        "role": "competitor",
        "domain": "anthropic.com"
      },
      {
        "name": "OpenAI",
        "role": "competitor",
        "domain": "openai.com"
      },
      {
        "name": "Reducto",
        "role": "competitor",
        "domain": "reducto.ai"
      },
      {
        "name": "Extend",
        "role": "competitor",
        "domain": "extend.ai"
      },
      {
        "name": "Amazon Web Services",
        "role": "competitor",
        "domain": "amazon.com"
      },
      {
        "name": "LlamaExtract",
        "role": "competitor",
        "domain": "llamaindex.ai"
      }
    ],
    "post_author_url": "https://www.reddit.com/user/latentnoise_/",
    "signal_category": "feedback",
    "comments_included": 8,
    "products_mentioned": [
      "Mistral OCR"
    ]
  }
}

curl https://signals.autobound.ai/v1/signals/ced210e7-e5a3-5877-a9a4-821a3d81f2e3 \
  -H "X-API-KEY: $AUTOBOUND_API_KEY"

curl -X POST https://signals.autobound.ai/v1/companies/enrich \
  -H "X-API-KEY: $AUTOBOUND_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{"domain":"mistral.ai","limit":20}'