James Ding
Might 06, 2026 19:05
Harvey AI’s new system permits correct chart and diagram reasoning in authorized paperwork, addressing expensive gaps in conventional OCR strategies.
Harvey AI has unveiled an on-demand imaginative and prescient system designed to sort out one of many longstanding challenges in authorized know-how: understanding and reasoning over visible components in authorized paperwork. Not like conventional OCR (Optical Character Recognition) pipelines that cut back charts, diagrams, and tables to plain textual content, the brand new system reads and interprets visible content material solely when vital, boosting each accuracy and effectivity.
Authorized paperwork are hardly ever text-only; they typically embody monetary charts, engineering diagrams, and even flooring plans. These components are vital for decision-making however are notoriously tough for AI programs to course of successfully. Harvey AI’s resolution permits customers to question these visuals straight, offering detailed, context-aware solutions. For instance, when requested, “What does the income chart on web page 47 present?”, the system doesn’t simply extract information. It analyzes axes, interpolates unlabeled factors, and delivers structured insights.
Why This Issues
Conventional doc processing fashions fail to seize the complexity of non-textual components, resulting in gaps in AI-generated responses. Harvey’s new system tackles these gaps head-on by using a selective, query-driven strategy. As a substitute of processing all visible components throughout doc ingestion, the system solely prompts its imaginative and prescient capabilities when a person’s query calls for it. This avoids pointless computational prices—vital for scaling throughout billions of photographs—and ensures high-fidelity evaluation the place it issues most.
Key Options
- Sensible Web page Detection: The system identifies related pages utilizing text-based search earlier than analyzing visuals, narrowing down a 500-page doc to a handful of candidates inside milliseconds.
- Excessive-Decision Rendering: Paperwork are transformed to constant codecs and rendered at excessive DPI, preserving particulars like small chart labels and complicated layouts.
- Structured Visible Reasoning: The imaginative and prescient mannequin doesn’t merely describe photographs—it extracts numeric values, reads chart axes, and distinguishes between exact and approximate information factors.
- Value Optimization: By processing visuals on-demand, Harvey reduces compute prices considerably. Early assessments revealed that as much as 90% of visible components in a doc are pointless for answering person queries.
Challenges and Improvements
Constructing a scalable imaginative and prescient system for authorized tech posed distinctive challenges. Authorized paperwork differ extensively in format and complexity, from handwritten annotations to outsized charts. Harvey’s resolution integrates high-speed rendering providers and ensures constant doc formatting. Moreover, the system incorporates “swish degradation,” avoiding hallucinated solutions when visible components are lacking or unclear. As a substitute, it reviews what it will probably and might’t confidently decide.
Takeaways from Actual-World Testing
Throughout evaluations, Harvey’s system demonstrated its functionality to reply complicated queries involving charts and diagrams with excessive accuracy. Apparently, many questions have been resolved utilizing textual content alone, underscoring the effectivity of Harvey’s “text-first, vision-second” design philosophy. This structure ensures fast responses for text-based queries whereas reserving visible evaluation for genuinely complicated circumstances.
Trying Forward
Harvey AI plans to increase its imaginative and prescient capabilities into different domains, together with extra superior diagram interpretation and enhanced rendering for edge circumstances. The corporate can be centered on lowering latency and additional refining its software’s skill to determine when visible evaluation is critical.
With this innovation, Harvey units a brand new normal for AI in authorized tech, combining price effectivity with unparalleled accuracy in processing complicated paperwork. For authorized professionals navigating data-heavy circumstances, this software represents a big leap ahead.
If constructing programs like this excites you, Harvey AI is hiring. Discover open roles right here.
Picture supply: Shutterstock
