Paul Weiss Builds Custom Internal AI Benchmarking Tool to Evaluate LLM Vendors
- Significance
- Medium
- Confidence
- Confirmed
Paul Weiss's director of research and competitive intelligence described the firm's proprietary process for evaluating AI tools (Perplexity, OpenAI, Harvey, Harvey+LexisNexis, Thomson Reuters) on accuracy, citations, style, and completeness, and disclosed the firm is building its own internal, ongoing benchmarking tool with its IT team to continuously rank vendor performance for bespoke legal use cases.
""We're actually looking now at finding ways to create our own internal benchmarking on an ongoing basis with a custom tool that we built, probably with our IT team." — Amy Dietrich, Director of Research and Competitive Intelligence, Paul Weiss"
- Significance
- Medium
- Source type
- Trade Press
Paul, Weiss, Rifkind, Wharton & Garrison on Panorama
Full timeline of tracked moves, capability areas, vendors in use and their Legal AI Capability Index standing.
More from Paul, Weiss, Rifkind, Wharton & Garrison
- Key HireJun 1, 2026
Paul Weiss Names Rebecca Yeargan Chief AI and Knowledge Officer
- Product AdoptionFeb 3, 2026
Paul Weiss Global Investment Funds Practice Adopts ProVision AI Platform
- Product AdoptionAug 25, 2025
Paul Weiss Investigations Team Uses GenAI to Review 120,000 Documents in Misconduct Probe
- Internal BuildAug 13, 2025
Paul Weiss Becomes First Firm to Launch Harvey Workflow Builder Custom Workflows
- Pilot / TrialJul 15, 2025
Paul Weiss Summer Associate Hackathon Confirms Hebbia as Firm-Approved AI Tool
- Key HireJun 11, 2025
Paul Weiss Names Gina Lynch Chief Knowledge & Innovation Officer