Internal BuildApril 29, 2026· Confirmed
Paul Weiss Builds Custom Internal AI Benchmarking Tool to Evaluate LLM Vendors
- Significance
- Medium
- Confidence
- Confirmed
Paul Weiss's director of research and competitive intelligence described the firm's proprietary process for evaluating AI tools (Perplexity, OpenAI, Harvey, Harvey+LexisNexis, Thomson Reuters) on accuracy, citations, style, and completeness, and disclosed the firm is building its own internal, ongoing benchmarking tool with its IT team to continuously rank vendor performance for bespoke legal use cases.
""We're actually looking now at finding ways to create our own internal benchmarking on an ongoing basis with a custom tool that we built, probably with our IT team." — Amy Dietrich, Director of Research and Competitive Intelligence, Paul Weiss"
- Significance
- Medium
- Source type
- Trade Press
Proprietary BuildAmLaw 100
Paul, Weiss, Rifkind, Wharton & Garrison on Panorama
Full timeline of tracked moves, capability areas, vendors in use and their Legal AI Activity Index standing.