LAWTECH OPEN
INNOVATION LAB

Benchmarking Legal AI: Building the Evidence Base for Safe, Confident Adoption

A ground breaking sector-led Legal AI testbed giving vendors and law firms unmatched access to real-world evaluation.

LawTech Open Innovation Lab (LOIL) is a collaborative, sector-led programme run by SuperTech WM. This years programme is bringing together law firms, academia, regulators and technology providers to benchmark Legal AI tools against real-world legal tasks.

Apply to join ‘LOIL 2.0 Benchmarking Legal AI’ a structured, use-case-driven environment that enables law firms to safely test, compare, interrogate and understand LawTech tools. Explore what works and what doesn’t work in practice, while generating clear signals to the market about what really matters in order to drive adoption, trust and tool use.

Where Legal AI Proves Itself - Real Firms. Real Workflows. Real Impact.

This is not a procurement exercise or a vendor showcase. It’s an 8‑week, open‑innovation experiment where ProfTech vendors and legal teams work side‑by‑side to evaluate Legal AI in real workflows, cut through noise and duplication, and move the sector towards doing innovation right. Read the press release here.

See below for use case themes and application requirements.

APPLICATIONS ARE NOW CLOSED this years cohort will be announced shortly!

Selected ProfTech Vendors will have the opportunity to engage with
Use Case benchmarking teams from: 

BENEFITS FOR SME PARTICIPANTS 

  • Work Directly with at least 3 Law Firms; Engaging with leading legal professionals. More to be announced! 

  • Test & Validate your Technology against specially designed frameworks to give confidence; Demonstrate how your solution helps law firms. 

  • Shape the Future of Lawtech; Influence the way law firms adopt new technologies. 

  • Gain Market Credibility; Strengthen your position as a trusted lawtech provider. 

  • Accelerate your market fit in the mid-tier legal services market.

  • Enrich your Network; Join a thriving West Midlands Professional Services community of legal innovators, leading law firms, academics and business support.

  • Collaborate & Learn; Peer to peer knowledge exchange. 

Programme Contributors

SHAPE THE FUTURE OF LEGAL AI ADOPTION

INNOVATION THROUGH COLLABORATION TO SUPPORT THE FUTURE OF LEGAL TECH

Legal AI is full of bold claims but the sector needs proof, not promises. 
LOIL: Benchmarking Legal AI is designed to move beyond demos and marketing to repeatable testing in real workflows, so firms can adopt faster and safer, and vendors can build what the market will actually trust and use. 

We will benchmark tools across scenarios and measure: 

  • Time saved vs effort required 

  • Output quality / accuracy 

  • Supervision burden (junior vs senior) 

  • Hallucination and risk controls 

  • Integration friction 

  • Scalability and cost practicality 

WHO SHOULD APPLY

We invite applications from vendors that:

  • Have a product that is ready to be used in a law firm context

  • Can provide product access to each law firm for the agreed programme period

  • Can provide support to firms during benchmarking period (onboarding + handling queries from benchmarking teams)  


    Law firms are adopting AI tools fast but without shared benchmarks or consistent evaluation methods across the many available tools and products.

    Pilots are costly in time and attention, and many firms are duplicating effort without a shared evidence base. This SuperTech LOIL programme creates a rare opportunity for cross-firm, real-task evaluation with academic input and regulatory awareness.

USE CASE THEMES

The challenges listed have been workshopped and chosen by our trusted legal partners and innovation team. If you have an innovative solution that fits one or more of the below we want to hear from you. SME’s wishing to apply can select one or more use case challenge when applying.

PROGRAMME KEY DATES

19th or 26th February - Pre-Application Webinars

1st March 8AM - Application Deadline

W/C 9th March - Virtual Participant Onboarding Session.
Approximately 90 mins

20th March - In Person Programme Launch Day event,
Birmingham City Centre

7th - 17th April - Virtual Deep Dive Sessions with Each Participating Law Firm

6th May - In Person Programme Demo Day, Birmingham City Centre

THIS PROJECT IS PART-FUNDED BY THE WEST MIDLANDS COMBINED AUTHORITY AND THROUGH THE  INTEGRATED SETTLEMENT FOR THE WEST MIDLANDS. .

Black and white photograph of a formal, historic British policeman, possibly from the early 20th century, wearing a tall helmet and a traditional uniform.
Logo of the West Midlands Combined Authority, featuring an orange hexagon and black accents.