Anthropic open-sources FlashProve for zero-knowledge provable model inference

What happened.Anthropic published FlashProve, an open-source cryptographic framework that enables model providers to mathematically prove which weights generated a specific completion without exposing proprietary model architectures.
Why it matters.Third-party API consumers and routing brokers currently have no cryptographic guarantee that an inference request was processed by the contracted frontier model rather than a cheaper distilled substitute. Zero-knowledge model verification resolves vendor trust disputes in regulated sectors like banking and healthcare without compromising intellectual property. Infrastructure founders should evaluate verifiable inference tooling to audit upstream API providers against model substitution and prompt tampering.
The technical specifications:
- zkSNARK verification: FlashProve deploys zero-knowledge succinct non-interactive arguments of knowledge tailored for machine learning, allowing lightweight clients to verify inference outputs against short cryptographic weight commitments.
- Frontier throughput: Benchmarked on a quantized 400-billion parameter Llama 4 Maverick Mixture-of-Experts checkpoint, a single NVIDIA H100 GPU produced cryptographic proofs at 110 tokens per second.
- Audit architecture: The open-source distribution includes a C++ prover, a fast CPU verifier generating 19-megabyte proofs per 1,024 tokens, and a Lean-verified formal proof published under an Apache 2.0 license.
STORYLINE PROGRESSION & CONTEXT
This report represents a verified evolution of prior newsroom intelligence: