Anthropic
July 11, 2023 · Read the original
Anthropic announced Claude 2, a new model with improved performance, longer responses, and access via API and a public beta website at claude.ai. The company said Claude 2 scored 76.5% on the multiple choice section of the Bar exam, up from 73.0% with Claude 1.3, and improved on the Codex HumanEval coding test to 71.2% from 56.0%. Users can input up to 100K tokens per prompt, and the Claude 2 API is offered at the same price as Claude 1.3. The beta chat experience is available in the US and UK.
Written from the article itself at capture time and checked against it before publication: every number and every name in it comes from the source. It is our summary, not the lab’s wording — the original is linked above.
The announcement says what the lab claims. The record says what was measured, by whom, and whether anyone reproduced it. Read both before believing either.