Anthropic · coding
October 29, 2024 · Read the original
Claude 3.5 Sonnet is rolling out on GitHub Copilot, letting developers choose it for coding in Visual Studio Code and on GitHub.com. The model outperforms all publicly available models on SWE-bench Verified and scores 93.7% on HumanEval, according to the announcement. It will be available in public preview to all GitHub Copilot Chat users and organizations over the coming weeks, running via Amazon Bedrock.
Written from the article itself at capture time and checked against it before publication: every number and every name in it comes from the source. It is our summary, not the lab’s wording — the original is linked above.
The announcement says what the lab claims. The record says what was measured, by whom, and whether anyone reproduced it. Read both before believing either.