Anthropic's latest Claude 3.5 Sonnet & Haiku models can now use a computer — just like you

Anthropic has announced the release of the upgraded Claude 3.5 Sonnet and introduced a new model, Claude 3.5 Haiku. The Claude 3.5 Sonnet features comprehensive enhancements over its predecessor, with notable advancements in coding, an area where it already excelled. Meanwhile, Claude 3.5 Haiku matches the performance of the previous largest model, Claude 3 Opus, on various evaluations, maintaining the same cost and similar speed as the earlier Haiku version.

Additionally, Anthropic is unveiling a novel capability in public beta: computer use. Accessible via the API, this feature enables developers to command Claude to interact with computers as humans do — by viewing screens, moving cursors, clicking buttons, and typing text. Claude 3.5 Sonnet is the first AI model to offer this capability in public beta, although it remains experimental and may be cumbersome and prone to errors. Anthropic is seeking feedback from developers to refine this capability, anticipating rapid improvements.