Model Inference

Google Brings Gemini Nano to ML Kit with New On-Device GenAI APIs

by

The new GenAI APIs recently added to ML Kit enable developers to use Gemini Nano for on-device inference in Android apps, supporting features like summarization, proofreading, rewriting, and image description. For example, you can summarize documents of up to 3,000 English words, refine messages to be more formal or casual, and generate titles, metadata, or … Read more

Anthropic’s “AI Microscope” Explores the Inner Workings of Large Language Models

by

Two recent papers from Anthropic attempt to shed light on the processes that take place within a large language model, exploring how to locate interpretable concepts and link them to the computational “circuits” that translate them into language, and how to characterize crucial behaviors of Claude Haiku 3.5, including hallucinations, planning, and other key traits. … Read more