Home Stories About RSS Feed
2 min read

Apple Integrates On-Device LLMs Deeply Into macOS, Redefining Desktop Search

Back to News

Apple has dramatically raised the bar for consumer AI with today’s announcement of macOS 17 “Sequoia”, featuring native, system-wide integration of its proprietary “Ajax” Large Language Models.

The most visible change is the complete overhaul of Spotlight. Instead of simply finding files or web links, the new Spotlight operates as an omnipresent desktop agent powered by a highly optimized, on-device 12-billion parameter model.

Users can now issue complex natural language commands such as:

Privacy First: The “Secure Enclave AI”

Crucially, Apple is leveraging its silicon advantage to run these models entirely on-device. The system utilizes the M5 chip’s dramatically expanded Neural Engine, processing personal data without ever sending it to the cloud.

For queries requiring world knowledge beyond the local model’s capacity, macOS seamlessly and securely routes the request to Apple’s Private Cloud Compute infrastructure, using cryptographic blinding to ensure user privacy.

A New Paradigm for Developers

Apple also introduced the “App Intent SDK,” allowing third-party developers to expose their app’s functions to the system-wide LLM. This essentially turns macOS into a massive, cohesive agentic ecosystem where the OS can control apps on the user’s behalf.


Source: apple.com, bloomberg.com