Apple to Introduce Siri Camera Mode and Enhanced Visual AI in iOS 27

Apple is planning to integrate artificial intelligence more deeply into the iPhone's camera application. The upcoming iOS 27 operating system will introduce a new Siri mode alongside the standard photo and video options.

According to individuals familiar with the matter, as part of this adjustment, the company will incorporate the "Visual Look Up" feature, currently linked to the "Camera Control" button, directly into the camera app itself. This integration will make the feature more prominent within the iPhone's interface.

The sources indicated that this function, now branded under the Siri name, will appear as a new toggle option next to existing modes like "Photo," "Video," and "Portrait." The individuals requested anonymity as the plans have not been publicly announced. Apple did not immediately respond to a request for comment.

These modifications are part of Apple's broader initiative to embed AI into more of its technologies and demonstrate the company's ability to compete in this critical field. Upgrades for iOS 27 and other Apple operating systems are anticipated to be unveiled at the Worldwide Developers Conference in June, followed by a consumer release in the fall.

Similar to the current "Visual Look Up" capability, the new mode will enable users to point the camera at an object and utilize services like ChatGPT to ask questions about it or the surrounding scene. Users will also be able to perform a Google reverse image search to obtain additional information.

The existing version can already extract information from real-world items; for example, it can convert details from a concert poster into a calendar event, identify plants and animals, and retrieve business information such as a phone number or menu details.

In the forthcoming operating system, Apple will redesign this experience with a new shutter button that adopts the style of the Apple Intelligence branding. This will replace the traditional white capture button used in the current "Visual Look Up" feature.

Beyond the camera integration, Apple is expanding the feature's capabilities by adding new internally developed functions. These include the ability to scan nutrition labels on food packaging to log dietary information. Users will also gain the capability to capture and add contact information directly from what the camera sees.