Apple is expanding its collaboration with Google, its search partner, by integrating new “Visual Intelligence” capabilities into the iPhone 16. During the “Glowtime” event, it was announced that, in addition to paying around $20 billion annually to keep Google as the default search engine in Safari, iPhone 16 users will be able to use Google’s visual search features through the device’s new Camera Control button.
A demonstration showed how OpenAI, via ChatGPT integrated into Siri, also acts as a partner. By pointing the camera at class notes, users can receive assistance with a single click. Additionally, the Camera Control button allows for adjustments such as zoom and exposure, while offering access to “visual intelligence,” enabling users to instantly gather information about what they capture with the camera, like identifying a dog’s breed or adding an event from a poster directly to their calendar.
Though initially it seemed like just a camera shutter, this button’s functionality goes far beyond that. The new Visual Intelligence feature not only helps users learn about objects in the camera’s frame, but also quickly accesses third-party tools, like Google Lens. For instance, it was demonstrated how users could identify and purchase a bicycle simply by pointing the camera and receiving visual search results from Google.
Craig Federighi, Apple’s Senior Vice President of Software Engineering, explained that the camera control opens the door to external services like Google, though certain details remain unclear, such as how users will know when Apple services or third-party services will be used. He also mentioned that users would have control over when to activate these tools.
Although neither Apple nor Google has provided additional details, this move reinforces Apple’s trend of collaborating with third parties rather than developing its own services, as seen with artificial intelligence. This allows Apple to offer users a broader experience without relying on an App Store that is becoming less relevant in a world where tasks are carried out directly from AI-powered interfaces like ChatGPT.
In summary, Apple positions itself as a platform that facilitates access to third-party technologies and services, without compromising its reputation when those tools fail or do not provide the expected results.
By: Nestor Castillo, ForAllTechNews Director