Must have deals! Today: Galaxy S23 Ultra and the Galaxy Buds 2 Pro!

SamMobile has affiliate and sponsored partnerships. If you buy something through one of these links, we may earn a commission.

Exclusive: Bixby can use the Galaxy S8’s camera for visual search, text recognition

Phone
By 

Last updated: January 26th, 2017 at 13:43 UTC+01:00

With the launch of the Galaxy S8 drawing nearer, we're uncovering different features of the device's AI assistant, Bixby. Previously we reported about its ability to conduct payments, and how it can control all native applications. Now, we have information that Bixby will also provide a visual search and OCR tool using the camera of the Galaxy S8.

The standard camera app on the Galaxy S8 will feature its own Bixby button, giving access to a search tool that processes whatever the user is pointing the camera at. Bixby will analyze the image, and identify objects and text. It will help you search for that object, or use optical character recognition to process any text you point the phone at.

This Bixby feature is somewhat reminiscent of Google's Goggles app, but with extended functionality and a high degree of interconnectedness to other applications. For example, not only will it help you find where you can buy an identified object, but it can make the purchase as well.

Of course, Samsung is still busy developing the software for Bixby and the Galaxy S8, and right until launch decisions can be made to add or remove previously rumored features from the phone. Samsung's AI assistant will debut on the Galaxy S8 and Galaxy S8 Plus, but will most likely not stay exclusive to those devices. Later in the year, it could come to a new Note device, and over time trickle down to Samsung's mid-range devices as well.

The Galaxy S8 is expected to be unveiled on March 29 and will feature a dual edge screen that covers around 90 percent of the device's front. To make room for such a large display, the traditional physical home key will disappear. Instead, recent case leaks have suggested a new button on the side of the phone, that will give direct access to Bixby and its plethora of functions.

Phone BixbyGalaxy S8 PlusSamsung Galaxy S8

You might also like

Apple’s iPhone 15 Pro Action Button is just a recycled Bixby key

Apple’s iPhone 15 Pro Action Button is just a recycled Bixby key

Apple's iPhone 15 launch yesterday was interesting, to say the least. The biggest changes is that the company is finally giving up on its proprietary charging port and will now ship the new iPhones with a USB-C port. The company also made a hardware change by replacing the vintage ring/vibrate switch with a new Action […]

  • By Adnan Farooqui
  • 2 weeks ago
Samsung is bringing Generative AI to Bixby and Tizen to all home appliances

Samsung is bringing Generative AI to Bixby and Tizen to all home appliances

Samsung has been on the back foot in the AI-powered voice assistant race over the past decade. Bixby hasn't performed well compared to Alexa, Google Assistant, and Siri. However, it seems Samsung has big plans for Bixby in the near future. The company revealed that it will bring advanced Generative AI chops to Bixby and […]

  • By Asif Iqbal Shaik
  • 3 weeks ago
Bixby can now answer you in your own voice!

Bixby can now answer you in your own voice!

Samsung has released an awesome new feature for those who use Bixby: you can now create your own custom voice! The Bixby Voice Creator app is now available for Samsung Galaxy smartphones and tablets – it's unclear if it requires the One UI 5.1.1 update, but it seems the rollout of the feature is happening […]

  • By Abhijeet Mishra
  • 1 month ago
Bixby Text Call supports Indian English accent with three variations

Bixby Text Call supports Indian English accent with three variations

When Samsung launched the Bixby Text Call feature last year, it only supported the Korean language. A few weeks later, support for American English was added to the feature. Over the past few months, Samsung has added support for more languages, and it has now added support for Indian English. Bixby Text Call now supports […]

  • By Asif Iqbal Shaik
  • 1 month ago
Samsung Bixby assistant gets more clever with the latest update

Samsung Bixby assistant gets more clever with the latest update

Samsung started rolling out a new Bixby update to enhance two primary features and smarten the voice assistant. The new Bixby update, version 3.3.15.18, weighs a little under 63MB. The company says that you can now do more with Bixby. Thanks to this new update, when talking to Bixby, the voice assistant can recommend useful […]

  • By Mihai Matei
  • 4 months ago
Apple gets inspired by Samsung for some of its iOS 17 features

Apple gets inspired by Samsung for some of its iOS 17 features

Just after Samsung announced new accessibility features for the Galaxy Buds 2 Pro, Apple announced some accessibility features for iPhones. Just ahead of Global Accessibility Awareness Day (May 18, 2023), Apple announced features to improve accessibility on iPhones, and it looks like those features have been inspired by Samsung's features. Apple's Assistive Access is similar […]

  • By Asif Iqbal Shaik
  • 4 months ago