SamMobile has affiliate and sponsored partnerships. If you buy something through one of these links, we may earn a commission. Learn more.

Exclusive: Bixby can use the Galaxy S8’s camera for visual search, text recognition


Last updated: January 26th, 2017 at 13:43 UTC+02:00

With the launch of the Galaxy S8 drawing nearer, we’re uncovering different features of the device’s AI assistant, Bixby. Previously we reported about its ability to conduct payments, and how it can control all native applications. Now, we have information that Bixby will also provide a visual search and OCR tool using the camera of the Galaxy S8.

The standard camera app on the Galaxy S8 will feature its own Bixby button, giving access to a search tool that processes whatever the user is pointing the camera at. Bixby will analyze the image, and identify objects and text. It will help you search for that object, or use optical character recognition to process any text you point the phone at.

This Bixby feature is somewhat reminiscent of Google’s Goggles app, but with extended functionality and a high degree of interconnectedness to other applications. For example, not only will it help you find where you can buy an identified object, but it can make the purchase as well.

Of course, Samsung is still busy developing the software for Bixby and the Galaxy S8, and right until launch decisions can be made to add or remove previously rumored features from the phone. Samsung’s AI assistant will debut on the Galaxy S8 and Galaxy S8 Plus, but will most likely not stay exclusive to those devices. Later in the year, it could come to a new Note device, and over time trickle down to Samsung’s mid-range devices as well.

The Galaxy S8 is expected to be unveiled on March 29 and will feature a dual edge screen that covers around 90 percent of the device’s front. To make room for such a large display, the traditional physical home key will disappear. Instead, recent case leaks have suggested a new button on the side of the phone, that will give direct access to Bixby and its plethora of functions.

Phone BixbyGalaxy S8 PlusSamsung Galaxy S8
Load 4 comments

You might also like

How to switch between Google Assistant and Bixby on Galaxy Watch 4

Galaxy Watch 4 and Galaxy Watch 4 Classic owners finally have access to one of the best Google apps. Google A …

  • By Abhijeet Mishra
  • 4 weeks ago

Samsung’s Bixby’s got a neat new hands-free update

Samsung has reduced its push toward Bixby over the past few years, but it is far from abandoning its AI-powere …

  • By Asif Iqbal Shaik
  • 2 months ago

Samsung, it’s time for the Side Key and Google Assistant to work …

Samsung and Google feel closer than ever as the two companies continue to join forces and find common ground i …

  • By Mihai Matei
  • 3 months ago

Our first look at The Freestyle, possibly Samsung’s most fun pro …

One of Samsung’s most surprising and arguably exciting products unveiled at CES in Las Vegas is The Free …

  • By Mihai Matei
  • 6 months ago

5-year-old Galaxy S8, Galaxy S8+ get new software update

Earlier this year, Samsung had removed the Galaxy S8 and the Galaxy S8+ from its software support list. Howeve …

  • By Asif Iqbal Shaik
  • 6 months ago

T-Mobile will buy these Galaxy phones for you just for switching netwo …

The offer includes various Galaxy S and Galaxy Note models and comes with a prepaid card worth up to $1,000.

  • By Mihai Matei
  • 8 months ago