Amazon’s new Firefly app will recognize audio, objects, images, and more

At Amazon’s smartphone event today in Seattle, the company showed off more than just a new high-spec handset. The company also showed off Firefly, a visual recognition program that can see objects, QR codes, bar codes, and more.

Amazon says Firefly is not just limited to codes and objects, however. You’ll also be able to scan and identify TV shows and music. When scanning a TV show it not only recognizes the show and gives you actor information; it will actually recognize the episode and scene of the show you’re watching. From there you can buy the video straight away.

You also can point Firefly at real world objects and the app will recognize them and give you options for further action. You’ll be able to point it at a phone number on a sign, for example, and Firefly will ask if you want to call it. You could scan a piece of art, and Firefly will scan its database to give you more information.

Amazon says Firefly will recognize over a hundred million items and its Fire phone will offer a dedicated button for quick access to to the app.

From what we could see on stage, the app worked surprisingly quickly, but we’ll have to hold our judgement until we get it in our hands.

Editors’ note: This post will continue to be updated throughout the day as we get more information.