Get Started
Back to Templates

Extract and Verify Book Titles from Bookshelf Photos using GPT-4o and Google Books

Created by

Created by: Arlene Martin || arlenemartin

Arlene Martin

Last update

Last update 2 days ago

Categories

Share

**Use Case: **
Analyze images with multiple subjects. In this use case I have a bookshelf and am extracting and verifying book titles/authors from a bookshelf photo.

**How it works: **

  1. Webhook receives an image url from a front end in which a user can upload a picture.
    • In this use case, it is an image of a book shelf.
  2. Edit Field (Set): Saves image in a consistent location so AI can find it.
  3. Analyze Image: Image is analyzed.
    • Extracts titles from the book spines
  4. Code: Splits extracted subjects to single item to be able to validate each item separately.
    • Books are individualized to their own entity
  5. **HTTP Request **validates each subject.
    • Queries Google Books to validate books in case only partial titles were found.
  6. Edit Field (Set): Tidies the result.
  7. Code: Aggregates and deduplicates
    • Titles and authors are aggregate into a list
  8. Respond to Webhook returns list to front end

How to use:
Use with a frontend that can capture images and receive back the result. For this use case Supabase was used to store images from which the image analyzer could reference.