Mobile Engineering Case Study

Bixby Vision
Shopping

A computer-vision shopping service built into the Samsung Camera app — point your phone at a product and find where to buy it.

Samsung Electronics · Android · Sr. Software Engineer

Overview

Bixby Vision Shopping let Samsung Galaxy users discover and buy products simply by taking a photo. Instead of typing a search, the camera recognizes the object in frame and returns matching products and shopping links in real time.

As Sr. Software Engineer at Samsung Electronics, I led the development of the service and engineered the data pipeline that processed 65+ million product items used to train the recognition models, and integrated the experience as a native plug-in inside the Samsung Camera app shipped on Galaxy devices.

Architecture & Data Pipeline

From a single camera frame to ranked shopping results — the flow that powered the feature, plus the offline pipeline that fed the models.

1
Capture
Native plug-in inside the Samsung Camera app captures the live frame on-device, with a lightweight UI layered over the camera preview.
2
Recognition
The frame is sent to the vision backend, which detects the product and classifies it against models trained on the product catalog.
3
Match & Rank
Recognized items are matched to shopping inventory and ranked, returning the most relevant products and purchase links.
4
Data Pipeline
An offline pipeline parsed and normalized 65+ million product items, producing clean, labeled training data for the recognition models.
5
Ship to Galaxy
Delivered as part of the Samsung Camera app on Galaxy devices, reaching a global user base.

Key Features

Native integration within the Samsung Camera app
Real-time product recognition and search
ML-powered product recommendations
Massive data pipeline for 65M+ items
Seamless point-and-shop experience

Impact

65M+
Product items in training pipeline
Millions
Galaxy users reached
Native
Plug-in inside Samsung Camera

Demo

See Bixby Vision Shopping in action.

Bixby Vision Shopping demo video thumbnail

Watch on YouTube →

Tech Stack

Android Java Python Computer Vision ML Pipeline Samsung Camera Data Processing