Hackathon PS-07 Open Track • Team NEXORA

Your Store. One Autonomous Intelligence.

Traditional retail dashboards only report problems after revenue is lost. RetaiLens AI perceives shelf & checkout activity via computer vision, reasons across persistent operational memory, executes safe deterministic tools, and keeps store managers in control of high-stakes approvals.

13

Deterministic Agent Tools

22

Tracked Store SKUs

4 Roles

Server-Enforced RBAC

HITL

Human Approval Gatekeeper

Real Store Inventory & CV Recognition Targets

Monitored Store Product Catalog

Every SKU tracked across aisles and checkout lanes with product photography, barcode verification, and live safety thresholds.

Inspect Full 22-SKU Inventory
Monsoon Reserve CoffeeSKU-COF-00134 left

Beverages

Monsoon Reserve Coffee

Aisle 1 - Coffee & Tea

₹540.00EAN 8901425001011
Hill Farm Whole MilkSKU-MLK-00218 left

Dairy

Hill Farm Whole Milk

Aisle 3 - Chilled Dairy

₹85.00EAN 8901425001028
Cold Pressed Olive OilSKU-OLV-0884 left

Gourmet Pantry

Cold Pressed Olive Oil

Aisle 4 - Oils & Condiments

₹920.00EAN 8901425001088
Millet & Sea Salt BitesSKU-SNK-00442 left

Healthy Snacks

Millet & Sea Salt Bites

Aisle 2 - Artisanal Snacks

₹145.00EAN 8901425001042
Wild Citrus Green TeaSKU-TEA-00529 left

Beverages

Wild Citrus Green Tea

Aisle 1 - Coffee & Tea

₹295.00EAN 8901425001059
Clover Greek YogurtSKU-YOG-00622 left

Dairy

Clover Greek Yogurt

Aisle 3 - Chilled Dairy

₹160.00EAN 8901425001066
Sourdough Country LoafSKU-BAK-00711 left

Bakery

Sourdough Country Loaf

Aisle 5 - Fresh Bakery

₹180.00EAN 8901425001073
Forest Multiflora Raw HoneySKU-HON-00819 left

Gourmet Pantry

Forest Multiflora Raw Honey

Aisle 4 - Oils & Condiments

₹460.00EAN 8901425001080

Built for Real Store Operations — Not a Generic Chatbot

Every alert connects directly to validated backend workflows, transactional inventory mutations, and role-authorized approvals.

Computer Vision Shelf Monitoring

Detects empty facings, shelf occupancy %, and misplaced items via OpenCV & YOLO-compatible feeds.

Intelligent Checkout Verification

Cross-checks POS barcode scans against overhead vision; pauses low-confidence mutations automatically.

Expiry-Aware Dynamic Pricing

Calculates margin-safe markdowns for approaching-expiry batches while honoring store floor rules.

Autonomous Replenishment Drafts

Computes depletion velocity + supplier lead times to draft POs—then waits for manager sign-off.

Persistent Cross-Session Memory

Remembers SKU evening rushes, supplier lead-time drift, and past manager approval patterns.

Human-in-the-Loop Governance

High-value POs, checkout overrides, and steep discounts require explicit authorized role approval.

ReAct Agentic Orchestration Loop

The model reasons and selects validated tools; the server enforces permissions, idempotency, and approval safety checks.

Inspect full pipeline diagram
01

PERCEIVE

Ingests OpenCV shelf detections, POS scans & expiry clocks.

02

REASON

Correlates stock levels, depletion velocity & confidence scores.

03

PLAN

Synthesizes safe multi-tool action plans bounded by policy.

04

ACT

Executes validated deterministic tools or pauses for approval.

05

OBSERVE

Verifies database mutations, receipts & supplier drafts.

06

REMEMBER

Persists cross-session patterns in PostgreSQL agent memory.

Computer Vision Pipeline

OpenCV & YOLO-Compatible Frame Analysis

Separates simulated demo feeds from connected FastAPI OpenCV media processing. Supports live frame uploads, edge-density shelf occupancy estimation, and Sobel/EAN barcode verification.

  • Confidence-gated POS mutations (auto-pauses below 80%)
  • Real-time missing facing & shelf occupancy tracking
Human-in-the-Loop Safety

Zero Unchecked Financial or Inventory Overrides

AI agents draft purchase orders and recommend dynamic markdowns—but only authenticated Store Managers or Owners can approve high-value dispatches or disputed checkouts.

  • Server-side RBAC + idempotent execution keys
  • Full audit log & feedback persisted to agent memory

Production Architecture Stack

Next.js App Router + TypeScriptSupabase PostgreSQL + RLSGemini Tool Calling + ReActPython FastAPI + OpenCVRecharts + Tailwind CSS