High-Throughput E-Commerce Ad Spy & Shopify Sales Intelligence
Architected a distributed competitive intelligence engine ingesting 500,000+ daily Meta advertisements, resolving cloaked advertiser links to Shopify stores, and estimating commercial sales velocity with sub-200ms multi-dimensional search.
Engineered the core high-throughput ingestion pipeline, redirect unravelling, sales estimation algorithms, and OpenSearch cluster powering the SaaS.
Performance marketers and DTC brands spend 15+ hours weekly manually scrolling Meta Ad Library, unable to determine which advertised products are actually generating sales. The native ad library isolates creatives from the underlying storefront, offers zero sales context, and obscures destination domains through tracking links and redirects.
Engineered an end-to-end data pipeline connecting ad creatives to real-time storefront commercial performance. The platform continuously monitors tens of thousands of Shopify stores, unrolls redirect chains to connect Ad IDs with store SKUs, estimates daily revenue using a non-invasive sales-tracking model, and indexes records into OpenSearch for sub-200ms faceted discovery with zero credit limits.
Deployed distributed Python worker clusters with dynamic residential proxy pools across 40+ countries. Built an entity resolution engine to follow 3xx redirects and extract clean Shopify IDs. Implemented unit depletion algorithms to track inventory draw over time. Indexed documents into an optimized OpenSearch cluster and cached video assets into Cloudflare R2 / AWS S3.
Resolving multi-hop tracking redirects and campaign subdomains to isolate canonical store domains; maintaining sub-200ms query performance across millions of documents under complex multi-parameter range filtering; deduplicating multi-terabyte ad video streams with perceptual hashing.
Reduced weekly product research time from 15+ hours to a 10-minute query; processed 500,000+ ads daily; sustained sub-200ms response times across millions of records; achieved high-fidelity sales estimates for stores >/month.
End-to-end technical leadership: domain modeling, system architecture, database design, hands-on production code, and zero-defect deployment.
Presented under fictional portfolio codename. Specific commercial entities and confidential operational identifiers have been withheld to respect non-disclosure obligations.
“The competitive advantage in e-commerce SaaS is not the dashboard; it is the data infrastructure underneath it. Shubham architected a pipeline capable of ingesting half a million ads daily, resolving cloaked stores, and serving complex searches in milliseconds without collapsing our infrastructure.”
You own the system.
The code. The infra. The data.
Software should not become valuable enough to matter and then be impossible for the client to own or operate.
Everything I build is 100% client-owned intellectual property from day one. You own the code, the accounts, the infrastructure, and the data. No vendor lock-in.
What belongs to you in full:
- 01Source code & Complete Git Repositories
- 02Apple, Google & Enterprise Developer Accounts
- 03Cloud Infrastructure, VPCs & Production Databases
- 04Figma Design Files, Assets & Documentation
- 05CI/CD Deployment Pipelines & Signing Keys