Transformers &
Representation Learning
Transaction sequence modeling, behavioral representations, and transformer-based ML systems.
Austin, Texas
Staff Machine Learning Scientist
Transformers · Fraud & Risk · Graph ML · Agentic AI
I build large-scale machine learning systems for financial risk and fraud, with a focus on transformer-based representation learning, graph-derived signals, and intelligent ML workflows. My work spans research through production.
Expertise
Transaction sequence modeling, behavioral representations, and transformer-based ML systems.
Payment fraud, scams, and financial risk, with an emphasis on production ML.
Identity and payment graphs, learned representations, and network-derived risk signals.
Agentic workflows, LLM-assisted systems, and automation across the ML lifecycle.
Selected work
Selected work across fraud detection, representation learning, graph ML, and intelligent ML systems.
Problem Model long-range account behavior to identify fraud patterns that are difficult to capture from isolated transactions.
Approach Led development of an encoder-based transformer for transaction sequence modeling and account-holder representation learning, trained at scale using distributed GPU infrastructure.
Impact Trained on 200M+ transaction sequences and delivered a 25% uplift in fraud dollars captured over the production baseline, representing $2M+ in incremental monthly fraud capture.
Problem Identify fraud and identity-risk patterns that are invisible when accounts and transactions are modeled independently.
Approach Led development of graph-based identity representations and proximity embeddings that capture structural relationships between accounts and known fraud networks.
Impact Built representations across 1B+ accounts and 5.4B+ transactions, improving downstream first-party fraud models by 8–15%.
Problem Detect mule accounts and scams across financial institutions and markets with different fraud patterns and data distributions.
Approach Developed mule and scam detection models and extended market-specific modeling into a global framework designed to generalize across regions.
Impact Achieved 70% mule detection with a two-month lead over police reporting in the initial deployment; subsequent global modeling operated across 50M+ monthly transactions.
Problem Reduce manual effort and knowledge loss across complex, repeatable data-science workflows.
Approach Designed an agentic ML system that translates modeling requests into an end-to-end nine-stage workflow spanning problem framing, feature engineering, experimentation, evaluation, and delivery.
Impact Enables validated experiments, features, and expert corrections to compound across projects rather than reset between workflows; currently piloted within Visa.
Research
My research spans machine learning, multimodal reasoning, algorithms, computational social choice, fair division, and optimization.
Selected publications
Vaishnavi Himakunthala, Andy Ouyang, Daniel Rose, Ryan He, Alex Mei, Yujie Lu, Chinmay Sonar, Michael Saxon, William Wang · EMNLP 2023
Paper ↗Daniel Rose, Vaishnavi Himakunthala, Andy Ouyang, Ryan He, Alex Mei, Yujie Lu, Michael Saxon, Chinmay Sonar, Diba Mirza, William Yang Wang · Under submission
arXiv ↗Úrsula Hébert-Johnson, Daniel Lokshtanov, Chinmay Sonar, Vaishali Surianarayanan · IJCAI 2024
Paper ↗Chinmay Sonar, Subhash Suri, Jie Xue · ESA 2023
Paper ↗Experience
Visa · Austin, Texas
Visa Research · Palo Alto, California
Visa Research · Austin, Texas
Clemson University
Computational Modeling and Visualization of Hydrogel Resonance
Education
University of California, Santa Barbara
Indian Institute of Technology Gandhinagar