10+ years architecting scalable cloud software, benchmarking frontier LLM systems, and conducting rigorous AI safety audits. Currently Senior Software Engineer — AI Benchmark & Evaluation at Mercor.
With a decade of hands-on software engineering across multiple continents, I combine production backend architecture with specialized expertise in frontier AI/LLM benchmarking and safety evaluation.
My core engineering stack includes Python (FastAPI, Django, Flask), TypeScript, React, Next.js, Node.js, AWS, Kubernetes, Docker, Terraform, and PostgreSQL. Whether evaluating agentic coding models or building high-throughput microservices, I deliver precision, reliability, and measurable outcomes.
Curating real-world codebase benchmarks, designing test harnesses, evaluating reasoning quality, and auditing LLM failure modes.
Designing high-performance distributed systems, automated CI/CD pipelines, and cloud-native infrastructure on AWS and Kubernetes.
Rigorous benchmarking, quality assessment, and safety testing for frontier AI systems.
Designing structured evaluation rubrics covering factuality, harm, bias, recency, hallucination tracking, and output consistency for models like GPT-4o, Claude 3.5, and Llama 3.1-70B.
Developing real-world codebase benchmarks, curating test suites, evaluating agentic reasoning, and verifying output correctness and reproducibility.
Systematically identifying edge-case failures, prompt injection vulnerabilities, and unhandled behavior in complex agent workflows.
Evaluating conversational health assistants, diagnostic triage models, and clinical decision support APIs against strict precision standards.
Target under test
Real-world prompts & codebases
Factuality, bias & safety
Automated + Expert review
Actionable remediation
A showcase of production-ready web applications, AI evaluation tools, and scalable architectures.
Enterprise SEO & Content Intelligence platform processing millions of search queries and automated insights.
View Platform ↗
Streaming aggregation engine serving millions of monthly active users with personalized content discovery.
View Platform ↗
Automated corporate expense management and travel mileage tracking SaaS with real-time approval workflows.
View Live System ↗
Autonomous AI job application assistant automating resume optimization, cover letters, and application submissions.
View Live System ↗
Premium private chauffeur and vehicle rental booking platform with automated multi-channel dispatch.
View Live System ↗
Secure digital asset wallet and payment gateway integration built for high-throughput mobile transactions.
View Live System ↗A comprehensive toolkit spanning languages, cloud platforms, and AI evaluation frameworks.
Python (FastAPI, Django, Flask), TypeScript, Node.js, RESTful APIs, async queues, PostgreSQL, Redis.
GPT-4o, Claude 3.5, Llama 3.1, Prompt Engineering, Benchmark Creation, Failure Analysis, Ollama, LangChain.
AWS (EC2, S3, RDS, Lambda), Docker, Kubernetes, Terraform, Caddy, Nginx, CI/CD Actions, Linux.
10+ years of engineering leadership, AI benchmarking, and robust system architecture.
Mercor
Developing and validating AI coding benchmarks from real-world repositories. Curating test suites, evaluating reasoning quality, and assessing reproducibility of model-generated outputs.
Global Clients & Scale-ups
Architecting production backend systems using Python, Django, FastAPI, React, and PostgreSQL. Designing cloud infrastructure on AWS and Kubernetes with automated QA and evaluation pipelines.
Looking for a Senior Software Engineer or Fractional CTO with deep AI evaluation expertise?