Available for Q4 Advisory & AI Benchmark Projects

Gakungu Peter

Senior Software Engineer & AI Evaluation Architect

10+ years architecting scalable cloud software, benchmarking frontier LLM systems, and conducting rigorous AI safety audits. Currently Senior Software Engineer — AI Benchmark & Evaluation at Mercor.

10+ Years
Production Software Engineering
LLM Benchmarks
GPT-4o, Claude 3.5, Llama 3
$2M+ Systems
Production Systems Architected
99.9% Uptime
Cloud Infrastructure Standard

Engineering Excellence & AI Safety

With a decade of hands-on software engineering across multiple continents, I combine production backend architecture with specialized expertise in frontier AI/LLM benchmarking and safety evaluation.

My core engineering stack includes Python (FastAPI, Django, Flask), TypeScript, React, Next.js, Node.js, AWS, Kubernetes, Docker, Terraform, and PostgreSQL. Whether evaluating agentic coding models or building high-throughput microservices, I deliver precision, reliability, and measurable outcomes.

AI Evaluation & Benchmarking

Curating real-world codebase benchmarks, designing test harnesses, evaluating reasoning quality, and auditing LLM failure modes.

Production Architecture

Designing high-performance distributed systems, automated CI/CD pipelines, and cloud-native infrastructure on AWS and Kubernetes.

AI Evaluation Dashboard

AI Evaluation & Responsible AI

Rigorous benchmarking, quality assessment, and safety testing for frontier AI systems.

LLM Evaluation & Auditing

Designing structured evaluation rubrics covering factuality, harm, bias, recency, hallucination tracking, and output consistency for models like GPT-4o, Claude 3.5, and Llama 3.1-70B.

GPT-4o Claude 3.5 Factuality Bias Tracking

AI Coding Benchmarks

Developing real-world codebase benchmarks, curating test suites, evaluating agentic reasoning, and verifying output correctness and reproducibility.

Repository Audits Test Harnesses SWE-Bench Style

Safety & Failure Analysis

Systematically identifying edge-case failures, prompt injection vulnerabilities, and unhandled behavior in complex agent workflows.

Edge Cases Red Teaming Agentic Safety

Digital Health AI Validation

Evaluating conversational health assistants, diagnostic triage models, and clinical decision support APIs against strict precision standards.

Healthcare AI Triage Models Safety Verification

AI Evaluation Methodology

01

Model / Pipeline

Target under test

→
02

Test Cases

Real-world prompts & codebases

→
03

Rubrics

Factuality, bias & safety

→
04

Audit

Automated + Expert review

→
05

Report

Actionable remediation

Selected Work & Production Systems

A showcase of production-ready web applications, AI evaluation tools, and scalable architectures.

Search Atlas

Search Atlas

Enterprise SEO & Content Intelligence platform processing millions of search queries and automated insights.

Python FastAPI PostgreSQL AWS
View Platform ↗
FreeCast

FreeCast / SelectTV

Streaming aggregation engine serving millions of monthly active users with personalized content discovery.

Django React Kubernetes Redis
View Platform ↗
ExpenseSync

ExpenseSync

Automated corporate expense management and travel mileage tracking SaaS with real-time approval workflows.

Flask PostgreSQL Docker Paystack
View Live System ↗
JobAgent AI

JobAgent AI

Autonomous AI job application assistant automating resume optimization, cover letters, and application submissions.

Python LLM Agents Playwright SQLite
View Live System ↗
CrestDrive Nairobi

CrestDrive Nairobi

Premium private chauffeur and vehicle rental booking platform with automated multi-channel dispatch.

Flask SEO Agent Docker Caddy
View Live System ↗
Kerypto

Kerypto Wallet

Secure digital asset wallet and payment gateway integration built for high-throughput mobile transactions.

Next.js Prisma PostgreSQL M-Pesa API
View Live System ↗

Core Technical Stack

A comprehensive toolkit spanning languages, cloud platforms, and AI evaluation frameworks.

Backend & Languages

Python (FastAPI, Django, Flask), TypeScript, Node.js, RESTful APIs, async queues, PostgreSQL, Redis.

AI & Evaluation

GPT-4o, Claude 3.5, Llama 3.1, Prompt Engineering, Benchmark Creation, Failure Analysis, Ollama, LangChain.

Cloud & DevOps

AWS (EC2, S3, RDS, Lambda), Docker, Kubernetes, Terraform, Caddy, Nginx, CI/CD Actions, Linux.

Professional Experience

10+ years of engineering leadership, AI benchmarking, and robust system architecture.

Present

Senior Software Engineer — AI Benchmark & Evaluation

Mercor

Developing and validating AI coding benchmarks from real-world repositories. Curating test suites, evaluating reasoning quality, and assessing reproducibility of model-generated outputs.

2014 — Present

Senior Software Engineer & Tech Advisor

Global Clients & Scale-ups

Architecting production backend systems using Python, Django, FastAPI, React, and PostgreSQL. Designing cloud infrastructure on AWS and Kubernetes with automated QA and evaluation pipelines.

Let's Build & Evaluate Together

Looking for a Senior Software Engineer or Fractional CTO with deep AI evaluation expertise?

Or reach out directly:

gakungu.peter@gmail.com  |  +254 724 863 632

GitHub ↗ LinkedIn ↗
Chat on WhatsApp