Bill Zhang
SF · --:--
VOICE-DRIVEN PORTFOLIO · 2026

Ask me
anything.

I'm Bill Zhang. I build LLM agent systems at Pinterest. On my own time I build voice-first projects, and I've won 36 hackathons. This page is one of the voice projects, so ask it something.

ABOUT

A builder who listens first.

01 / WHO

Most of my work is failure handling.

Latency, interrupted sentences, tool calls that half-fail, a model that answers the wrong question with total confidence. At RingCentral my eval pipeline moved retrieval accuracy from 90% to 95% and dropped human hand-offs from 40% to 13%. Almost all of that came out of the failure cases.

02 / WHAT

Software you can talk to.

A 911 console that triages live calls, a bank you can reach from any phone, a food-rescue network that dispatches by voice, game tape you can question mid-replay. Several of them work over an ordinary phone call.

03 / HOW

One idea, end to end, in 36 hours.

At a hackathon, I focus on getting one idea working. Dispatch AI was a phone line, a fine-tuned triage model, and a dispatcher screen, and it took the $50K grand prize at Berkeley against 900+ participants.

04 / WHY

Talking is the interface most people already have.

A phone call can be easier than navigating an app, and 1.7 billion adults have no bank account to log into in the first place. That is why TalkTuahBank answers an ordinary phone call with no app and no data plan.

PROJECTS · 6 STANDOUTS

Things I shipped.

Curated gallery
Ask by voice for any project, or filter the archive.
Dispatch AI demo still
Grand Prize, UC Berkeley AI Hackathon 2024/dispatchai↗ deep dive

Empathetic 911 dispatcher co-pilot. Aggregates emergency calls, triages severity, extracts context, and keeps humans in control.

#ai#voice#safety#winner2024
AdaptEd demo still
Google Challenge, LA Hacks 2024/adapted↗ deep dive

Lectures that talk back. A voice tutor with Gemini-driven slides and emotion-aware pacing.

#ai#voice#education#winner2024
TalkTuahBank demo still
Grand + Goldman Sachs, HackUTD 2024/talktuahbank↗ deep dive

Voice banking over a regular phone call. No internet, smartphone, or banking app required.

#voice#fintech#ai#winner2024
SlugLoop demo still
MLH GitHub, CruzHacks 2023/slugloop↗ deep dive

Real-time UCSC loop bus tracker. Helped students see live campus bus locations and reduce pressure on metro routes.

#transit#social-good#winner2023
SoundSearch demo still
NLX Overall, AI ATL 2024/soundsearch↗ deep dive

Phone-call voice guidance for complex websites. A caller gets step-by-step spoken help while the page highlights what to do next.

#voice#ai#accessibility#winner2024
SwarmAid demo still
2nd Place, Hack Dearborn 2024/swarmaid↗ deep dive

Decentralized food rescue agents. Matches surplus suppliers to food banks and shelters with real-time logistics planning.

#ai#social-good#winner2024
SCROLL ↓ drives gallery →
6/15 standouts
HACKATHONS · 36 WINS

Thirty-six wins from shipping.

Every one of these was built in a weekend and defended in front of judges. $150k+ in prizes, most of them during college. Top row is the flagship and grand-prize run, bottom row the earlier and smaller ones.

Berkeley AI Hackathon2024Grand Prize · $50kHackUTD2024Grand Prize + Goldman SachsHackDavis2025Best AI/ML HackVTHacks2024Best Startup HackYaleHacks20241st PlaceLAHacks2024Google ChallengeAIATL2023Most Innovative StartupAIATL2024NLX OverallHackMerced2025Letta AI + FinanceSpartaHacks2025SustainabilityCruzHacks2025Niantic WebXRSoCalTechWeek2024Solana UniversityHackMerced2024Letta + FinanceDiamondHacks2024Captain's ClassroomIrvineHacks2024Best Travel HackHackDearborn20242nd PlaceUncommon Hacks2024Programmatic ArtHackDavis2024Best Intel Dev CloudBerkeley AI Hackathon2024Grand Prize · $50kHackUTD2024Grand Prize + Goldman SachsHackDavis2025Best AI/ML HackVTHacks2024Best Startup HackYaleHacks20241st PlaceLAHacks2024Google ChallengeAIATL2023Most Innovative StartupAIATL2024NLX OverallHackMerced2025Letta AI + FinanceSpartaHacks2025SustainabilityCruzHacks2025Niantic WebXRSoCalTechWeek2024Solana UniversityHackMerced2024Letta + FinanceDiamondHacks2024Captain's ClassroomIrvineHacks2024Best Travel HackHackDearborn20242nd PlaceUncommon Hacks2024Programmatic ArtHackDavis2024Best Intel Dev Cloud
QWER Hacks2024Best Google CloudCruzHacks2023MLH GitHubCruzHacks2022QB3 @ UCSCSBHacks2023Student Life HackHackDavis2023Best MongoDB AtlasCitrusHacks2023New FrontiersACMHacks2023Best Global SolutionHackrithmitic2023Best Data ScienceAI Hacks20221st OverallWildHacks20222nd OverallHacks for Hackers20233rd OverallOpportunity Hacks20223rd PlaceWeb3Apps2023Microsoft Cloud + CirclePlanet Unity2023Top 10GraceHacks2022Best MobilePeddieHacks2022Innovation Prize (HS)Funathon2022Participation PrizeFullyHacks20241st PlaceQWER Hacks2024Best Google CloudCruzHacks2023MLH GitHubCruzHacks2022QB3 @ UCSCSBHacks2023Student Life HackHackDavis2023Best MongoDB AtlasCitrusHacks2023New FrontiersACMHacks2023Best Global SolutionHackrithmitic2023Best Data ScienceAI Hacks20221st OverallWildHacks20222nd OverallHacks for Hackers20233rd OverallOpportunity Hacks20223rd PlaceWeb3Apps2023Microsoft Cloud + CirclePlanet Unity2023Top 10GraceHacks2022Best MobilePeddieHacks2022Innovation Prize (HS)Funathon2022Participation PrizeFullyHacks20241st Place
36
Hackathons won
$74k
Largest prize
$150k+
Prizes won
17
Colleges visited
EXPERIENCE

A short, productive career.

Jul 2026 — Now

Software Engineer II

Building and deploying LLM agent systems for internal and partner-facing workflows: agent design, tool use, RAG integration, and production guardrails. Also partnering with product and engineering teams to set the evaluation, quality, and cost bar each solution must clear before launch.

Now
Jun 2025 — Jul 2026

Applied AI Engineer (Forward-Deployed)

Shipped a production multi-agent system automating denied-claim investigations: 3 sub-agents across 20 policy workflows, 300–500 weekly users, up to 20K claims/week. Led agent design for a major news publisher's AI agent, launched publicly in Nov 2025 over a 102-year archive in 13 languages. Owned the LLM-as-judge eval framework that took QA-audit accuracy 64% → 88% and helped close a seven-figure expansion, and cut the cost of a full health-system validation run ~4× ($4.6K → ~$1.2K).

Jun 2023 — Jun 2025

AI Engineer

Joined as a senior AI intern in June 2023 and converted to full-time that August. Built an LLM analytics and evaluation pipeline that grew coverage of 10,000+ weekly support chats from 1–2% to 100% while cutting processing from 8 hours to 1. Rubric-based retrieval scoring and 20 monitoring dashboards lifted accuracy 90% → 95% and dropped human hand-offs 40% → 13%.

Jun 2024 — Dec 2024

Co-founder + CFO

Built an emergency-response AI platform with Berkeley SkyDeck funding, solo-engineering the low-latency voice agent and telephony behind the dispatcher demo: intent routing, emotion signals, structured handoff to responders. Dispatch AI won the $50K Grand Prize at the UC Berkeley AI Hackathon against 900+ participants.

Feb 2023 — Jun 2024

Founder

Founded and shipped UCSC's real-time bus tracker, which served 20,000+ users. Placed Global Top 10 out of 2,000+ projects in the Google Solution Challenge.

Jun 2022 — Dec 2023

CS Instructor + Teaching Assistant

Taught Python through a challenge-based curriculum and coached USACO students from Bronze toward Silver through algorithm practice, debugging, and contest prep.

2023 — 2025+

Hackathon Mainstay

Competed mostly during college; still enter a few events a year. Most of the projects on this page started as weekend builds.

EDUCATION

Three schools, one path.

Click a card to flip it.

USC logo
01 / 03

University of Southern California

M.S. Computer Science, AI Specialization
Aug 2023 — May 2025
USC · NOTES

M.S. Computer Science, AI Specialization

Graduate-level ML, applied AI, agentic systems. Built voice-first products throughout.

UCSC logo
02 / 03

UC Santa Cruz

B.S. Computer Science
Sep 2020 — Mar 2023
UCSC · NOTES

B.S. Computer Science

Finished a 4-year program in 2.5 years. Caught the hackathon bug.

Lynbrook logo
03 / 03

Lynbrook High School

College Prep
2016 — 2020
Lynbrook · NOTES

College Prep

South Bay. First wrote code here.

I buildvoice-firstagents.I care aboutlatency,keeping a human in the loop,and what happenswhen the model is wrong.
RESUME · ONE-PAGER

The printable version.

Same information, one page, no talking required. Read it below or take the PDF; both match what the rest of this site says.

resume.pdf · last updated July 26, 2026
5+
Years building
36
Hackathon wins
9
Voice apps shipped
$150k+
Prizes won
At a glance
  • AI engineer: voice-first agents, multimodal pipelines, real-time inference.
  • Pinterest: LLM agent systems, RAG, production guardrails. Previously Scale AI.
  • USC: M.S. Computer Science, AI specialization.
  • Stack: TypeScript / Python / Rust, Next.js, Retell, Twilio, Mistral, Llama.
Voice tip

“Send me your resume.” → opens the download.

HOW THIS SITE WORKS

A portfolio that talks back.

Ask about a project and the agent can look it up, describe it, and open it on the page. Retell handles the audio; a Python backend runs the agent and sends navigation events to the browser.

01
Mic input

Browser mic stream → Retell client SDK. Low-latency WebRTC pipe to a hosted agent.

02
LLM agent

Retell bridges the audio to a FastAPI backend, where an OpenAI Agents SDK agent runs with this site's content in context and nine registered tools.

03
Tool calls

Agent emits structured tool calls: display_project(id), display_resume_page(), search_projects(query, ...), and six more.

04
VoiceBus

navigation.py turns each display_* call into a navigation metadata event; the browser converts it to a bus command. No prop drilling, no router. Sections opt in.

05
Sections react

Each section subscribes to the events it cares about and animates its own state. The site rearranges itself.

06
Voice reply

The agent says what it did while the scroll is still finishing, so the answer and the page land together.

Voice
  • Retell AI (agent runtime)
  • WebRTC (stream)
  • Custom tool registry
Brain
  • GPT-4 / Claude (selectable)
  • Site-grounded system prompt
  • Function-calling JSON schema
Frame
  • Next.js + React 19
  • Three.js + GLSL bg
  • Framer Motion + GSAP
State
  • VoiceBus pub-sub
  • URL-driven section anchors
  • Per-section local React state
// server: navigation.py turns a display_* tool call into
// { type: "navigation", page: "project", project_id: "dispatchai" }

// browser: metadata event → bus command → scroll
client.on("metadata", ({ metadata }) => {
  const action = metaToNavigationAction(metadata);
  if (!action) return;
  VoiceBus.emit(action.command);
  requestAnimationFrame(() => scrollToSection(action.scrollTo));
});

// every section subscribes to the same bus
VoiceBus.on((cmd) => {
  if (cmd.type === "open")   setOpenId(cmd.id);
  if (cmd.type === "scroll") scrollToSection(cmd.id);
});
off the clock · off the clock · off the clock
drums · piano · good noodles
made in san francisco
OFF THE CLOCK

A few true things.

Bill Zhang
SHOT · 2025 · LA
Finished a 4-year CS degree in 2.5 years.
Won my first hackathon at 17.
Speaks Mandarin and English; building agents in both.
Plays drums and piano when the laptop is closed.
Still chasing the best bowl of noodles in San Francisco.
Would rather talk to software than tap through it. Hence this site.
Try asking the orb: “What does Bill do for fun?”
Tap to talk · or scroll