Bill Zhang
SF · --:--
VOICE-DRIVEN PORTFOLIO · 2026

Ask me
anything.

I'm Bill Zhang. By day I build LLM agents at Pinterest. By night I build software you can talk to, which is how I ended up with 36 hackathon wins. This page is one of those builds. Go on, ask it something.

ABOUT

A builder who listens first.

01 / WHO

Most of my work is failure handling.

Latency, interrupted sentences, tool calls that half-fail, a model that answers the wrong question with total confidence. At Scale AI I shipped a multi-agent system that works through up to 20K denied claims a week, and owned the eval framework that moved audit accuracy from 64% to 88%. Almost all of that came out of the failure cases.

02 / WHAT

Software you can talk to.

A 911 console that triages live calls, a whole bank that runs inside a phone call, a food-rescue network that dispatches by voice, game tape you can question mid-replay. Several of them need nothing but a phone. No app, no internet.

03 / HOW

One idea, end to end, in 36 hours.

At a hackathon I pick one idea and make it actually work. Dispatch AI was a phone line, a fine-tuned triage model, and a dispatcher screen. It took the $50K grand prize at Berkeley against 900+ people.

04 / WHY

Talking is the interface of the future.

Most people can speak several times faster than they type, with a fraction of the effort. And while you talk, your hands are free for whatever else you were doing. That is why this site listens instead of making you click, and why TalkTuahBank handles balances, transfers, and bill pay by voice alone. No app, no data plan.

PROJECTS · 6 STANDOUTS

Things I shipped.

Curated gallery
Ask by voice for any project, or filter the archive.
Dispatch AI demo still
Grand Prize, UC Berkeley AI Hackathon 2024/dispatchai↗ deep dive

Empathetic 911 dispatcher co-pilot. Aggregates emergency calls, triages severity, extracts context, and keeps humans in control.

#ai#voice#safety#winner2024
AdaptEd demo still
Google Challenge, LA Hacks 2024/adapted↗ deep dive

Lectures that talk back. A voice tutor with Gemini-driven slides and emotion-aware pacing.

#ai#voice#education#winner2024
TalkTuahBank demo still
Grand + Goldman Sachs, HackUTD 2024/talktuahbank↗ deep dive

Voice banking over a regular phone call. No internet, smartphone, or banking app required.

#voice#fintech#ai#winner2024
SlugLoop demo still
MLH GitHub, CruzHacks 2023/slugloop↗ deep dive

Real-time UCSC loop bus tracker. Helped students see live campus bus locations and reduce pressure on metro routes.

#transit#social-good#winner2023
SoundSearch demo still
NLX Overall, AI ATL 2024/soundsearch↗ deep dive

Phone-call voice guidance for complex websites. A caller gets step-by-step spoken help while the page highlights what to do next.

#voice#ai#accessibility#winner2024
SwarmAid demo still
2nd Place, Hack Dearborn 2024/swarmaid↗ deep dive

Decentralized food rescue agents. Matches surplus suppliers to food banks and shelters with real-time logistics planning.

#ai#social-good#winner2024
SCROLL ↓ drives gallery →
6/15 standouts
HACKATHONS · 36 WINS

Thirty-six wins.

Every one of these was a weekend: build it, demo it, win over the judges. All during college. $150k+ in prizes.

Berkeley AI Hackathon2024Grand Prize · $50kHackUTD2024Grand Prize + Goldman SachsHackDavis2025Best AI/ML HackVTHacks2024Best Startup HackYaleHacks20241st PlaceLAHacks2024Google ChallengeAIATL2023Most Innovative StartupAIATL2024NLX OverallHackMerced2025Letta AI + FinanceSpartaHacks2025SustainabilityCruzHacks2025Niantic WebXRSoCalTechWeek2024Solana UniversityHackMerced2024Letta + FinanceDiamondHacks2024Captain's ClassroomIrvineHacks2024Best Travel HackHackDearborn20242nd PlaceUncommon Hacks2024Programmatic ArtHackDavis2024Best Intel Dev CloudBerkeley AI Hackathon2024Grand Prize · $50kHackUTD2024Grand Prize + Goldman SachsHackDavis2025Best AI/ML HackVTHacks2024Best Startup HackYaleHacks20241st PlaceLAHacks2024Google ChallengeAIATL2023Most Innovative StartupAIATL2024NLX OverallHackMerced2025Letta AI + FinanceSpartaHacks2025SustainabilityCruzHacks2025Niantic WebXRSoCalTechWeek2024Solana UniversityHackMerced2024Letta + FinanceDiamondHacks2024Captain's ClassroomIrvineHacks2024Best Travel HackHackDearborn20242nd PlaceUncommon Hacks2024Programmatic ArtHackDavis2024Best Intel Dev Cloud
QWER Hacks2024Best Google CloudCruzHacks2023MLH GitHubCruzHacks2022QB3 @ UCSCSBHacks2023Student Life HackHackDavis2023Best MongoDB AtlasCitrusHacks2023New FrontiersACMHacks2023Best Global SolutionHackrithmitic2023Best Data ScienceAI Hacks20221st OverallWildHacks20222nd OverallHacks for Hackers20233rd OverallOpportunity Hacks20223rd PlaceWeb3Apps2023Microsoft Cloud + CirclePlanet Unity2023Top 10GraceHacks2022Best MobilePeddieHacks2022Innovation Prize (HS)Funathon2022Participation PrizeFullyHacks20241st PlaceQWER Hacks2024Best Google CloudCruzHacks2023MLH GitHubCruzHacks2022QB3 @ UCSCSBHacks2023Student Life HackHackDavis2023Best MongoDB AtlasCitrusHacks2023New FrontiersACMHacks2023Best Global SolutionHackrithmitic2023Best Data ScienceAI Hacks20221st OverallWildHacks20222nd OverallHacks for Hackers20233rd OverallOpportunity Hacks20223rd PlaceWeb3Apps2023Microsoft Cloud + CirclePlanet Unity2023Top 10GraceHacks2022Best MobilePeddieHacks2022Innovation Prize (HS)Funathon2022Participation PrizeFullyHacks20241st Place
36
Hackathons won
$74k
Largest prize
$150k+
Prizes won
17
Colleges visited
EXPERIENCE

A short, productive career.

Jul 2026 — Now

Software Engineer II

  • Building and deploying LLM agent systems for internal and partner-facing workflows: agent design, tool use, RAG integration, and production guardrails.
  • Partnering with product and engineering teams to set the evaluation, quality, and cost bar each solution must clear before launch.
Now
Jun 2025 — Jul 2026

Applied AI Engineer (Forward-Deployed)

  • Shipped a production multi-agent system that automates denied-claim investigations, with 3 sub-agents covering 20 policy workflows.
  • Scaled it to 300–500 weekly users and up to 20K claims a week.
  • Led agent design for a major news publisher's AI agent, launched publicly in Nov 2025 over a 102-year archive in 13 languages.
  • Owned the LLM-as-judge eval framework that took QA-audit accuracy from 64% → 88% and helped close a seven-figure expansion.
  • Cut the cost of a full health-system validation run about 4× ($4.6K → ~$1.2K).
Jun 2023 — Jun 2025

AI Engineer

  • Joined as a senior AI intern in June 2023 and converted to full-time that August.
  • Built an LLM analytics and evaluation pipeline that grew coverage of 10,000+ weekly support chats from 1–2% to 100%.
  • Cut processing time for that pipeline from 8 hours to 1.
  • Added rubric-based retrieval scoring and 20 monitoring dashboards, lifting accuracy 90% → 95% and dropping human hand-offs 40% → 13%.
Jun 2024 — Dec 2024

Co-founder + CFO

  • Built an emergency-response AI platform with Berkeley SkyDeck funding.
  • Solo-engineered the low-latency voice agent and telephony behind the dispatcher demo: intent routing, emotion signals, and structured handoff to responders.
  • Won the $50K Grand Prize at the UC Berkeley AI Hackathon against 900+ participants.
Feb 2023 — Jun 2024

Founder

  • Founded and shipped UCSC's real-time bus tracker, which served 20,000+ users.
  • Placed Global Top 10 out of 2,000+ projects in the Google Solution Challenge.
Jun 2022 — Dec 2023

CS Instructor + Teaching Assistant

  • Taught Python through a challenge-based curriculum.
  • Coached USACO students from Bronze toward Silver through algorithm practice, debugging, and contest prep.
2023 — 2025+

Hackathon Mainstay

  • Competed mostly during college; still enter a few events a year.
  • Most of the projects on this page started as weekend builds.
EDUCATION

Three schools, one path.

Click a card to flip it.

USC logo
01 / 03

University of Southern California

M.S. Computer Science, AI Specialization
Aug 2023 — May 2025
USC · NOTES

M.S. Computer Science, AI Specialization

Graduate-level ML, applied AI, agentic systems. Built voice-first products throughout.

UCSC logo
02 / 03

UC Santa Cruz

B.S. Computer Science
Sep 2020 — Mar 2023
UCSC · NOTES

B.S. Computer Science

Finished a 4-year program in 2.5 years. Caught the hackathon bug.

Lynbrook logo
03 / 03

Lynbrook High School

College Prep
2016 — 2020
Lynbrook · NOTES

College Prep

South Bay. First wrote code here.

I buildvoice-firstagents.I care aboutlatency,keeping a human in the loop,and what happenswhen the model is wrong.
RESUME · ONE-PAGER

The printable version.

Same information, one page, no talking required. Read it below or take the PDF; both match what the rest of this site says.

resume.pdf · last updated July 26, 2026
5+
Years building
36
Hackathon wins
9
Voice apps shipped
$150k+
Prizes won
At a glance
  • AI engineer: voice-first agents, multimodal pipelines, real-time inference.
  • Pinterest: LLM agent systems, RAG, production guardrails. Previously Scale AI.
  • USC: M.S. Computer Science, AI specialization.
  • Stack: TypeScript / Python / Rust, Next.js, Retell, Twilio, Mistral, Llama.
Voice tip

“Send me your resume.” → opens the download.

HOW THIS SITE WORKS

A portfolio that talks back.

Ask about a project and the agent looks it up, describes it, and opens it on the page. Retell carries the audio, Deepgram hears you, GPT-5.6 Terra thinks, ElevenLabs talks back. A Python backend runs the agent and tells the browser where to scroll.

01
Mic input

Browser mic → Retell client SDK over WebRTC. Deepgram transcribes the stream as you speak.

02
LLM agent

Retell hands the transcript to a FastAPI backend, where a GPT-5.6 Terra agent (OpenAI Agents SDK) runs with this site's content in context, nine registered tools, and a jailbreak guardrail in front.

03
Tool calls

Agent emits structured tool calls: display_project(id), display_resume_page(), search_projects(query, ...), and six more.

04
VoiceBus

navigation.py turns each display_* call into a navigation metadata event; the browser converts it to a bus command. No prop drilling, no router. Sections opt in.

05
Sections react

Each section subscribes to the events it cares about and animates its own state. The site rearranges itself.

06
Voice reply

The reply streams back through Retell into an ElevenLabs voice while the scroll is still finishing, so the answer and the page land together.

Voice
  • Retell AI (call runtime, WebRTC)
  • Deepgram speech-to-text
  • ElevenLabs text-to-speech
Brain
  • GPT-5.6 Terra (the agent)
  • GPT-5.6 Luna (guardrail + call summary)
  • OpenAI Agents SDK, nine tools
  • Site-grounded system prompt
Frame
  • Next.js + React 19
  • Three.js + GLSL bg
  • Framer Motion + GSAP
State
  • VoiceBus pub-sub
  • URL-driven section anchors
  • Per-section local React state
// server: navigation.py turns a display_* tool call into
// { type: "navigation", page: "project", project_id: "dispatchai" }

// browser: metadata event → bus command → scroll
client.on("metadata", ({ metadata }) => {
  const action = metaToNavigationAction(metadata);
  if (!action) return;
  VoiceBus.emit(action.command);
  requestAnimationFrame(() => scrollToSection(action.scrollTo));
});

// every section subscribes to the same bus
VoiceBus.on((cmd) => {
  if (cmd.type === "open")   setOpenId(cmd.id);
  if (cmd.type === "scroll") scrollToSection(cmd.id);
});
off the clock · off the clock · off the clock
drums · piano · good noodles
made in san francisco
OFF THE CLOCK

A few true things.

Bill Zhang
SHOT · 2025 · LA
Finished a 4-year CS degree in 2.5 years.
Won my first hackathon at 17.
Speaks Mandarin and English; building agents in both.
Plays drums and piano when the laptop is closed.
Still chasing the best bowl of noodles in San Francisco.
Convinced everyone gets a personal Jarvis eventually: an AI you just talk to, in real time. Building toward it.
Would rather talk to software than tap through it. Hence this site.
Try asking the orb: “What does Bill do for fun?”
Tap to talk · or scroll