Bill Zhang
SF · --:--
VOICE-DRIVEN PORTFOLIO · 2026

Ask me
anything.

I'm Bill Zhang. By day I build LLM agents at Pinterest. By night I build software you can talk to, which is how I ended up with 36 hackathon wins. This page is one of those builds. Go on, ask it something.

ABOUT

A builder who listens first.

01 / WHO

Most of my work is failure handling.

Latency, interrupted sentences, tool calls that half-fail, a model that answers the wrong question with total confidence. At Scale AI I shipped a multi-agent system that works through up to 20K denied claims a week, and owned the eval framework that moved audit accuracy from 64% to 88%. Almost all of that came out of the failure cases.

02 / WHAT

Software you can talk to.

A 911 console that triages live calls, a whole bank that runs inside a phone call, a food-rescue network that dispatches by voice, game tape you can question mid-replay. Several of them need nothing but a phone. No app, no internet.

03 / HOW

One idea, end to end, in 36 hours.

At a hackathon I pick one idea and make it actually work. Dispatch AI was a phone line, a fine-tuned triage model, and a dispatcher screen. It won the $25K SkyDeck grand prize at Berkeley against 900+ people, plus a separate $25K investment from AIC.

04 / WHY

Talking is the interface of the future.

Most people can speak several times faster than they type, with a fraction of the effort. And while you talk, your hands are free for whatever else you were doing. That is why this site listens instead of making you click, and why TalkTuahBank handles balances, transfers, and bill pay by voice alone. No app, no data plan.

PROJECTS · 6 STANDOUTS

Things I shipped.

Curated gallery
Ask by voice for any project, or filter the archive.
Dispatch AI demo still
★ Grand Prize, UC Berkeley AI Hackathon 2024/dispatchai↗ deep dive

Empathetic 911 dispatcher co-pilot. Aggregates emergency calls, triages severity, extracts context, and keeps humans in control.

#ai#voice#safety#winner2024
AdaptEd demo still
★ Google Challenge, LA Hacks 2024/adapted↗ deep dive

Lectures that talk back. A voice tutor with Gemini-driven slides and emotion-aware pacing.

#ai#voice#education#winner2024
TalkTuahBank demo still
★ Grand + Goldman Sachs, HackUTD 2024/talktuahbank↗ deep dive

Voice banking over a regular phone call. No internet, smartphone, or banking app required.

#voice#fintech#ai#winner2024
SlugLoop demo still
★ MLH GitHub, CruzHacks 2023/slugloop↗ deep dive

Real-time UCSC loop bus tracker. Helped students see live campus bus locations and reduce pressure on metro routes.

#transit#social-good#winner2023
SoundSearch demo still
★ NLX Overall, AI ATL 2024/soundsearch↗ deep dive

Phone-call voice guidance for complex websites. A caller gets step-by-step spoken help while the page highlights what to do next.

#voice#ai#accessibility#winner2024
SwarmAid demo still
★ 2nd Place, Hack Dearborn 2024/swarmaid↗ deep dive

Decentralized food rescue agents. Matches surplus suppliers to food banks and shelters with real-time logistics planning.

#ai#social-good#winner2024
SCROLL ↓ drives gallery →
6/15 standouts
HACKATHONS · 36 WINS

Thirty-six wins.

Every one of these was a weekend: build it, demo it, win over the judges. All during college. $150k+ in prizes.

Berkeley AI Hackathon2024★ Grand Prize · $25k SkyDeck✦HackUTD2024★ Grand Prize + Goldman Sachs✦HackDavis2025★ Best AI/ML Hack✦VTHacks2024★ Best Startup Hack✦YaleHacks2024★ 1st Place✦LAHacks2024★ Google Challenge✦AIATL2023★ Most Innovative Startup✦AIATL2024★ NLX Overall✦HackMerced2025★ Letta AI + Finance✦SpartaHacks2025★ Sustainability✦CruzHacks2025★ Niantic WebXR✦SoCalTechWeek2024★ Solana University✦HackMerced2024★ Letta + Finance✦DiamondHacks2024★ Captain's Classroom✦IrvineHacks2024★ Best Travel Hack✦HackDearborn2024★ 2nd Place✦Uncommon Hacks2024★ Programmatic Art✦HackDavis2024★ Best Intel Dev Cloud✦Berkeley AI Hackathon2024★ Grand Prize · $25k SkyDeck✦HackUTD2024★ Grand Prize + Goldman Sachs✦HackDavis2025★ Best AI/ML Hack✦VTHacks2024★ Best Startup Hack✦YaleHacks2024★ 1st Place✦LAHacks2024★ Google Challenge✦AIATL2023★ Most Innovative Startup✦AIATL2024★ NLX Overall✦HackMerced2025★ Letta AI + Finance✦SpartaHacks2025★ Sustainability✦CruzHacks2025★ Niantic WebXR✦SoCalTechWeek2024★ Solana University✦HackMerced2024★ Letta + Finance✦DiamondHacks2024★ Captain's Classroom✦IrvineHacks2024★ Best Travel Hack✦HackDearborn2024★ 2nd Place✦Uncommon Hacks2024★ Programmatic Art✦HackDavis2024★ Best Intel Dev Cloud✦
QWER Hacks2024★ Best Google Cloud✦CruzHacks2023★ MLH GitHub✦CruzHacks2022★ QB3 @ UCSC✦SBHacks2023★ Student Life Hack✦HackDavis2023★ Best MongoDB Atlas✦CitrusHacks2023★ New Frontiers✦ACMHacks2023★ Best Global Solution✦Hackrithmitic2023★ Best Data Science✦AI Hacks2022★ 1st Overall✦WildHacks2022★ 2nd Overall✦Hacks for Hackers2023★ 3rd Overall✦Opportunity Hacks2022★ 3rd Place✦Web3Apps2023★ Microsoft Cloud + Circle✦Planet Unity2023★ Top 10✦GraceHacks2022★ Best Mobile✦PeddieHacks2022★ Innovation Prize (HS)✦Funathon2022★ Participation Prize✦FullyHacks2024★ 1st Place✦QWER Hacks2024★ Best Google Cloud✦CruzHacks2023★ MLH GitHub✦CruzHacks2022★ QB3 @ UCSC✦SBHacks2023★ Student Life Hack✦HackDavis2023★ Best MongoDB Atlas✦CitrusHacks2023★ New Frontiers✦ACMHacks2023★ Best Global Solution✦Hackrithmitic2023★ Best Data Science✦AI Hacks2022★ 1st Overall✦WildHacks2022★ 2nd Overall✦Hacks for Hackers2023★ 3rd Overall✦Opportunity Hacks2022★ 3rd Place✦Web3Apps2023★ Microsoft Cloud + Circle✦Planet Unity2023★ Top 10✦GraceHacks2022★ Best Mobile✦PeddieHacks2022★ Innovation Prize (HS)✦Funathon2022★ Participation Prize✦FullyHacks2024★ 1st Place✦
36
Hackathons won
$74k
Largest prize
$150k+
Prizes won
17
Colleges visited
EXPERIENCE

A short, productive career.

Jul 2026 — Now

Software Engineer II

  • Building and deploying LLM agent systems for internal and partner-facing workflows: agent design, tool use, RAG integration, and production guardrails.
  • Partnering with product and engineering teams to set the evaluation, quality, and cost bar each solution must clear before launch.
Now
Jun 2025 — Jul 2026

Applied AI Engineer (Forward-Deployed)

  • Shipped a production multi-agent system that automates denied-claim investigations, with 3 sub-agents covering 20 policy workflows.
  • Scaled it to 300–500 weekly users and up to 20K claims a week.
  • Led agent design for a major news publisher's AI agent, launched publicly in Nov 2025 over a 102-year archive in 13 languages.
  • Owned the LLM-as-judge eval framework that took QA-audit accuracy from 64% → 88% and helped close a seven-figure expansion.
  • Cut the cost of a full health-system validation run about 4× ($4.6K → ~$1.2K).
Jun 2023 — Jun 2025

AI Engineer

  • Joined as a senior AI intern in June 2023 and converted to full-time that August.
  • Built an LLM analytics and evaluation pipeline that grew coverage of 10,000+ weekly support chats from 1–2% to 100%.
  • Cut processing time for that pipeline from 8 hours to 1.
  • Added rubric-based retrieval scoring and 20 monitoring dashboards, lifting accuracy 90% → 95% and dropping human hand-offs 40% → 13%.
Jun 2024 — Dec 2024

Co-founder + CFO

  • Built an emergency-response AI platform with Berkeley SkyDeck funding.
  • Solo-engineered the low-latency voice agent and telephony behind the dispatcher demo: intent routing, emotion signals, and structured handoff to responders.
  • Won the Grand Prize at the UC Berkeley AI Hackathon against 900+ participants.
  • Earned $50K in total investment across two awards: the $25K Berkeley SkyDeck grand prize and a separate $25K investment from AIC.
Feb 2023 — Jun 2024

Founder

  • Founded and shipped UCSC's real-time bus tracker, which served 20,000+ users.
  • Placed Global Top 10 out of 2,000+ projects in the Google Solution Challenge.
Jun 2022 — Dec 2023

CS Instructor + Teaching Assistant

  • Taught Python through a challenge-based curriculum.
  • Coached USACO students from Bronze toward Silver through algorithm practice, debugging, and contest prep.
2023 — 2025+

Hackathon Mainstay

  • Competed mostly during college; still enter a few events a year.
  • Most of the projects on this page started as weekend builds.
  • Judged LA Hacks 2026.
  • Upcoming: confirmed as a judge for the LA Hacks AI Hackathon.
EDUCATION

Three schools, one path.

Click a card to flip it.

USC logo
01 / 03

University of Southern California

M.S. Computer Science, AI Specialization
Aug 2023 — May 2025
USC · NOTES

M.S. Computer Science, AI Specialization

Graduate-level ML, applied AI, agentic systems. Built voice-first products throughout.

UCSC logo
02 / 03

UC Santa Cruz

B.S. Computer Science
Sep 2020 — Mar 2023
UCSC · NOTES

B.S. Computer Science

Finished a 4-year program in 2.5 years. Caught the hackathon bug.

Lynbrook logo
03 / 03

Lynbrook High School

College Prep
2016 — 2020
Lynbrook · NOTES

College Prep

South Bay. Arrived already coding, thanks to an iD Tech camp in middle school.

I buildvoice-firstagents.I care aboutlatency,keeping a human in the loop,and what happenswhen the model is wrong.
RESUME · ONE-PAGER

The printable version.

Same information, one page, no talking required. Read it below or take the PDF; both match what the rest of this site says.

resume.pdf · last updated September 12, 2026
5+
Years building
36
Hackathon wins
9
Voice apps shipped
$150k+
Prizes won
At a glance
  • AI engineer: voice-first agents, multimodal pipelines, real-time inference.
  • Pinterest: LLM agent systems, RAG, production guardrails. Previously Scale AI.
  • USC: M.S. Computer Science, AI specialization.
  • Stack: TypeScript / Python / Rust, Next.js, Retell, Twilio, Mistral, Llama.
Voice tip

“Send me your resume.” → opens the download.

HOW THIS SITE WORKS

A portfolio that talks back.

Ask about a project and the agent looks it up, describes it, and opens it on the page. Retell carries the audio, Deepgram hears you, GPT-5.6 Terra thinks, ElevenLabs talks back. A Python backend runs the agent and tells the browser where to scroll.

01
Mic input

Browser mic → Retell client SDK over WebRTC. Deepgram transcribes the stream as you speak.

02
LLM agent

Retell hands the transcript to a FastAPI backend, where a GPT-5.6 Terra agent (OpenAI Agents SDK) runs with this site's content in context and nine registered tools.

03
Tool calls

Agent emits structured tool calls: display_project(id), display_resume_page(), search_projects(query, ...), and six more.

04
VoiceBus

navigation.py turns each display_* call into a navigation metadata event; the browser converts it to a bus command. No prop drilling, no router. Sections opt in.

05
Sections react

Each section subscribes to the events it cares about and animates its own state. The site rearranges itself.

06
Voice reply

The reply streams back through Retell into an ElevenLabs voice while the scroll is still finishing, so the answer and the page land together.

Voice
  • Retell AI (call runtime, WebRTC)
  • Deepgram speech-to-text
  • ElevenLabs text-to-speech
Brain
  • GPT-5.6 Terra (the agent)
  • GPT-5.6 Luna (call summary)
  • OpenAI Agents SDK, nine tools
  • Site-grounded system prompt
Frame
  • Next.js + React 19
  • Three.js + GLSL bg
  • Framer Motion + GSAP
State
  • VoiceBus pub-sub
  • URL-driven section anchors
  • Per-section local React state
// server: navigation.py turns a display_* tool call into
// { type: "navigation", page: "project", project_id: "dispatchai" }

// browser: metadata event → bus command → scroll
client.on("metadata", ({ metadata }) => {
  const action = metaToNavigationAction(metadata);
  if (!action) return;
  VoiceBus.emit(action.command);
  requestAnimationFrame(() => scrollToSection(action.scrollTo));
});

// every section subscribes to the same bus
VoiceBus.on((cmd) => {
  if (cmd.type === "open")   setOpenId(cmd.id);
  if (cmd.type === "scroll") scrollToSection(cmd.id);
});
off the clock · off the clock · off the clock
drums · piano · good noodles
made in san francisco
OFF THE CLOCK

A few true things.

Bill Zhang
SHOT · 2025 · LA
✦Finished a 4-year CS degree in 2.5 years.
✦Won my first hackathon at 17.
✦Speaks Mandarin and English; building agents in both.
✦Plays drums and piano when the laptop is closed.
✦Still chasing the best bowl of noodles in San Francisco.
✦Convinced everyone gets a personal Jarvis eventually: an AI you just talk to, in real time. Building toward it.
✦Would rather talk to software than tap through it. Hence this site.
› Try asking the orb: “What does Bill do for fun?”
Tap to talk · or scroll