Intro · 5:13
What voice agents are
Voice agents explained and what we'll build.
- Voice agents talk to callers using AI.
- Speech-to-text → LLM → text-to-speech.
- Build two agents today.
| Stage | Tech |
|---|---|
| Hear | Speech-to-text |
| Think | LLM |
| Speak | Text-to-speech |
Do this in your own tools, step by step. Ticks are saved on this device.
Pipeline?
STT, LLM, TTS.
What do they do?
Talk to callers.
0:00 And I'm going to show you guys that when we combine Vappy with Nodn, the possibilities are pretty much endless. [music] So, to start off, what is Vapy? Vapi is a noode platform that lets you build voice AI agents. And if you've never really heard the term voice agents before, it's basically just a virtual assistant that can have natural real-time conversations with people over the phone or on websites. And really, the only difference between a voice agent and a chatbot is that a voice agent uses voice instead of text.
0:22 These agents can make and receive phone calls. They can have natural conversations with users, and they can integrate into all of your existing systems. So, they can do things like appointment scheduling, customer support, sales calls, and more. So before we get into the actual building today, I did want to go over a few things at a high level so that we're all on the same page about how voice agents work. Essentially, there are three core components that go into voice agents.
0:45 We have speech to text, we have the large language model, and we have text to speech. And just think about it like this. When you're talking to your chatbt or your anthropic claude, what happens is you text something, the large language model interprets it and then responds to you. And that all happens in text. So the only thing we're actually changing here is the input and output. So the voice agent will take our speech, turn it into text.
1:08 The large language model will process it and it will output a text response. But then the agent will just turn that text response into speech and it happens real time with minimal latency. So no need to over complicate voice agents at their core. It's just an LLM the same way you would build one in NN or the same way you talk to chatbt except for we use speech rather than text. And now let's real quick break down the anatomy of a voice agent.
1:31 So there's four main parts I want you guys to think about. Obviously, we have the large language model, which is the brain of the AI agent. And we can use top models that you're already used to like OpenAI, Google or Anthropic. Then we have the system prompt, of course, which is like the playbook or the script for your agent. You write out the agents instructions. You define its personality and certain rules. We also have the actual voice.
1:54 So, you can choose from tons of different voice models. You can use 11 Labs, other providers, stuff like that. This can be male, female, young, old, British, American, whatever you want. Then finally, we have the tools, which is where all of the magic actually happens because tools let our agents do things. So, real quick example, let's say you're going into a dentist and you are building them a voice agent system. We could choose something like GPT40 as our large language model to run the entire agent to be the brain.
2:17 We would give it a system prompt as far as what is your role, what company do you work for, what do you do when people call in, what tools do you have, what is your end goal, and ultimately the end goal would be to help people book appointments. We would also give it a voice of course and then we would give it different tools. So it would need access to view the calendar. It would need access to make events on the calendar.
2:41 Maybe even need access to sending emails, stuff like that. And real quick, if you're not familiar with NAND, it is a noode automation platform that lets you visually build workflows. And what's really cool is you can have Vappy being the voice agent and you can have Vappy trigger any of your NAN workflows as tools. So anything that you build in Naden as a custom agent or a custom workflow, you can now have a Vappy Voice agent trigger that and use that.
3:03 So why would you want to connect them together? Because you can of course supercharge your agents and have them do anything that's possible with automation because in any you can connect to essentially anything. So you could have agents that instead of just answering questions could book appointments in Google Calendar or Air Table, look up customer information, send email confirmations, trigger payment processes, manage tasks, stuff like that. Now, there are two main types of voice agents, maybe three.
3:27 I'll explain the bonus one in a sec, but we have inbound versus outbound. So, inbound basically just means someone will call this number and then a voice agent will pick it up. These are great for handling things like customer support, answering questions, scheduling, managing orders whenever someone reaches out to your business first. And then we also have outbound agents. These are ones that proactively call people. So, some common use cases for outbound agents could be sales outreach, appointment reminders, collecting feedback, surveys, marketing campaigns, stuff like that.
3:49 And then the third bonus one I was going to say is basically an inbound one, but if you've ever been on a website and there's like a little chat widget in the bottom right and that's actually a voice agent, I would pretty much consider that inbound since a consumer would click on it to initiate that phone call. But just thought I'd also throw out there that it doesn't have to be a phone number. It could also be a website widget.
4:12 And why do I think that you should be learning this now? The voice agent space is going to blow up in 2026. There's lots of opportunities. There's very clear ROI and you can have a lot of impact if you know how to build voice agents. So, that's enough of the boring slides that I had prepared for today. We're going to jump into Vappy and Nitn and we're going to start to do some stuff, but I wanted to real quick tell you what we're going to be building today.
4:36 I'm going to show you guys how to set up Vappy. We're going to talk about prompting and stuff like that. I'm going to show you guys how you can give a voice agent a knowledge base super easily so you can load in a bunch of information about you and your business. So, now it has that. I'm also going to show you guys how we can connect tools to our AI agent so it can do things like, you know, check the calendar and create events and stuff like that.
4:58 And then I'm going to show you how you can automate all of your end of call reports so you can automatically see what was talked about and what actions had been taken. So, if that all sounds good to you, let's head over to Vappy and get started. All right, so here we are on Vapy and you can actually see right here is an example of one of those website widget voice agents where you could talk to Vappy right here.
4:58 But
Get the other 9 chapters, the exam and your certificate for LinkedIn, plus all 700+ AI courses.