How I'm building an AI Email Virtual Assistant (Pregnant Woman at Nandos)

all right this is my daily update for my all right this is my daily update for my all right this is my daily update for my build and public log it is December build and public log it is December build and public log it is December 27th 2024 uh the year is almost over 2024 uh the year is almost over 2024 uh the year is almost over um so I have been back in California for um so I have been back in California for um so I have been back in California for nine months nine months and it made me nine months nine months and it made me nine months nine months and it made me think of my random story for today so if think of my random story for today so if think of my random story for today so if you don’t want to hear my crazy random you don’t want to hear my crazy random you don’t want to hear my crazy random I’m sorry fast forward I’m sorry fast forward I’m sorry fast forward uh so one time I was living in South uh so one time I was living in South uh so one time I was living in South Africa for a while Cape Africa for a while Cape Africa for a while Cape Town and uh you know a bachelor Town and uh you know a bachelor Town and uh you know a bachelor traveling the world so I did what any traveling the world so I did what any traveling the world so I did what any bachelor Nomad does you fire up tnder or bachelor Nomad does you fire up tnder or bachelor Nomad does you fire up tnder or whatever dating app of the month and you whatever dating app of the month and you whatever dating app of the month and you know you start meeting people this is know you start meeting people this is know you start meeting people this is what you what you what you do so uh I started chatting with this do so uh I started chatting with this do so uh I started chatting with this woman in South Africa in Cape Town woman in South Africa in Cape Town woman in South Africa in Cape Town and I was very new to the city and she and I was very new to the city and she and I was very new to the city and she suggested we go to Nando so if you’re suggested we go to Nando so if you’re suggested we go to Nando so if you’re unfamiliar with um British culture which unfamiliar with um British culture which unfamiliar with um British culture which I was at that point ironically I went to I was at that point ironically I went to I was at that point ironically I went to the UK last before going to all the the UK last before going to all the the UK last before going to all the commonwealth countries or good deal of commonwealth countries or good deal of commonwealth countries or good deal of them and anyone who doesn’t know what them and anyone who doesn’t know what them and anyone who doesn’t know what Nando is it think of it as kind of like Nando is it think of it as kind of like Nando is it think of it as kind of like an upscale an upscale an upscale chicken place that has like all kinds of chicken place that has like all kinds of chicken place that has like all kinds of different chickens but like it’s kind of different chickens but like it’s kind of different chickens but like it’s kind of almost like a sitdown restaurant almost like a sitdown restaurant almost like a sitdown restaurant sometimes there’s a wa like a waitress sometimes there’s a wa like a waitress sometimes there’s a wa like a waitress or waiter but it’s also like kind of low or waiter but it’s also like kind of low or waiter but it’s also like kind of low brow you know middle class kind of food brow you know middle class kind of food brow you know middle class kind of food it’s not not fancy it’s not quite KFC it’s not not fancy it’s not quite KFC it’s not not fancy it’s not quite KFC but it’s not quite uh that bad but it’s but it’s not quite uh that bad but it’s but it’s not quite uh that bad but it’s also not like you know it’s like a a also not like you know it’s like a a also not like you know it’s like a a franchise chain kind of place pretty franchise chain kind of place pretty franchise chain kind of place pretty notorious in in the UK I didn’t know notorious in in the UK I didn’t know notorious in in the UK I didn’t know what nandas was so I so oh yeah sure what nandas was so I so oh yeah sure what nandas was so I so oh yeah sure okay let’s go meet and you know I I walk okay let’s go meet and you know I I walk okay let’s go meet and you know I I walk in and I see this woman sitting there in and I see this woman sitting there in and I see this woman sitting there she stands up my jaw drops she’s like she stands up my jaw drops she’s like she stands up my jaw drops she’s like nine months nine months nine months pregnant what pregnant what pregnant what you yeah you left out a very key you yeah you left out a very key you yeah you left out a very key important detail in your profile there important detail in your profile there important detail in your profile there turns out she was I don’t know like turns out she was I don’t know like turns out she was I don’t know like eight or nine months pregnant recently eight or nine months pregnant recently eight or nine months pregnant recently divorced and I was uh divorced and I was uh divorced and I was uh yeah that was my first Nando experience yeah that was my first Nando experience yeah that was my first Nando experience um let’s just say I didn’t stay for the um let’s just say I didn’t stay for the um let’s just say I didn’t stay for the stay very long and I had no chicken I I stay very long and I had no chicken I I stay very long and I had no chicken I I kind of got out of there as fast as I kind of got out of there as fast as I kind of got out of there as fast as I could which is a shame I I ended up kind could which is a shame I I ended up kind could which is a shame I I ended up kind of liking nandos when I lived in London of liking nandos when I lived in London of liking nandos when I lived in London but uh yeah I was I was mortified to see but uh yeah I was I was mortified to see but uh yeah I was I was mortified to see that she was you that she was you that she was you know about to have a child practically know about to have a child practically know about to have a child practically um no really I don’t I think she had um no really I don’t I think she had um no really I don’t I think she had like a month left or something but like a month left or something but like a month left or something but uh yeah no wasn’t a good fit wasn’t a uh yeah no wasn’t a good fit wasn’t a uh yeah no wasn’t a good fit wasn’t a good match let’s just put it that way good match let’s just put it that way good match let’s just put it that way but uh South Africa is a beautiful but uh South Africa is a beautiful but uh South Africa is a beautiful country I I love South Africa it’s country I I love South Africa it’s country I I love South Africa it’s a it has a lot of problems there’s a lot a it has a lot of problems there’s a lot a it has a lot of problems there’s a lot of social economical political issues a of social economical political issues a of social economical political issues a lot of lot of dark you know history but lot of lot of dark you know history but lot of lot of dark you know history but if you look at the people you look at if you look at the people you look at if you look at the people you look at the look at the nature from that point the look at the nature from that point the look at the nature from that point of view it’s a pretty cool country um I of view it’s a pretty cool country um I of view it’s a pretty cool country um I I wish they were doing better but it’s I wish they were doing better but it’s I wish they were doing better but it’s such a unique beautiful country you you such a unique beautiful country you you such a unique beautiful country you you go to the beach and you see literally go to the beach and you see literally go to the beach and you see literally great white sharks and whales in the great white sharks and whales in the great white sharks and whales in the water uh and then Penguins on the beach water uh and then Penguins on the beach water uh and then Penguins on the beach and then you drive you know up the road and then you drive you know up the road and then you drive you know up the road a few hours and you see zebras lions a few hours and you see zebras lions a few hours and you see zebras lions cheetahs I mean all in one little cheetahs I mean all in one little cheetahs I mean all in one little country it’s it’s a really really cool country it’s it’s a really really cool country it’s it’s a really really cool uh country so and the people are pretty uh country so and the people are pretty uh country so and the people are pretty fun uh they could be pretty wild uh it’s fun uh they could be pretty wild uh it’s fun uh they could be pretty wild uh it’s fun but yeah the the the history is fun but yeah the the the history is fun but yeah the the the history is unfortunately um a dark history with that country but um a dark history with that country but um a dark history with that country but you know it is uh still worth seeing I you know it is uh still worth seeing I you know it is uh still worth seeing I think and honestly truthfully the think and honestly truthfully the think and honestly truthfully the country the economy can really use a country the economy can really use a country the economy can really use a boost from from people going and boost from from people going and boost from from people going and visiting so I I really hope the country visiting so I I really hope the country visiting so I I really hope the country does better in the future but uh does better in the future but uh does better in the future but uh anyways anyways anyways uh so on to onto the business uh so on to onto the business uh so on to onto the business so uh there’s once again a lot of guests so uh there’s once again a lot of guests so uh there’s once again a lot of guests from out of town out of country out of from out of town out of country out of from out of town out of country out of state here uh there’s dogs going crazy state here uh there’s dogs going crazy state here uh there’s dogs going crazy out there there’s a baby a toddler it’s out there there’s a baby a toddler it’s out there there’s a baby a toddler it’s it’s been hard to get a lot of good it’s been hard to get a lot of good it’s been hard to get a lot of good Focus for but I managed to get make some Focus for but I managed to get make some Focus for but I managed to get make some really good progress especially on the really good progress especially on the really good progress especially on the agents part so agents part so agents part so uh no updates on uh no updates on uh no updates on revenue or users um revenue or users um revenue or users um but I am making it actually worthwhile but I am making it actually worthwhile but I am making it actually worthwhile to get the get both those things so let to get the get both those things so let to get the get both those things so let me just briefly explain what I worked on me just briefly explain what I worked on me just briefly explain what I worked on so I added a q okay so um how it works so I added a q okay so um how it works so I added a q okay so um how it works is so when somebody emails the service is so when somebody emails the service is so when somebody emails the service you you get assigned a unique address you you get assigned a unique address you you get assigned a unique address but you can just email this so when you but you can just email this so when you but you can just email this so when you when you when you send an email when you when you send an email when you when you send an email here what happens is a here what happens is a here what happens is a request get sent to the server so your request get sent to the server so your request get sent to the server so your email gets sent to the server okay and email gets sent to the server okay and email gets sent to the server okay and then it validates it it says hey are you are it validates it it says hey are you are it validates it it says hey are you are you a real user because I can’t just you a real user because I can’t just you a real user because I can’t just send an email back to anybody if you send an email back to anybody if you send an email back to anybody if you didn’t opt in I cannot I like because of didn’t opt in I cannot I like because of didn’t opt in I cannot I like because of anti- spam regulation and rules I can anti- spam regulation and rules I can anti- spam regulation and rules I can just send an email back like if you were just send an email back like if you were just send an email back like if you were to send an email to is I’m going to to send an email to is I’m going to to send an email to is I’m going to ignore you unless you’ve actually opt it ignore you unless you’ve actually opt it ignore you unless you’ve actually opt it in you have a real user account you’re in you have a real user account you’re in you have a real user account you’re either on a trial or you’re actually like a paid trial or you’re actually like a paid trial or you’re actually like a paid user user user okay so first it does some checks then okay so first it does some checks then okay so first it does some checks then it it it goes what I added is it then goes what I added is it then goes what I added is it then adds your email to a big CU so let’s adds your email to a big CU so let’s adds your email to a big CU so let’s think of think a big line think of think think of think a big line think of think think of think a big line think of think about it if 10,000 people sent an email about it if 10,000 people sent an email about it if 10,000 people sent an email at the same time you need to gracefully at the same time you need to gracefully at the same time you need to gracefully handle that so uh hopefully hopefully I handle that so uh hopefully hopefully I handle that so uh hopefully hopefully I need to do like serious load testing on need to do like serious load testing on need to do like serious load testing on this hopefully this doesn’t fall down this hopefully this doesn’t fall down this hopefully this doesn’t fall down you know if 10,000 people emailed this you know if 10,000 people emailed this you know if 10,000 people emailed this at the same time I need to test that at the same time I need to test that at the same time I need to test that more thoroughly but uh the idea is the more thoroughly but uh the idea is the more thoroughly but uh the idea is the heavy processing you know kicking off heavy processing you know kicking off heavy processing you know kicking off agents um you know sending it to chat agents um you know sending it to chat agents um you know sending it to chat GPT you know creating the email sending GPT you know creating the email sending GPT you know creating the email sending it back to the US all of that is very it back to the US all of that is very it back to the US all of that is very intensive and you don’t want that to intensive and you don’t want that to intensive and you don’t want that to happen on a little server like 10,000 happen on a little server like 10,000 happen on a little server like 10,000 times what you want is to put that in times what you want is to put that in times what you want is to put that in into a queue this does very little stuff into a queue this does very little stuff into a queue this does very little stuff like okay fine it’s probably going to be like okay fine it’s probably going to be like okay fine it’s probably going to be okay unless it you know you have really okay unless it you know you have really okay unless it you know you have really really serious really serious really serious usage and the important part is this usage and the important part is this usage and the important part is this needs to respond back very quickly it needs to respond back very quickly it needs to respond back very quickly it needs to say yes okay I got your email needs to say yes okay I got your email needs to say yes okay I got your email good stop stop sending your the emails good stop stop sending your the emails good stop stop sending your the emails so it’s important to to respond right so it’s important to to respond right so it’s important to to respond right away to the ser service here that is away to the ser service here that is away to the ser service here that is actually uh sending the email actually uh sending the email actually uh sending the email data okay so that’s what I did I added a data okay so that’s what I did I added a data okay so that’s what I did I added a queue um and the queue puts it in order queue um and the queue puts it in order queue um and the queue puts it in order and slowly you know as the server and slowly you know as the server and slowly you know as the server obviously can handle it it will process obviously can handle it it will process obviously can handle it it will process them now this could be scaled up and you them now this could be scaled up and you them now this could be scaled up and you could have like a lot of could have like a lot of could have like a lot of servers doing this like handling the servers doing this like handling the servers doing this like handling the queue if you need to so that’s why it’s queue if you need to so that’s why it’s queue if you need to so that’s why it’s important to have this kind of important to have this kind of important to have this kind of architecture so you can you can architecture so you can you can architecture so you can you can scale scale scale um it’s a bit more complicated because um it’s a bit more complicated because um it’s a bit more complicated because there is some datab database interaction there is some datab database interaction there is some datab database interaction so obviously if you need to scale it so obviously if you need to scale it so obviously if you need to scale it could get more complicated but I’m could get more complicated but I’m could get more complicated but I’m keeping it simple for now there’s a keeping it simple for now there’s a keeping it simple for now there’s a there’s now a there’s now a there’s now a Q and then it processes and then it Q and then it processes and then it Q and then it processes and then it figures out what to do so what I’m figures out what to do so what I’m figures out what to do so what I’m adding right adding right adding right now is the new functionality for all the now is the new functionality for all the now is the new functionality for all the agents the agent agents the agent agents the agent router so what the agent router does is router so what the agent router does is router so what the agent router does is that that that um it actually uses AI of course to look um it actually uses AI of course to look um it actually uses AI of course to look at the email and all the context so it’s at the email and all the context so it’s at the email and all the context so it’s is this like is this a big email thread is this like is this a big email thread is this like is this a big email thread what are they asking for so it doesn’t what are they asking for so it doesn’t what are they asking for so it doesn’t read the thread but it sees that it is a read the thread but it sees that it is a read the thread but it sees that it is a thread and it’s going to send a request thread and it’s going to send a request thread and it’s going to send a request to an llm chat to an llm chat to an llm chat jpt that asks okay what what’s the jpt that asks okay what what’s the jpt that asks okay what what’s the intention what does the user want here intention what does the user want here intention what does the user want here okay this is a thread and they’re saying okay this is a thread and they’re saying okay this is a thread and they’re saying summarize the thread obviously that’s summarize the thread obviously that’s summarize the thread obviously that’s going to go to the agent that is going to go to the agent that is going to go to the agent that is responsible for summarizing the thread responsible for summarizing the thread responsible for summarizing the thread and doing whatever they ask for are they and doing whatever they ask for are they and doing whatever they ask for are they asking to schedule an event and send asking to schedule an event and send asking to schedule an event and send calendar invites is there multiple calendar invites is there multiple calendar invites is there multiple people like on the on the email and people like on the on the email and people like on the on the email and they’re saying hey schedule a meeting they’re saying hey schedule a meeting they’re saying hey schedule a meeting obviously they want to schedule a obviously they want to schedule a obviously they want to schedule a meeting go and go route to the meeting go and go route to the meeting go and go route to the um you know go route to the scheduling agent do they want to go look up some agent do they want to go look up some agent do they want to go look up some data do you needed to go do some data do you needed to go do some data do you needed to go do some research okay then obviously route that research okay then obviously route that research okay then obviously route that to the research agent which actually is to the research agent which actually is to the research agent which actually is going to crawl the Internet it’s going to crawl the Internet it’s going to crawl the Internet it’s actually going to search and do real actually going to search and do real actually going to search and do real things more on that more to come on that things more on that more to come on that things more on that more to come on that later so I got the later so I got the later so I got the queue that that’s in place that’s that’s queue that that’s in place that’s that’s queue that that’s in place that’s that’s the kind of the the kind of the the kind of the foundational piece that I needed to do foundational piece that I needed to do foundational piece that I needed to do to actually like be able to kick off to actually like be able to kick off to actually like be able to kick off agents order in in an orderly fashion agents order in in an orderly fashion agents order in in an orderly fashion without overloading the S server you without overloading the S server you without overloading the S server you know like I said if thousands of know like I said if thousands of know like I said if thousands of requests come in you don’t want the requests come in you don’t want the requests come in you don’t want the thousands of Agents just instantly you thousands of Agents just instantly you thousands of Agents just instantly you know trying to trying to spin up and do know trying to trying to spin up and do know trying to trying to spin up and do things you need to do that in an orderly things you need to do that in an orderly things you need to do that in an orderly fashion like okay step by step one by fashion like okay step by step one by fashion like okay step by step one by one by one by one by one uh and yeah that’s looking promising one uh and yeah that’s looking promising one uh and yeah that’s looking promising so I need to do a bit more work here and so I need to do a bit more work here and so I need to do a bit more work here and as soon as that piece is done which is as soon as that piece is done which is as soon as that piece is done which is working I have it working how it works working I have it working how it works working I have it working how it works now very boring you it just routes it to now very boring you it just routes it to now very boring you it just routes it to to an to an to an llm I have that working so it still is llm I have that working so it still is llm I have that working so it still is working as it has for everybody at this working as it has for everybody at this working as it has for everybody at this point it’s not deployed yet but that point it’s not deployed yet but that point it’s not deployed yet but that seems to be working fine so the next seems to be working fine so the next seems to be working fine so the next piece is to build out these one thing I piece is to build out these one thing I piece is to build out these one thing I want to do is want to do is want to do is I I hate I I hate I I hate how the llms the popular ones um chat PT how the llms the popular ones um chat PT how the llms the popular ones um chat PT is pretty bad Claud is really really bad is pretty bad Claud is really really bad is pretty bad Claud is really really bad uh even even the meta one I hate how it uh even even the meta one I hate how it uh even even the meta one I hate how it treats you like a five-year-old child treats you like a five-year-old child treats you like a five-year-old child you asking anything kind of risque at you asking anything kind of risque at you asking anything kind of risque at all and it just says oh I can’t you know all and it just says oh I can’t you know all and it just says oh I can’t you know I’m not gonna I’m not going to respond I’m not gonna I’m not going to respond I’m not gonna I’m not going to respond to that I that drives me absolutely nuts to that I that drives me absolutely nuts to that I that drives me absolutely nuts my service is not going to do that one my service is not going to do that one my service is not going to do that one AG so the first agents I’m going to AG so the first agents I’m going to AG so the first agents I’m going to do is schedule do is schedule do is schedule that’s one I’ve needed a lot that’s one I’ve needed a lot that’s one I’ve needed a lot recently and it’s going to route recently and it’s going to route recently and it’s going to route to an llm that is actually going to to an llm that is actually going to to an llm that is actually going to respond if you ask it something risky so respond if you ask it something risky so respond if you ask it something risky so obviously uh the ex Elon Musk his xai obviously uh the ex Elon Musk his xai obviously uh the ex Elon Musk his xai grock that one is willing to answer grock that one is willing to answer grock that one is willing to answer number one it’s number one it answers number one it’s number one it answers number one it’s number one it answers more real time stuff because it actually more real time stuff because it actually more real time stuff because it actually looks at Twitter live which is really looks at Twitter live which is really looks at Twitter live which is really really cool so if you’re going to ask really cool so if you’re going to ask really cool so if you’re going to ask something that is is extremely up to the something that is is extremely up to the something that is is extremely up to the minute it’ll go there if you ask it minute it’ll go there if you ask it minute it’ll go there if you ask it something really risque that um chachu something really risque that um chachu something really risque that um chachu PT is going to be like no I I don’t want PT is going to be like no I I don’t want PT is going to be like no I I don’t want to um respond then it’s going to Route to um respond then it’s going to Route to um respond then it’s going to Route it there but it’s going to do some smart it there but it’s going to do some smart it there but it’s going to do some smart routing like that so not only is it routing like that so not only is it routing like that so not only is it going to be an agent router but it’ll be going to be an agent router but it’ll be going to be an agent router but it’ll be uh basically like a request router is uh basically like a request router is uh basically like a request router is this request going to get denied by this request going to get denied by this request going to get denied by Chacha BT okay and go somewhere else um Chacha BT okay and go somewhere else um Chacha BT okay and go somewhere else um I want to build that out later so it’s I want to build that out later so it’s I want to build that out later so it’s much more sophisticated like is a code much more sophisticated like is a code much more sophisticated like is a code go to Claude because honestly I in my go to Claude because honestly I in my go to Claude because honestly I in my opinion doing Claud doing coding work is opinion doing Claud doing coding work is opinion doing Claud doing coding work is better with Claude than CHT unless better with Claude than CHT unless better with Claude than CHT unless you’re doing the 01 but that’s very you’re doing the 01 but that’s very you’re doing the 01 but that’s very expensive I’m not going to do that so expensive I’m not going to do that so expensive I’m not going to do that so it’s going to be an agent llm router is it’s going to be an agent llm router is it’s going to be an agent llm router is really what it is really what it is really what it is so so so um you need to be careful with this um you need to be careful with this um you need to be careful with this because EG could start routing to the because EG could start routing to the because EG could start routing to the wrong llm for the wrong task but uh wrong llm for the wrong task but uh wrong llm for the wrong task but uh this is the piece I’m working on so once this is the piece I’m working on so once this is the piece I’m working on so once that piece is in and the que is looks that piece is in and the que is looks that piece is in and the que is looks that piece looks solid and this is that piece looks solid and this is that piece looks solid and this is working solid then it’s time to start working solid then it’s time to start working solid then it’s time to start building out the agents building out the agents building out the agents and one piece I want to do which is that and one piece I want to do which is that and one piece I want to do which is that this is all I’m going to say I’m going this is all I’m going to say I’m going this is all I’m going to say I’m going to wrap it up I to wrap it up I to wrap it up I want you to be able to route to any want you to be able to route to any want you to be able to route to any router you want so router you want so router you want so zappier in a zappier in a zappier in a in I want to set this up so so you can in I want to set this up so so you can in I want to set this up so so you can go do all your flows you need to do go do all your flows you need to do go do all your flows you need to do without like waiting for Integrations without like waiting for Integrations without like waiting for Integrations From Me Without You Know handing over From Me Without You Know handing over From Me Without You Know handing over your your API keys or Etc or authorizing your your API keys or Etc or authorizing your your API keys or Etc or authorizing Integrations within my app no I want you Integrations within my app no I want you Integrations within my app no I want you to be able to do whatever the hell you to be able to do whatever the hell you to be able to do whatever the hell you want so that’s going to be one of the want so that’s going to be one of the want so that’s going to be one of the first things is this one the scheduling first things is this one the scheduling first things is this one the scheduling agent web hook so you can integrate agent web hook so you can integrate agent web hook so you can integrate however you need and want to to actually however you need and want to to actually however you need and want to to actually make this thing useful and then there’ll make this thing useful and then there’ll make this thing useful and then there’ll be a whole slip of other agents after be a whole slip of other agents after be a whole slip of other agents after that that that so yeah good progress the last couple so yeah good progress the last couple so yeah good progress the last couple days despite all the distractions I days despite all the distractions I days despite all the distractions I managed to squeeze in some time but I managed to squeeze in some time but I managed to squeeze in some time but I need a lot more time and uh I’ll need a lot more time and uh I’ll need a lot more time and uh I’ll probably be headed out of town the next probably be headed out of town the next probably be headed out of town the next two days so I doubt I’ll get much done two days so I doubt I’ll get much done two days so I doubt I’ll get much done so hence the big update espe this might so hence the big update espe this might so hence the big update espe this might be the the last update for the next two be the the last update for the next two be the the last update for the next two days we’ll see hopefully not but uh good days we’ll see hopefully not but uh good days we’ll see hopefully not but uh good progress and I’m excited to see how this progress and I’m excited to see how this progress and I’m excited to see how this is going to come together I really is going to come together I really is going to come together I really really want an actual virtual really want an actual virtual really want an actual virtual assistant where you send a request and assistant where you send a request and assistant where you send a request and it will actually go do real things and it will actually go do real things and it will actually go do real things and with quality not just some garbage you with quality not just some garbage you with quality not just some garbage you know generic response that chot GP ke know generic response that chot GP ke know generic response that chot GP ke and the life give you gives you so and the life give you gives you so and the life give you gives you so that’s all I have for today hopefully that’s all I have for today hopefully that’s all I have for today hopefully that’s useful and explaining how to that’s useful and explaining how to that’s useful and explaining how to build out such a build out such a build out such a product all right have a good Friday