Got Agents working quickly using BullMQ (The cookie)

Build in Public · Feb 04 · Episode 44
all right this is my daily update for my all right this is my daily update for my all right this is my daily update for my build and public log it’s February 3rd build and public log it’s February 3rd build and public log it’s February 3rd 2025 um this will be a pretty short and 2025 um this will be a pretty short and 2025 um this will be a pretty short and sweet update I sweet update I sweet update I don’t have much more to say because I don’t have much more to say because I don’t have much more to say because I took yesterday off I really needed took yesterday off I really needed took yesterday off I really needed to I needed a day off I don’t take many to I needed a day off I don’t take many to I needed a day off I don’t take many days off these days so uh but I did make days off these days so uh but I did make days off these days so uh but I did make some progress today on continuing some progress today on continuing some progress today on continuing forward with forward with forward with building uh a queuing service so I’m I’m building uh a queuing service so I’m I’m building uh a queuing service so I’m I’m kind kind kind of not exactly rolling my own but you of not exactly rolling my own but you of not exactly rolling my own but you kind of have to do a lot of manual work kind of have to do a lot of manual work kind of have to do a lot of manual work when you use bu amq which is what I’m when you use bu amq which is what I’m when you use bu amq which is what I’m using to uh be able to handle using to uh be able to handle using to uh be able to handle gracefully a lot of requests so let’s gracefully a lot of requests so let’s gracefully a lot of requests so let’s say a lot of people are making calls to say a lot of people are making calls to say a lot of people are making calls to run agents you got to organize that in a run agents you got to organize that in a run agents you got to organize that in a sane way using a queue you need an sane way using a queue you need an sane way using a queue you need an orchestrator uh to not just destroy your orchestrator uh to not just destroy your orchestrator uh to not just destroy your your computer so you know adds it to a your computer so you know adds it to a your computer so you know adds it to a queue and one by one processes all the queue and one by one processes all the queue and one by one processes all the request and you could do a lot of stuff request and you could do a lot of stuff request and you could do a lot of stuff like you know make gracefully handling like you know make gracefully handling like you know make gracefully handling errors where you’re trying you can do errors where you’re trying you can do errors where you’re trying you can do prior prioritization so certain ones prior prioritization so certain ones prior prioritization so certain ones will will take priority I’m I’m working will will take priority I’m I’m working will will take priority I’m I’m working through that and I did uh I did get some through that and I did uh I did get some through that and I did uh I did get some of that working um there’s more work to of that working um there’s more work to of that working um there’s more work to be done after this video be done after this video be done after this video uh so I I did some really really basic uh so I I did some really really basic uh so I I did some really really basic uh load testing just I kind of just got uh load testing just I kind of just got uh load testing just I kind of just got it kind of it kind of it kind of working you know did some load testing working you know did some load testing working you know did some load testing to throw a bunch of requests at it and I to throw a bunch of requests at it and I to throw a bunch of requests at it and I was playing around with like the the was playing around with like the the was playing around with like the the settings like how much should you have settings like how much should you have settings like how much should you have it try to process at once so it try to process at once so it try to process at once so concurrency concurrency concurrency um and it was so fast it was way faster than it was so fast it was way faster than it was so fast it was way faster than trigger trigger. Dev which is which trigger trigger. Dev which is which trigger trigger. Dev which is which which is what I was trying to to use um which is what I was trying to to use um which is what I was trying to to use um and that and that was running on a BP and that and that was running on a BP and that and that was running on a BP dedicated server that nothing like dedicated server that nothing like dedicated server that nothing like there’s nothing really going on on that there’s nothing really going on on that there’s nothing really going on on that server uh and this is running on my server uh and this is running on my server uh and this is running on my MacBook MacBook MacBook so kind of makes sense this my MacBook so kind of makes sense this my MacBook so kind of makes sense this my MacBook is more powerful than that than that is more powerful than that than that is more powerful than that than that server if I’m being really server if I’m being really server if I’m being really honest uh but yeah it was fast I honest uh but yeah it was fast I honest uh but yeah it was fast I actually ran into uh actually ran into uh actually ran into uh to I I I got rate limited by open AI so to I I I got rate limited by open AI so to I I I got rate limited by open AI so I’m using open AI for the model for that I’m using open AI for the model for that I’m using open AI for the model for that agent that I was testing so you know agent that I was testing so you know agent that I was testing so you know basically I had I basically I had I basically I had I simulated a bunch of users making the simulated a bunch of users making the simulated a bunch of users making the making a request to the same API inpoint making a request to the same API inpoint making a request to the same API inpoint for to run an agent you know an agent for to run an agent you know an agent for to run an agent you know an agent runs in the background and then it makes runs in the background and then it makes runs in the background and then it makes a call to chat GPD comes back returns a call to chat GPD comes back returns a call to chat GPD comes back returns the data to uh to a poll pulling end the data to uh to a poll pulling end the data to uh to a poll pulling end point if if you were do pull that end point if if you were do pull that end point if if you were do pull that end point I talked about this a lot in the point I talked about this a lot in the point I talked about this a lot in the last few videos but uh yeah it held up last few videos but uh yeah it held up last few videos but uh yeah it held up well but I got rate limited by by open well but I got rate limited by by open well but I got rate limited by by open AI so I thought that was funny I AI so I thought that was funny I AI so I thought that was funny I actually added some money and they just actually added some money and they just actually added some money and they just like got bumped up to their tier they like got bumped up to their tier they like got bumped up to their tier they have like a tiering system where the have like a tiering system where the have like a tiering system where the more money you spend the more like you more money you spend the more like you more money you spend the more like you get to move up in the tier and you get get to move up in the tier and you get get to move up in the tier and you get like for example 03 their latest model like for example 03 their latest model like for example 03 their latest model drop you can’t even use drop you can’t even use drop you can’t even use that like the API unless you’re on a that like the API unless you’re on a that like the API unless you’re on a higher tier that’s all I’ve managed to higher tier that’s all I’ve managed to higher tier that’s all I’ve managed to get done I a lot more work on the a lot get done I a lot more work on the a lot get done I a lot more work on the a lot more work to be done on this all that’s more work to be done on this all that’s more work to be done on this all that’s what I’ll be working on the next couple what I’ll be working on the next couple what I’ll be working on the next couple days and that’s my update for today now days and that’s my update for today now days and that’s my update for today now I’m gonna do something different here uh I’m gonna do something different here uh I’m gonna do something different here uh I’m going to jump I’m going to jump I’m going to jump into answering people’s people’s into answering people’s people’s into answering people’s people’s questions and comments so I’m going to questions and comments so I’m going to questions and comments so I’m going to start doing this the more I get actual start doing this the more I get actual start doing this the more I get actual feedback and questions and comments so feedback and questions and comments so feedback and questions and comments so um and then I’ll at the end I’ll do my um and then I’ll at the end I’ll do my um and then I’ll at the end I’ll do my random story for the day so let’s let’s random story for the day so let’s let’s random story for the day so let’s let’s go through this uh do you have go through this uh do you have go through this uh do you have Twitter or Twitter or Twitter or LinkedIn LinkedIn LinkedIn yep it’s my name so I need to get better at actually name so I need to get better at actually name so I need to get better at actually posting on Twitter at posting on Twitter at posting on Twitter at I am working on something for that I am working on something for that I am working on something for that actually please explain with v visuals actually please explain with v visuals actually please explain with v visuals yep I try to sometimes I don’t have a yep I try to sometimes I don’t have a yep I try to sometimes I don’t have a lot to say for the day so uh have you lot to say for the day so uh have you lot to say for the day so uh have you had a chance to take a look at Galaxy AI had a chance to take a look at Galaxy AI had a chance to take a look at Galaxy AI no idea what galaxy AI is from my no idea what galaxy AI is from my no idea what galaxy AI is from my perspective the approach of having a perspective the approach of having a perspective the approach of having a voice assistant on your phone and asking voice assistant on your phone and asking voice assistant on your phone and asking a directly to create appointments has a directly to create appointments has a directly to create appointments has less friction than an agent scheduler less friction than an agent scheduler less friction than an agent scheduler has to offer if your product offer more has to offer if your product offer more has to offer if your product offer more then let me let be sure to let me know then let me let be sure to let me know then let me let be sure to let me know what it puts on the what it puts on the what it puts on the table been looking at your progress for table been looking at your progress for table been looking at your progress for a week now oh thank you um yeah a week now oh thank you um yeah a week now oh thank you um yeah so uh that is the plan I am going to do so uh that is the plan I am going to do so uh that is the plan I am going to do that actually as soon as I’m done with that actually as soon as I’m done with that actually as soon as I’m done with this So the plan is to build two two this So the plan is to build two two this So the plan is to build two two services in parallel I will have services in parallel I will have services in parallel I will have a uh agent Runner so there’s like an a uh agent Runner so there’s like an a uh agent Runner so there’s like an actual API service that I build agents actual API service that I build agents actual API service that I build agents and put them in there and then you could and put them in there and then you could and put them in there and then you could programmatically call it and run the programmatically call it and run the programmatically call it and run the agent uh for whatever project product agent uh for whatever project product agent uh for whatever project product you want to drop that into and have you want to drop that into and have you want to drop that into and have agents run and then get the response to agents run and then get the response to agents run and then get the response to do something with so I am actually going do something with so I am actually going do something with so I am actually going to build that what you just said um but to build that what you just said um but to build that what you just said um but a part of that is um how does the back a part of that is um how does the back a part of that is um how does the back end how how is it going to schedule end how how is it going to schedule end how how is it going to schedule schedule the the thing it needs to like schedule the the thing it needs to like schedule the the thing it needs to like have some kind of data format data have some kind of data format data have some kind of data format data structure to just actually schedule uh structure to just actually schedule uh structure to just actually schedule uh in event and IAL and um such formats are in event and IAL and um such formats are in event and IAL and um such formats are how a lot of how a lot of how a lot of services use that’s the data structure services use that’s the data structure services use that’s the data structure they use so um if you want to add they use so um if you want to add they use so um if you want to add something to your calendar a lot of a something to your calendar a lot of a something to your calendar a lot of a lot of services need like an IAL lot of services need like an IAL lot of services need like an IAL basically so that’s what that’s creating basically so that’s what that’s creating basically so that’s what that’s creating so my product that will be like a AI so my product that will be like a AI so my product that will be like a AI virtual assistant will call this product virtual assistant will call this product virtual assistant will call this product to build the actual events and then add to build the actual events and then add to build the actual events and then add it to your calendar or do whatever so it it to your calendar or do whatever so it it to your calendar or do whatever so it these things will be abstracted and this these things will be abstracted and this these things will be abstracted and this is agents that people will is agents that people will is agents that people will programmatically use programmatically use programmatically use to uh abstract way and hide kind of from to uh abstract way and hide kind of from to uh abstract way and hide kind of from the the the user uh I’ll the look into Galaxy AI user uh I’ll the look into Galaxy AI user uh I’ll the look into Galaxy AI never heard of it but there’s so many never heard of it but there’s so many never heard of it but there’s so many tools coming out every every day it’s tools coming out every every day it’s tools coming out every every day it’s hard to keep track of all right cool hard to keep track of all right cool hard to keep track of all right cool thank than you so much for the comments thank than you so much for the comments thank than you so much for the comments and support please please keep it and support please please keep it and support please please keep it up uh and let me know how I can help you up uh and let me know how I can help you up uh and let me know how I can help you or you know what should I talk about or you know what should I talk about or you know what should I talk about what should what should what should I explain what should I show some people I explain what should I show some people I explain what should I show some people want visuals actually so uh I do want to want visuals actually so uh I do want to want visuals actually so uh I do want to start a just a basic site so if somebody start a just a basic site so if somebody start a just a basic site so if somebody wants to like follow with RSS wants to like follow with RSS wants to like follow with RSS newsletter have like a let’s say you newsletter have like a let’s say you newsletter have like a let’s say you don’t want to always be looking at don’t want to always be looking at don’t want to always be looking at YouTube I’m going to have other op YouTube I’m going to have other op YouTube I’m going to have other op options Twitter as well so more to come options Twitter as well so more to come options Twitter as well so more to come on all of on all of on all of that all right so onto my random story that all right so onto my random story that all right so onto my random story for today this is a really random for today this is a really random for today this is a really random one all right so I it’s fun kind of one all right so I it’s fun kind of one all right so I it’s fun kind of funny uh Yesterday by funny uh Yesterday by funny uh Yesterday by chance like I randomly saw a chance like I randomly saw a chance like I randomly saw a picture and super super super made me picture and super super super made me picture and super super super made me remember this and think of this um I was remember this and think of this um I was remember this and think of this um I was talking to my family about this I was talking to my family about this I was talking to my family about this I was like do you remember this when when we like do you remember this when when we like do you remember this when when we were kids this super reminds me of it were kids this super reminds me of it were kids this super reminds me of it I’ll show a picture of it in a second I’ll show a picture of it in a second I’ll show a picture of it in a second when when I was a kid so I’m a 90s kid when when I was a kid so I’m a 90s kid when when I was a kid so I’m a 90s kid I’m an old guy I’m a 90s kid uh we got I’m an old guy I’m a 90s kid uh we got I’m an old guy I’m a 90s kid uh we got dragged to the mall a lot you know it dragged to the mall a lot you know it dragged to the mall a lot you know it was malls were a much bigger deal in the was malls were a much bigger deal in the was malls were a much bigger deal in the 90s early 2000s back in the 80s before 90s early 2000s back in the 80s before 90s early 2000s back in the 80s before my time the mall was like the in America my time the mall was like the in America my time the mall was like the in America you know I’m from California you know I’m from California you know I’m from California malls were a huge deal in the 80s so malls were a huge deal in the 80s so malls were a huge deal in the 80s so think about it like your your parents think about it like your your parents think about it like your your parents you know people in my age your parents you know people in my age your parents you know people in my age your parents went to the mall a lot and so they took went to the mall a lot and so they took went to the mall a lot and so they took you naturally as a kid to the mall my you naturally as a kid to the mall my you naturally as a kid to the mall my actually my parents met at a mall like actually my parents met at a mall like actually my parents met at a mall like not too far from here uh I’m in my not too far from here uh I’m in my not too far from here uh I’m in my hometown hanging out with the family for hometown hanging out with the family for hometown hanging out with the family for a while until I get the business going a while until I get the business going a while until I get the business going uh the mall kind of exists but it’s like uh the mall kind of exists but it’s like uh the mall kind of exists but it’s like shuttered and you know weird it’s like a shuttered and you know weird it’s like a shuttered and you know weird it’s like a kind of abandoned and shuttered because kind of abandoned and shuttered because kind of abandoned and shuttered because it’s an old Mall a lot of old malls are it’s an old Mall a lot of old malls are it’s an old Mall a lot of old malls are gone and have been converted or gone and have been converted or gone and have been converted or destroyed so my parents met out of mall destroyed so my parents met out of mall destroyed so my parents met out of mall like going to the mall back in the 80s like going to the mall back in the 80s like going to the mall back in the 80s was a big deal and so in the 90s as a was a big deal and so in the 90s as a was a big deal and so in the 90s as a 90s kid they took you to the mall all 90s kid they took you to the mall all 90s kid they took you to the mall all the time because it just you know that the time because it just you know that the time because it just you know that was the thing to do and now and I was the thing to do and now and I was the thing to do and now and I remember remember remember uh every time I’d go to the mall I would uh every time I’d go to the mall I would uh every time I’d go to the mall I would stop at like this this place was like a stop at like this this place was like a stop at like this this place was like a big deal and all this this was like an big deal and all this this was like an big deal and all this this was like an all the malls back in the day um and all the malls back in the day um and all the malls back in the day um and every time I’d go I’d eat this one every time I’d go I’d eat this one every time I’d go I’d eat this one cookie and I saw a picture that looked cookie and I saw a picture that looked cookie and I saw a picture that looked just like this damn cookie here here’s just like this damn cookie here here’s just like this damn cookie here here’s what this damn cookie I’d always get and what this damn cookie I’d always get and what this damn cookie I’d always get and I saw a picture that looked just like I saw a picture that looked just like I saw a picture that looked just like this yesterday made me think of this it this yesterday made me think of this it this yesterday made me think of this it made me remember God damn that reminds made me remember God damn that reminds made me remember God damn that reminds me of going to the mall when I was a kid me of going to the mall when I was a kid me of going to the mall when I was a kid so yeah it looks like of course so yeah it looks like of course so yeah it looks like of course probably not healthy look at this thing probably not healthy look at this thing probably not healthy look at this thing it’s like pure sugar and crap uh but yes it’s like pure sugar and crap uh but yes it’s like pure sugar and crap uh but yes I I would every time I’d go to the mall I I would every time I’d go to the mall I I would every time I’d go to the mall we’d stop at that little little booth we’d stop at that little little booth we’d stop at that little little booth you know it’s like when I showed you it you know it’s like when I showed you it you know it’s like when I showed you it was like a like not a full restaurant was like a like not a full restaurant was like a like not a full restaurant but you know it was like this like kind but you know it was like this like kind but you know it was like this like kind of a a window and like a register and of a a window and like a register and of a a window and like a register and someone you know making cookies and I someone you know making cookies and I someone you know making cookies and I would always get one of these cookies it would always get one of these cookies it would always get one of these cookies it remind man it really hit me hit me in remind man it really hit me hit me in remind man it really hit me hit me in the Nostalgia like memory like oh yeah the Nostalgia like memory like oh yeah the Nostalgia like memory like oh yeah God remember eating one of this this God remember eating one of this this God remember eating one of this this cookie that flavor of eating this cookie cookie that flavor of eating this cookie cookie that flavor of eating this cookie just reminds me of being at the Vault just reminds me of being at the Vault just reminds me of being at the Vault like as a kid because I’d always want like as a kid because I’d always want like as a kid because I’d always want this goddamn cookie uh apparently this this goddamn cookie uh apparently this this goddamn cookie uh apparently this place closed closed down years ago like place closed closed down years ago like place closed closed down years ago like this chain it just kind of struggled but this chain it just kind of struggled but this chain it just kind of struggled but yeah so uh I just made me think of this yeah so uh I just made me think of this yeah so uh I just made me think of this seeing this picture um I don’t use sugar seeing this picture um I don’t use sugar seeing this picture um I don’t use sugar now like I’m I’m like an kind of now like I’m I’m like an kind of now like I’m I’m like an kind of anti-sugar uh sugar just doesn’t sit anti-sugar uh sugar just doesn’t sit anti-sugar uh sugar just doesn’t sit well with me so I don’t eat stuff like well with me so I don’t eat stuff like well with me so I don’t eat stuff like this like I can’t like it just destroys this like I can’t like it just destroys this like I can’t like it just destroys me eating sugar me eating sugar me eating sugar uh but I’m not going to lie I wouldn’t uh but I’m not going to lie I wouldn’t uh but I’m not going to lie I wouldn’t mind eating one just for like Nostalgia mind eating one just for like Nostalgia mind eating one just for like Nostalgia old time sake how very distinctive old time sake how very distinctive old time sake how very distinctive flavor like to to me that tastes like flavor like to to me that tastes like flavor like to to me that tastes like the mul um so anyways a random trip down the mul um so anyways a random trip down the mul um so anyways a random trip down memory lane um apparently you can make memory lane um apparently you can make memory lane um apparently you can make it yourself there’s all these like it yourself there’s all these like it yourself there’s all these like recipes to to try and make it yeah look recipes to to try and make it yeah look recipes to to try and make it yeah look like this this is what this is kind of like this this is what this is kind of like this this is what this is kind of that’s a little old school looked a that’s a little old school looked a that’s a little old school looked a little bit more modern but little bit more modern but little bit more modern but uh anyways that’s all I uh anyways that’s all I uh anyways that’s all I got have a good day

Description

Stability improvements:

  • Error handling implementation
  • Logging system enhancement
  • Performance optimization

Summary

Summary of the Video: Daily Update for My Build and Public Log. The video covers a brief progress update on developing a queuing service using bu amq to manage agent requests and load testing. It also touches on rate limits with OpenAI, plans for building parallel API services, community Q&A, and ends with a nostalgic story about mall cookies.

Chapters

AI with Steve build in public

Subscribe to stay up to date