Slowly figuring out the right AI Model to use (health) | Build in public E141

· Sep 18 · Episode 141
This is my daily update for my build and This is my daily update for my build and This is my daily update for my build and public log. I’m battling with some public log. I’m battling with some public log. I’m battling with some health stuff that’s [  ] up my sleep health stuff that’s [  ] up my sleep health stuff that’s [  ] up my sleep really bad. I’ll save that to the end. really bad. I’ll save that to the end. really bad. I’ll save that to the end. You don’t have to watch it if you don’t You don’t have to watch it if you don’t You don’t have to watch it if you don’t want to. What is my update for today? want to. What is my update for today? want to. What is my update for today? What the hell have I been doing? I am What the hell have I been doing? I am What the hell have I been doing? I am trying to figure out the correct trying to figure out the correct trying to figure out the correct combination combination combination of models I should use for my AI agent of models I should use for my AI agent of models I should use for my AI agent for scheduling an event. So, I am for scheduling an event. So, I am for scheduling an event. So, I am building a micro SAS based on a micro AI building a micro SAS based on a micro AI building a micro SAS based on a micro AI agent. I I need two things. I need just agent. I I need two things. I need just agent. I I need two things. I need just text. So, you can copy and paste. Just text. So, you can copy and paste. Just text. So, you can copy and paste. Just put text and it reads the text and it put text and it reads the text and it put text and it reads the text and it creates an event or an image. I’m seeing creates an event or an image. I’m seeing creates an event or an image. I’m seeing a couple things. One of the best models a couple things. One of the best models a couple things. One of the best models accuracy wise is Chachi BT5. So, I want accuracy wise is Chachi BT5. So, I want accuracy wise is Chachi BT5. So, I want to use five. The pricing is kind of to use five. The pricing is kind of to use five. The pricing is kind of high, but it’s it’s okay, fine. But the high, but it’s it’s okay, fine. But the high, but it’s it’s okay, fine. But the problem I’m having is it’s so [  ] problem I’m having is it’s so [  ] problem I’m having is it’s so [  ] slow. And I I’ I’ve tried a bunch of slow. And I I’ I’ve tried a bunch of slow. And I I’ I’ve tried a bunch of things. I tried like changing the prompt things. I tried like changing the prompt things. I tried like changing the prompt and and doing all these things. It’s so and and doing all these things. It’s so and and doing all these things. It’s so so so slow. And I am not the only one so so slow. And I am not the only one so so slow. And I am not the only one complaining about this and seeing this. complaining about this and seeing this. complaining about this and seeing this. Uh Google, Uh Google, Uh Google, just Google it. ChatGpt 5 API slow. And just Google it. ChatGpt 5 API slow. And just Google it. ChatGpt 5 API slow. And there’s millions of other people there’s millions of other people there’s millions of other people complaining. I I’m far from it, but I am complaining. I I’m far from it, but I am complaining. I I’m far from it, but I am seeing off the chart slowdown. It it it seeing off the chart slowdown. It it it seeing off the chart slowdown. It it it it thinks way too much. I don’t know it thinks way too much. I don’t know it thinks way too much. I don’t know what I don’t know what’s going on on what I don’t know what’s going on on what I don’t know what’s going on on their end. So they added a reasoning their end. So they added a reasoning their end. So they added a reasoning effort setting to chat where you can effort setting to chat where you can effort setting to chat where you can explicitly say like reasoning high, explicitly say like reasoning high, explicitly say like reasoning high, medium, low. Like just just think a medium, low. Like just just think a medium, low. Like just just think a little bit, think a lot. Even setting little bit, think a lot. Even setting little bit, think a lot. Even setting that low is so goddamn slow. But the that low is so goddamn slow. But the that low is so goddamn slow. But the accuracy is so much better. So I’m I’m accuracy is so much better. So I’m I’m accuracy is so much better. So I’m I’m struggling to I’m struggling to like get struggling to I’m struggling to like get struggling to I’m struggling to like get this working because it’s like a this working because it’s like a this working because it’s like a delicated balance in welcome to delicated balance in welcome to delicated balance in welcome to developing AI tools. Uh it’s it’s kind developing AI tools. Uh it’s it’s kind developing AI tools. Uh it’s it’s kind of a it’s a never- ending nightmare of of a it’s a never- ending nightmare of of a it’s a never- ending nightmare of retrying models, reoing re, you know, retrying models, reoing re, you know, retrying models, reoing re, you know, it’s just all these different it’s just all these different it’s just all these different strategies, pointing at different strategies, pointing at different strategies, pointing at different models, like you know, updating models, models, like you know, updating models, models, like you know, updating models, you know, re-checking all all the you know, re-checking all all the you know, re-checking all all the different various settings and models, different various settings and models, different various settings and models, you know, because sometimes you want the you know, because sometimes you want the you know, because sometimes you want the temperature really low. You want it to temperature really low. You want it to temperature really low. You want it to be more deterministic. Sometimes you be more deterministic. Sometimes you be more deterministic. Sometimes you want use a new model because it’s so want use a new model because it’s so want use a new model because it’s so expensive. uh or the model you had expensive. uh or the model you had expensive. uh or the model you had pointed at got is kind of being soft pointed at got is kind of being soft pointed at got is kind of being soft deprecated and then they jack the price deprecated and then they jack the price deprecated and then they jack the price up to get you to use another one. Then up to get you to use another one. Then up to get you to use another one. Then you point it to the other one and you you point it to the other one and you you point it to the other one and you have weird things like this where it’s have weird things like this where it’s have weird things like this where it’s really slow. This is the pain of um really slow. This is the pain of um really slow. This is the pain of um this this is the pain of doing this kind this this is the pain of doing this kind this this is the pain of doing this kind of work. That is exactly uh what I was of work. That is exactly uh what I was of work. That is exactly uh what I was hoping to address with agents code. This hoping to address with agents code. This hoping to address with agents code. This is exactly kind of what I envisioned is exactly kind of what I envisioned is exactly kind of what I envisioned building. I envision building a uh a building. I envision building a uh a building. I envision building a uh a suite of micro agents where I just do suite of micro agents where I just do suite of micro agents where I just do all of that for you. So you you you have all of that for you. So you you you have all of that for you. So you you you have like this one task you need in your app like this one task you need in your app like this one task you need in your app or your project whatever you drop it in or your project whatever you drop it in or your project whatever you drop it in and all of that is just kind of and all of that is just kind of and all of that is just kind of abstracted away by by service by me abstracted away by by service by me abstracted away by by service by me doing the service. That’s that that was doing the service. That’s that that was doing the service. That’s that that was my intention but I’m barely getting back my intention but I’m barely getting back my intention but I’m barely getting back to working on this again. So, it it just to working on this again. So, it it just to working on this again. So, it it just needs a tremendous amount of work. And needs a tremendous amount of work. And needs a tremendous amount of work. And that brings me to the next thing I that brings me to the next thing I that brings me to the next thing I worked on a lot. I keep having to rejig worked on a lot. I keep having to rejig worked on a lot. I keep having to rejig the um the scheduling queuing system the um the scheduling queuing system the um the scheduling queuing system that I have in place for this. Thank god that I have in place for this. Thank god that I have in place for this. Thank god I don’t have any users. Actually, it was I don’t have any users. Actually, it was I don’t have any users. Actually, it was a little frustrating. No one tried this a little frustrating. No one tried this a little frustrating. No one tried this out, but in hindsight, out, but in hindsight, out, but in hindsight, I just needed to I just lost momentum I just needed to I just lost momentum I just needed to I just lost momentum and I really need a lot more work. Why and I really need a lot more work. Why and I really need a lot more work. Why did I stop working on this? Is I got did I stop working on this? Is I got did I stop working on this? Is I got this big freelance project. It kind of this big freelance project. It kind of this big freelance project. It kind of burnt me out. It was like six months of burnt me out. It was like six months of burnt me out. It was like six months of just being pushed really hard to to to just being pushed really hard to to to just being pushed really hard to to to to do a lot of work to do a lot of work to do a lot of work uh in a like really fast pace. Just not uh in a like really fast pace. Just not uh in a like really fast pace. Just not enough time. And I’m feeling quite burnt enough time. And I’m feeling quite burnt enough time. And I’m feeling quite burnt out after that. I’m finally getting back out after that. I’m finally getting back out after that. I’m finally getting back to working on this thing. And this thing to working on this thing. And this thing to working on this thing. And this thing just needs so much work. this thing just needs so much work. this thing just needs so much work. this thing honestly to to fulfill my my vision of honestly to to fulfill my my vision of honestly to to fulfill my my vision of what I want or what I think people want what I want or what I think people want what I want or what I think people want probably needs about 6 to 18 months of probably needs about 6 to 18 months of probably needs about 6 to 18 months of hard [  ] grinding work every single hard [  ] grinding work every single hard [  ] grinding work every single day. I kind of stopped doing that work day. I kind of stopped doing that work day. I kind of stopped doing that work because why build [  ] nobody wants and because why build [  ] nobody wants and because why build [  ] nobody wants and no one’s going to pay you for? I don’t no one’s going to pay you for? I don’t no one’s going to pay you for? I don’t really know if I’m solving a real pain really know if I’m solving a real pain really know if I’m solving a real pain that people have and would be willing to that people have and would be willing to that people have and would be willing to pay money for. So, I kind of paused all pay money for. So, I kind of paused all pay money for. So, I kind of paused all that so I can try to go uh talk to a lot that so I can try to go uh talk to a lot that so I can try to go uh talk to a lot of people and figure out if what I’m of people and figure out if what I’m of people and figure out if what I’m building people actually need and would building people actually need and would building people actually need and would actually pay for a solution. I put that actually pay for a solution. I put that actually pay for a solution. I put that on hold, but I am trying to use that on hold, but I am trying to use that on hold, but I am trying to use that system for this from for my micro SAS system for this from for my micro SAS system for this from for my micro SAS cuz it’s calling that micro agent. Um, cuz it’s calling that micro agent. Um, cuz it’s calling that micro agent. Um, so I did have to do a bunch of work to so I did have to do a bunch of work to so I did have to do a bunch of work to try to get that in a better place. So, try to get that in a better place. So, try to get that in a better place. So, this tool is actually kind of fast. I this tool is actually kind of fast. I this tool is actually kind of fast. I fixed those issues that seem it seems to fixed those issues that seem it seems to fixed those issues that seem it seems to be humming along and faster and and not be humming along and faster and and not be humming along and faster and and not as janky. But again, now I’ve run into as janky. But again, now I’ve run into as janky. But again, now I’ve run into the problem with Chachi PT5 where it’s the problem with Chachi PT5 where it’s the problem with Chachi PT5 where it’s really [  ] slow. In my opinion, that really [  ] slow. In my opinion, that really [  ] slow. In my opinion, that model is unusable for some task. model is unusable for some task. model is unusable for some task. Straight up. That’s my spicy hot take Straight up. That’s my spicy hot take Straight up. That’s my spicy hot take for the day. It’s unusable for a lot of for the day. It’s unusable for a lot of for the day. It’s unusable for a lot of tasks until they fix things and make it tasks until they fix things and make it tasks until they fix things and make it faster. It is so [  ] slow. It’s not faster. It is so [  ] slow. It’s not faster. It is so [  ] slow. It’s not usable. Again, it depends on your task. usable. Again, it depends on your task. usable. Again, it depends on your task. for some task. Doesn’t matter if it for some task. Doesn’t matter if it for some task. Doesn’t matter if it takes a minute, it’s fine. But for like takes a minute, it’s fine. But for like takes a minute, it’s fine. But for like a user clicks something and hits go, no, a user clicks something and hits go, no, a user clicks something and hits go, no, too [  ] slow. So, I’m trying too [  ] slow. So, I’m trying too [  ] slow. So, I’m trying different models, but their vision for different models, but their vision for different models, but their vision for their vision for track GPG5 is just their vision for track GPG5 is just their vision for track GPG5 is just I’m seeing just the best one. It’s so I’m seeing just the best one. It’s so I’m seeing just the best one. It’s so damn good. Uh just like here’s an image damn good. Uh just like here’s an image damn good. Uh just like here’s an image with like all this stuff in it. Go with like all this stuff in it. Go with like all this stuff in it. Go figure it out. Go make an event. Go make figure it out. Go make an event. Go make figure it out. Go make an event. Go make a reoccurring event. go make multiple a reoccurring event. go make multiple a reoccurring event. go make multiple reoccurring events from that. Damn, it’s reoccurring events from that. Damn, it’s reoccurring events from that. Damn, it’s just the best that I’ve seen so far in just the best that I’ve seen so far in just the best that I’ve seen so far in my testing. So, what do I do? It’s the my testing. So, what do I do? It’s the my testing. So, what do I do? It’s the best in quality, but it’s really slow. I best in quality, but it’s really slow. I best in quality, but it’s really slow. I need to find like middle middle grounds need to find like middle middle grounds need to find like middle middle grounds for all these things. So, that’s what for all these things. So, that’s what for all these things. So, that’s what I’m working on. I I I did a lot of work I’m working on. I I I did a lot of work I’m working on. I I I did a lot of work on the test. So, there’s a bunch of on the test. So, there’s a bunch of on the test. So, there’s a bunch of tests where I could quickly run uh tests where I could quickly run uh tests where I could quickly run uh because go doing in the UI is insane and because go doing in the UI is insane and because go doing in the UI is insane and going to be so [  ] slow. So I have a going to be so [  ] slow. So I have a going to be so [  ] slow. So I have a bunch of tests now where I I can bunch of tests now where I I can bunch of tests now where I I can literally like point to a different literally like point to a different literally like point to a different model, tweak a thing, tweak the model, tweak a thing, tweak the model, tweak a thing, tweak the reasoning effort setting quickly run and reasoning effort setting quickly run and reasoning effort setting quickly run and see like the timing. So a little bit see like the timing. So a little bit see like the timing. So a little bit more work to be done on that today. Um more work to be done on that today. Um more work to be done on that today. Um yeah, I’m feeling like hell. So it’s yeah, I’m feeling like hell. So it’s yeah, I’m feeling like hell. So it’s it’s tough. I’m I keep trying to push it’s tough. I’m I keep trying to push it’s tough. I’m I keep trying to push but I’m not feeling well. So let’s just but I’m not feeling well. So let’s just but I’m not feeling well. So let’s just jump in to see if there’s any questions jump in to see if there’s any questions jump in to see if there’s any questions or comments today. There’s no questions or comments today. There’s no questions or comments today. There’s no questions or comments today. Yep. The algorithm is or comments today. Yep. The algorithm is or comments today. Yep. The algorithm is killing me on I’m not getting shown very killing me on I’m not getting shown very killing me on I’m not getting shown very much. It’s frustrating. much. It’s frustrating. much. It’s frustrating. Um, clearly people are not watching. So Um, clearly people are not watching. So Um, clearly people are not watching. So hopefully people will start watching the hopefully people will start watching the hopefully people will start watching the by the more value and things that I I uh by the more value and things that I I uh by the more value and things that I I uh but the more value I give, hopefully but the more value I give, hopefully but the more value I give, hopefully that that gets the algorithm to show me that that gets the algorithm to show me that that gets the algorithm to show me more. more. more. Uh, moving on to my random story for Uh, moving on to my random story for Uh, moving on to my random story for today. Why why am I having health today. Why why am I having health today. Why why am I having health issues? Why am I not sleeping? Um, I issues? Why am I not sleeping? Um, I issues? Why am I not sleeping? Um, I talked about this a little bit before, talked about this a little bit before, talked about this a little bit before, like almost 10 years ago. I h I had to like almost 10 years ago. I h I had to like almost 10 years ago. I h I had to have like a pretty serious stomach have like a pretty serious stomach have like a pretty serious stomach surgery because my stomach is like surgery because my stomach is like surgery because my stomach is like physically pretty [  ] up. Um, I’m physically pretty [  ] up. Um, I’m physically pretty [  ] up. Um, I’m having a lot of issues with that this having a lot of issues with that this having a lot of issues with that this week. Lot a lot a lot of issues. That week. Lot a lot a lot of issues. That week. Lot a lot a lot of issues. That surgery surgery surgery becoming almost completely becoming almost completely becoming almost completely non-effective. I’m having a lot of non-effective. I’m having a lot of non-effective. I’m having a lot of issues again and that’s making me not issues again and that’s making me not issues again and that’s making me not sleep at night. So, it’s like this sleep at night. So, it’s like this sleep at night. So, it’s like this vicious cycle of u and this is a real vicious cycle of u and this is a real vicious cycle of u and this is a real documented medical thing when you it’s documented medical thing when you it’s documented medical thing when you it’s called gird like basically uh my stomach called gird like basically uh my stomach called gird like basically uh my stomach physically doesn’t have the valve to physically doesn’t have the valve to physically doesn’t have the valve to like close and stop the stomach acid like close and stop the stomach acid like close and stop the stomach acid from coming up my esophagus. It’s it’s from coming up my esophagus. It’s it’s from coming up my esophagus. It’s it’s called a hiatal hernia. I don’t care if called a hiatal hernia. I don’t care if called a hiatal hernia. I don’t care if you all know it’s a genetic thing. My you all know it’s a genetic thing. My you all know it’s a genetic thing. My mom has the same thing. I have it. It’s mom has the same thing. I have it. It’s mom has the same thing. I have it. It’s like a genetic thing where uh you you like a genetic thing where uh you you like a genetic thing where uh you you are prone to hydal hernas and then you are prone to hydal hernas and then you are prone to hydal hernas and then you have all this stomach acid coming up have all this stomach acid coming up have all this stomach acid coming up keeps you up. Keeps you from not keeps you up. Keeps you from not keeps you up. Keeps you from not sleeping. But then you get into this sleeping. But then you get into this sleeping. But then you get into this vicious cycle where you vicious cycle where you vicious cycle where you have really bad heartburn. It keeps you have really bad heartburn. It keeps you have really bad heartburn. It keeps you up. You’re not sleeping and then you up. You’re not sleeping and then you up. You’re not sleeping and then you start having health issues. You have start having health issues. You have start having health issues. You have even more acid reflux. you have even even more acid reflux. you have even even more acid reflux. you have even more acid, which it you you you can kind more acid, which it you you you can kind more acid, which it you you you can kind of spiral into this this weird pattern of spiral into this this weird pattern of spiral into this this weird pattern of like you don’t sleep and then you of like you don’t sleep and then you of like you don’t sleep and then you have even worse symptoms. It really have even worse symptoms. It really have even worse symptoms. It really sucks. And I’ve battled this quite a bit sucks. And I’ve battled this quite a bit sucks. And I’ve battled this quite a bit in the last 10 years. Like I had to have in the last 10 years. Like I had to have in the last 10 years. Like I had to have a really bad surgery. The surgeon turn a really bad surgery. The surgeon turn a really bad surgery. The surgeon turn told me he’s like, “Your thing’s [  ] told me he’s like, “Your thing’s [  ] told me he’s like, “Your thing’s [  ] you’re you’re basically I mean he didn’t you’re you’re basically I mean he didn’t you’re you’re basically I mean he didn’t say [  ] but he basically said like yeah say [  ] but he basically said like yeah say [  ] but he basically said like yeah I explained to him what what’s been I explained to him what what’s been I explained to him what what’s been happening kind of on like a long long happening kind of on like a long long happening kind of on like a long long long followup after many years and he’s long followup after many years and he’s long followup after many years and he’s like yeah you’re it’s not going to work like yeah you’re it’s not going to work like yeah you’re it’s not going to work I could tell already um 10 years it’ll I could tell already um 10 years it’ll I could tell already um 10 years it’ll be like basically doing nothing anymore be like basically doing nothing anymore be like basically doing nothing anymore I was like oh my god are you are you I was like oh my god are you are you I was like oh my god are you are you telling me I have to have this surgery telling me I have to have this surgery telling me I have to have this surgery again he’s like yeah you’re probably again he’s like yeah you’re probably again he’s like yeah you’re probably going to have to do something again in going to have to do something again in going to have to do something again in in 10 years which we’re coming up on the in 10 years which we’re coming up on the in 10 years which we’re coming up on the 10 year dark pretty soon near. So yeah, 10 year dark pretty soon near. So yeah, 10 year dark pretty soon near. So yeah, having a lot of issues again and it’s having a lot of issues again and it’s having a lot of issues again and it’s keeping me up and it makes me feel like keeping me up and it makes me feel like keeping me up and it makes me feel like [  ] cuz I’m not sleeping. That just has [  ] cuz I’m not sleeping. That just has [  ] cuz I’m not sleeping. That just has all these knockoff effects. It just all these knockoff effects. It just all these knockoff effects. It just that’s causes other things to happen. that’s causes other things to happen. that’s causes other things to happen. I’m hurting this week. I I need to get I’m hurting this week. I I need to get I’m hurting this week. I I need to get some medicine and do something. I I I’m some medicine and do something. I I I’m some medicine and do something. I I I’m going to have to bite the bullet, start going to have to bite the bullet, start going to have to bite the bullet, start taking medicine, but that medicine has a taking medicine, but that medicine has a taking medicine, but that medicine has a lot of side effects. So you’re you’re lot of side effects. So you’re you’re lot of side effects. So you’re you’re damned if you do, damned if you don’t. damned if you do, damned if you don’t. damned if you do, damned if you don’t. really sucks cuz it’s just like really sucks cuz it’s just like really sucks cuz it’s just like bad luck. It’s just genetic defect. It’s bad luck. It’s just genetic defect. It’s bad luck. It’s just genetic defect. It’s like bad luck. I’m going to get some like bad luck. I’m going to get some like bad luck. I’m going to get some medicine, get it under control, get back medicine, get it under control, get back medicine, get it under control, get back to sleeping and feeling better cuz I I I to sleeping and feeling better cuz I I I to sleeping and feeling better cuz I I I need to get this done. But I’m I’m need to get this done. But I’m I’m need to get this done. But I’m I’m seriously suffering this week and seriously suffering this week and seriously suffering this week and getting I’m working, but real real slow getting I’m working, but real real slow getting I’m working, but real real slow and not my brain is just not full and not my brain is just not full and not my brain is just not full capacity, unfortunately. So hopefully capacity, unfortunately. So hopefully capacity, unfortunately. So hopefully next week I’ll be back to normal and and next week I’ll be back to normal and and next week I’ll be back to normal and and knock this thing out. I’m so close. Just knock this thing out. I’m so close. Just knock this thing out. I’m so close. Just got to figure out the right balance of got to figure out the right balance of got to figure out the right balance of the models and speed and accuracy. It’s, the models and speed and accuracy. It’s, the models and speed and accuracy. It’s, you know, there’s all these levers to you know, there’s all these levers to you know, there’s all these levers to you got to pull to make this product you got to pull to make this product you got to pull to make this product work. So, I’m really close. That’s all I work. So, I’m really close. That’s all I work. So, I’m really close. That’s all I got for today. Um, got for today. Um, got for today. Um, thanks for tuning in if you made it this thanks for tuning in if you made it this thanks for tuning in if you made it this far. See you tomorrow.

Description

I’m battling a slow GPT-5 api and trying to figure out the right combo of models to use, prompts, etc. Almost there.

Plus, I’m battling some health issues this week. :-/ Don’t want to follow along on YT? https://howtoautomate.dev

Subscribe to my newsletter: https://randomdailyurls.com

Join the community https://discord.gg/QB4U8J4Kc9

See ya all tomorrow!

Summary

My Daily Build and Public Log Update Today, I share my progress and challenges in building a micro SaaS product powered by an AI agent designed for event scheduling. I discussed my struggle to find the right balance between speed and accuracy, particularly when using ChatGPT-5, which, although accurate, often runs unbearably slow. My update also covers the painstaking process of tweaking prompts, model settings, and the scheduling system while I work through a backlog of technical issues left by previous projects. Alongside these professional hurdles, I candidly explain my personal health problems and sleep issues stemming from a long-term hiatal hernia, which has been a recurring challenge since a serious surgery years ago. Despite the technical and personal difficulties, I remain determined to refine my system and build a sustainable solution, though I continue to evaluate whether it meets an actual market need.

AI with Steve build in public

Subscribe to stay up to date