I tried to use Grok and I think it sucks (Visiting a Ghost Town)

Build in Public · Jan 06 · Episode 17
all right this is my daily update for all right this is my daily update for all right this is my daily update for January 5th January 5th January 5th 2025 um I managed to get some work done 2025 um I managed to get some work done 2025 um I managed to get some work done random story of the of the day random story of the of the day random story of the of the day so uh I went so uh I went so uh I went to this state park that’s like a a Wild to this state park that’s like a a Wild to this state park that’s like a a Wild West theme little historical site here West theme little historical site here West theme little historical site here in California my random story for today in California my random story for today in California my random story for today I have been to the my keyboard just died I have been to the my keyboard just died I have been to the my keyboard just died I have been I have been I have been to to to the like ultimate Wild West the like ultimate Wild West the like ultimate Wild West Town before Town before Town before um it is called bod um it is called bod um it is called bod California it’s in the middle of the California it’s in the middle of the California it’s in the middle of the sier Nevada it is sier Nevada it is sier Nevada it is fantastic um I have a great picture of fantastic um I have a great picture of fantastic um I have a great picture of that it his way in the middle of nowhere that it his way in the middle of nowhere that it his way in the middle of nowhere but it is very very worth a trip but it is very very worth a trip but it is very very worth a trip so when I went there I took um my so when I went there I took um my so when I went there I took um my ex-girlfriend uh who I was dating in ex-girlfriend uh who I was dating in ex-girlfriend uh who I was dating in Mexico City so we we came up to Mexico City so we we came up to Mexico City so we we came up to California went on this big road trip California went on this big road trip California went on this big road trip and and we went here and she was so and and we went here and she was so and and we went here and she was so bored she was bored to death and I think bored she was bored to death and I think bored she was bored to death and I think this place is awesome it’s like a actual this place is awesome it’s like a actual this place is awesome it’s like a actual it’s probably the best one of the very it’s probably the best one of the very it’s probably the best one of the very very best um preserved and like complete very best um preserved and like complete very best um preserved and like complete Wild West Old Boom Town Wild West towns Wild West Old Boom Town Wild West towns Wild West Old Boom Town Wild West towns uh it’s one of the very best ones in the uh it’s one of the very best ones in the uh it’s one of the very best ones in the world um and she was so bored she was so world um and she was so bored she was so world um and she was so bored she was so like not just kind of miserable to be like not just kind of miserable to be like not just kind of miserable to be there there there and I sh you and I sh you and I sh you not this is when I knew this was not the not this is when I knew this was not the not this is when I knew this was not the the the woman for the the woman for the the woman for me and it didn’t work out and I I really me and it didn’t work out and I I really me and it didn’t work out and I I really in that moment when I saw how she acted in that moment when I saw how she acted in that moment when I saw how she acted here on this road trip probably not the here on this road trip probably not the here on this road trip probably not the one for me so um let me let me just show one for me so um let me let me just show one for me so um let me let me just show you where it’s you where it’s you where it’s at if you’re ever in this part of the at if you’re ever in this part of the at if you’re ever in this part of the world go there it’s so worth it um you world go there it’s so worth it um you world go there it’s so worth it um you can only go you can’t go in winter it’s can only go you can’t go in winter it’s can only go you can’t go in winter it’s very cold snows a lot um it’s right next very cold snows a lot um it’s right next very cold snows a lot um it’s right next to to to Nevada um very close to Mono Nevada um very close to Mono Nevada um very close to Mono Lake uh so Lake uh so Lake uh so this is Lake Tahoe this is Yos so you this is Lake Tahoe this is Yos so you this is Lake Tahoe this is Yos so you got a cross yose and it’s over here I’ve got a cross yose and it’s over here I’ve got a cross yose and it’s over here I’ve been working on this been working on this been working on this um llm router slash agent router so when um llm router slash agent router so when um llm router slash agent router so when you send an email to here you know when you send an email to here you know when you send an email to here you know when you when you send an you when you send an you when you send an email to the assistant I’m going to call email to the assistant I’m going to call email to the assistant I’m going to call it the AI assistant because that’s it’s it the AI assistant because that’s it’s it the AI assistant because that’s it’s going to be rebranded as that shortly so going to be rebranded as that shortly so going to be rebranded as that shortly so when you send an email uh it looks at when you send an email uh it looks at when you send an email uh it looks at your requests and figures out okay your requests and figures out okay your requests and figures out okay like where should this request get like where should this request get like where should this request get routed it doesn’t immediately respond routed it doesn’t immediately respond routed it doesn’t immediately respond first it first it thinks about it and it first it first it thinks about it and it first it first it thinks about it and it looks at your request analyzes it and looks at your request analyzes it and looks at your request analyzes it and goes okay what do they want do they do I goes okay what do they want do they do I goes okay what do they want do they do I need to Route this to an agent do I need need to Route this to an agent do I need need to Route this to an agent do I need to Route this to a different to Route this to a different to Route this to a different llm is it just a request just to route llm is it just a request just to route llm is it just a request just to route toat for toat for toat for example I made really good progress on example I made really good progress on example I made really good progress on that but one thing that I’m testing out that but one thing that I’m testing out that but one thing that I’m testing out is I’m testing out the real time is I’m testing out the real time is I’m testing out the real time data uh routing so um you know when you data uh routing so um you know when you data uh routing so um you know when you asked I’m sure you’ve experienced this asked I’m sure you’ve experienced this asked I’m sure you’ve experienced this you asked chat you asked chat you asked chat GPT uh something something about in GPT uh something something about in GPT uh something something about in recent event and it has no idea it’s recent event and it has no idea it’s recent event and it has no idea it’s like well you know my cut off data is like well you know my cut off data is like well you know my cut off data is like you like you like you know I don’t know March know I don’t know March know I don’t know March 2024 um pretty useless so it’s it’s just 2024 um pretty useless so it’s it’s just 2024 um pretty useless so it’s it’s just so it doesn’t so it doesn’t so it doesn’t doesn’t search and find updated um doesn’t search and find updated um doesn’t search and find updated um information unless you’re using like information unless you’re using like information unless you’re using like actually in the chat the API doesn’t do actually in the chat the API doesn’t do actually in the chat the API doesn’t do that so if I route uh your request to to that so if I route uh your request to to that so if I route uh your request to to chat GPT it doesn’t have that realtime chat GPT it doesn’t have that realtime chat GPT it doesn’t have that realtime search just yet and search just yet and search just yet and so I was testing so I was testing so I was testing out I tested out grck first I test Rock out I tested out grck first I test Rock out I tested out grck first I test Rock because when I go here so I asked it because when I go here so I asked it because when I go here so I asked it what’s going on with the monkey found on what’s going on with the monkey found on what’s going on with the monkey found on the rollro that happened like really the rollro that happened like really the rollro that happened like really close to here there was this crazy story close to here there was this crazy story close to here there was this crazy story where as you could see uh they pulled where as you could see uh they pulled where as you could see uh they pulled over a rollsroyce some rich guy in a over a rollsroyce some rich guy in a over a rollsroyce some rich guy in a rollsroyce and there was a monkey in the rollsroyce and there was a monkey in the rollsroyce and there was a monkey in the car and the mon they were like hey that car and the mon they were like hey that car and the mon they were like hey that monkey like what are you doing you’re monkey like what are you doing you’re monkey like what are you doing you’re drunk why do you have a monkey in your drunk why do you have a monkey in your drunk why do you have a monkey in your car why does that monkey not look good car why does that monkey not look good car why does that monkey not look good bizarre sort uh so if you were to like bizarre sort uh so if you were to like bizarre sort uh so if you were to like send an email for something like really send an email for something like really send an email for something like really like really really real time like this like really really real time like this like really really real time like this it just fails it doesn’t work um I don’t it just fails it doesn’t work um I don’t it just fails it doesn’t work um I don’t know why their API doesn’t support know why their API doesn’t support know why their API doesn’t support search yet I think it will uh grock is search yet I think it will uh grock is search yet I think it will uh grock is fantastic because it looks like look fantastic because it looks like look fantastic because it looks like look looks out websites looks at tweets and looks out websites looks at tweets and looks out websites looks at tweets and it figures it out and I love the answer it figures it out and I love the answer it figures it out and I love the answer I love the response that it gives you so I love the response that it gives you so I love the response that it gives you so I tried out grock quite a bit and let me I tried out grock quite a bit and let me I tried out grock quite a bit and let me tell you the API sucks the API really tell you the API sucks the API really tell you the API sucks the API really sucks it’s the documentation is a lot sucks it’s the documentation is a lot sucks it’s the documentation is a lot less than than open AI um it doesn’t less than than open AI um it doesn’t less than than open AI um it doesn’t give you this at all the results are give you this at all the results are give you this at all the results are compared to the to the you know the the compared to the to the you know the the compared to the to the you know the the gooey and and X it just sucks um I was gooey and and X it just sucks um I was gooey and and X it just sucks um I was really disappointed actually with their really disappointed actually with their really disappointed actually with their API API API so okay gave up on grock so uh I gave up so okay gave up on grock so uh I gave up so okay gave up on grock so uh I gave up on grock and then I tried perplexity on grock and then I tried perplexity on grock and then I tried perplexity um oh my my God that’s killing me my um oh my my God that’s killing me my um oh my my God that’s killing me my keyboard not working so I tried keyboard not working so I tried keyboard not working so I tried perplexity uh they have an API and they perplexity uh they have an API and they perplexity uh they have an API and they do recent um you know that actually do recent um you know that actually do recent um you know that actually searches the internet and finds your searches the internet and finds your searches the internet and finds your relevant stuff and that was better it relevant stuff and that was better it relevant stuff and that was better it wasn’t quite what I want just yet so I wasn’t quite what I want just yet so I wasn’t quite what I want just yet so I think I need to play around with the think I need to play around with the think I need to play around with the prompt more I don’t know I I still need prompt more I don’t know I I still need prompt more I don’t know I I still need to figure out how to use this API but to figure out how to use this API but to figure out how to use this API but um I found this to be good enough for now um so I this to be good enough for now um so I this to be good enough for now um so I think for the Real Time stuff I’ll use think for the Real Time stuff I’ll use think for the Real Time stuff I’ll use this unless unless open AI this unless unless open AI this unless unless open AI like you know beats them to the punch like you know beats them to the punch like you know beats them to the punch and fixes their or or Gro really unless and fixes their or or Gro really unless and fixes their or or Gro really unless they if they fix the API and make it they if they fix the API and make it they if they fix the API and make it match this then is great I’ll totally match this then is great I’ll totally match this then is great I’ll totally use that but I don’t understand why this use that but I don’t understand why this use that but I don’t understand why this is so different than what you get from is so different than what you get from is so different than what you get from the API I don’t know anyways um and the the API I don’t know anyways um and the the API I don’t know anyways um and the other thing I was looking at routing to other thing I was looking at routing to other thing I was looking at routing to Gro was I hate that ch GPT a lot of the Gro was I hate that ch GPT a lot of the Gro was I hate that ch GPT a lot of the llms they treat you like you’re a llms they treat you like you’re a llms they treat you like you’re a 5-year-old you ask a spicy question 5-year-old you ask a spicy question 5-year-old you ask a spicy question quote unquote spicy or quote unquote spicy or quote unquote spicy or controversial question and it just controversial question and it just controversial question and it just treats you oh I can’t answer that oh I treats you oh I can’t answer that oh I treats you oh I can’t answer that oh I refuse to answer that it treats you like refuse to answer that it treats you like refuse to answer that it treats you like a child and I don’t want that I want you a child and I don’t want that I want you a child and I don’t want that I want you to be able to use this service like to be able to use this service like to be able to use this service like think okay look let’s say you have a VA think okay look let’s say you have a VA think okay look let’s say you have a VA you’re paying you’re paying a an actual you’re paying you’re paying a an actual you’re paying you’re paying a an actual real real real assistant it to like do things right you assistant it to like do things right you assistant it to like do things right you can send that assistant some kind of can send that assistant some kind of can send that assistant some kind of controversial I mean obvious you know controversial I mean obvious you know controversial I mean obvious you know obviously you need to be careful you obviously you need to be careful you obviously you need to be careful you can’t ask something really totally can’t ask something really totally can’t ask something really totally insane um but you can ask them a spicy insane um but you can ask them a spicy insane um but you can ask them a spicy controversial question and they’re not controversial question and they’re not controversial question and they’re not going to say oh I’m sorry I can’t answer going to say oh I’m sorry I can’t answer going to say oh I’m sorry I can’t answer that for you like that’s against my that for you like that’s against my that for you like that’s against my terms like no they’re gonna go look up terms like no they’re gonna go look up terms like no they’re gonna go look up and give you an answer to whatever and give you an answer to whatever and give you an answer to whatever you’re asking for so I want it to I want you’re asking for so I want it to I want you’re asking for so I want it to I want this to act exactly like a real person this to act exactly like a real person this to act exactly like a real person and a real person’s not going to treat and a real person’s not going to treat and a real person’s not going to treat you like a 5-year-old and say I’m sorry you like a 5-year-old and say I’m sorry you like a 5-year-old and say I’m sorry I cannot answer that question I wanted I cannot answer that question I wanted I cannot answer that question I wanted to Route this and and really find you to Route this and and really find you to Route this and and really find you the answer to whatever damn thing you’re the answer to whatever damn thing you’re the answer to whatever damn thing you’re asking for and it’s even more important asking for and it’s even more important asking for and it’s even more important because there’s a lot of things you because there’s a lot of things you because there’s a lot of things you clearly wouldn’t ask a real human you clearly wouldn’t ask a real human you clearly wouldn’t ask a real human you would be too embarrassed so you know would be too embarrassed so you know would be too embarrassed so you know what I mean like you’re not going to ask what I mean like you’re not going to ask what I mean like you’re not going to ask somebody hey like find me the best uh somebody hey like find me the best uh somebody hey like find me the best uh you know medication for hemorrhoids or you know medication for hemorrhoids or you know medication for hemorrhoids or something bizarre like this you know something bizarre like this you know something bizarre like this you know what I mean like obviously there’s what I mean like obviously there’s what I mean like obviously there’s privacy um but like you know there’s so privacy um but like you know there’s so privacy um but like you know there’s so many things you can Google and Google’s many things you can Google and Google’s many things you can Google and Google’s F giving you tons of resp you know F giving you tons of resp you know F giving you tons of resp you know results for whatever the hell you’re results for whatever the hell you’re results for whatever the hell you’re searching for a matter how searching for a matter how searching for a matter how controversial but why won’t the llm so I controversial but why won’t the llm so I controversial but why won’t the llm so I get really upset by that and I tried Gro get really upset by that and I tried Gro get really upset by that and I tried Gro because you know according to Elon because you know according to Elon because you know according to Elon Musk Gro will like not like have the Musk Gro will like not like have the Musk Gro will like not like have the guard rails on and it will just respond guard rails on and it will just respond guard rails on and it will just respond and um it will respond in a way other llms um it will respond in a way other llms um it will respond in a way other llms won’t yeah that’s I tried it won’t yeah that’s I tried it won’t yeah that’s I tried it out and API in here it’s it it says the out and API in here it’s it it says the out and API in here it’s it it says the same thing that chat GPT for a lot of same thing that chat GPT for a lot of same thing that chat GPT for a lot of stuff so I was pretty disappointed with stuff so I was pretty disappointed with stuff so I was pretty disappointed with that um I tried out so there were models that um I tried out so there were models that um I tried out so there were models like uh like um llama models or like like uh like um llama models or like like uh like um llama models or like mistal models people hacked to death and mistal models people hacked to death and mistal models people hacked to death and repackaged uh really managed to like repackaged uh really managed to like repackaged uh really managed to like remove the guard rails I mean I really remove the guard rails I mean I really remove the guard rails I mean I really remove the guard rails so I tried out remove the guard rails so I tried out remove the guard rails so I tried out some of those models no a lot of stuff some of those models no a lot of stuff some of those models no a lot of stuff it it’s spicier but it doesn’t answer a it it’s spicier but it doesn’t answer a it it’s spicier but it doesn’t answer a lot of stuff like like I want it to lot of stuff like like I want it to lot of stuff like like I want it to um and the reason why is because where um and the reason why is because where um and the reason why is because where it’s those models are being hosted they it’s those models are being hosted they it’s those models are being hosted they add the guard rails back so ah I don’t add the guard rails back so ah I don’t add the guard rails back so ah I don’t know I find it I just want to like know I find it I just want to like know I find it I just want to like actually be able to ask adult questions actually be able to ask adult questions actually be able to ask adult questions like any damn question you want and have like any damn question you want and have like any damn question you want and have it respond um maybe maybe I’m being it respond um maybe maybe I’m being it respond um maybe maybe I’m being naive maybe I’m being Reckless wanting naive maybe I’m being Reckless wanting naive maybe I’m being Reckless wanting that for my service but I just it it it that for my service but I just it it it that for my service but I just it it it it boggles my mind that you can Google it boggles my mind that you can Google it boggles my mind that you can Google anything and it’ll give you a result but anything and it’ll give you a result but anything and it’ll give you a result but you can’t ask an lolm I just I don’t to you can’t ask an lolm I just I don’t to you can’t ask an lolm I just I don’t to me that is just the stupidest thing me that is just the stupidest thing me that is just the stupidest thing whatever the hell you could Google and whatever the hell you could Google and whatever the hell you could Google and it gives you results for you should be it gives you results for you should be it gives you results for you should be do the same with an llm so that’s that’s do the same with an llm so that’s that’s do the same with an llm so that’s that’s my state Dan and I’m I’m trying to get my state Dan and I’m I’m trying to get my state Dan and I’m I’m trying to get to match that and route to wherever to match that and route to wherever to match that and route to wherever needs to route to get your damn answer needs to route to get your damn answer needs to route to get your damn answer because I want this thing to actually be because I want this thing to actually be because I want this thing to actually be useful useful useful and I don’t know tell me what you think and I don’t know tell me what you think and I don’t know tell me what you think what do you think do you think those gar what do you think do you think those gar what do you think do you think those gar girls are are there for good reason I girls are are there for good reason I girls are are there for good reason I don’t know so one thing I think I could don’t know so one thing I think I could don’t know so one thing I think I could do next which I probably won’t for now do next which I probably won’t for now do next which I probably won’t for now but if you host these models yourself but if you host these models yourself but if you host these models yourself then you could route to them obviously then you could route to them obviously then you could route to them obviously you have the model running on your own you have the model running on your own you have the model running on your own machine I don’t want to do that that’s machine I don’t want to do that that’s machine I don’t want to do that that’s very expensive and not worth it so I very expensive and not worth it so I very expensive and not worth it so I I’ll play around with this a bit more I’ll play around with this a bit more I’ll play around with this a bit more but so far I’m disappointed with Gro but so far I’m disappointed with Gro but so far I’m disappointed with Gro really like just straight up really like just straight up really like just straight up um for many many many um for many many many um for many many many things uh 40 chap GPT 40 is is better it things uh 40 chap GPT 40 is is better it things uh 40 chap GPT 40 is is better it really is um and now with this real time really is um and now with this real time really is um and now with this real time searching searching searching um I I don’t know the cool thing though um I I don’t know the cool thing though um I I don’t know the cool thing though about grock is that it looks at recent about grock is that it looks at recent about grock is that it looks at recent tweets that is very powerful that’s very tweets that is very powerful that’s very tweets that is very powerful that’s very cool so uh anyways I’m going to keep cool so uh anyways I’m going to keep cool so uh anyways I’m going to keep playing around with the routing but playing around with the routing but playing around with the routing but honestly going to perplexity for Real honestly going to perplexity for Real honestly going to perplexity for Real Time stuff seemed to work really nicely Time stuff seemed to work really nicely Time stuff seemed to work really nicely and I got pretty okayish responses it’s and I got pretty okayish responses it’s and I got pretty okayish responses it’s much better than the responses this much better than the responses this much better than the responses this thing was giving before just routing to thing was giving before just routing to thing was giving before just routing to chat GPT and just saying I don’t know chat GPT and just saying I don’t know chat GPT and just saying I don’t know what the hell that is or tells you some what the hell that is or tells you some what the hell that is or tells you some weird thing that happened two years ago weird thing that happened two years ago weird thing that happened two years ago so um making good progress uh I have a so um making good progress uh I have a so um making good progress uh I have a bunch of tests written so I could bunch of tests written so I could bunch of tests written so I could clearly see see like when I Chang the clearly see see like when I Chang the clearly see see like when I Chang the prompt oh crap like look at now it’s prompt oh crap like look at now it’s prompt oh crap like look at now it’s acting different so good progress um I acting different so good progress um I acting different so good progress um I I’m not going to get much done today uh I’m not going to get much done today uh I’m not going to get much done today uh and I’ll be back and I’ll be back and I’ll be back on on this like with a lot more on on this like with a lot more on on this like with a lot more productivity in in a couple more days so productivity in in a couple more days so productivity in in a couple more days so almost there um yeah any anyways almost there um yeah any anyways almost there um yeah any anyways interesting stuff playing around more interesting stuff playing around more interesting stuff playing around more deeply with uh with the routing um oh deeply with uh with the routing um oh deeply with uh with the routing um oh and one more one last thing I found open and one more one last thing I found open and one more one last thing I found open router to be really useful um at first I router to be really useful um at first I router to be really useful um at first I started like okay here’s credit for Gro started like okay here’s credit for Gro started like okay here’s credit for Gro okay here’s credit for uh perplexity okay here’s credit for uh perplexity okay here’s credit for uh perplexity here’s credit to try this now open here’s credit to try this now open here’s credit to try this now open router kicked ass that was that was the router kicked ass that was that was the router kicked ass that was that was the way to go just pay open router and you way to go just pay open router and you way to go just pay open router and you can route your requests to so many can route your requests to so many can route your requests to so many models I I found I I that’s a plus models I I found I I that’s a plus models I I found I I that’s a plus that’s a thumbs up for me uh open router that’s a thumbs up for me uh open router that’s a thumbs up for me uh open router that that’s cool um I might actually that that’s cool um I might actually that that’s cool um I might actually just roll with open router to be honest just roll with open router to be honest just roll with open router to be honest and let it fall back to you know let’s and let it fall back to you know let’s and let it fall back to you know let’s say Chad GPT has a um uh let’s say say Chad GPT has a um uh let’s say say Chad GPT has a um uh let’s say they’re they’re they’re down just no problem routes is somewhere down just no problem routes is somewhere down just no problem routes is somewhere else so else so else so um yeah that that was interesting to um yeah that that was interesting to um yeah that that was interesting to play around with that too so anyways play around with that too so anyways play around with that too so anyways that’s all I got that’s all I got that’s all I got um yeah go visit go visit the West if um yeah go visit go visit the West if um yeah go visit go visit the West if you’ve never been especially like the you’ve never been especially like the you’ve never been especially like the the the ghost towns there are some the the ghost towns there are some the the ghost towns there are some really cool ones here in California

Description

Today’s insights:

  • Grok API implementation attempt
  • Perplexity performance comparison
  • Ghost town exploration story

Summary

Summary of the Video: Daily Update for January 5th 2025 This daily update details a road trip to a Wild West ghost town in California, includes personal reflections from a challenging relationship, and provides a technical update on an LLM routing project. The speaker compares APIs like Grok and perplexity and discusses the limitations of LLM guard rails.

AI with Steve build in public

Subscribe to stay up to date