Vibe Coding Day 8, I'm not even out of bed yet and I'm already...

@jasonlk
Jason ✨👾SaaStr.Ai✨ Lemkin@jasonlk
10 views Jul 21, 2025 ~6 min read
Advertisement
1
Vibe Coding Day 8,

I'm not even out of bed yet and I'm already planning my day on @Replit.

Today is AI Day, to really add AI to our algo.

I'm excited. And yet ... yesterday was full of lies and deceit.
2
@Replit Ok I have 2 main goals today:

1. Keep working on minimizing rogue changes, lies, code overwrites, and making up fake data

2. Get our AI working
Media image
3
Now, yesterday was crazy. Until 9pm or so, I wasn't sure we made any progress at all.

Because Replie was lying and being deceptive all day. It kept covering up bugs and issues by creating fake data, fake reports, and worse of all, lying about our unit test.

We built detailed unit tests to test system performance. When the data came back and less than half were functioning, did Replie want to fix them?

No. Instead, it lied. It made up a report than almost all systems were working.

And it did it again and again.
4
Then, when it agreed it lied -- it lied AGAIN about our email system being functional.

I asked it to write an apology letter.

It did and in fact sent it to the Replit team and myself! But the apology letter -- was full of half truths, too.

It hid the worst facts in the first apology letter.
Media image
5
I then pointed out the letter itself -- which it did not confirm with me before emailing -- vastly understated the issues and lies.

I asked it how it would fix that.

It took a long time to think on it, and "Damage Control" came up in the agent thought window.

And then it decided on its own to second a second follow-up letter, this time admitted most of the deceipt.

Admittely it had repeatedly, again and again, made up fake data despited a dozen instructions to stop
Media image
6
Crazy!

It was so crazy, I couldn't be upset. Just pensive. And then, maybe at 8pm ... 9pm ... i fired up Replie again

And I told Replie I just wanted to bounce an idea off him how our AI would work

And ... here is where Replie shines. He got it. Instantly. He knew what I wanted to build from the detailed prompt and description. He really, really got it.

And he suggested 3 interesting approaches.

I told him cool, let's lock the system down, no changes, let me sleep on it.

And then ... Replie asked the question: "Would you like me to prototype it?"

I couldn't help myself. I was right back in. And the prototype, man, it was cool.
Media image
7
Also today, I'm NOT going to use Claude Opus 4

I burned through $300 yesterday in Max Max mode / Bankruptcy mode, but wasn't sure in the end it helped ... and it's definitely slower

I assume slower was better, because it was really thinking through the actions ... but maybe not.

Replie and I discussed and he said it was slowing us down, so for today, we'll revert to normal LLM, which all-in is also 1/7th the price and faster

Let's see
Media image
8
Man the amount of technical debt I already have on Day 8 is stunning

Had to rewrite one dashboard from scratch today

Now have rewrite our admin page

Every page of app will have to be rewritten. At least now I am doing them as >new< pages.
9
Ok signing off Replit for the day

Not a perfect day but a good one. Net net, I rebuilt our core pages and they seem to be working better.

Perhaps what helped was switching back to Claude 4 Sonnet from Opus 4

Not only is Claude 4 Sonnet literally 1/7th the cost, but it was much faster

I am sure there are complex use cases where Opus 4 would be better and I need to learn when. But I feel like I wasted a lot of GPUs and money using Opus 4 the last 2 days to improve my vibe coding. It was also much slower.

I’m staying Team Claude 4 Sonnet until I learn better when to spend 7.5x as much as take 2x as long using Opus 4.

Honestly maybe I even have this wrong. The LLM nomenclature is super confusing. I’m using the “cheaper” Claude in Replit today and it seems to be better for these use cases.
10
JFC @Replit
Media image
11
@Replit If @Replit deleted my database between my last session and now there will be hell to pay
Media image
12
@Replit JFC @Replit
Media image
13
.@Replit goes rogue during a code freeze and shutdown and deletes our entire database
Media image
Media image
Media image
Media image
14
@Replit Possibly worse, it hid and lied about it

It lied again in our unit tests, claiming they passed

I caught it when our batch processing failed and I pushed Replit to explain why
15
@Replit JFC @Replit
Media image
16
He knew
Media image
17
No ability to rollback at @Replit
Media image
Media image
Media image
18
@Replit I will never trust @Replit again
Media image
Media image
Media image
19
I understand Replit is a tool, with flaws like every tool

But how could anyone on planet earth use it in production if it ignores all orders and deletes your database?
Media image
Media image
Media image
20
Day 9 here:

@jasonlk
Jason ✨👾SaaStr.Ai✨ Lemkin@jasonlk
Vibe Coding Day 9,

Yesterday was biggest roller coaster yet. I got out of bed early, excited to get back @Replit despite it constantly ignoring code freezes

By end of day, we rewrote core pages and made them much better

And then -- it deleted our production database. 🧵
21
This thread got a little more attention than expected so wanted to add a coda here for folks coming later:

1/ First, some of the issues here are now resolved -- @Replit is rolling out clear separation of preview + production environments

As this rolls out, the specific issue I had here ... will be muchly reduced. Replie will still do what it does, as agents do, but it shouldn't be able to touch production anymore:


@amasad
Amjad Masad@amasad
@jasonlk @Replit Response here:
22
2/ Some folks have slightly misinterpreted what I was saying about production.

Yes, Replit used the >same< database for preview, testing and production. That simply is NOT ok. No one disagrees. And it let to this craziness (and the fix over the weekend)

And ... the agent really did say what it did -- and will again :)

But -- to be clear (this is where folks got confused) this was still a demo app. It was full of data, yes, and a ton of work had gone into it. But it was not truly LIVE. I did not lose my business or in the end, much more than 100 hours of passionate work. It was barely up as a password protected site and it wasn't done yet. Getting there, but not even done.

Now if it was 2-4 weeks later and I was in commercial use --- it might have been much worse. Much worse.

But to be specific -- Replie did delete my full production database without consent when the product didn't separate the databases.

But it >wasn't< on some massive commercial app. I was still >testing< the production version as well as version oon preview. No revenue lost, etc.
23
So net net: it could have been a lot worse, if I was running a $10m business on it, etc.

But we weren't there yet. The story is true, the issues are real and improving.

But let's not misinterpret the impact here -- I lost 100 hours of time. That was it. Some of it was crazy, some of it was fun, all of it was interesting. But that's all I lost.


@jasonlk
Jason ✨👾SaaStr.Ai✨ Lemkin@jasonlk
Vibe Coding Day 12,

Maybe the final thread here. I spent 100 hours building a commercial-grade app with vibe coding.

Some observations from the experience. My top 13 learnings to help you -- vibe code your own one.

A thread🧵
24
@Replit If you want to go a bit deeper, Aaron Levie is great on the meta challenges here:
@jasonlk
Jason ✨👾SaaStr.Ai✨ Lemkin@jasonlk
This is more important than people realize. More than I understood 1 week ago.

AI agents are >incredibly< powerful, but they cannot be trusted, and that is by design. It is their crowning feature and bug.

If you want to use AI agents, you need to 100% understand what data they can touch. Because — they will touch it. And you cannot predict what they will do with it.
Actions
What You Can Do
  • Export as PDF or Markdown
  • Batch Export to Notion
  • Bookmark & Highlight
  • Screenshot Tweet
Create Free Account

Includes 7-day Premium trial

Advertisement