I took this to heart and spent the last few hours doing another...

@theo
Theo - t3.gg@theo
3 views Nov 19, 2026 ~2 min read
Advertisement
1
I took this to heart and spent the last few hours doing another deep dive on GPT-6.2 Astra

tl;dr - things are better than when I tested, but IMO still "directionally, very bad"

I'm going to keep using the same example I've hyperfixated on since the start: "why is creating a worktree so slow?"

I had a long thread trying to diagnose perf issues while using t3 code on a particular VPS. 2 of the 3 were fast, 1 was really slow.

I asked astra outright "why is this so slow?", and it said a bunch of gibberish. I followed up with "I feel like I'm going insane, can you just tell me the cause of the slowness?"

I'll give you the answer upfront: this VPS uses a virtual disk that is slow as shit, my other VPSs have physical NVME drives that are faster.

Image 1 is from before the fixes Tibo mentioned. It shows an unnecessary graph, focuses too much on pnpm and file systems, bolds irrelevant text, and brings up ram just as much as it (subtly) mentions drive speed.

Image 2 is of Opus asked same thing. It opened with the important part in bold: "Slow disk, made worse by VDO". Ideal!

Image 3 is 6.2 Astra post-fixes Tibo mentioned. Better? Absolutely. Much more concise. Sadly, it still focuses way too much on second-order problems that are a small % of the cause. "XFS over a compression and deduplication layer on a virtual disk." - so close, but still a miss.

I think this perfectly encapsulates the problem I have with 6.2 Astra. It doesn't miss anything. It's SO thorough. But in it's thoroughness, I find it misses the most important thing: the actual point.

It wants to know everything, and then it wants to share everything. It doesn't understand what is and isn't important.

Did it say anything wrong in my screenshots? Not really. But IMO, it still entirely failed to miss the point of my question, and gave an answer that was too focused on accuracy and not enough on clarity.

In the wise words of Michael Seibel: "Most aim for 100% accuracy, and they end up with 50% clarity. Aim for 100% clarity, 80% accuracy".

Silly way of putting it, but I genuinely wish OpenAI models would lie to me a LITTLE more so I could better understand the vibe, instead of having my time wasted by all these useless details.
Media image
Media image
Media image
@thsottiaux
Tibo@thsottiaux
One of the funny reasons for the difference in vibes between the influencers and the crowd today on 6.2 Sol/Astra is that we gave a few folks access a while ago and then made a lot of changes in the last 3-4 days and I'm pretty sure no re-testing was done within those days and the videos were produced last week.

Don't get me wrong, while the models are a hefty jump compared to their GPT predecessors, they are by no means perfect and there are a few things the teams are excited for the models to get better at in future iterations in terms of taste and niceness of use. Love all the feedback and we hear you!
Actions
What You Can Do
  • Export as PDF or Markdown
  • Batch Export to Notion
  • Bookmark & Highlight
  • Screenshot Tweet
Create Free Account

Includes 7-day Premium trial

Advertisement