The most prestigious law school admissions discussion board in the world.
|
 |
 
|
GPT 5.2 is again so far ahead of everything that its a joke
Poast new message in this thread
Date: January 12th, 2026 2:22 PM Author: coiffed mad cow disease I was honestly wondering if Claude was going to jump ahead with 5.1 being kind of lackluster. but then 5.2 made a huge leap ahead of opus. and obviously gemini is still way behind both of those (http://www.autoadmit.com/thread.php?thread_id=5821130&forum_id=2#49583695) |
 |
Date: January 12th, 2026 2:23 PM Author: Flirting Vengeful Lay Nowag how can you tell? (http://www.autoadmit.com/thread.php?thread_id=5821130&forum_id=2#49583697) |
|
Date: January 12th, 2026 2:24 PM Author: Hideous zombie-like faggot firefighter university I'm just guessing (http://www.autoadmit.com/thread.php?thread_id=5821130&forum_id=2#49583701) |
|
Date: January 12th, 2026 3:10 PM Author: White Base (http://www.autoadmit.com/thread.php?thread_id=5821130&forum_id=2#49583849) |
|
Date: January 12th, 2026 4:32 PM Author: coiffed mad cow disease (http://www.autoadmit.com/thread.php?thread_id=5821130&forum_id=2#49584035) |
|
Date: January 16th, 2026 2:27 AM Author: ruddy medicated senate patrolman (http://www.autoadmit.com/thread.php?thread_id=5821130&forum_id=2#49593262) |
Date: January 12th, 2026 2:27 PM Author: costumed office It's a hilarious/brutal market. There's effectively no lock-in, so I just switch between whoever is good right now. Think they're the current winner, I never need to switch bots because it can't do something. In 4 the python became passable, now in 5.2 it's really good. I never bother coding "by hand" any more. (http://www.autoadmit.com/thread.php?thread_id=5821130&forum_id=2#49583708) |
|
Date: January 12th, 2026 2:31 PM Author: galvanic smoky candlestick maker I've used ChatGPT a few times to make scripts for Windows, and it always fucks up. Is it better at real coding? (http://www.autoadmit.com/thread.php?thread_id=5821130&forum_id=2#49583728) |
|
Date: January 12th, 2026 2:32 PM Author: costumed office Windows Scripts? You mean PowerShell? I haven't tried that. It does just fine with python, which isn't surprising. Python is one of the most documented languages on the planet. (http://www.autoadmit.com/thread.php?thread_id=5821130&forum_id=2#49583733) |
|
Date: January 12th, 2026 2:37 PM Author: galvanic smoky candlestick maker Powershell and just good old batch files for cmd. (http://www.autoadmit.com/thread.php?thread_id=5821130&forum_id=2#49583753) |
|
Date: January 12th, 2026 4:42 PM Author: coiffed mad cow disease i dont believe for a second that it is messing up powershell scripts. maybe a script 3K lines long you glued together to train a model might not work the first go around. (http://www.autoadmit.com/thread.php?thread_id=5821130&forum_id=2#49584053) |
|
Date: January 12th, 2026 4:58 PM Author: Hideous zombie-like faggot firefighter university (http://www.autoadmit.com/thread.php?thread_id=5821130&forum_id=2#49584090) |
|
Date: January 12th, 2026 6:07 PM Author: galvanic smoky candlestick maker Nothing nearly that long. And it has been things like CLI syntax errors and mistakes in handling errors. (http://www.autoadmit.com/thread.php?thread_id=5821130&forum_id=2#49584273) |
|
Date: January 12th, 2026 6:15 PM Author: coiffed mad cow disease well idk. i dont use powershell I use ubuntu and mac os only. it never fucks up bash and python scripts for me. the older versions used to fuck them up a lot. I haven't seen gpt make a syntax error since like gpt 4.1. maybe once in a while on o3 and o4. but not since it switched to 5. (http://www.autoadmit.com/thread.php?thread_id=5821130&forum_id=2#49584292) |
|
Date: January 16th, 2026 2:22 AM Author: soggy pearly parlour really tough guy I've also noticed it's lackluster at powershell (http://www.autoadmit.com/thread.php?thread_id=5821130&forum_id=2#49593260) |
|
Date: January 12th, 2026 2:34 PM Author: at-the-ready school No it's horrible (http://www.autoadmit.com/thread.php?thread_id=5821130&forum_id=2#49583738) |
|
Date: January 12th, 2026 2:41 PM Author: galvanic smoky candlestick maker One of the things I've found most frustrating is that when you're telling it to fix an error (which is annoying enough), it will often change (and break) other things that aren't at issue and were working just fine. It will even do that sometimes when you specifically tell it not to touch anything else. (http://www.autoadmit.com/thread.php?thread_id=5821130&forum_id=2#49583773) |
|
Date: January 12th, 2026 2:45 PM Author: costumed office What are you trying to do and what prompt did you give the bot (http://www.autoadmit.com/thread.php?thread_id=5821130&forum_id=2#49583786) |
|
Date: January 12th, 2026 2:55 PM Author: at-the-ready school I am coding a discord replacement in assembly language
But it can't even give the right proxmox commands. It always says pct restart instead of pct reboot for instance, It's bad |
|
Date: January 12th, 2026 4:34 PM Author: coiffed mad cow disease lol yeah no wonder. you are using it to code assembly language. its really good at the popular languages. python is probably its best. also you can't always just give it some abstract prompt and expect it to guess the "right" implementation you have in mind. you need to be feeding it real concrete evidence from outputs etc. (http://www.autoadmit.com/thread.php?thread_id=5821130&forum_id=2#49584036) |
|
Date: January 12th, 2026 5:19 PM Author: costumed office (http://www.autoadmit.com/thread.php?thread_id=5821130&forum_id=2#49584139) |
|
Date: January 12th, 2026 5:20 PM Author: Anal mad-dog skullcap were u possessed by NSAM (http://www.autoadmit.com/thread.php?thread_id=5821130&forum_id=2#49584143) |
|
Date: January 12th, 2026 5:50 PM Author: at-the-ready school I'm flaming online (http://www.autoadmit.com/thread.php?thread_id=5821130&forum_id=2#49584236) |
|
Date: January 12th, 2026 6:09 PM Author: topaz toaster public bath (http://www.autoadmit.com/thread.php?thread_id=5821130&forum_id=2#49584278) |
|
Date: January 12th, 2026 3:01 PM Author: Hideous zombie-like faggot firefighter university Scripts are coding and it's good also try codex (http://www.autoadmit.com/thread.php?thread_id=5821130&forum_id=2#49583832) |
|
Date: January 12th, 2026 3:10 PM Author: Twinkling titillating stag film boiling water (bizarro world where opus 4.5 doesn't exist) (http://www.autoadmit.com/thread.php?thread_id=5821130&forum_id=2#49583847) |
|
Date: January 12th, 2026 4:34 PM Author: beady-eyed angry resort (http://www.autoadmit.com/thread.php?thread_id=5821130&forum_id=2#49584037) |
|
Date: January 12th, 2026 4:35 PM Author: coiffed mad cow disease its much better than opus 4.5. opus 4.5 just comes up with all of this stuff that literally doesn't matter. like give it something thats broken and it will give you 100 edge cases that matter in 1 in a billion situations and tell you to fix them. gpt 5.2 gives you useful stuff every time. opus 4.5 can be ok though if you have gpt 5.2 to keep it in check but still nowhere even close to as good at coding and math as gpt 5.2. also gpt 5.2 is much more conservative about conclusions. opus 4.5 will be super super certain about an answer when its just guessing. the guess might be correct like 1 in 5 times but the times its hallucinating add up. there are probably things opus is better at like writing and business intelligence. but im 100% sure gpt 5.2 is substantially better at coding and math because the gap is big. (http://www.autoadmit.com/thread.php?thread_id=5821130&forum_id=2#49584039) |
|
Date: January 12th, 2026 4:54 PM Author: ebony theater stage incel ChatGPT is smarter likexo autist
Claude is more polished like legally blonde or whatever |
|
Date: January 12th, 2026 5:46 PM Author: coiffed mad cow disease yeah i agree with that (http://www.autoadmit.com/thread.php?thread_id=5821130&forum_id=2#49584221) |
|
Date: January 12th, 2026 8:03 PM Author: beady-eyed angry resort (http://www.autoadmit.com/thread.php?thread_id=5821130&forum_id=2#49584733) |
|
Date: January 12th, 2026 4:43 PM Author: bistre turdskin persian (http://www.autoadmit.com/thread.php?thread_id=5821130&forum_id=2#49584058) |
|
Date: January 12th, 2026 5:04 PM Author: Flesh bateful striped hyena What a Joke (http://www.autoadmit.com/thread.php?thread_id=5821130&forum_id=2#49584107) |
|
Date: January 12th, 2026 5:46 PM Author: coiffed mad cow disease (http://www.autoadmit.com/thread.php?thread_id=5821130&forum_id=2#49584223) |
|
Date: January 15th, 2026 10:37 PM Author: coiffed mad cow disease yeah turns out my intuition was correct. even though claude slightly edges out gpt 5.2 on the SWE i think by .8%, GPT scores SIGNIFICANTLY HIGHER on abstract reasoning benchmarks (54.2% vs. 37.6%) for Opus 4.5 making it better at generalizing to solve problems outside its training data. and also Blocker-Severity Vulnerabilities: GPT 5.2 High achieved a best-in-class security posture with only 16 blocker vulnerabilities per million lines of code (MLOC). Claude Comparison: By contrast, Claude Opus 4.5 Thinking generated 44 blockers per MLOC—nearly 3x as many—while Claude Sonnet 4.5 registered a high of 198 blockers. In deep-reasoning evaluations, GPT 5.2 has demonstrated a significant lead in identifying "blocker-severity" issues: GPT 5.2: Identified 13 out of 15 critical system-level errors (such as subtle race conditions and complex handler registration bugs). Claude Opus 4.5: Identified only 5 out of 15 of these same high-level architectural errors, often missing the deeper root causes despite fixing the surface-level bugs.
Also GPT 5.2 scores significantly higher on a newer version of the SWE called SWE pro which is less python centric. 55.6% for 5.2 with 43.3 for Claude. |
|
Date: January 15th, 2026 10:47 PM Author: grizzly mediation nursing home With "the best LLM" use case is everything. (http://www.autoadmit.com/thread.php?thread_id=5821130&forum_id=2#49593074) |
|
Date: January 15th, 2026 10:50 PM Author: coiffed mad cow disease to me the generalized reasoning capability is the most important part. in terms of more specific "use case" stuff its just about being clever enough to make the model give you useful outputs and clever ways to cross-check and verify without putting in too much effort
I want an AGI level superhuman general reasoning machine. Not a leading expert in x gay field |
|
Date: January 15th, 2026 10:55 PM Author: Lime talented school cafeteria It changes on a weekly basis lately
Opus 4.5 was kicking everyone's ass since December to the point it became personally ranked #1 for the first time ever, but only for a few weeks. Anthropic must be selectively throttling max subs because some days it's noticeably weaker. On Sunday nights it is so much smarter and better at outputs and handling large contexts that it feels like a different AI
Gpt 5.2 needs more conscious prompting to extract the desired output and its responses are dense and less legible; but there is no question that it bitch slaps opus 4.5 on more complicated reasoning tasks as of THIS WEEK
Next week might be a different story |
|
Date: January 15th, 2026 11:00 PM Author: coiffed mad cow disease this makes it sound like you think reasoning tasks themselves change in difficulty from week to week, but maybe you just were lazy about what you wrote? The thing that changes is that the next model claude releases could be better than 5.2. I guess what you mean is that Opus 5 might be better than gpt 5.2 which I agree with. (http://www.autoadmit.com/thread.php?thread_id=5821130&forum_id=2#49593093) |
|
Date: January 15th, 2026 11:13 PM Author: Lime talented school cafeteria I have a multi-model validation process that's a ghetto version of mainlining's mahchine. It's the same exact prompts that I'm comparing outputs from. There was a brief period that 4.5 still outperformed 5.2 (and Sunday nights) (http://www.autoadmit.com/thread.php?thread_id=5821130&forum_id=2#49593110) |
|
Date: January 15th, 2026 11:18 PM Author: coiffed mad cow disease You are confusing different output from the same prompt as the model changing from week to week. The outputs are not going to be the same every time. Outputs are stochastic. The model itself is the same until they release an update. (http://www.autoadmit.com/thread.php?thread_id=5821130&forum_id=2#49593113) |
|
Date: January 15th, 2026 11:42 PM Author: Lime talented school cafeteria I would say it's more fluid than week to week
And I never said that models change in between releases |
|
Date: January 16th, 2026 6:58 AM Author: Anal mad-dog skullcap I rike a GRM (http://www.autoadmit.com/thread.php?thread_id=5821130&forum_id=2#49593313) |