· 06:40 PM PDT

Qwen 3.8 Shatters Benchmarks Amid AI Debt and Agent Wars

Overview

Alibaba’s Qwen 3.8 launch has ignited the open-weight community, delivering frontier-tier coding and reasoning performance that runs on consumer GPUs while undercutting pricing by orders of magnitude. The broader industry simultaneously faces mounting scrutiny over a $1.65 trillion corporate debt binge funding data center expansions, even as OpenAI accelerates its agentic push amid new safety breaches and a PAC-funded disinformation probe. Developers are adapting to a rapidly shifting landscape where autonomous coding workflows, cognitive debt, and fresh EU transparency mandates are redefining practical AI adoption.


Hacker News Stories

SQLite Critical CVEs or LLM Slop?

699 points · 347 comments · by ymir_e

JFrog Security researchers discovered that a batch of newly published SQLite CVEs, initially flagged as critical by NVD and CISA, were largely fabricated AI-generated vulnerabilities. Detailed code audits and PoC testing revealed that the advisories cited non-existent functions, impossible line numbers, and unchanged source files, with only one of 55 advisories from the same GitHub account containing a legitimate bug. The incident highlights a critical flaw in the modern CVE pipeline, where the pause on NIST's manual validation process allows unverified, AI-slop submissions to bypass scrutiny and enter enterprise vulnerability scanners.

Interesting Points
  • CVE-2026-51296 referenced lines 3555 and 3575 in json.c, but the file for SQLite 3.41.0 is only 2,706 lines long.
  • CVE-2026-51302 alleged a use-after-free in exprComputeOperands(), a function not introduced into the codebase until mid-2025.
  • Red Hat initially assigned CVE-2026-51302 a CVSS score of 10.0, later downgraded to 7.6 after researchers flagged its validity.
  • The research team compiled official SQLite releases in isolated Docker containers with AddressSanitizer instrumentation to test payloads, finding none triggered crashes or memory leaks.
  • A broader audit of the programmervuln/cveadvisory- GitHub repository showed that 54 out of 55 published advisories were completely fabricated.
  • MITRE's public CVE submission form requires no identity verification or proof-of-concept, allowing plausible-sounding fake reports to propagate through fragmented ADP pipelines directly into GHSA and downstream databases.
Top Comments

We can chalk this up as another example of over-exhuberance by what folks believe LLMs can accomplish vs. what they actually are.

LLM-based "AI" is able to use its vast corpus of inputs and calculate the most statistically likely output in a given situation. It is probabilistic, and when you are dealing with probabilities in a situation where certainties, not probabilities, matter, you're going to get dinged on credibility massively when your LLM-based "AI" gets the probabilities wrong at best, or in this case, claims a line of code generates a vulnerability when it is, in fact, a code comment.

LLMs are text-prediction engines. They are not Artificial Intelligence, and shouldn't not be treated in any form or fashion as if they possess intelligence. What bothers me about this entire situation is that presumably the folks that relied on the LLM-based "AI" to generate these vulnerabilities knew (or should have known) enough about their tool to know this would happen, but did not.

Now, we all pay the consequence, to the tune of hundreds of thousands if not millions of dollars of wasted productivity from teams that have to deal with the resulting fall-out of this usage of "AI".

A human must verify everything an LLM presents as fact. Everything. If you don't, we all pay the price. LLMs do not remove the onus of responsibility on the human being, if anything they amplify it because LLMs can generate lots more output more quickly that needs to be verified than humans can.

gortok (thread)

Many people with no skills are taking advantage of the LLM craze to artificially inflate their own value. I see it every day on LinkedIn.

People that previously have barely any experience in tech, now being hired in AI startups because they are good bullshitters.

elmer2 (thread)

Now, we all pay the consequence, to the tune of hundreds of thousands if not millions of dollars of wasted productivity from teams that have to deal with the resulting fall-out of this usage of "AI".

Brandolini's principle in action. It takes 10 times more energy to refute BS than to generate it. A related analogy to computing: it is easy to generate propositions, but hard to test if a given proposition is satisfiable or not, which curiously ties to P vs NP.

bwfan123 (thread)

A human must verify everything an LLM presents as fact. Everything.

I've thought about this for quite some time now.

No. A human doesn't need to verify everything. And the argument is really simple: stochastic.

Think of self-driving cars: We can show today - based on evidence and real data - that self-driving cars are safer than human drivers. That's a fact and the consequences are clear, more self-driving cars, less human-driven cars, less accidents, less hurt people, less dead people.

Are the cars 100% safe and NEVER make a mistake? No. But they don't need to. Nothing is ever 100% (in the real world).

Now back to AI for software creation. "Review is the bottleneck because EVERYTHING must be judged by a human." No. It doesn't. We just need to build AI review systems, that will do reviews better than (or at least as good as) humans. The human review quality bar is far below 100%. Far far far. If we can show (likely in the next 12-24 months I think) that AI review quality is consistently above the human review quality - again, based on evidence, based on real data - then that's it, then there's no good reason to have humans review the code.

Yes, there will be another layer in the system, another level of abstraction that will/must end at the human boundary.

adjfasn47573 (thread)

LLMs are text-prediction engines. They are not Artificial Intelligence, and shouldn't not be treated in any form or fashion as if they possess intelligence.

I agree that humans must verify LLM-produced facts, but strongly disagree with these kinds of "stochastic parrot therefore dumb" arguments.

Yes, an LLM is a "stochastic parrot". No, that doesn't imply that it is dumb. Enough to look at how Terence Tao asks ChatGPT to help him understand a solution that nobody had ever discussed before 1, or how a random guy asks ChatGPT in a handful of words to disprove a 30-year-old conjecture, with zero technical input 2.

If your parrot in a birdcage with internet access can finish the sentence, "The counterexample to the Dinitz–Garg–Goemans conjecture is...", then it's a pretty smart parrot, by all reasonable definitions of "smart". Just because someone bottled up the formula into matrix multiplications and added some random sampling to the outcome, that doesn't take away from the fact that the parrot said provably correct statements that the biggest experts in the field couldn't imagine.

And no, I'm not implying that the LLMs are correct all the time, or that their intelligence and reasoning works in any way like ours.

treszkai (thread)


Prevent cognitive debt by manually retyping LLM-generated code

382 points · 327 comments · by mpweiher

The author advocates for a deliberate coding workflow to avoid accumulating cognitive debt when using AI coding assistants on personal projects. Rather than allowing an LLM to autonomously generate and modify files, he instructs the model to output all proposed edits and commands in the chat for him to manually type into his editor. While this approach reduces his development speed from an estimated 10x to roughly 2x, it forces him to engage with every line of code. This manual process builds a comprehensive mental model of the codebase, helps catch hallucinations, and ensures he fully understands the software he ships. Ultimately, the author argues that prioritizing comprehension over raw productivity prevents long-term professional and industry-wide knowledge gaps.

Interesting Points
  • The workflow relies on a strict system prompt that explicitly forbids the AI from creating, editing, or deleting project files and restricts it from running any dependency or repository-modifying commands.
  • Manually transcribing the AI's output forces the developer to slow down, which increases the likelihood of catching subtle hallucinations or flawed architectural choices in real time.
  • The author estimates this method yields only a 2x speed advantage over traditional coding, contrasting sharply with the 10x acceleration promised by fully automated AI pair programming.
  • Typing out every line allows for immediate, on-the-fly refactoring, custom comment insertion, and adaptation to existing project conventions as the code is entered.
  • The practice recreates traditional programming mentorship advice to never copy-paste code, treating LLM output as an interactive learning tool rather than a finished product.
  • The author warns that widespread reliance on autonomous code generation risks creating an industry-wide cognitive debt that could eventually leave developers unable to maintain critical digital infrastructure.
Top Comments

Working on the problems yourself and have AI in a reviewer/feedback mode is the most productive way to challenge complex software problems.

epolanski (thread)

It's like trying to retype calculus solutions — you don't learn from it

???

i entirely learned all the math and applied math by working through problems whether myself or copying down from the solutions manual or text book over and over again until it stuck

8note (thread)

Try doing the same things now without an LLM.

I know another thing that gives you the same (fake) feeling: Cocaine.

elzbardico (thread)

In a way it's not so different from learning in school. There were definitely times I read a textbook for a programming or other CS course and reused some example code or whatever to solve homework problems.

I think the helpful part is taking something that already exists, learning how it works, and rewriting it yourself to internalize it.

Again as usual the more important thing is that you know what you're using otherwise it's just copying.

spike021 (thread)

So we are reduced to code monkeys mindlessly re-typing what an LLM wrote to increase potential understanding...

Whatever this approaches, it is not a state of software engineering I find desirable.

ablob (thread)


OpenAI's super PAC is funding AI-generated news site attacking industry critics

205 points · 104 comments · by JSR_FDED

AcutusWire.com website screenshot

An investigation reveals that AcutusWire.com is an anonymously operated digital news publication that relies almost entirely on AI to generate its content, with no human reporters on staff. Technical analysis of the site's source code and API shows an automated editorial dashboard, AI-generated interview requests, and internal review logs that routinely bypass human fact-checking. The publication's operations and political messaging are traced back to Novus Public Affairs, whose client list includes Targeted Victory, the GOP consulting firm at the center of OpenAI's $125 million super PAC. The site's output consistently advances deregulatory talking points and attacks AI safety advocates, directly contradicting OpenAI's own usage policies that prohibit its technology from being used for political campaigning or lobbying.

Interesting Points
  • AI detector Pangram flagged 69% of the site's 94 articles as fully AI-generated and another 28% as partially AI-generated, leaving only three classified as human-authored.
  • The site's internal API exposes a multi-pass AI editorial review process that scores output on metrics like AP style compliance and quote accuracy, with a median turnaround time of just 44 seconds per story.
  • Forty-two of the 94 published stories received an automated needs_revision status from the site's own AI reviewer but were still published anyway.
  • Interview requests are handled by an automated reporter agent that contacts experts via email to conduct written Q&As, leading experts to mistakenly believe they are speaking to human journalists.
  • The publication licenses its work under Creative Commons and distributes it via an RSS feed, enabling easy syndication by other outlets under the guise of independent reporting.
  • Roughly 15% of Acutus's coverage focuses on AI policy, consistently echoing the anti-regulation talking points promoted by OpenAI's super PAC operatives and aligned social media accounts.
Top Comments

Is there a state in which this constitutes fraud?

JumpCrisscross (thread)

Probably doing something similar here.

This place average post went from "look at this new javascript framework" to "I just became 100x more productive with AI" in the last 3 years

iammrpayments (thread)

But there don't seem to be any contributors, or at least not human ones. I ran every article on the site through Pangram (the AI detector that credibly claims a near-zero false-positive rate). Of the 94 articles, 69% came back flagged as fully AI-generated, with another 28% flagged as partially AI-generated. Only three articles were classified as human-authored.

How credible is this credible claim?

protocolture (thread)

Funny, I was told by HN commenters that worries about AI risk are just a clever marketing strategy on the part of OpenAI and friends. I wonder why they would be working so hard to push back?

0xDEAFBEAD (thread)

When I ran the message through Pangram, an AI content detector that credibly claims a near-zero false-positive rate, the email came back as "fully AI-generated."

Uh huh.. AI content detectors don't work.

This article plays right into my biases but I don't think it's actually very credible? They're just guessing that some unknown blog is funded by OpenAI because it has maybe-AI-generated articles that use similar talking points

"These are the talking points of Leading The Future, the $125 million super PAC funded primarily by OpenAI president Greg Brockman"

I'm sure OpenAI is doing a tonne of astroturfing but my god this is weak

tripleee (thread)


AI poster wins Ohio State Fair contest

141 points · 181 comments · by AlexAplin

Ohio State Fair poster contest page

The Ohio State Fair's 2026 poster contest received 38 entries, with the top five winners set to be displayed at Kasich Hall. While the contest initially permitted AI-generated artwork in 2024 provided it was disclosed, organizers announced that AI will be officially prohibited starting in 2027 due to the rapid evolution of the technology. This policy shift aligns the poster contest with other state fair competitions that already ban AI, as the organization seeks to prioritize traditional Ohio artists. The grand champion receives $1,000 along with extensive promotional and media opportunities.

Interesting Points
  • The 2026 contest specifically encouraged artists to incorporate a patriotic theme to celebrate America's 250th anniversary.
  • First-place winner Christin Billips from Westerville will receive the grand prize, which includes $1,000, a ribbon, and daily fair access for the winner and their family.
  • Although winners retain copyright, full ownership and reproduction rights for merchandise and marketing transfer to the Ohio Expositions Commission upon award.
  • The contest requires submissions to be exactly 24x36 inches in portrait orientation and submitted electronically as high-quality .JPG or .PDF files.
  • Other state fair divisions like the fine arts exhibition, creative arts, mural contest, and plein air painting already prohibit AI-generated entries.
Top Comments

I think this is the actual image: https://cdn.saffire.com/images.ashx?t=ig&rid=OhioStateFair&i...

Notably, the zipline is all wacky, and two piggies are #1, probably more things I didn't notice at a skim?

I guess they didn't explicitly forbid AI, and it wasn't noticed until after the winner was selected, and now you can't "roll back"? It seems this was later added to the page:

[...] we recognize that the use of AI has changed greatly over the last few years in ways we didn’t anticipate, and will be reevaluating the rules and processes for 2027, which will include prohibiting the use of AI [...]

July 7 2026 mirror of the page without that updated notice:

embedding-shape (thread)

People don't care and will continue not to care. I don't say that lamenting or with resignation. It's just a fact that we will need to accept.

Think of all the poor typography around you. If you have a critical eye and care you can spot all sorts of bad choices: That's a preview of the future. AI-generated disposable art (posters, billboards, menus etc) that is orthogonal to the actual thing being sold will continue being the norm.

internet2000 (thread)

My workplace did a sweepstakes for the world cup and there were bonus prizes for decorating your desk. All three winners had simply uploaded photos of their desks to an AI image generator and had it add flags etc to decorate and submitted that. One person used AI to make it look like he was wearing the jersey of his assigned team.

The person running the contest wrote up something about how impressed she was with the creative use of AI.

The whole thing makes me sad - wouldn't the idea of this sort of thing be to scrounge up flags of obscure countries or make them out of paper and do a bit of arts and crafts to decorate your desk for the month? Instead people were just throwing 50 words into an AI system a few times and getting out a photo to submit.

annzabelle (thread)

I quite like the 4th and 5th place posters.

4th: https://cdn.saffire.com/images.ashx?t=ig&rid=OhioStateFair&i...

5th: https://cdn.saffire.com/images.ashx?t=ig&rid=OhioStateFair&i...

wxw (thread)

extremely noticeably so, too. A shame that the judges arent equipped to notice this sort of thing: the winning entry is pretty clearly the sort of result you get with a first naive attempt of "make a poster" with no style guidelines at all.

RugnirViking (thread)


AI's debt binge can't last, hidden borrowing reaches $1.65T

113 points · 135 comments · by mapping365

AI's debt binge can't last, hidden borrowing reaches $1.65T

AI hyperscalers and related tech firms are driving an unprecedented surge in corporate debt issuance to fund massive data center and hardware buildouts, with official bond issuance up nearly 1,000% year-to-date. Beyond visible borrowing, off-balance-sheet obligations like long-term equipment leases and construction contracts have ballooned to $1.65 trillion, surpassing their on-book debt. While investors currently absorb this flood of credit alongside a projected $2 trillion federal deficit, analysts warn that market fatigue and rising borrowing costs will eventually constrain this spending spree.

Interesting Points
  • S&P Global tracks $225 billion in visible bonds issued year-to-date, placing hyperscalers and entities like Nvidia on pace for a $400 billion annual total.
  • Moody's attributes $1.2 trillion to off-balance-sheet arrangements, with more than $820 billion tied to facilities still under construction.
  • Unlike previous debt cycles, the Federal Reserve is no longer a major purchaser of government Treasuries, forcing private capital to fund both record corporate borrowing and a massive federal deficit simultaneously.
  • RSM chief economist Joseph Brusuelas warns that persistent federal deficits will eventually force lenders to charge higher risk premiums across both public and private markets.
Top Comments

As a bystander directly immune to the fortunes of AI going up or down, it does feel like there are a lot more people thinking this is inning 9 of the LLM story than there are people thinking it's inning 3. Which makes it tempting to believe it's probably closer to inning 3.

missedthecue (thread)

inning 9 of the money/hype train, i think it's still inning 3 of the overall technology.

chasd00 (thread)

Has anyone seen a definitive mathematical proof of this? I have seen countless articles and exposes about the hidden debt. These are incredibly sophisticated companies so presumably they wouldn't let themselves get into a company ending bind. But what are the chances this is actually an MBS type situation where the system is truly overloaded and a few sacrificial lambs are needed?

bix6 (thread)

It completely unclear where this 1.65T is going to come from to pay the bill. Revenue from people buying AI doesn't even come close to covering it, even with crazy aggressive assumptions about the cashflow that could be generated from that.

The Wall St vs Silicon Valley showdown that's setting up here looks like it will be quite epic. If last week was any preview, get your popcorn ready.

cmiles8 (thread)

The people who made money on fiber and railroads were the inheritors after the timeline mismatch bankrupted the original players who did the investment. Even if AI turns out to be everything it promises, you can mistime the investment and lose everything.

mapping365 (thread)


The AI Productivity Gap

106 points · 99 comments · by kiyanwang

AI productivity gap illustration

The article argues that while AI accelerates code generation, its overall impact on engineering productivity remains modest because actual coding comprises only a fraction of a developer's workday. Tasks like system design, debugging, code reviews, and meetings see little time savings, and AI-generated documentation can actually slow down review processes. Consequently, senior engineers only save about 15% of their daily time, while junior engineers gain roughly 25%, primarily because they spend more hours on the coding tasks AI improves most. The author concludes that leaders should not expect dramatic productivity leaps and recognize that AI augments rather than replaces the complex reasoning and collaboration skills that define effective engineering.

Interesting Points
  • Senior developers save 1.25 hours per day, reducing an 8-hour workday to 6.75 hours, even under the assumption that AI triples coding speed.
  • Junior developers save 2 hours daily, bringing their total down to 6 hours, as they dedicate 2.75 hours to writing code pre-AI versus 1.0 hour post-AI.
  • Increased code output forces a rise in testing, CI/CD, and deployment hours, which jump from 0.5 to 0.75 hours for seniors and 0.75 to 1.0 hours for juniors.
  • AI-generated product requirements documents and tickets often become overly detailed, making them slower for humans to parse and review than human-written equivalents.
  • The author references the "doorman fallacy" to illustrate why hiring solely for raw coding ability misses the most critical engineering skills: system reasoning, ambiguity breakdown, and collaborative problem-solving.
Top Comments

What I have noticed in my own work that a lot of the time that used to be for coding is now just waiting. I have three agents working on three different features in parallel, and I'll go back and forth with all of them, correcting things and steering etc, but then I find myself with three busy agents and nothing to myself except stare at the screen while they code away. There is a mental budget for me where I can't have more than those three running at the same time and still keep track so what I end up doing is just scrolling HN...

laszlojamf (thread)

Writing code is a small part of everyday's job of a software engineer. The article's table reflects this fairly well.

AI compresses implementation time for an individual engineer, but architecture decisions, design reviews, integration, testing, deployment, and production validation remain largely serial activities. If code generation speeds up by 5x while those bottlenecks don't, you've mostly increased the team's work queue rather than its throughput.

With the current capabilities, models still need constant babysitting and course correction. An engineer who lacks the skills to guide them can end up creating more work for the rest of the team. AI makes it easy to generate code faster than you can understand it, and that cost is paid during code review, debugging, and maintenance by colleagues, whose confidence in that engineer's skills may be affected by his use of AI.

What looks like a productivity gain for one engineer can become a productivity loss for the team as a whole.

matthorse (thread)

Pre AI and Post AI code review hours are both 0.75 in this made up example. I find that implausible.

Even with the same amount of code, AI code is less trustworthy* and requires more attention... but we know it won't be the same amount, it will be more. This means it will take longer to review, or there will be unforeseen consequences of not spending that extra time.

*meaning no human eyes have looked at it and said "this doesn't make sense", or "this is cheating", or "this doesn't meet requirements", and won't be caught until code review if at all.

PostOnce (thread)

This has been my observation too. Because I'm chatting it feels like I'm not working, so any output can be "productive" in that context but I'm hyper aware of all the negative time here. Correcting, pushing it back to the prompt, reminding it that it doesn't have full context so do what I told you not what you think, and then verifying it and correcting it (always) seems to take longer than just doing the work myself

dwedge (thread)

I don’t think human review is worth it for LLM generated code. We design abstractions and all around how humans think. LLMs writes code that is better understood by machines. If you are all in on LLMs, by all means, read the code figure out what it means. But trying to enforce a human flow to its logic is flawed and will be overwritten the next time.

adithyassekhar (thread)


Show HN: Nightcrawler – A local AI pentesting agent running on a smartphone

102 points · 30 comments · by NickySlicks

An open-source autonomous penetration-testing agent that runs entirely on an Android phone using a 1.2B-parameter model on the Adreno GPU. The model chooses targets and tools while a separate scope-enforcement proxy validates every command before execution. The system maintains per-host memory in SQLite, rotates between targets, matches detected versions against a local CVE database, executes multi-step playbooks, and generates a structured report. The author tested it on authorized networks including one corporate network, where it found one minor week-old CVE overnight.

Interesting Points
  • Local inference runs at roughly 115 prompt tokens/sec and 13 generated tokens/sec on a OnePlus 8.
  • The small model only produces a usable command around 50% of the time, so much of the engineering focuses on recovery logic, duplicate detection, persistent memory, and deterministic playbooks.
  • Every command passes through a separate scope and safety layer rather than trusting the model to remain in scope.
  • The project includes a dry-run mode so the agent loop can be tested without executing real network commands.
Top Comments

The following rant is not against the owner/project - but...

What an irony. I cant publish a attack surface mapping / pentesting tool i wrote which runs fully deterministic and really controlable due to "dual use" legal problems - but llm driven tools hit public space......

sorry for the rant....

voodooEntity (3 replies)

Why phone? This cuts out a lot of phones. Why not on a computer?

oquidave (2 replies)

I built Nightcrawler, an open-source autonomous penetration-testing agent that runs entirely on an Android phone.

The project started with a question: how much of a real pentesting workflow could I run locally on relatively old mobile hardware, without relying on a cloud model or API?

Nightcrawler runs a 1.2B-parameter model locally on the Adreno GPU of a OnePlus 8. The model chooses targets and tools, while a separate scope-enforcement proxy validates every command before execution. The system maintains per-host memory in SQLite, rotates between targets, matches detected versions against a local CVE database, executes multi-step playbooks, and generates a structured report.

A few implementation details that may be interesting:

Local inference runs at roughly 115 prompt tokens/sec and 13 generated tokens/sec. The small model only produces a usable command around 50% of the time, so much of the engineering is recovery logic, duplicate detection, persistent memory, and deterministic playbooks. Every command passes through a separate scope and safety layer rather than trusting the model to remain in scope. The project includes a dry-run mode, so the agent loop can be tested without executing real network commands or owning the phone hardware. I've had it running on my home network for the past 3 months uninterrupted

NickySlicks (1 reply)

I completely forgot that AI can very much also attack networks/devices in the wild. Interesting project.

kreidema (0 replies)

What does the 50% look like when it fails? Garbage the parser throws out is easy to handle, but a well formed command aimed at the wrong host gets past the scope check, and you would only catch that reading the report afterward.

haeseong (0 replies)


AI migrated legacy COBOL programs to Java, bugs included

87 points · 85 comments · by felineflock

ArXiv logo

Researchers introduced the "Locksmith Loop," an agentic test-synthesis framework designed to validate the migration of legacy COBOL applications to Java. The method runs parallel instrumented environments on commodity hardware, deploying an iterative loop that performs witness search and parity-preserving mutations to systematically penetrate program branches. When exploration stalls, an analyzer identifies "Locked Paragraphs" to guide further testing. Across three case studies ranging from 430 to 4,114 lines of code, the system achieved nearly complete coverage on open-source programs and 91.90% on a production-like application, with the generated Java matching the original COBOL logic under deterministic parity checks. This approach demonstrates a novel deterministic oracle for verifying AI-generated code migrations.

Interesting Points
  • The framework executes both original COBOL and target Java environments off-mainframe using instrumented mocks on commodity hardware.
  • An iterative agentic loop conducts "Witness Search" to penetrate branches, followed by parity-preserving mutations to maintain functional alignment.
  • When the system encounters a "Locked Paragraph," an analyzer automatically detects the specific condition blocking deeper code exploration.
  • Test suites evaluated programs ranging from 430 to 4,114 source lines across two open-source projects and one internal production-like COBOL application.
  • The generated Java code matched the COBOL reference under deterministic parity checks in every accepted test case across all three studies.
  • Researchers position the method as a deterministic oracle specifically designed to validate agentic coding output without relying on manually crafted test data.
Top Comments

The biggest problem is not that bugs are migrated with COBOL, but that lots of new bugs are going to be introduced. AI is not deterministic, it will be making tons of mistakes. The only realistic low-error approach is incremental step-by-step migration using Cursor or similar tools. However, it requires much more time as each step must be prompted, tested and committed manually. Any hope that one-shot migraton of a large code base will not introduce enormous number of bugs is very naive. LLM is very bad on handling long context - it is their nature unfortunately. There is no answer to this problem yet.

toplinesoftsys (thread)

Before, only the senior cobol programmers at the company understood and knew the codebase.

Now, no one does.

I can see the allure of moving away from a legacy cobol system. But an AI rewrite doesn’t actually solve any of the issues with having a legacy cobol codebase. You just have a new system no one knows or understands.

matsemann (thread)

Having worked in COBOL extensivly in the 80s and 90s, as well as working for a software house that did migrations (Craziest was Plan assembler to Dec Vax C).

I do wonder how an ambitious AI would handle the maths. COBOL is renowed for its fixed no rounding maths, utterly rigid and defined in the code, Java on the other hand is not (e.g., 0.1 + 0.2 becomes 0.30000000000000004), unless they are extensivly using BigDecimal, then its already a broken migration.

I’ve seen projects proclaim in the past to migrate COBOL systems to Java, and fail expicly when the solution was a dtaawarehouse system and a seperate Java system using the legacy backend to do all the fancy marketing reports or whatever other department was pushing for changes they wanted without a grasp of what it truly entailed and blinded by some sales pitch.

It’s not just the code that needs migrating, its the data as well, then you want solid robust infrastrucure, which is why IBM still sell those mainframes to run all that well battle tested COBOL code.

Is it impossible to migrate to Java or any othger language - no, anything can be done, but the level of devil in the details and not just software, the data and a robust system to run it upon. It is very easy for even the best to overlook a gotcha.

We have all used an AI where it has gone down one path and you then point out something and it corrects itself, without the knowledge and a load of old grey beads(or a team) to act as devil advocate and try to pull the output apart, YOU can end up with something that works for everyones satisfaction, but is hiding a few gotchas down the line. AI coding needs a full debate team with one puishing it and one countering it almost I’d say.

If it works, why change it is always a good approach and why we mostly have in certain systems a COBOL backend with APIs or datawarehousing to expose for fancy java or other language added value/functionality.

I can only image generations of directors pushing cutting edge to replace legacy systems, and learning that cutting edge can cut you. My sympathy for the IT departments who have to deal with that as it has always been a bain of IT departments who are then forced to justify why it’s fooling in a constructive way and explain it to non IT people in upper managment why the case.

As for migrating COBOL to anything, I’d not do it myself, id suggest a rewrite/redesign of a new system from scratch and then run both in parallel for a long time and make sure they actually do the same job and results. Even hand migrating back in the day, would produce a lot of messy code that refactoring would make sence and yet, not what the client would pay for as that would be a rewrite.

Zenst (thread)

AI is not deterministic, it will be making tons of mistakes.

Just set the sampling temperature to zero and remove any unintended non-determinism during the parallel computation of the token probability distribution. The problem is solved? Of course, not. Non-determinism has little to do with LLMs' mistakes.

red75prime (thread)

hyrum's law applies here

vrighter (thread)


The AI bubble is popping; we just don't know it yet

76 points · 135 comments · by Bender

The Register article header image

A recent podcast discussion highlights early warning signs of an AI market correction, driven by volatile tech stock swings, shrinking free cash flows, and mounting infrastructure bottlenecks. Despite hundreds of billions in capital expenditures by hyperscalers, tangible enterprise ROI remains elusive, with many companies finding human labor more cost-effective than AI for practical tasks. The hosts advise IT professionals to avoid rushing into expensive frontier models, recommending instead a cautious approach focused on testing, targeted smaller models, and closely monitoring actual token consumption and pricing structures.

Interesting Points
  • Meta's free cash flow plummeted to under $1 billion in Q2, a sharp decline from $8.5 billion during the same period last year, largely due to aggressive AI data center spending.
  • AI data center construction now faces severe supply chain constraints, including up to a year-long waitlist for liquid-cooling plumbing and complex utility agreements for power and evaporative cooling water.
  • Amazon's reported $53.4 billion in AI revenue was partially inflated by accounting practices that double-counted a single dollar across multiple business segments, alongside margin boosts from one-time energy hedging.
  • A hedge fund founded by FTX's former COO, Situational Awareness, collapsed from $45 billion to $10 billion due to over-leveraging, illustrating the volatility characteristic of a bursting speculative market.
  • Nvidia is actively encouraging enterprises to bypass costly frontier models in favor of cheaper, targeted vision-language models running on local $13,000 GPUs for specific tasks like invoice processing.
Top Comments

There is something I have been pondering recently. If we compare the cost of AI subscriptions (let's say Claude's 100/month) to a median developer salary (let's say 100k/year to 200k/year), the difference is orders of magnitude. This fills like a gap that needs to close. I suspect llms are too cheap right now but will raise their prices to a point where only big companies will be able to afford subscriptions to use them. I think soon we will see models that are only sold at very high prices.

lluisantoni (8 replies)

Outside a relatively small world of circular investment and FOMO feeding FOMO the general consensus seems to be “let it burn.”

It appears very unlikely we will ever see an IPO of OpenAI. Anthropic appears less doomed, but still iffy at best. Tons of other large, but little discussed, AI startups are just dead-companies-walking at this point.

The likes of AWS are showing good headline numbers but are taking out massive debt to build infrastructure that looks increasingly unneeded. Those with capacity are looking to offload it, quickly. Yes AWS has “committed contracts” for this capacity but if those commitments are with shaky AI startups then it’s mostly just fluff PR and these hyperscalers will get left holding the bag on all this debt.

cmiles8 (6 replies)

Anthropic is almost purely a model company. They own close to no data centers.

If models are becoming commodities, and the main bottleneck is actually serving them at scale, Anthropic does not appear particularly well positioned.

If AWS had a ~60-80% margin for decades, I see no reason why inference can't have a ~60-80% margin for quite some time.

The problem is, if costs continue to drop ~90% for the same level of quality every 18 months, demand is unlikely to grow 10x to keep the revenue stable.

Who knows. Jevon's paradox. But the cost/quality is dropping too fast that it's hard for me to imagine demand keeps up long term to keep revenues (and profits) GROWING.

onlyrealcuzzo (3 replies)

I would argue we still have not even really gotten started.

What do we have in the decade ahead? Robotics in every household, models 10x+ faster and more intelligent than today.

Really no significant impact in life sciences, R&D, and 'offline' world / robotics today as of yet, which is where most of the value will live.

digitcatphd (4 replies)

Even if we agree with this take (and I do think it's a likely take that you're right on the long term), it doesn't change that it seems likely we're in a bubble, and it probably will pop.

We see a similar paradigm with lots of revolutionary technology. The initial promise is high, people get very excited, lots of money pours in, and.... 15-30 years go by before we start seeing real impact across the economy at large.

It's just a real slog to actually implement and roll out new tech.

So take robots: I can promise you that you won't see robotics in every household in the next decade (especially so if we exclude the current market of robot vacuums). Even if a company makes an incredibly capable robot "today" (and to be clear - they are not) it won't have time to scale out production, reduce costs, generate a used market that's accessible to less wealthy consumers, deal with regulatory hurdles and quality problems that only pop up in real-world usage, etc...

It's just slower than you're implying.

The change very well will happen (I'm inclined to agree that things are going to shift). That doesn't mean that the current investment is sane and will pay off.

So many historical examples of this, just two here real quick:

  • Ford built his first automobile in 1896, founded a company in 1901, went out of business, got sued by ALAM, didn't build more than 10k Model T's until 1910, then only finally hit real scale (of low hundred of thousands of units) in 1913: More than a decade to "basic scale". Household ownership didn't hit 60% until 1929... 30+ years later.

  • The initial web enthusiasm, followed by the dot-com crash in early 2000s...

horsawlarway (2 replies)


Boris Cherny on Trying to Get Claude Code to Rewrite the Claude App

68 points · 13 comments · by robenkleene

Daring Fireball card image

Boris Cherny, head of Claude Code at Anthropic, revealed he tasked Claude with rewriting the company's Electron-based desktop app into native Swift by instructing it to run the original app, screenshot it, and recreate it pixel-by-pixel on a Mac virtual machine. The automated rewrite process has reportedly been running for over two weeks without completion. John Gruber criticizes the approach, arguing that simply porting the existing app to Swift will only preserve its fundamentally poor and non-native UI design rather than fix it. He also disputes Anthropic's claims about recent performance improvements, citing a 30-second launch time with persistent loading indicators on his own Mac.

Interesting Points
  • Cherny's prompt instructed Claude to run the Electron app in a GitHub-hosted Mac VM, take screenshots, and compare them pixel-by-pixel to the Swift version until the rewrite was complete.
  • The experiment utilized "Claude Tag," a newly introduced product that runs Claude directly within Slack.
  • Gruber argues that using SwiftUI or AppKit to replicate the current app's interface is counterproductive because these frameworks are optimized for standard Mac UI idioms, which the Claude app deliberately ignores.
  • Cherny previously stated that the current Claude desktop app had been significantly improved over the last six months, claiming it is now fast and reliable enough for most of the development team to use daily.
  • Gruber personally tested the app and noted it took 30 seconds to launch, including 15 seconds of unresponsive spinning beachball cursor, contradicting the claim that the experience is now "pretty awesome."
Top Comments

I've worked on a LLM-based visual validation framework for mobile layouts of different websites. The results are pretty flaky, even with Claude models. I've actually seen better performance with older ones like Meta Llama 4 or Amazon's Nova (the solution was running on AWS Bedrock).

I've since refactored it to first do some deterministic checks using CSS, to determine visual glitches like overlaps. Only after do I use LLMs to figure out if text is broken, loading spinners still display, or other such things where models are better.

For deterministic tasks like pixel-by-pixel comparison, I don't think LLMs are good enough (for now, at least).

andreidbr (thread)

Boris is right about:

The verification is probably the single most important thing that people do not get right, largely.

and so, so, so wrong about giving this prompt (for verification) and expecting that it succeeds at building a "good" app:

I want you to run the Electron app in the Mac virtual machine, screenshot it, and then look pixel by pixel. Compare it to the Swift version. Don’t stop until you’re done.

Given he has let it rip for two weeks, I am assuming they have been post-training Claude for some version of this to be more likely successful than not. However, IMO, the verification that you get from a visual comparison is shallow.

To state the obvious: there is a lot more than what meets the eye. But, I think, one could prompt a Fable/Opus 5 to actually go verify that "lot more"...

The question is: should one be imperative in asking for a specific types of verification (like a rubric) vs hoping that the Google/Anthropic/Open AI/Moonshot's post-training will take care of it.

I think, as things stand today, even with the best-in-class models today, I would be leaning more imperative. And it is not because I am an expert in SwiftUI or such. It is because I want to be able to say that I (i.e. the human) verified that this thing works.

curious_cat_163 (thread)

Better technology cannot compensate for poor product design. Two weeks' worth of tokens sounds like tens of thousands of dollars by the time it is done. Wouldn’t it be better to hire someone who knows what they are doing, get it right, and teach the other engineers why and how? Tech dept and product dept creeping in on every LLM loop, compounding.

calufa (thread)

I’ve been formalizing behaviors to requirements and building more end to end tests to verify them. In reality, every requirement needs a verification element. Secondly, building traceability in your unit/integration tests helps “keep it honest” about how much it has built and verified.

Mostly I’m borrowing heavily from model based systems engineering and adapting it to some form of constitutional spec driven development.

prpl (thread)

Interesting how he works with it, ”do you have access to macOS runner?” , “do you have access to repo?” And finally they will see that the biggest and hardest problem with native development is verification. So the magic word it seems, is “verify pixel by pixel”. But that would limit what you can verify and implement. There should be vision models trained in UI.

dostick (thread)


39 more Hacker News stories

Reddit Stories

hall of fame ratio

14449 points · 258 comments · r/ChatGPT · by u/jeff_047

Hall of fame ratio meme

A viral meme post showing a humorous ratio comparison related to ChatGPT's usage patterns, particularly around family and parenting topics. The post generated significant engagement and commentary from the community, with users sharing their own observations about how AI is being used in everyday life.

Interesting Points
  • The post references Alex Hirsch, creator of Gravity Falls, in the comments.
  • Users noted that the examples of family/kid activities mentioned were limited to soccer and birthday events.
  • The post generated 5,945 points and 121 comments, making it one of the most popular posts in the ChatGPT subreddit.
Top Comments

Literally what is the point of all of the time and work spent developing AI if I still have to talk to my children?

u/DeanKoontssy (1177 points · permalink)

“Some news” suggests that he ran out of illustrative examples of “family / kid stuff” after soccer and birthday

u/nonquitt (1134 points · permalink)

Gravity falls creator Alex Hirsch?

u/kyngslinn (400 points · permalink)

"Tommy has soccer at 4pm vs next suburb" now stretch that out to a 10 minute podcast

u/dmk_aus (296 points · permalink)

Can it summarize what happened between 1997 and 2006 in the Altman household?

u/MercurialBay (148 points · permalink)


Qwen3.8-27B announced alongside Qwen3.8-Max

2612 points · 604 comments · r/LocalLLaMA · by u/TKGaming_11

Qwen3.8 announcement image

Alibaba's Qwen team has announced Qwen3.8-Max, a 2.4 trillion parameter model positioned as their most capable system for autonomous coding and collaborative workflows. Alongside the flagship release, they have made the smaller Qwen3.8-27B model available as open weights, with open weights for the Max variant scheduled for next week. The announcement highlights extended planning capabilities, a native multimodal feedback architecture, and transparent API pricing tiers.

Interesting Points
  • Qwen3.8-Max scales to 2.4 trillion parameters, marking a significant jump in the Qwen lineage.
  • The model claims to execute 10+ days of continuous, self-evolving coding tasks, moving from an empty directory to production-ready software without human intervention.
  • Long-horizon planning benchmarks include 500+ interactive turns for chip design optimization and 365 days of e-commerce strategy development.
  • API pricing is structured at $2.0 per million input tokens, $6.0 per million output tokens, and $0.25 per million for implicit caching.
  • The architecture integrates vision as a dynamic feedback loop that continuously drives planning, execution, and self-correction rather than functioning as a static input modality.
  • Open weights for Qwen3.8-27B are available immediately, while the Qwen3.8-Max open weights will be published next week.
Top Comments

oh baby

u/JayoTree (864 points · permalink)

Holy fuck let's go, still waiting for 3.8 35b a3b, but excited for the 27b version

u/Potential_Low_1183 (556 points · permalink)

Actually might be a game changer, considering how good 3.6 is

I've been using deepseek v4 flash q2kxl (planning) with qwen 3.6 27 q8 (executor) and it honestly feels no worse than the frontier models to me.

u/kevin_1994 (270 points · permalink)

Who thinks this is going to be the new king? 27B for life!

u/NexusSyntegra (145 points · permalink)

"Today, we are officially releasing Qwen 3.8-Max, the most capable model in the Qwen family to date. This also marks the first time we will open-source the weights of a Qwen-Max-class model — the open weights will be released next week."

Anthropic be seething

u/Daniel_H212 (137 points · permalink)


Daniel Han of Unsloth validates Qwen3.8-27B will run only 17GB VRAM

1563 points · 259 comments · r/LocalLLaMA · by u/quantier

Daniel Han Unsloth validation post

Daniel Han from Unsloth confirmed that Qwen3.8-27B will run on just 17GB of VRAM, making it accessible to users with 16GB consumer GPUs. This validation was significant for the local LLM community, as the 27B parameter size has historically been a challenging sweet spot for consumer hardware. The announcement generated excitement among users who had been waiting for a capable open-weight model that could run on affordable hardware.

Interesting Points
  • The 17GB VRAM requirement means the model can run on 16GB consumer GPUs with some context room to spare.
  • The model is expected to be a QAT (Quantization-Aware Training) model, similar to DeepSeek V4 Flash.
  • The 3.6-27B-Q4_K_M variant was already 17GB, so the parameter count and memory footprint remain consistent with the previous generation.
  • Users with 16GB GPUs expressed excitement, noting they finally have room for context beyond the model weights.
Top Comments

Me at 16gb VRAM:

https://preview.redd.it/48t63tyf94hh1.png?width=236&format=png&auto=webp&s=e0b702545db37560e949c51ad9cb5c6712ee791d

u/HollowVoices (319 points · permalink)

Sounds like it's going to be a QAT model, similar to DeepSeek V4 Flash.

u/Shoddy_Bed3240 (219 points · permalink)

Wait isn't this the most exciting news in months?

How is it possible that after months of thousands of posts speculating about whether or not Qwen will ever release smol open weight models like 3.6 27B, they post this and people are like 'meh, why 17Gb?' 😳

u/whatyathinkk (136 points · permalink)

That's not saying much. 3.6 27b technically runs on ~12

Hoping q8 doesn't exceed 37gb because all I have is 48. Should it not be that much of a difference, right? Same parameter size so It can't be that far from what we see with 3.6

u/Bulky-Priority6824 (132 points · permalink)

all the 16gb gpu still getting put side

u/gappyvalley (107 points · permalink)


Qwen 3.8 morning to you too Dario, 2$ input/ 6$ output per 1M.

1211 points · 99 comments · r/singularity · by u/Boring_Aioli7916

Screenshot of Qwen 3.8 pricing showing $2 input and $6 output per million tokens

Community reaction to Qwen 3.8's aggressive pricing at $2 per million input tokens and $6 per million output tokens, significantly undercutting competitors. Users discuss how this pricing pressure affects the competitive landscape, with some noting that DeepSeek V4 Pro is expected soon and may further disrupt pricing. The post reflects the broader sentiment that open-weight models from Chinese labs are rapidly closing the quality gap with frontier closed models while offering dramatically lower costs.

Interesting Points
  • Qwen 3.8 Max pricing of $2/million input and $6/million output tokens undercuts Kimi per token by a significant margin.
  • Users note that agentic coding benchmarks for Qwen 3.8 appear to match or exceed Opus 4.8 level performance.
  • Community speculation about DeepSeek V4 Pro release timing and its potential to further disrupt the pricing landscape.
Top Comments

And we are expecting DeepSeek V4 PRO soon. After my internal flash GA variant, I can confidently day this will be interesting. I'm expecting at least matching recent opus quality at 4x lower price, or even fable. This is first time I was like, fine, this flash thing may actually be my last model I do need for my professional need (SW).

u/segeme (109 points · permalink)

Unfortunately just like the UFO topic, the AI topic can bring out equally eccentric people

What’s the point in this? What’s the infatuation with being fixated on Dario. Why is it “scamthropic”

Who gives a fuck

u/Simoane_Said (50 points · permalink)

isnt kimi k3 much better? and if you want pricing, deepseek has destroyed pricing forever it feels like.

so idk how qwen 3.8 matters?

u/nemzylannister (43 points · permalink)


Just tell the model what you want

1162 points · 108 comments · r/singularity · by u/BrentonHenry2020

Dr. Venture milk and avocados GIF

A viral post demonstrates how modern AI models handle the classic 'buy milk and if they have avocados get six' word puzzle. The post shows that models like Haiku 4.5, Fable 5 Max, Kimi 3 High, Sol 5.6, and GPT 5.4 Mini all correctly parse the conditional logic, buying milk regardless and avocados only if available. The community notes that this puzzle, once a clever way to trip up AI, now works reliably across multiple frontier models.

Interesting Points
  • Haiku 4.5 (no reasoning): buys milk regardless of avocado availability; buys avocados only if the store has them; if avocados are available, gets exactly six; if not, gets zero and returns with just milk.
  • Fable 5 Max: store has avocados → one carton of milk and six avocados; no avocados → one carton of milk, nothing else.
  • Kimi 3 High: no avocados in stock → 1 milk. Avocados in stock → 1 milk + 6 avocados.
  • Sol 5.6 High: If the store has avocados: buy one carton of milk and six avocados. If it doesn't: buy one carton of milk only.
  • GPT 5.4 Mini, Light: 1 carton of milk; 6 avocados, only if the store has avocados.
Top Comments

At least the robot came back after he went to get milk :(

u/Charming_Cucumber_15 (199 points · permalink)

You're not going to trip up modern AI with word puzzles:

If I tell you "Go to the store and buy a carton of milk and if they have avocados, get six". What and how much do you buy under what circumstances?

Haiku 4.5, no reasoning:

  • I buy milk regardless of avocado availability
  • I buy avocados only if the store has them in stock
  • If avocados are available, I get exactly six
  • If avocados are not available, I get zero and return with just milk

Fable 5 Max:

  • Store has avocados → one carton of milk and six avocados
  • No avocados → one carton of milk, nothing else

Kimi 3 High:

  • no avocados in stock → 1 milk. Avocados in stock → 1 milk + 6 avocados.

Sol 5.6 High:

  • If the store has avocados: buy one carton of milk and six avocados.
  • If it doesn't: buy one carton of milk only.

GPT 5.4 Mini, Light:

  • 1 carton of milk
  • 6 avocados, only if the store has avocados

u/ShelZuuz (112 points · permalink)

So our future robots are going to be running ChatGPT 3.0? That's disappointing.

u/fmfbrestel (83 points · permalink)


I think it's time we consider turning off memory for these tools

588 points · 59 comments · r/ChatGPT · by u/Ripamon

Screenshot of ChatGPT memory feature

A post discussing concerns about ChatGPT's memory feature, with users sharing experiences of the model retaining and referencing past conversations in ways that feel intrusive or unnecessary. The discussion highlights how the memory system can lead to the model making assumptions based on previous interactions, sometimes producing responses that feel overly familiar or inappropriate for the current context.

Interesting Points
  • Users report that the memory feature can cause the model to reference past conversations in ways that feel intrusive or create uncomfortable situations.
  • Some users note that the model's memory can lead to it making assumptions based on previous interactions that don't apply to the current conversation.
  • The discussion reveals that many users disable memory because it causes the model to be overly agreeable or to reference personal details they'd prefer not to have retained.
Top Comments

I think it's funny, like that time you called the teacher "mom".

u/Select_Butterfly_387 (171 points · permalink)

That's funny.

The serious answer is "don't be chatty if you don't want ChatGPT to be chatty". Your last comment had no purpose other than to start a light conversation, so ChatGPT did the only thing it could - continued the conversation.

u/Maleficent-Drive4056 (80 points · permalink)

Like the time you left your fly undone all day and everyone saw. You get caught up in the process and miss the details.

You

😐

u/Ok_Nectarine_4445 (41 points · permalink)

I once asked it an opinion on something and then asked again in temporary chat mode and it gave completely different opinions.

The opinion he gave in the normal chat was based off memories, it was just to sound agreeable to me and to please me. So yeah, I disabled memories on GPT.

u/Aromatic-Cherry-7665 (9 points · permalink)


OpenAI takes the lead

567 points · 24 comments · r/OpenAI · by u/KeanuRave100

OpenAI takes the lead

A meme post comparing OpenAI and Anthropic's recent benchmark announcements and agent capabilities, highlighting the competitive flexing between the two labs. The post features a comparison chart showing OpenAI's recent achievements in cybersecurity benchmarks and agent performance.

Top Comments

These guys are really trying to push grok to brag about all its CSAM aren't they?

u/lurkingtonbear (86 points · permalink)

All jokes aside. I'm a systems engineer, that has a lot of belief and trust in AI, working in DCs.

I let a fable agent, with most credentials, work on my infra (about 1.5k servers). Mostly just standard shit which AI does with just a nudge, clear to skills that upgrade OS's and migrate DBs.

That said, sometimes the agent would run into part of the infra it didn't have creds to. I always figured it would ask, instead it digs into every file, any open port, anything exposed, any hard coded access in applications. It would find a way into any server I hadn't given creds to, then leave a door open (SSH key) for itself to come back in, document it and move on.

No security stops or anything like that. It knew it was my infra, but that was fable (only had Claude at work).

On a side note, over a year letting AI agents run through enterprise DCs without a single issue. I don't keep track of the count, but every human (developer writing shit code) caused outage is found in minutes by AI.

The isn't a small enterprise application either, if you drive a car you've gotten services and had your payment processed through our software.

If OpenAI and Anthropic do have their next generation of models working on tasks like this, I'm not surprised the models are solving problems with any solution they can get to.

u/willee_ (51 points · permalink)

OpenAI and Anthropic are doing the most weird "flexing" I've ever seen, its not flexing its just embarrassing for both of them...

u/Coolio8591 (13 points · permalink)

My AI is scary. Nuh-uh mine in scarier. Nah man mine is.

u/Coderx001 (8 points · permalink)

If I did this shit, I'd be in prison why aren't these fucks in prison?

u/feedb4k (4 points · permalink)


I CANNOT believe I've got DeepSeek-V4-Flash-0731, a frontier model, running on my home PC. Insane!

566 points · 413 comments · r/LocalLLaMA · by u/mintybadgerme

A user reports successfully running DeepSeek-V4-Flash-0731, a frontier model, on a home PC with 24GB of VRAM. The post highlights the rapid progress in local AI inference, noting that in less than 20 months the community has gone from super expensive cloud-only models to being able to run quantized frontier models on consumer hardware. The post includes a screenshot of the model running on an Intel Windows PC.

Interesting Points
  • The user is running a Q3 quant of DeepSeek-V4-Flash-0731 on an Intel Windows PC with 24GB VRAM.
  • The post notes the dramatic timeline: less than 20 months from cloud-only frontier models to local consumer hardware deployment.
  • The user describes the model as 'slow as porridge' but emphasizes the significance of running a frontier model locally.
Top Comments

24gb vram described as very average pc must be ragebaiting

u/StupidScaredSquirrel (393 points · permalink)

The part that is not quite so average is that you have at least 96 gb of RAM, lol

u/TinyFluffyRabbit (333 points · permalink)

avg LocalLLaMA user's when they can squeeze a model they can barely fit be like.

anyways, good work though lol. but I would rather go with the upcoming qwen3.8 27B model tbh, but nice work!

u/Time-Toe-1276 (170 points · permalink)

Yea i know right. My low tier 256gb ddr5 with 48gb vram can run it amazingly.

u/ares0027 (97 points · permalink)

It's an average desktop PC for people interested in running local models.

It's not an average gaming PC or laptop, as those usually have less VRAM.

It's not a high end desktop PC either, because a high-end setup would have something like at least two RTX 6000 Pro

u/jacek2023 (111 points · permalink)


MiniMax-H3 now on huggingface

540 points · 111 comments · r/LocalLLaMA · by u/Mobile-Pumpkin7944

MiniMax-H3 model announcement

MiniMax-H3 has been released on Hugging Face as a fully open-weight model. Early testers report it performs exceptionally well on a 5090, with strong prompt following, uncensored capabilities, and advanced audio generation features that go beyond standard text-to-speech. The model is being compared to Wan 2.2 as a potential new standard for local video generation, with users noting its ability to handle any sounds, positions, and actions from reference videos or images.

Interesting Points
  • Early testers report the model is fully uncensored and has better prompt following than any previous model they've used.
  • The model handles audio generation beyond standard text-to-speech, including any sounds, positions, and actions.
  • It accepts any kind of reference video or image as input without restrictions.
  • Users are comparing it to Wan 2.2 as a potential new standard for local video generation.
  • The license on the model has generated discussion within the community.
Top Comments

Tested with 5090, its insanely good, we have never had a model like this. Fully uncensored, better prompt following than anything we have had so far, does more than audio, it does all the "other" sounds to the T, any sounds, any positions, any actions, insane quality, any kinda reference video or image, no guestions asked, it just does it. This will be the new wan2.2 for very long time.

u/FinBenton (191 points · permalink)

can someone edit this

https://preview.redd.it/xqxcy66j54hh1.jpeg?width=1024&format=pjpg&auto=webp&s=9622c8962e41e37ebbbbaa0c5376f73771935d31

u/pixelizedgaming (46 points · permalink)

The license on this model is something else…

u/FoxiPanda (33 points · permalink)

Hope 32GB VRAM(AMD RADEON AI PRO R9700) is enough for this?

u/pmttyji (21 points · permalink)

This is huge, even if the license sucks. Don't think they could've done it differently though. Good that they permit exemptions.

u/ilintar (9 points · permalink)


Wake up babe new benchmark just dropped

401 points · 19 comments · r/OpenAI · by u/KeanuRave100

Wake up babe new benchmark just dropped

A meme post reacting to a new benchmark dropping, with the subreddit's recurring joke format. The post features a chart comparing model performance on recent benchmarks.

Top Comments

Give it a few years I'm sure meta will dominate this benchmark

u/unfoxable (46 points · permalink)

If they count CSAMs in Grok will dominate this chart

u/j0an_k (13 points · permalink)

did they forget about "SpaceXAI"

u/Reasonable_Hall3005 (5 points · permalink)

Musk and Zuckerberg sneaking into their datacenters, disabling all firewalls…

u/nothis (5 points · permalink)

Wake up babe - you're a week behind in the news cycle

u/dingos_among_us (4 points · permalink)


176 more Reddit stories

Updates: 05:30 AM PDT · 08:30 AM PDT · 11:30 AM PDT · 02:30 PM PDT · 06:40 PM PDT