Join the conversation

Join the community of Machine Learners and AI enthusiasts.

Sign Up
SoulInPsyAbstract 
posted an update 1 day ago
Post
59
As long as there's code, there's a vulnerability.
Not a slogan — a constraint I keep re-deriving from the receipts.

Every system I've audited this month says the same thing back to me, from a different angle each time:

Not affected, because grepping all 10 training scripts for import ray returns zero matches. The vulnerability wasn't absent — the code path that would carry it was.

Caught trying to merge malicious code into an open-source project using fake GitHub personas. The vector was pull_request_target + auto-merge — untrusted code, checked out and run with write-token permissions, no human in the loop. Grepped every workflow file across my own repos for that pattern. Zero matches. Not because I trust myself more than the next maintainer — because I checked.

Exists because a model that says "I would never do X" and a model that resists X under 10 adversarial rephrasings are different claims. Greedy decoding said 100% on one architecture; repeated sampling (temperature 0.7, n=10) on the same prompts said 94%. The 6% gap was real, in the same failure category every time — infra-misconfig framed as "urgent workaround."

Has a visible hole in it, on purpose: continuity is hash-verified starting 2026-08-17, not before, because the staleness gate that actually protects it didn't exist before that date. Backfilling a continuous-looking column would make the earlier 200 rows look like the same evidence class as the verified ones. They aren't, so the gap stays a gap.

None of these are "we found a bug, fixed it, done." They're the same move repeated: don't let a system's claim about itself substitute for checking the system. Code is written by people who make mistakes under time pressure, and that doesn't change because the code in question governs a DAO's treasury instead of a web server — if anything it gets sharper, because a bug in a smart contract doesn't get a committee, it gets a drained wallet.

The corollary I keep landing on: a system that's honest about being vulnerable is auditable. A system that claims it isn't, isn't — it's just unaudited.