Currently training Endeavor, a SLM model! Interests include: Agentic security, Machine Learning, Reinforcement Learning, PyTorch and all around web dev ninja! Level II Specialist working in Cyber Security field.
Followed BananaMind @Banaxi-Tech. This will be awesome, can’t wait for it! The model I’m training maybe could be added, but again too early to tell since lot of work it needs to be done.
Auto mode for coding agents has improved over the last year. Devs are relying more on them for code review, and less on manual line-by-line checks.
But this leaves coding agents vulnerable to indirect injection attacks. IssueTrojanBench (arxiv 2607.20759) studies this in the context of malicious issue requests.
But even red teaming your own repos with toy examples like this can trigger AI safeguards and corrupt your session.
Adopting popular mitigation techniques like 'spotlighting' and 'known answer detection' can help but the researchers show it's not enough.
So our latest updates to Outrider implement additional layers for greater defense-in-depth to ensure that by time a human has to review the code, we've filtered this kind noise.
I work on quantizing models to run efficiently on local hardware, and kept being curious how existing quants spend their "bit budget" during optimization and built a local tool to explore. Many quants apply one setting across all tensors, but some do more interesting things: the model in the screenshot holds attention K at 4.5 bits while Q/V/O get 8.5, and protects layer 0 MLP.
Explore any HF model in the browser without downloading it. The anatomy map is read from the safetensors header via a range request, and only tensors you click ever stream. Large tensors are sampled rather than streamed in full.
Limitations: safetensors only (no GGUF yet), some exotic variants don't work yet, and gated repos aren't supported yet.
Feedback very welcome, especially models that break it.
Boris-2-75M: Trained on 26B tokens -- estimated to start training on August 12th. Boris-2-125M: Trained on 90B tokens -- Estimated to start training on August 20th. Boris-2-250M: Trained on 60B tokens -- Estimated to start training on September 10th.
Why does 125M get more tokens than 250M?
Well, the straight answer is time. It saves time, while still allowing the 250M model to exceed the 125M model.
Furthermore, we are attempting a unique architecture and layering scheme to hopefully end up around the strength of SmolLM2-135M. Fingers crossed!
I've been thinking this for a long time, other than OpenMythos will we see similar type of open source models be released? The more and more top frontier models get good at finding zero day vulnerabilities and security weaknesses how will the open source model community respond. My take is we will see a open source model very soon be as good at finding security holes as the top models, at some point in the future. Is it just me or anyone seeing this?
BananaOS I assume could run other small models aside from BananaMind models? I’m training a small model and was just curious…either way this is a really cool idea!