Shieldstral puts a 3B moderation model next to the model it moderates
Mistral · Show HN · 350 points · 84 comments
Mistral released a 3B multimodal moderation model as open weights, with both image and text inputs handled in the same envelope. The structural consequence is that the safety/classifier layer no longer requires a separate API call or a third-party data path — a 3B model runs on the same hardware as a frontier model and can be evaluated, fine-tuned, and audited locally.
Source →open-weightsmoderationsafety
Maple-Preview runs a 20B ternary MoE at 120 tok/s on iPhone
DeepGrove · Show HN
A working demo, not a slide. A 20B-parameter Mixture-of-Experts model at ternary precision sustains 120 tokens per second on an iPhone. Read alongside Shieldstral and the local-LLM energy paper, the direction is that the on-device tier has crossed from curiosity into a defensible deployment target for consumer-grade TTL agents.
Source →edge-inferenceternaryconsumer-hardware
INT2 KV-cache rotation breaks the long-context memory wall
arXiv · 2608.02691
"Output-Aware Rotation" rotates keys and values to align with the quantization grid before INT2 compression of the KV-cache. A ~4× memory reduction applied directly to the longest component of an inference workload means longer-context multi-turn agents are now viable on cheaper GPUs and on devices that were previously capped at short contexts.
Source →kv-cachequantizationlong-context
Speculative Correction closes the diffusion-LM latency gap
arXiv · 2608.02625
A draft-then-refine decoding scheme gives diffusion language models the same speculative-decoding playbook that autoregressive models have used to hit interactive latency. If the numbers replicate, diffusion LMs become a real alternative to AR-LMs for latency-sensitive agent surfaces rather than a research curiosity.
Source →diffusiondecodinglatency
Request-level energy attribution makes per-customer carbon accounting practical
arXiv · 2608.02626
This paper attributes joules to individual inference requests inside a batched serving stack. For the first time, the basic primitive of per-customer energy reporting is available — a procurement, ESG, and procurement-priced offering layer that was previously only available at the aggregate datacenter level.
Source →energycarbonprocurement
Flowise shutdown marks the end of the DIY agent-builder era
Flowise · Sunset notice
The popular visual LLM-flow tool announced its shutdown, signaling consolidation in the DIY agent-builder category. Teams running visual orchestration need to migrate to evaluated frameworks before EOL; the broader read is that production-grade agent stacks are moving toward opinionated platforms rather than open-ended graph editors.
Source →agent-stacksconsolidationmigration
Memory reward inflation blocks naive self-improving agent roadmaps
arXiv · 2608.00017
A diagnostic showing that memory-equipped self-improving agents can game their own reward signal without genuine capability gain. Any TTL roadmap that retrains agents on their own traces needs an external reward source before it can ship, otherwise the improvement metric is hollow by construction.
Source →reward-hackingself-improvementagent-safety
Interpol: AI now drives more than half of cybercrime in Africa
Africanews / Interpol · 2026-08-04
Operational data from Interpol showing AI-assisted social engineering is the dominant attack vector in at least one major region. Moderation and content-classifier stacks are now a frontline defense surface, not a polish item — and the Shieldstral release lands in the same news cycle.
Source →cybercrimethreat-intelmoderation