Tag: safety
All the articles with the tag "safety".
Computer-Use Agents: Screens as Observations, the Mouse as a Tool
Updated:A computer-use agent operates software the way a person does: it looks at the screen, decides, and clicks or types. The perceive-think-act loop; screenshots versus accessibility trees, measured on real pages (a screenshot is 1,000 to 4,800 tokens; a raw accessibility tree 4,000 to 170,000, pruned 600 to 20,000); coordinate grounding; the action space; what a task costs as screenshots pile up; OSWorld and how far agents have come; and why safety, not reasoning, decides where these agents can be deployed.
Guardrails and Prompt Injection: Why Filters Reduce Risk and Only Architecture Bounds It
Updated:A language model reads instructions and data through the same channel, so text in a retrieved page can act as a command. Input and output guardrails and classifier filters; direct versus indirect injection; why there is no escaping, as there is for SQL; and an injection attack measured against a small tool-using assistant that summarizes this blog, before and after four defenses, from a system-prompt rule and spotlighting to an input classifier and removing the tool.
Watermarking LLM Text: A Signal Hidden in the Sampling
Updated:Sampling leaves slack: many tokens would do at most steps. A keyed bias toward a pseudo-random green list spends that slack on a signature anyone with the key can test for, with no access to the model. The green-list scheme and its z-test derived and worked, how many tokens detection needs, the scheme run on a real 1.5B model at four bias strengths with its cost in likelihood, why low-entropy text resists it, what substitution and paraphrase do to it, distortion-free schemes (Aaronson's Gumbel trick, SynthID-Text's tournament), and why post-hoc AI-text detectors are a different and weaker thing.