Impossible to hide secret ...: Uncovering Security and Privacy Issues in LLM-native IDEs
- Source
- arxiv.org
- Author
- Mostafijur Rahman Akhond, Md Afif Al Mamun, Gias Uddin, Song Wang
- Date

Context
Security concerns about AI coding environments extend to the software surrounding the model: what information it can access and which actions it can take unchecked. Researchers screened 1.1 million Reddit posts, identifying 446 posts and more than 6,000 associated comments about security and privacy problems. Their analysis attributed most reported issues to system design choices and found developers describing safeguards such as isolated execution and manual review. These are accounts of user experiences, rather than independently verified incidents or a measure of how often products fail. They identify access and action controls as concrete subjects for security . Study abstract.
- The evidence comes from what developers actually hit, not lab experiments: 1.1M posts across 29 subreddits, narrowed to 446 posts about security and privacy in AI-first IDEs, with 6,000+ comments coded into a taxonomy.
- The headline finding is that most reported problems trace to system-level design choices in the IDE itself, like what user data it can reach and which actions it takes unchecked, rather than to the underlying model. Swapping models will not fix them.
- Developers defend themselves with external measures rather than the tool's own controls: the code and manually reviewing what the does. That workaround pattern is itself the study's measure of how little they trust these IDEs.
- eval — A repeatable test for AI quality — a set of tasks plus scoring — used the way software teams use test suites, because model output is too variable to judge by eyeballing.
- LLM — A large language model — the neural network behind tools like Claude and ChatGPT, trained on huge amounts of text to predict what comes next.
- sandbox — An isolated environment where AI-generated code or agent actions run without being able to touch anything real.
- AI agent — An AI system that doesn't just answer once but works toward a goal in a loop — taking actions, reading the results, and deciding what to do next.
“Our results show that most issues in LIDEs stem from system-level design choices, rather than the underlying LLMs, such as user data access, unchecked autonomous actions, etc.”
“To overcome these issues, developers frequently relied on external safeguards like code sandboxing and manual reviewing, highlighting prevalent mistrust among developers about LIDEs.”
“We collected 1.1M posts from 29 popular subreddits related to LIDEs.”
Checking sign-in…
Loading comments…
