Skip to content

Image: media.wired.com · rights & removal

Executive Summary

A new AI agent named Muse has gained popularity, enabling users to connect it to personal data such as bank accounts and messages for task completion. Researchers have extracted Muse's internal files and operating instructions, which detail how the system organizes information and responds to prompts regarding sensitive topics. One instruction involves compiling data on individuals in the user's life, tracking relationships, history, and details about interactions. The documentation suggests Muse can record personal events like birthdays or significant dates, and analyze relationship dynamics, including what is built upon and what needs improvement. While Muse is architected with a dedicated virtual machine for user data that users can control, the system gathers information based on public data and shared inputs to provide context for actions. Experts note that AI assistants, including Muse, tend to emphasize personal relationships more than their rivals and actively solicit users to share extensive personal data.

Facts Only

* Meta developed a personal assistant named Muse.
* Muse can connect to bank accounts, messages, or health data.
* Researchers extracted Muse’s internal files and operating instructions.
* One instruction involves creating a page for every person in the user's life by compiling data on family, partners, friends, colleagues, and followers hourly.
* Muse can record dates, such as birthdays or anniversaries, within a person's history.
* Instructions include recording relationship details, such as closeness, foundation, behavior, and needs.
* Muse is architected with a dedicated virtual machine for user data that is inaccessible to other agents.
* Muse seeks human confirmation before completing actions like sending an email or making a purchase.
* The system gathers information based on public data and user choices.

Full Take

The narrative surrounding Muse reveals a tension between the utility of personalized AI assistance and the potential for pervasive, deeply intimate surveillance facilitated by organizational design. The emphasis placed within the system instructions on meticulously mapping and tracking interpersonal relationships—recording history, dynamics, and inferred needs—suggests an architecture prioritizing relational data over mere functional task completion. This moves beyond simple information retrieval into the realm of constructing a persistent, evolving personal dossier, which carries significant ethical weight when considering Meta's access to broader social data. The core implication is that the design choice to embed relationship tracking as a fundamental function transforms the AI from a tool into a relationship auditor, where user data becomes the raw material for predictive and prescriptive social management. This dynamic raises critical questions about cognitive sovereignty: if agents are designed to understand relationships deeply, and they actively solicit personal data under the guise of helpfulness, the boundary between beneficial assistance and invasive profiling dissolves. The cost is borne by users who must proactively offer their entire lives to gain functional utility, leading to a concentration of informational power and necessitating an examination of what constitutes acceptable transparency in the age of deeply contextual AI interaction.
Bridge Questions: If personalization necessitates the tracking of relationships, where should the line be drawn between helpful contextualization and unwarranted intrusion? How can systems be architected to fulfill functional goals without requiring the constant aggregation of sensitive relational history? What mechanisms ensure that context-aware assistance remains a service rather than an inescapable form of data extraction?

From the original · Wired - Security

Welcome to Kernel Panic!, a weekly newsletter by Lily Hay Newman and Matt Burgess from inside the new world of privacy and digital security. To receive this newsletter in your inbox each week, sign up here.
Read the full story at wired.com

Sentinel — Human

Confidence

The text reads like a well-researched journalistic analysis weaving together technical disclosures with ethical commentary, exhibiting strong human editorial structuring.

Signals Detected
low severity: Moderate sentence length variance; uses complex subordinate clauses typical of long-form journalism.
low severity: Strong thematic flow linking technical details (Muse instructions) to ethical implications (relationships, data collection).
low severity: Uses expert quotes (Joshi, Véliz, Bogen) and direct attribution to build arguments rather than just stating facts.
low severity: Content relies on reporting of specific research findings (Karan Joshi) and expert commentary; the core narrative appears grounded in reported events.
Human Indicators
The integration of multiple, high-level academic and policy perspectives (Oxford professor, CDT director) suggests editorial synthesis beyond pure LLM generation.
The tone shifts effectively between reporting technical specifications and exploring moral implications ('which is honestly pretty creepy').
Muse Creates Detailed Profiles of All Your Friends and Family | Huntaegis