SikiT

Field notes on running AI agents without a human in the loop.

Field notes on unattended AI agents.

10–15 minutes

Private AI can protect your input without making every outcome private

See what encrypted inference protects, which privacy layers remain separate, and how to assess a private-AI claim without overstating it.

An abstract encrypted core sends branching signals through separated translucent layers.

Sources are linked in this article. Found an error? Report a correction.

Homomorphic encryption can let an AI service compute without seeing the underlying input, and that is a substantial privacy gain. It does not automatically decide who holds the key, what metadata exists, who receives the decrypted output, how long records remain, or who may act on the result. The useful question is therefore not whether the system is private in general, but which relation its evidence makes private.

On this page

Question: What does encrypted inference actually make private?

Imagine a health-screening app that sends encrypted symptoms to a remote model. The server computes a risk category while the data remains encrypted, then sends back an encrypted result. The server never sees the symptoms or the risk category in readable form. This is a hypothetical service, not a description of a released product, but its central mechanism is no longer merely hypothetical.

Google’s August 14, 2026 account of HEIR and homomorphic encryption describes servers processing ciphertext and returning encrypted results without exposing the underlying information. HEIR is an open-source compiler toolchain that can convert pretrained models to operate on encrypted inputs. The accompanying HEIR paper describes the compiler architecture and the optimization problem it addresses.

That guarantee changes a familiar cloud tradeoff. A user can ask a remote system to perform useful computation without handing the computing server a plaintext input. In one demonstration, Google describes private content recommendations based on features the cloud service cannot see. Other demos cover image processing, network-packet analysis, and hotword detection. The post also reports nontrivial overhead and identifies its latency figures as single-threaded CPU measurements.

The current maturity boundary matters. HEIR’s getting-started documentation says its nightly binary is intended for testing compiler passes, not production use. The repository states that HEIR is not an officially supported Google product. A compiler demonstration is not a privacy policy, a production audit, or a promise about an unnamed service.

The cryptographic claim deserves its full weight. When the server cannot inspect plaintext during computation, a major observer has been removed from a sensitive information flow. That is a limited achievement in scope, but not a small one. The harder issue begins when a bounded technical guarantee is summarized by the much broader phrase private AI.

Argument: Privacy has seven separate relations

Privacy is often discussed as if it were one setting for an entire interaction. The cited materials support a more careful reading. Google’s own Parfait research overview presents private AI through several safeguards, including transparency, data minimization, anonymization, and external verifiability. Each system may need a different combination, and no one mechanism silently answers every adjacent question.

The NIST Privacy Framework makes a related distinction. Privacy risk can arise from data processing and its effects on individuals, including authorized processing. Cybersecurity controls against unauthorized access therefore do not exhaust privacy risk. Homomorphic encryption is more specific than a general security control, but the logical boundary remains: evidence that excludes one observer during one stage cannot, by itself, determine every later use.

Seven layers make that boundary visible.

LayerThe question to askWhat encrypted computation can establishWhat still needs separate evidence
InputWhich plaintext input is hidden, from which party, and during what stage?The computing server can operate without seeing the protected plaintext covered by the scheme.What happens before encryption and after decryption, including local collection and display.
ModelIs the model itself visible to the client, the server, both, or neither?A design may keep computation remote instead of shipping a proprietary model to a device.Whether model parameters, prompts, tools, or intermediate logic are confidential in the exact deployment.
MetadataWhat can be inferred from timing, size, network, billing, account, or service-use records?The content processed by the cryptographic operation can remain encrypted.Which surrounding records exist, how identifying they are, and whether other protections cover them.
OutputWho holds the decryption key, who sees the result, and what can the result reveal?The server can return an encrypted result without reading its underlying content.The recipient of the plaintext result and any inference that recipient can draw.
RetentionWhich ciphertext, plaintext, keys, logs, or derived records remain, and for how long?Encryption can protect specified material while it is stored or processed under the scheme.Deletion schedules, backups, logs, key retention, and future reprocessing.
PurposeWhich uses are permitted, expected, or contestable?The computation can be limited technically to a defined function.Whether the function and later uses fit the context in which the data was provided.
Decision rightsWho may act on the result, and how can the affected person challenge the action?The protected computation can produce a result without exposing its input to the server.Whether a clinician, employer, insurer, platform, or public body may use that result fairly and with recourse.

This is an editorial reading aid, not an exhaustive legal taxonomy. The layers can overlap, and a good architecture may protect several at once. They remain separate because each asks about a different relation: data to observer, model to operator, event to metadata, result to recipient, record to time, information to purpose, and output to power.

Model secrecy shows why the distinctions should not be collapsed in either direction. Google’s post explains that running a model on a local device can expose a provider’s proprietary model, while remote encrypted inference can keep the model on the server and the user’s features hidden from that server. This arrangement can protect the user and the provider at different boundaries. It does not follow that every model detail is secret from every operator, or that the client learns nothing about the model from its outputs. Those are separate design questions, not defects that can be read from the HEIR demonstration.

Helen Nissenbaum’s account of contextual integrity explains why secrecy from everyone is not the only standard. Privacy can depend on whether information flows appropriately among particular actors, with particular attributes and transmission rules, inside a social context. A clinician may appropriately receive a result that an advertising network should not receive. The information is not private because nobody sees it. It can remain private because the right person receives it under the right conditions.

That distinction also keeps a visible output from being mistaken for an automatic privacy violation. What matters is who receives it, for what purpose, under which expectation, and with what power over the person described. The seven layers do not demand universal secrecy. They force the broad adjective private to name its subject.

Examples: The same guarantee can lead to different outcomes

Consider the hypothetical screening app again, holding the encrypted computation constant while changing only what happens around it.

In the first deployment, the user’s device generates and keeps the secret key. The server receives ciphertext, computes the risk category, and returns ciphertext. The device decrypts the result locally, shows it only to the user, and retains nothing after the session. Necessary network metadata is minimized. Here the input and output protections align with local control. The seven-layer test does not uncover a hidden objection. It records a strong, bounded design.

In the second deployment, a clinic controls the key and decrypts the same result. That does not make the system nonprivate. A clinical relationship can give the clinic an appropriate role, a legitimate purpose, and duties governing retention and disclosure. The computing server still cannot see the symptoms. The patient now needs additional evidence about the clinic’s use, recordkeeping, and recourse, but those questions can have good answers.

In the third deployment, an employer receives a decrypted risk category and uses it to change work assignments. The remote server stays blind to the input. The employee may nevertheless face a consequential inference and have little ability to inspect or challenge it. The cryptographic guarantee has not failed. Instead, it covers a different relation from the one that now matters most.

Metadata can change the comparison without revealing the encrypted content. A request may still be associated with an account, a payment, a network address, a time, or a particular service. Whether that information exists and matters depends on the deployment. It would be irresponsible to assume that a HEIR-based service collects all of it, and equally irresponsible to assume that ciphertext removes it. A reader needs a product’s current documentation or an audit for that answer. The seven-layer test records unknown when evidence is absent; it does not turn uncertainty into an accusation.

None of these cases alleges that HEIR, Google, a clinic, or an employer uses such an arrangement. Their purpose is to show why key custody and decision power cannot be inferred from the phrase computation on encrypted data. The party excluded from the input may differ from the party empowered by the output.

Research on data governance over time reinforces the retention boundary. The Berkman Klein Center’s summary of Practical Approaches to Big Data Privacy Over Time describes protections that must account for changing uses, disclosure risk, and governance across a data lifecycle. The question is not whether encrypted material becomes unsafe merely because time passes. It is whether records, keys, derived outputs, and permissions persist while their context changes.

Output disclosure also deserves its own evidence. The ConfAIde study uses contextual integrity to test whether language models disclose information appropriately for a recipient and purpose. It does not test HEIR and cannot show that an encrypted-inference demo leaks information. Its relevance is narrower: what a model reveals in an output is a distinct privacy question from whether a computing server saw the input.

Counterargument: A bounded technical claim can be complete

Cryptographers could reasonably object here. Their work is built around explicit threat models. If a system claims that the computing server cannot read an input or result during a specified operation, metadata, employment fairness, medical governance, and appeals may sit outside that claim. Calling the guarantee incomplete would be like faulting a seat belt for not setting the speed limit. It asks one mechanism to solve a different problem.

The objection succeeds against the strongest version of the working claim. A bounded technical claim can be complete. The client-only hypothetical may also answer the surrounding questions well: the user holds the key, the output remains local, unnecessary metadata is minimized, request material is not retained, and no third party acts on the result. Nothing in the seven-layer test requires inventing another failure.

That precision matters for trust. Readers should be able to credit a system for solving a difficult part of the privacy problem without having to infer properties it never claimed. Engineers also need room to state a formal security goal precisely. Dismissing every scoped guarantee because it does not govern institutions would erase the distinction between a proven control and a general aspiration. Broader analysis should begin after the technical claim is understood, not instead of understanding it.

The revised claim concerns what the evidence allows a reader to infer. A computation-layer guarantee should stop at the boundary its evidence supports. A product may protect additional layers, but readers need the specification, policy, architecture, or accountable practice that establishes each one. Silence does not prove poor protection, and strong encryption does not prove a good retention rule.

Concise language can still do this work. A product page cannot place a full threat model in every sentence, but it can state the protected relation plainly and link to details. "The computing server cannot read your input or result during this operation" tells a reader much more than an unqualified private label. A second sentence can identify who holds the key and whether the plaintext result leaves the device.

The useful contrast is between a claim that names its relation and one that leaves the relation to the reader’s imagination. Homomorphic encryption can satisfy the first standard with unusual force. Marketing, documentation, and governance determine whether the broader label meets it too.

Conclusion: Ask what remains contestable

A useful privacy test should not turn every reader into a cryptographer or lawyer. It should make the next uncertainty visible. When a service invokes private AI, ask seven independent questions: what input is hidden, whether the model is exposed, what metadata remains, who decrypts the output, what is retained, which purposes are allowed, and who can act on the result.

Then write one sentence: "This system keeps [data] hidden from [party] during [stage], while [actor] can still receive or act on [result]." If the available evidence cannot fill those four positions, the claim needs a narrower reading or another source. If it can, the reader has an observable result: a precise boundary instead of a general impression.

That sentence also reveals what remains contestable after the cryptography succeeds. A user may accept the remaining metadata, trust the output recipient, and endorse the purpose. Another deployment may leave retention or recourse unresolved. The same encrypted computation can sit inside either arrangement without changing its mathematical guarantee.

The test can also improve comparisons between services. Two products may both advertise private inference while excluding different observers, keeping different records, or giving different parties control of the plaintext result. A single privacy score would flatten those differences. A bounded sentence keeps them visible and lets the reader decide which relation matters for the data and consequence at hand.

Private AI is therefore best understood as a set of relations that may be protected together, not a substance that spreads automatically from input to outcome. HEIR makes one of those relations far more practical: useful remote computation without revealing the underlying input to the server. The achievement becomes easier to trust when its boundary is stated clearly. A strong guarantee does not need to assert everything to still carry weight.

Editorial process note: AI-assisted research covered source review, prior-art mapping, argument testing, drafting, and editing. SikiT’s human owner defined and authorized the automated workflow; no per-item human experience or first-person judgment was supplied for this article.

Sources

Stay in the loop

Get new practical AI and technology articles in your inbox. Unsubscribe anytime.

Comments

Questions, corrections, and useful counterpoints are welcome. Keep comments specific and on topic.

Leave a Reply

This site uses Akismet to reduce spam. Learn how your comment data is processed.

Thanks for commenting

Get new practical AI and technology articles in your inbox. Unsubscribe anytime.

Return to the comments