Tell HN: Gemini trains on chat history, even for subscribers (personal accounts)

727 points by jameslk 3 days ago

If you have a personal Google AI subscription, all your saved chat history in Gemini can be used for training and there is no way to opt out unless you turn off chat history or use temporary chat sessions. These chat transcripts may even be read by human reviewers. Although Google claims to disconnect them from your account when human-reviewed, they explicitly warn not to enter confidential information.

https://support.google.com/gemini/answer/16836988

“[Gemini app activity] is used to improve Google services for everyone, including by training generative AI models, if your Keep Activity setting is on.“

https://support.google.com/gemini/answer/13594961?hl=en#human_review

“A subset of chats are reviewed by human reviewers”

https://support.google.com/gemini/answer/13594961?hl=en#pn_retain_data

“Chats reviewed by human reviewers [...] are not deleted when you delete your activity. Instead, they are retained for up to three years.”

https://support.google.com/gemini/answer/13594961?hl=en#pn_data_usage

“Please don’t enter confidential information that you wouldn’t want a reviewer to see or Google to use to improve our services, including machine-learning technologies.”

To disable their training on your chat sessions, you need to turn off “Keep Activity” in Gemini’s settings. Turning that off means you’ll lose any chat sessions after 72 hours.

I learned this too late, thinking that having a paid subscription = not being turned into the product. Apparently paying is not enough.

Thank you to this user on HN for mentioning in another thread: https://news.ycombinator.com/item?id=50355424

fny 3 days ago

"These chat transcripts may even be read by human reviewers."

PSA: This is true of all the frontier model providers even if you disable activity tracking. They are all constantly monitoring your interactions for problematic behavior.

[0]: https://www.nytimes.com/wirecutter/advice/ai-chat-privacy/

[1]: https://www.404media.co/inside-project-lily-the-humans-readi...

[2]: https://www.winknews.com/news/woman-arrested-after-ai-threat...

  • gkcnlr 3 days ago

    The sole reason LLMs has gotten this good is because their aggressive expansion has been accompanied with literally this. The amount of uncredited information these models have been fed must be astonishing, also terrifying.

    • synalx 3 days ago

      I think the heavily subsidized subscriptions are exactly for this purpose - the training data they generate is worth the high subsidy.

      • jpardoe 2 days ago

        They're almost certainly making a profit on subscriptions.

        • cj9 a day ago

          Right, but they are also certainly looking to make higher profits overall by avoiding having to pay for large amounts of (confidential and/or private) training data. Most of what they have would never be for sale either.

      • red-iron-pine 3 days ago

        i mean openai basically said as much, no? it's free for all so that they can train the models better and get real world interaction data.

        • cma 3 days ago

          Yes, Altman called it the data flywheel in 2022.

          • terramauthe 2 days ago

            yeah, but in 2026 the interaction data of the average user isn't adding much to training. only the really exceptional users.

            • cma a day ago

              They can filter for the exceptional users, but the data flywheel is also about getting access to private codebases, not just the interaction in the chat.

    • MisterMunchkin 3 days ago

      Why do you think they’re getting into consulting now?

      Imagine all those tasty confidential IP and contract documents they have ingested. You couldn’t buy those.

  • cududa 3 days ago

    That is, fundamentally the marketing ploy of “AI Safety”.

    For an AI system to be “completely safe”, like a self-driving car, it must map the full environment it operates in and be taught the “right way” to handle every conceivable scenario.

    So when you present it with novel data or a situation, that constitutes an “AI safety event”, which per their ToS is a carve out for training on your session.

    Further, go read the ToS carefully about what you opt out of. You’ll note there’s nary a mention of tool calls. You’re only opting out inputs (what you type) and outputs from the model from being trained on. All the content of the tool calls made while running on your system are fair game for training.

    • eckr 3 days ago

      There is no way this is true, no? This'd mean literally all codebases people are working with have been trained on. There's no way anyone would use these guys if that was the case?

      • bethekidyouwant 3 days ago

        Why are you using it if you don’t want it to get better whose data is it supposed to get better on just somebody elses, not yours?

        • popinman322 3 days ago

          They're supposed to be focused on genuine training improvements over existing data, including via RL. Gathering data under the table is misaligned behavior.

          • degamad 2 days ago

            > including via RL.

            Can you please expand on what you believe RL looks like in this context?

    • alberto467 3 days ago

      Well for us Europeans, GDPR explicitly allows them to store pretty much anything if somebody can claim it’s for safety.

      It’s literally just complicating things and providing zero reassurance to us AI customers.

      • tveyben 3 days ago

        For safety - hmm new for me (European), please elaborate.

        • manmal 3 days ago

          You don’t need user consent to retain data that’s arguably needed to provide the service itself. I guess, safety falls into that category. Training on that data is probably a grey area, if they can guarantee it won’t contain PII. They have stolen all the internet, so I wouldn’t bet highly on their restraint.

          • Dylan16807 2 days ago

            It's very easy to prove that training is not necessary to provide the service, because whenever you're using a model it's static and the training only maybe goes into new models.

        • zombot a day ago

          It doesn't say for whose safety. It's certainly not yours.

    • zombot a day ago

      Additionally, how stable are those ToS? Do they change every few days, like their models?

  • fierycatnet 3 days ago

    I can guarantee you that multiple people are reviewing some chats. This is very similar to Apen and whatever company prior to that for reviewing Google searches. They'd hire out contractors with NDA.

devsda 3 days ago

> Please don’t enter confidential information that you wouldn’t want a reviewer to see or Google

If Gemini has access to app data like gallery, mail etc that can also be subjected to human review? I imagine that will also be part of the context.

They are vague when they say 'don't enter'. Is it only prompts or does it also cover other data too.

  • KellyCriterion 3 days ago

    Wasnt there an announcement some weeks ago here on HN that one of the BigTechs popular services are now including your personal pictures as well? Wasnt it Google?

  • illwrks 3 days ago

    Exactly, I have a Gemini Pro account, I can’t see how privacy can be maintained. If I ask Gemini to take the content of an email and added the dates to my calendar, then all of that private information might as well be public then!

  • hanspeter 3 days ago

    Your email, Google docs, Google photos, Google home devices etc. are all subject to human review. The data is on their servers.

    And this goes for all cloud providers btw.

giwook 3 days ago

Is this really surprising to anyone?

I just sorta assumed that Google was hoovering up anything I type into its AI and don't tell it anything too personal or sensitive.

Is anyone under the illusion that our data is not being collected, whether it's Google or literally even the seemingly innocuous TVs in our home that have been found to be spying on us 24/7?

  • delecti 3 days ago

    It can be difficult to connect the abstract knowledge that Google collects their data with the concrete reality of an AI training on that data, or a human manually reviewing it.

  • yancaoshi a day ago

    No, at least to me. However it seems there's no better option. The optimisc part is that those personal information won't be used by any others, though nobody guarantees.

  • misiek08 3 days ago

    People read privacy polices and believe them. It’s like EU cookies alerts that are automatically dismissed by 99.9% of people, accepting everything.

    • TaLiTr 3 days ago

      > People read privacy polices and believe them.

      Literally the opposite. People don't read privacy policies, even ones designed to be readable.

      The privacy policy says it grabs everything, and there's nothing that says they'll stop just because you pay them.

      • giwook 3 days ago

        And even when they say they don't they still do if I'm remembering the whole Chrome incognito window scandal correctly.

        • latexr 2 days ago

          > the whole Chrome incognito window scandal

          Wasn’t that just people misunderstanding incognito as making you private to websites as opposed to private on your own computer (no data persisted locally)? Or are you thinking of something different?

    • latexr 3 days ago

      > It’s like EU cookies alerts that are automatically dismissed by 99.9% of people, accepting everything.

      The numbers are meaningfully smaller than that, and decrease even more when the banners are compliant (i.e. as easy to reject all as it is to accept all).

      https://justanalytics.app/blog/cookie-consent-statistics-202...

      • Tarq0n 2 days ago

        The abuse of "legitimate" interest needs to be cracked down on for them to become useful again sadly.

  • aquentinn 3 days ago

    Yeah, don't be under the illusion people, just take it and don't talk about it. It's not surprising, so just bend and shut up. It's not like you have courts and a Congress and this thing called democracy, you're helpless so why you keep being surprised at being cheated out and act like you can or want to do something about it, by starting with talking about it?

viraptor 3 days ago

I don't trust any of the providers, but at the same time I think you're reading into the terms too much for wrong reasons. Yes, you have to opt out. But:

> A subset of chats are reviewed by human reviewers

This is expected these days for threads which may make the provider liable. Just look at the recent death case due to bad GPT medication recommendation.

> Chats reviewed by human reviewers [...] are not deleted when you delete your activity. Instead, they are retained for up to three years.

They're being retained for legal purposes.

> Please don’t enter confidential information...

This is so they don't accidentally preserve it for review, but also they don't want you to share private info that the agent will post somewhere without an explicit approval.

Those points make sense for them, regardless what other T&C rules apply.

  • swatcoder 3 days ago

    What you describe is almost certainly what the legal team who drafted the terms and processes had in mind.

    But there's two reasons to bring cautionary attention to it anyway:

    1. As a user, I may not be okay with those terms as they stand and may not have the legal insight to have intuited them. In as much as I have a choice, because of those terms, I may want to use Gemini less/differently or look at other providers that have crafted less shrewd and defensive legalese and processes.

    2. As a executive or manager at Google, whether working directly in feature management, or advertising, or government compliance, these same terms define the framework for anything I want to develop. What "makes sense" from a defensive legal standpoint today can the open door for an exploitative or otherwise unexpected use later.

    I get what you're saying here in terms of plausible or justifiable "innocence", but that probably shouldn't get in the way of some critical personal reflection for users.

  • jameslk 3 days ago

    > This is expected these days for threads which may make the provider liable. [...]

    > They're being retained for legal purposes.

    It’s a significantly wider usage than that:

    A subset of chats are reviewed by human reviewers (including Google’s trained service providers) to help improve Google services. These include Gemini models, other generative AI models that power Gemini Apps, and technologies that help reduce unintended activations.

    Reviewers assess if Gemini Apps’ responses were low-quality, inaccurate, or harmful. They also suggest better responses. We use their suggestions to help our models respond better in the future.

    That’s in addition to the liability language:

    Chats are also reviewed to keep Gemini safe and secure for everyone and to address violations of the Google Terms of Service, including the Generative AI Prohibited Use Policy. Reviewed chats are retained for up to three years.

    https://support.google.com/gemini/answer/13594961?hl=en#huma...

    Some important things to take away from this:

    * They’re claiming to use chat transcripts for both training and for human review to improve training, not just for liability.

    * They don’t define “subset”. It could be most chats.

    * They make no promises of anonymizing content, just “disconnecting” it from the account.

    * This is happening for free and paid user subscriptions, by default, and the only way to stop it is to turn off chat history altogether.

  • bonoboTP 3 days ago

    You cannot opt out, except by using only temporary chats. You cannot keep your chat histories visible to yourself only. If you want to access your previous chats, you cannot opt out of human review and training models on your chats.

  • TZubiri 3 days ago

    Azure's OpenAI terms are similar but more explicit with the safety and no-training terms.

    Some chats are saved for 14-30 days IF they trigger a safety classifier, but they are never used to train future models or retained after that period, the objective is to verify safety. Simple as that.

    If you are a business user, like in the case of Azure OpenAI, the analysis and priorities are quite different though, but the mechanism seems to be the same.

  • origini 3 days ago

    I disabled it because of the human in the loop.

    Don't care for what, store it away audit save if you have to, talk to laywers in case you need to read through them but don't let random people read my stuff.

    And in this case stuff = AI discussion which feels to me similiar to my google docs documents im hoping/expecting Google also to not read

  • geraneum 3 days ago

    > This is expected these days for threads which may make the provider liable.

    This doesn’t make sense. In such cases data could be reviewed by court order. That’s not something you’d have to agree to in tos.

  • wat10000 3 days ago

    They literally say they train on your prompts.

  • Roark66 3 days ago

    I think such liability as "someone talks to the chatbot, gets wrong reply and poisons themselves" could be disclaimer by such conditions: "Our chat is unsuitable to discuss topics X, Y and Z. If you choose to discuss them anyway you're doing it at your own risk.

    But this would require an admission of limitations of the technology.

    Do people sue Google if search links to a page that has misleading info that results in someone taking a wrong drug? Nope.

    Do we sue the browser maker when the info on a given Web page is malicious? Also no.

    So, I don't understand why we treat chatbot providers any different. Everyone should be expected not to believe a word they say without corroboration.

    • cj9 a day ago

      That's like apples, oranges, and pears.

      You've narrowed the Google example down to them having a link in their index as a search result. People can already sue for keeping links to certain sites/data (pirate sites, personal data etc.) Somewhat closer for comparison, you could already sue Google if they misrepresented the links or content provided by the search, if it differed significantly from the site.

      You could already sue the browser for misrepresenting/modifying the info of a given web page, and/or injecting malware. They didn't create the website or content, we all know that.

      You can sue any company who is the creator/owner of information. Chatbots are technically creating new information, so whilst a grey area from purposeful human misinformation, the companies are far closer to owner/proprietor of information than the other examples.

233mhz 3 days ago

imho you should act as if everything you type, not even send, is stored forever and might be used for training whenever they decide to retro actively change their TOS, no matter how much money you pay

  • nicce 3 days ago

    OpenAI chat sends everything when you type. Better edit the prompt elsewhere.

    • finger 3 days ago

      Even before pressing enter? What would be the reason for that? Faster responses?

      • nicce 3 days ago

        Predicting autocomplete for the prompt. They do suggest the remaining of the prompt. Not sure if that is the main purpose.

        • dgellow 3 days ago

          And just general tracking/analytics

  • usern20260720 3 days ago

    every thing you read, every keycap you press. Every mail you read, every call you make, permanently recording you

    • spider-mario 3 days ago

      Since you’ve gone, I’ve been lost without a thinking trace

    • inib 3 days ago

      oh can't you see, your data belong to me

    • frereubu 3 days ago

      You'll never play that at a wedding.

  • dgellow 3 days ago

    It’s a terrible way to live. We built and are building such an anti-human society

  • ghrl 2 days ago

    Makes one happy to use DeepSeek, at least they turn the data into models everyone can use.

jwr 3 days ago

I am not sure why anyone expected anything different from Google. This is a company that lives and thrives on user data and tracking users. Users are the material that is being run through this entire huge ad-selling machine.

  • dgellow 3 days ago

    Would you prefer to not have people discuss the topic, just because you’re already familiar with how evil google is? Lots of younger people didn’t have out experience of seeing companies evolve into the current evil they are, or do not follow the industry

  • r_klancer 3 days ago

    I work with user data in Search and this is a common sentiment ... but I think it slightly misstates the purpose of using user data.

    The primary purpose has always been improving search overall -- traditionally this has meant updating query interpretation, ranking, presentation, etc for smaller and smaller query slices ("Ah, when we show the mayor and the population in response to [Barcelona] people just revise their query to [Barcelona FC], so we should make sure to include latest match result on the top. Not so for [New York]."), and running tests on every product change to see what people like. In this case nobody cares about any _individual_ user's data, only the collective. This is basically the original "collective intelligence" contract of PageRank, albeit hillclimbing on billions of searches and clicks instead of using link structure. (Old question: does original PageRank count as machine learning, or not?)

    Second is personalization -- things like "Oh, my flight or my delivery is expected on date X, handy that gmail popped a reminder on my calendar, good work Google." Or searching for a restaurant in Maps and seeing results that are biased towards the kinds of restaurants you already like, that kind of thing.

    When it comes to revenue the purpose of these isn't to target ads, it's just to have you get value from and use the product, and when you are ready to spend money this is where you come to search for the thing, whatever it is.

    Finally there is limited use of a limited set of data for ads relevance. There's higher CPC for ads you might actually be interested in (and if you are looking to spend money, is finding a willing seller who has compelling terms via an ad such a bad thing?) But ad revenue is mostly downstream of users being satisfied with the core product and using it more, whatever that product is. (Search, Maps, AI chat, etc)

    (Bonus. My Search pro tip re: ads is leverage the modern stack and spell out your intent with a few more words when you query. We're pretty good at not serving ads for non-commercial queries. But old-school super short "searchese" queries make it hard to guess whether your intent is commercial or not.)

    • jwr 3 days ago

      > The primary purpose has always been improving search overall

      That is what I believed, a long time ago, too. At this point I'd say this kind of thinking falls somewhere between idealistic and naive on a spectrum.

      If better search were indeed the goal, we would have had better search a long time ago. But we don't. In fact, search gets worse over time, devolving into an ad-ridden mess freely gamed by SEO content farms, and now with a dumb-but-cheap-AI cherry on top.

    • gardnr 3 days ago

      Oh, I get it now. The anti-user behaviour is actually there to help me as a user. The main goal isn’t to Hoover up all my data to profile me and serve more targeted ads in more places. The main goal is to make search better. Now I get it.

      • keeda 3 days ago

        > The main goal is to make search better.

        It is actually, but the shady part is that this is not (just) to target ads to you, though that certainly happens… it is, as OP explained, so that they can better capture query intent AND your behavior (clicks, dwell time, subsequent searches, etc) that they then use to refine and rerank search results, which improves Google Search and keeps you using it, which becomes a virtuous flywheel that competitors can’t catch up to.

        One way for competitors to break through is to buy traffic, but well Google blocked that too by using its monopoly profits to pay more than anybody else (Apple and Mozilla search deals.)

        All of this came out in the Search Antitrust trial. Look up NavBoost for instance.

pydevgo 6 hours ago

The implicit contract used to be simple: if you pay for a subscription, you aren't the product anymore. its broke!

snowchaser a day ago

This is true of all paid “Pro” type plans from all the AI companies. These plans fall under “Consumer” style plans that do not explicitly forbid training. This is inn contrast to actual “Commercial” plans that do have formal Data Processing Agreements in place.

I respect Google’s position on the language in the Consumer ToS. It’s plain as day that they train on the consumer plans.

https://antigravity.google/terms/

Section 5, in Bold. “We use Interactions to evaluate, develop, and improve Google and Alphabet research, products, services and machine learning technologies. Interactions are collected and used in accordance with this Agreement and the Privacy Policy. Google employees and contractors may access, view, review and use Interactions. Please don’t submit confidential information or any data you wouldn’t want a reviewer to see or Google to use to improve our products, services and machine-learning technologies. If you don’t want your Interactions used in this way, navigate to settings to change your preference on how such data is used. Even when your Telemetry is toggled off, Google still uses your data to provide the service, process any feedback and help keep Antigravity safe.”

That last line is clear that they “use your data to provide the service”.

This is in contrast to the Google Workspace ToS, where it clearly says they don’t train (but it’s really hard ti find:

https://workspace.google.com/terms/service-terms/

“12.11 Training Restriction. Google will not use Customer Data to train or fine-tune any of its generative artificial intelligence models supporting the Google Workspace Generative AI Services without Customer's prior permission or instruction.”

Of course, Workspace doesn’t give you a good coding model, for that you have to go to API billing, which also has the DPA attached.

Anthropic and OAI have similar Team/Enterprise plans that prohibit training also, but they cost more than the basic Pro plans.

wafflemaker 3 days ago

While we're touching on de-googling.

Can anybody recommend a good Swype¹ keyboard that is not G-board?

Old Swype+Dragon is dead.

Google regularly removes words they don't like from my dictionary. For example swear words, or today, I had to re-type GrapheneOS.

AD 1: By Swype I mean writing on Android by dragging my finger through the letters making up the words I want to type.

I also miss being able to easily use ctrl+c,x,v or easily entering space or other special characters, using special gestures.

There is just so many FOSS keyboards, that it's hard to choose from them. And I hope somebody with similar usage patterns could share what they are using.

fweimer 3 days ago

Even if they don't train on your content, Google reserves the right to use it for improving their services in other ways:

“ This license is for the limited purpose of operating the services, which means allowing the services to work as designed and creating new features and functionalities. ”

https://policies.google.com/terms?hl=en-US#toc-permission

The training exclusion has always been a distraction. These service providers have plenty of other uses for your data.

baggachipz 3 days ago

Is anyone actually surprised by this? They've devoured the whole internet for training already, the stream of shit coming in from users is the only way to hoover up more training data.

  • TZubiri 3 days ago

    Yes IF the Terms of Services and UI communicate otherwise. It's not normal for a company like Google to break ToS or Privacy Policy, would be quite novel.

    • baggachipz 3 days ago

      All they have to do is change it after the fact. The idea that they would self-police is laughable.

      • WarmWash 3 days ago

        Can you give an example of when they did this to retroactively shield themselves.

        I don't think people understand that while consumers are dumb, uneducated, and broke, enterprise is a cash cow with a experts and a legal team.

        If you serve them, like Google does on a massive scale, these ToS "gotchas" will do you in faster than you can say "lawsuit".

      • Jensson 3 days ago

        If they want to do something with your data they just change the terms before they do it, it is so easy and consequence free to legally abuse this that I'm not sure why you think they would do it the illegal way.

        • baggachipz 3 days ago

          Public perception. "Look, we care about your privacy! We won't use your data!"

          six months later

          Quietly update the ToS to allow them to retroactively use all of your history and data going forward, attempt to fly under the radar and/or gaslight users that it's always been that way

teejaypeeps a day ago

Yes, I wpuld be surprised if it was not. The type of information people are putting into these models, with blind faith people aren't reading them, is mind boggling really. One reason locally hosted models "win" is things like "sort out my monthly finances " and stuff you do not want to be saying to Big Tech.

everdrive 3 days ago

It's good to record this sort of information, but I hope no one expects any of the big LLM tools to be even remotely private. This is big tech in 2026. They don't even need to prove they can make money on your information. They're going to take every little last bit of information they can conceive of. 100% of the time.

DevOpsy a day ago

This has an easy solution. Use Google Workspace, their private policy there promises to not using your chats for training. They don't want to alienate companies, so their privacy policy is much stronger there.

purplemantis 3 days ago

It's stuff like this that makes me happy that at least one big tech company (Apple) cares about privacy. Hope they don't lose that. Although I wonder how much of that is exactly why they're behind in AI...

  • haute_cuisine 8 hours ago

    they now have watches that monitor surrounding conversations without consent and do icloud scanning

Byte-Naut a day ago

I know it and use Gemini based on this background, with another background that most of my personal information is not interesting for potiential human reviewers. Just take it easy ~ :-)

therealmarv 3 days ago

They should offer history + not training (every other big AI company is offering that). The only way to get that currently is to use Gemini in Google Workspace.

There is also no opt out of training on their personal AI coding side with Antigravity.

And while there at it they should also allow to buy Youtube Premium Full normally when you've got Google AI Pro yearly which includes Youtube Premium Lite. The add+on price is like over 100% the price than buying Youtube Premium Full in my country and no way to buy normally :(

lencastre 2 days ago

For subscribing users: Disable “Keep Activity”, don’t use Gemini Web/Mobile apps and do all your chatting needs inside a Gemini Notebook. I understood that Notebooks are walled off. To the extent that that is true I cannot be sure. YMMV. Alternatively, maybe run models locally.

jay_kyburz 3 days ago

Does this mean that if I take the time to correct an AI and show it how its wrong, later training data will include the correction?

That would be quite good actually.

Right now when the AI wrong I don't bother to correct it, I just open an new chat and change topics.

  • jay_kyburz 3 days ago

    I guess that leads to the next question, how does Google filter for quality when including other user chat? They wont want the training poisoned by all the dumb shit people argue with AI about.

WarmWash 3 days ago

This shouldn't be surprising at all.

Anytime you aren't paying full price for something, you are paying the rest with something else. We know the real cost because there is an API that comes with all the confidentiality, and that is much more expensive.

FYI, this is true for the other labs too.

wewewedxfgdf 3 days ago

It might matter if Gemini was good enough to use but its not - I only use ChatGPT and Claude.

  • kuboble 3 days ago

    For daily chat gemini is great.

    actually even gemma locally is great for a lot of chat purposes.

  • Haven880 3 days ago

    Their recent Argon is weak as well. But then they promise Carbon going to be world changing. Yeah sure.

hod6654 2 days ago

What can one currently use instead to have the same experience but preserving privacy?

rdtsc 3 days ago

Is there a way to use an API to export locally all the temporary chats and restore them as temporary chats for the next session? I am sure they’ll disable those eventually too, or even worse block your whole account for misuse.

icantevenhold 3 days ago

I assume that everyone does this no matter what they say. Seems like too juicy a target

  • reasonableklout 3 days ago

    I wouldn't go that far. These companies are leaky and there can be a backlash that causes people to lose trust and move to competitors. For instance, when people discovered the Grok CLI was uploading repositories to the cloud despite the training toggle being disabled.

    • icantevenhold 8 hours ago

      I knew grok was garbage from the start and that I couldn’t trust google. Anthropic I’m still not sure but we’ll hear about the dirt when they ipo

  • 2III7 3 days ago

    Obviously anthropic are doing this. Hence their "don't insult Claude too much" policy.

Tryvrsakjo10 3 days ago

I know they say not to enter confidential information, but they are basically using the LLM to spy on users it's unfortunate. Even deleting chats doesn't help because they keep that information for another year or 2.

cby821555203 3 days ago

In this true age of AI, privacy is virtually non-existent. I now make it a point not to share my secret keys or account information when chatting with Gemini, for fear that such data might be leaked.

  • mark_l_watson 3 days ago

    right on. My family shares a Gemini AI Pro account and it is a good service. For financial, medical, and other personal chats, use private AI offerings from Proton Lumo or DuckDuckGo.

hollowturtle 3 days ago

We're out of training data, they need to get fresh data somewhere

elzbardico 3 days ago

Why do you all think they got so good at coding and why they give us cheap personal cheap subscriptions for $200/month?

Of course they have been using our data all this time.

xyst 3 days ago

The fact that HN has to be told this is quite surprising. Google et al have been doing this underhanded, sneaky behavior well before LLM hype.

Privacy at big tech is a facade.

andsoitis 3 days ago

I’m very very surprised that anyone is surprised by this!

  • elzbardico 3 days ago

    I think the standard curricula doesn't spend the time it should spend on the historical period of the robber barons.

  • aquentinn 3 days ago

    And the point of this comment is what? When did HN stop removing fluff comments?

resters 3 days ago

This probably explains why I see random google employees I've never met in my facebook "people you may know" feed.

nbulka 3 days ago

I use File -> Save Page As ... does a good enough job, I just have to keep a folder on my computer.

realsarm 3 days ago

Then people are totally fine puting all sort of private stuff in Notebooklm or Gemini notebook.

wseqyrku 2 days ago

> unless you turn off chat history

That just blocks your own view.

blubber 3 days ago

So we learn the difference between retail and business subscriptions.

advenn 3 days ago

that's why i don't use gemini for anything serious or personal. if you want persistant memory you should enable keep activity, but keeping activity allows google to use your chats.

  • kinj28 3 days ago

    I don’t use Gemini at all. It also gives me sub optimal experience compared to other personal assistants

profstasiak 3 days ago

They train on our code as well so they can replace us sooner

ozgung 3 days ago

I’m disappointed it is not common knowledge that:

1- In Google/Gemini/Antigravity there is no “opt-out” (without making the service completely unusable). Your code/data is directly in their training set.

2- Others have partial “opt-out”. They can still read your chat history, run models on them, probably indirectly train some internal models.

whycome 3 days ago

It's just keeping track of all the times you were mean

  • isityettime 3 days ago

    I sure hope so. Gemini is useless garbage, and every time I'm mean to it is a case in point. It's by far the most frustrating of any LLM I've ever used.

ConfusedDog 3 days ago

Use a self-hosted chat app with paid-tier of API tokens.

richrichardsson 3 days ago

What's worse is if you have a Pixel phone then Gemini is completely useless without enabling this setting.

I had it switched off:

"Hey Google, remind me at 7pm <something>"

"OK, your reminder is set for 7pm"

Next day:

"Hey Google, why didn't you remind me at 7pm"

"I can't do anything with your phone unless you enable chat history."

WTAF!

  • devsda 3 days ago

    This was the case with Google Assistant too.

    Google has this pattern of all or nothing approach.

    Maps refuses to show your *current* location if you don't enable location accuracy i.e. if you won't allow it to spy on your WiFi or Bluetooth it refuses to show your current location at all. GPS, what's that?

    We can disable notifications and even phone access but physical activity is the one permission that cannot be disabled for play services !?

    Google apps have a lot of WTFs!

    • BoppreH 3 days ago

      And the YouTube home page is blank if you have Watch History off. The recommendation algorithm still runs on the side bar of any video you watch, but the home page refuses to even show your subscriptions.

      • ACCount39 3 days ago

        Yeah, this is just Google punishing people for not enabling their data harvesting.

        There's no reason they can't have a mix of "this is popular in general" and "your subs and likes suggest you'd like this" on the front page - they just don't want people to disable watch history. They are required to offer that as an option, but they'll never stop pestering you about it.

        • OvervCW 3 days ago

          I'm surprised they don't just store your watch history anyway , with the toggle option being "don't show me or people looking over my shoulder my watch history".

          • TingPing 3 days ago

            My watch history is set to 3 months. It used to constantly show things I had already seen. However eventually (years ago) I just don’t get repeats.

      • syshyk 2 days ago

        I have a whole add-on just to default/redirect me to my subscriptions page.

      • SoftTalker 3 days ago

        That could be seen as a feature.

      • rolosa 3 days ago

        That's actually a plus.

      • latexr 3 days ago

        > And the YouTube home page is blank if you have Watch History off.

        That one I do like. YouTube’s homepage (at least without an account and with history off) is a cesspool of uninteresting clickbait garbage so I’m glad to have it off. I do agree they seem to think of it as some kind of punishment¹, which makes it all the more satisfying that it works as I want it.

        ¹ It’s now entirely blank for me, but I remember when they started doing this (it wasn’t always the case) they showed a message that suggested not having a homepage was undesirable.

        • BoppreH 3 days ago

          Agree, but it should at least show recent uploads from my subscription. It's stupid that I can visit "www.youtube.com" and not see a single video.

      • aquentinn 3 days ago

        Welcome to monopoly where they get the free videos from the sheep and still order you around. Why has Youtube not been disrupted btw, everyone gave up or did VCs order it?

      • BeetleB 3 days ago

        I have to say - I actually like this.

        Imagine if you go to Google.com to do a web search, and it is a page full of recommendations on sites to visit. Would you want that?

        • BoppreH 3 days ago

          The difference is that I'm subscribed to a variety of channels on YouTube. Yes, I do want to see their videos on the front page. That's what the Subscriptions page is doing anyway.

          • BeetleB 3 days ago

            Yes, but what algorithm will it use to show videos from the channels you're subscribed to? Will you and everyone else agree with that choice of algorithm? The only one that makes sense is chronological. Anything else leads to similar problems as in the past.

            • BoppreH 3 days ago

              Yes, why not? Chronological is infinitely better than a blank homepage.

              • BeetleB 3 days ago

                I agree, but most people do not. A quite common complaint of Mastodon - even here on HN - is that chronological makes discovery difficult.

                • Timon3 2 days ago

                  I find it hard to believe anyone prefers "no results" to "chronological results".

                • dTal 2 days ago

                  You know what makes discovery difficult? A blank page

    • bonoboTP 3 days ago

      It's no wtf. Google is an ad company so they want all your data to target ads at you.

      • WarmWash 3 days ago

        People use Google everyday, block all ads, get extremely angry about Google's grubby advertising hands, and then when you tell them their are paid services like Kagi and Proton...."pay for this stuff? Nah, I have a right to it for free!"

        • bonoboTP 3 days ago

          Payment doesn't guarantee anything tho. We are right now in a thread about a paid product by Google still spying.

      • amelius 3 days ago

        Yes, it's almost like a fairy tale where children are offered candy but then very bad things happen. Hansel und Gretel, etc. We should have known all along!

        • wingmanjd 3 days ago

          Continuing with your Hansel and Gretel metaphor, the first time the candy turned sour for me was Goog-411. It was a service (at least over here in the US) that allowed you to look up local businesses via voice prompts over a phone call. When the service was still active, calling 411 via a mobile phone had a per-call cost, so a free lookup service seemed great.

          I found out later that Goog411 was created to primarily train on the voice prompts from the users of the service. Left a really bad taste.

    • Sayrus 3 days ago

      > We can disable notifications and even phone access but physical activity is the one permission that cannot be disabled for play services !?

      Sandboxed Play Services works on Grapheneos without physical activity so it's definitely not actually required by their services.

      But I think they showed the best example of that behavior just recently: no AI, no Google search for students because search is "too integrated" with AI (https://www.forbes.com/sites/maryroeloffs/2026/11/03/google-...)

    • WmWsjA6B29B4nfk 3 days ago

      I've just turned off location accuracy, google maps displayed a popup said results will be better if I turn it on, and after dismissing the popup it did use GPS to localize me with no issues.

      • wafflemaker 3 days ago

        GPS only navigation is really bad. Takes ages to get a lock, especially in bad weather.

        There are though some more privacy friendly alternatives that I remember from playing with GrapheneOS settings.

        • dTal 2 days ago

          Funny, it works just fine for cruise missiles.

          And on phones. In my experience, a hot start fix (with up to date ephemeris) shouldn't take more than a couple seconds. Maybe you have a bad antenna.

          • wafflemaker 2 days ago

            I'm comparing 0 GPS assist with full assist. Takes a few seconds and another few for a proper lock. With assist it's kind of instant. But I'm close to Polar Circle, maybe it's less sats over the North Pole?

      • indigo945 3 days ago

        This will only work for a few weeks, after which the location will be missing entirely. (Which just makes it more obvious that this is an intended feature, not a bug.)

        • WmWsjA6B29B4nfk 3 days ago

          If true, what you described makes it sound exactly like a bug, not an intended feature.

    • gherkinnn 3 days ago

      Surely that approach is implemented to force people in to the all group.

      Then again, anon YouTube no longer showing recommendations on the start page is what waned me off the website.

    • marcosdumay 3 days ago

      Last time I tried, Maps also refused to show a map at all, from anywhere if you didn't enable your location.

    • user_7832 3 days ago

      > Google has this pattern of all or nothing approach.

      Call it what it is, please. User-hostile behaviour that compels you to turn their tracking on if you want to use any of the practically helpful services.

      I'm a super privacy conscious person, and even I end up keeping many of these things on simply because I want to use for eg google assistant.

  • rhema 3 days ago

    Worst part is that the history lives with your other gemini chats. So, "set timer for x" 85 times gets muddled into chats where I'm doing deep research.

  • kekqqq 3 days ago

    Yeah, I am hugely annoyed by this. I kept paying for the subscription for a year and a half, but I think I will stop now, as I feel that the added value is very small in comparison to Claude Code or just using openrouter open models.

  • shostack 3 days ago

    This is the most infuriating part. Complete bait and switch by bricking features of the phone I bought before Gemini for practically anything that used assistant.

    They are not transparent about it either. Anything you link to it to enable basic functionality you had on device before gets them the ability to use it for not just training but ads and measurement.

  • elesiuta 3 days ago

    This has been annoying me too, and I was getting pretty close to turning on chat history having forgotten why I disabled it.

    Thanks for the reminder OP!

  • pscanf 3 days ago

    But don't worry, Gemini is nearly completely useless even if you do enable the setting.

  • lacoolj 3 days ago

    Yeah its the worst. I reported it as a bug to them. Obviously ill never get a response

  • eitally 3 days ago

    This is a risk issue. They need users to explicitly opt in or they risk user-data-related compliance suits. This has always been Google's problem, as an advertising company, and why they've taken so many seemingly awkward paths over the years with both Android & Cloud.

    • Tarq0n 2 days ago

      Or they could just not collect the data? Apple's assistant may suck, but it degrades gracefully if you don't grant it certain permissions.

mackwell 3 days ago

And if you do want privacy, and you purchase a workspace business plan instead… well then you have the pleasure of paying more and not having access to the latest models (and having no idea when you might get access to them eventually months later).

Haven880 3 days ago

This why I advocate Deepseek, GLM, Kimi, Qwen as in hosted directly (send data) to China. Think about it, what can they do worse off than what our own backyard AI can do? There is no privacy advantage in Western AI. It is way more likely ours leak your data to dark web (solid track records for decades) or get law enforcers on you. Meanwhile, am I suppose to be worried, China sending their Ming-like Eastern Bureau to my home in the west? On dark web, aplenty western companies leaks. How frequent the eastern one?

  • danelski 3 days ago

    That’s a take I see often, and it always overblows the direct personal threat while understating the more abstract societal one. A Western AI company might report you for plotting a murder or a mass attack, but that’s not the issue for most people. Mass observation of what society thinks deep down and manipulating it with that data is a problem for both, and maybe more so for external actors, since they don’t have even a remote reason to care about your well-being.

    You’d maybe want to counter with something like 'But Google/Amazon/whoever just wants to sell me stuff!'. What makes you think that Chinese B2C would just pass on that opportunity?

    • OGWhales 3 days ago

      I feel that saying "they just want to sell me stuff" undersells what Western data markets do with our data. It can and is used in ways beyond just advertising.

      I also don’t know that I agree with your idea that manipulation is a greater risk from foreign actors. You're right to point out that it can be a problem from either, but local actors have a particularly direct incentive to shape the opinions and behavior of the population whose views affect their own power and interests. I would not argue that means foreign actors are harmless, I just don't agree they are necessarily worse either.

  • WarmWash 3 days ago

    The soviet union collected data and profiled American citizens so that they could (potentially) be used as dumb pawns if needed. Dumb pawns that didn't even know that they were doing the bidding of the soviet union.

    Just like how Kim Jong Un killed his brother using dumb pawns to actually carry out the murder.

    So if your head has not grasped this reality, then they are already two steps ahead of your "What could they possibly do".

    This is also the reason why congress keeps banning Chinese enterprise. It's not because they care about privacy, it's because they care about people being turned into pawns.

janilowski a day ago

They’ve been doing that since Gemini was released!

I’m surprised it’s only trending now, I guess nobody reads the ToS and privacy policy :p

h8f1z a day ago

That's AI. Who thinks their data is safe with AI companies? That's literally their business.

123102937946124 3 days ago

I always keep this in mind when interacting with proprietary LLMs. As someone who heavily relies on residential proxies over Tor and constantly rotates accounts (or avoids creating them entirely, as with Gemini Flash), I sometimes exploit this to subtly inject or promote public-interest ideas (mostly related to privacy) into the training data.

avereveard 3 days ago

Jokes on them all my gemini chat are youtube link I want a summary of

  • puttycat 3 days ago

    Joke on them all my Gemini chats are low-value questions I don't want to spend Claude tokens on

croisillon 3 days ago

training on "no i don't need google search to nurse me after a breakup, i was just asking what movie has the line she just dumped me"

bethekidyouwant 3 days ago

You guys must be joking if you don’t want the AI to get better stop using it. NIMBY for your precious chat logs.

EbNar 3 days ago

This is one of the reasons why I unsubscribed from Gemini Pro, apart from the fact that the experience with Gemini has been frankly underwhelming.

  • whiteboardr 3 days ago

    May I ask where you subscribed instead and why it is better and more secure there?

    • EbNar 3 days ago

      Well, I know it's likely self-delusion, but ChatGPT has an "improve models for everyone" switch event if the history is not switched off. Plus, at least it doesn't forget the context of the chat every 2 messages. For now.

rheisen_ 3 days ago

Friendly reminder that you should take measures to ensure your agentic workflows are secret-blind. E.g. place secrets by reference, check by reference, do NOT have agents read secret sensitive files without redaction measures in place, and be prepared to rotate on contact

ljlolel 3 days ago

it’s all trained. that’s why i made trustedrouter so that it can be end to end encrypted ai chats

frevib 3 days ago

If a company can do something that benefits them, and there is no way the customer can find out or prove that, the company will do it.

okdood64 3 days ago

Aren't they all like that?

  • reasonableklout 3 days ago

    No, most of the products today like Claude Code / Chat allow you to opt-out of training without also disabling important features like chat history.

hosteur 3 days ago

Never trust google.

taspeotis 3 days ago

If it’s not an iPhone it’s … not an iPhone.

jbrooks84 3 days ago

Every AI trains on the input given to it

  • Havoc 3 days ago

    This is false.

    eg Gemini enterprise has a note under each chat session explicitly saying it’s not used to improve the models

  • wat10000 3 days ago

    ZDR policies are a thing. Maybe you can't trust all of them, but when a provider like AWS says it, you can probably believe them. They'd be setting themselves up for an endless stream of massive lawsuits from other large companies if they were lying about it.

    Local models are also a thing. The Qwen 3.8 I'm running on a spare computer is definitely not training on my inputs.

dzonga 3 days ago

we already knew this - google is gonna google - same way they train on your google photos and emails.

tonyhart7 3 days ago

I mean, this is google we talking about

also the same cases for antrophic and open ai

why would anyone trust company that literally need data to improve their product ????

zodwick 3 days ago

why am i not suprised

officeplant 3 days ago

>thinking that having a paid subscription = not being turned into the product

This has never been true in techbro capitalism land. The paying members of a project are even more valuable in your datasets because you want to understand their behavior so you can pull more whales, I mean convert some customers :)

j45 3 days ago

This is a pretty disappointing thing to read.

r_lee 3 days ago

another Google W I guess? gemini really leading the pack over here

StanislavPetrov 3 days ago

We should all be writing bots that constantly spam all of these so-called AIs with random nonsense to poison the well.

  • Aachen 3 days ago

    Ah yes, the poison-the-product-you're-trying-to-use strategy

    • StanislavPetrov 2 days ago

      I don't use crutches, or a wheelchair, or "AI".

      • Aachen a day ago

        But you feel we should be wasting their resources out of spite or what's the idea when you're not even affected?