At the end of July, the CEO of open AI Sam Altman said in his podcast that GPT does not follow privacy rules, and users often use the app for legal advice... so WHAT are the risks here?
“People tell ChatGPT the most personal things from their lives. Young people especially use it as a therapist, as a coach: they share problems in relationships and ask: “what should I do?”
And now, if you talk to a therapist, a lawyer or a doctor, then there is a legal privilege: medical confidentiality, attorney-client privilege, and so on. And for conversations with ChatGPT, we have not yet come up with anything like this.
I think this is very dangerous. We had to ensure the same privacy for conversations with AI as when we are talking to a therapist or a lawyer; and almost no one even thought about this a year ago.”
According to today's algorithms, everything you write in AI can and will be used against you in court.
And if you look at this from the point of view of immigration and jurisprudence in Canada?
Today, AI is widely used not only for everyday issues or correspondence. Many people take it as an "assistant" to write letters on immigration programs, especially humanitarian ones. Moreover, there are "gifted" people who try to consult with artificial intelligence on criminal and administrative cases, in order to argue with a judge or a lawyer, for the sake of saving money, of course, why pay a lawyer if there is a “I-know-everything” chat GPT.
And here is the crucial point: AI is not a lawyer or a consultant. It has neither the right nor the obligation to keep your information confidential. Whereas your representative, by law, does not have the right to disclose your documents until the court (in exceptional cases, for example, in criminal cases) obliges them to do so in the interests of justice.
AI records all your requests. Let's say an applicant asks: "What else should I add so that the officer gives a positive decision on the humanitarian program?" The AI answers: "Write that you were unhappy" or "that your life was in danger". And apparently this request remains recorded. From a legal point of view, this is false information, where you have previously made it clear to the chat that you made it up to win the case.
We do not know how and by whom this data will be used in 2-3 years, when the client’s application will be considered.
And here is the paradox: a person who decides to "go without a lawyer" and entrust their documents to AI, creates the risk that their own words will be used against them.
Always look deeper and analyze the possible consequences.
Now, let’s take a look from a different point of view. Every time you give your personal (financial, work, medical) documents to people who are not legally responsible to properly take care of them, you expose yourself to a great danger!
Firstly, if your specialist is licensed, you know for sure that he/she has no criminal record, no current charges, neither administrative nor bankruptcy, not even delays in child support payments or a bad credit history, because otherwise their LICENSE will be suspended (!!!). And we cannot claim the same about the "great" helpers providing their “services” for a small fee.
Secondly, by passing on your personal information to “unlicensed hands”, you expose yourself to the danger of becoming a victim of a credit scam, an immigration scam, becoming a hostage to the situation and even becoming a victim of blackmail (yesterday you drank a beer, and today you are intimidated that they will cancel your file on your behalf).
Be careful!
Oleksandra Melnykova, Canadian Immigration and Refugee Consultant.
Copyright 2025 «SKI Immigration Inc. »
All rights reserved.
