Chinese Surveillance and AI

New report: “The Party’s AI: How China’s New AI Systems are Reshaping Human Rights.” From a summary article:

China is already the world’s largest exporter of AI powered surveillance technology; new surveillance technologies and platforms developed in China are also not likely to simply stay there. By exposing the full scope of China’s AI driven control apparatus, this report presents clear, evidence based insights for policymakers, civil society, the media and technology companies seeking to counter the rise of AI enabled repression and human rights violations, and China’s growing efforts to project that repression beyond its borders.

The report focuses on four areas where the CCP has expanded its use of advanced AI systems most rapidly between 2023 and 2025: multimodal censorship of politically sensitive images; AI’s integration into the criminal justice pipeline; the industrialisation of online information control; and the use of AI enabled platforms by Chinese companies operating abroad. Examined together, those cases show how new AI capabilities are being embedded across domains that strengthen the CCP’s ability to shape information, behaviour and economic outcomes at home and overseas.

Because China’s AI ecosystem is evolving rapidly and unevenly across sectors, we have focused on domains where significant changes took place between 2023 and 2025, where new evidence became available, or where human rights risks accelerated. Those areas do not represent the full range of AI applications in China but are the most revealing of how the CCP is integrating AI technologies into its political control apparatus.

News article.

Tags: AI, censorship, China, human rights, privacy, reports, surveillance

Posted on December 16, 2025 at 7:02 AM • 20 Comments

Comments

Winter • December 16, 2025 7:59 AM

The demographic future is in the continent of Africa. Africa are currently receiving their Information and Computer Technology and Infrastructure largely from China.

Understandable as, regarding Africa, the US and Europe are mainly concerned with extractive commerce, bulk agricultural products, and raw materials.

Chinese repressive technology and AI will be rooted deeply in Africa for decades to come.

Clive Robonson • December 16, 2025 10:21 AM

@ Bruce, ALL,

With regards the quote opener,

“China is already the world’s largest exporter of AI powered surveillance technology; new surveillance technologies and platforms developed in China are also not likely to simply stay there.”

Technically this is not quite correct, but practically it does not make any difference apart from actually the US, UK and other Five-Eyes are “already the world’s largest” when it comes to “surveillance technology” and have been through out the Cold War and upto today.

Where China has scored big is “Fast Moving Consumer Electronics”(FMCE) that has Internet Connectivity.

So Consumer electronics like security and home control tech, likewise TV’s, IoT and more recently your fridge, cooker and other kitchen appliances. Oh and don’t forget anything that has an app on your mobile device (including toys in bedrooms etc).

They devices talk to Amazon or China, and the Five-Eyes get it all.

But the thing is they are the sensors not the AI, it’s a difference that is lost on most people, untill you talk about “Client Side Scanning” that “searches for specifics”.

But moving on,

“Examined together, those cases show how new AI capabilities are being embedded across domains that strengthen the CCP’s ability to shape information, behaviour and economic outcomes at home and overseas.”

Take CCP out and insert US or EU in there and it would be just as true, but less talked about in the MSM.

In the UK and Australia and other Western Nations is the “think of the children” “PAPERS NOW” of Age Control systems.

The fact is I and others have been warning that Current AI LLM and ML systems are in effect “Surveillance 3.0” as part of Web3.0 etc.

You only have to look at the madness coming out of Palantir to see that we are being pushed down a slope into “Surveillance Hell” as fast as politicians can pass the legislation.

The fact too many people have “warm cuddly feelings” about Current AI actually scares me way more than just about anything else in society.

Unless we pull the plug on Current AI and the new systems arising and the get rich quick idiots behind it, we will have no Privacy, thus Society as we know it.

Wannabe Techguy • December 16, 2025 4:26 PM

Clive, even though I’ve been reading some of your comments here for years, I’m still surprised that a tech professional like yourself would write those last two paragraphs. So,it’s not just an “old guy”(I’m 63) like me that is concerned.
I get laughed at regularly because I don’t own a “smart” phone. Hah!

KC • December 16, 2025 5:39 PM

It’s interesting how the definition of ‘AI safety’ diverges between China and liberal democracies.

In China, ‘AI safety’ overwhelmingly serves the state rather than the individual. The largest segment of attended AI risk relates to violations of core socialist values, eg, criticism of the CCP, terrorism, etc.

Liberal democracies conceive of ‘AI safety’ as protecting people and institutions from harm, though often falling short. Harms can and do emerge as ‘unintended by-products of weak oversight, commercial incentives or policy inertia.’

As a topic covered in Chapter 1, the reader might find it interesting how LLMs from different ecosystems describe the same image differently. Check out four examples starting on page 71; you may observe omissions or careful reframings.

To me of most critical note are the Policy Recommendations on pages 63 to 66.

Some of these include establishing transparency standards for public procurement, the right to audit, and so on.

XYZZY • December 16, 2025 5:41 PM

Freedom from surveillance is an unrecognized human right. A subset of which is freedom from data aggregation and correlation to subvert privacy. IMHO

Winter • December 17, 2025 7:56 AM

@KC

In China, ‘AI safety’ overwhelmingly serves the state rather than the individual.

This is often misunderstood as being somehow about the “security” of the population. It is not.

For simplicity, the world’s politics can be divided into two camps:

The people select their government
The government select their people

Camp 1. is what we call Democracies, exemplified by “The West”, with “Europe” as the principle advocate. If there is a dispute between the population and the government, the government goes out.

Camp 2. is authoritarianism/fascism exemplified by China and Russia. Camp 2. is characterized by ethnic/religious cleansing or genocide of various forms [1], and internment camps for “nonconformists” under any name. If there is a dispute between the population and the government, the population goes out [2].

The current leadership of China and Russia are on the record about who they consider to be their subjects and who they consider unfit to be alive as their subjects.

Extrapolations to other governments and politicians are left as an exercise for the reader.

[1] Ethnic cleansing and genocide are for all practical purposes the same, as driving out masses of people cannot be done without lethal force.

[2] See the actions of the former Syrian government during the civil war and the actions of the current Russian government wrt Ukrainians. The activities of the Chinese government against Uighurs is also in this category.

Ray Dillinger • December 17, 2025 2:04 PM

Why is nobody talking about the fact that China – currently the leader in AI analysis of bulk data for purposes at best unrelated to privacy and human rights – is also the home of the companies that own and operate all the VPN’s that people are using in hope of achieving privacy and/or human rights?

Or the fact that every company that does the bulk of its business on the Internet in China must, by law, give the CCP real-time access to their data streams and logs? I think that a VPN provider meets the definition of a company that does the bulk of its business on the Internet.

I also think that the fees people pay for this service are not sufficient for companies to make a profit providing it. If the fees people pay for this service were sufficient for companies to make a profit providing it then there would be VPN’s operated from many different nations. Therefore companies operating VPN’s in China are likely to have revenue from an additional source.

I think it’s fairly obvious what that source must be.

Why does nobody seem to care?

Winter • December 17, 2025 4:41 PM

@Ray Dillinger

Why is nobody talking about the fact that China – currently the leader in AI analysis of bulk data for purposes at best unrelated to privacy and human rights – is also the home of the companies that own and operate all the VPN’s that people are using in hope of achieving privacy and/or human rights?

Please, be more specific. Which companies and how are they subject to Chinese law and oversight?

jelo 117 • December 17, 2025 8:16 PM

So those (h)arping on “routes around damage” are retailing a bit of a myth. Your only chance if your topology is or can be made bad is to get a new topology.

ResearcherZero • December 18, 2025 12:42 AM

DHS is using AI in the surveillance, immigration and law enforcement supply chain.
These systems effectively deny people the right to see what information was used and how decisions were made, preventing proper review, or scrutiny of any deliberate misconduct.

‘https://www.dhs.gov/ai/use-case-inventory/ice

AI systems are used to screen, track, write reports, process applications and deny asylum
https://www.visaverge.com/immigration/new-ai-tech-could-be-used-for-immigration-enforcement-risks-and-reach/

The Trump administration wants to strip citizenship from those who entered the US legally.
https://www.nytimes.com/2025/12/17/us/politics/trump-immigration-citizenship-denaturalization.html

After having declared Venezuela unsafe, Trump then removed protections for Venezuelans.
https://www.cbsnews.com/news/supreme-court-trump-temporary-protected-status-venezuelans/

ResearcherZero • December 18, 2025 1:27 AM

@Clive Robinson, Winter, Bruce

The Coalition has demanded that the Electronic Surveillance Bill be immediately passed and implemented, which would give more agencies the right to access retained data and greater powers to agencies to issue surveillance, electronic device and network activity warrants.

Politicians won’t waste any opportunity to ramp up surveillance and censorship efforts.

‘https://www.liberal.org.au/2025/12/18/coalition-calls-for-urgent-laws-to-combat-antisemitism-and-terror

The Electronic Surveillance Bill would expand the range of activities and reasons for granting law enforcement powers to surveil groups of people and individuals, seize devices and conduct operations to access network activity, communications and electronic device.

There are interesting points to note under Schedule 4 – International Production Orders

“establishing this capability would require significant technical investment by both Australian agencies and the US providers”

…and Schedule 3 – Development or testing of technologies for interception capabilities

Schedule 3 provides cover to develop carrier interception capability, test products and access data through application to the authorizing body to avoid any legal ramifications.

Notably Schedule 5 would allow for officers and civilians to engage in criminal schemes. They would not be held responsible for any indirect harm that occurred as a result of their actions if it could not be reasonably foreseen by those responsible. This section allows for covert actions and a range of other activities to conduct surveillance activities.

https://www.aph.gov.au/Parliamentary_Business/Bills_Legislation/bd/bd2526/26bd017

ResearcherZero • December 18, 2025 3:56 AM

@Winter

Western organisations helped lend a hand in developing these surveillance technologies with partnerships, funding and joint collaboration with the Chines Ministry of Public Security.

India could solve its AI surveillance needs with a bunch of these Chinese AI systems.

‘https://www.hindustantimes.com/ht-insight/future-tech/why-india-s-cctv-cameras-need-ai-to-actually-fight-crime-101765620209885.html

Large scale deployment of smart IP cameras will allow real-time intelligence gathering.
https://www.gizmochina.com/2025/12/10/qualcomm-acquires-augentix/

The Third Research Institute of the Ministry of Public Security has developed a range of advanced AI surveillance tools. Western institutions including Department of Defense funding and universities assisted the Third Research Institute with project development.

The surveillance tools include AI tracking of groups and individuals using encrypted messaging platforms such as Telegram, behavioral analysis to detect suspicious shopping patterns, or actions that might indicate preparations to conduct violence or law breaking.

Other tools are designed to assist with interrogation of suspects and sifting through data.

https://hrf.org/latest/hrf-sponsored-research-reveals-western-funding-ties-to-chinas-state-backed-ai-labs/

Implications of Russia-India-China Trilateral Cooperation

‘https://assets.recordedfuture.com/insikt-report-pdfs/2025/ta-cn-2025-1210.pdf

Clive Robinson • December 18, 2025 6:01 AM

@ ResearcherZero, ALL,

The thing that really worries me is,

“Schedule 5 would allow for officers and civilians to engage in criminal schemes”

Historically such notions were allowed by two methods,

1, Letters Patent.
2, Turning Kings Evidence.

Neither of which are formally allowed in most jurisdictions.

Which is why we now have loosely worded “National Security” phrases in so much legislation and regulation. Which is why a specific exemption is so greatly concerning.

In short it’s an “indicator of intent” to very deliberately take up such actions as an increasingly default behaviour by authorities.

Whilst they are currently using the “dog whistle” example of CSAM, as we all should know by now this is just to block reasonable argument against such provisions. Then once the act is passed as we’ve seen so many times “the scope” will increase like a virulent pestilence, that could touch anyone as the rats scurry.

jelo 117 • December 18, 2025 12:41 PM

@ moderator

Please move

https://www.schneier.com/blog/archives/2025/12/chinese-surveillance-and-ai.html/#comment-450710

to the thread

https://www.schneier.com/blog/archives/2025/12/deliberate-internet-shutdowns.html

369 • December 18, 2025 6:10 PM

One in three using AI for emotional support and conversation, UK says
https://www.bbc.com/news/articles/cd6xl3ql3v0o

‘One in three adults in the UK are using artificial intelligence (AI) for emotional support or social interaction, according to research published by a government body.

And one in 25 people turned to the tech for support or conversation every day, the AI Security Institute (AISI) said in its first report.

A survey by AISI of over 2,000 UK adults found people were primarily using chatbots like ChatGPT for emotional support or social interaction, followed by voice assistants like Amazon’s Alexa.

The researchers found when the chatbots went down, people reported self-described “symptoms of withdrawal”, such as feeling anxious or depressed – as well as
having disrupted sleep or neglecting their responsibilities.

AI systems were also beginning to complete expert-level cyber tasks which would
typically require over 10 years of experience.

Researchers also found the tech’s impact in science was also growing rapidly.

In 2025, AI models had “long since exceeded human biology experts with PhDs –
with performance in chemistry quickly catching up”.

In May, AI firm Anthropic released a controversial report which described how an AI model was capable of seemingly blackmail-like behaviour if it thought its
“self-preservation” was threatened.’

ResearcherZero • December 19, 2025 12:21 AM

@Clive Robinson, ALL

They have very similar laws in the UK which allow all of the very same activities.

Schedule 7 allows anyone to be stopped and search without suspicion. Agencies can request anyone to be stopped and handed over. The powers then allow officers to detain anyone for interrogation. Refusing to answer questions, or refusing to hand over passwords to devices can result in jail time and people have been charged and convicted for refusing to do this.

Anyone stopped can be ordered to hand over electronic devices, memory cards, bank cards and accompanying passwords. DNA swabs and fingerprints can be taken, data can be retrieved from devices without the owner’s knowledge and the devices can be held as long as deemed fit to undergo forensic analysis. Schedule 7 operates as part of the UK’s secret Phantom Parrot program to target persons of interest to the government. The laws have been normalised and used for routine policing matters and to target people for deportation attempts.

Journalists, lawyers and human rights workers have been detained and interrogated and activists sentenced to prison. A 78 year old woman was jailed under the Terrorism Act 2000 for involvement in unfurling a banner at an anti oil protest.

‘https://www.libertyhumanrights.org.uk/advice_information/examined-under-schedule-7-of-the-terrorism-act-2000-what-are-my-rights/

Updates to the Terrorism Act of 2000
https://www.legislation.gov.uk/ukpga/2000/11/schedule/7

ResearcherZero • December 19, 2025 1:02 AM

@Clive Robinson, ALL

The scope is indeed increasing like a virulent pestilence and currently there are a number of politicians using inflammatory language, accusing others of being “weak” and demanding the immediate rapid expansion of laws to scrutinize backgrounds and citizenship in what they refer to as a “radical response”. Dividing people is often used to bring in laws that can then be rapidly expanded to encompass everyone. Behind the scenes this is happening.

If you want to crush and silence any dissent, then everyone must be under suspicion. The cleaner might be a secret spy for the Communist Party. So might be the generals too! This does have the effect of creating an environment ripe for corruption, infiltration and defection, but to solidify executive power, a completely dysfunctional national security apparatus is just one of the costs that a nation must pay. Stalin didn’t achieve his vision in a single day. To completely f–k every institution took almost as much time as filling the Gulags. The scope must be continually widened to maintain the flow, suspicion and fear.

The Trump administration has a new measure for secret preemptive law enforcement actions.
Anyone can be targeted under the executive order using methods that are classified. 😉 😉

Similar laws exist in the UK under the Terrorism Act, though the new measures implemented in the US go even further. These methods will include those used against organized crime groups such as the methods used by task forces to combat mafia groups and designated terrorist organisations. Pam Bondi has ordered law enforcement and FBI to begin looking for people to investigate based on their beliefs and ideology who might be of interest.

‘https://theconversation.com/labeling-dissent-as-terrorism-new-us-domestic-terrorism-priorities-raise-constitutional-alarms-269161

Veteran Affairs will be investigated and citizenship checked to detect foreign workers.
https://www.stripes.com/veterans/2025-12-05/va-employees-not-us-citizens-19993467.html

ICE employees will be subjected to increased surveillance and investigated for signs of dissent. The administration is also ramping up investigation methods to detect leaks.

https://www.wired.com/story/ice-seeks-cyber-upgrade-to-better-surveil-and-investigate-its-employees/

lurker • December 19, 2025 4:42 AM

Maybe it’s time I took another research trip to China. Last time I was there I was apprehended several times, and my devices examined, and sometimes photos deleted, by the Railway Police. These are a completely separate outfit from the Public Security Bureau, who were always very polite and never bothered about my electronics. The Railway Police each have their own rules within their own patch. Ten years ago they were all using old-fashioned manual methods, some even still applying Soviet era interpretations of the law. Now that the High Speed network covers the whole country they might have been dragged into the 21st century.

Rontea • December 19, 2025 10:46 AM

To be watched without end is to be exiled from oneself. In China, surveillance has become a philosophy disguised as progress, and artificial intelligence its most zealous disciple. They have automated suspicion, turned existence into a ledger of compliance, and confused total awareness with control. What irony—that in trying to script the collective soul, they have only proven the futility of owning even a single thought. In the end, the cameras do not protect the state from chaos; they merely reflect its fear, multiplied into infinity.

lurker • December 19, 2025 7:56 PM

@Rontea
“In China, surveillance has become a philosophy disguised as progress…”

In China, surveillance has been a philosophy for millenia. From the rise of the Rule of Law in the late Warring States period, as “the all-powerful instrument which makes it possible to guide everyone’s activity in the direction most favourable to the power of the state and the public peace.”[1]
through the baojia system of the Song dynasty a thousand years later, where households were divided into groups of ten, each expected to spy on their neighbours;
to the 20th century Kuomintang Blue Shirts:
State surveillance of the population has been a fact of life in China.

Nobody should be surprised that the present Chinese government is continuing this tradition, or that they are using the best modern technology to do so.

[1] Jacques Gernet, A History of Chinese Civilization

Chinese Surveillance and AI

Comments

Leave a comment Cancel reply