Sixty-page report exposes how tech giants use exploitative algorithms to prey on vulnerable people and force users to pay for their services with intimate personal data

Digital surveillance ‘is one of the defining human rights challenges of our era’ – Kumi Naidoo

Facebook and Google’s omnipresent surveillance of billions of people poses a systemic threat to human rights, Amnesty International warned in a new report today [21 November].

The 60-page report - Surveillance Giants - lays out how the surveillance-based business models of Facebook and Google allows for mass harvest of users’ data in exchange for the free use of their platforms and uses exploitative algorithms to prey on vulnerable people.

Amnesty is calling on governments to protect citizens from corporate human rights abuses by enforcing robust data protection laws and regulating Big Tech companies in line with human rights law.

Kumi Naidoo, Secretary General of Amnesty International, said:

“Google and Facebook dominate our modern lives – amassing unparalleled power over the digital world by harvesting and monetising the personal data of billions of people. Their insidious control of our digital lives undermines the very essence of privacy and is one of the defining human rights challenges of our era.

“To protect our core human values in the digital age – dignity, autonomy, privacy – there needs to be a radical overhaul of the way Big Tech operates, and to move to an internet that has human rights at its core.”

Paying with personal data

Google and Facebook have established dominance over the primary channels that most of the world – outside of China – relies on to realise their rights online. The various platforms they own – including Facebook, Instagram, Google Search, YouTube and WhatsApp – facilitate the ways people seek and share information, engage in debate and participate in society. Google’s Android also underpins most of the world’s smartphones.

While other Big Tech companies – including Apple, Amazon and Microsoft – have accrued significant power in other areas, it is the platforms owned by Facebook and Google that have become fundamental to how people engage and interact with each other – effectively a new global public square.

The tech giants offer these services to billions without charging users a fee. Instead, individuals pay for the services with their intimate personal data, being constantly tracked across the web and in the physical world as well, for example, through connected devices.

Kumi Naidoo, said:

“The internet is vital for people to enjoy many of their rights, yet billions of people have no meaningful choice but to access this public space on terms dictated by Facebook and Google.

“To make it worse this isn’t the internet people signed up for when these platforms started out. Google and Facebook chipped away at our privacy over time. We are now trapped. Either we must submit to this pervasive surveillance machinery – where our data is easily weaponised to manipulate and influence us – or forego the benefits of the digital world. This can never be a legitimate choice. We must reclaim this essential public square, so we can participate without having our rights abused.”

This extraction and analysis of people’s personal data on such an unprecedented scale is incompatible with every element of the right to privacy, including the freedom from intrusion into our private lives, the right to control information about ourselves, and the right to a space in which we can freely express our identities.

Exploitative algorithms

Google and Facebook’s platforms are underpinned by algorithmic systems that process huge volumes of data to infer incredibly detailed characteristics about people and shape their online experience. Advertisers then pay Facebook and Google to be able to target people with advertising or specific messages.

The Cambridge Analytica scandal exposed how easily people’s data can be misused in unforeseen ways with the aim of manipulating and influencing them.

Kumi Naidoo, said:

“We have already seen that Google and Facebook’s vast architecture for advertising is a potent weapon in the wrong hands. Not only can it be misused for political ends, with potentially disastrous consequences for society, but it allows all kinds of new exploitative advertising tactics such as preying on vulnerable people struggling with illness, mental health or addiction. Because these ads are tailored to us as individuals, they are hidden from public scrutiny.”

A new internet

Amnesty is calling on governments to enact laws to ensure companies including Google and Facebook are prevented from making access to their service conditional on individuals “consenting” to the collection, processing or sharing of their personal data for marketing or advertising. Companies including Google and Facebook also have a responsibility to respect human rights wherever and however they operate.

Kumi Naidoo, said:

“Facebook and Google must not be allowed to dictate how we live online. These companies have chosen a specific surveillance-business model that impacts on privacy, freedom of expression and other human rights. The technology behind the internet is not incompatible with our rights, but the business model Facebook and Google have chosen is.

“Now it is time to reclaim this vital public space for everyone rather than a few powerful unaccountable companies in Silicon Valley.”

Facebook and Google disputed the findings. The companies’ responses are included in the report.