DIGITAL EXTREMISM
WHY do we need a strategy
There are indications that the rising tide of extremist, violent
AND DANGEROUS
material and ideologies, along with potentially harmful
National Counter
Christchurch
Terrorism Strategy
Call
disinformation is becoming a ‘hard problem’ that is beyond the
DISINFORMATION
capabilities of government agencies alone to fix.
Real progress demands an integrated strategy – so we can co-
STRATEGY
ordinate efforts across not just government agencies, but also
incorporate the efforts of digital platforms, mainstream media
organisations and community groups while supporting and
engaging the public.
COORDINATED
Answering the call:
RESPONSE
A strategy to disrupt violent
New Zealand
We have been uniquely impacted by the ‘weaponisation’ of social
extremist content and dangerous
media and the viral propagation of extremist and abhorrent
disinformation
material. The livestream broadcast of the mosque attacker’s acts
Digital Extremism
and Dangerous
Public information
on March 15 exploded across all major internet platforms and
Disinformation
and education
was viewed by many thousands of New Zealanders – both adults
interventions
Preventing extremist attacks is traditionally considered
Strategy
and children.
through a law enforcement and prevention lens as well as
In the COVID-19 environment, the available evidence suggests
a national security perspective (critical for
there has been an increase in engagement with extremist
content and potentially dangerous disinformation. A significant
countering organised terror groups such
number of cell towers have been subject to attacks in NZ –that
as ISIS). Post Christchurch, the need for
Freedom and democracy first:
appear to be correlated with a rise in conspiracy theories linking
greater international collaboration and
5G with the pandemic.
TRIBUTE
the importance of having governments
‘Designing in’ Bill of Rights protections to get the
balance right.
and digital industry working together
Globally
at a national/industry level to address/
Countering digital content harms is inherently complex and
challenging, as the cyber environment is vast and ever changing (there
The ‘livestream video’ and ‘Great Replacement ’ documentation
prevent distribution of viral, extremist
are 500 hours of fresh video content put on YouTube per minute).
from the March 15 attacks have been referenced in at least five
material resulted in the unprecedented
Determining what is ‘dangerous disinformation’ as opposed to
subsequent lethal, racially motivated attacks around the world.*
Christchurch Call initiative.
legitimate free expression is challenging.
Internet analysts worldwide are observing that levels of extremist
DRAFT
T DIS
Even seriously disturbing footage of a violent death can have important
content created, exchanged and distributed on the internet are
A national digital extremism and
social value or can support just outcomes. It is vitally important that
climbing since the onset of the pandemic.
dangerous disinformation strategy is
citizens can openly engage with and debate ideas and issues of all
Threats are being identified from new groups, often
needed to support and reinforce these
kinds. In order to navigate this complex space,
key principles must be
domestically-based and which do not fit traditional profiles
pillars, while providing an opportunity for
‘designed in’ to any policy/major operational change:
and models of operation for terrorist organisations. These new
challenges demand new ways of thinking, connecting and
national state, industry and community
• Freedom of expression
mobilising government, industry and the community.
groups to work together to address these
• Privacy
serious and growing threats.
• Transparency
• Evidence-led
• Harm prevention
DO NO
THE ONLINE HARM PREVENTION GROUP (OHPG)
DIA
NETSAFE
Police
CERT
EDUCATION
INTERNET NZ
PRIVACY
NETWORK 4
COMMISSIONER
LEARNING
Strategy – key elements
The Digital ‘Rabbit Hole’
Regulate
Coordinate
Current reviews of hate speech legislation and
Having an integrated strategy to deal with
amendment of the FVPCA can be used to help
complex online issues like digital disinformation
TRIBUTE reinforce and build awareness of a modern,
and extremist content is vital. The OHPG represents
It is increasingly evident that online platforms can play a significant role
effective strategy. Further regulation
a unique coalition of departments, agencies
DRAFT
T DIS
in developing radicalised attitudes and distributing promotional extremist
can be designed to connect with a
and NGO’s with insight, responsibility
videos and literature.
modern, evidence-led approach
and relationships to build and drive
to the digital word.
a truly comprehensive strategy,
DO NO
Regulate
Coord
While we have seen terror groups such as ISIS previously use digital platforms and social
in
leveraging relationships with and
a
media in very sophisticated ways, now new groups including extreme white nationalist
te
understanding of digital industry
as well as global partners.
organisations are evolving the same tactics. A feature of the new digital environment is
Activate
A
the highly decentralised, digital–savvy aspects of these groups, who are highly capable in
Social media companies and
ct
adopting/leveraging fears (such as those related to the COVID-19 pandemic) to propagate
digital platforms are central
i
Educate
va
Overseas experience
hate and violent ideology.
to the success of any moves
te
in this area – integrating them
indicates that education can
Modern ‘digital extremists’ are highly aware of the mechanics of the ‘rabbit hole’ staying just
into a planned set of staged
be a key means of building
Educate
within the terms of use of big platforms such as YouTube and Facebook in order to reach wide
interventions to help establish a
resilience to disinformation/
Ev
extremism in young people. And
audiences, some of whom progress to less moderated and more extreme platforms (like
more open, safer, transparent and
aluate
good, trusted information can be
8chan/kiwi farms) and potentially then to encrypted ‘cells’.
less hate-filled internet.
the best antidotes for all ages.
A key benefit in understanding the ‘rabbit hole’ means that we can start to see holistically how
Evaluate
different techniques can disrupt the flow down the hole at different stages; good informative
Evidence-led policy is essential in this area. The understanding
and accurate public information can disrupt the uptake of disinformation and how other levers
of what needs to be researched and evaluated is beginning
can operate at different stages.
to emerge. We can devise and execute research to properly
inform solutions tailored for NZ.
INTERVENTIONS
The Rabbit Hole
EXECUTION – FIRST STEPS
There are a range of known interventions that can help
TRIBUTE
counter misinformation and disrupt the flow towards
1. COORDINATE
extremist material.
Twitter
The OHPG is well placed to coordinate and communicate an approach
Broadcast news
CLEAR PUBIC INFORMATION can help counter
reflected in the digital strategy. It could work with key stakeholders,
Initiation
Facebook
disinformation and harmful narratives.
industry and community groups and could align with existing work/
Mainstream and
strategies.
social media
YouTube
COMMUNITIES can rally online groups and narratives.
Reddit
Inquiry
EDUCATORS can help build digital literacy and critical skills to
DRAFT
Subreddits
2. EDUCATE
T DIS
Chans and
inoculate against propaganda and manipulation.
closed groups
4chan
Research is being gathered on current concerns in the education sector
Advocacy
Private groups
DIGITAL PLATFORMS can effectively police themselves to
around disinformation – this can in turn help inform support/modules
limit the propagation of hate and deplatform violent extremists.
8kun Pol
Hate sites
Kiwi Farms
NGO’S AND COUNTER HATE GROUPS can identify
Mobilisation
3. EVALUATE
The Daily Stormer
extremists ‘lurking in plain sight’ and call out emerging
DIA is undertaking NZ Research (ISD) and the Classification Office is
dangerous and violent ideologies.
scoping a National Survey. Work with industry research and academics
Action
Terror
Encrypted services
CROWN ENTITIES can monitor, research, report and in some
could be coordinated to develop a coherent evidence base.
cells
Dark Net
cases classify material as restricted or unlawful.
ENFORCEMENT AGENCIES such as Police, DIA can help
4. ACTIVATE
develop more sophisticated tools such as take-down notices,
Radicalised Extremist
Set up an inter-agency group with responsibility for developing strategy
digital filters, nudge notifications and contact research.
further and building networks.
DO NO
LAW ENFORCEMENT/STATE SECURITY can play their
traditional prevention and security roles, while being informed
5. REGULATE
by and in turn informing the broader collaborative effort.
One opportunity is progressing the CVE Bill. Hate speech law reforms
could also be coordinated through an integrated approach. Further
relevant work can be coordinated under a general media review.
