Editorial 2:  Scam space

Context

Fraudulent content should be actively detected and removed by social media platforms.

Introduction

The rise of AI-generated deepfakes and cryptocurrency fraud poses serious challenges to the digital economy. Cases like a Hyderabad investor losing ₹20 lakh illustrate how scammers exploit technical illiteracy, regulatory gaps, and passive social media monitoring. With smartphone penetration high but awareness low, continuous public education, government regulation, and platform accountability are crucial to protect citizens.

Vulnerabilities in the Digital Economy

• Policing digital scams requires substantial resources due to their complexity and cross-border nature.
• Hyderabad Case Study: A retired doctor lost over ₹20 lakh after a deepfake Instagram video appeared to show Finance Minister Nirmala Sitharaman endorsing an investment scheme.
• Scam tactics exploit:
  • AI-generated deepfakes featuring public figures
  • Limited technical literacy of users
  • Regulatory gaps in cryptocurrency trading
  • Passive social media monitoring
• Many users are lured by promises of quick profits and fabricated gains, reporting complaints only after withdrawals fail.
• Scams often operate via foreign platforms and complex wallet chains, disappearing overnight.

Role of Social Media Platforms

• Platforms like Instagram provide advisories and reporting mechanisms, but often respond passively.
• Policies focus on user self-protection rather than proactive detection, allowing scams to circulate long enough to entrap victims.
• Challenges:
  • Scale of global content slows manual review
  • Automated systems struggle to detect manipulated videos
  • Platforms avoid intrusive monitoring to maintain user engagement and profits
• Result: deepfake scams are treated as individual incidents rather than systemic vulnerabilities

Recommended Measures

• Government Action:
  • Define standards for registration, disclosure, and cross-border cooperation
  • Limit operational space for fraudulent schemes
• Technical Literacy:
  • Treat as a public policy priority
  • Integrate continuous awareness efforts into educational institutions
• Social Media Accountability:
  • Require proactive removal of fraudulent content
  • Strengthen monitoring and detection systems
• Without these measures, deepfake scams will continue to impose high human and material costs.

Conclusion

Deepfake and crypto scams highlight systemic vulnerabilities in the digital ecosystem, causing financial loss and eroding trust. Effective mitigation requires regulatory clarity, enhanced technical literacy, and proactive content removal by social media platforms. Without these measures, fraudsters will continue to exploit cross-border loopholes, resulting in significant human, economic, and reputational costs.