AI-Driven Psychological Profiling on Social Media: Mechanisms, Ethical Breaches, and Regulatory Challenges in Data Inference


Year : 2025 | Volume : 02 | Issue : 01 | Page : 1-7
    By

    Evan Bose,

  • Chaitanya Anil Kumar,

  • Meenakshi N.,

  1. Student, Department of Psychology, Bangalore University, Bangalore, Karnataka, India
  2. Student, Department of Psychology, Bangalore University, Bangalore, Karnataka, India
  3. Assistant Professor, Department of Psychology, Bangalore University, Bangalore, Karnataka, India

Abstract

This literature review examines AI-driven psychological profiling on social media, analyzing 21 academic studies that focus on machine learning techniques such as supervised learning, deep neural networks, sentiment analysis, and natural language processing. These methodologies infer mental health indicators—such as depression, anxiety, and stress—from users’ digital footprints, encompassing linguistic patterns, engagement metrics, and temporal behaviors. While these tools offer potential for early detection of psychological distress, they also raise significant ethical concerns. Key issues include the absence of explicit informed consent, lack of transparency due to algorithmic opacity, data minimization challenges, and the risk of bias amplification. The study critically assesses how biases in training data can disproportionately impact underprivileged populations, resulting in unfair access to interventions and distorted profiling results. The effects of AI-based profiling on autonomy and stigmatization of mental health are also examined. The assessment also emphasizes the absence of worldwide uniformity in regulatory methods and criticizes current legislative frameworks, such as the CCPA and GDPR, which provide scant protections for inferred psychometric data. It suggests multidisciplinary frameworks to improve data sovereignty, privacy, and accountability while promoting more robust enforcement and public monitoring. The review’s conclusion highlights the necessity of long-term study and teamwork to fill up knowledge gaps in algorithmic accountability and ethical governance.

Keywords: AI ethics, psychological profiling, algorithmic opacity, mental health, legal protections.

[This article belongs to Recent Trends in Social Studies ]

How to cite this article:
Evan Bose, Chaitanya Anil Kumar, Meenakshi N.. AI-Driven Psychological Profiling on Social Media: Mechanisms, Ethical Breaches, and Regulatory Challenges in Data Inference. Recent Trends in Social Studies. 2025; 02(01):1-7.
How to cite this URL:
Evan Bose, Chaitanya Anil Kumar, Meenakshi N.. AI-Driven Psychological Profiling on Social Media: Mechanisms, Ethical Breaches, and Regulatory Challenges in Data Inference. Recent Trends in Social Studies. 2025; 02(01):1-7. Available from: https://journals.stmjournals.com/rtss/article=2025/view=194193


References

  1. Uhlenbusch N, Löwe B, Härter M, Schramm C, Weiler-Normann C, Depping MK. Depression and anxiety in patients with different rare chronic diseases: A cross-sectional study. PloS one. 2019 Feb 20;14(2): e0211343.
  2. Ramon Y, Farrokhnia RA, Matz SC, Martens D. Explainable AI for psychological profiling from behavioral data: An application to big five personality predictions from financial transaction records. Information. 2021 Dec 13;12(12):518.
  3. Thieme A, Hanratty M, Lyons M, Palacios J, Marques RF, Morrison C, Doherty G. Designing human-centered AI for mental health: Developing clinically relevant applications for online CBT treatment. ACM Transactions on Computer-Human Interaction. 2023 Mar 17;30(2):1-50.
  4. Wang B. Psychological AI: A critical analysis of capabilities, limitations, and ramifications. Applied and Computational Engineering. 2024 Mar 28; 53:205-12.
  5. Thakkar A, Gupta A, De Sousa A. Artificial intelligence in positive mental health: a narrative review. Frontiers in Digital Health. 2024 Mar 18; 6:1280235.
  6. Zhou S, Zhao J, Zhang L. Application of artificial intelligence on psychological interventions and diagnosis: an overview. Frontiers in Psychiatry. 2022 Mar 17; 13:811665.
  7. Ahmed A, Agus M, Alzubaidi M, Aziz S, Abd-Alrazaq A, Giannicchi A, Househ M. Overview of the role of big data in mental health: A scoping review. Computer Methods and Programs in Biomedicine Update. 2022 Jan 1; 2:100076.
  8. Garcia-Ceja E, Riegler M, Nordgreen T, Jakobsen P, Oedegaard KJ, Tørresen J. Mental health monitoring with multimodal sensing and machine learning: A survey. Pervasive and Mobile Computing. 2018 Dec 1; 51:1-26.
  9. Jeyaraman M, Balaji S, Jeyaraman N, Yadav S. Unraveling the ethical enigma: artificial intelligence in healthcare. Cureus. 2023 Aug;15(8).
  10. Lee EE, Torous J, De Choudhury M, Depp CA, Graham SA, Kim HC, Paulus MP, Krystal JH, Jeste DV. Artificial intelligence for mental health care: clinical applications, barriers, facilitators, and artificial wisdom. Biological Psychiatry: Cognitive Neuroscience and Neuroimaging. 2021 Sep 1;6(9):856-64.
  11. Graham S, Depp C, Lee EE, Nebeker C, Tu X, Kim HC, Jeste DV. Artificial intelligence for mental health and mental illnesses: an overview. Current psychiatry reports. 2019 Nov; 21:1-8.
  12. Alowais SA, Alghamdi SS, Alsuhebany N, Alqahtani T, Alshaya AI, Almohareb SN, Aldairem A, Alrashed M, Bin Saleh K, Badreldin HA, Al Yami MS. Revolutionizing healthcare: the role of artificial intelligence in clinical practice. BMC medical education. 2023 Sep 22;23(1):689.
  13. Kong Y, Ding H. Tools, Potential, and Pitfalls of Social Media Screening: Social Profiling in the Era of AI-Assisted Recruiting. Journal of Business and Technical Communication. 2024 Jan;38(1):33-65.
  14. Ienca M, Malgieri G. Mental data protection and the GDPR. Journal of Law and the Biosciences. 2022 Jan;9(1): 1-06.
  15. Peters H, Matz SC. Large language models can infer psychological dispositions of social media users. PNAS nexus. 2024 Jun;3(6): page 31.
  16. Varsha PS. How can we manage biases in artificial intelligence systems–A systematic literature review. International Journal of Information Management Data Insights. 2023 Apr 1;3(1):100165.
  17. Sullivan Y, de Bourmont M, Dunaway M. Appraisals of harm and injustice trigger an eerie feeling that decreases trust in artificial intelligence systems. Annals of Operations Research. 2022 Jan; 308:525-48.
  18. Gerke S, Minssen T, Cohen G. Ethical and legal challenges of artificial intelligence-driven healthcare. InArtificial intelligence in healthcare 2020 Jan 1 (pp. 295-336). Academic Press.
  19. Hummel P, Braun M, Tretter M, Dabrock P. Data sovereignty: A review. Big Data & Society. 2021 Jan;8(1):2053951720982012.
  20. Olawade DB, Wada OZ, Odetayo A, David-Olawade AC, Asaolu F, Eberhardt J. Enhancing mental health with Artificial Intelligence: Current trends and future prospects. Journal of medicine, surgery, and public health. 2024 Apr 17:100099.
  21. Raman R, Pattnaik D, Hughes L, Nedungadi P. Unveiling the dynamics of AI applications: A review of reviews using scientometrics and BERTopic modeling. Journal of Innovation & Knowledge. 2024 Jul 1;9(3):100517.
Regular Issue Subscription Review Article
Volume 02
Issue 01
Received 19/11/2024
Accepted 17/12/2024
Published 15/01/2025
Total Visits: 156


Loading citations…

PlumX Metrics