AI blind spots in recruitment, hidden discrimination and quantitative detection methods

A.I. Novitskaya

Abstract


This article addresses the problem of hidden discrimination in AI‑based recruitment systems. The widespread adoption of automation and artificial intelligence in hiring increases the speed and scale of candidate selection but also contributes to the replication of historical inequalities, a problem that is particularly critical for small and medium‑sized enterprises (SMEs) with limited resources for model auditing. The literature lacks reproducible, applied protocols that are suitable for use in closed SaaS systems and under constrained access to logs. The aim of the study is to develop and empirically validate a practice‑oriented protocol for the quantitative detection and mitigation of algorithmic bias in personnel selection systems that is compatible with SME capabilities. The methodology combines controlled résumé‑pair tests (résumé audit testing), input–output analysis of models, statistical and decision‑tree methods for identifying proxy features, the use of fairness metrics (Disparate Impact, Equal Opportunity Difference, calibration across groups), and iterative corrective procedures (blind preprocessing, feature revision, adjustment of training distributions, and monitoring). Empirical validation demonstrated that applying the proposed set of measures consistently reduces key discrimination metrics with minimal degradation of selection accuracy and throughput; it also identified the most influential proxy features and proposed threshold criteria for triggering corrective actions. The results formalize a step‑by‑step guide for SMEs and a set of simple monitoring tools suitable when access to system logs is limited. The contribution of the study is a practical, reproducible methodology for auditing and correcting AI in recruitment that balances efficiency and fairness and is suitable for implementation under resource constraints. The proposed approach includes recommendations for regular validation, model version documentation, staff training, and integration of explainable AI modules; its adoption reduces legal and reputational risk and increases candidate trust. Further research should evaluate the protocol’s transferability across industries and regions and develop automated tools for proxy‑feature detection.

Full Text:

PDF (Russian)

References


Ali, O., & Kallach, L. (2024). Artificial Intelligence Enabled Human Resources Recruitment Functionalities: A Scoping Review. Proceedings of the 5th International Conference on Industry 4.0 and Smart Manufacturing, pp. 3268–3277.

Bar-Gil, O., Ron, T., & Czerniak, O. (2024). AI for the people? Embedding AI ethics in HR and people analytics projects. Technology in Society, 77: 102527.

Barocas, S., & Selbst, A. D. (2016). Big Data's Disparate Impact. California Law Review, 104, 671–732.

Buolamwini, J., & Gebru, T. (2018). Gender Shades: Intersectional Accuracy Disparities in Commercial Gender Classification. Proceedings of FAT* 2018.

Delecraz, S., Eltarr, L., Becuwe, M., Bouxin, H., Boutin, N., & Oullier, O. (2022). Responsible Artificial Intelligence in Human Resources Technology: An innovative inclusive and fair by design matching algorithm for job recruitment purposes. Journal of Responsible Technology, 11: 100041.

Dwork, C., Hardt, M., Pitassi, T., Reingold, O., & Zemel, R. (2012). Fairness Through Awareness. ITCS 2012.

Feldman, M., Friedler, S. A., Moeller, J., Scheidegger, C., & Venkatasubramanian, S. (2015). Certifying and Removing Disparate Impact. Proceedings of KDD 2015.

Kleinberg, J., Mullainathan, S., & Raghavan, M. (2017). Inherent Trade‑offs in the Fair Determination of Risk Scores. Proceedings of the 8th Innovations in Theoretical Computer Science Conference (and related preprint literature).

Hu, J., Huang, G. I., Wong, I. A., & Wan, L. C. (2024). AI trust divide: How recruiter-candidate roles shape tourism personnel decision-making. Annals of Tourism Research, 109: 103860.

Holstein, K., Wortman Vaughan, J., Daumé III, H., Dudík, M., & Wallach, H. (2019). Improving Fairness in Machine Learning Systems: What Do Industry Practitioners Need? Proceedings of CHI 2019 / FAccT‑related workshops.

Horodyski, P. (2023). Recruiter’s perception of artificial intelligence (AI)-based tools in recruitment. Computers in Human Behavior Reports, 10: 100298.

Raji, I. D., Smart, A., White, R. N., Mitchell, M., Hutchinson, B., & Gebru, T. (2020). Actionable Auditing: Investigating the Impact of Publicly Naming Biased Performance Results of Commercial AI Products. Proceedings of FAccT 2020.

Rigotti, C., & Fosch-Villaronga, E. (2024). Fairness, AI & recruitment. Computer Law & Security Review, 53(1): 105966.

Szandała, T. (2025). ChatGPT vs human expertise in the context of IT recruitment. Expert Systems with Applications, 264: 125868.


Refbacks

  • There are currently no refbacks.


Abava  Кибербезопасность Monetec 2026 СНЭ

ISSN: 2307-8162