Gender biased algorithms and replacing human interaction: A deep dive into the ethical considerations of using AI in your recruitment process.

Charlotte Colley • 19 August 2024

In today’s rapidly evolving job market, AI has emerged as a powerful tool in recruitment, with 70% of businesses now using AI-powered applicant tracking systems (ATS) to find and hire talent. Despite research showing that using AI sources candidates 75% quicker than conventional techniques, there are huge concerns across the industry about its ethics. From gender-biased algorithms to removing the human touch, we’re unpicking the good, the bad and the ugly when it comes to using AI in your hiring process – and sharing our best practices when it comes to keeping things ethical. Let’s dig in!


The Good: Where and why businesses are turning to AI for hiring


The three most common ways of using AI in hiring is for CV screening, candidate sourcing, and using chatbots for initial interactions - but the list goes on, to interview scheduling, skills assessments and onboarding. Hiring teams are reaping the benefits, with AI enabling them to quickly sift through large volumes of applications, identify top candidates, expand their talent pools and find passive candidates, significantly reducing business’ time-to-hire. We’ve seen that where AI is used well, is for mundane tasks, saving employers time to focus on enhancing good, old, human interaction.


CV screening


Generative AI has significantly shifted the industry, with its ability to scan large volumes of CVs and match candidates to roles based on skills rather than just job titles. Tools like Canditech and HireVue promise to refine the selection processes through extracting key information from CVs and matching them with available job descriptions. Where hiring teams would otherwise need to manually review each application, these tools sift through CVs automatically and highlight the most suitable candidate for the position.


Candidate sourcing


Businesses are also using AI-driven candidate sourcing tools to identify and reach out to potential candidates more efficiently, enabling them to manage a larger talent pool without getting bogged down in administrative work. LinkedIn Recruiter now includes AI functions such as AI-Assisted Search and AI-Assisted Messages to help users target the right people and create personalised messages for their initial outreach. AI-Assisted Messages uses AI to draw on profile information provided by the candidate and combines it with the job requirements, saving hiring teams hours of time skimming LinkedIn profiles to gather insight.


Chatbots


Using chatbots for initial candidate interactions has been a contentious topic among industry leaders and has its obvious downfalls – mainly, its lack of personalisation and not being able to deal with complex issues. However, with many candidates searching for roles in the evening having worked at their current roles all day, an evening AI chatbot answering queries while your workforce is offline could ultimately booster your customer experience. Automated responses can also be used to avoid candidate ‘ghosting’, although if this is an existing problem, we’d probably advise to take a look at the root cause! Where chatbots take a turn for the worse, is when businesses continue the AI interactions into the first rounds of interviews – we’ll get to that travesty shortly…


The Bad: Where to be cautious

 

Gender-biased algorithms


One of the main ethical issues when it comes to using AI in the hiring process is its risk of reinforcing existing biases. Afterall, AI only generates the information it’s trained on, meaning that the input data can directly influence the decision-making in algorithms. The difference in the gender pay gap in STEM industries for example is still at around a 30%, and interestingly, women account for less than 25% of AI specialists. Because this information originally accentuates gender biases in the STEM industry, there is a risk that AI algorithms will replicate these biases in decision making.


A well-known example of this is when Amazon used automated CV screening, which used CV samples from candidates over a 10-year period to train its recruitment model. The model picked up historical patterns by analysing language patterns on CVs, and, due to the previous underrepresentation of women, began associating male candidates with the language commonly found on CVs of successful employments. On the other hand, CVs that included language often associated with women were dismissed by the algorithm. A more recent example is Carnegie Mellon University’s research, which found that Google Ads exhibited gender discrimination, showing males better paying jobs than female job seekers.


Brookings Institution’s Aylin Caliskan argues that AI algorithms, “need to be transparently standardised, audited and regulated […] Trustworthy AI would require companies and agencies to meet standards, and pass the evaluations of third-party quality and fairness checks before employing AI in decision-making”.


More and more businesses who use AI are adopting audit mechanisms as a step towards regulating AI biases. Out of interest, we reached out to PreScreenAI, a platform designed for AI-powered job interviews to ask how they avoid gender-bias. They commented, “[our] software has its own mechanism for avoiding [gender bias] and a specific methodology to test that.” However, Erica Sweeney from Business Insider points out that over 80% of companies using AI hiring tools lack proper oversight mechanisms to prevent biases […and] without rigorous auditing and regulation, these biases could become deeply embedded in AI-driven hiring practices.”


It's clear that careful oversight is essential to ensure AI doesn’t perpetuate the same old biases. Despite many platforms promising to enable a more diverse and inclusive hiring process, businesses should be extremely wary of biased AI algorithms.


Data privacy


Another issue businesses should consider is how their AI-powered processes are using and collecting candidate data. Businesses using Open AI (or similar) to generate and automate candidate interactions should be wary of the kind of data they’re feeding into their system. If businesses are inputting private data such as email addresses and names, then being transparent with candidates about how their data is being used is crucial.


The Ugly: Replacing essential human interactions


With 68% of jobseekers saying they want to be engaged with at least 1-2x per week, you can see why many hiring teams are cutting corners and automating their interactions. Platforms like Zapier allow you to use Chat GPT 4 to automate workflows such as candidate sourcing, assessments and scheduling, saving hiring managers hours of time. Where this turns ugly however, is when AI starts to seep into the workflows where personalisation and real human interaction is essential.


We’ve seen some businesses use AI platforms to assess candidates based on their tone of voice, buzz words they use and even their head movements. Some platforms also provide the functionality to carry out first stage interviews with an AI avatar. When we asked our network how they’d feel if their first stage interview was with an AI bot, over 80% said they would hate it. One respondent commented, “if I receive a request to do a 1-way interview with AI, I ignore it and drop out of the interview process. Companies which use [AI interviews] expect candidates to invest time preparing for such ‘interviews’ yet demonstrate they are unwilling to invest time themselves.”


In the end, while AI can significantly boost efficiency in recruitment by automating routine tasks, it’s crucial not to let technology replace the personal touch that candidates value. The backlash against AI-driven interviews and impersonal assessments underscores the need for a balanced approach. Businesses should harness AI's strengths to streamline processes but remain committed to genuine, human interaction where it matters most.


Using AI ethically: our best practices


There’s a common phrase quickly making its way around the industry, which is that HR won’t be replaced by AI. HR will be replaced by humans who are using AI to their advantage.


To harness the benefits of AI in your hiring process while maintaining ethical standards, check out our Ethical AI: Best Practices:

 

1.       Balance automation with personal touch


Use AI to streamline tasks such as candidate sourcing, but ONLY to enable more time to focus on real human interactions.

If you’re struggling to figure out which of your processes to automate, try noting

down your core workflows. Ask yourself how much time you spend on the activity, how frequently the activity needs to be completed, and assess whether it can be automated or not while keeping candidate experience at the forefront.


2.       Make candidate experiences engaging and respectful

 

Avoid over-reliance on AI for tasks where personal interaction is essential. Chatbots and auto-responses are good way of acknowledging queries and initial interactions, especially if a candidate needs support during offline hours. However, don’t over-use AI for things like first stage interviews, where employer/candidate connection is key to a good customer experience and ensuring a good cultural fit.


3.       Be wary of biased algorithms


If you’re using AI for things like targeting candidates, initial screenings, and assessments, be extremely wary of gender biased algorithms and ensure your AI platforms use ethical AI practices such as establishing processes to test for and mitigate bias and investing in bias research.


4.       Prioritise data privacy


Be transparent about how candidate data is collected and used. Ensure that all data handling practices comply with privacy regulations and inform candidates about how their information is being processed.


5.       And last but not least, MAINTAIN HUMAN OVERSIGHT!

 

AI should support, not replace, human judgment. Use AI-generated insights as a tool to aid decision-making, but rely on human expertise for final decisions and to provide that oh-so-important personal touch in candidate interactions.


Useful links and references

How SOW solutions drive project success
by Tina Ledger 19 May 2025
How SOW solutions drive project success
How Project RPO can solve your biggest recruitment challenges
by Tina Ledger 12 May 2025
How Project RPO can solve your biggest recruitment challenges
The rise of skills-based hiring
by Tina Ledger 7 May 2025
The rise of skills-based hiring
by Tina Ledger 28 April 2025
How AI is reshaping workforce management and how we can help you stay ahead
by Tina Ledger 27 March 2025
We're back! We're thrilled to announce the return of our interview series, Women in Law, where we shine a spotlight on the extraordinary women making waves in the legal world. Join us as we delve into their journeys, explore their challenges and triumphs and celebrate their remarkable achievements.
by Tina Ledger 25 March 2025
There’s a quiet revolution happening in the legal sector, and AI and data are powering it.
by Cameron McCammon 26 February 2025
With over 20 years of experience in the global legal arena, we've provided our clients with access to top legal talent worldwide. Leveraging our extensive industry connections and in-depth expertise, we've curated the most comprehensive salary data and hiring trends for professionals like yourself. Our 2025 Salary Guide provides an overview of competitive packages and explores the latest hiring trends shaping the landscape of Legal employment in your region. Get your complimentary copy of the 2025 Salary Guide directly to your inbox by filling in the form below.
Preparing for Generation Beta
by Sophy Moyes 21 January 2025
As the STEM sector continues to grow at a rapid pace, businesses are facing increasing challenges attracting and retaining top talent.
by Charlotte Colley 26 November 2024
We're back! We're thrilled to announce the return of our interview series, Women in Law, where we shine a spotlight on the extraordinary women making waves in the legal world. Join us as we delve into their journeys, explore their challenges and triumphs and celebrate their remarkable achievements. Anna is a partner in the Herbert Smith Freehills LLP corporate practice in Dubai specializing in mergers & acquisitions, joint ventures and investments with particular focus on the Middle East. Anna is regularly involved in award winning and other high-profile transactions in the region that span a number of sectors. In addition to executing transactions in the energy and infrastructure sectors, Anna advises on digital infrastructure and TMT transactions. Anna studied law and obtained her master's in law from the University of Warsaw in 2005 and subsequently moved to the UK to pursue her career in law in London. She re-qualified as a solicitor in England and Wales in 2013. She spent over 13 years working for two US law firms in the City of London before moving to Dubai and joining Herbert Smith Freehills in 2018 as a senior associate. Anna was first promoted to of Counsel in 2023 and elevated to partner in May 2024. Anna is frequently commanded by her clients for her exceptionally pragmatic approach to transactions, enabling them to navigate complex legal challenges with ease. Why did you decide to pursue a career in law? I didn’t always know I wanted to be a lawyer. In fact, I considered other paths. At one point at a very young age, I even thought about joining the army – I admired the discipline and resilience it required, and honestly, some of those skills would be helpful in law, too! While I had considered pursuing an MBA immediately after completing my master's degree, I ultimately chose to move countries and requalify in the UK, believing that this path would provide me with the most meaningful opportunities to advance my career. Looking back on your career, what are some key moments that have helped or hindered you in getting to where you are? There have been many key moments, both positive and challenging, that have shaped where I am today. Early on, studying law in two different languages and legal systems and requalifying in a very competitive market in London was a significant hurdle and achievement, that taught me the value of determination, hard work and persistence. Ultimately, moving firms to prove myself further and eventually relocating to Dubai to accelerate my career were key decisions that allowed me to challenge myself in new ways and grow. On the flip side, there were times when I faced doubts about whether I belonged in certain rooms, especially being a woman in a traditionally male-dominated industry. But each obstacle has made me more determined and shaped my leadership style. Each of these steps has been part of my evolution, and over the years I have learned that resilience and adaptability are key to navigating any obstacle. My promotion to of Counsel and then Partner earlier this year were major milestones, and currently, I am the only female partner in the office, which is something I am incredibly proud of. Having said all that, I know I wouldn't have been able to achieve all this without the support of amazing colleagues and mentors along the way. Do you believe there’s a glass ceiling for women in the workplace, and has it changed? I do believe the glass ceiling still exists in many industries, including law, though progress is being made. I have experienced certain challenges in my career, but I have not faced prejudice based on my gender; I’ve always thought of myself simply as a lawyer, focusing on being the best I can be. Today, we’re seeing more women in leadership roles, and I am proud to be among them. Yet, women still encounter less visible challenges, whether in the form of bias, societal expectations, or balancing family life with a demanding career. While strides have been made, there’s more to be done. Through evolving recruitment practices, mentorship, diversity initiatives, and challenging outdated norms, we can create further change. I’m encouraged by the support women offer each other, and that keeps me hopeful that the glass ceiling will continue to crack. What do you think the legal industry can do to improve diversity & inclusion? The legal industry has made progress, but there’s still room for improvement. First and foremost, we need more than just diversity in numbers—we need inclusion at every level, where everyone’s voice is heard and valued. This can be achieved through better representation in leadership positions and by ensuring that recruitment practices are truly inclusive. Broaden recruitment criteria to include candidates with diverse life and career experiences will create a more inclusive environment and enrich teams with new perspectives. Mentorship and sponsorship programs for underrepresented groups can make a huge difference in retaining diverse talent. The industry also needs to focus on creating a supportive environment where people can bring their authentic selves to work without fear of judgment. As part of my new role, I make it a priority to champion diversity and inclusion, and I encourage others to do the same. What advice do you have for young women looking to make a career in your industry now? My advice to those starting their legal careers is that hard work is essential, but in today’s world, it’s also crucial to be resilient, proactive and open-minded. The legal world is evolving, so it’s crucial to stay alert to change and seek out opportunities, even if they’re outside your comfort zone. Your career may not be a straight line, it may have twists and turns, but each step, whether a success or a setback, adds to your growth. The most successful lawyers are often the ones who are authentic and have taken unique paths to get where they are. Success is as much about resilience and adaptability as it is about effort. Focus on building core skills and surround yourself with a network that supports and challenges you. And, most importantly, stay true to your values and who you are.
by Charlotte Colley 23 October 2024
Innovation thrives on diverse perspectives. Yet, women still hold only 27% of STEM (Science, Technology, Engineering and Mathematics) jobs , despite them making up nearly half of the workforce. That’s a massive gap, and if your business isn't working to close it, you're missing out on untapped potential, fresh ideas and a stronger competitive edge. But don’t worry – we’re here to help! We’ve been catching up with inspiring women in the STEM and diversity and inclusion space, asking them that one question the STEM industry has grappled with since its foundation – what can businesses be doing to attract more females into the sector? So here it is, a guide for women in STEM – by women in women in STEM. Sure, we’ve come a long way (back in 1970, only 8% of STEM roles were held by women), but progress has slowed, and serious challenges remain. Women in STEM earn only 74% of what men in similar roles do, and many face roadblocks like pay gaps, fewer leadership opportunities and unconscious bias. As progress in closing the gender gap has slowed, businesses must take decisive action to attract and retain more women in STEM roles to foster a more inclusive and innovative environment. It’s time for businesses to step up. So, without further ado, here’s what women in STEM say are vital for attracting more females to the industry: 1. “Implement female mentors” Attracting female talent is only half the battle - keeping them engaged and helping them grow is just as important. Racing TV Sports Presenter and Women in Tech advocate, Sophie Brown, says, “I would encourage businesses to implement mentors, but also encourage women to find external mentors too. While an internal mentor can give you confidence and leadership skills, there is serious value in having an external mentor, giving you more freedom to explore advice with zero bias ” . “More female mentors in the STEM space means creating a warmer and more welcoming environment for women entering the industry. I had to go out and find mentors for myself when I first started out, but now there are incredible mentorship programmes available to businesses”. Sophie is also known for her appearance on the Channel 4 show, Married at First Sight , where she stood up to body shaming contestants and spoke out about the misogynistic side of fame. “As females in the industry, we need to speak up more about our experiences and anecdotes,” Sophie says. “More visibility of inspiring women in STEM will encourage others to take the leap and explore.” It’s clear that implementing mentorship programs for women is essential for businesses to give females a voice, support their career growth, and foster a more inclusive and innovative workforce. Businesses should also work harder to highlight the success of female colleagues to inspire others into the industry.  2. “Rethink your culture” Justine Craston, former Diversity, Equity and Inclusion Practitioner at Dojo , says her number one piece of advice to businesses is to, “be VERY intentional about how you are driving ‘Inclusion’ in your Diversity, Equity and Inclusion practices ” . Building a more inclusive workplace in the Science, Technology, Engineering and Mathematics sector doesn’t happen by accident. It takes active work. Justine maintains this starts by curating a culture of psychological safety. “Be curious”, Justine says. “It’s much better to ask about an employee’s experience than to avoid the subject… It never hurts to give someone the opportunity to be listened to”. Businesses that actively support diverse voices will attract, retain and inspire female talent. Justine also suggests working with Employee Resource Groups (ERGs) to “drive belonging and inclusion”, as well as being a great platform to connect and share experiences. 3. “Redesign ‘flexibility’ and parental benefits” Biased hiring processes often unintentionally deter women. Flexible work options like remote roles or flexible hours can make a big difference for women balancing career and family. Joan Iwuoha, Product Manager at HNG Tech , says, “Mothers in STEM are constantly juggling work alongside family. To accommodate them, businesses should have options like flexible work hours and remote work ”. Companies including Next , Morgan Stanley and Toyota even have on-site nurseries charging competitive rates, some via a salary sacrifice scheme. This work benefit is currently extremely rare, despite 71% of working mothers having children under 4. Joan says that on-site childcare “takes away the stress from mothers in STEM and will encourage more females who plan to have a family into STEM roles ” . 4. “Build a clear pathway for growth and leadership” Women are more likely to pursue STEM careers if they can see themselves succeeding. Promoting and celebrating female leaders - both inside and outside your company - creates visible proof that the future of STEM is diverse. Former Client Operations Manager in the SaaS world, Luciana Alemanno-Frankson, says, “Many women look for opportunities where they see a strong possibility of progression, mentorship and leadership development. It’s not just about hiring more women, but ensuring they have the tools and support to thrive and grow within the organisatio n” . Authentic role models are bound to inspire current employees and the next generation of female innovators. Luciana says on the topic, “Providing access to female role models in senior positions and ensuring diverse voices are actively included in decision making can be a strong draw for women considering a career in STEM ” . By creating an environment where growth and leadership are accessible, companies can create a lasting impact, empowering women to envision and achieve long-term success in STEM fields 5. “Close the pay gap” Women in STEM make around $66,200 annually compared to men’s $90,000 in the US, and in the UK, on average, females in STEM earn around 19% (or £12,000) less than men. Presenter, Sophie Brown, says on the subject, "For businesses, transparency from senior leadership is important so that everyone knows where they stand, and more conversations around salary negotiations and instilling confidence need to be had. To female candidates – know your worth and schedule in a pay review as soon as you accept the role to make sure it’s solidified in. Your salary is your livelihood – it should never be underestimated!” Empowering women to advocate for their worth begins with a culture of transparency and support. When businesses actively promote equal pay opportunities and encourage open conversations about compensation, they create an environment where every woman feels valued and confident in asking for what she deserves. 6. “Inspire future generations” “It’s our responsibility to engage Gen Z and Gen Alpha by showcasing pathways to fulfilling STEM careers ” , says female Director at an IT talent solutions firm. “We need to create workplaces that align with their values, making STEM roles more attractive and relevant to their priorities.” If businesses want more women in STEM, they should start at the source. Partnering with schools and universities to support scholarships and internships will help to target young women. Sponsoring coding boot camps, summer programmes or apprenticeships can also build excitement about STEM careers early on. She also points out that, “Commitment to change needs to start from the top. Businesses need to ensure representation at all levels of leadership in order to inspire young women entering the STEM workforce. Lily Spokes and Clara Schmitz, from IT Services and Consulting business Pace Integration , agreed, stating that their "number one piece of advice to businesses is to hire more women into leadership positions. Having great role models will inspire future generations into STEM.” So, there you have it. The talent gap in STEM is real - and closing it is more crucial than ever for businesses that want to be industry leaders. Creating an inclusive workplace, addressing pay gaps, and investing in the development of female talent aren’t just the right things to do - they’re smart business decisions. Now’s the time to lead the change. What will your business do to enable women to thrive in STEM? Interested in learning more about how to attract more women in STEM? Talk to our Client Services Consultant in Tech, Amy Glynn today! -------------------- We're committed to enabling our clients and candidates to thrive in a constantly changing world. By helping businesses grow and supporting people in leading more fulfilling lives both at work and beyond, we aim to make a lasting impact. Our ultimate goal is to become the world’s most valued and trusted workforce solutions company, trusted by our people, our clients and our communities. References: Home of Technology News Pew Research Center https://www.census.gov/library/stories/2021/01/women-making-gains-in-stem-occupations-but-still-underrepresented.html https://www.stemwomen.com/job-market-for-women-in-stem https://yulife.com/blog/top-10-companies-for-childcare-and-working-parents/ https://www.aauw.org/resources/article/fast-facts-working-moms/ https://www.ons.gov.uk/employmentandlabourmarket/peopleinwork/employmentandemployeetypes/articles/familiesandthelabourmarketengland/2021#:~:text=4.,employment%20than%20full%2Dtime%20employment .
More posts