Did Keir Starmer finally realise what being a leader meant this summer? No, not the Labour leader’s heroic rescue of a lost dog while on holiday, but his decision to enter the bitter gender debate and back a reversal of his party’s policy on allowing people to self-declare a new gender identity on official documents.

For the past few years, Starmer has largely avoided talking about it, save to complain that the debate is “too toxic”. It certainly has far too much poison in it, but Starmer is one of the people with the most power to change that by coaxing the debate in a better direction. It’s just taken him a while. There has been a visible change in the party since its national policy forum dropped the self-identification policy in July. Its MPs and activists now say they feel more confident in saying biological sex is important, after years of fearing a furious backlash from across the party.

Starmer isn’t leading all that much, but benefiting from a realignment in politics that has been under way for some time. We are all very familiar with the debate about sex-based rights and transgender equality. We know its roars, culture wars and bitter recriminations. Some Tories plan to “weaponise” it at the next election, claiming that Starmer can’t be trusted to know what a woman is. Rishi Sunak told the first of his two leadership contests last year that the left wanted to “cancel our women”. It was a weird use of the possessive pronoun. It was also a sign that politicians saw what had previously been quite a niche concern as a campaign tool, even if that made a sensitive debate even harder to conduct in a civil fashion. But, below the fury, many of us have missed the way this debate has also broken down party boundaries. It has brought together a group of MPs who are in no way like-minded.

One of them is Baroness Jenkin. The joke among Westminster women used to be that if you’d met Anne Jenkin, she’d probably already have asked you to become a Tory MP. A determined, slightly eccentric figure who often cycles around Westminster with light-up wheels on her bike, she has spent years trying to increase the number of women being elected for her party, identifying and coaching them through the candidates process. Now, though, if you meet her, she’s more likely to ask you to join her campaign for sex-based rights – and you definitely don’t need to have any Conservative beliefs at all. Jenkin and Conservative colleagues found themselves offering a safe space to Labour MPs who were at odds with their party’s policy on gender self-identification. The most high-profile of these is Rosie Duffield, who has previously said she feels as though she is in an “abusive relationship” with her party – hardly something she would say lightly, given that she also escaped domestic abuse a few years ago. Even though the gender-critical Tories enjoy spending time with Duffield, she is manifestly not one of them: she disagrees vehemently with the two-child benefit limit, for instance, and doesn’t have much truck with the other views of the more strident Tory campaigners such as Miriam Cates. Yet she and other Labour women have ended up confiding in those Conservatives because they have found the atmosphere in their party so hostile for the past few years.

Jenkin says: “It’s easier for us Conservatives than it is for the other [parties], and so we’ve given these women moral support and company because it has been so lonely for them. And a lot of blokes just think it’s a women’s fight, even though of course when they come out in support of us, they don’t get anything like the abuse Rosie and others get because they’re men.”

Many of these women regularly join cross-party meetings held in parliament for politicians worried about the erosion of sex-based rights. They were set up two years ago by the three gender-critical campaign groups in the main parties: Labour Women’s Declaration (LWD), Conservatives for Women and Liberal Voice for Women. Initially, they met monthly and over Zoom – more recently their meetings, private and under the Chatham House rule, have gone weekly. They include peers and MPs who gather to hear from experts in sex and gender, transgender people, people who have detransitioned and clinicians.

They should now be in the position where to say that biological sex matters isn’t treated as heresy within the party

The numbers have gradually been growing – and more Labour figures have started coming along recently too, as well as SNP figures including Joanna Cherry. It is striking, though, that the Chatham House rule, probably the most frequently broken rule in politics by MPs happy to leak against each other, is one the attendees really do stick to. It’s also striking that Jenkin spends a lot of her time telling Conservative colleagues that they need to speak up more and do some of the heavy lifting on gender. And there are many more Labour frontbenchers who privately call themselves gender critical than there are out and about. Duffield isn’t the only Labour MP to campaign on this: Tonia Antoniazzi and Karin Smyth have also shrugged off heckling from their party colleagues when speaking on this in the chamber, but they have studiously avoided criticising their own leadership because that tends to get Labour backs up even more than expressing a view on biology.

Across all the parties, though, there is a whisper network of people who quietly agree with each other, or secretly meet, rather like an underground church or a resistance movement behind enemy lines.

Everyone involved agrees that the gender-critical movement in politics was slow to get going, and didn’t notice the many changes to policy that ministers, public agencies and other organisations were agreeing to without much public fuss – until it almost seemed too late. In the past couple of years, activists have gone into a frenzy of organising to try to catch up and change party and government policy. As Jenkin says, it was easier in the Conservatives, if only because senior figures, including Sunak, saw the topic as a way of undermining Starmer. But the real prize was Labour party policy, because the debate is still largely happening on the left, not in the Tory party.

We’ve given these women moral support and company because it has been so lonely for themConservative peer Anne Jenkin

This organising paid off at the end of July when the Labour national policy forum met to thrash out the basic direction of the manifesto. One of the decisions it reached, supported by the leader’s office, was that the party would no longer have self-identification as its official policy in relation to Gender Reform Act reform. Many LWD activists are angry that there has been no acknowledgement of or apology to all the women in the party who have been abused for merely holding what is now Labour policy, and other than a brief comment from Wes Streeting, no apology to Duffield or other female MPs for the way they have been treated. However, all agree that they should now be in the position where to say that biological sex matters isn’t treated as heresy within the party. But it is still not a fully comfortable place to be.

Even though LWD has won a significant policy shift and also has two fringe meetings listed in the guide to the party’s conference in October, it has now learned that it will not be able to have a stall there this year. Last year, the group’s stand was rejected for “commercial reasons”, and this year eight Labour politicians – three MPs and five peers – applied for it again on LWD’s behalf. The application was rejected, and last week one of the group was told that the decision stood, despite the change of policy at the NPF. The politicians who applied are baffled: Lord Hunt calls it “short-sighted and authoritarian” and points to a “chilling effect of the years of ‘no debate’ ” in Labour. Diana Johnson, due to speak at one of the fringes, says conference delegates will be “denied the opportunity” to discuss gender with LWD due to the rejection.

Starmer is clearly more comfortable sticking his neck out on gender politics – but only up to a point. He still doesn’t want gender to be one of the rows at his party’s conference, and he will benefit from leading a party that tends to see criticism of the leader as deeply disloyal (the Tories consider it a healthy hobby akin to gardening or jogging). But he has seen that the tectonic plates have shifted under his feet: now the campaigners he has to listen to are the ones his party previously felt were safe to ignore.

Isabel Hardman is assistant editor of the Spectator

Do you have an opinion on the issues raised in this article? If you would like to submit a letter of up to 250 words to be considered for publication, email it to us at observer.letters.co.uk