The ERG have somewhere between 60 and 80 MPs, they can't ditch them - it would be even more devastating to the Tory party than what Boris has done to them.

Also a Hard Brexit is now essentially government policy, not something they want to avoid.