Apologies in advance: my answer relies on more of a semantic argument than a mathematical one.
Suppose the patient had to wear a cast until the doctor could certify that they'd healed, which can only be done in the doctor's office in an appointment. In this world, doctor's appointments are restricted to follow that uneven spacing after a surgery. So a cast's duration in months has support $\{1.5, 3, 6, 12\}$. The variable of interest is no longer "time to fracture healing", but rather "time till the patient gets to take off that itchy cast".
In this case, the mean time to event becomes quite meaningful. If I were a doctor, I'd want to be able to tell the patient how long they should expect to have to wear that darn cast.
I think the reason why I find this so much easier to swallow is that it sidesteps the question of "what if the fracture actually healed sometime between observation points?" which sort of captures why I was initially hesitant.
Anyway, that's why I think it's appropriate. I hope this makes sense!