Text this: Causal Structure Learning Assumptions Shape Counterfactual Safety