Text this: Trade-Offs in Leveraging External Data Capabilities