Trade-Offs in Leveraging External Data Capabilities: Evidence from a Field Experiment in an Online Search Market.
Saved in:
| Authors: | Lei, Xiaoxia1 (AUTHOR) dr.xiaoxia.lei@gmail.com, Chen, Yixing2 (AUTHOR) ychen43@nd.edu, Sen, Ananya3 (AUTHOR) ananyase@andrew.cmu.edu |
|---|---|
| Source: | Management Science (INFORMS). Apr2026, Vol. 72 Issue 4, p2998-3015. 18p. |
| Subject Terms: | *Application program interfaces, *Electronic data processing, *Digital platforms, *Field research, Instrumental variables (Statistics), Digital technology |
| Abstract: | Firms increasingly leverage external entities' data capabilities to unlock improvements in their offerings, but measuring the impact of such capabilities is challenging. Collaborating with the search team at a technology company, we analyzed a large-scale field experiment in which we randomized access to an external, leading search engine's autocomplete application programming interface (API) for more than two million users over 108 days. We measure the causal effects of removing API access on two performance metrics of the focal company's search product: (a) clickthrough rate (CTR) on search suggestions and (b) CTR on the search engine results page. We find that, on average, compared with the baseline with API access, removing API access reduces the search suggestion CTR by 4.6%. Further, exploiting the experimental variation, we use an instrumental variables approach to establish that a 10% increase (decrease) in CTR on search suggestions leads to a 1.85% increase (decrease) in CTR on top-slot search results. However, the negative effect of removing API access becomes less negative over time with the effect magnitude in the longer term being half what we would have obtained with a short-term experiment. We provide suggestive mechanism evidence of the longer term effect: the focal company's reliance on the leading search engine's data capability tapers off the accumulation of internal data and then limits the improvement of its autocomplete predictions. This research informs managers of a critical trade-off in leveraging external data capabilities and sheds light on regulations, such as the Digital Markets Act, that mandate data sharing by large digital platforms. This paper was accepted by DJ Wu, information systems. Funding: This work was supported by the National Natural Science Foundation of China [Grants 72442015, 72171132, and 72171146] and the China Scholarship Council [Grant 202206230110]. Supplemental Material: The online appendix and data files are available at https://doi.org/10.1287/mnsc.2023.01834. [ABSTRACT FROM AUTHOR] |
| Database: | Entrepreneurial Studies Source |
|
Full text is not displayed to guests.
Login for full access.
|
|
| FullText | Links: – Type: pdflink Text: Availability: 1 |
|---|---|
| Header | DbId: ent DbLabel: Entrepreneurial Studies Source An: 192910482 AccessLevel: 6 PubType: Academic Journal PubTypeId: academicJournal PreciseRelevancyScore: 0 |
| IllustrationInfo | |
| Items | – Name: Author Label: Authors Group: Au Data: <searchLink fieldCode="AR" term="%22Lei%2C+Xiaoxia%22">Lei, Xiaoxia</searchLink><relatesTo>1</relatesTo> (AUTHOR)<i> dr.xiaoxia.lei@gmail.com</i><br /><searchLink fieldCode="AR" term="%22Chen%2C+Yixing%22">Chen, Yixing</searchLink><relatesTo>2</relatesTo> (AUTHOR)<i> ychen43@nd.edu</i><br /><searchLink fieldCode="AR" term="%22Sen%2C+Ananya%22">Sen, Ananya</searchLink><relatesTo>3</relatesTo> (AUTHOR)<i> ananyase@andrew.cmu.edu</i> – Name: TitleSource Label: Source Group: Src Data: <searchLink fieldCode="JN" term="%22Management+Science+%28INFORMS%29%22">Management Science (INFORMS)</searchLink>. Apr2026, Vol. 72 Issue 4, p2998-3015. 18p. – Name: Subject Label: Subject Terms Group: Su Data: *<searchLink fieldCode="DE" term="%22Application+program+interfaces%22">Application program interfaces</searchLink><br />*<searchLink fieldCode="DE" term="%22Electronic+data+processing%22">Electronic data processing</searchLink><br />*<searchLink fieldCode="DE" term="%22Digital+platforms%22">Digital platforms</searchLink><br />*<searchLink fieldCode="DE" term="%22Field+research%22">Field research</searchLink><br /><searchLink fieldCode="DE" term="%22Instrumental+variables+%28Statistics%29%22">Instrumental variables (Statistics)</searchLink><br /><searchLink fieldCode="DE" term="%22Digital+technology%22">Digital technology</searchLink> – Name: Abstract Label: Abstract Group: Ab Data: Firms increasingly leverage external entities' data capabilities to unlock improvements in their offerings, but measuring the impact of such capabilities is challenging. Collaborating with the search team at a technology company, we analyzed a large-scale field experiment in which we randomized access to an external, leading search engine's autocomplete application programming interface (API) for more than two million users over 108 days. We measure the causal effects of removing API access on two performance metrics of the focal company's search product: (a) clickthrough rate (CTR) on search suggestions and (b) CTR on the search engine results page. We find that, on average, compared with the baseline with API access, removing API access reduces the search suggestion CTR by 4.6%. Further, exploiting the experimental variation, we use an instrumental variables approach to establish that a 10% increase (decrease) in CTR on search suggestions leads to a 1.85% increase (decrease) in CTR on top-slot search results. However, the negative effect of removing API access becomes less negative over time with the effect magnitude in the longer term being half what we would have obtained with a short-term experiment. We provide suggestive mechanism evidence of the longer term effect: the focal company's reliance on the leading search engine's data capability tapers off the accumulation of internal data and then limits the improvement of its autocomplete predictions. This research informs managers of a critical trade-off in leveraging external data capabilities and sheds light on regulations, such as the Digital Markets Act, that mandate data sharing by large digital platforms. This paper was accepted by DJ Wu, information systems. Funding: This work was supported by the National Natural Science Foundation of China [Grants 72442015, 72171132, and 72171146] and the China Scholarship Council [Grant 202206230110]. Supplemental Material: The online appendix and data files are available at https://doi.org/10.1287/mnsc.2023.01834. [ABSTRACT FROM AUTHOR] |
| PLink | https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=ent&AN=192910482 |
| RecordInfo | BibRecord: BibEntity: Identifiers: – Type: doi Value: 10.1287/mnsc.2023.01834 Languages: – Code: eng Text: English PhysicalDescription: Pagination: PageCount: 18 StartPage: 2998 Subjects: – SubjectFull: Application program interfaces Type: general – SubjectFull: Electronic data processing Type: general – SubjectFull: Digital platforms Type: general – SubjectFull: Field research Type: general – SubjectFull: Instrumental variables (Statistics) Type: general – SubjectFull: Digital technology Type: general Titles: – TitleFull: Trade-Offs in Leveraging External Data Capabilities: Evidence from a Field Experiment in an Online Search Market. Type: main BibRelationships: HasContributorRelationships: – PersonEntity: Name: NameFull: Lei, Xiaoxia – PersonEntity: Name: NameFull: Chen, Yixing – PersonEntity: Name: NameFull: Sen, Ananya IsPartOfRelationships: – BibEntity: Dates: – D: 01 M: 04 Text: Apr2026 Type: published Y: 2026 Identifiers: – Type: issn-print Value: 00251909 Numbering: – Type: volume Value: 72 – Type: issue Value: 4 Titles: – TitleFull: Management Science (INFORMS) Type: main |
| ResultId | 1 |
