Difference-in-differences Design and Propensity Score Matching in Top Accounting Research: A Short Guide for Ph.D. Students in Iran

Document Type : Original Article

Author

• Reza Hesarzadeh

Faculty of Economics and Business Administration, Ferdowsi University of Mashhad, Mashhad, Iran

10.22067/ijaaf.2020.39426

Abstract

In recent years, to increase the robustness of methodology sections of accounting research, applying quasi-experimental methods has become a popular approach in archival-empirical research of top-tier accounting journals. The purpose of this study is to discuss the usefulness of the two most robust methods, including difference-in-differences (DD) and propensity score matching (PSM). This paper discusses DD and PSM design and reviews DD and PSM's use in articles of American Accounting Associations’ journals in recent years. In addition to a simple explanation of DD and PSM, this research provides a list of credible empirical accounting studies that have used these two methods. The research also explores the reasons for using the two methods in the empirical-archival studies of accounting and shows that in addition to extracting a causal relationship, the most important reason for using the two methods is to reduce the potential concerns surrounding the "omitted variables" "and "heterogeneity of treatment and control groups". Overall, by highlighting the importance and application of the DD and the PSM, this research can help the methodology sections' robustness in the empirical-archive accounting research that focuses on causal relationships and provide a simple and practical guide, especially for Ph.D. students in accounting.

Keywords

• Quasi-experimental methods
• Causal relationships
• Difference-in-differences
• Propensity score matching
• Archival-empirical accounting research

---

References

Anantharaman. D. Pittman, J.A. and Wans, N. (2016). State Liability Regimes within the United States and Auditor Reporting. The Accounting Review, 91(6),1545-1575. https://papers.ssrn.com/sol3/papers.cfm?abstract_id=2372993

Angrist, J.D. and Pischke, J.S. (2009), Mostly Harmless Econometrics. ISBN-13: 978-0691120355

Amin. K. Eshleman, J.D. and Feng, C. (2018). The Effect of the SEC's XBRL Mandate on Audit Report Lags. Accounting Horizons, 32(1),  1-27. https://papers.ssrn.com/sol3/papers.cfm?abstract_id=2989894

Blundell, R. Meghir, C. Costa Dias, M. and Van Reenen, J. (2004). Evaluating the employment impact of a mandatory job search program. Journal of the European Economic Association 2(4), 569–606. https://www.jstor.org/stable/40004874

Bills. K.L. Cunningham, L.M. and Myers, L.A. (2016). Small Audit Firm Membership in Associations, Networks, and Alliances: Implications for Audit Quality and Audit Fees. The Accounting Review, 91(3), 767-792. https://papers.ssrn.com/sol3/papers.cfm?abstract_id=2379678

Bauer A.M. Henderson, D.and Lynch, D.P. (2018). Supplier Internal Control Quality and the Duration of Customer-Supplier Relationships. The Accounting Review, 93(3), 59-82. Doi: 10.2308/accr-51889

Chi. S.S. and Shanthikumar, D.M. (2017). Local Bias in Google Search and the Market Response around Earnings Announcements. The Accounting Review, 92(4), 115-143. Doi: 10.2308/accr-51632

Conley, T. and Taber, C. (2011). Inference with “difference in differences with a small number of policy changes. Review of Economics and Statistics, 93, 113–125. https://www.nber.org/papers/t0312

Card, D. and Krueger, A.B. (1994). Minimum wages and employment:A case study of the fast-food industry in New Jersey and Pennsylvania. The American Economic Review, 90(5), 772–793. https://www.jstor.org/stable/2677856

Cheng. Q. Lee, J. and Shevlin, T. (2016). Internal Governance and Real Earnings Management. The Accounting Review, 91(4), 1051-1085. https://papers.ssrn.com/sol3/papers.cfm?abstract_id=2666117

Chen. G. Kim, J.B. Lim, J. and Zhou, J. (2017). XBRL Adoption and Bank Loan Contracting: Early Evidence. Journal of Information Systems In-Press, 32(2), Doi: 10.2308/isys-51688

Dutillieux. W. Francis, J.R. and Willekens, M. (2016). The Spillover of SOX on Earnings Quality in Non-U.S. Jurisdictions. Accounting Horizons, 30(1), 23-39. Doi: 10.2308/acch-51241

Dong. Q. and Zhao, X. (2018). Do Firms Do What They Say? The Effect of the American Jobs Creation Act of 2004 on R&D Spending. The Journal of the American Taxation Association, 40(1), 87-107. https://doi.org/10.2308/atax-51879

Eshleman, J.D. and Guo, P. (2014). Do Big 4 Auditors Provide Higher Audit Quality After Controlling for the Endogenous Choice of Auditor?. Auditing: A Journal of Practice & Theory, 33(4),197-219. Doi: 10.2308/ajpt-50792

Francis. B.B. Hunter, D.M. Robinson, D.M. Robinson, M.N. and Yuan, X. (2017). Auditor Changes and the Cost of Bank Debt. The Accounting Review,92(3),155-184. http://commons.aaahq.org/posts/4c6c42de48

Gunn. J.L. and Michas, P.N. (2017). Auditor Multinational Expertise and Audit Quality. The Accounting Review, 93(4), Doi: 10.2308/accr-51925

Gow, I. D. Larcker, D.F. and Reiss, P.C. (2016). Causal Inference in Accounting Research. Journal of Accounting Research, 54(2), 110-135. https://doi.org/10.1111/1475-679X.12116

Garg. M. Gul, F.A. and Wickramanayake, J. (2017). Evaluating the Credibility of Voluntary Internal Controls Certification. Journal of International Accounting Research, 16(3), 91-117. https://doi.org/10.2308/jiar-51856

Garrido, M. (2014). Methods for Constructing and Assessing Propensity Scores. Health Services Research, 49 (5), 1701–20. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4213057/

Heckman, J.J. (1998). Comment on Eissa: Labor supply and the economic recovery act of 1981. In: M. Feldstein and J. Poterba (eds.): Empirical Foundations of Household Taxation. 34(2), 5–38. https://doi.org/10.1111/1911-3846.12297

Honaker. K. and Sharma, D.S. (2017). Does Schedule UTP Have Uniform Long-Run Effects on Corporate Tax Planning?. The Journal of the American Taxation Association, 39(2), 63-79.

Huang, Y., Jennings, R. and Yu, Y. (2017). Product Market Competition and Managerial Disclosure of Earnings Forecasts: Evidence from Import Tariff Rate Reductions. The Accounting Review, 92(3), 185-207. https://doi.org/10.2308/accr-51558

Imai, K. and Van Dyk, D.A. (2004). Causal Inference with General Treatment Regimes: Generalizing the Propensity Score. Journal of the American Statistical Association, 99 (467), 854-866. https://doi.org/10.1198/016214504000001187

Johnston, R. and Petacchi, R. (2017). Regulatory oversight of financial reporting: Securities and Exchange Commission comment letters. Contemporary Accounting Research, https://papers.ssrn.com/sol3/papers.cfm?abstract_id=1291345&rec=1&srcabs=1892286&pos=10

Jiang. J.X. Wang, I.Y. and Philip Wang, K. (2018). Big N auditors and audit quality: New evidence from quasi-experiments. The Accounting Review, https://papers.ssrn.com/sol3/papers.cfm?abstract_id=2617802

Kim, S. and Klein, A. (2017). Did the 1999 NYSE and NASDAQ Listing Standard Changes on Audit Committee Composition Benefit Investors?. The Accounting Review, 92(6), 187-212. https://papers.ssrn.com/sol3/papers.cfm?abstract_id=2901187

Kraft. A.G.Vashishtha, V. and Venkatachalam, M. (2018). Frequent Financial Reporting and Managerial Myopia. The Accounting Review, 93(2), 249-275. Doi: 10.2139/ssrn.2456765

Lennox. C. S. (2016). Did the PCAOB's Restrictions on Auditors' Tax Services Improve Audit Quality?. The Accounting Review, 91(5), 1493-1512. http://commons.aaahq.org/posts/25aaa151b9

Li . X. and Yang, H.I. (2016). Mandatory Financial Reporting and Voluntary Disclosure: The Effect of Mandatory IFRS Adoption on Management Forecasts. The Accounting Review, 91(3), 933-953. https://papers.ssrn.com/sol3/papers.cfm?abstract_id=2172014

Lennox, C.S. Li. W. Pittman, J. and Wang, Z. (2018). The determinants and consequences of tax audits: Some evidence from China. The Journal of the American Taxation Association, https://papers.ssrn.com/sol3/papers.cfm?abstract_id=2585466

Lunceford, J.K. and Davidian, M. (2004). Stratification and weighting via the propensity score in estimation of causal treatment effects. A comparative study. Statistical Methods, 23(19), 2937–2960. https://doi.org/10.1002/sim.1903

Meyer, B.D. (1995). Natural and quasi-experiments in economics. Journal of Business & Economic Statistics, 13(2), 151–161. https://doi.org/10.2307/1392369

Navissi. F.V.S. Khedmati, M. Lim, E. and Evdokimov, E. (2017). Business Strategy, Over- (Under-) Investment, and Managerial Compensation. Journal of Management Accounting Research, 29(2), 63-86. https://papers.ssrn.com/sol3/papers.cfm?abstract_id=2806967

Obenauer, M. and Von der Nienburg, B.  (1915). Effect of minimum wage determinations in oregon. Bulletin of the U.S. Bureau of Labor Statistics, 176, Washington, D.C.: U.S. Government Printing Office.

Shaikh, A. M. Simonsen, M. Vydacil, E.J. and Yildiz, N. (2009). A Specification Test for the Propensity Score Using Its Distribution Conditional on Participation. Journal of Econometrics, 151 (1), 33-46. https://doi.org/10.1016/j.jeconom.2009.01.014

Shipman, J.E. and Swanquist, Q.T. and Whited, R.L. (2016). Propensity Score Matching in Accounting Research. The Accounting Review, 92 (1), 213-244. Doi: 10.2308/accr-51449

Snow, J. (1855). On the Mode of Communication of Cholera. 2nd edition. London: John Churchill.

Zhou, J. and Chen, G. (2018). XBRL Adoption and Systematic Information Acquisition via EDGAR. Journal of Information Systems, 33(2), Doi: 10.2308/isys-52140