Triangulation Results

Overview

We have higher frequency data (monthly) from India. To leverage these data and show robustness to choice across methods, we adopt (i) an event study approach (using RDiT approach), (ii) forecast methods (using a time-series approach) and iii) placebo control approach using sales from prior periods. These approaches do not rely on the presence of a control group and therefore tradeoff higher frequency data for not fully accounting for temporal confounding factors.

In Table below, we present the results of the RDiT approach and forecast (SARIMA) methods. We use sales volumes from two prior time periods as placebo controls – i) July 2010 to June 2012, and ii) July 2009 to June 2011. We present the time periods we use as placebo controls in Table below. We employed generalized synthetic control method with data from the two placebo controls as control pools, and covariates (as we had covariate data for SKUs from India). Results from both the generalized synthetic control when using both the placebo controls are presented in Table below.

The results of (i) an event study approach (using RDiT approach), (ii) forecast methods (using a time-series approach) and iii) placebo control approach using sales from prior periods, are consistent with our main analysis results.

Effect Sales volume (units)
LATE estimate (average) -3,489,221(70)
Meta-Analysis (all SKUs)
Effect size -.668***
Fail-safe number 10,281
Meta-Analysis (significant SKUs)
Effect size -1.942***
Fail-safe number 14,708
SARIMA forecasts
ATE -6,044,131(70)

Notes: Parentheses – No. of SKUs with significant LATE estimates

*** p<.001

Explanatory variables Placebo control 1 (Jul 2010 – Jun 2012) Placebo control 2 (Jul 2009 – Jun 2011)
Post 8,306,055 *** (788,610) 11,273,051 *** (1129862)
Treat 10,586,426 *** (788,609) 21,859,477 *** (1,129,862)
Post x Treat -6,543,267 *** (1,115,262) -9,510,263 *** (1,597,866)
Intercept 31,655,104 *** (3,761,426) 23,005,857 *** (5,389,097)
Observations 8,592 8,592
R-squared 0.99 0.98
SKU FE Yes Yes

Robust standard errors in parentheses

*** p<0.01, ** p<0.05, * p<0.1