Skip to main content

Advertisement

Skills versus Luck: Bolivia and its recent Bonanza

Abstract

This paper uses different approaches to determine the contribution of internal policies and external factors on the good performance of the Bolivian economy in the recent past. It is demonstrated that the extremely favorable external conditions are mainly responsible for its bonanza, and that the domestic policies have, probably, caused more harm, than good. The extent of the harm ranges from 2% to up to 6.1% of GDP per capita.

Introduction

Governments have the tendency to attribute good outcomes to their policies (skills) and bad ones to negative external shocks outside of their control (luck). That is certainly the case in Bolivia.

As in many other dimensions, the economic debate regarding the sources of the economic performance during the (continuing) tenure of President Evo Morales, is polarized. Opponents consider that most (if not all) of the good economic indicators are due to extraordinarily favorable external conditions.Footnote 1 Acolytes consider that a major role has to be attributed to the heterodox policies that the government has implemented, and compare favorably recent economic indicators, against the ones of, what they tend to call, the “neoliberal past” (Arce 2016).

Economists have long understood that one of the most prevalent and pernicious logical fallacies is to attribute a causal effect to a correlation.Footnote 2 Thus, a rigorous effort to ascertain how important were skills (or lack thereof) and luck, requires more than informal comparisons, declarations, and charts.Footnote 3

Answering this question is not easy, as an obvious counterfactual is not readily available. That is, ideally, we would like to know how would Bolivia have fared if faced with the same external conditions, but with different internal policies than the ones pursued by President Morales. In experimental terms, we would like to quantify what were the effects of receiving the “Evo Morales treatment,” when no natural control group is available.

This paper attempts to do so, using three methodologies. For completeness, each one is described, justified, and implemented. Presenting more than one approach helps to narrow down the possible answers, highlights their strengths and weaknesses, and provides robustness checks.

The rest of the paper is organized as follows: Sect. 2 describes and implements a methodology known as the synthetic control method. Section 3 uses a panel data model. Section 4 uses a simple dynamic stochastic general equilibrium model (DSGE). Finally, Sect. 5 concludes.

Synthetic control approach

Establishing a counterfactual to evaluate the relative merits of the policies implemented in Bolivia since 2006 is not simple. Ideally, we would like to have Bolivia face the same external conditions, but carry out different policies. In that case, the differences in outcomes between the treatment unit (policies implemented during Morales’s Presidency) and the control unit could be, in principle, attributed to the policies.

Abadie and Gardeazabal (2003) and Abadie et al. (2010) proposed a method that creates a statistical synthetic control that can be used as a counterfactual on a given treatment. Closely related to our approach, Grier and Maynard (2016) applied this method to assess the economic consequences of Venezuela’s Hugo Chavez.

This section describes the methodology, discusses practical issues of its implementation, and presents its results, when applied to Bolivia.

The method

As the ideal experiment, in which the systematic difference among two groups is clearly defined, is generally not available in social sciences, causal inference about the effects of events requires the development of different techniques. When there are several control and treatment units, facing similar environments, with or without common trends, a number of econometric techniques can be used to measure average treatment effects on the treated.Footnote 4

In the present circumstances, there is only one treatment unit (Bolivia, under the Presidency of Evo Morales) and no natural control units that can be used as counterfactuals. As Grier and Maynard (2016) for the case of Venezuela, we want to evaluate how different variables would have evolved, without Evo Morales and his policies.

Synthetic control methods were specifically developed to address issues like this one. Intuitively, we want to construct a synthetic Bolivia that is a weighted average of other countries, and that closely resembles conditions in Bolivia prior to the “treatment,” which, in this case, is Evo Morales taking office in 2006. If the synthetic control captures other influences common to Bolivia, we use this synthetic Bolivia to compare the effect of Evo Morales on different outcomes.Footnote 5

Following Abadie and Gardeazabal (2003), let \(X_{1}\) be a k \(\times\) 1 vector of pre-treatment observations of economic and social indicators of the treatment unit (Bolivia).Footnote 6 Let \(X_{0}\) be a k \(\times\) N matrix which contains k observations of the same variables as \(X_{1}\), but for the N countries considered to build the synthetic control. Let V be a k \(\times\) k diagonal weighting matrix that reflects the relative importance of the k indicators considered in \(X_{0}\) and \(X_{1}\). Given V , the objective is to find the N \(\times\) 1 vector of weights \(W\left( V\right)\) that minimizes the objective function:

$$\begin{aligned} W\left( V\right) =\underset{W}{\arg \min }\left( X_{1}-X_{0}W\right) ^{\prime }V\left( X_{1}-X_{0}W\right) , \end{aligned}$$
(1)

subject to the constraints that each element of W satisfies that \(w_{i}\ge 0\) (\(i=1,2,...,N\)) and \(W^{\prime }\iota =1,\) where \(\iota\) is an N—vector of ones.

As in Abadie and Gardeazabal (2003), let \(Z_{1}\) be a j \(\times\) 1 vector of pre-treatment observations of the variable that we are interested in comparing. Let \(Z_{0}\) be the j \(\times\) N matrix which contains j observations of the same variable of interest, for the N potential controls. Define \({\widehat{V}}\) as the nonnegative diagonal weighting matrix that solves:

$$\begin{aligned} {\widehat{V}}=\underset{V}{\arg \min }\left( Z_{1}-Z_{0}W\left( V\right) \right) ^{\prime }\left( Z_{1}-Z_{0}W\left( V\right) \right) , \end{aligned}$$
(2)

so that \({\widehat{W}}=W\left( {\widehat{V}}\right)\) is the vector of weights that minimizes (1), given the matrix V that minimizes (2).

Several observations are in order. First, given V, the minimization of (1) is simple as it corresponds to a quadratic programming problem with linear constraints that has an analytical solution. Second, although the simultaneous optimization of (1) and (2) could be conducted, the objective function is no longer quadratic, and numerical methods would be required. Third, a simpler way to proceed is to apply a sequential approach, in which we first consider a wide variety of candidates of V, obtain the value of W that minimizes (1) for each candidate, and evaluate which of those candidates minimizes (2). This procedure is numerically more stable than the simultaneous approach, as long as the candidates of V are dense enough. This is the approach that we pursue here.Footnote 7

Once the optimal weights, \({\widehat{W}}\), are obtained, we can evaluate if, before the treatment, the synthetic control thus generated resembles the economy that we are trying to replicate. For that, we can consider the difference between \(X_{1}\) and \({\widehat{X}}_{1}\), and \(Z_{1}\) and \(\widehat{Z }_{1}\), where:

$$\begin{aligned} {\widehat{X}}_{1}=X_{0}{\widehat{W}},\quad {\widehat{Z}}_{1}=Z_{0}{\widehat{W}}. \end{aligned}$$

That is, we evaluate if the weighted average of the control group (other countries) approximates well the pre-treatment characteristics of Bolivia (\(X_{1}\)), and the behavior of the pre-treatment variable of interest (\(Z_{1}\) ).

To evaluate the effect of the treatment, we can use the vector of weights \({\widehat{W}}\) obtained using pre-treatment information, to compare the post-treatment outcomes of the variable of interest. That is, let \(Y_{1}\) be a l \(\times\) 1 vector of post-treatment observations of the variable that we are interested in comparing. Let \(Y_{0}\) be the l \(\times\) N matrix which contains l observations of the same variable of interest for the N potential controls. The goal of approximating the behavior that the outcome variable of interest would have had in the absence of Evo Morales, can be obtained by considering the counterfactual generated by our synthetic Bolivia. Thus, the effect of Evo Morales on the variable of interest can be defined as:

$$\begin{aligned} \Delta =Y_{1}-{\widehat{Y}}_{1}=Y_{1}-Y_{0}{\widehat{W}}. \end{aligned}$$
(3)

To address the issue of the significance of the results, and if the differences can be attributed to the treatment, Abadie et al. (2010) suggest performing a “placebo study.” It consists on applying the synthetic control method to all the countries in the control group (that, of course, did not have Evo Morales as their president). If the placebos generate gaps similar to the ones of (3), we would conclude that the treatment (Evo Morales) did not have a significant effect on the variable of interest. On the other hand, if the treated unit displays a different behavior than the placebos, we would conclude that there is significant evidence of the effect of the treatment.

Results

Here we present the results of applying the methodology described above to evaluate the effects of the Evo Morales Presidency on (the natural log of) GDP per capita at purchasing power parity (PPP).Footnote 8 We consider the years 1992–2005 for constructing \(Z_{1}\) in the pre-treatment period, and the period 2006–2016 as the treatment period.

Table 1 presents the results of applying the methodology described above to obtain the optimal weights \({\widehat{W}}\). Eight countries have positive weights to compose the synthetic control (Cote d’Ivoire, Kyrgyz Republic, Niger, Peru, Togo, UK, Uruguay, and Zimbabwe).

Table 1 Optimal weights for synthetic control: GPD per capita

Table 2 presents the list of pre-treatment characteristics that we seek to match. These characteristics take into account, not only, conventional factors considered as determinants of economic conditions, but also other social indicators that provide a broad characterization of the pre-treatment conditions faced by Bolivia.Footnote 9 The table shows that Bolivia is considerably poorer than the simple average of the 84 countries for which the information is available, and that are used to obtain the synthetic control. It also shows that, with the possible exception of energy use, the synthetic control does a good job replicating Bolivia’s pre-treatment characteristics. Suffice it to say that synthetic Bolivia has a RMSPE that is more than eleven times smaller than the average of all countries.

Table 2 Pre-treatment characteristics

Figures 1 and 2 display the evolution of the level of GDP per capita (at PPP) for Bolivia, the average of the 84 countries considered as possible controls, and the synthetic control. As it happened with the pre-treatment characteristics, the average corresponds to more than two times the income of Bolivia, thus not being a suitable control. However, the synthetic control matches the behavior of Bolivia very closely up to the period of the treatment. After 2005, the synthetic control and actual Bolivia sharply diverge, especially up to 2014. In particular, if synthetic Bolivia were a valid counterfactual, the gap between the actual Bolivia and the synthetic control is, on average, of US$ 270 (at PPP).

Fig. 1
figure1

GDP per capita (at PPP): possible controls. The solid line represents Bolivia. The dashed line represents the simple average of the 84 countries considered as possible controls. The vertical line corresponds to the year prior to the treatment (2005)

Fig. 2
figure2

GDP per capita (at PPP): Bolivia and synthetic Bolivia. The solid line represents Bolivia. The dashed line represents synthetic Bolivia. The vertical line corresponds to the year prior to the treatment (2005)

To evaluate the significance of the results we conduct the “placebo” test described in Abadie et al. (2010).Footnote 10 To do so, we conduct the same synthetic control method to the 84 countries used as our control.Footnote 11 As they did not have Evo Morales as their president since 2006, if the placebo gaps are similar to the one obtained for Bolivia, we would conclude that our results are not attributable to Morales and his policies. However, if the gap estimated for Bolivia is large compared to the gaps for the other countries, we would conclude that the Morales Presidency had a significantly negative impact on GDP per capita.

Figure 3 presents the results of this exercise. Following Abadie et al. (2010), the placebo gaps depicted exclude the countries for which their RMSEs prior to the treatment are 2.2 times higher than Bolivia’s. The reason for doing so is that we want to include only countries that have synthetic controls that can reproduce relatively well the pre-treatment behavior of (the log of) GDP per capita prior to the treatment.Footnote 12 From this exercise we conclude that the differences are consistently negative between actual Bolivia and synthetic Bolivia, and are significant. On average, the gap between actual Bolivia and synthetic Bolivia is of 4.7% of GDP per capita, with a peak of up to 6.3% of GDP per capita between 2010 and 2012.Footnote 13

Fig. 3
figure3

Placebo test for (log of) GDP per capita (at PPP). The bold line represents the difference between the (log of) observed GDP per capita in Bolivia and the synthetic control. The gray lines represent placebo tests deviations for the other countries in the data set. The graph excludes countries with pre-treatment RMSE 2.2 times higher than Bolivia. The vertical line corresponds to the year prior to the treatment (2005)

Again, following Abadie et al. (2010), one final way to compare the Bolivia gap relative to the gaps in the placebo test, is to consider the ratios of the post-/pre-treatment RMSE for each country and their synthetic control. A large ratio indicates that the post-treatment period is significantly different than the pre-treatment period. Figure 4 shows that the post-treatment Bolivia is significantly different than the pre-treatment Bolivia when compared to its synthetic control. Indeed, the post-treatment RMSE is more than three times higher than the pre-treatment RMSE, pertaining to the right tail of the distribution.

Fig. 4
figure4

Ratio of post- and pre-treatment RMSE. Estimation of the empirical density of post-/pre-treatment RMSE using the Epanechnikov kernel. The vertical line corresponds to the ratio of RMSE of Bolivia

Summarizing, we show that Bolivia underperformed when compared to its synthetic counterfactual, in terms of the behavior of GDP per capita. While the synthetic control replicates relatively well broad characteristics of Bolivia prior to the treatment, it performs markedly better than actual Bolivia since the year 2006. This exercise suggest that, on average, Bolivia may have lost 4.7% of GDP per capita because of the treatment (Evo Morales Presidency). Furthermore, as evidenced in Appendix 2, there is no evidence that the Morales Presidency achieved better results than its synthetic counterpart when considering outcomes such as inequality (measured by the Gini coefficient), school dropout rate, infant mortality rate, or life expectancy. Although not in the same magnitude, these results are similar in spirit, to those encountered by Grier and Maynard (2016) for Chavez’s Venezuela.

Panel data approach

The previous section tackles the fact that there is no obvious control group with which to evaluate the effect of the Evo Morales Presidency. That is so, because the other countries differ from Bolivia, not only on who is their President, but also on their economic structure, external shocks they face, etc. The synthetic control approach deals with this problem by building an artificial control that, hopefully, resembles the actual Bolivia, prior to the treatment, and compares an outcome variable of the actual Bolivia, with the synthetic counterfactual, after the treatment on Bolivia.

Under certain conditions, cross-country panel data models could be used to evaluate this same question, without having to construct a synthetic control.Footnote 14 This section describes the methodology followed. If anything, this approach can be used to assess the robustness of the results obtained above.

The method

Lucas (1987) describes methodological aspects that should be considered to evaluate alternative policies. First, describe the environment in which the agents interact, their preferences, technologies, and constraints they face. Second, determine their optimal plans or policy functions of the control variables (y). Then, alter the laws of motion of the state or forcing variables (x). Finally, evaluate how the agents react to these alterations.

Under certain conditions, an econometric exercise can achieve the same goal. To do so, consider the conditional density as the empirical equivalent of the policy function, and the marginal density as the law of motion of the state variables. Recalling that the joint density can be written as the product of the conditional density and the marginal density, we have:

$$\begin{aligned} f(y_{t},x_{t},\theta )=f(y_{t}\left| x_{t},\theta _{1}\right. )f(x_{t},\theta _{2}), \end{aligned}$$

where \(f(x_{t},\theta _{2})=\int _{-\infty }^{\infty }f(y_{t},x_{t},\theta )dy\) is the marginal density of x, and \(\theta\), \(\theta _{1}\), and \(\theta _{2}\) are the vectors of parameters of the joint, conditional, and marginal densities, respectively.

Regression analysis usually focuses on statistical inference of some moments of the conditional density. To do so ignoring the marginal density requires for \(\theta _{1}\) and \(\theta _{2}\) to be “variation free”. Footnote 15 This condition is not sufficient for conducting counterfactual analysis. To do so, it is required for the conditional density (or its relevant moments) to be structurally invariant. That is, that the parameters of interest in the conditional density remain unchanged, in the presence of an unstable marginal density.Footnote 16 If those conditions are met, evaluating counterfactual scenarios would imply comparing the forecasts of the variable of interest under alternative trajectories of the state variables.

We are interested in evaluating how external shocks and internal conditions (or policies) affected the trajectory of the variable of interest: (log of) GDP per capita. Considering solely information of Bolivia would be advisable if enough quality data for approximating internal conditions were available. Unfortunately, this is not the case.

An alternative approach, followed here, is to consider a panel data structure. Under certain homogeneity conditions, this structure would lead not only to consistent, but also more efficient estimates than the ones obtained with time series models for one country. Of course, panel data models tend to assume that the only source of heterogeneity (difference) among units is a fixed effect, which can be a strong assumption.

Formally, we estimate the following simple dynamic specification:

$$\begin{aligned} y_{i,t}=\alpha _{i}+\sum _{j=1}^{J}\delta _{j}y_{i,t-j}+\beta x_{i,t}+\gamma p_{i,t}+\phi x_{i,t}p_{i,t}+\theta t+u_{i,t} \end{aligned}$$
(4)

where \(y_{i,t}\) is the (log of) GDP per capita (at PPP) of country i in year t, \(x_{i,t}\) is a proxy for external conditions, p is a proxy for internal policies, t is a time trend, and J is the number of lags necessary to make \(u_{i,t}\) a white noise process for each country.

A few comments regarding (4) are in order. First, \(\alpha _{i}\) summarizes the heterogeneity considered as a fixed effect. Second, the lags of the dependent variable are intended to capture the persistence of the series. Third, the series of interest is considered to be trend stationary.Footnote 17 Fourth, this specification allows for differences in short, and long-run impacts of changes of the forcing variables. To conduct valid inference, this specification requires that x and p be weakly exogenous to the parameters of interest. Furthermore, to conduct counterfactual evaluations, these variables must be super exogenous to the parameters of interest. Finally, in the spirit of Chang et al. (2009), we consider the interaction between internal and external factors, as described by the parameter \(\phi\).Footnote 18 The main idea is that good policies may act as enhancers (complements) of good external conditions.Footnote 19

The choice of a simple structure is deliberate, as there are not many observations in the panel structure for Bolivia. If the model were misspecified (as all are), we would want to avoid systematic and persistent errors for Bolivia. Thus, after the estimation of the parameters using a panel structure, we conduct exogeneity and specification tests for the residuals of Bolivia.

Next, we describe the choice of variables and results of implementing this strategy.

Results

A natural proxy for external conditions is the evolution of (the log of) the terms of trade, which we use. Internal conditions are trickier to proxy, as they should reflect policy decisions, and their distortionary effects on the decisions of private agents. Furthermore, the variable(s) used to characterize this feature should have a time span useful for estimation and be comparable between countries.Footnote 20

Chumacero and Fuentes (2006) use the ratio of government expenditures to GDP as a proxy of these distortions. However, this is not a good proxy for government intervention for Bolivia in the recent past, as the distinction between government expenditures and investment has become increasingly blurred. Instead, we consider summary indexes that evaluate overall, and other types of freedom, constructed by the Heritage Foundation. As Fig. 5 makes clear, irrespective of the index considered, Bolivians have experienced their freedoms curtailed, and thus, distortions increased since Evo Morales became president.Footnote 21

Fig. 5
figure5

Internal conditions (2005 vs 2016). Comparison of freedom indexes. See Appendix 1 for details

The choice of the variable used to proxy internal conditions was done following the general-to-specific approach suggested by Hendry (1995). That is, we consider the candidates presented in Fig. 5, estimate Eq. (4), perform specification tests for each candidate, and eliminate non-significant variables. Although these variables display similar patterns (in terms of direction), the Labor Market Freedom Index best captures the interaction with terms of trade, and satisfies the specification tests. Thus, this is the variable chosen as proxy of p.Footnote 22

Table 3 reports the results of estimating a panel data models with fixed country effects.Footnote 23 It also reports weak exogeneity tests for the external and internal factors. In both cases, the null hypothesis of no correlation between the residuals for Bolivia of the panel data models (conditional density) and the residuals of the marginal specification for each factor, estimated solely for Bolivia using AR(1) models, is not rejected.Footnote 24 Thus, inference, conditional on contemporary internal and external factors, is valid and no further estimation issues are considered to be problematic.

Table 3 Panel data results

To conduct the counterfactual exercise, it is required for the variables subject to intervention to be super exogenous, in the sense of Hendry (1995), to the parameters of interest. To test this, we must find evidence of structural instability in the marginal densities of the internal and external factors, while the conditional density remained stable. The AR(1) models used for the weak exogeneity tests are unstable, as judged by CUSUM tests for Bolivia, while the panel model is stable in the sample considered.

With this background, our counterfactual exercises ask the question: What would have happened with Bolivia if the conditions (internal and/or external) observed prior to the treatment (2005), would have remained unchanged after the treatment?

Table 4 shows four combinations of internal and external factors. If external factors are exogenous and can not be affected by the government, extremely favorable terms of trade as observed during the treatment (after 2005) can be labeled as “good luck” (GL). Thus, “bad luck” (BL) is defined as facing the same level of terms of trade during the treatment (after 2005) of the year 2005. On the other hand, our proxy for internal conditions that are consistent with the policies and statements of the Bolivian government tends to show increasing distortions faced by the private sector. As the panel data results and economic theory tend to predict, these distortions would (generally) be welfare deteriorating and reduce consumption, investment, and formal sector employment.Footnote 25 Thus, we label as “good skills” (GS) to maintaining the level of the Labor Market Freedom Index observed in 2005, and “bad skills” (BS) to the actual index that displays a clear deterioration on this dimension.Footnote 26

Table 4 Scenarios considered

As the specification of Table 3 evidences, there is an interaction between terms of trade and labor market freedom, thus making the effects of luck and skills nonlinear. To evaluate the effect of luck (or skills) on GDP per capita, we need to consider the behavior of the skills (or luck). For example, to evaluate the marginal effect of GL, we need to keep constant the level of skill. Thus, A–C is the effect of GL, conditional on GS, and B–D is the effect of GL, conditional on BS. Conversely, A–B is the effect of GS, conditional on GL, and C–D is the effect of GS, conditional on BL. If B were an accurate description of Bolivia after the treatment, A would be the counterfactual in which Bolivia would have benefited from the same favorable external conditions, with internal policies that would have enhanced the effect of the commodity prices bonanza.

With the estimates of the specification of Tables 3 and (4), we can compute the expected effect of comparing scenario k with scenario l as:

$$\begin{aligned} \Delta ^{k-l}&=\sum _{j=1}^{J}{\widehat{\delta }}_{j}\left( y_{i,t-j}^{k}-y_{i,t-j}^{l}\right) +{\widehat{\beta }}\left( x_{i,t}^{k}-x_{i,t}^{l}\right) \\ & \quad +{\widehat{\gamma }}\left( p_{i,t}^{k}-p_{i,t}^{l}\right) +{\widehat{\phi }} \left( x_{i,t}^{k}p_{i,t}^{k}-x_{i,t}^{l}p_{i,t}^{l}\right) , \end{aligned}$$
(5)

where \(k,l=\)A, B, C, D, and i represents Bolivia.

Figure 6 presents the results of computing the differences described in (5). As intuition would prescribe, good luck is “good,” unconditionally. However, good skills enhance the effects of a positive external environment. Given the observed path of terms of trade, GDP per capita increased in up to 4% just due to this effect. On the other hand, maintaining fewer distortions, with the external commodity prices bonanza, would have increased GDP per capita in up to 2%, on average, compared to the observed scenario. Thus, this exercise shows that Bolivia’s recent economic bonanza is mostly due to the extremely favorable external conditions it faced, and that, if anything, the internal factors prevented Bolivia from enjoying greater benefits.

Fig. 6
figure6

Effects of skills versus luck (fraction of GDP per capita). Left panel: Solid line depicts the effect of GL conditional on GS (A–C) and dashed line depicts the effect of GL conditional on BS (B–D). Right panel: Solid line depicts the effect of GS conditional on GL (A–B) and dashed line depicts the effect of GS conditional on BL (C–D)

DSGE approach

The previous sections attempt to quantify the effects of Evo Morales’s Presidency relying on econometric methods that, through different means, build a counterfactual with which to compare the actual performance of Bolivia.

Although these methods have their merits, they do not provide deep insights regarding the explicit mechanisms that operate. In short, these methods may help to predict, but lack of the economic theory required to understand.

As mentioned, Lucas (1987) proposed a different approach to evaluate counterfactual scenarios, proposing to use DSGE models as tools for conducting artificial experiments. This approach considers that if there are structural parameters that are invariant to interventions, we can evaluate the effects of interventions by solving the model before the intervention, solving it again with the intervention in place (provided that it is permanent) and compare the long-run (or steady state) effects of the intervention. If the intervention is deemed transitory, a natural tool to tackle the effect of the intervention is to map it to a impulse-response surface.Footnote 27

One weakness of the approaches followed in Sects. 2 and 3 is that the quantitative results are sample dependent. One weakness of the approach of this section is that the results are theory dependent. This, however, should not demean the elegance and boldness of this approach, as it makes transparent the structure used, and the mechanisms through which an intervention operates.

This section uses a deterministic version of the DSGE model developed by Chumacero et al. (2004) to address the issue of the effects of the Free Trade Agreements signed by Chile.Footnote 28 It is general enough, so as to provide a wide variety of mechanisms to analyze, and allows us to operationalize what we mean by luck and skills. Of course, the model is calibrated to replicate some long-run characteristics of Bolivia, and then modified to evaluate the effects of counterfactual scenarios that intend to capture luck and skills.

The model

The model considers a small open economy with firms in three sectors (exportable, importable, and non-tradable), a government, and a representative household that faces an upward-sloping supply schedule for debt.

The households

The economy is inhabited by a representative agent, who maximizes the value of lifetime utility as given by:Footnote 29

$$\begin{aligned} \sum _{t=0}^{\infty }\beta ^{t}u\left( c_{m,t},c_{n,t}\right) , \end{aligned}$$
(6)

where \(c_{m,t}\) and \(c_{n,t}\) represent period t consumption of an importable (m) and a non-tradable good (n). The other good produced in this economy is not consumed at home. We denote this good as the exportable good (x).

The maximization of (6) is done subject to the budget constraint:Footnote 30

$$\begin{aligned}&\left( 1+\tau _{m}\right) \left( 1+\tau _{c_{m}}\right) c_{m}+\left( 1+\tau _{c_{n}}\right) c_{n}p+\left( 1+\tau _{m}\right) \left( 1+\tau _{c_{m}}\right) i+\left( 1+{\widetilde{r}}\right) b \\&\qquad \le \left( 1-\tau _{k}\right) \left( 1+\tau _{m}\right) \left( 1+\tau _{c_{m}}\right) rk+b_{+1}+F+\pi _{x}+\pi _{m}+\pi _{n}. \end{aligned}$$
(7)

where \(\tau _{m}\) is an import tariff, \(\tau _{c_{n}}\) and \(\tau _{c_{m}}\) are taxes on the consumption of non-tradables and importables, p is the relative price of the non-tradable good in terms of the importable good (used as numeraire), b is the amount of foreign debt that the private agent contracted from abroad on the previous period, \({\widetilde{r}}\) is the (net) interest rate paid on that debt, \(\tau _{k}\) is a tax on capital income levied by the government, r is the rental rate of capital stock that is given to the firms of the three sectors, \(\pi _{x}\), \(\pi _{m}\), and \(\pi _{n}\) are the profits of the exportable, importable, and non-tradable sectors, F is a lump sum transfer from the government to households, and i is investment, which satisfies the standard law of motion for capital:

$$\begin{aligned} k_{+1}=\left( 1-\delta \right) k+i, \end{aligned}$$
(8)

where \(\delta\) is the depreciation rate of the capital stock and k is the capital stock. As k is expressed in units of the importable good, it is also subject to the same taxes of the importable good destined to consumption (tariffs and the value-added tax).Footnote 31

The problem of the representative consumer can be summarized by the value function that satisfies:

$$\begin{aligned} V\left( s_{h}\right) =\max _{c_{m},c_{h},b_{+1},k_{+1}}\left\{ u\left( c_{m},c_{n}\right) +\beta \left[ V\left( s_{h,+1}\right) \right] \right\} , \end{aligned}$$
(9)

subject to (7, 8), and the perceived laws of motion of the states \(s_{h}\).Footnote 32

The first-order optimality conditions are:

$$\begin{aligned} p^{-1}= \,& {} \frac{u_{c_{m}}^{\prime }}{u_{c_{n}}^{\prime }}\frac{\left( 1+\tau _{c_{n}}\right) }{\left( 1+\tau _{m}\right) \left( 1+\tau _{c_{m}}\right) } \nonumber \\ 1= \,& {} \beta \left[ \frac{u_{c_{m},+1}^{\prime }}{u_{c_{m}}^{\prime }}\frac{ \left( 1+\tau _{m}\right) \left( 1+\tau _{c_{m}}\right) }{\left( 1+\tau _{m,+1}\right) \left( 1+\tau _{c_{m},+1}\right) }\left( 1+{\widetilde{r}} _{+1}\right) \right] \nonumber \\ 1= & {} \beta \left[ \frac{u_{c_{m},+1}^{\prime }}{u_{c_{m}}^{\prime }}\left[ \left( 1-\tau _{k,+1}\right) r_{+1}+1-\delta \right] \right] . \end{aligned}$$
(10)

The first intratemporal optimality condition states that the relative price between importables and non-tradables (real exchange rate) must equate the ratio of marginal utilities between both goods. The next two (intertemporal) conditions are the standard Euler equations that state that the marginal rate of substitution between consumption today and tomorrow, must equate their relative price, evaluated at the cost of foreign borrowing and the rate of return of capital investment, respectively.

The firms

Three sectors with an equal number of representative firms produce the exportable, importable, and non-tradable goods. All sectors require capital as the only explicit production factor.Footnote 33 Next, we state the problems faced by the firms.

The importable good

The profits of the representative firm are determined by:

$$\begin{aligned} \pi _{m}=\left( 1+\tau _{m}\right) f\left( z_{m},k_{m}\right) -\left( 1+\tau _{m}\right) \left( 1+\tau _{c_{m}}\right) rk_{m}, \end{aligned}$$
(11)

where \(z_{m}\) is a productive shock and \(k_{m}\) is the amount of capital demanded.

The first-order optimality condition is:

$$\begin{aligned} f_{k_{m}}^{\prime }\left( z_{m},k_{m}\right) =\left( 1+\tau _{c_{m}}\right) r, \end{aligned}$$
(12)

which states that the marginal cost of new capital must equate its marginal value.

The output of this sector can be consumed or used as capital in any of the three sector.

The exportable good

The profits of firms producing the exportable good are determined by:

$$\begin{aligned} \pi _{x}=\left( 1-\tau _{x}\right) qf\left( z_{x},k_{x}\right) -\left( 1+\tau _{m}\right) \left( 1+\tau _{c_{m}}\right) rk_{x}, \end{aligned}$$
(13)

where \(\tau _{x}\) is an export tax, q is the relative price of exportables in terms of importables, \(z_{x}\) is a productive shock, and \(k_{x}\) is the amount of (importable) capital demanded by the exportable sector.

The first-order optimality condition is:

$$\begin{aligned} \left( 1-\tau _{x}\right) qf_{k_{x}}^{\prime }\left( z_{x},k_{x}\right) =\left( 1+\tau _{m}\right) \left( 1+\tau _{c_{m}}\right) r, \end{aligned}$$
(14)

This equation presents the optimality condition equivalent to (12).

The output of this sector is only consumed abroad.

The non-tradable good

The profits of the representative firm are determined by:

$$\begin{aligned} \pi _{n}=pf\left( z_{n},k_{n}\right) -\left( 1+\tau _{m}\right) \left( 1+\tau _{c_{m}}\right) rk_{n}, \end{aligned}$$
(15)

where \(z_{n}\) is a productive shock and \(k_{n}\) is the amount of (importable) capital demanded by the sector.

The first-order optimality condition is:

$$\begin{aligned} pf_{k_{n}}^{\prime }\left( z_{n},k_{n}\right) =\left( 1+\tau _{m}\right) \left( 1+\tau _{c_{m}}\right) r, \end{aligned}$$
(16)

which states the optimality condition of the sector, and has the same interpretation of (14).

The output of this sector is only consumed in the domestic economy.

The government

It is assumed that the government has no explicit objective function to maximize, but satisfies the following constraint:

$$\begin{aligned} g+F= \,& {} \tau _{m}\left( c_{m}+i-f\left( z_{m},k_{m}\right) \right) +\tau _{c_{m}}\left( 1+\tau _{m}\right) \left( c_{m}+i\right) \nonumber \\&+\tau _{x}qf\left( z_{x},k_{x}\right) +\tau _{c_{n}}c_{n}p+\left( 1+\tau _{m}\right) \left( 1+\tau _{c_{m}}\right) \tau _{k}rk, \end{aligned}$$
(17)

It is further assumed that a fraction \(\varkappa _{t}\) of the total government expenditures is used to consume the non-tradable good produced in the economy.

Market-clearing conditions

Define the productions of the exportable, importable, and non-tradable goods by:

$$\begin{aligned} y_{x}\,=\, & {} f\left( z_{x},k_{x}\right) \nonumber \\ y_{m}\,= \,& {} f\left( z_{m},k_{m}\right) \nonumber \\ y_{n}\,= \,& {} f\left( z_{n},k_{n}\right) . \end{aligned}$$
(18)

The market-clearing conditions are:

$$\begin{aligned} py_{n}\,= \,& {} pc_{n}+\varkappa g, \nonumber \\ -\left( b_{+1}-b\right)= \,& {} qy_{x}+y_{m}-c_{m}-\left( 1-\varkappa \right) g-k_{+1}+\left( 1-\delta \right) k-{\widetilde{r}}b, \end{aligned}$$
(19)

where the first equation describes the equilibrium in the non-tradable good market and the second the equilibrium in the importable good market, which shows that the current account balance must be compensated by the capital account balance.

To avoid having to model the world credit market, and following Bhandari et al. (1990), Turnovsky (1997), and Osang and Turnovsky (2000), we assume that the country faces an upward-sloping supply schedule for debt:

$$\begin{aligned} {\widetilde{r}}={\widetilde{r}}\left( b\right) ,\quad {\widetilde{r}}^{\prime }>0. \end{aligned}$$
(20)

Competitive equilibrium

A competitive equilibrium is a set of allocation rules \(c_{m}=C_{m}\left( s\right)\), \(c_{n}=C_{n}\left( s\right)\), \(k_{+1}=K\left( s\right)\), and \(b_{+1}=B\left( s\right)\), \(k_{x,+1}=K_{x}\left( s\right)\), \(k_{n,+1}=K_{n}\left( s\right)\), and \(k_{m,+1}=K_{m}\left( s\right)\), a set of pricing functions \(r=R\left( s\right)\), and \(p=P\left( s\right)\), and the laws of motion of the exogenous state variables \(s_{+1}=S\left( s\right) ,\) such that

  • Households solve the problem (9), taking as given s and the form of the functions \(R\left( s\right)\), \(P\left( s\right)\), and \(S\left( s\right)\), with the equilibrium solution to this problem satisfying \(c_{m}=C_{m}\left( s\right)\), \(c_{n}=C_{n}\left( s\right)\), \(k_{+1}=K\left( s\right)\), and \(b_{+1}=B\left( s\right)\).

  • Firms of the exportable, importable, and non-tradable sectors solve the problems (11), (13), (15), taking as given s and the form of the functions \(R\left( s\right)\), \(P\left( s\right)\), and \(S\left( s\right)\), with the equilibrium solutions to these problems satisfying \(k_{x,+1}=K_{x}\left( s\right)\), \(k_{n,+1}=K_{n}\left( s\right)\) , and \(k_{m,+1}=K_{m}\left( s\right)\).

  • The economy-wide resource constraints (19) hold each period, and the factor market clears:

    $$\begin{aligned} K_{x}\left( s\right) +K_{n}\left( s\right) +K_{m}\left( s\right) =K\left( s\right) . \end{aligned}$$

Functional forms

With the generic model specified, next we group functional forms in terms of preferences, production technology, government, and exogenous prices.

Preferences

We consider the following functional form:

$$\begin{aligned} u\left( c_{m,t},c_{n,t}\right) =\theta _{m}\ln c_{m,t}+\theta _{n}\ln c_{n,t}, \end{aligned}$$

with \(\theta _{m},\theta _{n}>0\) and \(\theta _{m}+\theta _{n}=1\).

Production technology

The production functions are assumed to be Cobb–Douglas:

$$\begin{aligned} f\left( z_{j,t},k_{j,t}\right) =e^{z_{j,t}}k_{j,t}^{\alpha _{j}}, \end{aligned}$$

where \(\alpha _{j}\) is the compensation for capital as a share of output of sector j for \(j=x,m,n\).

As we will compare deterministic steady states to evaluate the relative importance of skills and luck, the steady-state values of the productivity shocks (\(z_{j}\)) are calibrated to match the sectorial composition of GDP in Bolivia.

Fiscal variables

We calibrate different values for government expenditures (\({\overline{g}}\)) and other fiscal variables (taxes and tariffs), depending on whether or not we activate the treatment, reflecting that distortions increased during the treatment (bad skills). The specific way in which these variables are set is discussed below.

Exogenous prices

Next, we describe the functional forms chosen for the laws of motion of two external variables: terms of trade (q) and the borrowing rate (\(\widetilde{ r}\)) discussed in (20).

The steady state of terms of trade (\({\overline{q}}\)) is contingent on whether or not we activate the condition of a favorable terms of trade to assess the effects of “luck” . Further discussion is given below.

Finally, as discussed above, we assume that the country faces an upward-sloping supply schedule for debt and model it as:

$$\begin{aligned} {\widetilde{r}}_{t+1}={\overline{r}}+\varphi \frac{b_{t}}{y_{t}}, \end{aligned}$$
(21)

where \(y_{t}\) is total output (GDP), expressed in terms of importables.

Calibration and results

Next, we parameterize the model, distinguishing deep parameters from those that are considered to be affected by the treatment. Table 5 presents the values of the parameters that are assumed to be unchanged by the treatment and Table 6 the values of the parameters before and after the treatment.

Table 5 Deep parameters

The parameters \(\theta _{m}\) and \(\theta _{n}\) are chosen so as to reproduce the share of consumption on importables and non-tradables over total consumption in steady state. The subjective discount factor (\(\beta\)) was set to make it consistent with a 5% annual real interest rate.

The output-factor elasticities in each sector (\(\alpha\)) were set to match the sectorial shares on GDP, and consider that the exportable sector is more capital intensive than the other sectors.Footnote 34 The depreciation rate was set to 6%, while the constants of the production functions, government expenditures, and terms of trade were set to match the participation of each sector in total GDP.Footnote 35

Table 6 Values of the parameters before and after the treatment

Table 6 reports how we capture the effects of good luck and good skills. Regarding luck, it is associated with a positive terms of trade shock (increased q). During the treatment (after 2005), terms of trade were (on average) 50% higher than the average of the period before (1990–2005), and almost 40% higher (on average) than in the year before the treatment. As we are comparing steady states, it would be incorrect to assume that this increase is permanent. What we need is to obtain the level of a permanent shock that is equivalent (in present value) to a 50% temporary increase in terms of trade of 10 years. That is, we need to find:

$$\begin{aligned} \lambda _{q}=1.5\left( 1-\beta ^{9}\right) +\beta ^{10}\simeq 1.15, \end{aligned}$$
(22)

and consider a steady-state level of terms of trade 15% higher when we evaluate the effect of GL.

It is a bit more difficult to assess what the effects of the treatment were on the increased distortions faced by agents.Footnote 36 Furthermore, reliable figures for the finances of the public sector are not available.Footnote 37 What is clear is that the size of the public sector and the distortions have increased markedly, making private investment more costly, levied heavier taxes on the exportable sector and increased overall government expenditures. The magnitude of this changes is computed so as the share of government expenditure over GDP after the positive terms of trade shock increases by 2%.Footnote 38 This is equivalent to increasing government expenditures and taxes on capital and the exportable sector of 19%.Footnote 39

As with Sect. 3, here we conduct counterfactual experiments by changing parameters, solving the model with different configurations, and evaluating the effect on the variable of interest (what the model considers to be GDP).

As mentioned, there are several ways in which the exercise could be done. One, in which modifications are considered transitory, is to shock the system with a perturbation and follow the results. In this case, the laws of motion of the states (particularly their persistence) are key. As the model lacks of an analytical solution, numerical methods need to be used to solve for the optimal policies. In case second-order perturbation methods are used (as in Schmitt-Grohé and Uribe 2004), the volatility of the shocks would also be important. The other way to tackle the question is to consider that the counterfactual (or treatment) involves a permanent change in some variables. In that case, we could also evaluate the effects by comparing changes in the optimal policies, or simply evaluating the long-term effects by comparing changes in the (deterministic) steady states. The advantage of this approach is that it solves the fully fledged nonlinear steady state of the system, and does not require approximations of the policy functions. Furthermore, as far as the deterministic steady states are concerned, persistence and volatility are irrelevant. This is the approach we follow.

Concretely, we consider the same scenarios presented in Table 4. As the model is extremely nonlinear, it will be the case that changes in luck (skills) would have different effects on the economy, depending on the skills (luck) scenario that is considered.

As changes in terms of trade and/or distortions will lead to changes in allocations and relative prices, differences in GDP in each scenario are not directly comparable to the ones obtained in the previous sections. This is so, because in them, comparisons were made in dollars of a base year, while here, they are made in GDP expressed in terms of importables. One way to make the figures comparable is to compute GDP in prices of a baseline scenario. A natural baseline scenario would be Bolivia prior to the treatment, which in our case, corresponds to scenario C.

Figure 7 presents the results of comparing the changes in the steady-state GDPs of different scenarios, computed in terms of importables, and also in prices of scenario C. As previously, good luck is “good” unconditionally, and good skills enhance the effects of a positive external environment. These results suggest that the long-term effects of a substantial increase in terms of trade would have led to increases in GDP of between 8.9 and 9.9% when measured at the new relative prices. When measured at constant (scenario C) prices, the increments in GDP due to favorable terms of trade are between 3.7 and 4.1%. Figures are in line with our results of Sect. 3. On the other hand, good skills (less distortions) would amount to increases in GDP of between 6.4 and 7.4% (depending on the levels of terms of trade), when measured allowing changes of the real exchange rate, and between 5.6 and 6.1%, when measured at prices of scenario C. Thus, this exercise provides further support to the hypothesis that Bolivia’s recent economic bonanza is mostly due to the extremely favorable external conditions it faced, and that, the internal factors were very costly.

Fig. 7
figure7

Effects of skills versus luck with DSGE (fraction of GDP per capita). A–C depicts the effect of GL conditional on GS. B–D depicts the effect of GL conditional on BS. A–B depicts the effect of GS conditional on GL. C–D depicts the effect of GS conditional on BL. The lighter bars evaluate changes in GDP with the relative prices changed due to the scenarios. The darker bars correspond to the changes evaluated at the relative prices of the baseline scenario (C)

Concluding remarks

This paper intends to evaluate the relative importance of internal and external conditions on the economic bonanza Bolivia experienced.

As the external conditions were extremely favorable, with increases (of the terms of trade) of, on average, more than 50% since 2006 with respect to 2005, or, for that matter, any other period in the past, it is tempting to conclude that this is the main culprit of the bonanza. Nevertheless, Evo Morales’s government has not remained still and has also conducted major policy changes. Acolytes of the regime conclude that, it is mainly the policies that should be credited for the boom. Settling this dispute requires more than charts and graphs. As Evo Morales emerged as president of Bolivia in, roughly, the same period of favorable external conditions, it is not trivial to identify the causal effect of each.

This paper provides three complementary approaches to evaluate the relative importance of luck (favorable external conditions) that can not be attributed to the government, and skills (internal policies that could have fostered or lessened the effects of the external conditions). These approaches differ on identifying assumptions, the methodological approach, information used, and foundation on economic theory.

The first approach attempts to construct the counterfactual of how would have Bolivia fared since 2006 if Evo Morales (and his policies) would not have been implemented. To construct this counterfactual, a synthetic control (comprised of a weighted average of other countries) is derived. The results indicate that Evo Morales caused, on average, a loss in the level of GDP per capita of around 4.7% per year, since in office. They also suggest that conditions in other social indicators would not have been affected in his absence.

The second approach uses a panel of countries to evaluate the precise counterfactual of changing one factor (external or internal), and leaving the other constant. This approach imposes some restrictions in terms of the degree of homogeneity in responses by the countries, the proxies considered, and the requirement of super exogeneity (in the sense of Hendry). Meeting these conditions, we find an interesting nonlinearity due to the interaction between internal and external conditions. Put simply, good luck is enhanced with fewer distortions. This approach estimates that good luck provided up to 4% more on GDP per capita, while the increased distortions in the internal conditions lead to a decrease of up to 2% of GDP per capita. Thus, not taking into account secular conditions, the bonanza was due to external conditions, with internal conditions harming, more than helping.

The third and final approach uses a DSGE model to evaluate counterfactual scenarios. The model is calibrated so as to replicate the sectorial composition of GDP, and introduces changes in the structure of the model that are intended to accommodate the internal and external conditions observed prior to the treatment (Evo Morales), and change them to compute how the agents would react to them. This approach has the main benefit of providing an optimizing and internally consistent model that has to make explicit the interventions. It also helps to provide economic insights on the mechanisms at play. The results of this approach are qualitatively consistent with the previous findings. With GDP calculated at constant relative prices of the period prior to the treatment, the commodity prices boom may have caused increases of up to 4.1% (apart from secular trends), while increased internal distortions might have caused around a 6.1% drop in GDP.

Concluding, all the exercises conducted lead to similar conclusions. Bolivia’s recent bonanza is primarily due to incredibly favorable external conditions. If anything, the boom was not fully capitalized due to the increased distortions in the internal economic policies.

Thus, paraphrasing Sir Ronald Ross, the Government’s “favorite scam is pretending that luck is skill.”Footnote 40

Availability of data and materials

See Appendix 1.

Notes

  1. 1.

    Morales (2014) edits a volume that presents several studies quantifying the magnitude of resources that Bolivia received, thanks to the commodities prices boom.

  2. 2.

    The Latin phrase “post hoc, ergo propter hoc ” (after this, therefore, because of this) is a logical fallacy that states that because two events occurred in succession, the former event must have caused the latter event.

  3. 3.

    To my knowledge, there are no systematic studies that have tackled this question for the case of Bolivia.

  4. 4.

    Textbook treatments of alternatives are discussed in Angrist and Pischke (2009), Imbens and Rubin (2015), Lee (2016), and Pan and Bai (2015).

  5. 5.

    As pointed out by one of the referees, this method can be used to assess if the “Evo Morales treatment” is relevant, but not to evaluate the relative importance of the external and internal factors.

  6. 6.

    The choice of \(X_{1}\) should consider characteristics that could be interpreted as fundamentals behind the output variable, or a comprehensive description of the pre-treatment Bolivia.

  7. 7.

    We consider one hundred thousand candidates for V, generated using pseudo-random numbers. V is always normalized such that its trace is one.

  8. 8.

    Appendix 1 describes the datasets used. Appendix 2 presents the results of the synthetic control approach for the Gini coefficient, primary school dropout rate, infant mortality, and life expectancy.

  9. 9.

    One issue that is particularly relevant is to assess the importance of “luck,” measured by improved terms of trade. As terms of trade shocks can be considered as exogenous, we could use them as another relevant characteristic for the synthetic control. Including net barter terms of trade in the 2006–2016 period as an additional X variable does not significantly alter the results reported here.

  10. 10.

    This inferential tool is also known as the “falsification” or “refutability” test, intended to evaluate if the results obtained may be due to pure chance. See Abadie et al. (2010) for further references.

  11. 11.

    The placebo test requires to perform the optimization procedure described above for each country. For computational expediency, we consider one thousand randomly generated candidates for V.

  12. 12.

    As in Abadie et al. (2010), we also considered excluding of the placebo test countries that present more than 4.5 times the RMSE of Bolivia, with similar resuls.

  13. 13.

    Even bigger effects, of up to 6%, were found using GDP per capita (without the PPP conversion). Although the magnitude may also vary depending on the pre-treatment characteristics included, whenever they were matched, synthetic Bolivia performed systematically better than actual Bolivia during the “Evo Morales treatment” .

  14. 14.

    For example, Easterly et al. (1993) evaluate the importance of internal versus external determinants of levels and growth rates of GDP.

  15. 15.

    In this case, we say that x is “weakly exogenous” for \(\theta _{1}\). See Hendry (1995) for details.

  16. 16.

    In this case, we say that x is “super exogenous” for \(\theta _{1}\). See Hendry (1995) for details.

  17. 17.

    As is well known, the parameter associated with the trend component is super consistent. Thus, even if the variable were difference stationary, the process still has a valid representation, if cointegration is present.

  18. 18.

    A dynamic structure that includes lags of x and p can be considered. However, information (particularly of proxies of p) is not abundant for Bolivia. Thus, we privilege parsimony and conduct specification tests.

  19. 19.

    As the quote attributed to the Roman philosopher Seneca states, “luck is what happens when preparation meets opportunity” .

  20. 20.

    See Appendix 1 for the list of variables considered and their sources.

  21. 21.

    In fact, the 2019 report of the Heritage Foundation ranks Bolivia in place 173 out of 180 in terms of overall freedom, characterizing it is “repressed” . Other countries in this category are Cuba (178), Venezuela (179), and North Korea (180).

  22. 22.

    The results are robust to the choice of proxy for internal conditions. A previous version of the paper also considered the share of government expenditures over GDP as a proxy for p, with similar results.

  23. 23.

    As should be expected, Hausman specification tests reject the null of random effects in favor of fixed effects. A LRT rejects the null of redundant fixed effects. Finally, cross-dependence tests reject the null hypothesis of no correlation among the residuals of each country (Pesaran 2015).

  24. 24.

    Other specifications tests for the residuals of the panel (conditional) and univariate times series models (marginal) indicate that the residuals can be broadly characterized as homoskedastic, normal, and white noise processes.

  25. 25.

    In fact, distortions in the formal labor market have deteriorated so much that, according to Medina and Schneider (2018), Bolivia has the biggest informal sector in the world. For partial equilibrium evidence, see Nogales et al. (2019). For general equilibrium evidence, see Román (2011), Vargas (2009), or Sect. 4 below.

  26. 26.

    Describing as “good skills” to the economic policies pursued prior to 2006 is, admittedly, a bit of a stretch. Economic policies and political internal conditions have always produced a fragile environment in Bolivia. While corruption and distortions have always been present, these characteristics have increased substantially under the “treatment” . Furthermore, expropriations and reversals of market oriented policies have been a constant feature of the past years, as evidenced by the evolution of all the freedom indexes of the Heritage Foundation.

  27. 27.

    As noted by a referee, a third approach would require to solve the entire transitions subject to (possibly) time-varying policies, and compare the entire time series.

  28. 28.

    For completeness, the model is presented in its entirety.

  29. 29.

    As noted by a referee, we focus on comparing steady states before and after the treatment. As uncertainty is not required, we consider a deterministic version of the DSGE model of Chumacero et al. (2004).

  30. 30.

    For brevity, time t subscripts are eliminated.

  31. 31.

    As pointed out by a referee, this is a simplifying assumption, as investment has tradable and non-tradable components.

  32. 32.

    We define \(s_{h}=\left( \tau _{m},\tau _{c_{m}},\tau _{c_{n}},p,{\widetilde{r}} ,\tau _{k},r,k,b,F,\pi _{x},\pi _{m},\pi _{h}\right) .\)

  33. 33.

    This setup is consistent with a model in which labor is sector specific and is static.

  34. 34.

    The long-run shares on GDP for each sector are 11$ for exportables, 31% for importables, and 58% for non-tradables.

  35. 35.

    The tax on importables is set relatively low, as tariffs are low and a very dynamic smuggling sector is prevalent. Taxes on consumption of importables and non-tradables are set approximately equivalent to the value-added tax.

  36. 36.

    As discussed in Sect. 3, the indexes that proxy indicators of freedom have deteriorated by between 11 and 35 points. Furthermore, private investment and formal firms have faced expropriations. Finally, a large component of the increased distortions have taken the form of unproductive public investment and corruption. Linares (2018) shows that most of the public enterprises created under Evo Morales run deficits. These enterprises include a cell phone and computer company, a paper company, and textiles, among others. Public investment has also been used to build artificial grass soccer fields (a major hobby of Evo Morales) and a museum on his honor. Public investment changed from 620 million US$ in 2005 to 5.1 billion dollars in 2016.

  37. 37.

    For example, the IMF, ECLAC, the Bolivian Central Bank, the National Bureau of Statistics, and the Finance Ministry have different figures for the size of the public sector on the economy. This figures range from between 15% to almost 50%. The last figure is constructed by Kehoe et al. (2019).

  38. 38.

    Again, different official sources tell different stories regarding this magnitude. Public consumption and public investment have increased their participation on GDP by, between 3 and 10%, depending on the source considered. Total tax revenues (as a share of GDP) have increased by 1.7% (on average) according to the Ministry of Finance.

  39. 39.

    A referee suggested using Mendoza et al. (1994) to calibrate taxes. This task probed to be impossible as there are no reliable statistics of the different sources of tax revenue and tax base that can be used.

  40. 40.

    Sir Ronald Ross was a British medical doctor who received the Nobel Prize for Physiology or Medicine in 1902. Humorously, his quote referred to Wall Street. Fittingly, Sir Ross was a pioneer in the systematic analysis of control and treatment groups.

  41. 41.

    We do so because one of the main contentions of the Bolivian government is that there were significant improvements on social conditions that would not have occurred otherwise.

Abbreviations

BL:

bad luck

BS:

bad skills

CUSUM:

cumulative sum (test)

DSGE:

dynamic stochastic general equilibrium model

GDP:

Gross Domestic Product

GL:

good luck

GS:

good skills

PPP:

purchasing power parity

RMSPE:

Root mean squared percentage error

References

  1. Abadie A, Diamond A, Hainmueller J (2010) Synthetic control methods for comparative case studies: estimating the effect of California’s tobacco control program. J Am Stat Assoc 105(490):493–505

  2. Abadie A, Gardeazabal J (2003) The economic costs of conflict: a case study of the Basque country. Am Econ Rev 93(1):113–32

  3. Angrist J, Pischke J (2009) Mostly harmless econometrics. Princeton University Press, Princeton

  4. Arce L (2016) El Modelo Económico. Social, Comunitario, Productivo Boliviano, Ministerio de Economía y Finanzas Públicas

  5. Bhandari J, Haque N, Turnovsky S (1990) Growth, external debt, and sovereign risk in a small open economy. IMF Staff Papers 37:388–417

  6. Chang R, Kaltani L, Loayza N (2009) Openness can be good for growth: the role of policy complementarities. J Dev Econ 90(1):33–49

  7. Chumacero R, Fuentes R (2006) Economic growth in Latin America: structural breaks or fundamentals? Estudios de Economía 33(2):141–54

  8. Chumacero R, Fuentes R, Schmidt-Hebbel K (2004) Free trade agreements: how big is the deal?, DTBC 264, Central Bank of Chile

  9. Easterly W, Kremer M, Pritchett L, Summers L (1993) Good policy or good luck? Country growth performance and temporary shocks. J Monet Econ 32(3):459–83

  10. Feenstra R, Inklaar R, Timmer M (2015) The next generation of Penn world table. Am Econ Rev 105(10):3150–82

  11. Grier K, Maynard N (2016) The economic consequences of Hugo Chavez: a synthetic control analysis. J Econ Behav Organ 125(1):1–21

  12. Hendry D (1995) Dynamic econometrics. Oxford University Press, Oxford

  13. Imbens G, Rubin D (2015) Causal inference for statistics, social, and biomedical sciences. Cambridge University Press, Cambridge

  14. Kehoe T, Machicado C, Peres J (2019) The Monetary and Fiscal History of Bolivia, 1960–2017, Working Paper 25523, National Bureau of Economic Research

  15. Lee M (2016) Matching, regression discontinuity, difference in differences, and beyond. Oxford University Press, Oxford

  16. Linares J (2018) “Má s Ruido que Nueces, Análisis de los Emprendimientos Empresariales del Proceso de Cambio,” Grupo Sobre Política Fiscal y Desarrollo, 26, CEDLA

  17. Lucas R (1987) Models of business cycles. Blackwell, Oxford

  18. Medina L, Schneider F (2018) Shadow economies around the world: what did we learn over the last 20 years?, IMF Working Paper, WP/18/17

  19. Mendoza E, Razin A, Tesar L (1994) Effective tax rates in macroeconomics. cross-country estimates of tax rates on factor incomes and consumption. J Monet Econ 34:297–323

  20. Morales J (2014) editor, ¿Dónde Está la Plata? Cuantificación de los Ingresos Extraordinarios que Percibió Bolivia de 2006 a 2013, Fundaci ón Milenio

  21. Nogales R, Córdova P, Urquidi M, Rejas B (2019) On the relationship between labor market policies and outcomes in Bolivia: a search and matching approach. Estudios de Economía 46(1):61–87

  22. Osang T, Turnovsky S (2000) Differential tariffs, growth, and welfare in a small open economy. J Dev Econ 62:315–42

  23. Pan W, Bai H (2015) Propensity score analysis: fundamentals and developments. The Guilford Press, New York

  24. Pesaran H (2015) Time series analysis and panel data econometrics. Oxford University Press, Oxford

  25. Román S (2011) “Costos Laborales, Economía Informal y Reformas a la Legislación Laboral en Bolivia,” Master Of Science Thesis, Universidad de Chile

  26. Schmitt-Grohé S, Uribe M (2004) Solving dynamic general equilibrium models using a second-order approximation to the policy function. J Econ Dyn Control 28:755–75

  27. Turnovsky S (1997) Equilibrium growth in a small economy facing an imperfect world capital market. Revi Dev Econ 1:1–22

  28. Vargas J (2009) Bienestar y Ciclos Económicos en una Economía con Evasión y Sector Informal, Ph.D. Thesis, Universidad de Chile

Download references

Acknowledgements

I thank Boris Branisa, Luis Castro, Rodrigo Fuentes, Daniel Hernaiz, Carlos Gustavo Machicado, Pablo Mendieta, Alejandro Mercado, Oscar Molina, Ricardo Nogales, Antonio Saravia, Rodrigo Villareal, the participants of the 8th Bolivian Conference on Development Economics, the 2018 SECHI Conference, seminars at the Academia Boliviana de Ciencias Económicas, Universidad Católica Boliviana and Universidad Privada Boliviana, and two anonymous referees for helpful comments and suggestions. I also thank Guillermo Gómez, Alejandra Goytia, Esteban Michel, Solange Sardán, Luis Serrudo, and Alejandro Terán, for their valuable research assistance.

Funding

None.

Author information

The author is solely responsible for the article. The author read and approved the final manuscript.

Correspondence to Rómulo A. Chumacero.

Ethics declarations

Competing interests

The author declares no competing interests.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Appendices

Appendix 1: The data

Table 7 lists the series used for the synthetic control approach detailed in Sect. 2. The results of which are reported in Sect. 2 (for GDP per capita) and Appendix 2 (for the Gini coefficient, primary school dropout rate, infant mortality, and life expectancy).

Table 7 Information used in Sect. 2 and Appendix 2

Table 8 lists the series used for the panel data exercise of Sect. 3.

Table 8 Information used in Sect. 3

Table 9 lists the series used for the DSGE exercise of Sect. 4.

Table 9 Information used in Sect. 4

Appendix 2: Synthetic control: other results

This Appendix presents the results of applying the synthetic control procedure to assess the effects of the treatment (Evo Morales’s Presidency) in four social variables, namely the Gini coefficient, the school dropout rate, infant mortality rate, and life expectancy, as presented in Appendix 1.Footnote 41

As in the case of GDP per capita discussed in Sect. 2, we first find the optimal weights that define the synthetic control. Although the pre-treatment characteristics are always the same (see Table 2), the optimal weights will change depending on the variable of interest (Z). That is, the synthetic control that is used to evaluate the effect of the treatment on, for example, the Gini coefficient will not be the same to one used for other variable.

Table 10 shows which countries are used to form the synthetic control for each variable, while Table 11 presents the list of pre-treatment characteristics that we seek to match, the values obtained for synthetic Bolivia, and the simple average of the countries considered in each exercise. The number of countries that have information for the Gini coefficient and the dropout rate for the same years that Bolivia has, is reduced. More information is available on infant mortality rate and life expectancy.

Table 10 Optimal weights for synthetic control: other variables
Table 11 Pre-treatment characteristics

Although the synthetic controls do a better job than the simple average of countries, the RMSPE of the synthetic controls used for the Gini coefficient and the dropout rate are substantially higher than the ones for the other two variables, which are in line with the RMSPE of the synthetic Bolivia used in Sect. 2. This means that at least the results for the Gini coefficient and the dropout rate should be viewed with caution.

Figure 8 presents the placebo tests for all the variables. From them, we gather that the treatment (Evo Morales) had no discernible effect on any of the variables considered. In particular, the behavior of the difference between actual Bolivia and synthetic Bolivia pre- and post-treatment is noisy for the case of the Gini coefficient and the dropout rate. Even when there is a slight decline in the infant mortality rate and increase in life expectancy, the synthetic controls do no match well the behavior of these variables prior to the treatment.

Fig. 8
figure8

Placebo tests. The bold lines represent the difference between the observed variable in Bolivia and the synthetic control. The gray lines represent placebo test deviations for the other countries in the data set. The graphs exclude countries with pre-treatment RMSE 2.2 times higher than Bolivia. The vertical line corresponds to the year prior to the treatment (2005). Clockwise, the first panel presents the results for the Gini coefficient, the second for the dropout rate, the third for the infant mortality rate, and the fourth for life expectancy

In summary, there is no robust evidence to indicate that there were statistically significant improvements on the social indicators considered, due to the Evo Morales Presidency, when compared to the synthetic controls.

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made.

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Keywords

  • Bolivia
  • Synthetic control
  • Panel data
  • DSGE

JEL Classification

  • C32
  • C33
  • C53
  • E65