David Holtz's research while affiliated with University of California and other places

Publications (20)

Article
We study a field experiment of an incentivized review program on Airbnb and quantify its impact on reviewing behavior and market outcomes.
Article
Considering the recent effects of remote work on network structure.
Article
Full-text available
The coronavirus disease 2019 (COVID-19) pandemic caused a rapid shift to full-time remote work for many information workers. Viewing this shift as a natural experiment in which some workers were already working remotely before the pandemic enables us to separate the effects of firm-wide remote work from other pandemic-related confounding factors. H...
Preprint
Full-text available
Online reviews are typically written by volunteers and, as a consequence, information about seller quality may be under-provided in digital marketplaces. We study the extent of this under-provision in a large-scale randomized experiment conducted by Airbnb. In this experiment, buyers are offered a coupon to review listings that have no prior review...
Article
Full-text available
Reputation systems are used by nearly every digital marketplace, but designs vary and the effects of these designs are not well understood. We use a large-scale experiment on Airbnb to study the causal effects of one particular design choice—the timing with which feedback by one user about another is revealed on the platform. Feedback was hidden un...
Article
Full-text available
In an interconnected world, understanding policy spillovers is essential. We propose a program evaluation framework to measure policy spillover effects and apply that framework to study the governmental responses to COVID-19 in the United States. Our analysis suggests the presence of social spillovers. We estimate that while state closures directly...
Article
Full-text available
In a two-sided reputation system, it is in the interest of both buyers and sellers to be a good transaction partner. What sounds wonderful in theory is unfortunately not so easy to implement in reality. Reputation systems can have flaws due to factors such as reciprocity and retaliation, selective reviewing, and reputation inflation. These flaws ca...
Preprint
The COVID-19 pandemic has had a wide-ranging impact on information workers such as higher stress levels, increased workloads, new workstreams, and more caregiving responsibilities during lockdown. COVID-19 also caused the overwhelming majority of information workers to rapidly shift to working from home (WFH). The central question this work address...
Preprint
Social distancing is the core policy response to COVID-19. But as federal, state and local governments begin opening businesses and relaxing shelter-in-place orders worldwide, we lack quantitative evidence on how policies in one region affect mobility and social distancing in other regions and the consequences of uncoordinated regional policies ado...
Preprint
Online marketplace designers frequently run A/B tests to measure the impact of proposed product changes. However, given that marketplaces are inherently connected, total average treatment effect estimates obtained through Bernoulli randomized experiments are often biased due to violations of the stable unit treatment value assumption. This can be p...
Preprint
In an A/B test, the typical objective is to measure the total average treatment effect (TATE), which measures the difference between the average outcome if all users were treated and the average outcome if all users were untreated. However, a simple difference-in-means estimator will give a biased estimate of the TATE when outcomes of control units...
Preprint
It remains unknown whether personalized recommendations increase or decrease the diversity of content people consume. We present results from a randomized field experiment on Spotify testing the effect of personalized recommendations on consumption diversity. In the experiment, both control and treatment users were given podcast recommendations, wi...

Citations

... This provides scientific evidence for public managers, who had to consult anecdotal evidence (see Bilotta et al., 2021), business surveys (Yang et al., 2022), or research from before the crisis (de Vries et al., 2019) on how to support employees in a virtual workenvironment. Unfortunately, our results suggest that there is little they can do to facilitate positive outcomes and reduce negative side-effectsaside from selecting self-disciplined public servants. ...
... Cohesive underlying theories to explain the dimensions and facets of freelancing are in the process of being applied or developed (Poon 2019;Wagner et al. 2021;Aguinis and Lawal 2013;Bögenhold and Klinglmair 2016;McKeown 2016;Syrett 2016). Existing studies have only focused on macro-level factors, linking freelancing to shifts in the labor force, global mobility, and access to knowledge and skills (Syrett 2016;Abreu et al. 2019;Annink 2017;Meager 2016;McKeown and Leighton 2016;Holtz et al. 2022;Nikolova 2019;Obschonka et al. 2014). These studies have been limited to a few narrow domains, including book publishing (George and Ng 1997), information technology and software development (Sultana et al. 2019;Gupta et al. 2020aGupta et al. , 2020b, fintech freelancers (Damian and Manea 2019), freelance jazz musicians (Elstad 2015), freelance journalists (Norbäck and Styhre 2019), and internet freelancers (Shevchuk et al. 2015). ...
... There is a growing literature that designs more complex randomized experiments. One strand of the literature addresses issues caused by interference, when individuals interact with one another through an equilibrium, a network, or a market platform Fradkin et al. (2021); Eckles et al. (2017). There is a large literature on cluster-randomized designs, see Hudgens and Halloran (2008) for a general cluster design, Harshaw et al. (2021) for design in two-sided markets, and Leung (2022) for designs under a spatial model. ...
... Die Kommunikation verläuft über digitale Medien, wie Telefon, Mails oder Videokonferenzen. In der digitalen Zusammenarbeit kann es daher zu mehr Koordinationsproblemen kommen (Yang et al., 2022). Insgesamt scheint es schwieriger zu sein, neue Informationen zu erhalten und sich spontan auszutauschen (Yang et al., 2022). ...
... But among those being sent home because of the pandemic restrictions, a certain amount of commuting is required. The reason for this is that they are dealing with more meetings (DeFilippis et al., 2020), static collaboration and an increase in asynchronous communication (Yang et al., 2021). According to a recent study, about 30% of employees reported that their work and private lives had worsened, while about 10% reported improvements in their work and 13% in their private lives (Tušl et al., 2021). ...
... Pandemic transmission and policy interventions are interdependent among regions. Interventions to contain the virus spread may go beyond the regions it directly affects [1,2]. Specifically, interventions of one region may exert spatial spillover effects (SSE hereafter) to neighboring regions by affecting the human behavior of nearby regions. ...
... For example, the limited capacity of properties in peer-to-peer rental platforms has resulted in a relatively scant number of reviews compared with hotel booking platforms (Liang, Schuckert, Law, & Chen, 2020). Some studies have also indicated the existence of review or rating bias on peer-to-peer rental platforms, such as Airbnb (Holtz & Fradkin, 2020;Pera, Viglia, Grazzini, & Dalli, 2019). Zervas, Proserpio, and Byers (2021) compared the rating distribution between Airbnb properties and TripAdvisor hotels and found that the ratings in Airbnb are relatively much higher and have lower variations than those in TripAdvisor. ...
... As regards the impact of the parameters of the model, it has been suggested that there is a trade-off between the usual notion of performance (engagement or accuracy) and the notion of diversity (Holtz et al. 2020). To investigate this relation, in Fig. 4 we show how the number of latent factors impacts the diversity 7 of the recommendations exposed to the users, along with the model performance (measured by the NDCG, in black dashed lines). ...
... Causal inference plays a central role in many disciplines, from economics (Varian, 2016;Holtz et al., 2020) to health sciences (Antman et al., 1992;Loucks and Thuma, 2003) and social sciences (Sobel, 2000;Gangl, 2010). The goal of causal inference is to estimate the effect of an intervention on individuals' outcomes. ...
... The wave of migrant workers returning from urban areas to their rural homes following the initial lockdown in India sparked a rural Covid outbreak [14] that could have been mitigated with better coordination of policy responses across the country (for example, putting in place quarantine centers and testing facilities before the lockdown was announced to prepare for the returning workers). This is also true elsewhere; Holtz and colleagues show that in the USA mobility patterns in one region were influenced by policy measures in other regions [15]. ...