Policy evaluation for temporal and/or spatial dependent experiments

Shikai Luo

doi:10.1093/jrsssb/qkad136

Policy evaluation for temporal and/or spatial dependent experiments

2024-01-05

0

OA

AI

DOI：10.1093/jrsssb/qkad136

Original

Original request for help

Save

Abstract

En 中文

The aim of this article is to establish a causal link between the policies implemented by technology companies and the outcomes they yield within intricate temporal and/or spatial dependent experiments. We propose a novel temporal/spatio-temporal Varying Coefficient Decision Process model, capable of effectively capturing the evolving treatment effects in situations characterized by temporal and/or spatial dependence. Our methodology encompasses the decomposition of the average treatment effect into the direct effect (DE) and the indirect effect (IE). We subsequently devise comprehensive procedures for estimating and making inferences about both DE and IE. Additionally, we provide a rigorous analysis of the statistical properties of these procedures, such as asymptotic power. To substantiate the effectiveness of our approach, we carry out extensive simulations and real data analyses.

Keywords:

A/B testing

policy evaluation

spatio-temporal dependent experiments

varying coefficient decision process

Policy evaluation for temporal and/or spatial dependent experiments

Abstract

Journal

Organization