arrow
Return

Missing value replacement in strings and applications

delete2025-01-22
delete0
delete
OA
AI
G
Giulia Bernardini
C
Chang Liu
G
Grigorios Loukides *
A
Alberto Marchetti-Spaccamela
S
Solon P. Pissis
L
Leen Stougie
M
Michelle Sweering
DOI:10.1007/s10618-024-01074-3delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Missing values arise routinely in real-world sequential (string) datasets due to: (1) imprecise data measurements; (2) flexible sequence modeling, such as binding profiles of molecular sequences; or (3) the existence of confidential information in a dataset which has been deleted deliberately for privacy protection. In order to analyze such datasets, it is often important to replace each missing value, with one or more valid letters, in an efficient and effective way. Here we formalize this task as a combinatorial optimization problem: the set of constraints includes the context of the missing value (i.e., its vicinity) as well as a finite set of user-defined forbidden patterns, modeling, for instance, implausible or confidential patterns; and the objective function seeks to minimize the number of new letters we introduce. Algorithmically, our problem translates to finding shortest paths in special graphs that contain forbidden edges representing the forbidden patterns. Our work makes the following contributions: (1) we design a linear-time algorithm to solve this problem for strings over constant-sized alphabets; (2) we show how our algorithm can be effortlessly applied to fully sanitize a private string in the presence of a set of fixed-length forbidden patterns [Bernardini et al. 2021a]; (3) we propose a methodology for sanitizing and clustering a collection of private strings that utilizes our algorithm and an effective and efficiently computable distance measure; and (4) we present extensive experimental results showing that our methodology can efficiently sanitize a collection of private strings while preserving clustering quality, outperforming the state of the art and baselines. To arrive at our theoretical results, we employ techniques from formal languages and combinatorial pattern matching.
Keywords:
String algorithms
Forbidden patterns
Missing value replacement
String sanitization

Journal

Data Mining and Knowledge Discovery cover
Data Mining and Knowledge Discovery
IF:
4.3
Papers:
188
Citations:
6.0K

Organization

U
Univ Trieste
Scholars:
393
Papers: 236
Citations: 89
U
Univ Roma La Sapienza
Scholars:
234
Papers: 119
Citations: 22
C
cwi
Scholars:
4
Papers: 2
Citations: 0
K
Kings Coll London
Scholars:
2.0K
Papers: 1.3K
Citations: 377
researcher View more organizations