Data Anonymization that Leads to the Most Accurate Estimates of Statistical Characteristics

Authors

Gang XiangFollow
Vladik Kreinovich, The University of Texas at El PasoFollow

Publication Date

1-2013

Comments

Technical Report: UTEP-CS-12-42a

To appear in Proceedings of the IEEE Series of Symposia on Computational Intelligence SSCI'2013, Singapore, April 16-19, 2013.

Abstract

To preserve privacy, we divide the data space into boxes, and instead of original data points, only store the corresponding boxes. In accordance with the current practice, the desired level of privacy is established by having at least k different records in each box, for a given value k (the larger the value k, the higher the privacy level).

When we process the data, then the use of boxes instead of the original exact values leads to uncertainty. In this paper, we find the (asymptotically) optimal subdivision of data into boxes, a subdivision that provides, for a given statistical characteristic like variance, covariance, or correlation, the smallest uncertainty within the given level of privacy.

In areas where the empirical data density is small, boxes containing k points are large in size, which results in large uncertainty. To avoid this, we propose, when computing the corresponding characteristic, to only use data from boxes with a sufficiently large density. This deletion of data points increases the statistical uncertainty, but decreases the uncertainty caused by introducing the privacy-related boxes. We explain how to compute an optimal threshold for which the overall uncertainty is the smallest.