News & Insights

Anonymization and Compelled Destruction Requirements for Companies

A seated conference audience seen from behind

INTRODUCTION

Data privacy laws complicate the ability of companies to manage information by: (1) compelling their destruction before fulfilling business or operational needs; and (2) limiting how information can be shared or transferred. This article discusses anonymization techniques and options to deal with compelled destruction requirements for companies collecting and storing personal information for valid business reasons. It also briefly explores arguments about sharing, transferring, and even publishing personal data that has been anonymized.

Laws

To explain the options anonymization can provide, it’s useful to first set the legal landscape by discussing data privacy laws and definitions. A type of privacy law that often causes compliance headaches for many companies is compelled destruction requirements, which specify a fixed or event-driven amount of time in which personal data must be destroyed. The Netherlands “Exemption Data Protection Act” contains many examples of compelled destruction requirements. One example, article (8)(5) requires that “payroll data be deleted no later than two years after the employment.”Footnote [1] This demonstrates how little room for interpretation compelled destruction requirements allow. The problem is that most companies need to keep payroll records for longer than 2 years after employment ends for operational reasons, such as defending against wage and discrimination claims and reviewing an employee’s payment history to guide requests or analysis for wage increases.

What constitutes personal information is not usually as clear as the Netherlands example. It will be defined by each law, and is not usually limited to just sensitive information, such as social security numbers, or financial and health information. Most laws take a more ubiquitous approach, for example the UK’s Data Protection Act defines personal data as “…data that relates to a living individual who can be identified from those data or from those data and other information which is in the possession of, or is likely to come into the possession of, the data controller and includes any expression of opinion about the individual…”Footnote [2] Data controllers are defined broadly, to include anyone “obtaining, recording or holding the [personal] information or data.”Footnote [3] Information that, when combined with other information that is or could likely become available, identifies an individual, would meet the above definition of personal data.Footnote [4]

Anonymization Options:

The UK Information Commissioners Office (ICO)Footnote [5] defines Anonymization as “the process of turning data into a form which does not identify individuals and where identification is not likely to take place.Footnote [6]” There are several anonymization methods which will be explained in the table below, but all generally seek to remove identifiers by removing, masking, or disguising personal information. Used correctly, the ICO provides that “anonymization can allow us to make information derived from personal data available in a form that is rich and usable, whilst protecting individual data subjects.”Footnote [7]

UK’s Information Commissioners Office developed an Anonymization Code in the context of sharing data that otherwise would be restricted by privacy concerns, but it’s also useful in exploring options for companies retaining personal information. The code states that if techniques are correctly used, it will allow many types of anonymized data to be shared publically and privately in compliance with the UK Data Protection Act and other Privacy Regulations.Footnote [8] The threshold used is the  likelihood of identification at the time of the data share and the standard is not that re-identification is impossible, but that given the data that is currently out and likely to come out in the near future, that re-identification is unlikely.Footnote [9]

Which anonymization option to use depends on the situation and the goals of the anonymization project.Footnote [10] The table below lists many of the options for anonymization and is categorized by the basic principle involved in the anonymization. It also lists variations, and general as well as company-specific uses, including its usefulness in dealing with personal data.

Anonymization options by basic principle
Basic principleTypesGeneral technique overviewVariationsGeneral usesCompanies: personal data
Remove personal dataMasking, redaction, reduction, removal, suppressionRemoval of personal identifiers such as social security numbers, names, addresses, birthdays, or other variables which provide direct or indirect identifiers.Partial data removal: Removal of some identifiers while some remain.
Automated redaction: An automated process for redacting targeted data.
Often used for de-classification of documents. Best used on reports or other documents where removing scattered items. Handles data restriction needs. If used for data sets, it is best used internally, because data would still exist in an individualized form, presenting risk. This technique will not be as useful where the personal data contains variables being measured in the analysis.For company records, this approach can be both time consuming and damaging to the content of the records being anonymized. If identifying information were removed, the content of the document that could be used to defend against various claims, or used to guide an analysis for salary increase, for example, would not be helpful. However, in the context of data analytics, where the goal is not to preserve information about individuals, but to identify trends, suppressing the identifiers could meet the goal of complying with personal information requirements while retaining the functional use of the data.
Replace personal data with an encryption or pseudonymEncryption, pseudonymisation, replacementDe-identifying data so that an encryption, coded reference, or pseudonym is attached to a record to allow the data to be associated with a particular individual without the individual being identified.Deterministic modification: The same original value is always replaced by the same modified value.
AES Encryption Algorithm: Advanced Encryption Standard.
Tokenization: Encrypting using a mapping table which maps values in the original data set to modified values.
Internal, or to parties that do not have information that could be used to re-identify. This technique has risk because it still exists in an individualized form.Encryption anonymizes data while preserving the important aspects of a record so when used by a company, this method may provide the best option for dealing with compelled destruction requirements while balancing company needs for records.
Aggregate data or statistical dataAggregation/tabular reporting, statistical dataData is aggregated so no data relating to individuals is shown. Small numbers may be suppressed.Cell suppression / Inference Control: Suppression of data categories or cells with small numbers where identification could be possible or where sample size is too small so that there may be sampling errors.
Cross-tabulation of data: The data is comprised of a table with two or more variables, tabulating the variables and creating a contingency table.
Rounding: Replacing a more complex number with the nearest and most approximately equal simpler number.
Sampling: Where there is a large enough number of data sets available that a sample is adequate for statistical purposes.
Swapping / Synthetic data: Mixing the data up so that totals are the same but individual data has been changed.
Best used in reports, samples, or surveys where there is a large number of individuals’ data involved and where statistics or trends about the information can be substituted for the actual data.When used for purposes such as reviewing average pay in determining salary, or other determinations where an aggregate of the data is all that is needed, this method satisfy company needs while resolving privacy concerns.
Changing the dataPerturbation, randomizationMaking changes to the data or completely randomizing the data. Often times, totals are the same, but individual data has been changed or randomized.Barbarization: Randomly adding or subtracting 1 from cells in the table so that it is unclear which values are accurate and which are not. Totals will remain the same.
Adding noise: Adding a random value to the protected values.
Resampling: This requires estimating how a variable is distributed and generating a distorted sample with the same values as the estimate. The personal data is then replaced with the distorted data.
Best used in reports, samples, or surveys where there is a large number of individuals’ data involved and where statistics or trends about the information can be substituted for the actual data.Same as Aggregate Data or Statistical data.
Deriving or generalizing dataDerived data, generalizationData that has been derived or generalized so that it reflects the character of the source data, but exact original values have been replaced.Banding: Replacing individualized data with similar equivalents, such as birthday with age or address with zip codes.Best used in reports, samples, or surveys where there is a large number of individuals’ data involved and where statistics or trends about the information can be substituted for the actual data.Same as Aggregate Data or Statistical data.
Controlling accessData quarantiningControlling who has access to data so that recipients that have access that could facilitate re-identification are excluded. Though not an anonymization technique, this can be used with many of the above mentioned techniques to reduce the risk of re-identification.Departmental: Restricting access by department.
Security Clearance: Restricting access by security clearance.
Limited Release: Limiting the audience for releases of items containing sensitive information.
Limiting access to sensitive information to those who have a low risk of re-identification.Companies do this already, limiting who has access to their records, though this could be used more effectively in combination with one of the above techniques.

[11]

USING ANONYMIZATION FOR COMPLIANCE

Encryption, as outlined above, is a powerful tool for companies looking to comply with compelled destruction requirements. Encrypted data is anonymized data that has a potential to be re-identified through the use of a key. By definition, anonymized data falls outside the scope of the compelled destruction requirements in many personal data laws. Some laws go so far as to state so expressly, like the UK Protection Directive of 1995, which provides that its regulations on data protection do not apply to “data rendered anonymous in such a way that the data subject is no longer identifiable.”Footnote [12]

The major key to the success of anonymization is anticipating and preventing re-identification, as the parties of some high profile examples of failed attempts can confirm. For example, when AOL released search queries from its users over a three-month span, it replaced user IDs with unique numbers, but used a deterministic modification method, meaning that every search conducted by the same user had the same unique number.Footnote [13] The content of the searches themselves, like searches based on dating habits, ailments, dog training, and for real estate, were enough for reporters from the New York Times to identify one user.Footnote [14] Because the searches themselves contained personal information that could be analyzed to re-identify, they should have been further anonymized to prevent re-identification, even if that meant some loss of valuable data. In another example, Netflix released a dataset of user movie ratings as part of a competition to improve its recommendations analytics method.Footnote [15] Researchers were able to use that data, along with publically available ratings information from IMDB, to identify some users.Footnote [16] In releasing the data, Netflix failed to identify public information that could be used in conjunction with the data to re-identify.

One issue increasing the likelihood of re-identification is that releases of anonymized data draw the attention of computer scientists that see re-identification as a resume-building activity. Footnote [17] This incentivizes re-identification at the cost of the individuals whose data is then released.Footnote [18] Without these efforts, it may be unlikely that re-identification would occur, but with the increased attention, a higher level of sophistication is necessary to prevent against re-identification. Going back to the guidance provided by the UK’s Information Commissioners Office, the level of sophistication that previous re-identification efforts exhibited should be taken as a warning to companies looking to release anonymized data. Increased planning and scrutiny of data will be necessary before future release occurs, and the threshold that re-identification will be unlikely has become more complicated and difficult to meet.

Given this threshold, there are some that question the feasibility of anonymization in publically releasing de-identified data in general.Footnote [19] They question whether it is ever really unlikely that re-identification will occur with developing technology and capabilities Footnote [20] Paul Ohm, an associate professor at University of Colorado Law School, goes so far as to state that “data can be either useful or perfectly anonymous but never both.”Footnote [21] The counter to this argument is that it’s a sensationalist theory based on assumptions, and that examples of failures to adequately anonymize do not condemn the practice, but instead provide learning opportunities to improve. Footnote [22]

CONCLUSION

Whether heightened scrutiny and better anonymization techniques will lead to a lower chance of re-identification when data is released publically is a debate that only the success or failure of more thorough future anonymization attempts will decide. However, anonymizing data and keeping it internal, or limiting the audience that has access, is a step in the right direction for companies seeking compliance with privacy laws. The risk of re-identification discussed in the high profile Netflix or AOL cases would have been highly unlikely if the anonymized data was kept private or released to a controlled audience. A controlled release, or keeping the data internal, provides the protections that data privacy laws and compelled destruction requirements mandate while letting companies keep information for a reasonable time based on their operating and liability needs.

Disclaimer: The purpose of this post is to provide general education on Information Governance topics. The statements are informational only and do not constitute legal advice. If you have specific questions regarding the application of the law to your business activities, you should seek the advice of your legal counsel.

Back to reference [1] Netherlands Exemption Data Protection Act 2013 (8)(5), Dutch statute text (wetten.overheid.nl)

Back to reference [2] United Kingdom Data Protection Act 1998 (1)(1), (Reprinted Incorporating Corrections 2005). Data Protection Act 1998, PDF (legislation.gov.uk)

Back to reference [3] Id.

Back to reference [4] See UK Information Commissioners Office “Anonymization: managing data protection risk code of practice” Chapter 2 “Anonymization and personal data” Code of practice, PDF (ico.org.uk)

Back to reference [5] The UK Information Commissioners Office is an Authority created to “uphold information rights in the public interest, promoting openness by public bodies and data privacy for individuals.” They are tasked with enforcing the UK Data Protection Act 1998 and created the “Anonymization: managing data protection risk code of practice.” About the ICO (ico.org.uk)

Back to reference [6] UK Information Commissioners Office (ICO) Anonymization webpage. ICO anonymisation guidance (ico.org.uk)

Back to reference [7] UK Information Commissioners Office “The Guide to Data Protection” Information Commissioner’s foreword “Retaining personal data (Principle 5)” Guide to Data Protection (ico.org.uk)

Back to reference [8] Id. at Section “Retaining personal data (Principle 5)”

Back to reference [9] Id. at Section 1 “About this code.”

Back to reference [10] See UK Information Commissioners Office “Anonymization: managing data protection risk code of practice” Annex 3 for “Practical examples of some anonymization techniques” Code of practice, PDF (ico.org.uk)

Back to reference [11] Summarized from Id.

Back to reference [12] Id. at “Information Commissioner’s foreword”

Back to reference [13] A Face Is Exposed for AOL Searcher No. 4417749 Article (nytimes.com)

Back to reference [14] Id.

Back to reference [xv] Netflix Prize Competition. Netflix Prize website (netflixprize.com)

Back to reference [15] Researchers reverse Netflix anonymization Article (securityfocus.com)

Back to reference [16] “Anonymized” data really isn’t—and here’s why not. Article (arstechnica.com) discussed how Latanya Sweeney and other computer scientists take re-identification as a challenge.

Back to reference [18] Id.

Back to reference [19] Sticky data: Why even ‘anonymized’ information can still identify you. Article (theglobeandmail.com)

Back to reference [20] The authors state that “there is no evidence that de-identification works either in theory or in practice and attempts to quantify its efficacy are unscientific and promote a false sense of security by assuming unrealistic, artificially constrained models of what an adversary might do.[xx]” No silver bullet: De-identification still doesn’t work; Arvind Narayanan & Edward W. Felten. July 9, 2014. Paper, PDF (randomwalker.info)

Back to reference [21] University of Colorado Law School associate professor Paul Ohm: Broken Promises of Privacy: Responding to the Surprising Failure of Anonymization. August 13, 2009. UCLA Law Review, Vol. 57, p. 1701, 2010. U of Colorado Law Legal Studies Research Paper No. 9-12

Back to reference [22] Big Data and Innovation, Setting the Record Straight: De-identification Does Work. Ann Cavoukian, Ph.D. Information and Privacy Commissioner Ontario, Canada. Daniel Castro, Senior Analyst, Information Technology and Innovation foundation. June 16, 2014. Report, PDF (itif.org)

Headshot of Rick Surber

Author: Rick Surber, CRM, IGP

Senior Analyst / Licensed Attorney