Opening our data – is it worth the risk?
Big data and its analysis is a hot topic, but it is not just reserved for the world’s leading tech companies. Big data is creeping into business all over the world, into the way cities run, and even into the way governments go about their business. The potential uses for analysis of large data sets are vast, and their benefits wide-spreading, but what are the risks of opening our data to anyone, and is it worth it?
Government data:
Governments across the world are opening more of their data up to the general public. The reasons for this include:
- Increased government transparency (regarding crime rates, social services, etc. – prevents some “fake news”).
- Improved private products and services – allowing businesses to access these data sets to improve their own efficiency and effectiveness.
- Innovation – allowing individuals and firms to utilize the data for everything from building apps to teaching data analysis in schools and universities.
- Improved efficiency of government services – different governmental departments have access to all data, without having to file formal data requests.
- Impact measurement of government (federal, state or council) policies.
- Larger data sets provide more accurate trends, as well as new insights. [1]
One particular example that I wish to highlight is California State Government’s Open Data Portal [2], which was discussed by Mr. Chris Cruz (Chief Deputy Director and Deputy State CIO for the California Department of Technology) in a talk given to Stanford students on June 30th. The portal provides open data on all non-confidential undertakings for the state of California, from water management and recycling to economic and demographic information. This portal allows all of the afore mentioned benefits to be brought to the table in terms of the state’s proceedings, and it is particularly useful in California given the high density of data scientists in and around Silicon Valley in particular! Portals such as this one have helped the US to rank fourth globally for open data in an annual report by the World Wide Web Foundation, behind the UK, Canada and France. [3]
There are some problems associated with opening governmental data up to the public, however. An example of this is a survey by Direct Line Insurance in 2011 [4], which found that 11% of survey respondents claimed to have seen but not reported a crime in their area out of fear that it would make it more difficult to rent or sell their property, which raises questions over the quality of the data. On top of these sorts of problems, there are the inevitable concerns over the security of increased openness. Recent ransomware attacks across the world have highlighted these risks; in June of this year, an attack that started from an email attachment in Ukraine caused an Australian chocolate factory’s computer systems to go down![5] Although not specifically caused by data sharing, these events will inevitably make companies and governments more hesitant to share their information.
Personal data:
Many people do not object to sharing data about themselves. However, lots of people are less comfortable with it. We have seen recently in the US that 44 states have rejected the Trump administration’s request for voter information on the grounds that it is too intrusive. [6] Despite this, advertisers across the globe already use data they have collected on us to target their advertising. For example, if I sign up to a golf magazine’s weekly e-newsletter then advertisers can assume that I have an interest in golf, and hence target appropriate advertising towards me, rather than wasting money on “blanket advertising” (where everyone receives the same advert). This massively increases the “click-through-rate”, meaning a better ROI for the firm purchasing the advertising.
Furthermore, we are starting to see companies such as Datacoup [7] emerging, that offer us more for our data. These companies allow you to register your social media accounts, bank accounts and more, so that they can build up a substantial data set based on you and others, which they then sell on to buyers, giving you a slice of the profit.
Now, although my love of golf is not as sensitive as, say, a portion of my social security number, or my political affiliation, the point still stands – should we be more aware of the widespread use of our data?
In short, yes. Although most large data-owning companies are secure, that doesn’t mean that data sharing is risk free. It does open some doors to identity theft and other crimes, but the benefits that it proposes are far greater. We mustn’t let ourselves be held back out of fear – with the proper controls around data, it could massively improve the lives of individuals, the profits of companies and the fortunes of nations.
References:
[1]: opendatahandbook.org/guide/en/why-open-data/
[2]: data.ca.gov
[3]: World Wide Web Foundation, Open Data Barometer, available at devodb.wpengine.com/?_year=2016&indicator=ODB
[4]: spatial-economics.blogspot.co.uk/2011/07/crime-nudge.html
[5]: www.abc.net.au/news/2017-06-28/cadbury-chocolate-factory-targeted-in-ransomware-attack/8658222
[6]: www.cnn.com/2017/07/03/politics/kris-kobach-letter-voter-fraud-commission-information/index.html
[7]: datacoup.com
Image: mobilemarketingwatch.com/what-you-missed-in-2016-data-science-year-in-review-70613/
4 comments on “Opening our data – is it worth the risk?”
Comments are closed.
Great post on the risks and positives surrounding more transparency with our data. I definitely agree that with the right use of personal data and government data, we could enhance our ability to innovate and grow as a society. However, I think the issues surrounding sharing personal data are particularly accentuated in the medical field. I worked on a project previously which involved using data from customers at hospitals and clinics to advertise relevant medical devices and medication on their EMR (electronic medical records) interface. What we heard overwhelmingly from the patients and doctors we interviewed was the importance of patient data security, particularly with HIIPA rules in mind. Though we could make sure the data is secure up to a point, as you pointed out data transparency does leave us vulnerable to cyber attacks sometimes. As such, the power of data sharing, used here for more targeted advertisements to help the patient choose the right solution, is almost unlimited if used wisely and securely. However we cannot neglect the reality that not everyone uses the data for good.
Thanks for your feedback and insight, Abishek! You raise a really interesting point with regards to data sharing in the field of medicine, in particular the risk of exposure to cyber attacks. In the UK recently there was a ransomware attack on the NHS (primarily in England), which was not specifically aimed at stealing patient data, rather blocking the trusts’ access to it, bringing ERs to a shuddering halt. However, as you point out, there are a lot of benefits to data sharing in this field, provided the right security is in place! Another interesting area of study in the medical field is the use of AI. A friend of mine is currently working with a few universities to try and model the brain’s motor-context so people with spinal cord injuries can walk again, and AI is very important in this process. Medicine is certainly an interesting alternative to the usual tech startup-oriented uses for these emerging technologies!
Hi Chris,
I enjoyed reading your thoughts and especially the links you shared on Opening our data and it’s implications for governments and private persons.
To me thinking about Open Data also results in a philosophical question on how much control and power can we take away from individuals about their data and how much can the government or especially companies use people’s data without them often being full aware of the longterm consequences for their privacy.
I agree that open data can open doors to great innovations and it even should (be used)! On the other hand, there must be still an option for individuals to decide consciously which data they want to share, and which they want to keep to themselves. Currently, I feel that individuals are too often unaware and not properly informed of what it means to share certain data and how much of the data they share is used in all types of ways.
Now, if we imagine that we do want open data so that we don’t miss out on great improvements, innovations and possibilities for important fields, then there must be strict guidelines, regulations and especially more information and education on the topic to counter data misuse, especially for people who have no relation to IT. This sounds easier than it is, but only if properly regulated, there is a chance that people’s privacy and autonomy is not compromised on the long term.
Thank you for this article! It inspires to think further on the topic.
Good article! thank you! Reminds of the issue of software bug becomes hard when establishing the presence of bugs. Software testers are known for finding bugs and writing codes, and that support their testing. The harm of bugs could be a loss of data, financial loss, or leakage of critical and confidential information.