--- title: "Big Data Security Series Part 2: How Hard is it to Secure Big Data?" description: Find out what makes big data environments so difficult to secure. image: https://insights.comforte.com/hubfs/1.Data_how_hard_to_secure.jpg --- [![Hubspot_blog_logo](https://insights.comforte.com/hs-fs/hubfs/Hubspot_blog_logo.png?width=295&name=Hubspot_blog_logo.png)](http://www.comforte.com) [![Subscribe](https://no-cache.hubspot.com/cta/default/4026697/ba125972-4bdc-4e47-b9a9-81df496120a0.png)](https://cta-redirect.hubspot.com/cta/redirect/4026697/ba125972-4bdc-4e47-b9a9-81df496120a0) [![1.Data_how_hard_to_secure](https://insights.comforte.com/hubfs/1.Data_how_hard_to_secure.jpg)](https://insights.comforte.com/big-data-security-series-part-2-how-hard-is-it-to-secure-big-data) [Felix Rosbach](https://insights.comforte.com/author/felix-rosbach) l Nov 1, 2019 l [Data Protection](https://insights.comforte.com/tag/data-protection), [Compliance](https://insights.comforte.com/tag/compliance), [Big Data Analytics](https://insights.comforte.com/tag/big-data-analytics), [Cloud Computing](https://insights.comforte.com/tag/cloud-computing) # Big Data Security Series Part 2: How Hard is it to Secure Big Data? Survey says: exceedingly difficult. But why? Years ago, on traditional databases you had complete control over how to implement and protect your servers. You also had a manageable number of servers, let’s say around 10, you had your hardened environment, and you were able to do anything you wanted with the data you had. Over time, the number of inputs has exploded from web, mobile, digital workplaces, and so on. In order to process all that new data, now we need more storage and more computing power than you can fit in your garage. And by garage, of course I mean state-of-the-art, in-house data center. The fact is, big data means big resources. In response to this growing demand, cloud technology came along to help reduce the burden of in-house storage and processing, at times taking those roles over entirely. New analytics tools like Hadoop MapReduce framework help manage the growing amount of data. While very practical, cloud services add a lot of complexity to questions of security and compliance. Additionally, some enterprises utilize a multicloud environment to avoid vendor lock in, which can complicate things even further. Now, don’t get me wrong, cloud computing is great. It offers flexibility and insights like never before. And many companies are getting on board. As of 2018, [73% of global businesses](https://www.globenewswire.com/news-release/2018/09/11/1569178/0/en/Qubole-Announces-2018-Big-Data-Trends-and-Challenges-Report.html) performed big data processing in the cloud. And with IoT we’ll need even more power. Currently, [over 7 billion IoT devices are in use](https://iot-analytics.com/state-of-the-iot-update-q1-q2-2018-number-of-iot-devices-now-7b/) and that number is expected to reach 10 billion by the end of 2020. ## The more complex the network, the bigger the attack surface ![cloud computing](https://insights.comforte.com/hs-fs/hubfs/Stock%20images/Mammatus%20clouds%20over%20northern%20Illinois%20on%20a%20warm%20evening%20in%20June.jpeg?width=325&name=Mammatus%20clouds%20over%20northern%20Illinois%20on%20a%20warm%20evening%20in%20June.jpeg)But again, in terms of security, cloud computing and IoT makes things a lot more, well, cloudy. When you’ve deployed Hadoop systems on hundreds of systems, your infrastructure is much larger and much more difficult to protect. Let me try and illustrate: let’s say sensitive data is collected when someone submits information on a web form. What happens then? For every data set, there might be something like 10 copies in your network. And that data isn’t all stored and analyzed on-premises anymore, nowadays it’s going to be constantly moving between different environments, databases, and applications, which might be on-premises, in the cloud, or in a hybrid environment combining both. Take the Hadoop MapReduce framework for example. It’s based on groups of standard computers that process data in parallel. Unless care is taken to remove known technical vulnerabilities, manage and secure the multiple administrator accounts as well as the content of the multiple file systems, the framework is at risk from common cyberthreats that could impact the confidentiality of the data as well as the integrity of the analysis. In essence, MapReduce is just a bunch of machines with vulnerabilities like any other. The point I’m getting at here is that traditional perimeter defenses don’t cut it anymore because the network perimeter has become a lot more, I'll say it again, *cloudy*. The extent of the network is so broad that a perimeter can no longer be clearly defined and, as a consequence, traditional perimeter security can't fill in all the gaps. Organizations are struggling to adapt their cybersecurity strategy. [A 2019 survey](https://cyber-edge.com/wp-content/uploads/2019/03/CyberEdge-2019-CDR-Report.pdf) of 1200 IT decision makers across the globe revealed that 78% of organizations had experienced a successful cyberattack in the preceding 12 months. At this point, if you haven’t been hacked, you should almost be asking yourself, is it because my defenses are that good or is my company just that uninteresting? ## Internal and third party threats Putting external threats aside, there are plenty of internal threats to data security as well. They might be due to the oversight of a partner or just accidental exposure. Where third parties are involved in the analysis process, this can also increase the risks of data being copied or misused. For example, we often hear about misconfigured Amazon S3 instances where data was available in clear text. This is just human error which is nearly unavoidable.  Additionally, the data is at risk before it even arrives on the third parties’ network. In many cases, data in motion is not protected well and too often it’s not protected at all. ## Data privacy regulations So we have a massive amount of valuable data in our network, sensitive data is all over the place, and the lines of our network perimeter are blurred. Could things get any worse? The answer is yes, things can always get worse. Enter stage right the four letters of mass destruction: GDPR. Wherever personal data goes in your network, so too travels your regulatory obligations, and in a big data environment, that’s a lot of locations. And chances are GDPR isn’t the only data privacy regulation you have to comply with. So what’s next? How can we protect the data in all these instances and comply with all these data privacy regulations? How can we reap the benefits of big data analytics when there are so many challenges? Find out in the next post! --- | Share this:  | [![LinkedIn](https://insights.comforte.com/hubfs/Social%20Icons/linkedin%20icon.png)](https://www.linkedin.com/shareArticle?mini=true&url=https://insights.comforte.com/big-data-security-series-part-2-how-hard-is-it-to-secure-big-data&utm_medium=social&utm_source=linkedin) | [![Bluesky](https://insights.comforte.com/hubfs/Social%20Icons/bluesky_logo.png)](https://bsky.app/intent/compose?url=https://insights.comforte.com/big-data-security-series-part-2-how-hard-is-it-to-secure-big-data&utm_medium=social&utm_source=Bluesky) | ![Twitter](https://insights.comforte.com/hubfs/Social%20Icons/twitter_x_logo-1.png) | [![XING](https://insights.comforte.com/hubfs/Social%20Icons/xing-color2.png)](https://www.xing.com/spi/shares/new?url=https://insights.comforte.com/big-data-security-series-part-2-how-hard-is-it-to-secure-big-data&utm_medium=social&utm_source=xing) | [![Email](https://insights.comforte.com/hubfs/Social%20Icons/email%20icon.png)](mailto:?subject=Check%20out%20https://insights.comforte.com/big-data-security-series-part-2-how-hard-is-it-to-secure-big-data&utm_medium=social&utm_source=email%20&body=Check%20out%20https://insights.comforte.com/big-data-security-series-part-2-how-hard-is-it-to-secure-big-data&utm_medium=social&utm_source=email) | | --- | --- | --- | --- | --- | --- | ## SPOILER ALERT! Whether on-premises, in the cloud, or both, there's a security solution that travels with the data and allows you to perform analytics on data while it's still in a protected state. Click the button below to get our free white paper and learn how to develop a big data security strategy that fits your needs: [![Download White Paper](https://no-cache.hubspot.com/cta/default/4026697/ce3f06cf-2808-4a7f-b75f-c53126c48a70.png)](https://cta-redirect.hubspot.com/cta/redirect/4026697/ce3f06cf-2808-4a7f-b75f-c53126c48a70) ### Related posts ![Reuse, Reward: How Banks Can Safely Unlock the Value of Their Data](https://insights.comforte.com/hubfs/comforte%20AG_%20Reuse%20Reward_%20How%20Banks%20Can%20Safely%20Unlock%20the%20Value%20of%20Their%20Data_03.2025.png) Mar 12, 2026 l [Data Protection](https://insights.comforte.com/tag/data-protection) , [Payments Transformation](https://insights.comforte.com/tag/payments-transformation) , [Business Value](https://insights.comforte.com/tag/business-value) ### [Reuse, Reward: How Banks Can Safely Unlock the Value of Their Data](https://insights.comforte.com/reuse-reward-how-banks-can-safely-unlock-the-value-of-their-data?hsLang=en) The financial world is awash with data. But too few organizations are able to use it effectively. In [Bank Director’s *2025 Technology Survey*](https://www.bankdirector.com/wp-content/uploads/2025/09/2025TechReport-OpenVersion.pdf), one-third of US banking leaders cite an inability to harness data as a top technology challenge facing their... [Read more](https://insights.comforte.com/reuse-reward-how-banks-can-safely-unlock-the-value-of-their-data?hsLang=en) ![Delivering a Secure, Trusted Foundation for Cloud Growth at LGT](https://insights.comforte.com/hubfs/comforte%20AG_Delivering%20a%20Secure%2c%20Trusted%20Foundation%20for%20Cloud%20Growth%20at%20LGT_01.2026.png) Jan 15, 2026 l [Data Protection](https://insights.comforte.com/tag/data-protection) , [Business Value](https://insights.comforte.com/tag/business-value) ### [Delivering a Secure, Trusted Foundation for Cloud Growth at LGT](https://insights.comforte.com/delivering-a-secure-trusted-foundation-for-cloud-growth-at-lgt?hsLang=en) There’s a world of difference between retail and private banking. While the former is transactional and focused on the mass market, the latter is built on trust and personal relationships. That trust can be hard won, but is easily lost, especially... [Read more](https://insights.comforte.com/delivering-a-secure-trusted-foundation-for-cloud-growth-at-lgt?hsLang=en) ![Top Indicators You Have a Cybersecurity Problem—and What to Do About It](https://insights.comforte.com/hubfs/comforte%20AG_Top%20Indicators%20You%20Have%20a%20Cybersecurity%20Problem_and%20What%20to%20Do%20About%20It.png) May 22, 2025 l [Data Protection](https://insights.comforte.com/tag/data-protection) , [Digital Enablement](https://insights.comforte.com/tag/digital-enablement) ### [Top Indicators You Have a Cybersecurity Problem—and What to Do About It](https://insights.comforte.com/top-indicators-you-have-a-cybersecurity-problem-and-what-to-do-about-it?hsLang=en) Data is both blessing and curse to the modern enterprise. Yes, when analyzed effectively it can surface intelligence to improve decision making, customer engagement, process efficiency and, ultimately, drive revenue. But it also represents a major... [Read more](https://insights.comforte.com/top-indicators-you-have-a-cybersecurity-problem-and-what-to-do-about-it?hsLang=en) ### Service - [Contact](https://www.comforte.com/contact/) - [About us](https://www.comforte.com/company/) - [Blog](https://insights.comforte.com/) - [Press Releases](https://www.comforte.com/company/press-releases/) - [Career](https://www.comforte.com/company/career/) - [Resources](https://www.comforte.com/resources/) ### Germany comforte AG Abraham-Lincoln-Str. 22 65189 Wiesbaden Germany Phone: + 49 611 93199 00 Fax: + 49 611 93199 05 ### Australia comforte PTY Suite 20, 1 Rivett Road North Ryde NSW 2113 Australia Postal Address: PO Box 1710 Lane Cove NSW 1595 Australia Phone: +61 2 8197 0272 ### USA comforte Inc. 30 Wall Street, 8th Floor New York, NY 10005-2205 USA Phone: +1-646-438-5716 ### Singapore comforte Asia Pte. Ltd. 1 Raffles Place, #19-61 Tower 2  Singapore 048616 Phone: +65 6808 5507 - [Sitemap](https://www.comforte.com/sitemap/) - [Legal Notice](https://www.comforte.com/legal-notice/) - [Privacy Policy](https://www.comforte.com/privacy-policy/) © comforte AG 2026