https://insideainews.com/tag/data-lakes/ Illuminating AI's Frontiers: Your Go-To News Destination. Thu, 01 Feb 2024 00:38:26 +0000 en-US hourly 1 https://wordpress.org/?v=6.6.1 https://insideainews.com/wp-content/uploads/2024/06/iain-favicon.png https://insideainews.com/tag/data-lakes/ 32 32 136462205 https://insideainews.com/2024/02/02/introducing-the-streaming-datalake/ https://insideainews.com/2024/02/02/introducing-the-streaming-datalake/#respond Fri, 02 Feb 2024 11:00:00 +0000 https://insidebigdata.com/?p=34734 In this contributed article, Tom Scott, CEO of Streambased, outlines the path event streaming systems have taken to arrive at the point where they must adopt analytical use cases and looks at some possible futures in this area.]]> https://insideainews.com/2024/02/02/introducing-the-streaming-datalake/feed/ 0 34734 https://insideainews.com/2023/09/07/navigating-data-lake-challenges-governance-security-and-gdpr-compliance/ https://insideainews.com/2023/09/07/navigating-data-lake-challenges-governance-security-and-gdpr-compliance/#comments Thu, 07 Sep 2023 18:06:18 +0000 https://insidebigdata.com/?p=33339 In this contributed article, Coral Trivedi, Product Manager at Fivetran, discusses how enterprises can get the most value from a data lake. The article discusses automation, security, pipelines and GSPR compliance issues. ]]> https://insideainews.com/2023/09/07/navigating-data-lake-challenges-governance-security-and-gdpr-compliance/feed/ 1 33339 https://insideainews.com/2023/07/04/why-do-we-prefer-elt-rather-than-etl-in-the-data-lake-what-is-the-difference-between-etl-elt/ https://insideainews.com/2023/07/04/why-do-we-prefer-elt-rather-than-etl-in-the-data-lake-what-is-the-difference-between-etl-elt/#comments Tue, 04 Jul 2023 10:10:00 +0000 https://insidebigdata.com/?p=32768 In this article, Ashutosh Kumar discusses the emergence of modern data solutions that have led to the development of ELT and ETL with unique features and advantages. ELT is more popular due to its ability to handle large and unstructured datasets like in data lakes. Traditional ETL has evolved into cloud-based ETL which allows rapid batch processing, scalability, savings, and simplicity while maintaining security, governance, and compliance. ]]> https://insideainews.com/2023/07/04/why-do-we-prefer-elt-rather-than-etl-in-the-data-lake-what-is-the-difference-between-etl-elt/feed/ 1 32768 https://insideainews.com/2022/04/29/data-virtualizations-ubiquity-data-meshes-data-products-data-lake-houses-data-fabrics/ https://insideainews.com/2022/04/29/data-virtualizations-ubiquity-data-meshes-data-products-data-lake-houses-data-fabrics/#respond Fri, 29 Apr 2022 13:00:00 +0000 https://insidebigdata.com/?p=29168 In this contributed article, editorial consultant Jelani Harper discusses how data virtualization is the underlying technology for some of the most progressive architectures today, including that of the data mesh, data lake house, and data fabric. Although it’s still regarded as a desirable, dynamic means of integrating data, it’s silently reshaping itself into something that encompasses this attribute but, ultimately, is much more.]]> https://insideainews.com/2022/04/29/data-virtualizations-ubiquity-data-meshes-data-products-data-lake-houses-data-fabrics/feed/ 0 29168 https://insideainews.com/2020/01/21/real-time-analytics-from-your-data-lake-teaching-the-elephant-to-dance/ https://insideainews.com/2020/01/21/real-time-analytics-from-your-data-lake-teaching-the-elephant-to-dance/#respond Tue, 21 Jan 2020 16:00:45 +0000 https://insidebigdata.com/?p=23872 This whitepaper from Imply Data Inc. explains why delivering real-time analytics on a data lake is so hard, approaches companies have taken to accelerate their data lakes, and how they leveraged the same technology to create end-to-end real-time analytics architectures.]]> https://insideainews.com/2020/01/21/real-time-analytics-from-your-data-lake-teaching-the-elephant-to-dance/feed/ 0 23872 https://insideainews.com/white-paper/real-time-analytics-from-your-data-lake-teaching-the-elephant-to-dance/ https://insideainews.com/white-paper/real-time-analytics-from-your-data-lake-teaching-the-elephant-to-dance/#respond Sat, 18 Jan 2020 18:15:53 +0000 https://insidebigdata.com/?post_type=wpdmpro&p=23856 This whitepaper from Imply Data Inc. introduces Apache Druid and explains why delivering real-time analytics on a data lake is so hard, approaches companies have taken to accelerate their data lakes, and how they leveraged the same technology to create end-to-end real-time analytics architectures.]]> 0 23856 https://insideainews.com/white-paper/introducing-apache-druid/ https://insideainews.com/white-paper/introducing-apache-druid/#respond Tue, 14 Jan 2020 22:17:16 +0000 https://insidebigdata.com/?post_type=wpdmpro&p=23858 This whitepaper provides an introduction to Apache Druid, including its evolution, core architecture and features, and common use cases. Founded by the authors of the Apache Druid database, Imply provides a cloud-native solution that delivers real-time ingestion, interactive ad-hoc queries, and intuitive visualizations for many types of event-driven and streaming data flows.]]> 0 23858 https://insideainews.com/2019/11/03/okera-delivers-industrys-first-real-time-actionable-insights-into-data-lakes/ https://insideainews.com/2019/11/03/okera-delivers-industrys-first-real-time-actionable-insights-into-data-lakes/#respond Sun, 03 Nov 2019 21:00:29 +0000 https://insidebigdata.com/?p=23516 Okera, a leading active data management platform that enables companies to discover, audit, and protect data at scale, announced Okera Spotlight for Amazon Web Services (AWS) users, the first and only solution to provide full visibility with real-time and continuous audit of your Amazon Simple Storage Service (S3) data lake. ]]> https://insideainews.com/2019/11/03/okera-delivers-industrys-first-real-time-actionable-insights-into-data-lakes/feed/ 0 23516 https://insideainews.com/white-paper/data-lakes/ https://insideainews.com/white-paper/data-lakes/#respond Thu, 01 Sep 2016 15:37:21 +0000 http://insidebigdata.com/?post_type=wpdmpro&p=15359 As with any major IT initiative, cost-savings drives many data lakes initiatives. However, the value will ultimately be realized in the potential avenues it offers for business growth. The next frontier for data lakes is providing organizations with greatly enhanced analytical opportunities. ]]> 0 15359 https://insideainews.com/white-paper/data-lakes-principles/ https://insideainews.com/white-paper/data-lakes-principles/#respond Thu, 01 Sep 2016 15:36:39 +0000 http://insidebigdata.com/?post_type=wpdmpro&p=15389 This Checklist Report discusses what your enterprise should consider before diving into a data lake project, no matter if it’s your first or second or even third major data lake project. Presumably, adherence to these principles will become second nature to the data lake team and they will even improve upon them at some point.]]> 0 15389