https://insideainews.com/tag/data-lake/ Illuminating AI's Frontiers: Your Go-To News Destination. Thu, 01 Feb 2024 00:38:26 +0000 en-US hourly 1 https://wordpress.org/?v=6.6.1 https://insideainews.com/wp-content/uploads/2024/06/iain-favicon.png https://insideainews.com/tag/data-lake/ 32 32 136462205 https://insideainews.com/2024/02/02/introducing-the-streaming-datalake/ https://insideainews.com/2024/02/02/introducing-the-streaming-datalake/#respond Fri, 02 Feb 2024 11:00:00 +0000 https://insidebigdata.com/?p=34734 In this contributed article, Tom Scott, CEO of Streambased, outlines the path event streaming systems have taken to arrive at the point where they must adopt analytical use cases and looks at some possible futures in this area.]]> https://insideainews.com/2024/02/02/introducing-the-streaming-datalake/feed/ 0 34734 https://insideainews.com/2023/09/07/navigating-data-lake-challenges-governance-security-and-gdpr-compliance/ https://insideainews.com/2023/09/07/navigating-data-lake-challenges-governance-security-and-gdpr-compliance/#comments Thu, 07 Sep 2023 18:06:18 +0000 https://insidebigdata.com/?p=33339 In this contributed article, Coral Trivedi, Product Manager at Fivetran, discusses how enterprises can get the most value from a data lake. The article discusses automation, security, pipelines and GSPR compliance issues. ]]> https://insideainews.com/2023/09/07/navigating-data-lake-challenges-governance-security-and-gdpr-compliance/feed/ 1 33339 https://insideainews.com/2023/07/04/why-do-we-prefer-elt-rather-than-etl-in-the-data-lake-what-is-the-difference-between-etl-elt/ https://insideainews.com/2023/07/04/why-do-we-prefer-elt-rather-than-etl-in-the-data-lake-what-is-the-difference-between-etl-elt/#comments Tue, 04 Jul 2023 10:10:00 +0000 https://insidebigdata.com/?p=32768 In this article, Ashutosh Kumar discusses the emergence of modern data solutions that have led to the development of ELT and ETL with unique features and advantages. ELT is more popular due to its ability to handle large and unstructured datasets like in data lakes. Traditional ETL has evolved into cloud-based ETL which allows rapid batch processing, scalability, savings, and simplicity while maintaining security, governance, and compliance. ]]> https://insideainews.com/2023/07/04/why-do-we-prefer-elt-rather-than-etl-in-the-data-lake-what-is-the-difference-between-etl-elt/feed/ 1 32768 https://insideainews.com/2022/11/03/video-highlights-modernize-your-ibm-mainframe-netezza-with-databricks-lakehouse/ https://insideainews.com/2022/11/03/video-highlights-modernize-your-ibm-mainframe-netezza-with-databricks-lakehouse/#respond Thu, 03 Nov 2022 13:09:00 +0000 https://insidebigdata.com/?p=30797 In the video presentation below, learn from experts how to architect modern data pipelines to consolidate data from multiple IBM data sources into Databricks Lakehouse, using the state-of-the-art replication technique—Change Data Capture (CDC).]]> https://insideainews.com/2022/11/03/video-highlights-modernize-your-ibm-mainframe-netezza-with-databricks-lakehouse/feed/ 0 30797 https://insideainews.com/2022/07/14/maximizing-data-lake-utility-with-query-optimization/ https://insideainews.com/2022/07/14/maximizing-data-lake-utility-with-query-optimization/#respond Thu, 14 Jul 2022 13:00:00 +0000 https://insidebigdata.com/?p=29842 In this contributed article, editorial consultant Jelani Harper highlights the recent acquisition of Varada by Starburst in terms how the deal provides Starburst’s platform two pivotal benefits. On the one hand, it employs cognitive computing to intelligently index data at scale. On the other, it has caching capabilities that make queries even more responsive for swiftly retrieving answers for informed decision-making, analytics, and applications.]]> https://insideainews.com/2022/07/14/maximizing-data-lake-utility-with-query-optimization/feed/ 0 29842 https://insideainews.com/2021/12/03/from-data-warehouses-and-data-lakes-to-data-fabrics-for-analytics/ https://insideainews.com/2021/12/03/from-data-warehouses-and-data-lakes-to-data-fabrics-for-analytics/#respond Fri, 03 Dec 2021 14:00:00 +0000 https://insidebigdata.com/?p=27780 In this contributed article, Kendall Clark, Founder and CEO of Stardog, discusses how data fabric is fast-becoming the data architecture foundation for analytics and how it is revolutionizing the $50 billion data lakes/warehouse market. Supported by real-word examples, the article explores how technologies such as expressive semantic modeling, knowledge graph, and data virtualization are connecting disparate data lakes to streamline data pipelines, reduce dataops costs and improve analytics insight. ]]> https://insideainews.com/2021/12/03/from-data-warehouses-and-data-lakes-to-data-fabrics-for-analytics/feed/ 0 27780 https://insideainews.com/2021/08/28/data-warehouse-costs-soar-roi-still-not-realized/ https://insideainews.com/2021/08/28/data-warehouse-costs-soar-roi-still-not-realized/#respond Sat, 28 Aug 2021 13:00:00 +0000 https://insidebigdata.com/?p=26979 Enterprises are pouring money into data management software – to the tune of $73 billion in 2020 – but are seeing very little return on their data investments.  According to a new study out from Dremio, the SQL Lakehouse company, and produced by Wakefield Research, only 22% of the data leaders surveyed have fully realized ROI in the past two years, with most data leaders (56%) having no consistent way of measuring it. ]]> https://insideainews.com/2021/08/28/data-warehouse-costs-soar-roi-still-not-realized/feed/ 0 26979 https://insideainews.com/2021/05/06/how-to-overcome-obstacles-in-data-lake-and-warehouse-strategies-3-best-practices-for-enterprise-architects/ https://insideainews.com/2021/05/06/how-to-overcome-obstacles-in-data-lake-and-warehouse-strategies-3-best-practices-for-enterprise-architects/#respond Thu, 06 May 2021 13:00:00 +0000 https://insidebigdata.com/?p=26102 In this special guest feature, Kimberly Read, the enterprise architect at Faction, suggests that to support the business case for multi-cloud, enterprise architects can benefit by addressing three primary considerations. Multi-cloud initiatives—drawing on services from public and private clouds—can help organizations stay ahead of the curve. ]]> https://insideainews.com/2021/05/06/how-to-overcome-obstacles-in-data-lake-and-warehouse-strategies-3-best-practices-for-enterprise-architects/feed/ 0 26102 https://insideainews.com/2021/04/15/interview-prat-moghe-ceo-of-cazena/ https://insideainews.com/2021/04/15/interview-prat-moghe-ceo-of-cazena/#respond Thu, 15 Apr 2021 13:00:00 +0000 https://insidebigdata.com/?p=25945 I recently caught up with Prat Moghe, CEO of cloud data lake leader Cazena to get his take on how getting off the ground with cloud data lakes continues to be a major frustration for enterprises. We're seeing such deployments taking at least six months and millions of dollars of annual spend for in-house development and management. There's got to be a better way. Gartner has estimated the failure rate of big data projects as high as 80%. What can you do about companies that stubbornly hang on to legacy data strategies, using analytics/BI approaches that put them ever-more behind competitors who are modernizing their data stack with AI/ML/etc? In this interview, we'll get some valuable perspectives for you to follow in accelerating your time-to-analytics.]]> https://insideainews.com/2021/04/15/interview-prat-moghe-ceo-of-cazena/feed/ 0 25945 https://insideainews.com/2021/03/23/protecting-your-data-lake-requires-a-new-mindset/ https://insideainews.com/2021/03/23/protecting-your-data-lake-requires-a-new-mindset/#comments Tue, 23 Mar 2021 13:00:00 +0000 https://insidebigdata.com/?p=25821 In this contributed article, technologist Bernard Brode discusses how protecting your data lake requires a new mindset. Some have questioned whether they actually need a data lake. While the answer is often positive, this doesn’t mean you’re doomed to the certainty of successful cyber attacks - as long as you are not relying on hope as a strategy, that is.]]> https://insideainews.com/2021/03/23/protecting-your-data-lake-requires-a-new-mindset/feed/ 1 25821