https://insideainews.com/tag/data-pipeline/ Illuminating AI's Frontiers: Your Go-To News Destination. Fri, 01 Mar 2024 22:49:40 +0000 en-US hourly 1 https://wordpress.org/?v=6.6.1 https://insideainews.com/wp-content/uploads/2024/06/iain-favicon.png https://insideainews.com/tag/data-pipeline/ 32 32 136462205 https://insideainews.com/2024/03/04/hammerspace-unveils-the-fastest-file-system-in-the-world-for-training-enterprise-ai-models-at-scale/ https://insideainews.com/2024/03/04/hammerspace-unveils-the-fastest-file-system-in-the-world-for-training-enterprise-ai-models-at-scale/#respond Mon, 04 Mar 2024 11:00:00 +0000 https://insidebigdata.com/?p=34888 Hammerspace, the company orchestrating the Next Data Cycle, unveiled the high-performance NAS architecture needed to address the requirements of broad-based enterprise AI, machine learning and deep learning (AI/ML/DL) initiatives and the widespread rise of GPU computing both on-premises and in the cloud. This new category of storage architecture – Hyperscale NAS – is built on the tenants required for large language model (LLM) training and provides the speed to efficiently power GPU clusters of any size for GenAI, rendering and enterprise high-performance computing.]]> https://insideainews.com/2024/03/04/hammerspace-unveils-the-fastest-file-system-in-the-world-for-training-enterprise-ai-models-at-scale/feed/ 0 34888 https://insideainews.com/2023/10/25/achieving-faster-time-to-insights-with-modern-data-pipelines/ https://insideainews.com/2023/10/25/achieving-faster-time-to-insights-with-modern-data-pipelines/#comments Wed, 25 Oct 2023 10:00:00 +0000 https://insidebigdata.com/?p=33717 In this sponsored post, Devika Garg, PhD, Senior Solutions Marketing Manager for Analytics at Pure Storage, believes that in the current era of data-driven transformation, IT leaders must embrace complexity by simplifying their analytics and data footprint. Data pipelines allow IT leaders to optimize data and maximize value for faster analytic insights. When paired with the right storage solution, IT leaders can modernize their pipelines and consolidate data into a central and accessible layer - breaking through silos and delivering the real-time insights that drive true business advantage. Modern data analytics fuel digital-first organizations to unlock faster insights - is your infrastructure keeping pace? ]]> https://insideainews.com/2023/10/25/achieving-faster-time-to-insights-with-modern-data-pipelines/feed/ 2 33717 https://insideainews.com/2023/01/12/hewlett-packard-enterprise-acquires-pachyderm-to-expand-ai-at-scale-capabilities-with-reproducible-ai/ https://insideainews.com/2023/01/12/hewlett-packard-enterprise-acquires-pachyderm-to-expand-ai-at-scale-capabilities-with-reproducible-ai/#respond Thu, 12 Jan 2023 15:00:00 +0000 https://insidebigdata.com/?p=31387 Hewlett Packard Enterprise (NYSE: HPE) today announced an expansion to its AI-at-scale offerings with the acquisition of Pachyderm, a startup that delivers software, based on open-source technology, to automate reproducible machine learning pipelines that target large-scale AI applications. ]]> https://insideainews.com/2023/01/12/hewlett-packard-enterprise-acquires-pachyderm-to-expand-ai-at-scale-capabilities-with-reproducible-ai/feed/ 0 31387 https://insideainews.com/2022/12/07/how-to-ensure-an-effective-data-pipeline-process/ https://insideainews.com/2022/12/07/how-to-ensure-an-effective-data-pipeline-process/#respond Wed, 07 Dec 2022 14:00:00 +0000 https://insidebigdata.com/?p=31058 In this contributed article, Rajkumar Sen, Founder and CTO at Arcion, discusses how the business data in a modern enterprise is spread across various platforms and formats. Data could belong to an operational database, cloud warehouses, data lakes and lakehouses, or even external public sources. Data pipelines connecting this variety of sources need to establish some best practices so that the data consumers get high-quality data delivered to where the data apps are being built. ]]> https://insideainews.com/2022/12/07/how-to-ensure-an-effective-data-pipeline-process/feed/ 0 31058 https://insideainews.com/2022/08/13/ebook-unlock-complex-and-streaming-data-with-declarative-data-pipelines/ https://insideainews.com/2022/08/13/ebook-unlock-complex-and-streaming-data-with-declarative-data-pipelines/#respond Sat, 13 Aug 2022 13:00:00 +0000 https://insidebigdata.com/?p=30077 Our friend, Ori Rafael, CEO of Upsolver and advocate for engineers everywhere, released his new book "Unlock Complex and Streaming Data with Declarative Data Pipelines." Ori discusses why declarative pipelines are necessary for data-driven businesses and how they help with engineering productivity, and the ability for businesses to unlock more potential from their raw data. Data pipelines are essential to unleashing the potential of data and can successfully pull from multiple sources. ]]> https://insideainews.com/2022/08/13/ebook-unlock-complex-and-streaming-data-with-declarative-data-pipelines/feed/ 0 30077 https://insideainews.com/2022/04/06/databricks-announces-general-availability-of-delta-live-tables/ https://insideainews.com/2022/04/06/databricks-announces-general-availability-of-delta-live-tables/#respond Wed, 06 Apr 2022 13:00:00 +0000 https://insidebigdata.com/?p=28936 Databricks, the Data and AI company and pioneer of the data lakehouse paradigm, announced the general availability of Delta Live Tables (DLT), the first ETL framework to use a simple declarative approach to build reliable data pipelines and to automatically manage data infrastructure at scale. Turning SQL queries into production ETL pipelines often requires a lot of tedious, complicated operational work. By using modern software engineering practices to automate the most time consuming parts of data engineering, data engineers and analysts can concentrate on delivering data rather than on operating and maintaining pipelines.]]> https://insideainews.com/2022/04/06/databricks-announces-general-availability-of-delta-live-tables/feed/ 0 28936 https://insideainews.com/2021/11/13/5-easy-steps-to-make-your-data-business-ready/ https://insideainews.com/2021/11/13/5-easy-steps-to-make-your-data-business-ready/#respond Sat, 13 Nov 2021 14:00:00 +0000 https://insidebigdata.com/?p=27641 In this contributed article, Ayush Parashar Vice President of Engineering at Boomi, discusses five core components to a strong data strategy so businesses can derive insights from and act on the data. As the uses for data continue to grow, businesses must ensure their data is actually usable.]]> https://insideainews.com/2021/11/13/5-easy-steps-to-make-your-data-business-ready/feed/ 0 27641 https://insideainews.com/2021/10/23/how-governing-observability-data-is-critical-to-esg-success/ https://insideainews.com/2021/10/23/how-governing-observability-data-is-critical-to-esg-success/#respond Sat, 23 Oct 2021 13:00:00 +0000 https://insidebigdata.com/?p=27469 In this contributed article, Nick Heudecker, Senior Director of Market Strategy at Cribl, discusses how observability data comprises the logs, events, metrics, and traces that make things like security, performance management, and monitoring possible. While often overlooked, governing these data sources is critical in today’s enterprises. The current state of observability data management is, at best, fragmented and ad hoc. By adopting an observability pipeline as a key component in your observability infrastructure, you can centralize your governance efforts while remaining agile in the face of constant change.]]> https://insideainews.com/2021/10/23/how-governing-observability-data-is-critical-to-esg-success/feed/ 0 27469 https://insideainews.com/2021/04/26/how-yum-brands-uses-location-data-from-foursquare-to-make-smarter-decisions/ https://insideainews.com/2021/04/26/how-yum-brands-uses-location-data-from-foursquare-to-make-smarter-decisions/#respond Mon, 26 Apr 2021 13:00:00 +0000 https://insidebigdata.com/?p=25990 Join this virtual event with a compelling panel of technology leaders to discuss to discover how Yum! Brands and other organizations are leveraging location-based data to boost in-app location accuracy, increase in-store foot traffic, and expand e-commerce business.]]> https://insideainews.com/2021/04/26/how-yum-brands-uses-location-data-from-foursquare-to-make-smarter-decisions/feed/ 0 25990 https://insideainews.com/2020/06/23/global-study-sponsored-by-qlik-finds-strong-relationship-between-optimizing-data-pipelines-and-business-value/ https://insideainews.com/2020/06/23/global-study-sponsored-by-qlik-finds-strong-relationship-between-optimizing-data-pipelines-and-business-value/#respond Wed, 24 Jun 2020 00:00:00 +0000 https://insidebigdata.com/?p=24642 Qlik® announced a global study that shows organizations that strategically invest in creating data-to-insights capabilities through modern data and analytics pipelines are seeing significant bottom line impact. The global IDC survey, sponsored by Qlik, of 1,200 business leaders* shows that companies with a higher ability to identify, gather, transform, and analyze data to glean insights benefited from higher quality decision making and better business outcomes, including improved operational efficiencies, increased revenue and increased profits.]]> https://insideainews.com/2020/06/23/global-study-sponsored-by-qlik-finds-strong-relationship-between-optimizing-data-pipelines-and-business-value/feed/ 0 24642