https://insideainews.com/category/inside-spark/ Illuminating AI's Frontiers: Your Go-To News Destination. Wed, 10 Aug 2022 16:12:50 +0000 en-US hourly 1 https://wordpress.org/?v=6.6.1 https://insideainews.com/wp-content/uploads/2024/06/iain-favicon.png https://insideainews.com/category/inside-spark/ 32 32 136462205 https://insideainews.com/2022/08/09/mlops-is-the-enterprise-repeating-the-same-diy-mistakes/ https://insideainews.com/2022/08/09/mlops-is-the-enterprise-repeating-the-same-diy-mistakes/#respond Tue, 09 Aug 2022 13:00:00 +0000 https://insidebigdata.com/?p=30029 In this contributed article, Aaron Friedman, VP of Operations at Wallaroo.ai, discusses why hiring data scientists isn’t the answer to unlocking ML value (especially at a time when finding qualified candidates is harder than ever).]]> https://insideainews.com/2022/08/09/mlops-is-the-enterprise-repeating-the-same-diy-mistakes/feed/ 0 30029 https://insideainews.com/2022/07/02/databricks-announces-major-contributions-to-flagship-open-source-projects/ https://insideainews.com/2022/07/02/databricks-announces-major-contributions-to-flagship-open-source-projects/#respond Sat, 02 Jul 2022 13:00:00 +0000 https://insidebigdata.com/?p=29715 Databricks announced that the company will contribute all features and enhancements it has made to Delta Lake to the Linux Foundation and open source all Delta Lake APIs as part of the Delta Lake 2.0 release. In addition, the company announced MLflow 2.0, which includes MLflow Pipelines, a new feature to accelerate and simplify ML model deployments. Finally, the company introduced Spark Connect, to enable the use of Spark on virtually any device, and Project Lightspeed, a next generation Spark Structured Streaming engine for data streaming on the lakehouse. ]]> https://insideainews.com/2022/07/02/databricks-announces-major-contributions-to-flagship-open-source-projects/feed/ 0 29715 https://insideainews.com/2022/06/09/dont-call-it-a-data-product-unless-it-meets-these-5-requirements/ https://insideainews.com/2022/06/09/dont-call-it-a-data-product-unless-it-meets-these-5-requirements/#comments Thu, 09 Jun 2022 13:00:00 +0000 https://insidebigdata.com/?p=29561 In this special guest feature, Barr Moses, Co-founder and CEO of Monte Carlo, believes data products can transform an organization’s ability to be data-driven as long as they meet 5 key requirements. Data products can transform an organization’s ability to be data-driven, as long as they are implemented correctly and in good faith.]]> https://insideainews.com/2022/06/09/dont-call-it-a-data-product-unless-it-meets-these-5-requirements/feed/ 3 29561 https://insideainews.com/2020/11/14/databricks-launches-sql-analytics-to-enable-cloud-data-warehousing-on-data-lakes/ https://insideainews.com/2020/11/14/databricks-launches-sql-analytics-to-enable-cloud-data-warehousing-on-data-lakes/#respond Sat, 14 Nov 2020 14:00:00 +0000 https://insidebigdata.com/?p=25231 Databricks, the data and AI company, announced the launch of SQL Analytics, which for the first time enables data analysts to perform workloads previously meant only for a data warehouse on a data lake. This expands the traditional scope of the data lake from data science and machine learning to include all data workloads including Business Intelligence (BI) and SQL.]]> https://insideainews.com/2020/11/14/databricks-launches-sql-analytics-to-enable-cloud-data-warehousing-on-data-lakes/feed/ 0 25231 https://insideainews.com/2020/01/08/understanding-intention-using-content-context-and-the-crowd-to-build-better-search-applications/ https://insideainews.com/2020/01/08/understanding-intention-using-content-context-and-the-crowd-to-build-better-search-applications/#respond Wed, 08 Jan 2020 16:00:57 +0000 https://insidebigdata.com/?p=23801 This white paper by enterprise search specialists Lucidworks, points out that unlike consumer search, which has become a seamless part of our everyday lives, the enterprise side might as well still be running Windows 95. Imagine if Amazon, Google, or Facebook treated every user the same, regardless of who they are, where they are, what they’re searching for, and what they’ve clicked. Your users expect that same sophistication in their enterprise apps.]]> https://insideainews.com/2020/01/08/understanding-intention-using-content-context-and-the-crowd-to-build-better-search-applications/feed/ 0 23801 https://insideainews.com/2019/09/15/streamsets-launches-streamsets-transformer/ https://insideainews.com/2019/09/15/streamsets-launches-streamsets-transformer/#respond Sun, 15 Sep 2019 20:00:55 +0000 https://insidebigdata.com/?p=23254 StreamSets, Inc., provider of the DataOps platform for modern data integration, released StreamSets® Transformer, a simple-to-use, drag-and-drop UI tool to create native Apache Spark applications. Designed for a wide range of users — even those without specialized skills — StreamSets Transformer enables the creation of pipelines for performing ETL, stream processing and machine-learning operations. Now, data engineers, scientists, architects and operators gain deep visibility into the execution of Apache Spark while broadening usage across the business.]]> https://insideainews.com/2019/09/15/streamsets-launches-streamsets-transformer/feed/ 0 23254 https://insideainews.com/2019/06/19/addressing-governmental-challenges-when-engaging-ai-ml-and-data-analytics/ https://insideainews.com/2019/06/19/addressing-governmental-challenges-when-engaging-ai-ml-and-data-analytics/#comments Wed, 19 Jun 2019 15:30:17 +0000 https://insidebigdata.com/?p=22827 Gartner recently stated that all industries and levels of government agree the top three game-changing technologies today are AI/machine learning, data analytics/predictive analytics and cloud technologies. However, there are some primary sticking points when it comes to innovation in these areas. Government organizations continue to encounter challenges when trying to pursue these initiatives due to complex security and compliance requirements, poor scalability of legacy IT infrastructure, and perceived risks associated with cloud and IT modernization efforts. How can these challenges be addressed? ]]> https://insideainews.com/2019/06/19/addressing-governmental-challenges-when-engaging-ai-ml-and-data-analytics/feed/ 1 22827 https://insideainews.com/2019/03/31/the-power-of-crunching-big-data-effectively/ https://insideainews.com/2019/03/31/the-power-of-crunching-big-data-effectively/#respond Sun, 31 Mar 2019 15:00:20 +0000 https://insidebigdata.com/?p=22354 In this contributed article, Lex Boost, CEO of Leaseweb USA, points out that according to an Accenture study, 79% of enterprise executives agree that companies not embracing big data will lose their competitive edge. Considering that data creation is on track to grow 10-fold by 2025, it’s crucial for companies to be able to process it more quickly, and meaningfully. ]]> https://insideainews.com/2019/03/31/the-power-of-crunching-big-data-effectively/feed/ 0 22354 https://insideainews.com/2018/10/14/databricks-rstudio-introduce-new-version-mlflow-r-integration/ https://insideainews.com/2018/10/14/databricks-rstudio-introduce-new-version-mlflow-r-integration/#respond Sun, 14 Oct 2018 20:00:22 +0000 https://insidebigdata.com/?p=21248 Databricks, a leader in unified analytics and founded by the original creators of Apache Spark™, and RStudio, today announced a new release of MLflow, an open source multi-cloud framework for the machine learning lifecycle, now with R integration. RStudio has partnered with Databricks to develop an R API for MLflow v0.7.0. ]]> https://insideainews.com/2018/10/14/databricks-rstudio-introduce-new-version-mlflow-r-integration/feed/ 0 21248 https://insideainews.com/2018/07/05/state-art-natural-language-processing-scale/ https://insideainews.com/2018/07/05/state-art-natural-language-processing-scale/#respond Thu, 05 Jul 2018 15:30:11 +0000 https://insidebigdata.com/?p=20691 https://insideainews.com/2018/07/05/state-art-natural-language-processing-scale/feed/ 0 20691