Presto REST API for running SQL statements in watsonx.data (SAAS & Software)REST API to execute SQL in Presto WatsonX.DataJul 26Jul 26
Native Spark Engine on WatsonX.Data on Cloud Pak For Data (CPD) using CAS featureSubmitting applications to native spark engine on WXD on CPD without passing credentials!Jul 8Jul 8
Hello Ozone from Spark using s3a:// protocolQuick dive into a basic POC with Dharmesh Jain and Anurag Dwivedi to test that s3a:// based connectivity can work between Apache Spark…Jun 22Jun 22
Hello HBase World from Spark WorldFirst steps on how to read and write pyspark applications to read and write to HBase tablesJun 15Jun 15
Published inTowards DevSpark Streaming Application to Process Files From and To an S3 bucketSpark Streaming with S3 Source and S3 Sink (No Kafka*)May 25May 25
All you wanted to know about Native Spark on WatsonX Data(Public Cloud) — Part 2Part Two (Submitting applications to the Native Spark Engine)May 19May 19
All you wanted to know about Native Spark on WatsonX Data(Public Cloud) — Part 1Part One (Create Native Spark Engine)May 19May 19
Seamlessly transition your Spark applications between Cloud and OnPrem using IBM Analytics EngineDepending on the need of your organization and usecase, you may need to use either public cloud managed service for running your spark…May 31May 31
Data Ingestion and Table Management in the Lakehouse using Presto, Iceberg and SparkThis blog (cowritten with Dharmesh Jain and inputs from Shrinivas Kulkarni) is about why and how to get Presto, Iceberg and Spark to work…Sep 28, 2023Sep 28, 2023
Published inIBM Data Science in PracticeAnalytics Engine — Serverless Spark — The complete demoShort Video Demos — Run Spark workloads, Troubleshoot using Spark UI/ Spark History in combination with LogsFeb 3, 2023Feb 3, 2023
