Unity Catalog API & Iceberg REST Catalog API in watsonx.dataInteroperability and flexibility with new APIs in watsonx.dataJan 2Jan 2
Presto REST API for running SQL statements in watsonx.data (SAAS & Software)REST API to execute SQL in Presto WatsonX.DataJul 26, 2024Jul 26, 2024
Native Spark Engine on WatsonX.Data on Cloud Pak For Data (CPD) using DAS featureSubmitting applications to native spark engine on WXD on CPD without passing credentials!Jul 8, 2024Jul 8, 2024
Hello Ozone from Spark using s3a:// protocolQuick dive into a basic POC with Dharmesh Jain and Anurag Dwivedi to test that s3a:// based connectivity can work between Apache Spark…Jun 22, 2024Jun 22, 2024
Hello HBase World from Spark WorldFirst steps on how to read and write pyspark applications to read and write to HBase tablesJun 15, 2024Jun 15, 2024
Published inTowards DevSpark Streaming Application to Process Files From and To an S3 bucketSpark Streaming with S3 Source and S3 Sink (No Kafka*)May 25, 2024May 25, 2024
All you wanted to know about Native Spark on WatsonX Data(Public Cloud) — Part 2Part Two (Submitting applications to the Native Spark Engine)May 19, 2024May 19, 2024
All you wanted to know about Native Spark on WatsonX Data(Public Cloud) — Part 1Part One (Create Native Spark Engine)May 19, 2024May 19, 2024
Seamlessly transition your Spark applications between Cloud and OnPrem using IBM Analytics EngineDepending on the need of your organization and usecase, you may need to use either public cloud managed service for running your spark…May 3, 20241May 3, 20241
Data Ingestion and Table Management in the Lakehouse using Presto, Iceberg and SparkThis blog (cowritten with Dharmesh Jain and inputs from Shrinivas Kulkarni) is about why and how to get Presto, Iceberg and Spark to work…Sep 28, 2023Sep 28, 2023
