Mrudula MadirajuSeamlessly transition your Spark applications between Cloud and OnPrem using IBM Analytics EngineDepending on the need of your organization and usecase, you may need to use either public cloud managed service for running your spark…8 min read·2 days ago----
Mrudula MadirajuData Ingestion and Table Management in the Lakehouse using Presto, Iceberg and SparkThis blog (cowritten with Dharmesh Jain and inputs from Shrinivas Kulkarni) is about why and how to get Presto, Iceberg and Spark to work…9 min read·Sep 28, 2023----
Mrudula MadirajuinIBM Data Science in PracticeAnalytics Engine — Serverless Spark — The complete demoShort Video Demos — Run Spark workloads, Troubleshoot using Spark UI/ Spark History in combination with Logs2 min read·Feb 3, 2023----
Mrudula MadirajuStore upto 25 GB data per month for free on Cloud Object Storage for Spark Analytics!This is not a hook line, just the (data) sink you have been looking for! ;-)7 min read·Jan 2, 2023--2--2
Mrudula MadirajuJust 3 Curls: Take your first steps with Analytics Engine — Serverless Spark APIIf you are a newbie and want to get started with running your Spark workloads, you can do that in just 3 curls.2 min read·Dec 12, 2022----
Mrudula MadirajuinSelectFromBuilding Pipelines for Serverless SparkLeveraging Apache Airflow for defining Data Pipelines for Spark7 min read·Jun 13, 2022----
Mrudula MadirajuinSelectFromStreaming Applications on Serverless SparkHow to Push Data Events to a Kafka Topic, Read Them Using SparkStreaming and Persist to ObjectStore9 min read·May 19, 2022----
Mrudula MadirajuProvisioning Analytics Engine — Serverless Spark using TerraformTerraform — Overview3 min read·Mar 27, 2022----
Mrudula MadirajuLogging in Serverless Spark (Part3)Export Logs for each application2 min read·Feb 14, 2022----
Mrudula MadirajuLogging in Serverless Spark (Part2)Learn how to tune logging : Executor vs Driver logs, Log Levels and Turning off Logs3 min read·Feb 14, 2022----