IBM Analytics Engine — Serverless Spark — End to End Demo

Short Video Demos — Run Spark workloads, Troubleshoot using Spark UI/ Spark History in combination with Logs

DEMO START

This video blog is a series of quick, short demos on various concepts of IBM Analytics Engine Serverless plan — right from creating and configuring an “instance”, running spark workloads, troubleshooting the run through a combination of the application run logs and through Spark UI / Spark History

P.S These demos do no have a voiceover. If you don’t want to listen to the background music, you can turn down the volume.

➡️ Demo 1: Creating an AE-Serverless Spark Instance

➡️ Demo 2: Viewing an AE-Serverless Spark Instance

➡️ Demo 3: Creating a platform logs enabled Log Analysis Instance

➡️ Demo 4: Enabling Logs for IBM Analytics Engine Instance

📌 Before going to Demo 4, understand the concepts of how to run a spark application on IBM Analytics Engine. All of the code referred in the demo can be found in product documentation and also in these blogs/tutorials below:

>> This article explains how you can submit applications using REST API: https://mrudulamadiraju.medium.com/just-3-curls-take-your-first-steps-with-analytics-engine-serverless-spark-api-6d59b57fa81

>> This article explains the fundamental concepts of storing your application/data on object store and how you reference them in Spark applications : https://medium.com/@mrudulamadiraju/store-upto-25-gb-data-per-month-for-free-on-cloud-object-storage-4a946daa4e43

>>This tutorial explains how to submit applications using the IBM Cloud CLI: https://cloud.ibm.com/docs/AnalyticsEngine?topic=AnalyticsEngine-using-cli

➡️ Demo 5: Analytics Engine — Spark UI & Spark History

DEMO END

What else would you like to see a demo of? Let me know through a private note or a comment.