IBM Analytics Engine’s Sparkling New Avatar!

Serverless Apache Spark

Run Pay-Per-Second, On-Demand, Spark Workloads


IBM Analytics Engine’s recently launched new plan Standard Serverless for Apache Spark, comes with a host of exciting new features for teams that need to run BigData, Machine Learning, Spark based workloads.

New plan for IBM Analytics Engine — Standard Serverless for Apache Spark

You, as a Developer, will dig:

  • Running on latest and greatest versions :- Spark on Scala, Python, R
  • You can just submit your spark application without worrying about setting up a Spark cluster, queues, priority of your application etc. Let Analytics Engine take care of bringing up dedicated internal Spark cluster for your app, in few seconds and get your job completed.
  • You don’t have to think of how many executors/cores are needed to run your app.Make use of auto scaling feature and let the workload drive the executor — memory/cpu usage. If, on the other hand, you prefer to specify the executor/CPU upfront, you can pick from a standard ratio that suits your needs.
  • Interface of your choice :- CLI, REST API, SDK, Livy like interfaces..
  • Customization per your needs:- Bring in external standard or custom files packages and libraries, Specify default configurations for Spark..

You, as the Admin / Security person will love:

You, as DevOps will like:

Your Finance team can count on:

  • Pay-per-second billing:- Pay exactly only for the resources that you use and pay only for as long as the workload runs.
  • Limits and Quotas :- Know in advance, the max limits of resource consumption that can be hit by team, so that you know that final bill will not exceed X $$$.
  • Auto Scaling Feature:- Letting your workload determine the resources needed in the most optimized way as opposed to a fixed estimate ..

Have More Questions?

Read the FAQ
Reach out to us at Support on IBM Cloud

Try it out!

From all of us at the dev team :)
Avani G, Chetan B, Darshan K, Deepali G, Deepashree G, Dharmesh J, Harshavardhan C, Jaytheerthan K, Kapil J, Madhusudan KJ, Mrudula M, Shiv P Y, Shivangi G, S Kulki, Shyamala G, Silpi D, Subin S, Tapas S




Senior Consultant, IBM Cloud. Sharing titbits of epiphanies...

Love podcasts or audiobooks? Learn on the go with our new app.

Recommended from Medium

Installing VirtualBox and Vagrant on Windows 10

How to Upgrade Python to 3.10

A journeyman engineer’s inflection point

A potter turns a vase on a potting wheel.

How I Built This: A Sports Betting Exchange (Part 4: The Retro)

Installing OpenLDAP and phpLDAPadmin on Ubuntu 20.04 LTS

Flutter Cross-Platform Tricks

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store
Mrudula Madiraju

Mrudula Madiraju

Senior Consultant, IBM Cloud. Sharing titbits of epiphanies...

More from Medium

Up and Running with Kafka (installation) in Simplest way

Dynamic filtering in Flink

3 Reasons why we need an Open Source Data Infrastructure Platform

Screenshot from the website

Orchestration of AWS EMR Clusters Using Airflow —The Insider Way