Logging in Serverless Spark (Part3)

Overview

LogDNA Service Key & Export API

Execute the Export API for your application

curl -s "https://api.us-south.logging.cloud.ibm.com/v2/export?query=$application_id&to=$(date +%s)000&from=$(($(date +%s)-86400))000" -u $service_key: > logs.json

Extract Application Log Lines

cat logs.json | jq '.lines | .[] | .message' > $application_id.log

Debug with grep

That’s it!

--

--

--

Senior Consultant, IBM Cloud. Sharing titbits of epiphanies...

Love podcasts or audiobooks? Learn on the go with our new app.

Recommended from Medium

JavaScript HTML Calculator — Simulator

Know the Cognitive Advantages of Good Names

images/Chp5_TopHotspotsSize.png

Create a Player and Add Basic Input Movements in Unity

Amazon’s First Non-Employee Customer and What He Bought

Per My Last Comment: Creating Reply Threads in Your React/Rails App

AWS vs Google Cloud vs Azure

Getting to know RSpec, Just a Little Bit

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store
Mrudula Madiraju

Mrudula Madiraju

Senior Consultant, IBM Cloud. Sharing titbits of epiphanies...

More from Medium

Logging in Serverless Spark (Part2)

Adding Cassandra JDBC Driver to DBeaver Community Edition

How to Interact Delta Lake Using EMR

Data Replication (CDC) from Oracle to PostgreSQL using Debezium, Run in Docker & Exposed in Grafana