Is there a rest call to list all the running applications in spark standalone mode?

Question

Is there any rest call to list all the running applications on spark running in standalone mode?

I could find rest calls to submit application but not get all running applications !

UPDATED - If we do not know the running application port and the history server is not enabled too than is there a way to get all running applications with just spark master and rest port details ?

question from:https://stackoverflow.com/questions/65848533/is-there-a-rest-call-to-list-all-the-running-applications-in-spark-standalone-mo

Answer 1

You can use the REST Api from Spark. Documentation: https://spark.apache.org/docs/latest/monitoring.html#rest-api

Here's an example:

http://localhost:4040/api/v1?status=running

Note: For the history server, they would typically be accessible at http://localhost:18080/api/v1 and for a running application, at http://localhost:4040/api/v1