i have spark cluster 1 master 9nodes.i running in standalone-mode. not have access web browser of nodes in cluster (i connecting nodes through ssh --it grid5000 cluster). wondering, there possibility access spark web ui in case? tried copying logs cluster in spark_path/work on local machine (leaving impression jobs ran in cluster ran on local machine). idea came after reading part documentation:
if application has logged events on course of lifetime, standalone master’s web ui automatically re-render application’s ui after application has finished.
but did not work. can see in ui is:
applications: 0 running, 0 completed drivers: 0 running, 0 completed status: alive
thank you!
you don't need copy anything, access port 8080 on master machine or port 4040 on application machine (while application running). if machines not externally accessible have tunnel through ssh.
tunneling through ssh popular topic, search it. use ssh -d 9999 , set localhost:9999 proxy using foxyproxy plugin exists both firefox , chrome.
Comments
Post a Comment