且构网

分享程序员开发的那些事...
且构网 - 分享程序员编程开发的那些事

如何在Yarn上配置应用程序驱动程序的自动重启

更新时间:2023-10-19 08:35:28

您正在寻找的是在纱线群集模式"下启动应用程序的一组指令: https://spark.apache.org/docs/latest/running-on -yarn.html

What you are looking for is the set of instructions to launch your application in yarn "cluster mode" : https://spark.apache.org/docs/latest/running-on-yarn.html

这意味着您的驱动程序应用程序在YARN上的群集上运行(而不是在本地计算机上).因此,如果失败,可以由YARN重新启动.

This means that your driver application runs on the cluster on YARN (not on your local machine). As such it can be restarted by YARN if it fails.