且构网

分享程序员开发的那些事...
且构网 - 分享程序员编程开发的那些事

如何使用飞艇来访问AWS火花EC2集群和S3桶

更新时间:2022-01-05 21:27:39

最有可能您的IP地址连接到您的火花集群受阻。您可以通过启动火花壳指着那个终点(甚至只是远程登录)试试。要解决它,你可以登录到您的AWS帐户并更改防火墙设置。它也有可能是它没有指向正确的主机(我假设您删除火花具体框://.us-west-2.compute.amazonaws.com:7077 ,但如果不应该有一点对于.US - 西-2)。您可以尝试ssh'ing到该计算机并运行netstat的--tcp -l -n,看看它的收听。(甚至只是的ps aux | grep的Java来看看星火运行)

Most likely your IP address is blocked from connecting to your spark cluster. You can try by launching the spark-shell pointing at that end point (or even just telnetting). To fix it you can log into your AWS account and change the firewall settings. Its also possible that it isn't pointed at the correct host (I'm assuming you removed the specific box from spark://.us-west-2.compute.amazonaws.com:7077 but if not there should be a bit for the .us-west-2). You can try ssh'ing to that machine and running netstat --tcp -l -n to see if its listening (or even just ps aux |grep java to see if Spark is running).