且构网

分享程序员开发的那些事...
且构网 - 分享程序员编程开发的那些事

如何使用 Zeppelin 访问 aws spark-ec2 集群和 s3 存储桶

更新时间:2022-11-06 22:15:22

很可能您的 IP 地址被阻止连接到您的 Spark 集群.您可以尝试启动指向该端点的 spark-shell(甚至只是 telnet).要修复它,您可以登录您的 AWS 账户并更改防火墙设置.它也可能没有指向正确的主机(我假设您从 spark://.us-west-2.compute.amazonaws.com:7077 中删除了特定框,但是如果没有,.us-west-2 应该有一点).您可以尝试通过 ssh 连接到该机器并运行 netstat --tcp -l -n 以查看它是否正在侦听(或者甚至只是 ps aux |grep java 以查看 Spark 是否正在运行).

Most likely your IP address is blocked from connecting to your spark cluster. You can try by launching the spark-shell pointing at that end point (or even just telnetting). To fix it you can log into your AWS account and change the firewall settings. Its also possible that it isn't pointed at the correct host (I'm assuming you removed the specific box from spark://.us-west-2.compute.amazonaws.com:7077 but if not there should be a bit for the .us-west-2). You can try ssh'ing to that machine and running netstat --tcp -l -n to see if its listening (or even just ps aux |grep java to see if Spark is running).