且构网

分享程序员开发的那些事...
且构网 - 分享程序员编程开发的那些事

[Spark][Hive][Python][SQL]Spark 读取Hive表的小例子

更新时间:2022-09-18 13:31:25

[Spark][Hive][Python][SQL]Spark 读取Hive表的小例子
$ cat customers.txt
1 Ali us
2 Bsb ca
3 Carls mx

$ hive

hive> 
> CREATE TABLE IF NOT EXISTS customers(
> cust_id string,
> name string,
> country string
> )
> ROW FORMAT DELIMITED FIELDS TERMINATED BY '\t';

hive> load data local inpath '/home/training/customers.txt' into table customers;

hive>exit

$pyspark

sqlContext =HiveContext(sc)
filterDF=sqlContext.sql(""" SELECT * FROM customers WHERE name LIKE "A%" """)

filterDF.limit(3).show()

+-------+----+-------+
|cust_id|name|country|
+-------+----+-------+
| 001| Ani| us|
+-------+----+-------+




本文转自健哥的数据花园博客园博客,原文链接:http://www.cnblogs.com/gaojian/p/7634234.html,如需转载请自行联系原作者