通过CDH5 Hadoop读取和写入OSS数据( 三 ) _云服务器

重启所有节点的impala相关进程。
重启完成后即可使用impala查询OSS数据。

验证配置TPC-DS的benchmark有一张表为call_center，假设该表存储在OSS中，我们可以创建一个外部表指向它，并且查询这张表根据cc_country分组分别有多少条记录。

[root@cdh-master ~]# impala-shell -i cdh-slave01:21000

Starting Impala Shell without Kerberos authentication

Connected to cdh-slave01:21000

Server version: impalad version 2.11.0-cdh5.14.4 RELEASE (build20e635646a13347800fad36a7d0b1da25ab32404)

***********************************************************************************

Welcome to the Impala shell.

(Impala Shell v2.11.0-cdh5.14.4 (20e6356) built on Tue Jun 1203:43:08 PDT 2018)

The HISTORY command lists all shell commands in chronological order.

***********************************************************************************

[cdh-slave01:21000] > droptableifexists call_center;

Query: droptableifexists call_center

[cdh-slave01:21000] >

[cdh-slave01:21000] > createexternaltable call_center(

>cc_call_center_skbigint

> ,cc_call_center_idstring

> ,cc_rec_start_datestring

> ,cc_rec_end_datestring

> ,cc_closed_date_skbigint

> ,cc_open_date_skbigint

> ,cc_namestring

> ,cc_classstring

> ,cc_employeesint

> ,cc_sq_ftint

> ,cc_hoursstring

> ,cc_managerstring

> ,cc_mkt_idint

> ,cc_mkt_classstring

> ,cc_mkt_descstring

> ,cc_market_managerstring

> ,cc_divisionint

> ,cc_division_namestring

> ,cc_companyint

> ,cc_company_namestring

> ,cc_street_numberstring

> ,cc_street_namestring

> ,cc_street_typestring

> ,cc_suite_numberstring

> ,cc_citystring

> ,cc_countystring

> ,cc_statestring

> ,cc_zipstring

> ,cc_countrystring

> ,cc_gmt_offsetdouble

> ,cc_tax_percentagedouble

> )

> rowformatdelimitedfieldsterminatedby'|'

> location 'oss://${your-bucket-name}/call_center';

Query: createexternaltable call_center(

cc_call_center_skbigint

,cc_call_center_idstring

,cc_rec_start_datestring

,cc_rec_end_datestring

,cc_closed_date_skbigint

,cc_open_date_skbigint

,cc_namestring

,cc_classstring

,cc_employeesint

,cc_sq_ftint

,cc_hoursstring

,cc_managerstring

,cc_mkt_idint

,cc_mkt_classstring

,cc_mkt_descstring

,cc_market_managerstring

,cc_divisionint

,cc_division_namestring

,cc_companyint

,cc_company_namestring

,cc_street_numberstring

,cc_street_namestring

,cc_street_typestring

,cc_suite_numberstring

,cc_citystring

,cc_countystring

,cc_statestring

,cc_zipstring

,cc_countrystring

,cc_gmt_offsetdouble

,cc_tax_percentagedouble

)

rowformatdelimitedfieldsterminatedby'|'

location 'oss://${your-bucket-name}/call_center'

Fetched 0row(s) in0.07s

[cdh-slave01:21000] > select cc_country, count(*) from call_center groupby cc_country;

Query: select cc_country, count(*) from call_center groupby cc_country

Query submitted at: 2018-10-2816:21:13 (Coordinator: http://cdh-slave01:25000)

Query progress can be monitored at: http://cdh-slave01:25000/query_plan?query_id=fb4e09977145f367:3bdfe4d600000000

+---------------+----------+

| cc_country| count(*) |

+---------------+----------+

| United States | 30|

+---------------+----------+

Fetched 1 row(s) in 4.71s