1、下载安装
2、解压
tar -xf apache-doris_apache-doris-0.12.0-incubating-bin.tar.gz -C /usr/java
mv apache-doris_apache-doris-0.12.0 dorsi
3、启动doris。 参考博客:http://doc.dorisdb.com/2178813
1、安装mysql-client失败:Error: Nothing to dothing to do
a) 添加源 rpm -ivh https://repo.mysql.com//mysql57-community-release-el7-11.noarch.rpm
b) yum search mysql-community
c) yum -y install mysql-community-client.x86_64
FE: 2、cd DorisDB-XX-1.0.0/fe 3、mkdir -p doris-meta 4、bin/start_fe.sh --daemon 5、查看log日志,8030和9030是否启动成功,且没有错误 6、mysql -h 127.0.0.1 -P9030 -uroot 连接doris 7、SHOW PROC '/frontends'\G 查看状态 BE: 8、cd DorisDB-XX-1.0.0/be 9、mkdir -p storage 10、ALTER SYSTEM ADD BACKEND "hadoop102:9050"; 11、bin/start_be.sh --daemon 12、SHOW PROC '/backends'\G 如果isAlive为true,则说明BE正常接入集群。如果BE没有正常接入集群,请查看log目录下的be.WARNING日志文件确定原因。
########################案例,导入CSV文件#############################
1、创建表结构
CREATE DATABASE IF NOT EXISTS load_test; USE load_test; CREATE TABLE insert_wiki_edit ( event_time DATETIME, channel VARCHAR(32) DEFAULT '', user VARCHAR(128) DEFAULT '', is_anonymous TINYINT DEFAULT '0', is_minor TINYINT DEFAULT '0', is_new TINYINT DEFAULT '0', is_robot TINYINT DEFAULT '0', is_unpatrolled TINYINT DEFAULT '0', delta INT SUM DEFAULT '0', added INT SUM DEFAULT '0', deleted INT SUM DEFAULT '0' ) AGGREGATE KEY(event_time, channel, user, is_anonymous, is_minor, is_new, is_robot, is_unpatrolled) PARTITION BY RANGE(event_time) ( PARTITION p06 VALUES LESS THAN ('2015-09-12 06:00:00'), PARTITION p12 VALUES LESS THAN ('2015-09-12 12:00:00'), PARTITION p18 VALUES LESS THAN ('2015-09-12 18:00:00'), PARTITION p24 VALUES LESS THAN ('2015-09-13 00:00:00') ) DISTRIBUTED BY HASH(user) BUCKETS 10 PROPERTIES("replication_num" = "1");
2、导入数据
curl --location-trusted -u root -H "column_separator:," -T wikipedia-2015-09-12-sampled http://localhost:8030/api/load_test/insert_wiki_edit/_stream_load
解释:
-u root :表示doris的账户,其实可以写成 -u root:password
-H "column_separator:," : 表示csv文件分割的字符串
-T wikipedia-2015-09-12-sampled : 表示数据文件
load_test/insert_wiki_edit/_stream_load :表示 库名/表名/执行方式
3、导入报错:
{ "TxnId": 7, "Label": "2eb7f173-d107-4169-aafd-951a6aced38d", "Status": "Fail", "Message": "too many filtered rows", "NumberTotalRows": 39244, "NumberLoadedRows": 39242, "NumberFilteredRows": 2, "NumberUnselectedRows": 0, "LoadBytes": 2505414, "LoadTimeMs": 426, "ErrorURL": "http://192.168.75.102:8040/api/_load_error_log?file=__shard_4/error_log_insert_stmt_f145238f303b5cc5-a0e5691877cab184_f145238f303b5cc5_a0e5691877cab184" }
可以查看错误curl http://192.168.75.102:8040/api/_load_error_log?file=__shard_4/error_log_insert_stmt_f145238f303b5cc5-a0e5691877cab184_f145238f303b5cc5_a0e5691877cab184
Reason: actual column number is more than schema column number. actual number: 12 sep: ,, schema number: 11; . src line: [2015-09-12 15:00:00,#en.wikipedia,Eat me, I'm a red bean,0,0,0,0,0,381,381,0]; Reason: actual column number is more than schema column number. actual number: 12 sep: ,, schema number: 11; . src line: [2015-09-12 20:00:00,#pt.wikipedia,Chronus, o cagão bunda-mole corno,0,0,0,0,1,0,0,0];
从错误可知,实际由12列,但是schema只有11列
4、导入成功
{ "TxnId": 8, "Label": "3b68d252-af25-4a55-b126-1310cd92931d", "Status": "Success", "Message": "OK", "NumberTotalRows": 39244, "NumberLoadedRows": 39244, "NumberFilteredRows": 0, "NumberUnselectedRows": 0, "LoadBytes": 2505412, "LoadTimeMs": 323 }
© 著作权归作者所有
举报
发表评论
0/200