菜单 学习猿地 - LMONKEY

VIP

开通学习猿地VIP

尊享10项VIP特权 持续新增

知识通关挑战

打卡带练!告别无效练习

接私单赚外块

VIP优先接,累计金额超百万

学习猿地私房课免费学

大厂实战课仅对VIP开放

你的一对一导师

每月可免费咨询大牛30次

领取更多软件工程师实用特权

入驻
319
0

Doris安装

原创
05/13 14:22
阅读数 73883

1、下载安装

2、解压

tar -xf apache-doris_apache-doris-0.12.0-incubating-bin.tar.gz -C /usr/java

mv  apache-doris_apache-doris-0.12.0 dorsi

3、启动doris。 参考博客:http://doc.dorisdb.com/2178813

1、安装mysql-client失败:Error: Nothing to dothing to do
  a) 添加源 rpm -ivh https://repo.mysql.com//mysql57-community-release-el7-11.noarch.rpm
b) yum search mysql-community
c) yum -y install mysql-community-client.x86_64
FE:
2、cd DorisDB-XX-1.0.0/fe

3、mkdir -p doris-meta

4、bin/start_fe.sh --daemon

5、查看log日志,8030和9030是否启动成功,且没有错误

6、mysql -h 127.0.0.1 -P9030 -uroot 连接doris

7、SHOW PROC '/frontends'\G 查看状态

BE:

8、cd DorisDB-XX-1.0.0/be

9、mkdir -p storage

10、ALTER SYSTEM ADD BACKEND "hadoop102:9050";

11、bin/start_be.sh --daemon

12、SHOW PROC '/backends'\G  
如果isAlive为true,则说明BE正常接入集群。如果BE没有正常接入集群,请查看log目录下的be.WARNING日志文件确定原因。

########################案例,导入CSV文件############################# 

1、创建表结构

CREATE DATABASE IF NOT EXISTS load_test;
 
 USE load_test;
 
 CREATE TABLE insert_wiki_edit
(
    event_time DATETIME,
    channel VARCHAR(32) DEFAULT '',
    user VARCHAR(128) DEFAULT '',
    is_anonymous TINYINT DEFAULT '0',
    is_minor TINYINT DEFAULT '0',
    is_new TINYINT DEFAULT '0',
    is_robot TINYINT DEFAULT '0',
    is_unpatrolled TINYINT DEFAULT '0',
    delta INT SUM DEFAULT '0',
    added INT SUM DEFAULT '0',
    deleted INT SUM DEFAULT '0'
)
AGGREGATE KEY(event_time, channel, user, is_anonymous, is_minor, is_new, is_robot, is_unpatrolled)
PARTITION BY RANGE(event_time)
(
    PARTITION p06 VALUES LESS THAN ('2015-09-12 06:00:00'),
    PARTITION p12 VALUES LESS THAN ('2015-09-12 12:00:00'),
    PARTITION p18 VALUES LESS THAN ('2015-09-12 18:00:00'),
    PARTITION p24 VALUES LESS THAN ('2015-09-13 00:00:00')
)
DISTRIBUTED BY HASH(user) BUCKETS 10
PROPERTIES("replication_num" = "1");

2、导入数据

curl --location-trusted -u root -H "column_separator:," -T wikipedia-2015-09-12-sampled http://localhost:8030/api/load_test/insert_wiki_edit/_stream_load

解释:
-u root :表示doris的账户,其实可以写成 -u root:password
  -H "column_separator:,"  : 表示csv文件分割的字符串
-T wikipedia-2015-09-12-sampled   : 表示数据文件
 load_test/insert_wiki_edit/_stream_load   :表示  库名/表名/执行方式

3、导入报错:

{
    "TxnId": 7,
    "Label": "2eb7f173-d107-4169-aafd-951a6aced38d",
    "Status": "Fail",
    "Message": "too many filtered rows",
    "NumberTotalRows": 39244,
    "NumberLoadedRows": 39242,
    "NumberFilteredRows": 2,
    "NumberUnselectedRows": 0,
    "LoadBytes": 2505414,
    "LoadTimeMs": 426,
    "ErrorURL": "http://192.168.75.102:8040/api/_load_error_log?file=__shard_4/error_log_insert_stmt_f145238f303b5cc5-a0e5691877cab184_f145238f303b5cc5_a0e5691877cab184"
}

可以查看错误curl   http://192.168.75.102:8040/api/_load_error_log?file=__shard_4/error_log_insert_stmt_f145238f303b5cc5-a0e5691877cab184_f145238f303b5cc5_a0e5691877cab184  

Reason: actual column number is more than schema column number. actual number: 12 sep: ,, schema number: 11; . src line: [2015-09-12 15:00:00,#en.wikipedia,Eat me, I'm a red bean,0,0,0,0,0,381,381,0]; 
Reason: actual column number is more than schema column number. actual number: 12 sep: ,, schema number: 11; . src line: [2015-09-12 20:00:00,#pt.wikipedia,Chronus, o cagão bunda-mole corno,0,0,0,0,1,0,0,0]; 

从错误可知,实际由12列,但是schema只有11列

 4、导入成功

{
    "TxnId": 8,
    "Label": "3b68d252-af25-4a55-b126-1310cd92931d",
    "Status": "Success",
    "Message": "OK",
    "NumberTotalRows": 39244,
    "NumberLoadedRows": 39244,
    "NumberFilteredRows": 0,
    "NumberUnselectedRows": 0,
    "LoadBytes": 2505412,
    "LoadTimeMs": 323
}

 

发表评论

0/200
319 点赞
0 评论
收藏
为你推荐 换一批