日韩av黄I国产麻豆传媒I国产91av视频在线观看I日韩一区二区三区在线看I美女国产在线I麻豆视频国产在线观看I成人黄色短片

歡迎訪問 生活随笔!

生活随笔

當前位置: 首頁 >

Clickhouse安装及使用/clickhouse-mysql安装

發布時間:2024/9/27 27 豆豆
生活随笔 收集整理的這篇文章主要介紹了 Clickhouse安装及使用/clickhouse-mysql安装 小編覺得挺不錯的,現在分享給大家,幫大家做個參考.

本文轉自:https://blog.csdn.net/xyb1206/article/details/82982688

1.安裝clickhouse環境

ClickHouse對Debian/Ubuntu支持較好,但是工作當中服務器我們一般用CentOs。今天我們使用CentOs7來安裝一下ClickHouse。
操作系統版本:CentOS Linux release 7.5.1804 (Core)

檢查一下是否支持SSE 4.2指令集:

grep -q sse4_2 /proc/cpuinfo && echo "SSE 4.2 supported" || echo "SSE 4.2 not supported"

2.下載安裝包

  • 下載地址:
  • https://repo.yandex.ru/clickhouse/rpm/stable/x86_64/ 下載一下四個包: clickhouse-client-18.12.17-2.noarch.rpm clickhouse-server-common-18.12.17-2.noarch.rpm clickhouse-server-18.12.17-2.noarch.rpm clickhouse-client-18.12.17-2.noarch.rpm
  • 開始安裝:
  • rpm -ivh clickhouse-server-common-18.12.17-2.noarch.rpm rpm -ivh clickhouse-server-18.12.17-2.noarch.rpm rpm -ivh clickhouse-common-static-18.12.17-2.x86_64.rpm rpm -ivh clickhouse-client-18.12.17-2.noarch.rpm

    注意:在安裝第二步會出現依賴錯誤,需下載依賴,yum install ODBC
    再次安裝clickhouse-server沒問題了。
    安裝后配置路徑:cd /etc/clickhouse-server/

  • 啟動命令:
  • clickhouse-server --config-file=/etc/clickhouse-server/config.xml 或: systemctl stop clickhouse-server systemctl start clickhouse-server

    3.clickhouse配置

  • 放開遠程訪問:
    vi /etc/clickhouse-server/config.xml
    修改服務器的配置文件/etc/clickhouse-server/config.xml,第65行,放開注釋即可,修改之后的內容如下:
  • <listen_host>::</listen_host> <listen_host>127.0.0.1</listen_host>
  • 內存權限設置:
    vi /etc/clickhouse-server/users.xml
  • <default><!-- Maximum memory usage for processing single query, in bytes. --><max_memory_usage>26800000000</max_memory_usage><!-- Use cache of uncompressed blocks of data. Meaningfu

    4.本地客戶端使用clickhouse-client

  • 啟動客戶端命令:
  • #clickhouse-client
  • 創建數據庫:(遵循mysql創建語句)
  • CREATE DATABASE [ IF NOT EXISTS ] db_name
  • 創建數據表:(末尾需要增加表引擎)
  • CREATE TABLE F_SZ_RYXX (PERSON_ID String,NBXH String,NAME String,CERTYPE String,BLICTYPE String,CERNO String,HJSZD String,SEX String,AGE Decimal (18,0),RZQX Decimal (18,0),NATDATE Date,DOM String,TEL String,LITDEG String,OFFSIGN String,ACCDSIDE String,COUNTRY String,STUFFTYPE String,POSITION String,POSBRFORM String,APPOUNIT String,SJC Date,RJZB Decimal (18,0),TZE Decimal (18,0),CZFS String,SJZB Decimal (18,0),SJCZFS String,CZRQ Date,CZBL Decimal (18,0),CZF String,TZRLX String,SFBD Decimal (18,0),SFLDRKHYZM Decimal (18,0),ZXHHSWBZ String,RYLX String,FZJG String,SJQK String,BFB Decimal (18,0),UNISCID String,ZCH String,QYMC String,DJJG String,FDDBR String,CLRQ Date,QYLX String,QYSX String,JYZT String,ZCZB Decimal (18,0) ) ENGINE = MergeTree(CLRQ,(PERSON_ID),10);
  • 插入數據
    A: 通過insert into 語句插入:(字符串需要單引號才能插入)
  • insert into f_sz_ryxx (PERSON_ID,NBXH,NAME,CERTYPE,BLICTYPE,CERNO,HJSZD,SEX,AGE,RZQX,NATDATE,DOM,TEL,LITDEG,OFFSIGN,ACCDSIDE,COUNTRY,STUFFTYPE,POSITION,POSBRFORM,APPOUNIT,SJC,RJZB,TZE,CZFS,SJZB,SJCZFS,CZRQ,CZBL,CZF,TZRLX,SFBD,SFLDRKHYZM,ZXHHSWBZ,RYLX,FZJG,SJQK,BFB,UNISCID,ZCH,QYMC,DJJG,FDDBR,CLRQ,QYLX,QYSX,JYZT,ZCZB) values('2140000000171339','2140000000014007','王民','10','','142701570501001','','1','61','','1/5/1957 00:00:00','太原市迎澤區東安路7-3-17','13835178783','','0','','156','02','','03','','19/2/2001 00:00:00','','','','','','','','','','','','','1','','','','','1400002002070','山西皮爾復臨床醫藥開發有限公司','1400000000','王民','1/9/1992 00:00:00','1130','03','11','300');

    B: 導入csv文件數據:

    cat F_SZ_RYXX.csv | clickhouse-client --query="INSERT INTO f_sz_ryxx FORMAT CSV"

    C: mysql數據導入clickhouse

    #du出的表大小 5.5G article_clientuser_sum.ibd#ClickHouse操作語句CREATE TABLE article_clientuser_sumENGINE = MergeTreeORDER BY id ASSELECT *FROM mysql('host:port', 'db', 'article_clientuser_sum', 'user', 'password') #耗時和平均速度0 rows in set. Elapsed: 137.251 sec. Processed 18.59 million rows, 7.34 GB (135.43 thousand rows/s., 53.48 MB/s.)

    5 clickhouse-mysql安裝及數據實時插入

    在CentOS 7上測試

  • 來自packagecloud.io的 Packagecloud repo 有關安裝的更多詳細信息,請訪問https://github.com/Altinity/clickhouse-rpm-install
  • curl -s https://packagecloud.io/install/repositories/altinity/clickhouse/script.rpm.sh | sudo bash

    安裝EPEL(for python3)和MySQL(for libmysqlclient)repos

    sudo yum install -y epel-release sudo yum install -y https://dev.mysql.com/get/mysql57-community-release-el7-11.noarch.rpm

    如果您的回購中沒有EPEL,請直接從EPEL網站安裝

    sudo yum install -y https://download.fedoraproject.org/pub/epel/7/x86_64/Packages/e/epel-release-7-11.noarch.rpm

    從packagecloud.io安裝數據閱讀器

    sudo yum install -y clickhouse-mysql

    clickhouse包也將作為依賴項安裝。
    準備配置文件 - 將示例文件復制到生產環境中并進行編輯。

    sudo cp /etc/clickhouse-mysql/clickhouse-mysql-example.conf /etc/clickhouse-mysql/clickhouse-mysql.conf sudo vim /etc/clickhouse-mysql/clickhouse-mysql.conf
  • 連接mysql-clickhouse數據插入
  • clickhouse-mysql \ --src-server-id=1 \ --src-resume \ --src-wait \ --nice-pause=1 \ --src-host=192.168.3.191 \ --src-user=root \ --src-password=abcd@1234 \ --src-tables=ZHIXIAOQIYE.zhixiao_data \ --dst-host=192.168.3.194 \ --dst-schema=default \ # 指定clickhouse數據庫 --dst-table=zhixiao \ # 指定clickhouse數據表 --csvpool \ --csvpool-file-path-prefix=qwe_ \ --mempool-max-flush-interval=60 \ --mempool-max-events-num=10000

    6 clickhouse客戶端連接

    clickhouse-client -h 192.168.3.194 --port 9001

    總結

    以上是生活随笔為你收集整理的Clickhouse安装及使用/clickhouse-mysql安装的全部內容,希望文章能夠幫你解決所遇到的問題。

    如果覺得生活随笔網站內容還不錯,歡迎將生活随笔推薦給好友。