Kettle

http://www.kettle.net.cn/

Flume

http://flume.apache.org/

dataX

https://github.com/alibaba/DataX
https://www.oschina.net/p/datax?hmsr=aladdin1e1

埋點

hive

https://hive.apache.org/

安裝tengine

#下載鏈接 http://tengine.taobao.org/download.html #所需依賴 yum install gcc openssl-devel pcre-devel zlib-devel -y

./configure

需要先安裝gcc：

yum install -y gcc

僅安裝gcc還不夠，還需要安裝pcre-devel：

yum install -y pcre-devel

出現(xiàn)如下日志表示成功：

make && make install

make && make install

出現(xiàn)下圖表示成功：

啟動tengine

tengine安裝成功后會在/usr/local目錄下生成nginx目錄，進入其sbin目錄即可啟動tengine：

cd /usr/local/nginx/sbin/

訪問時記得關(guān)閉防火墻或添加端口：

配置nginx為開機啟動

#1、在/etc/rc.d/init.d/目錄中建立文本文件nginx #2、在文件中粘貼下面的內(nèi)容：#!/bin/sh # # nginx - this script starts and stops the nginx daemon # # chkconfig: - 85 15 # description: Nginx is an HTTP(S) server, HTTP(S) reverse \ # proxy and IMAP/POP3 proxy server # processname: nginx # config: /etc/nginx/nginx.conf # config: /etc/sysconfig/nginx # pidfile: /var/run/nginx.pid# Source function library. . /etc/rc.d/init.d/functions# Source networking configuration. . /etc/sysconfig/network# Check that networking is up. [ "$NETWORKING" = "no" ] && exit 0nginx="/usr/local/nginx/sbin/nginx" prog=$(basename $nginx)NGINX_CONF_FILE="/usr/local/nginx/conf/nginx.conf"[ -f /etc/sysconfig/nginx ] && . /etc/sysconfig/nginxlockfile=/var/lock/subsys/nginxmake_dirs() {# make required directoriesuser=`nginx -V 2>&1 | grep "configure arguments:" | sed 's/[^*]*--user=\([^ ]*\).*/\1/g' -`options=`$nginx -V 2>&1 | grep 'configure arguments:'`for opt in $options; doif [ `echo $opt | grep '.*-temp-path'` ]; thenvalue=`echo $opt | cut -d "=" -f 2`if [ ! -d "$value" ]; then# echo "creating" $valuemkdir -p $value && chown -R $user $valuefifidone }start() {[ -x $nginx ] || exit 5[ -f $NGINX_CONF_FILE ] || exit 6make_dirsecho -n $"Starting $prog: "daemon $nginx -c $NGINX_CONF_FILEretval=$?echo[ $retval -eq 0 ] && touch $lockfilereturn $retval }stop() {echo -n $"Stopping $prog: "killproc $prog -QUITretval=$?echo[ $retval -eq 0 ] && rm -f $lockfilereturn $retval }restart() {configtest || return $?stopsleep 1start }reload() {configtest || return $?echo -n $"Reloading $prog: "killproc $nginx -HUPRETVAL=$?echo }force_reload() {restart }configtest() {$nginx -t -c $NGINX_CONF_FILE }rh_status() {status $prog }rh_status_q() {rh_status >/dev/null 2>&1 }case "$1" instart)rh_status_q && exit 0$1;;stop)rh_status_q || exit 0$1;;restart|configtest)$1;;reload)rh_status_q || exit 7$1;;force-reload)force_reload;;status)rh_status;;condrestart|try-restart)rh_status_q || exit 0;;*)echo $"Usage: $0 {start|stop|status|restart|condrestart|try-restart|reload|force-reload|configtest}"exit 2 esac#3、修改nginx文件的執(zhí)行權(quán)限chmod +x nginx #4、添加該文件到系統(tǒng)服務(wù)中去chkconfig --add nginx # 查看是否添加成功chkconfig --list nginx

啟動，停止，重新裝載nginx

service nginx start|stop

總結(jié)

以上是生活随笔為你收集整理的大数据技术栈整理的全部內(nèi)容，希望文章能夠幫你解決所遇到的問題。

如果覺得生活随笔網(wǎng)站內(nèi)容還不錯，歡迎將生活随笔推薦給好友。