第一章 文档概述
本文描述适用于Greenplum4.0以上版本的安装操作。所涉及到的操作系统相关参数调整,主要针对Redhat Linux操作系统。
第二章 安装介质
操作系统:CentOS release 6.5 (Final)。
Greenplum安装版本:greenplum-db-4.3.8.1-build-2-RHEL5-x86_64.zip
第三章 安装前准备
3.1、网络规划
建议在Greenplum数据库系统安装之前,把网络配置规划好
3.2、存储空间规划
首先,需要评估目标数据库数据所需要的空间容量。建议了解客户搭建Greenplum数据库的具体应用。
举例:估计数据库所需空间为U,数据库需要启用Mirror,磁盘阵列总可用空间为D(Raid之后)。空间规划服务和如下公式:
2 * U + U / 3 = D * 70%
磁盘空间D平均分配到各个Segment服务器上。
Master需要相应的空间。使用服务器内置硬盘的计算方式类似。
3.3、数据库实例规划
规划每个Segment服务器上建立的数据库实例的数量(instance数量),通常建议每2个CPU内核(core)对应一个数据库实例
第四章 操作系统设置
4.1 、设置主机名
修改各台主机的主机名称。一般建议的命名规则如下:
Master:mdw
Standby Master:smdw
Segment Host:sdw1、sdw2……sdwn
修改操作:
1、hostname mdw
2、修改 /etc/sysconfig/network 配置文件中的hostname
4.2 、设置hosts解析(所有节点,Master和Segments)
通常Master和Standby Master主机都配置外部IP和内部IP。Segment主机可只配置内部IP。所有主机的hosts文件内容必须保持一致
127.0.0.1 mdw localhost localhost.localdomain localhost4 localhost4.localdomain4
192.168.1.201 mdw
192.168.1.202 sdw1
192.168.1.203 sdw2
4.3、安装依赖软件(所有节点,Master和Segments)
yum -y install ed rsync coreutils glib2 lrzsz sysstat e4fsprogs xfsprogs ntp readline-devel zlib zlib-devel openssl openssl-devel pam-devel libxml2-devel libxslt-devel python-devel tcl-devel gcc make smartmontools flex bison OpenIPMI-tools openldap openldap-devel logrotate python-py gcc-c++ apr-devel libcurl-devel bzip2-devel libyaml-devel openssh-clients
【涉及机器】:所有服务器关闭防火墙
service iptables stop
chkconfig iptables off
service ip6tables stop
chkconfig ip6tables off
4.4、配置NTP时间同步(所有节点)
使用root用户进行操作,涉及所有服务器。
Greenplum推荐使用NTP(Network Time Protocol)同步各台主机的时钟。建议设置一台独立的时钟服务器。例如时钟服务器IP为10.6.220.20
4.4.1、Master服务器配置与时钟服务器同步。
修改配置文件/etc/ntp.conf后,启动ntpd服务。举例:配置文件增加:
server 10.6.220.20
启动NTP服务:
service ntpd start;chkconfig ntpd on
#如果没有独立的时钟服务器,则应该以Master服务器做内部的时钟服务器,Master就可以不用修改ntp.conf配置文件,直接启动ntpd服务即可。
4.4.2、所有Segment服务器优先与Master服务器同步,其次与Standby Master服务器同步。
修改配置文件/etc/ntp.conf后,重启ntpd服务。配置文件增加:
server mdw prefer
server smdw
启动服务:
service ntpd start;chkconfig ntpd on
4.4.3、Standby Master服务器优先与Master服务器,其次与始终服务器同步。
修改配置文件/etc/ntp.conf后,重启ntpd服务。配置文件增加:
server mdw prefer
server 10.6.220.20
启动服务:
service ntpd start;chkconfig ntpd on
#如果没有独立的时钟服务器,第二行不用配置。
4.5 修改系统参数(Redhat)
【涉及机器】:所有服务器;使用root用户进行修改,重启后生效。
4.5.1、修改系统参数/etc/sysctl.conf
kernel.shmmax = 500000000
kernel.shmmni = 4096
kernel.shmall = 4000000000
kernel.sem = 250 512000 100 2048
kernel.sysrq = 1
kernel.core_uses_pid = 1
kernel.msgmnb = 65536
kernel.msgmax = 65536
net.ipv4.tcp_syncookies = 1
net.ipv4.ip_forward = 0
net.ipv4.conf.default.accept_source_route = 0
net.ipv4.tcp_tw_recycle = 1
net.ipv4.tcp_max_syn_backlog = 4096
net.ipv4.conf.all.arp_filter = 1
net.ipv4.conf.default.arp_filter = 1
net.core.netdev_max_backlog = 10000
vm.overcommit_memory = 2
kernel.msgmni = 2048
net.ipv4.ip_local_port_range = 1025 65535
4.5.2、修改系统参数/etc/security/limits.conf
Linux PAM中 pam_limits.so 的配置文件
* soft nofile 65536
* hard nofile 65536
* soft nproc 131072
* hard nproc 131072
4.5.3、修改磁盘预读参数(所有节点,Master和Segments)
通过修改预读扇区数,可以有效磁盘的读性能,特别是顺序读,GPDB数据库要求最小磁盘扇区数为16384,建议设置为65535。
在参数文件/etc/rc.d/rc.local中增加;
blockdev --setra 65535 /dev/sd
4.5.4、修改配置/boot/grub/menu.lst
Linux默认的I/O调度模式是CFQ,通常需要修改I/O调度策略为deadline,可以通过下面的命令查看I/O调度策略。
cat /sys/block/sda/queue/scheduler
#临时修改
echo deadline > /sys/block/sda/queue/scheduler
如果永久修改I/O调度策略,则需要修改/boot/grub/menu.lst文件,在“kernel*”行后面增加elevator=deadline。
4.5.5、修改配置/etc/sysconfig/i18n
增加RC_LANG=en_US.UTF-8
4.6、启动IPMI服务
(IPMI(Intelligent Platform Management Interface)即智能平台管理接口是使硬件管理具备“智能化”的新一代通用接口标准。如果没有安装相关服务,建议安装)
service ipmi start;chkconfig ipmi on
第五章 配置用户和数据目录
5.1、创建gpadmin用户(所有节点,Master和Segments)
[root@mdw ~]# groupadd -g 520 gpadmin
[root@mdw ~]# useradd -u 520 -g gpadmin gpadmin
[root@mdw ~]# passwd gpadmin
Changing password for user gpadmin.
New password:
BAD PASSWORD: is too simple
Retype new password:
passwd: all authentication tokens updated successfully.
5.2、创建软件安装目录(所有节点,Master和Segments)
[root@mdw ~]# mkdir -p /gpdb/app
[root@mdw ~]# chown -R gpadmin:gpadmin /gpdb/
/gpdb目录为GPDB的BASE目录,/gpdb/app为GPDB的HOME目录。
第六章 安装Greenplum
6.1、上传并解压GPDB安装文件(仅Master节点)
[gpadmin@mdw gpdb]$ unzip greenplum-db-4.3.8.1-build-1-RHEL5-x86_64.zip
Archive: greenplum-db-4.3.8.1-build-1-RHEL5-x86_64.zip
inflating: README_INSTALL
inflating: greenplum-db-4.3.8.1-build-1-RHEL5-x86_64.bin
[gpadmin@mdw gpdb]$ ll
total 278668
drwxr-xr-x. 2 gpadmin gpadmin 4096 Mar 29 00:07 app
-rwxr-xr-x. 1 gpadmin gpadmin 143791566 Apr 20 2016 greenplum-db-4.3.8.1-build-1-RHEL5-x86_64.bin
-rw-r--r--. 1 gpadmin gpadmin 141547878 Mar 28 16:02 greenplum-db-4.3.8.1-build-1-RHEL5-x86_64.zip
-rw-r--r--. 1 gpadmin gpadmin 6997 Apr 20 2016 README_INSTALL
6.2、运行安装文件
gpadmin@mdw gpdb]$ ./greenplum-db-4.3.8.1-build-1-RHEL5-x86_64.bin
下面是许可信息后面的内容
********************************************************************************
You must read and accept the Pivotal Database license agreement
before installing
********************************************************************************
*** IMPORTANT INFORMATION - PLEASE READ CAREFULLY ***
PIVOTAL GREENPLUM DATABASE END USER LICENSE AGREEMENT
IMPORTANT - READ CAREFULLY: This Software contains computer programs and
other proprietary material and information, the use of which is subject to
and expressly conditioned upon acceptance of this End User License
Agreement ("EULA").
This EULA is a legally binding document between you (meaning the person or
the entity that obtained the Software under the terms and conditions of
this EULA, is agreeing to be bound by the terms and conditions of this
EULA, and is referred to below as "You" or "Customer") and Pivotal (meaning
(i) Pivotal Software, Inc., if Customer is located in the United States;
and (ii) the local Pivotal sales subsidiary, if Customer is located in a
country outside the United States in which Pivotal has a local sales
subsidiary; and (iii) GoPivotal International Limited, if Customer is
located in a country outside the United States in which Pivotal does not
have a local sales subsidiary (in each case, referred to herein as
"Pivotal"). Unless Customer has entered into a written and separately
signed agreement with Pivotal that is currently in effect with respect to
the license of the Software and provision of Support Services and
Subscription Services, this EULA governs Customer's use of the Software and
the provision of Support Services and Subscription Services. Capitalized
terms have the meaning stated in the EULA.
............
必须输入YES才可继续安装。
********************************************************************************
Do you accept the Pivotal Database license agreement? [yes|no]
********************************************************************************
yes
默认GPDB的安装路径为/usr/local/greenplum-db-**,确认需要输入YES,如果需要安装到其他路径,直接输入要按照的路径即可
********************************************************************************
Provide the installation path for Greenplum Database or press ENTER to
accept the default installation path: /usr/local/greenplum-db-4.3.8.1
********************************************************************************
/gpdb/app
********************************************************************************
Install Greenplum Database into </gpdb/app>? [yes|no]
********************************************************************************
yes
Extracting product to /gpdb/app
安装完成;安装完成会在/gpdb/app目录下生成以下文件。
[gpadmin@mdw gpdb]$ cd app
[gpadmin@mdw app]$ ll
total 276
drwxr-xr-x. 4 gpadmin gpadmin 4096 Apr 20 2016 bin
drwxr-xr-x. 2 gpadmin gpadmin 4096 Apr 20 2016 demo
drwxr-xr-x. 5 gpadmin gpadmin 4096 Apr 20 2016 docs
drwxr-xr-x. 2 gpadmin gpadmin 4096 Apr 20 2016 etc
drwxr-xr-x. 3 gpadmin gpadmin 4096 Apr 20 2016 ext
-rw-r--r--. 1 gpadmin gpadmin 43025 Apr 20 2016 GPDB-LICENSE.txt
-rw-rw-r--. 1 gpadmin gpadmin 713 Mar 29 00:12 greenplum_path.sh
drwxr-xr-x. 6 gpadmin gpadmin 4096 Apr 20 2016 include
drwxr-xr-x. 9 gpadmin gpadmin 4096 Apr 20 2016 lib
-rw-r--r--. 1 gpadmin gpadmin 192912 Apr 20 2016 LICENSE.thirdparty
drwxr-xr-x. 2 gpadmin gpadmin 4096 Apr 20 2016 sbin
drwxr-xr-x. 4 gpadmin gpadmin 4096 Apr 20 2016 share
6.3、设置GPDB环境变量(仅Master节点)
安装完成后修改gpadmin用户home的~/.bashrc配置文件,增加
source /gpdb/app/greenplum_path.sh
6.4、配置hostname文件(用于建立多机信任)
编辑节点信息文件(仅Master节点)。为了管理方便,在app目录下创建config文件夹,将节点信息文件存放在该目录下。需要创建两个文件,其中一个文件(hostlist)存放所有节点信息,seg_host文件只存放segment节点信息
[gpadmin@mdw app]$ mkdir config
[gpadmin@mdw app]$ cd config
[gpadmin@mdw config]$ cat hostlist
mdw
sdw1
sdw2
[gpadmin@mdw config]$ cat seg_host
sdw1
sdw2
6.5、打通所有节点直接的互信(仅Master节点)
GreenPlum数据库提供gpssh-exkeys工具来打开所有节点直接的互信关系,非常方便
[gpadmin@mdw config]$ gpssh-exkeys -f hostlist
[STEP 1 of 5] create local ID and authorize on local host
... /home/gpadmin/.ssh/id_rsa file exists ... key generation skipped
[STEP 2 of 5] keyscan all hosts and update known_hosts file
[STEP 3 of 5] authorize current user on remote hosts
... send to mdw
... send to sdw1
***
*** Enter password for sdw1:
... send to sdw2
[STEP 4 of 5] determine common authentication file content
[STEP 5 of 5] copy authentication files to all remote hosts
... finished key exchange with mdw
... finished key exchange with sdw1
... finished key exchange with sdw2
[INFO] completed successfully
互信配置完成后,可以通过gpssh工具来验证互信是否成功配置,-e参数后面的是远程登录节点后执行的命令。通过gpssh工具可以在所有节点运行同一命令,非常方便(后续会用到)。
[gpadmin@mdw config]$ gpssh -f /gpdb/app/config/hostlist -e 'pwd'
[ mdw] pwd
[ mdw] /home/gpadmin
[sdw2] pwd
[sdw2] /home/gpadmin
[sdw1] pwd
[sdw1] /home/gpadmin
6.6、Segment节点安装GreenPlum软件(仅Master节点)
通过gpseginstall命令安装segment软件,使用-u参数指定安装用户,-p参数指定安装用户的密码,这样将不再需要交互式输入密码。
[gpadmin@mdw config]$ gpseginstall -f hostlist -u gpadmin -p li0924
20180329:00:16:00:018760 gpseginstall:mdw:gpadmin-[INFO]:-Installation Info:
link_name greenplum-db
binary_path /gpdb/app
binary_dir_location /gpdb
binary_dir_name app
20180329:00:16:00:018760 gpseginstall:mdw:gpadmin-[INFO]:-check cluster password access
20180329:00:16:00:018760 gpseginstall:mdw:gpadmin-[INFO]:-de-duplicate hostnames
20180329:00:16:00:018760 gpseginstall:mdw:gpadmin-[INFO]:-master hostname: mdw
20180329:00:16:01:018760 gpseginstall:mdw:gpadmin-[INFO]:-rm -f /gpdb/app.tar; rm -f /gpdb/app.tar.gz
20180329:00:16:01:018760 gpseginstall:mdw:gpadmin-[INFO]:-cd /gpdb; tar cf app.tar app
20180329:00:16:10:018760 gpseginstall:mdw:gpadmin-[INFO]:-gzip /gpdb/app.tar
20180329:00:16:35:018760 gpseginstall:mdw:gpadmin-[INFO]:-remote command: mkdir -p /gpdb
20180329:00:16:35:018760 gpseginstall:mdw:gpadmin-[INFO]:-remote command: rm -rf /gpdb/app
20180329:00:16:35:018760 gpseginstall:mdw:gpadmin-[INFO]:-scp software to remote location
20180329:00:16:39:018760 gpseginstall:mdw:gpadmin-[INFO]:-remote command: gzip -f -d /gpdb/app.tar.gz
20180329:00:16:58:018760 gpseginstall:mdw:gpadmin-[INFO]:-md5 check on remote location
20180329:00:17:02:018760 gpseginstall:mdw:gpadmin-[INFO]:-remote command: cd /gpdb; tar xf app.tar
20180329:00:17:10:018760 gpseginstall:mdw:gpadmin-[INFO]:-remote command: rm -f /gpdb/app.tar
20180329:00:17:12:018760 gpseginstall:mdw:gpadmin-[INFO]:-remote command: cd /gpdb; rm -f greenplum-db; ln -fs app greenplum-db
20180329:00:17:13:018760 gpseginstall:mdw:gpadmin-[INFO]:-rm -f /gpdb/app.tar.gz
20180329:00:17:13:018760 gpseginstall:mdw:gpadmin-[INFO]:-version string on master: gpssh version 4.3.8.1 build 1
20180329:00:17:13:018760 gpseginstall:mdw:gpadmin-[INFO]:-remote command: . /gpdb/greenplum-db/./greenplum_path.sh; /gpdb/greenplum-db/./bin/gpssh --version
20180329:00:17:13:018760 gpseginstall:mdw:gpadmin-[INFO]:-remote command: . /gpdb/app/greenplum_path.sh; /gpdb/app/bin/gpssh --version
20180329:00:17:19:018760 gpseginstall:mdw:gpadmin-[INFO]:-SUCCESS -- Requested commands completed
Segment节点会根据Master节点的安装路径安装GreenPlum软件,目录结构和Master一模一样。
6.7、 Segment节点配置环境变量(所有Segment节点)
修改gpadmin用户home的~/.bashrc配置文件,增加
source /gpdb/app/greenplum_path.sh
第七章 数据库的初始化
7.1、创建数据文件存放目录(所有节点)
[root@mdw ~]# mkdir -p /data/gpdata/master
[root@mdw ~]# chown -R gpadmin:gpadmin /data
[root@sdw1 ~]# mkdir -p /data/gpdata/primary
[root@sdw1 ~]# mkdir -p /data/gpdata/mirror
[root@sdw1 ~]# chown -R gpadmin:gpadmin /data
本案例Master节点的数据文件存放在/data/gpdata/master目录,Segment节点的主数据文件存放在/data/gpdata/primary目录;镜像数据文件放在/data/gpdata/mirror目录
7.2、配置时间同步(所有节点)
本案例Master节点的服务器配置为NTP的服务端,Segment节点为NTP的客户端。Master节点使用root用户通过gpssh工具批量调用date命令对比各服务器的时间是否一致。
[gpadmin@mdw ~]$ gpssh -f /gpdb/app/config/hostlist
Note: command history unsupported on this machine ...
=> date
[sdw1] Wed Mar 28 17:51:36 CST 2018
[ mdw] Wed Mar 28 17:51:36 CST 2018
[sdw2] Wed Mar 28 17:51:36 CST 2018
7.3、系统检查(仅Master节点)
在初始化数据库之前,需要进行先决条件检查,主要检查磁盘I/O能力、网络带宽、内核参数、limit等条件是否满足GreenPlum数据库的要求。
参数配置检查
[gpadmin@mdw ~]$ gpcheck -f /gpdb/app/config/hostlist -m mdw
20180328:17:58:36:001300 gpcheck:mdw:gpadmin-[INFO]:-dedupe hostnames
20180328:17:58:37:001300 gpcheck:mdw:gpadmin-[INFO]:-Detected platform: Generic Linux Cluster
20180328:17:58:37:001300 gpcheck:mdw:gpadmin-[INFO]:-generate data on servers
20180328:17:58:38:001300 gpcheck:mdw:gpadmin-[INFO]:-copy data files from servers
20180328:17:58:39:001300 gpcheck:mdw:gpadmin-[INFO]:-delete remote tmp files
20180328:17:58:39:001300 gpcheck:mdw:gpadmin-[INFO]:-Using gpcheck config file: /gpdb/greenplum-db/./etc/gpcheck.cnf
20180328:17:58:39:001300 gpcheck:mdw:gpadmin-[ERROR]:-GPCHECK_ERROR host(None): utility will not check all settings when run as non-root user
20180328:17:58:39:001300 gpcheck:mdw:gpadmin-[INFO]:-gpcheck completing...
参数性能检查
1 参数配置检查
gpcheck -f /gpdb/app/config/hostlist -m mdw -s smdw
核对并修改下你感应系统参数。
2 性能检查
2.1 网络性能检查
gpcheckperf -f /gpdb/app/config/hostlist -r N -d /tmp > checknetwork.out
2.2 磁盘性能检查
gpcheckperf -f /gpdb/app/config/hostlist -r ds -D -d /data/gpdata/primary -d /data/gpdata/mirror r > checkio.out
检查磁盘IO的目标目录是数据库的数据文件目录,测试工具会写入系统内存的两倍大小的数据量。
7.4、创建GreenPlum数据库的参数文件(仅Master节点)
在$GPHOME/docs目录下,存在一些参数文件的模版,可以通过这些模版快速配置一些常用的参数文件。比如GreenPlum数据库的参数文件可以参考$GPHOME/docs/cli_help/gpconfigs/gpinitsystem_config文件。
[gpadmin@mdw ~]$ cp $GPHOME/docs/cli_help/gpconfigs/gpinitsystem_config /gpdb/app/config/gpinitsystem_config
配置参数文件gpinitsystem_config
[gpadmin@mdw config]$ cat gpinitsystem_config
# FILE NAME: gpinitsystem_config
# Configuration file needed by the gpinitsystem
################################################
#### REQUIRED PARAMETERS
################################################
#### Name of this Greenplum system enclosed in quotes.
ARRAY_NAME="EMC Greenplum DW"
#### Naming convention for utility-generated data directories.
SEG_PREFIX=gpseg
#### Base number by which primary segment port numbers
#### are calculated.
PORT_BASE=40000
#### File system location(s) where primary segment data directories
#### will be created. The number of locations in the list dictate
#### the number of primary segments that will get created per
#### physical host (if multiple addresses for a host are listed in
#### the hostfile, the number of segments will be spread evenly across
#### the specified interface addresses).
declare -a DATA_DIRECTORY=(/data/gpdata/primary)
#### OS-configured hostname or IP address of the master host.
MASTER_HOSTNAME=mdw
#### File system location where the master data directory
#### will be created.
MASTER_DIRECTORY=/data/gpdata/master
#### Port number for the master instance.
MASTER_PORT=5432
#### Shell utility used to connect to remote hosts.
TRUSTED_SHELL=ssh
#### Maximum log file segments between automatic WAL checkpoints.
CHECK_POINT_SEGMENTS=8
#### Default server-side character set encoding.
ENCODING=UNICODE
################################################
#### OPTIONAL MIRROR PARAMETERS
################################################
#### Base number by which mirror segment port numbers
#### are calculated.
#MIRROR_PORT_BASE=50000
#### Base number by which primary file replication port
#### numbers are calculated.
#REPLICATION_PORT_BASE=41000
#### Base number by which mirror file replication port
#### numbers are calculated.
#MIRROR_REPLICATION_PORT_BASE=51000
#### File system location(s) where mirror segment data directories
#### will be created. The number of mirror locations must equal the
#### number of primary locations as specified in the
#### DATA_DIRECTORY parameter.
#declare -a MIRROR_DATA_DIRECTORY=(/data/gpdata/mirror)
################################################
#### OTHER OPTIONAL PARAMETERS
################################################
#### Create a database of this name after initialization.
#DATABASE_NAME=name_of_database
#### Specify the location of the host address file here instead of
#### with the the -h option of gpinitsystem.
#MACHINE_LIST_FILE=/home/gpadmin/gpconfigs/hostfile_gpinitsystem
7.5、GreenPlum数据库初始化(仅Master节点)
接下来就可以使用gpinitsystem工具初始化数据库了,一些参数文件中没有设置的重要参数,在初始化数据库时会被使用默认值,可以在初始化之后根据需求及主机的配置进行设置。GreenPlum数据库的参数也分为静态参数和动态参数,静态参数需重启数据库才能生效,动态参数不需要重启数据库即可生效。
若需要standby master;可以-s 主机名即可;也可以后续使用gpinitsystem添加。这个后续文章讲解
[gpadmin@mdw config]$ gpinitsystem -c gpinitsystem_config -h seg_host
20180329:18:18:42:001126 gpinitsystem:mdw:gpadmin-[INFO]:-Checking configuration parameters, please wait...
20180329:18:18:42:001126 gpinitsystem:mdw:gpadmin-[INFO]:-Reading Greenplum configuration file gpinitsystem_config
20180329:18:18:42:001126 gpinitsystem:mdw:gpadmin-[INFO]:-Locale has not been set in gpinitsystem_config, will set to default value
20180329:18:18:42:001126 gpinitsystem:mdw:gpadmin-[INFO]:-Locale set to en_US.utf8
20180329:18:18:42:001126 gpinitsystem:mdw:gpadmin-[INFO]:-No DATABASE_NAME set, will exit following template1 updates
20180329:18:18:42:001126 gpinitsystem:mdw:gpadmin-[INFO]:-MASTER_MAX_CONNECT not set, will set to default value 250
20180329:18:18:43:001126 gpinitsystem:mdw:gpadmin-[INFO]:-Checking configuration parameters, Completed
20180329:18:18:43:001126 gpinitsystem:mdw:gpadmin-[INFO]:-Commencing multi-home checks, please wait...
..
20180329:18:18:44:001126 gpinitsystem:mdw:gpadmin-[INFO]:-Configuring build for standard array
20180329:18:18:44:001126 gpinitsystem:mdw:gpadmin-[INFO]:-Commencing multi-home checks, Completed
20180329:18:18:44:001126 gpinitsystem:mdw:gpadmin-[INFO]:-Building primary segment instance array, please wait...
..
20180329:18:18:45:001126 gpinitsystem:mdw:gpadmin-[INFO]:-Checking Master host
20180329:18:18:45:001126 gpinitsystem:mdw:gpadmin-[INFO]:-Checking new segment hosts, please wait...
.20180329:18:18:50:001126 gpinitsystem:mdw:gpadmin-[WARN]:-----------------------------------------------------------
20180329:18:18:50:001126 gpinitsystem:mdw:gpadmin-[WARN]:-Host sdw1 is assigned as localhost in /etc/hosts
20180329:18:18:50:001126 gpinitsystem:mdw:gpadmin-[WARN]:-This will cause segment->master communication failures
20180329:18:18:50:001126 gpinitsystem:mdw:gpadmin-[WARN]:-Remove sdw1 from local host line in /etc/hosts
20180329:18:18:50:001126 gpinitsystem:mdw:gpadmin-[WARN]:-----------------------------------------------------------
.20180329:18:18:51:001126 gpinitsystem:mdw:gpadmin-[WARN]:-----------------------------------------------------------
20180329:18:18:51:001126 gpinitsystem:mdw:gpadmin-[WARN]:-Host sdw2 is assigned as localhost in /etc/hosts
20180329:18:18:51:001126 gpinitsystem:mdw:gpadmin-[WARN]:-This will cause segment->master communication failures
20180329:18:18:51:001126 gpinitsystem:mdw:gpadmin-[WARN]:-Remove sdw2 from local host line in /etc/hosts
20180329:18:18:51:001126 gpinitsystem:mdw:gpadmin-[WARN]:-----------------------------------------------------------
20180329:18:18:51:001126 gpinitsystem:mdw:gpadmin-[INFO]:-Checking new segment hosts, Completed
20180329:18:18:52:001126 gpinitsystem:mdw:gpadmin-[INFO]:-Greenplum Database Creation Parameters
20180329:18:18:52:001126 gpinitsystem:mdw:gpadmin-[INFO]:---------------------------------------
20180329:18:18:52:001126 gpinitsystem:mdw:gpadmin-[INFO]:-Master Configuration
20180329:18:18:52:001126 gpinitsystem:mdw:gpadmin-[INFO]:---------------------------------------
20180329:18:18:52:001126 gpinitsystem:mdw:gpadmin-[INFO]:-Master instance name = EMC Greenplum DW
20180329:18:18:52:001126 gpinitsystem:mdw:gpadmin-[INFO]:-Master hostname = mdw
20180329:18:18:52:001126 gpinitsystem:mdw:gpadmin-[INFO]:-Master port = 5432
20180329:18:18:52:001126 gpinitsystem:mdw:gpadmin-[INFO]:-Master instance dir = /data/gpdata/master/gpseg-1
20180329:18:18:52:001126 gpinitsystem:mdw:gpadmin-[INFO]:-Master LOCALE = en_US.utf8
20180329:18:18:52:001126 gpinitsystem:mdw:gpadmin-[INFO]:-Greenplum segment prefix = gpseg
20180329:18:18:52:001126 gpinitsystem:mdw:gpadmin-[INFO]:-Master Database =
20180329:18:18:52:001126 gpinitsystem:mdw:gpadmin-[INFO]:-Master connections = 250
20180329:18:18:52:001126 gpinitsystem:mdw:gpadmin-[INFO]:-Master buffers = 128000kB
20180329:18:18:52:001126 gpinitsystem:mdw:gpadmin-[INFO]:-Segment connections = 750
20180329:18:18:52:001126 gpinitsystem:mdw:gpadmin-[INFO]:-Segment buffers = 128000kB
20180329:18:18:52:001126 gpinitsystem:mdw:gpadmin-[INFO]:-Checkpoint segments = 8
20180329:18:18:52:001126 gpinitsystem:mdw:gpadmin-[INFO]:-Encoding = UNICODE
20180329:18:18:52:001126 gpinitsystem:mdw:gpadmin-[INFO]:-Postgres param file = Off
20180329:18:18:52:001126 gpinitsystem:mdw:gpadmin-[INFO]:-Initdb to be used = /gpdb/greenplum-db/./bin/initdb
20180329:18:18:52:001126 gpinitsystem:mdw:gpadmin-[INFO]:-GP_LIBRARY_PATH is = /gpdb/greenplum-db/./lib
20180329:18:18:52:001126 gpinitsystem:mdw:gpadmin-[INFO]:-Ulimit check = Passed
20180329:18:18:52:001126 gpinitsystem:mdw:gpadmin-[INFO]:-Array host connect type = Single hostname per node
20180329:18:18:52:001126 gpinitsystem:mdw:gpadmin-[INFO]:-Master IP address [1] = ::1
20180329:18:18:52:001126 gpinitsystem:mdw:gpadmin-[INFO]:-Master IP address [2] = 192.168.1.201
20180329:18:18:52:001126 gpinitsystem:mdw:gpadmin-[INFO]:-Master IP address [3] = fe80::20c:29ff:fe30:f99e
20180329:18:18:52:001126 gpinitsystem:mdw:gpadmin-[INFO]:-Standby Master = Not Configured
20180329:18:18:52:001126 gpinitsystem:mdw:gpadmin-[INFO]:-Primary segment # = 1
20180329:18:18:52:001126 gpinitsystem:mdw:gpadmin-[INFO]:-Total Database segments = 2
20180329:18:18:52:001126 gpinitsystem:mdw:gpadmin-[INFO]:-Trusted shell = ssh
20180329:18:18:52:001126 gpinitsystem:mdw:gpadmin-[INFO]:-Number segment hosts = 2
20180329:18:18:52:001126 gpinitsystem:mdw:gpadmin-[INFO]:-Mirroring config = OFF
20180329:18:18:52:001126 gpinitsystem:mdw:gpadmin-[INFO]:----------------------------------------
20180329:18:18:52:001126 gpinitsystem:mdw:gpadmin-[INFO]:-Greenplum Primary Segment Configuration
20180329:18:18:52:001126 gpinitsystem:mdw:gpadmin-[INFO]:----------------------------------------
20180329:18:18:52:001126 gpinitsystem:mdw:gpadmin-[INFO]:-sdw1 /data/gpdata/primary/gpseg0 40000 2 0
20180329:18:18:52:001126 gpinitsystem:mdw:gpadmin-[INFO]:-sdw2 /data/gpdata/primary/gpseg1 40000 3 1
Continue with Greenplum creation Yy/Nn>
y
20180329:18:19:05:001126 gpinitsystem:mdw:gpadmin-[INFO]:-Building the Master instance database, please wait...
20180329:18:19:19:001126 gpinitsystem:mdw:gpadmin-[INFO]:-Starting the Master in admin mode
20180329:18:19:25:001126 gpinitsystem:mdw:gpadmin-[INFO]:-Commencing parallel build of primary segment instances
20180329:18:19:25:001126 gpinitsystem:mdw:gpadmin-[INFO]:-Spawning parallel processes batch [1], please wait...
..
20180329:18:19:25:001126 gpinitsystem:mdw:gpadmin-[INFO]:-Waiting for parallel processes batch [1], please wait...
.............................
20180329:18:19:54:001126 gpinitsystem:mdw:gpadmin-[INFO]:------------------------------------------------
20180329:18:19:54:001126 gpinitsystem:mdw:gpadmin-[INFO]:-Parallel process exit status
20180329:18:19:54:001126 gpinitsystem:mdw:gpadmin-[INFO]:------------------------------------------------
20180329:18:19:54:001126 gpinitsystem:mdw:gpadmin-[INFO]:-Total processes marked as completed = 2
20180329:18:19:54:001126 gpinitsystem:mdw:gpadmin-[INFO]:-Total processes marked as killed = 0
20180329:18:19:54:001126 gpinitsystem:mdw:gpadmin-[INFO]:-Total processes marked as failed = 0
20180329:18:19:54:001126 gpinitsystem:mdw:gpadmin-[INFO]:------------------------------------------------
20180329:18:19:55:001126 gpinitsystem:mdw:gpadmin-[INFO]:-Deleting distributed backout files
20180329:18:19:55:001126 gpinitsystem:mdw:gpadmin-[INFO]:-Removing back out file
20180329:18:19:55:001126 gpinitsystem:mdw:gpadmin-[INFO]:-No errors generated from parallel processes
20180329:18:19:55:001126 gpinitsystem:mdw:gpadmin-[INFO]:-Restarting the Greenplum instance in production mode
20180329:18:19:55:011745 gpstop:mdw:gpadmin-[INFO]:-Starting gpstop with args: -a -i -m -d /data/gpdata/master/gpseg-1
20180329:18:19:55:011745 gpstop:mdw:gpadmin-[INFO]:-Gathering information and validating the environment...
20180329:18:19:55:011745 gpstop:mdw:gpadmin-[INFO]:-Obtaining Greenplum Master catalog information
20180329:18:19:55:011745 gpstop:mdw:gpadmin-[INFO]:-Obtaining Segment details from master...
20180329:18:19:55:011745 gpstop:mdw:gpadmin-[INFO]:-Greenplum Version: 'postgres (Greenplum Database) 4.3.8.1 build 1'
20180329:18:19:55:011745 gpstop:mdw:gpadmin-[INFO]:-There are 0 connections to the database
20180329:18:19:55:011745 gpstop:mdw:gpadmin-[INFO]:-Commencing Master instance shutdown with mode='immediate'
20180329:18:19:55:011745 gpstop:mdw:gpadmin-[INFO]:-Master host=mdw
20180329:18:19:55:011745 gpstop:mdw:gpadmin-[INFO]:-Commencing Master instance shutdown with mode=immediate
20180329:18:19:55:011745 gpstop:mdw:gpadmin-[INFO]:-Master segment instance directory=/data/gpdata/master/gpseg-1
20180329:18:19:56:011745 gpstop:mdw:gpadmin-[INFO]:-Attempting forceful termination of any leftover master process
20180329:18:19:56:011745 gpstop:mdw:gpadmin-[INFO]:-Terminating processes for segment /data/gpdata/master/gpseg-1
20180329:18:19:57:011832 gpstart:mdw:gpadmin-[INFO]:-Starting gpstart with args: -a -d /data/gpdata/master/gpseg-1
20180329:18:19:57:011832 gpstart:mdw:gpadmin-[INFO]:-Gathering information and validating the environment...
20180329:18:19:57:011832 gpstart:mdw:gpadmin-[INFO]:-Greenplum Binary Version: 'postgres (Greenplum Database) 4.3.8.1 build 1'
20180329:18:19:57:011832 gpstart:mdw:gpadmin-[INFO]:-Greenplum Catalog Version: '201310150'
20180329:18:19:57:011832 gpstart:mdw:gpadmin-[INFO]:-Starting Master instance in admin mode
20180329:18:19:58:011832 gpstart:mdw:gpadmin-[INFO]:-Obtaining Greenplum Master catalog information
20180329:18:19:58:011832 gpstart:mdw:gpadmin-[INFO]:-Obtaining Segment details from master...
20180329:18:19:58:011832 gpstart:mdw:gpadmin-[INFO]:-Setting new master era
20180329:18:19:58:011832 gpstart:mdw:gpadmin-[INFO]:-Master Started...
20180329:18:19:58:011832 gpstart:mdw:gpadmin-[INFO]:-Shutting down master
20180329:18:19:59:011832 gpstart:mdw:gpadmin-[INFO]:-Commencing parallel segment instance startup, please wait...
....
20180329:18:20:03:011832 gpstart:mdw:gpadmin-[INFO]:-Process results...
20180329:18:20:03:011832 gpstart:mdw:gpadmin-[INFO]:-----------------------------------------------------
20180329:18:20:03:011832 gpstart:mdw:gpadmin-[INFO]:- Successful segment starts = 2
20180329:18:20:03:011832 gpstart:mdw:gpadmin-[INFO]:- Failed segment starts = 0
20180329:18:20:03:011832 gpstart:mdw:gpadmin-[INFO]:- Skipped segment starts (segments are marked down in configuration) = 0
20180329:18:20:03:011832 gpstart:mdw:gpadmin-[INFO]:-----------------------------------------------------
20180329:18:20:03:011832 gpstart:mdw:gpadmin-[INFO]:-
20180329:18:20:03:011832 gpstart:mdw:gpadmin-[INFO]:-Successfully started 2 of 2 segment instances
20180329:18:20:03:011832 gpstart:mdw:gpadmin-[INFO]:-----------------------------------------------------
20180329:18:20:03:011832 gpstart:mdw:gpadmin-[INFO]:-Starting Master instance mdw directory /data/gpdata/master/gpseg-1
20180329:18:20:04:011832 gpstart:mdw:gpadmin-[INFO]:-Command pg_ctl reports Master mdw instance active
20180329:18:20:04:011832 gpstart:mdw:gpadmin-[INFO]:-No standby master configured. skipping...
20180329:18:20:04:011832 gpstart:mdw:gpadmin-[INFO]:-Database successfully started
20180329:18:20:04:001126 gpinitsystem:mdw:gpadmin-[INFO]:-Completed restart of Greenplum instance in production mode
20180329:18:20:04:001126 gpinitsystem:mdw:gpadmin-[INFO]:-Loading gp_toolkit...
20180329:18:20:05:001126 gpinitsystem:mdw:gpadmin-[INFO]:-Scanning utility log file for any warning messages
20180329:18:20:05:001126 gpinitsystem:mdw:gpadmin-[WARN]:-*******************************************************
20180329:18:20:05:001126 gpinitsystem:mdw:gpadmin-[WARN]:-Scan of log file indicates that some warnings or errors
20180329:18:20:06:001126 gpinitsystem:mdw:gpadmin-[WARN]:-were generated during the array creation
20180329:18:20:06:001126 gpinitsystem:mdw:gpadmin-[INFO]:-Please review contents of log file
20180329:18:20:06:001126 gpinitsystem:mdw:gpadmin-[INFO]:-/home/gpadmin/gpAdminLogs/gpinitsystem_20180329.log
20180329:18:20:06:001126 gpinitsystem:mdw:gpadmin-[INFO]:-To determine level of criticality
20180329:18:20:06:001126 gpinitsystem:mdw:gpadmin-[INFO]:-These messages could be from a previous run of the utility
20180329:18:20:06:001126 gpinitsystem:mdw:gpadmin-[INFO]:-that was called today!
20180329:18:20:06:001126 gpinitsystem:mdw:gpadmin-[WARN]:-*******************************************************
20180329:18:20:06:001126 gpinitsystem:mdw:gpadmin-[INFO]:-Greenplum Database instance successfully created
20180329:18:20:06:001126 gpinitsystem:mdw:gpadmin-[INFO]:-------------------------------------------------------
20180329:18:20:06:001126 gpinitsystem:mdw:gpadmin-[INFO]:-To complete the environment configuration, please
20180329:18:20:06:001126 gpinitsystem:mdw:gpadmin-[INFO]:-update gpadmin .bashrc file with the following
20180329:18:20:06:001126 gpinitsystem:mdw:gpadmin-[INFO]:-1. Ensure that the greenplum_path.sh file is sourced
20180329:18:20:06:001126 gpinitsystem:mdw:gpadmin-[INFO]:-2. Add "export MASTER_DATA_DIRECTORY=/data/gpdata/master/gpseg-1"
20180329:18:20:06:001126 gpinitsystem:mdw:gpadmin-[INFO]:- to access the Greenplum scripts for this instance:
20180329:18:20:06:001126 gpinitsystem:mdw:gpadmin-[INFO]:- or, use -d /data/gpdata/master/gpseg-1 option for the Greenplum scripts
20180329:18:20:06:001126 gpinitsystem:mdw:gpadmin-[INFO]:- Example gpstate -d /data/gpdata/master/gpseg-1
20180329:18:20:06:001126 gpinitsystem:mdw:gpadmin-[INFO]:-Script log file = /home/gpadmin/gpAdminLogs/gpinitsystem_20180329.log
20180329:18:20:06:001126 gpinitsystem:mdw:gpadmin-[INFO]:-To remove instance, run gpdeletesystem utility
20180329:18:20:06:001126 gpinitsystem:mdw:gpadmin-[INFO]:-To initialize a Standby Master Segment for this Greenplum instance
20180329:18:20:06:001126 gpinitsystem:mdw:gpadmin-[INFO]:-Review options for gpinitstandby
20180329:18:20:06:001126 gpinitsystem:mdw:gpadmin-[INFO]:-------------------------------------------------------
20180329:18:20:06:001126 gpinitsystem:mdw:gpadmin-[INFO]:-The Master /data/gpdata/master/gpseg-1/pg_hba.conf post gpinitsystem
20180329:18:20:06:001126 gpinitsystem:mdw:gpadmin-[INFO]:-has been configured to allow all hosts within this new
20180329:18:20:06:001126 gpinitsystem:mdw:gpadmin-[INFO]:-array to intercommunicate. Any hosts external to this
20180329:18:20:06:001126 gpinitsystem:mdw:gpadmin-[INFO]:-new array must be explicitly added to this file
20180329:18:20:06:001126 gpinitsystem:mdw:gpadmin-[INFO]:-Refer to the Greenplum Admin support guide which is
20180329:18:20:06:001126 gpinitsystem:mdw:gpadmin-[INFO]:-located in the /gpdb/greenplum-db/./docs directory
20180329:18:20:06:001126 gpinitsystem:mdw:gpadmin-[INFO]:-------------------------------------------------------
来源:oschina
链接:https://my.oschina.net/u/4279943/blog/4523061