Configuration of a new UAF Node

Table of Contents

Create an Logical Volume from all spare disk space

First partition the disks accordinging and reboot so the machine picks up the current tables.

Create the Physical Volumes

pvcreate /dev/sda4 /dev/sdb4 /dev/sdc1 /dev/sdd1

Create the volume groups

vgcreate uaf_vg /dev/sda4 /dev/sdb4 /dev/sdc1 /dev/sdd1

Create the logical Volume

lvcreate -L 3550G -i 4 -I 256 uaf_vg -n uaf_lv

Create the file system

mkfs.ext3 /dev/uaf_vg/uaf_lv
tune2fs -m0 /dev/uaf_vg/uaf_lv

Add the file system to fstab

/dev/uaf_vg/uaf_lv      /data                   ext3    defaults        1 3

Mount the file system

mkdir /data
mount /data

Files to copy from an existing UAF Node

scp root@uaf-2.t2.ucsd.edu:.ssh/auth* /root/.ssh
scp root@uaf-2.t2.ucsd.edu:/etc/auto.* /etc/
scp root@uaf-2.t2.ucsd.edu:/etc/passwd root@uaf-2.t2.ucsd.edu:/etc/group root@uaf-2.t2.ucsd.edu:/etc/shadow /etc/
scp root@uaf-2.t2.ucsd.edu:/etc/profile.d/custom.sh /etc/profile.d/
scp root@uaf-2.t2.ucsd.edu:/etc/init.d/condor /etc/init.d/
scp root@uaf-2.t2.ucsd.edu:/etc/DIR_COLORS /etc/

Autofs configuration

chkconfig autofs on
/etc/init.d/autofs restart

Condor Configuration

Copy the existing uaf configuration for the current node

Note: This step must be done on the central manager

cd /condor/release/etc
cp uaf-X.local uaf-NEW.local

Edit the uaf-NEW.local file and make the appropriate changes.

Create the following links

mkdir /etc/condor
ln -s /condor/release/etc/condor_config /etc/condor/
ln -s /condor/release/bin/* /usr/bin/
ln -s /condor/release/sbin/* /usr/sbin/

Create the following directory tree

mkdir -p /state/data/condor_local

Start Condor

chkconfig condor on
/etc/rc.d/init.d/condor start

Install the OSG Client

cd /data
mkdir vdt
mkdir pacman
cd pacman
wget http://physics.bu.edu/pacman/sample_cache/tarballs/pacman-3.26.tar.gz
tar zxvf pacman-3.26.tar.gz
cd pacman-3.26
source setup.sh
cd /data/vdt
export VDTSETUP_CONDOR_LOCATION=/condor/release
export VDTSETUP_CONDOR_CONFIG=/etc/condor/condor_config
export VDTSETUP_AGREE_TO_LICENSES=y
export VDTSETUP_ENABLE_CONDOR=
export VDTSETUP_INSTALL_CERTS=r
export VDTSETUP_EDG_CRL_UPDATE=y
export VDTSETUP_ENABLE_ROTATE=y
export VDTSETUP_CA_CERT_UPDATER=y


pacman -get OSG:client

Say yes to the questions

Install the Gridftp server

cd  /data/pacman/pacman-3.26
source setup.sh
cd /data/vdt
pacman -get http://vdt.cs.wisc.edu/vdt_1101_cache:Globus-Base-Data-Server

Say yes to the questions

Enable the gftp server

source /data/vdt/setup.sh
vdt-control --on gsiftp

Configure the authentication by copying over /etc/grid-security/grid-mapfile, add a host key using certify

Setup the NTP server

ntpdate us.pool.ntp.org
scp uaf-2.t2.ucsd.edu:/etc/ntp.conf /etc/
/etc/init.d/ntpd restart
chkconfig ntpd on

Create the data tmp area

mkdir /data/tmp
chmod 1777 /data/tmp

Adding the Compat packages

yum -y install compat* 

Add the i386 glibc

 yum -y install glibc-devel*

Adding iptables

scp uaf-2.t2.ucsd.edu:/etc/sysconfig/iptables /etc/sysconfig/iptables 
/etc/init.d/iptables restart

Install the Latest DCCP client

Download the client rpm from the dcache website http://www.dcache.org/

rpm -ivh dcache-dcap-1.8.0-4.x86_64.rpm

Install i386 and x64 versions of libz

yum -y install zlib-devel-1.2.1.2-1.2

KRB Config

Copy from another working UAF

/etc/krb5.conf

BWM-NG

Grab bwm-ng RPM for DAG and install it

http://www.gropp.org/?id=projects⊂=bwm-ng

Install some X applications

yum -y install xemacs xclock xterm
yum -y install  ImageMagick ggv xpdf gpdf  
 wget http://dag.wieers.com/rpm/packages/acroread/acroread-5.0.10-1.2.el4.rf.i386.rpm ; rpm -ivh acroread-5.0.10-1.2.el4.rf.i386.rpm

ViewVC?

Versions 1.0 is preferred as it uses highlight, at least for RHEL4

Limits.conf and Ulimit

Add the following to /etc/security/limits.conf

*       soft    rss 33554432
*       hard    rss 41943040
*       soft    nofile 2048
*       hard    nofile 2048

Add the following to /etc/pam.d/login

session    required     pam_limits.so

Add Gfortran

yum -y install gcc4-gfortran

-- TerrenceMartin - 31 Jul 2008