vim /etc/sysconfig/network
NETWORKING=yes
HOSTNAME=itcast01 ###
The first: to be modified by the Linux graphical interface (highly recommended)
Into the Linux graphical interface -> Right click on the top right of two small computer -> click Edit connections -> select the current network System eth0 -> click on the edit button -> select IPv4 -> method selected for the manual -> Click on the add button -> Add IP: 192.168.8.118 Subnet Mask: 255.255.255.0 gateway: 192.168.1.1 -> apply
The second: the way modify the configuration file (program ape Cock wire dedicated)
vim /etc/sysconfig/network-scripts/ifcfg-eth0
DEVICE="eth0"
BOOTPROTO="static" ###
HWADDR="00:0C:29:3C:BF:E7"
IPV6INIT="yes"
NM_CONTROLLED="yes"
ONBOOT="yes"
TYPE="Ethernet"
UUID="ce22eeca-ecde-4536-8cc2-ef0dc36d4a8c"
IPADDR="192.168.8.118" ###
NETMASK="255.255.255.0" ###
GATEWAY="192.168.8.1" ###
vim /etc/hosts
192.168.8.118 itcast01
# Check firewall status
service iptables status
# Turn off the firewall
service iptables stop
# View firewall boot state
chkconfig iptables --list
# Turn off the firewall boot
chkconfig iptables off
# Create a folder
mkdir /usr/java
# Unzip
tar -zxvf jdk-7u55-linux-i586.tar.gz -C /usr/java/
vim /etc/profile
# In the file add
export JAVA_HOME=/usr/java/jdk1.7.0_55
export PATH=$PATH:$JAVA_HOME/bin
# Refresh configuration
source /etc/profile
hadoop-env.sh
vim hadoop-env.sh
# Line 27
export JAVA_HOME=/usr/java/jdk1.7.0_65
core-site.xml
<! - developed HDFS boss (NameNode) address ->
<property>
<name>fs.defaultFS</name>
<value>hdfs://itcast01:9000</value>
</property>
<! - generated file when run hadoop designated storage directory ->
<property>
<name>hadoop.tmp.dir</name>
<value>/itcast/hadoop-2.4.1/tmp</value>
</property>
hdfs-site.xml
<! - Specifies the number of copies of HDFS ->
<property>
<name>dfs.replication</name>
<value>1</value>
</property>
mapred-site.xml (mv mapred-site.xml.template mapred-site.xml)
mv mapred-site.xml.template mapred-site.xml
vim mapred-site.xml
<-! Mr designated to run on yarn ->
<property>
<name>mapreduce.framework.name</name>
<value>yarn</value>
</property>
yarn-site.xml
<! - Specifies the YARN boss (ResourceManager) address ->
<property>
<name>yarn.resourcemanager.hostname</name>
<value>itcast01</value>
</property>
<-! Reducer way to get data ->
<property>
<name>yarn.nodemanager.aux-services</name>
<value>mapreduce_shuffle</value>
</property>
vim /etc/proflie
export JAVA_HOME=/usr/java/jdk1.7.0_65
export HADOOP_HOME=/itcast/hadoop-2.4.1
export PATH=$PATH:$JAVA_HOME/bin:$HADOOP_HOME/bin:$HADOOP_HOME/sbin
source /etc/profile
hdfs namenode -format (hadoop namenode -format)
First start HDFS
sbin/start-dfs.sh
Restart YARN
sbin/start-yarn.sh
Use command to verify jps
27408 NameNode
28218 Jps
27643 SecondaryNameNode
28066 NodeManager
27803 ResourceManager
27512 DataNode
http://192.168.8.118:50070 (HDFS Management Interface)
http://192.168.8.118:50030 (MR Management Interface)
# Into my home directory
cd ~/.ssh
ssh-keygen -t rsa (four carriage return)
After executing this command, two files are generated id_rsa (private), id_rsa.pub (public key)
To copy the public key to avoid landing on the machine
ssh-copy-id localhost
Cluster node namenode master node datanode slave node The master node of resourcemanager yarn slave node of nodemanager yarn Cluster construction Use three machines shizhan01 NameNode ResourceManager ...
The test three clusters (node1 (192.168.1.2), node2 (192.168.1.4), node3 (192.168.1.6)), all of the main services are installed on node1 node operating system CentOS7.6 Environmental preparation Refer...
1. Download hadoop Download address:http://hadoop.apache.org (1) Found under Getting Started: Download (2) Find the following under To verify Hadoop releases using GPG: mirror site (3) Enter the conne...
project instruction First, it is necessary to explain the Hadoop cluster. There is a total of 5 servers, one of which as Namenode, and the other is a Datenode node. The specific content is inconvenien...
My experience is to remember three points First, learn to see the log: example: cat /usr/local/hbase-1.1.2/logs/hbase-root-master-hadoop1.log The second is to ensure that each of the time synchronizat...
1. The following error occurs when hdfs namenode -format Reason analysis: According to the error, I am here because the Hadoopdata directory cannot be created, the reason is the problem of defining da...
The following is a personal summary of the error I reported when installing Hadoop! ! ! Hadoop version: hadoop-3.1.0 Official website:http://hadoop.apache.org/releases.html Error: Solution: Since the ...
Summary of Hadoop installation Configuration file matching Remember to follow the format, otherwise he will have a reminder At this time, you only need to delete the space at the beginning of the rele...
Install jdk first Set environment variables Download hadoop Modify jdk profile, add HADOOP_HOME Modify 4 files under hadoop hadoop-env.sh core-site.xml hdfs-site.xml mapred-site.xml format Turn on Ano...
1, IP problem: Ifconfig does not display the IP of Enp3S0. After receiving the information, LO is a local loopback address, used for local and its own connectivity, does not take the network, if Hadoo...