文档库 最新最全的文档下载
当前位置:文档库 › MapReduce输出至hbase

MapReduce输出至hbase

MapReduce输出至hbase
MapReduce输出至hbase

MapReduce输出至hbase

首先,提一句,笔者在Hadoop集群执行此MR的时候报了一个错误,是一个jar包的缘故,这个错误是hbase版本的bug,在下面笔者会为大家介绍以及如何解决这个问题。

好了,笔者将分以下几个步骤进行介绍:

一、pom依赖

0.96.1.1-cdh5.0.0

org.apache.hbase

hbase-client

${hbase.version}

jdk.tools

jdk.tools

hbase-protocol

org.apache.hbase

org.apache.hbase

hbase-common

${hbase.version}

org.apache.hbase

hbase-server

${hbase.version}

hbase-protocol

org.apache.hbase

org.apache.hbase

hbase-thrift

${hbase.version}

hbase-protocol

org.apache.hbase

org.apache.hbase

hbase-testing-util

${hbase.version}

test

hbase-protocol

org.apache.hbase

org.apache.hbase

hbase-protocol

${hbase.version}

compile

二、hbase表创建以及hdfs数据准备

首先,我们执行hbase shell进入命令行,然后执行:

create 'user_info', {NAME => 'info'}

创建user_info表,列族是info。

然后hdfs数据还是之前入hive以及db的文件,这里就不贴出来了。

三、MR代码实现

首先,我们来看主类:

然后再来看Mapper类:

这个Mapper基本上没干啥事。再来看看Reducer:

我们在reducer再进行split,然后把结果写入到hbase。

四、执行以及版本bug解决方案

首先,我们打好包,直接在hadoop集群上执行,会报错如下:

16/04/1018:34:25INFO zookeeper.ClientCnxn: Opening socket connection to server massdata8/172.31.25.8: 2181.Will not attempt to authenticate using SASL (unknown error)

https://www.wendangku.net/doc/b12611574.html,ng.IllegalAccessError: class com.google.protobuf.HBaseZeroCopyByteString cannot access its superclass com.google.protobuf.LiteralByteString

我在网上查了半天,结果发现是hbase版本的原因。

笔者公司hadoop集群所使用的hbase版本是hbase-0.96.1.1-cdh5.0.0,使用这个刚好遇到这个bug,这个bug在后面的版本已经解决。

下面,我们执行:

HADOOP_CLASSPATH=/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hbase/lib/hbase-protocol-0.96.1.1-cdh5.0.0.jar:/etc/hbase/conf hadoop jar mr-demo-0.0.1-SNAPSHOT-jar-with-dependencies.jar

便可执行成功,主要是这个hbase版本,会动态加载jar文件,后面的日志我们可以看到,如下:

HADOOP_CLASSPATH=/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hbase/lib/hbase-protocol-0.96.1.1-cdh5.0.0.jar:/etc/hbase/conf hadoop jar mr-demo-0.0.1-SNAPSHOT-jar-with-dependencies.jar

16/04/1112:54:17INFO client.RMProxy: Connecting to ResourceManager at massdata8/172.31.25.8:8032

16/04/1112:54:17INFO zookeeper.ZooKeeper: Client environment:zookeeper.version=3.4.5-cdh5.0.0--1, built on 03/28/201404:21GMT

16/04/1112:54:17INFO zookeeper.ZooKeeper: Client environment:https://www.wendangku.net/doc/b12611574.html,=massdata8

16/04/1112:54:17INFO zookeeper.ZooKeeper: Client environment:java.version=1.7.0_75

16/04/1112:54:17INFO zookeeper.ZooKeeper: Client environment:java.vendor=Oracle Corporation

16/04/1112:54:17INFO zookeeper.ZooKeeper: Client environment:java.home=/usr/jdk1.7.0_75/jre

16/04/1112:54:17INFO zookeeper.ZooKeeper: Client environment:java.class.path=/etc/hadoop/conf:/opt/clou dera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop/lib/jaxb-api-2.2.2.jar:/opt/cloudera/par cels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop/lib/commons-beanutils-1.7.0.jar:/opt/cloudera/ parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop/lib/commons-el-1.0.jar:/opt/cloudera/parcel s/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop/lib/mockito-all-1.8.5.jar:/opt/cloudera/parcels/CD H-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop/lib/activation-1.1.jar:/opt/cloudera/parcels/CDH-5.0.0-1. cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop/lib/jasper-runtime-5.5.23.jar:/opt/cloudera/parcels/CDH-5.0.0-1.c dh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop/lib/snappy-java-1.0.4.1.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh 5.0.0.p0.47/lib/hadoop/libexec/../../hadoop/lib/jsr305-1.3.9.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47 /lib/hadoop/libexec/../../hadoop/lib/commons-httpclient-3.1.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.4 7/lib/hadoop/libexec/../../hadoop/lib/jsp-api-2.1.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoo

adoop/libexec/../../hadoop/lib/hue-plugins-3.5.0-cdh5.0.0-SNAPSHOT.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh 5.0.0.p0.47/lib/hadoop/libexec/../../hadoop/lib/jetty-6.1.26.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/ lib/hadoop/libexec/../../hadoop/lib/guava-11.0.2.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoo p/libexec/../../hadoop/lib/jersey-json-1.9.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexe c/../../hadoop/lib/commons-collections-3.2.1.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/li bexec/../../hadoop/lib/commons-math3-3.1.1.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/li bexec/../../hadoop/lib/xz-1.0.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoo p/lib/jaxb-impl-2.2.3-1.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop/lib/ slf4j-log4j12.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop/lib/jackson-xc -1.8.8.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop/lib/asm-3.2.jar:/opt/ cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop/lib/jersey-core-1.9.jar:/opt/clouder a/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop/lib/commons-digester-1.8.jar:/opt/clouder a/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop/lib/zookeeper-3.4.5-cdh5.0.0.jar:/opt/clou dera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop/lib/xmlenc-0.52.jar:/opt/cloudera/parce ls/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop/lib/httpclient-4.2.5.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop/lib/jackson-jaxrs-1.8.8.jar:/opt/cloudera/parcels/CDH-5.0. 0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop/lib/jetty-util-6.1.26.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh 5.0.0.p0.47/lib/hadoop/libexec/../../hadoop/lib/commons-logging-1.1.3.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cd h5.0.0.p0.47/lib/hadoop/libexec/../../hadoop/lib/avro.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/ha doop/libexec/../../hadoop/lib/jasper-compiler-5.5.23.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/ha doop/libexec/../../hadoop/lib/commons-io-2.4.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/ libexec/../../hadoop/lib/jackson-core-asl-1.8.8.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/li bexec/../../hadoop/lib/netty-3.6.2.Final.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/.. /../hadoop/lib/jets3t-0.9.0.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop/l ib/paranamer-2.3.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop/lib/slf4j-api-1.7.5.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop/lib/stax-api-1.0-2. jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop/lib/java-xmlbuilder-0.4.jar: /opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop/lib/log4j-1.2.17.jar:/opt/cloud era/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop/lib/jackson-mapper-asl-1.8.8.jar:/opt/clo udera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop/lib/commons-codec-1.4.jar:/opt/clou dera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop/lib/commons-compress-1.4.1.jar:/opt/c loudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop/lib/jersey-server-1.9.jar:/opt/clouder a/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop/lib/commons-lang-2.6.jar:/opt/cloudera/p arcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop/lib/jettison-1.1.jar:/opt/cloudera/parcels/CDH -5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop/lib/servlet-api-2.5.jar:/opt/cloudera/parcels/CDH-5.0.0-1. cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop/lib/jsch-0.1.42.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0. 47/lib/hadoop/libexec/../../hadoop/lib/protobuf-java-2.5.0.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/ lib/hadoop/libexec/../../hadoop/lib/httpcore-4.2.5.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hado op/libexec/../../hadoop/lib/commons-beanutils-core-1.8.0.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/l ib/hadoop/libexec/../../hadoop/lib/commons-net-3.1.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/ha

libexec/../../hadoop/lib/junit-4.8.2.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../h adoop/.//parquet-column-sources.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../ hadoop/.//parquet-pig-bundle-sources.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec /../../hadoop/.//parquet-cascading.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../ hadoop/.//parquet-encoding-javadoc.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/.. /../hadoop/.//parquet-thrift-javadoc.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../.. /hadoop/.//parquet-avro-javadoc.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../h adoop/.//parquet-avro.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop/.//h adoop-annotations-2.3.0-cdh5.0.0.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../ hadoop/.//parquet-thrift.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop/./ /parquet-thrift-sources.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop/.// parquet-generator.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop/.//parq uet-hadoop-bundle-sources.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoo p/.//hadoop-common-2.3.0-cdh5.0.0-tests.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libe xec/../../hadoop/.//parquet-scrooge.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../.. /hadoop/.//parquet-encoding-sources.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec /../../hadoop/.//hadoop-common.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../h adoop/.//parquet-pig-sources.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../had oop/.//parquet-cascading-sources.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../ hadoop/.//parquet-format-javadoc.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../ hadoop/.//parquet-scrooge-javadoc.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../.. /hadoop/.//parquet-encoding.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hado op/.//hadoop-common-2.3.0-cdh5.0.0.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/.. /../hadoop/.//parquet-generator-javadoc.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libex ec/../../hadoop/.//parquet-column.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../ hadoop/.//parquet-test-hadoop2.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../h adoop/.//hadoop-nfs.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop/.//ha doop-nfs-2.3.0-cdh5.0.0.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop/.// parquet-pig.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop/.//parquet-co mmon-javadoc.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop/.//hadoop-annotations.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop/.//parquet-co mmon-sources.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop/.//parquet-cascading-javadoc.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop/.//hado op-auth-2.3.0-cdh5.0.0.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop/.// parquet-common.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop/.//parqu et-hadoop-sources.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop/.//parq uet-format-sources.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop/.//parq uet-pig-bundle.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop/.//parquet-format.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop/.//parquet-avro-so urces.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop/.//parquet-hadoop.ja

r:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop/.//parquet-column-javadoc.j ar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop/.//parquet-hadoop-bundle. jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop/.//hadoop-auth.jar:/opt/cl oudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop/.//parquet-generator-sources.jar:/op t/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop/.//parquet-scrooge-sources.jar:/o pt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop/.//parquet-hadoop-javadoc.jar:/ opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop/.//parquet-pig-javadoc.jar:/opt /cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop-hdfs/./:/opt/cloudera/parcels/CD H-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop-hdfs/lib/commons-el-1.0.jar:/opt/cloudera/parcels/CD H-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop-hdfs/lib/jasper-runtime-5.5.23.jar:/opt/cloudera/parcels /CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop-hdfs/lib/jsr305-1.3.9.jar:/opt/cloudera/parcels/CDH -5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop-hdfs/lib/jsp-api-2.1.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop-hdfs/lib/jetty-6.1.26.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.

0.0.p0.47/lib/hadoop/libexec/../../hadoop-hdfs/lib/guava-11.0.2.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p 0.47/lib/hadoop/libexec/../../hadoop-hdfs/lib/asm-3.2.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/h adoop/libexec/../../hadoop-hdfs/lib/jersey-core-1.9.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/had oop/libexec/../../hadoop-hdfs/lib/xmlenc-0.52.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/l ibexec/../../hadoop-hdfs/lib/jetty-util-6.1.26.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/lib exec/../../hadoop-hdfs/lib/commons-logging-1.1.3.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/had oop/libexec/../../hadoop-hdfs/lib/commons-io-2.4.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hado op/libexec/../../hadoop-hdfs/lib/jackson-core-asl-1.8.8.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/ hadoop/libexec/../../hadoop-hdfs/lib/netty-3.6.2.Final.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/h adoop/libexec/../../hadoop-hdfs/lib/log4j-1.2.17.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoo p/libexec/../../hadoop-hdfs/lib/jackson-mapper-asl-1.8.8.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/li b/hadoop/libexec/../../hadoop-hdfs/lib/commons-codec-1.4.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.4 7/lib/hadoop/libexec/../../hadoop-hdfs/lib/jersey-server-1.9.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47 /lib/hadoop/libexec/../../hadoop-hdfs/lib/commons-lang-2.6.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.4 7/lib/hadoop/libexec/../../hadoop-hdfs/lib/servlet-api-2.5.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/li b/hadoop/libexec/../../hadoop-hdfs/lib/protobuf-java-2.5.0.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47 /lib/hadoop/libexec/../../hadoop-hdfs/lib/commons-cli-1.2.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/ lib/hadoop/libexec/../../hadoop-hdfs/lib/commons-daemon-1.0.13.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.

0.p0.47/lib/hadoop/libexec/../../hadoop-hdfs/.//hadoop-hdfs-2.3.0-cdh5.0.0-tests.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop-hdfs/.//hadoop-hdfs-nfs.jar:/opt/cloudera/parcels/CDH-5.

0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop-hdfs/.//hadoop-hdfs-2.3.0-cdh5.0.0.jar:/opt/cloudera/parcel s/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop-hdfs/.//hadoop-hdfs-nfs-2.3.0-cdh5.0.0.jar:/opt/clo udera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop-hdfs/.//hadoop-hdfs.jar:/opt/cloudera /parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop-yarn/lib/jaxb-api-2.2.2.jar:/opt/cloudera/par cels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop-yarn/lib/activation-1.1.jar:/opt/cloudera/parcels /CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop-yarn/lib/jsr305-1.3.9.jar:/opt/cloudera/parcels/CDH -5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop-yarn/lib/guice-servlet-3.0.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop-yarn/lib/commons-httpclient-3.1.jar:/opt/cloudera/parcels

/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop-yarn/lib/jetty-6.1.26.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop-yarn/lib/guava-11.0.2.jar:/opt/cloudera/parcels/CDH-5.0.0 -1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop-yarn/lib/javax.inject-1.jar:/opt/cloudera/parcels/CDH-5.0.0-1.c dh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop-yarn/lib/jersey-json-1.9.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh 5.0.0.p0.47/lib/hadoop/libexec/../../hadoop-yarn/lib/aopalliance-1.0.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.

0.0.p0.47/lib/hadoop/libexec/../../hadoop-yarn/lib/xz-1.0.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/li b/hadoop/libexec/../../hadoop-yarn/lib/jaxb-impl-2.2.3-1.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/li b/hadoop/libexec/../../hadoop-yarn/lib/jackson-xc-1.8.8.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib /hadoop/libexec/../../hadoop-yarn/lib/asm-3.2.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/ libexec/../../hadoop-yarn/lib/jersey-core-1.9.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/lib exec/../../hadoop-yarn/lib/jersey-guice-1.9.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libe xec/../../hadoop-yarn/lib/zookeeper-3.4.5-cdh5.0.0.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/had oop/libexec/../../hadoop-yarn/lib/jackson-jaxrs-1.8.8.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/ha doop/libexec/../../hadoop-yarn/lib/jetty-util-6.1.26.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/had oop/libexec/../../hadoop-yarn/lib/commons-logging-1.1.3.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/l ib/hadoop/libexec/../../hadoop-yarn/lib/jline-0.9.94.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/had oop/libexec/../../hadoop-yarn/lib/commons-io-2.4.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hado op/libexec/../../hadoop-yarn/lib/jackson-core-asl-1.8.8.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/ hadoop/libexec/../../hadoop-yarn/lib/stax-api-1.0-2.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/had oop/libexec/../../hadoop-yarn/lib/guice-3.0.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libe xec/../../hadoop-yarn/lib/jersey-client-1.9.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libex ec/../../hadoop-yarn/lib/log4j-1.2.17.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../.. /hadoop-yarn/lib/jackson-mapper-asl-1.8.8.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/lib exec/../../hadoop-yarn/lib/commons-codec-1.4.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop /libexec/../../hadoop-yarn/lib/commons-compress-1.4.1.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib /hadoop/libexec/../../hadoop-yarn/lib/jersey-server-1.9.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/ hadoop/libexec/../../hadoop-yarn/lib/commons-lang-2.6.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/li b/hadoop/libexec/../../hadoop-yarn/lib/jettison-1.1.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/had oop/libexec/../../hadoop-yarn/lib/servlet-api-2.5.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoo p/libexec/../../hadoop-yarn/lib/protobuf-java-2.5.0.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/had oop/libexec/../../hadoop-yarn/lib/commons-cli-1.2.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/had oop/libexec/../../hadoop-yarn/.//hadoop-yarn-server-tests.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/ lib/hadoop/libexec/../../hadoop-yarn/.//hadoop-yarn-api-2.3.0-cdh5.0.0.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cd h5.0.0.p0.47/lib/hadoop/libexec/../../hadoop-yarn/.//hadoop-yarn-server-nodemanager-2.3.0-cdh5.0.0.jar:/opt/cl oudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop-yarn/.//hadoop-yarn-server-commo n-2.3.0-cdh5.0.0.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop-yarn/.//ha doop-yarn-client-2.3.0-cdh5.0.0.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../ha doop-yarn/.//hadoop-yarn-server-common.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/lib exec/../../hadoop-yarn/.//hadoop-yarn-client.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/li bexec/../../hadoop-yarn/.//hadoop-yarn-server-web-proxy-2.3.0-cdh5.0.0.jar:/opt/cloudera/parcels/CDH-5.0.0-1. cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop-yarn/.//hadoop-yarn-common.jar:/opt/cloudera/parcels/CDH-5.0.

0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop-yarn/.//hadoop-yarn-server-tests-2.3.0-cdh5.0.0.jar:/opt/clou dera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop-yarn/.//hadoop-yarn-applications-distri butedshell-2.3.0-cdh5.0.0.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop-y arn/.//hadoop-yarn-server-resourcemanager.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/li bexec/../../hadoop-yarn/.//hadoop-yarn-applications-unmanaged-am-launcher-2.3.0-cdh5.0.0.jar:/opt/cloudera/ parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop-yarn/.//hadoop-yarn-applications-distribute dshell.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop-yarn/.//hadoop-yarn -api.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop-yarn/.//hadoop-yarn-s erver-nodemanager.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop-yarn/. //hadoop-yarn-applications-unmanaged-am-launcher.jar:/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/ hadoop/libexec/../../hadoop-yarn/.//hadoop-yarn-server-resourcemanager-2.3.0-cdh5.0.0.jar:/opt/cloudera/parc els/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop-yarn/.//hadoop-yarn-server-web-proxy.jar:/opt/c loudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/libexec/../../hadoop-yarn/.//hadoop-yarn-common-2.3.0 -cdh5.0.0.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/lib/junit-4.10.jar:/opt/cloudera/parcels/CDH/lib /hadoop-mapreduce/lib/snappy-java-1.0.4.1.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/lib/guice-ser vlet-3.0.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/lib/javax.inject-1.jar:/opt/cloudera/parcels/CDH/li b/hadoop-mapreduce/lib/aopalliance-1.0.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/lib/xz-1.0.jar:/o pt/cloudera/parcels/CDH/lib/hadoop-mapreduce/lib/asm-3.2.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapred uce/lib/jersey-core-1.9.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/lib/jersey-guice-1.9.jar:/opt/cloud era/parcels/CDH/lib/hadoop-mapreduce/lib/avro.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/lib/com mons-io-2.4.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/lib/jackson-core-asl-1.8.8.jar:/opt/cloudera/p arcels/CDH/lib/hadoop-mapreduce/lib/netty-3.6.2.Final.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/li b/paranamer-2.3.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/lib/guice-3.0.jar:/opt/cloudera/parcels/ CDH/lib/hadoop-mapreduce/lib/log4j-1.2.17.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/lib/jackson-mapper-asl-1.8.8.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/lib/commons-compress-1.4.1.jar:/opt/cl oudera/parcels/CDH/lib/hadoop-mapreduce/lib/jersey-server-1.9.jar:/opt/cloudera/parcels/CDH/lib/hadoop-ma preduce/lib/protobuf-java-2.5.0.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/lib/hamcrest-core-1.1.jar: /opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//jaxb-api-2.2.2.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//hadoop-mapreduce-examples.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//commons -beanutils-1.7.0.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//hadoop-extras-2.3.0-cdh5.0.0.jar:/opt/c loudera/parcels/CDH/lib/hadoop-mapreduce/.//commons-el-1.0.jar:/opt/cloudera/parcels/CDH/lib/hadoop-map reduce/.//hadoop-distcp-2.3.0-cdh5.0.0.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//junit-4.10.jar:/o pt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//hadoop-distcp.jar:/opt/cloudera/parcels/CDH/lib/hadoop-m apreduce/.//hadoop-mapreduce-client-hs-plugins.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//activ ation-1.1.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//hadoop-mapreduce-client-hs-2.3.0-cdh5.0.0.j ar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//jasper-runtime-5.5.23.jar:/opt/cloudera/parcels/CDH/lib /hadoop-mapreduce/.//snappy-java-1.0.4.1.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//jsr305-1.3.

9.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//hadoop-sls-2.3.0-cdh5.0.0.jar:/opt/cloudera/parcels/ CDH/lib/hadoop-mapreduce/.//commons-httpclient-3.1.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/. //jsp-api-2.1.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//hadoop-mapreduce-client-app.jar:/opt/cl oudera/parcels/CDH/lib/hadoop-mapreduce/.//commons-configuration-1.6.jar:/opt/cloudera/parcels/CDH/lib/h

adoop-mapreduce/.//hadoop-datajoin-2.3.0-cdh5.0.0.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//j etty-6.1.26.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//guava-11.0.2.jar:/opt/cloudera/parcels/CDH /lib/hadoop-mapreduce/.//hadoop-rumen-2.3.0-cdh5.0.0.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce /.//jersey-json-1.9.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//hadoop-archives.jar:/opt/cloudera/p arcels/CDH/lib/hadoop-mapreduce/.//hadoop-streaming.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce /.//commons-collections-3.2.1.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//commons-math3-3.1.1.j ar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//hadoop-archives-2.3.0-cdh5.0.0.jar:/opt/cloudera/parce ls/CDH/lib/hadoop-mapreduce/.//xz-1.0.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//jaxb-impl-2.2. 3-1.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//jackson-xc-1.8.8.jar:/opt/cloudera/parcels/CDH/lib/ hadoop-mapreduce/.//hadoop-gridmix-2.3.0-cdh5.0.0.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.// hadoop-mapreduce-examples-2.3.0-cdh5.0.0.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//asm-3.2.j ar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//jersey-core-1.9.jar:/opt/cloudera/parcels/CDH/lib/hado op-mapreduce/.//commons-digester-1.8.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//hadoop-grid mix.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//zookeeper-3.4.5-cdh5.0.0.jar:/opt/cloudera/parcels /CDH/lib/hadoop-mapreduce/.//xmlenc-0.52.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//httpclient -4.2.5.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//jackson-jaxrs-1.8.8.jar:/opt/cloudera/parcels/CD H/lib/hadoop-mapreduce/.//jetty-util-6.1.26.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//commons -logging-1.1.3.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//hadoop-mapreduce-client-shuffle-2.3.0-cdh5.0.0.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//metrics-core-3.0.0.jar:/opt/cloudera/parcels/C DH/lib/hadoop-mapreduce/.//avro.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//jasper-compiler-5.5.

23.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//commons-io-2.4.jar:/opt/cloudera/parcels/CDH/lib/ hadoop-mapreduce/.//jackson-core-asl-1.8.8.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//hadoop-extras.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//hadoop-mapreduce-client-hs.jar:/opt/cloudera/ parcels/CDH/lib/hadoop-mapreduce/.//hadoop-mapreduce-client-common-2.3.0-cdh5.0.0.jar:/opt/cloudera/par cels/CDH/lib/hadoop-mapreduce/.//hadoop-mapreduce-client-app-2.3.0-cdh5.0.0.jar:/opt/cloudera/parcels/CD H/lib/hadoop-mapreduce/.//hadoop-mapreduce-client-core-2.3.0-cdh5.0.0.jar:/opt/cloudera/parcels/CDH/lib/ha doop-mapreduce/.//jets3t-0.9.0.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//paranamer-2.3.jar:/opt /cloudera/parcels/CDH/lib/hadoop-mapreduce/.//stax-api-1.0-2.jar:/opt/cloudera/parcels/CDH/lib/hadoop-map reduce/.//java-xmlbuilder-0.4.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//hadoop-mapreduce-clien t-common.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//hadoop-rumen.jar:/opt/cloudera/parcels/C DH/lib/hadoop-mapreduce/.//hadoop-sls.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//log4j-1.2.17.j ar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//jackson-mapper-asl-1.8.8.jar:/opt/cloudera/parcels/CD H/lib/hadoop-mapreduce/.//commons-codec-1.4.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//com mons-compress-1.4.1.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//jersey-server-1.9.jar:/opt/clouder a/parcels/CDH/lib/hadoop-mapreduce/.//commons-lang-2.6.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapred uce/.//jettison-1.1.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//hadoop-auth-2.3.0-cdh5.0.0.jar:/opt/ cloudera/parcels/CDH/lib/hadoop-mapreduce/.//hadoop-mapreduce-client-jobclient.jar:/opt/cloudera/parcels/C DH/lib/hadoop-mapreduce/.//servlet-api-2.5.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//hadoop-mapreduce-client-core.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//jsch-0.1.42.jar:/opt/cloudera/pa rcels/CDH/lib/hadoop-mapreduce/.//hadoop-streaming-2.3.0-cdh5.0.0.jar:/opt/cloudera/parcels/CDH/lib/hadoo p-mapreduce/.//protobuf-java-2.5.0.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//hamcrest-core-1.1.

jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//hadoop-datajoin.jar:/opt/cloudera/parcels/CDH/lib/ha doop-mapreduce/.//hadoop-auth.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//hadoop-mapreduce-client-shuffle.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//httpcore-4.2.5.jar:/opt/cloudera/parcels/C DH/lib/hadoop-mapreduce/.//commons-beanutils-core-1.8.0.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapred uce/.//commons-net-3.1.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//hadoop-mapreduce-client-jo bclient-2.3.0-cdh5.0.0-tests.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//commons-cli-1.2.jar:/opt/cl oudera/parcels/CDH/lib/hadoop-mapreduce/.//hadoop-mapreduce-client-hs-plugins-2.3.0-cdh5.0.0.jar:/opt/clo udera/parcels/CDH/lib/hadoop-mapreduce/.//hadoop-mapreduce-client-jobclient-2.3.0-cdh5.0.0.jar:/opt/cloude ra/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hbase/lib/hbase-protocol-0.96.1.1-cdh5.0.0.jar:/etc/hbase/conf

16/04/1112:54:17INFO zookeeper.ZooKeeper: Client environment:java.library.path=/opt/cloudera/parcels/CD H-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop/lib/native

16/04/1112:54:17INFO zookeeper.ZooKeeper: Client environment:java.io.tmpdir=/tmp

16/04/1112:54:17INFO zookeeper.ZooKeeper: Client environment:https://www.wendangku.net/doc/b12611574.html,piler=

16/04/1112:54:17INFO zookeeper.ZooKeeper: Client environment:https://www.wendangku.net/doc/b12611574.html,=Linux

16/04/1112:54:17INFO zookeeper.ZooKeeper: Client environment:os.arch=amd64

16/04/1112:54:17INFO zookeeper.ZooKeeper: Client environment:os.version=2.6.32-279.el6.x86_64

16/04/1112:54:17INFO zookeeper.ZooKeeper: Client environment:https://www.wendangku.net/doc/b12611574.html,=hdfs

16/04/1112:54:17INFO zookeeper.ZooKeeper: Client environment:user.home=/home/hdfs

16/04/1112:54:17INFO zookeeper.ZooKeeper: Client environment:user.dir=/home/qiyongkang

16/04/1112:54:17INFO zookeeper.ZooKeeper: Initiating client connection, connectString=172.31.25.2:2181,1 72.31.25.8:2181,172.31.25.3:2181sessionTimeout=60000watcher=hconnection-0xfcc6c91, quorum=172.31.25.2: 2181,172.31.25.8:2181,172.31.25.3:2181, baseZNode=/hbase

16/04/1112:54:17INFO zookeeper.RecoverableZooKeeper: Process identifier=hconnection-0xfcc6c91connect ing to ZooKeeper ensemble=172.31.25.2:2181,172.31.25.8:2181,172.31.25.3:2181

16/04/1112:54:17INFO zookeeper.ClientCnxn: Opening socket connection to server massdata8/172.31.25.8: 2181.Will not attempt to authenticate using SASL (unknown error)

16/04/1112:54:17INFO zookeeper.ClientCnxn: Socket connection established to massdata8/172.31.25.8:2181, initiating session

16/04/1112:54:17INFO zookeeper.ClientCnxn: Session establishment complete on server massdata8/172.31.

25.8:2181, sessionid = 0x353975519d0d25a, negotiated timeout = 60000

16/04/1112:54:18INFO mapreduce.TableOutputFormat: Created table instance for user_info

16/04/1112:54:18WARN mapreduce.JobSubmitter: Hadoop command-line option parsing not performed. I mplement the Tool interface and execute your application with ToolRunner to remedy this.

16/04/1112:54:21INFO input.FileInputFormat: Total input paths to process : 1

16/04/1112:54:22INFO mapreduce.JobSubmitter: number of splits:1

16/04/1112:54:22INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1458262657013_0989

16/04/1112:54:22INFO impl.YarnClientImpl: Submitted application application_1458262657013_0989

16/04/1112:54:22INFO mapreduce.Job: The url to track the job: http://massdata8:8088/proxy/application_1 458262657013_0989/

16/04/1112:54:22INFO mapreduce.Job: Running job: job_1458262657013_0989

16/04/1112:54:32INFO mapreduce.Job: Job job_1458262657013_0989 running in uber mode : false

16/04/1112:54:32INFO mapreduce.Job: map 0% reduce 0%

16/04/1112:54:42INFO mapreduce.Job: map 100% reduce 0%

16/04/1112:54:51INFO mapreduce.Job: map 100% reduce 100%

16/04/1112:54:52INFO mapreduce.Job: Job job_1458262657013_0989 completed successfully 16/04/1112:54:53INFO mapreduce.Job: Counters: 49

File System Counters

FILE: Number of bytes read=182

FILE: Number of bytes written=230209

FILE: Number of read operations=0

FILE: Number of large read operations=0

FILE: Number of write operations=0

HDFS: Number of bytes read=259

HDFS: Number of bytes written=0

HDFS: Number of read operations=2

HDFS: Number of large read operations=0

HDFS: Number of write operations=0

Job Counters

Launched map tasks=1

Launched reduce tasks=1

Data-local map tasks=1

Total time spent by all maps in occupied slots (ms)=7763

Total time spent by all reduces in occupied slots (ms)=8240

Total time spent by all map tasks (ms)=7763

Total time spent by all reduce tasks (ms)=8240

Total vcore-seconds taken by all map tasks=7763

Total vcore-seconds taken by all reduce tasks=8240

Total megabyte-seconds taken by all map tasks=7949312

Total megabyte-seconds taken by all reduce tasks=8437760

Map-Reduce Framework

Map input records=8

Map output records=8

Map output bytes=168

Map output materialized bytes=178

Input split bytes=117

Combine input records=0

Combine output records=0

Reduce input groups=8

Reduce shuffle bytes=178

Reduce input records=8

Reduce output records=8

Spilled Records=16

Shuffled Maps =1

Failed Shuffles=0

Merged Map outputs=1

GC time elapsed (ms)=70

CPU time spent (ms)=2560

Physical memory (bytes) snapshot=960487424

Virtual memory (bytes) snapshot=3228942336

Total committed heap usage (bytes)=1584398336 Shuffle Errors

BAD_ID=0

CONNECTION=0

IO_ERROR=0

WRONG_LENGTH=0

WRONG_MAP=0

WRONG_REDUCE=0

File Input Format Counters

Bytes Read=142

File Output Format Counters

Bytes Written=0

这样,便执行成功啦。

五、查看结果

下面,我们在hbase执行scan ‘user_info’,可以看到:

说明结果入hbase成功!

本文作者:qiyongkang

污水处理厂工艺流程图

污水处理工艺流程图 污水进入厂区先通过截流井(让厂能处理的污水进入厂区进行处理)进入粗格栅(打捞较大的渣滓)到污水泵(提升污水的高度)到细格栅(打捞较小的渣滓)到沉沙池(以重力分离为基础,将污水的比重较大的无机颗粒沉淀并排除)到生化池(采用活性污泥法去除污水里的BOD5、SS和以各种形式的氮或磷)进入终沉池(排除剩余污泥和回流污泥)进入D型滤池(进一步减少SS,使出水达到国家一级标准)进入紫外线消毒(杀灭水中的大肠杆菌)然后出水 生化池、终沉池出的污泥一部分作为生化池的回流污泥,剩下的送入污泥脱水间脱水外运 主要有物理处理法,生化处理法和化学处理法,生化处理法经常被使用,主流处理方法主要看被处理水质和受纳水体情况,一般城市生活污水的主流处理方法为生化处理法,如活性污泥法,mbr 等方法。 污水处理 sewage treatment.wastewater treatment 为使污水经过一定方法处理后.达到设定的某些标准.排入水体.排入某一水体或再次使用等的采取的某些措施或者方法等. 现代污水处理技术.按处理程度划分.可分为一级.二级和三级处理. 一级处理.主要去除污水中呈悬浮状态的固体污染物质.物理处理法大部分只能完成一级处理的要求.经过一级处理的污水.BOD一般可去除30%左右.达不到排放标准.一级处理属于二级处理的预处理. 二级处理.主要去除污水中呈胶体和溶解状态的有机污染物质(BOD.COD 物质).去除率可达90%以上.使有机污染物达到排放标准. 三级处理.进一步处理难降解的有机物.氮和磷等能够导致水体富营养化的可溶性无机物等.主要方法有生物脱氮除磷法.混凝沉淀法.砂率法.活性炭吸附法.离子交换法和电渗分析法等. 整个过程为通过粗格删的原污水经过污水提升泵提升后.经过格删或者筛率器.之后进入沉砂池.经过砂水分离的污水进入初次沉淀池.以上为一级处理(即物理处理).初沉池的出水进入生物处理设备.有活性污泥法和生物膜法.(其中活性污泥法的反应器有曝气池.氧化沟等.生物膜法包括生物滤池.生物转盘.生物接触氧化法和生物流化床).生物处理设备的出水进入二次沉淀池.二沉池的出水经过消毒排放或者进入三级处理.一级处理结束到此为二级处理.三级处理包括生物脱氮除磷法.混凝沉淀法.砂滤法.活性炭吸附法.离子交换法和电渗析法.二沉池的污泥一部分回流至初次沉淀池或者生物处理设备.一部分进入污泥浓缩池.之后进入污泥消化池.经过脱水和干燥设备后.污泥被最后利用.

矿井水处理工艺流程

矿井停电停风通风安全技术措施 页脚内容 - 1 - 一、矿井水处理工艺流程及说明 1、工艺流程 ↓ ↓ ↓ 冲洗水回到集水池 → 煤泥外运 2、工艺流程说明: 矿井水经泵提升到集水调节池,水在调节池内得到水质、水量的调节并停留沉降, 大量的煤泥沉降在池底通过行车式泵吸排泥机将煤泥吸入污泥池中,调节池内的水再 由泵提升通过管道混合器,同时在管道混合器前投加混凝剂PAC 和助凝剂PAM ,混合 反应后,进入高效斜管沉淀池,生成大量的有机胶团将大部分悬浮物(浊度)在斜管沉 淀池内下沉除去,沉淀池的上清液进入无阀过滤器,将水中不易沉降的固体物通过滤 料的截留、拦截等作用进行过滤,沉淀后的原水中还含有颗粒很细的与水形成溶胶状 态的有机悬浮物,这些物质中具有很强的聚合、沉降稳定性,不能用常规重力自然沉 降法去除, 由无阀过滤器内的过滤介质(石英砂),拦截水中的胶体及水中很细的物 质,确保出水水质。出水进入清水池,在清水池中通过二氧化氯的强氧化作用把水中 的细菌杀灭,经消毒后的水回用于井下防尘和消防等生产用水,多余的水溢流外排。 无阀过滤器为自动反冲洗式,当运行一个周期后滤层阻力加大,出水水量减少, 此时滤池的虹吸上升水位升高到一定位置时无阀过滤器进行自动反冲洗。反冲洗出回 流到集水调节池重新处理。 集水调节池和混凝反应斜管沉淀池的污泥排入污泥浓缩池,经浓缩后用泵打入压 滤机脱水后外运处置,污泥浓缩池的上清液回流到调节集水池。

矿井停电停风通风安全技术措施 页脚内容 - 2 - 二、生活污水工艺流程及说明 1、工艺流程 矿井水合并处理

矿井停电停风通风安全技术措施 页脚内容- 3 - 2、工艺流程说明 生活污水由管网收集汇流到污水处理站经格栅将水中的大颗粒杂物去除,去除后的颗 粒物作垃圾处理,然后进入调节池,污水在调节池内调节水质、水量后由提升泵提升污水进入水解沉淀池,污水在水解初沉池有一定的沉淀停留时间,污水中细小的颗粒杂质能大部分的在初沉池沉降去除。水解后的水自流进入曝气生物滤池,进行C/N 、N 二次生化处理,将污水中的有机物分解去除,生化后的水进入砂滤池进一步去除截留去除水中细小物质,最后进入清水池后可直接回用或溢流外排。 曝气生物滤池、砂滤池的反冲洗水回流到调节池重新处理。 水解初沉池底部污泥排入污泥池,进行压滤。 三、河水净化处理工艺流程及说明 1、工艺流程 用水点 污泥外排 反冲洗出水外排 2、工艺流程说明 用泵将3公里外的河水提升进入矿区现有两座储水池,然后再用阀门控制自流到一体 化净水器,阀前投加PAC 混凝剂,阀后投加PAM 絮凝剂,河水在此进行充分混合,反应生成大量的有机胶团,进入一体化净水器。一体化净水器是混合、反应、沉淀、过滤以及对滤料反冲洗等进行合理的设计组合,处理后的出水浊度小于3mg/L ,原水经泵提升加药混合后进入设备的反应区,再进沉淀区,形成絮状的悬浮物在沉淀区重力沉降,沉降底部的污泥定期外排。然后上部清水由集水管收集进入高位分配水箱进行配水后进入过滤区,水再经过多介质滤层,滤料层拦截靠重力不能沉降的细小颗粒物和胶体,过滤后的出水存入设备的清水区,清水区的清水作为自冲洗滤料的清洗水,冲洗滤料自动进行。高出清水区的清水经消毒后流入清水池。 排出少量的泥水与自动反洗水汇合进入污水处理站进行处理。

水处理工艺方案及流程

印染废水处理工艺方案及流程 处理工艺一 厌氧-好氧-生物炭接触为主的处理工艺,见图1。 图处理工艺一流程 该处理工艺是原纺织部设计院"七五"科研攻关成果。是近几年来在印染废水处理中采用较多,较成熟的工艺流程。这里的厌氧处理不是传统的厌氧硝化,而是进行水解和酸化作用。目的是对印染废水中可生化性很差的某些高分子物质和不溶性物质通过水解酸化,降解为小分子物质和可溶性物质,提高可生化性和BOD5 /COD Cr值,为后续好氧生化处理创造条件。同时好氧生化处理产生的剩余污泥经沉淀池全部回流到厌氧生化段,因污泥在厌氧生化段有足够的停留时间(8h~10h),能进行彻底的厌氧消化,使整个系统没有剩余污泥排放,即达到自身的污泥平衡(注:仅有少量的无机泥渣会在厌氧段积累,但不必设专门的污泥处理装置)。 厌氧池和好氧池中均安装填料,属生物膜法处理;生物炭池装活性炭并供氧,兼有悬浮生长和固着生长法特点;脉冲进水的作用是对厌氧池进行搅拌。 各部分的水力停留时间一般为: 调节池:8h~12h;厌氧生化池:8h~10h 好氧生化池:6h~8h;生物炭池:1h~2h 脉冲发生器间隔时间:5min~10min。 该处理工艺系统,对于COD Cr≤1000mg/L的印染废水,处理后的出水可达到国家排放标准,如进一步深度处理则可回用。对运转5年以上的工程观察,运行正常,处理效果稳定,也没有外排污泥,未发现厌氧生化池内污泥过度增长。 处理工艺二 以生化处理为主体,由厌氧水解酸化、接触氧化、合建式氧化沟组成,处理工艺流程见图2。

图处理工艺二流程 图2是二级生化处理串联的工艺,合建式氧化沟内设沉淀池,内沉池中污泥回流到厌氧水解酸化池,既提高生物量,又使污泥硝化。此处理工艺用于有机物浓度高,以印染废水为主的综合工业废水处理。 处理工艺三 为生化、物化相结合的工艺,其流程见图3。 图处理工艺三流程 主要染料为硫化、涂料、凡士林、活性及化学助剂。处理水量为100m3/d(漂炼60m3/d,染色40m3/d),水质为:pH=10~12,COD Cr=1000mg/ L,BOD5=200mg/L~300mg/L,色度为200倍~300倍。厌氧水解酸化池内设半软性填料、生物接触氧化池内设SNP型新型填料。后续物化处理采用加药反应气浮池,采用加药反应气浮池的特点为:一是脱落的生物膜、悬浮物等去除率高,可达到80%~90%;二是色度去除高,可达到95%;三是气浮池水力停留时间短,约30min左右,而沉淀池水力停留时间1 .5h~2h,故气浮池体积小,占地面积少;四是污泥含水率低,约97%~98%,气浮排渣可直接进行脱水处理。因此,采用气浮池后工艺流程中出现了二个明显的特点:一是只设污泥池,不设污泥浓缩池和污泥反应池,污泥直接进脱水机脱水处理;二是本来应采用活性污泥回流到厌氧水解酸化池,因加药反应后的污泥失去了活性,不能

污水处理厂工艺流程图

污水处理工艺流程图 污水进入厂区先通过截流井(让厂能处理的污水进入厂区进行处理)进入粗格栅(打捞较大的渣滓)到污水泵(提升污水的高度)到细格栅(打捞较小的渣滓)到沉沙池(以重力分离为基础,将污水的比重较大的无机颗粒沉淀并排除)到生化池(采用活性污泥法去除污水里的BOD5、SS和以各种形式的氮或磷)进入终沉池(排除剩余污泥和回流污泥)进入D 型滤池(进一步减少SS,使出水达到国家一级标准)进入紫外线消毒(杀灭水中的大肠杆菌)然后出水 生化池、终沉池出的污泥一部分作为生化池的回流污泥,剩下的送入污泥脱水间脱水外运主要有物理处理法,生化处理法和化学处理法,生化处理法经常被使用,主流处理方法主要看被处理水质和受纳水体情况,一般城市生活污水的主流处理方法为生化处理法,如活性污泥法,mbr 等方法。 污水处理 sewage treatment.wastewater treatment 为使污水经过一定方法处理后.达到设定的某些标准.排入水体.排入某一水体或再次使用等的采取的某些措施或者方法等. 现代污水处理技术.按处理程度划分.可分为一级.二级和三级处理. 一级处理.主要去除污水中呈悬浮状态的固体污染物质.物理处理法大部分只能完成一级处理的要求.经过一级处理的污水.BOD一般可去除30%左右.达不到排放标准.一级处理属于二级处理的预处理. 二级处理.主要去除污水中呈胶体和溶解状态的有机污染物质(BOD.COD物质).去除率可达90%以上.使有机污染物达到排放标准. 三级处理.进一步处理难降解的有机物.氮和磷等能够导致水体富营养化的可溶性无机物等.主要方法有生物脱氮除磷法.混凝沉淀法.砂率法.活性炭吸附法.离子交换法和电渗分析法等. 整个过程为通过粗格删的原污水经过污水提升泵提升后.经过格删或者筛率器.之后进入沉砂池.经过砂水分离的污水进入初次沉淀池.以上为一级处理(即物理处理).初沉池的出水进入生物处理设备.有活性污泥法和生物膜法.(其中活性污泥法的反应器有曝气池.氧化沟等.生物膜法包括生物滤池.生物转盘.生物接触氧化法和生物流化床).生物处理设备的出水进入二次沉淀池.二沉池的出水经过消毒排放或者进入三级处理.一级处理结束到此为二级处理.三级处理包括生物脱氮除磷法.混凝沉淀法.砂滤法.活性炭吸附法.离子交换法和电渗析法.二沉池的污泥一部分回流至初次沉淀池或者生物处理设备.一部分进入污泥浓缩池.之后进入污泥消化池.经过脱水和干燥设备后.污泥被最后利用. 各个处理构筑物的能耗分析 1.污水提升泵房 进入污水处理厂的污水经过粗格删进入污水提升泵房.之后被污水泵提升至沉砂池的前池.水泵运行要消耗大量的能量.占污水厂运行总能耗相当大的比例.这与污水流量和要提升的扬程有关. 2.沉砂池 沉砂池的功能是去除比重较大的无机颗粒.沉砂池一般设于泵站前.倒虹管前.以便减轻无机颗粒对水泵.管道的磨损,也可设于初沉池前.以减轻沉淀池负荷及改善污泥处理构筑物的处理条件.常用的沉砂池有平流沉砂池.曝气沉砂池.多尔沉砂池和钟式沉砂池. 沉砂池中需要能量供应的主要是砂水分离器和吸砂机.以及曝气沉砂池的曝气系统.多尔沉砂池和钟式沉砂池的动力系统. 3.初次沉淀池

矿井水处理工艺流程(井工程)

一、矿井水处理工艺流程及说明 1、工艺流程 ↓↓↓ 冲洗水回到集水池 →煤泥外运 2、工艺流程说明: 矿井水经泵提升到集水调节池,水在调节池内得到水质、水量的调节并停留沉降,大量的煤泥沉降在池底通过行车式泵吸排泥机将煤泥吸入污泥池中,调节池内的水再由泵提升通过管道混合器,同时在管道混合器前投加混凝剂PAC和助凝剂PAM,混合反应后,进入高效斜管沉淀池,生成大量的有机胶团将大部分悬浮物(浊度)在斜管沉淀池内下沉除去,沉淀池的上清液进入无阀过滤器,将水中不易沉降的固体物通过滤料的截留、拦截等作用进行过滤,沉淀后的原水中还含有颗粒很细的与水形成溶胶状态的有机悬浮物,这些物质中具有很强的聚合、沉降稳定性,不能用常规重力自然沉降法去除,由无阀过滤器内的过滤介质(石英砂),拦截水中的胶体及水中很细的物质,确保出水水质。出水进入清水池,在清水池中通过二氧化氯的强氧化作用把水中的细菌杀灭,经消毒后的水回用于井下防尘和消防等生产用水,多余的水溢流外排。 无阀过滤器为自动反冲洗式,当运行一个周期后滤层阻力加大,出水水量减少,此时滤池的虹吸上升水位升高到一定位置时无阀过滤器进行自动反冲洗。反冲洗出回流到集水调节池重新处理。 集水调节池和混凝反应斜管沉淀池的污泥排入污泥浓缩池,经浓缩后用泵打入压

滤机脱水后外运处置,污泥浓缩池的上清液回流到调节集水池。

钻井作业% 二、生活污水工艺流程及说明 1、工艺流程 矿井水合并处理

2、工艺流程说明 生活污水由管网收集汇流到污水处理站经格栅将水中的大颗粒杂物去除,去除后的颗粒物作垃圾处理,然后进入调节池,污水在调节池内调节水质、水量后由提升泵提升污水进入水解沉淀池,污水在水解初沉池有一定的沉淀停留时间,污水中细小的颗粒杂质能大部分的在初沉池沉降去除。水解后的水自流进入曝气生物滤池,进行C/N、N二次生化处理,将污水中的有机物分解去除,生化后的水进入砂滤池进一步去除截留去除水中细小物质,最后进入清水池后可直接回用或溢流外排。 曝气生物滤池、砂滤池的反冲洗水回流到调节池重新处理。 水解初沉池底部污泥排入污泥池,进行压滤。 三、河水净化处理工艺流程及说明 1、工艺流程 用水点 污泥外排反冲洗出水外排 2、工艺流程说明 用泵将3公里外的河水提升进入矿区现有两座储水池,然后再用阀门控制自流到一体化净水器,阀前投加PAC混凝剂,阀后投加PAM絮凝剂,河水在此进行充分混合,反应生成大量的有机胶团,进入一体化净水器。一体化净水器是混合、反应、沉淀、过滤以及对滤料反冲洗等进行合理的设计组合,处理后的出水浊度小于3mg/L,原水经泵提升加药混合后进入设备的反应区,再进沉淀区,形成絮状的悬浮物在沉淀区重力沉降,沉降底部的污泥定期外排。然后上部清水由集水管收集进入高位分配水箱进行配水后进入过滤区,水再经过多介质滤层,滤料层拦截靠重力不能沉降的细小颗粒物和胶体,过滤后的出水存入设备的清水区,清水区的清水作为自冲洗滤料的清洗水,冲洗滤料自动进行。高出清水区的清水经消毒后流入清水池。

中水处理工艺及选择

一、中水处理的工艺及选择。 1、中水回用工艺流程为了将污水处理成符合中水水质标准的水,一般要进行三个阶段的处理: (1)预处理该阶段主要有格栅和调节池两个处理单元,主要作用是去除污水中的固体杂质和均匀水质。 (2)主处理该阶段是中水回用处理的关键,主要作用是去除污水的溶解性有机物。 (3)后处理该阶段主要以消毒处理为主,对出水进行深度处理。保证出水达到中水水标准。 2、主处理的方法按目前已被采用的方法大致可分为三类: (1)生物处理法利用水中微生物的吸附、氧化分解污水中的有机物,包括好氧和厌氧微生物处理,一般以好氧处理较多。 (2)物理化学处理法以混凝沉淀(气浮)技术及活性炭吸附相结合为基本方式,与传统的二级处理相比,提高了水质,但运行费用较高。 (3)膜处理采用超滤(微滤)或反渗透膜处理,其优点是SS去除率很高,占地面积与传统的二级处理相比,减少了很多。但目前对此工艺在实际应用上还存有一定争议。 3、工艺流程的选择 工艺流程的选择需确定工艺流程时必须掌握中水原水的水量、水质和中水的使用要求,应根据上述条件选择经济合理、运行可靠的处理工艺;在选择工艺流程时,应考虑装置所占的面积和周围环境的限制以及噪声和臭气对周围环境带来的影响;中水水源的主要污染物是有机物,目前大多数以生物处理为主处理方法;在工艺流程中消毒灭菌工艺必不可少,一般采用含氯消毒剂进行消毒。 中水处理的工艺流程主要取决于中水水源和中水的用途,中水水源不仅影响处理工艺的选择,而且影响处理成本,因此,中水水源的选择十分关键;目前,我国主要以小区生活污水作为中水水源,所处理的中水主要用于浇花、冲厕、洗车等。当以城市污水处理厂二级处理出水为中水水源时,可采用物化+消毒工 艺,具体如下: 源水---> 调节池---> 过滤池---> 消毒池---> 储水池---> 排放当以小区生活污水作为中水水源时,可采用生化+消毒工艺,具体如下: 源水---> 水力筛---> 调节池---> 生化池---> 过滤池---> 消毒池---> 储水池--->排放上述工艺设施可根据现场具体情况,设计成地上式或地埋式结构。 一体化中水回用设备是将中水回用处理的几个单元集中在一台设备内进行,其特点是结构紧凑、占地面积小、自动化程度高,一般的处理量小于1500吨/天,主要适用于某一单体建筑的生活污水处理,一般人口少于3000人。当污水

生活污水处理工艺流程

生活污水处理工艺流程 随着人们生活水平的提高,生活污水排放越来越严重。在这样的形式下,生活污水处理工艺也在不断改进,下面我们来了解一下最新的污水处理工艺流程。 曝气生物滤池生活污水处理工艺流程 污水处理工艺流程简介:曝气生物滤池,就是在生物滤池处理装置中设置填料,通过人为供氧,使填料上生长大量的微生物。这种污水处理工艺流程装置由滤床、布气装置、布水装置、排水装置等组成。曝气装置采用配套专用曝气头,产生的中小气泡经填料反复切割,达到接近微控曝气的效果。由于反应池内污泥浓度高,处理设施紧凑,可大大节省占地面积,减少反应时间。 城市污水SPR除磷工艺 污水处理工艺流程简介:水体富营养化主要原因是人类向水体排放了大量的氨氮和磷,磷更是水体富营养化的最主要因素。纵观国内污水处理流程工艺,除磷技术一直是困扰污水处理厂运行的难题。传统的物化除磷技术需要大量的药剂,具有运行成本高,污泥产量大的缺点;前置厌氧的生物除磷工艺具有运行费用低的优点,但是由于完全依赖于微生物的摄磷、释磷作用,难以达到国家污水处理工艺流程的要求。当考虑中水回用时,则更难以达到要求。

实物流程图 图一:格栅间。 初次沉淀池。 图三:曝气池。

二次沉淀池。 消化池微波化学污水处理工艺不同于传统的污水处理工艺,其优点是工艺流程大大简化,且减少大量的管网工程,对进水的pH,浓度、温度等无特殊要求,工艺流程图见图。

流程说明: 1格栅:(对水中有较大颗粒物的水质,如城市生活污水),清除砂石、木块、塑料等大块杂物; 2调节池:调节水量和水质,降低对后续处理构筑物的冲击负荷;3混合器:将污水与投加的1#、2#添加剂进行充分混合与振荡;4微波反应器:污染物与添加剂进行物理化学反应以及微波低温催化的物化反应; 5沉降过滤一体化设备:实现固液分离,达到排放或回用目的,污泥则脱水外运或用作其他用途。 水中污染物是在添加剂与微波的共同作用下,发生剧烈的催化、物理

中水回用工艺流程与处理方式

中水回用工艺流程与处理方式 一、方式:中水因用途不同有两种处理方式: 1. 一种是将其处理到饮用水的标准而直接回用到日常生活中,即实现水资源直接循环利用,这种处理方式适用于水资源极度缺乏的地区,但投资高,工艺复杂; 2. 另一种是将其处理到非饮用水的标准,主要用于不与人体直接接触的用水,如便器的冲洗,地面、汽车清洗,绿化浇洒,消防,工业普通用水等,这是通常的中方式。 按处理方法,一般分为3种类型: 1.物理处理法: 膜滤法,适用于水质变化大的情况。 采用这种流程的特点是:装置紧凑,容易操作,以及受负荷变动的影响小。

膜滤法是在外力的作用下,被分离的溶 液以一定的流速沿着滤膜表面流动,溶液中溶剂和低分子量物质、无机离子从高压侧透过滤膜进入低压侧,并作为滤液而排出;而溶液中高分子物质、胶体微粒及微生物等被截留,溶液被浓缩并以浓缩形式排出。 适用于污水水质变化较大的情况。一般采用的方法有:砂滤、活性炭吸附、浮选、混凝沉淀等。这种流程的特点是:采用中空纤维超滤器进行处理,技术先进,结构紧凑,占地少,系统间歇运行,管理简单。 3.生物处理法: 适用于有机物含量较高的污水。一般采 用活性污泥法、接触氧化法、生物转盘等生物处理方法。或是单独使用,或是几种生物处理方法组合使用,如接触氧化 + 生物滤池;生物滤池 + 活性炭吸附;转盘十砂滤等流程。这种流程具有适应水力负荷变动能力强、产生污泥量少、维护管理容易等优点。 二、中水处理回用系统按其供应的范

围大小和规模,一般有下面四大类: 1.排水设施完善地区的单位建筑中水回用系统: 该系统中水水源取自本系统内杂用水和 优质杂排水。该排水经集流处理后供建筑内冲洗便器、清洗车、绿化等。其处理设施根据条件可设于本建筑内部或临近外部。如北京新万寿宾馆中水处理设备设于地下室中。 2.排水设施不完善地区的单位建筑中水回用系统: 城市排水体系不健全的地区,其水处理 设施达不到二级处理标准,通过中水回用可以减轻污水对当地河流再污染。该系统中水水源取自该建筑韧的排水净化池(如沉淀池、化粪池、除油池等),该池内的水为总的生活污水。该系统处理设施根据条件可设于室内或室外。

相关文档