Jul 032012
 

When trying to use Apache Pig in local mode to connect to a stand-alone HBase using HBaseStorage, I kept getting errors like this:

ERROR org.apache.pig.tools.grunt.Grunt - ERROR 2999: Unexpected internal error. Not a host:port pair: ?42548@endive.local10.1.10.70,    64058,1341349176322

The unrecognized host:port pair corresponds to a happy sign-on message from the HBase log:

INFO org.apache.hadoop.hbase.zookeeper.RecoverableZooKeeper: The identifier of this process is 42548@endive.local

The problem is a version mismatch: HBase apparently changed the format of this data in 0.92. As of Pig 0.10.0, the solution is downgrade HBase to 0.90.6.

  2 Responses to “Apache Pig “Not a host:port pair” errors using HBase”

  1. Can you tell me how to downgrade HBase to 0.90.6? thanks

     
  2. Interesting. What happens if you instead ensure Pig is using the 0.92 HBase jar? You should be able to do this by simply putting it on $PIG_CLASSPATH, I think; or you might have to use pig-core instead of pig-withoutdependencies, and provide all the guava, hbase, etc jars yourself.

     

 Leave a Reply

You may use these HTML tags and attributes: <a href="" title=""> <abbr title=""> <acronym title=""> <b> <blockquote cite=""> <cite> <code> <del datetime=""> <em> <i> <q cite=""> <s> <strike> <strong>

(required)

(required)