hadoop - vertica jar -


i trying transfer data vertica hive. according manual following should set input format:

-inputformat com.vertica.hadoop.deprecated.verticastreaminginput

but hadoop-vertica jar has org.apache.hadoop.vertica.verticastreaminginput class , not above.

so throwing me following exception:

exception in thread "main" java.lang.runtimeexception:   class org.apache.hadoop.vertica.verticastreaminginput not   org.apache.hadoop.mapred.inputformat

the full command is:

$hadoop_home/bin/hadoop jar $hadoop_home/contrib/streaming/hadoop-streaming-*.jar \   -libjars $hadoop_home/lib/hadoop-vertica.jar \    -dmapred.vertica.hostnames=verticahost \   -dmapred.vertica.database=exampledb \   -dmapred.vertica.username=exampleuser \   -dmapred.vertica.password=password123 \   -dmapred.vertica.port=5433 \   -dmapred.vertica.input.query="select * alltypes order key" \    -dmapred.vertica.input.delimiter=, \    -dmapred.map.tasks=1 \    -inputformat com.vertica.hadoop.deprecated.verticastreaminginput \    -input /tmp/input -output /tmp/output -reducer /bin/cat -mapper /bin/cat

hive cdh-4.4.0-1.cdh4.4.0.p0.39/ environment , vertica 7.1.

if have wrong hadoop-vertica jar, can correct one? if that's not problem, doing wrong?

so com.vertica.hadoop.deprecated.verticastreaminginput class come from? got installing vertica connector.(page 9 , step 5) https://my.vertica.com/docs/7.0.x/pdf/hp_vertica_7.0.x_hadoopintegration.pdf

i downloaded hadoop connector mapreduce the downloads page on my.vertica.com. took 2.0 version (which supports cdh 4), since that's hadoop version said you're using.

i looked in hadoop-vertica.jar file in downloaded file (yarn-vertica_1.6.0.zip) , has class file in correct place (com.vertica.hadoop.deprecated). zip file includes source, can inspect it.

i can't tell org.apache.hadoop.vertica.verticastreaminginput coming from, downloading fresh copy of connector should fix problem. make sure download jdbc driver , other java configuration described in documentation.


Comments

Post a Comment

Popular posts from this blog

javascript - Bootstrap Popover: iOS Safari strange behaviour -

i looking through twitter bootstrap documentation, , i'm interested in implementing dismissible popover when button clicked. here example bootstrap's docs: http://getbootstrap.com/javascript/#dismiss-on-next-click when press "dismissible popover" button os x safari browser works fine. when access same link above ios safari, button not work. is, popover not dismissed on click. why button not working ios safari? the example linked using data-trigger="focus" attribute. try changing data-trigger="click" . <a tabindex="0" class="btn btn-lg btn-danger" role="button" data-toggle="popover" data-trigger="click" title="dismissible popover" data-content="and here's amazing content. it's engaging. right?">dismissible popover</a>
Read more

Magento/PHP - Get phones on all members in a customer group -

i working on custom magento extension. working around adminhtml part , i've created custom form there. here form code: <?php class vivasindustries_smsnotification_block_adminhtml_sms_sendmass_edit_form extends mage_adminhtml_block_widget_form { public function _preparelayout() { $extensionpath = mage::getmoduledir('js', 'vivasindustries_smsnotification'); $head = $this->getlayout()->getblock('head'); $head->addjs('jquery.js'); $head->addjs('vivas.js'); return parent::_preparelayout(); } protected function _prepareform() { $form = new varien_data_form(array( 'id' => 'edit_form', 'action' => $this->geturl('*/*/save', array('id' => $this->getrequest()->get...
Read more

session - Logging Out Using PHP -

i have seen other programs regarding can't seem make work. doing wrong? want achieve after user logged out, going previous pages become restricted. i have 3 php files: 1. sample.php - main page username , password filled in 2. successful.php - user's page after logging in 3. logout.php - destorys session hinder user access pages after logging out sample.php </html> <form action="" method="post"> <table> <tr> <td>username:</td> <td>password:</td> </tr> <tr> <td><input type="text" name="username"></td> <td><input type="password" name="password"></td> </tr> <tr> <td><input type="submit" value="submit" name="submit"></td> </tr> </table> </form> </html> <?php $servername = "localhost"; $username = ...
Read more