ubuntu - spark and cloudera vm -


can tell me best way practice spark ? see majority of them pointing install cloudera vm. find pretty hard work on system has 6gb of ram. process pretty slow , annoying me. cloudera manger never launches , believe because needs 8gb of ram. of have given 3 gb windows os , 3gb vm. there way speed process ? or can install cdh in ubuntu , use spark ? (i have ubuntu installation in machine can allocate complete 6gb linux). or should buying new machine has 8/16gb ram ?

processor : i5 560m ram: 6gb (5.6 usable) vm: vmplayer (vmware)

can let me know configuration ?

to practice spark hadoop on 6gb machine windows machine host

follow these:

  • install ubuntu guest o.s in oracle vm box 4 gb ram (2 gb windows machine fine - assuming not running cpu/memory intensive tasks in win)
  • for 4gb vm suggest , not go cloudera , cloudera manager (they launch lot of services behind)
  • install hadoop valina stable version 2.4.1 manually(so have control of deamons) use link steps - link

  • assuming

    • reserved memory guest os - 1 gb min
    • memory hadoop single node deamons - 2 gb
    • rest 1 gb can use spark learning

  • then install spark in standalone mode single node (nothing vm)

hope these helps :)


Comments

Post a Comment

Popular posts from this blog

Magento/PHP - Get phones on all members in a customer group -

i working on custom magento extension. working around adminhtml part , i've created custom form there. here form code: <?php class vivasindustries_smsnotification_block_adminhtml_sms_sendmass_edit_form extends mage_adminhtml_block_widget_form { public function _preparelayout() { $extensionpath = mage::getmoduledir('js', 'vivasindustries_smsnotification'); $head = $this->getlayout()->getblock('head'); $head->addjs('jquery.js'); $head->addjs('vivas.js'); return parent::_preparelayout(); } protected function _prepareform() { $form = new varien_data_form(array( 'id' => 'edit_form', 'action' => $this->geturl('*/*/save', array('id' => $this->getrequest()->get
Read more

php - .htaccess mod_rewrite for dynamic url which has domain names -

i want convert url ex:( example.com/link.php?url=facebook.com ) ( example.com/facebook.com.php ) how can using .htaccess. or there other process make job easier ? i tried adding script .htaccess file options +followsymlinks rewriteengine on rewriterule url-(.*)\.htm$ link.php?url=$1 but converting url adding "url-" ( example.com/url-facebook.com.php ) i want remove "url-" , want make ( example.com/facebook.com.php ) rewriteengine on rewritecond %{the_request} ^get.*link\.php\?url\= [nc] rewritecond %{request_uri} !/system/.* [nc] rewriterule (.*?)link\.php\?url\=/*(.*) /$1$2 [r=301,ne,l] not sure how above work edit of used use remove index.php url
Read more

Website Login Issue developed in magento -

i have website developed using magento . able login. right now, login failed. infact operations interacts user table failing. need know issue. how figure out? first clear try clear log file second make sure have not upgraded magento and 3rd make sure db accessible in magento -harry p
Read more