amazon ec2 - Adding new Spark workers on AWS EC2 - access error -


i have existing oeprating spark cluster launched spark-ec2 script. i'm trying add new slave following instructions:

  • stop cluster
  • on aws console "launch more this" on 1 of slaves
  • start cluster

although new instance added same security group , can ssh same private key, spark-ec2 ... start call can't access machine reason:

running setup-slave on cluster nodes mount filesystems, etc...

[1] 00:59:59 [failure] xxx.compute.amazonaws.com

exited error code 255 stderr: permission denied (publickey).

, obviously, followed tons of other errors while trying deploy spark stuff on instance.

the reason spark master machine doesn't have rsync access new slave, 22 port open...

the issue ssh key generated on spark master not transferred new slave. spark-ec2 script start command omits step. solution use launch command --resume options. ssh key transferred new slave , goes smooth.

yet solution add master's public key (~/.ssh/id_rsa.pub) newly added slaves ~/.ssh/authorized_keys. (got advice on spark mailing list)


Comments

Post a Comment

Popular posts from this blog

javascript - Bootstrap Popover: iOS Safari strange behaviour -

i looking through twitter bootstrap documentation, , i'm interested in implementing dismissible popover when button clicked. here example bootstrap's docs: http://getbootstrap.com/javascript/#dismiss-on-next-click when press "dismissible popover" button os x safari browser works fine. when access same link above ios safari, button not work. is, popover not dismissed on click. why button not working ios safari? the example linked using data-trigger="focus" attribute. try changing data-trigger="click" . <a tabindex="0" class="btn btn-lg btn-danger" role="button" data-toggle="popover" data-trigger="click" title="dismissible popover" data-content="and here's amazing content. it's engaging. right?">dismissible popover</a>
Read more

Website Login Issue developed in magento -

i have website developed using magento . able login. right now, login failed. infact operations interacts user table failing. need know issue. how figure out? first clear try clear log file second make sure have not upgraded magento and 3rd make sure db accessible in magento -harry p
Read more

Can the constants be defined inside a model file of a framework in PHP? -

i'm using phpfox framework. i've define 2 constants used 2 functions present within model class file. can define constants @ beginning of model class file or cause issue or against coding standards? please me in regard. following 1 method model class file. i want write following code : <?php /** * [phpfox_header] */ /*header('content-type: text/event-stream'); header('cache-control: no-cache');*/ defined('phpfox') or exit('no dice!'); /** * * * @copyright [phpfox_copyright] * @author raymond benc * @package phpfox_service * @version $id: service.class.php 67 2009-01-20 11:32:45z raymond_benc $ */ class notification_service_process extends phpfox_service { /** * class constructor */ public function __construct() { $this->_stable = phpfox::gett('notification'); } public function add($stype, $iitemid, $iowneruserid, $isenderuserid = null) ...
Read more