Spark Notebook not working on HUE for EMR -
ok, i've got hue 3.8 pointing @ emr cluster, , it's working. 1 thing i'm missing care @ point spark notebook
when attempt choose language snippet, there error, "no usable value lang did not find value can converted java.lang.string (error 400)" , logs this:
[03/jun/2015 11:38:59 -0700] decorators error error running <function create_session @ 0x7fe30acd1d70> traceback (most recent call last): file "/usr/local/hue/apps/spark/src/spark/decorators.py", line 77, in decorator return func(*args, **kwargs) file "/usr/local/hue/apps/spark/src/spark/api.py", line 44, in create_session response['session'] = get_api(request.user, snippet).create_session(lang=snippet['type']) file "/usr/local/hue/apps/spark/src/spark/models.py", line 284, in create_session response = api.create_session(kind=lang) file "/usr/local/hue/apps/spark/src/spark/job_server_api.py", line 87, in create_session return self._root.post('sessions', data=json.dumps(kwargs), contenttype='application/json') file "/usr/local/hue/desktop/core/src/desktop/lib/rest/resource.py", line 122, in post return self.invoke("post", relpath, params, data, self._make_headers(contenttype, headers)) file "/usr/local/hue/desktop/core/src/desktop/lib/rest/resource.py", line 78, in invoke urlencode=self._urlencode) file "/usr/local/hue/desktop/core/src/desktop/lib/rest/http_client.py", line 161, in execute raise self._exc_class(ex) restexception: no usable value lang did not find value can converted java.lang.string (error 400) is problem software or config?
this might tied fact attempting run sudo ./hue livy_server yields:
failed run spark-submit executable: java.io.ioexception: cannot run program "spark-submit": error=2, no such file or directory spark-submit in fact exist , in path
the
spark-submit
command comes spark, needs present on hue machine.
Comments
Post a Comment