Docker install has errors on Mac

chris.topinka · October 13, 2022, 7:00pm

Any assist much appreciated.

Trying to use docker install on arm64 mac monterey 12.5.1 with docker from homebrew and

docker run -it -p 8888:8888 gethue/hue:latest

terminal hangs and getting:

Unable to find image ‘gethue/hue:latest’ latest: Pulling from gethue/hue
35807b77a593: Pull complete
65052bfcdb41: Pull complete
e73228830d39: Pull complete
81d8f3be4500: Pull complete
ec9a77367221: Pull complete
Digest: sha256:c3e0b2484bfa1d2a5cd4 Status: Downloaded newer image WARNING: The requested image’s [13/Oct/2022 16:02:31 ] settings [13/Oct/2022 09:02:33 -0700] backend [13/Oct/2022 09:02:33 -0700] client [13/Oct/2022 09:02:35 -0700] apps [13/Oct/2022 09:02:35 -0700] apps [13/Oct/2022 09:02:35 -0700] apps [13/Oct/2022 09:02:36 -0700] api3 [13/Oct/2022 09:02:36 -0700] jdbc [13/Oct/2022 09:02:36 -0700] sql [13/Oct/2022 09:02:36 -0700] hiveserver2 [13/Oct/2022 09:02:37 -0700] query_api Traceback (most recent call last):
File “/usr/share/hue/apps/jobbrow from impala.server import ModuleNotFoundError: No module [13/Oct/2022 09:02:37 -0700] views [13/Oct/2022 09:02:37 -0700] backend Operations to perform:
Apply all migrations: auth, Running migrations:
No migrations to apply.
[13/Oct/2022 09:02:38 -0700] models [13/Oct/2022 09:02:38 -0700] models [13/Oct/2022 09:02:38 -0700] models [13/Oct/2022 09:02:38 -0700] models [13/Oct/2022 09:02:38 -0700] models [13/Oct/2022 09:02:38 -0700] models [13/Oct/2022 09:02:38 -0700] models [13/Oct/2022 09:02:38 -0700] models [13/Oct/2022 09:02:38 -0700] models [13/Oct/2022 09:02:38 -0700] models [13/Oct/2022 09:02:38 -0700] models [13/Oct/2022 09:02:38 -0700] models [13/Oct/2022 09:02:38 -0700] models [13/Oct/2022 09:02:38 -0700] models [13/Oct/2022 09:02:39 -0700] models [13/Oct/2022 09:02:39 -0700] models [13/Oct/2022 09:02:39 -0700] models [13/Oct/2022 09:02:39 -0700] models [13/Oct/2022 09:02:39 -0700] models [13/Oct/2022 09:02:39 -0700] models [13/Oct/2022 09:02:39 -0700] models [13/Oct/2022 09:02:39 -0700] models [13/Oct/2022 09:02:39 -0700] models [13/Oct/2022 09:02:39 -0700] models [13/Oct/2022 09:02:39 -0700] models [13/Oct/2022 09:02:39 -0700] models [13/Oct/2022 09:02:39 -0700] models [13/Oct/2022 09:02:39 -0700] models [13/Oct/2022 16:02:41 ] supervisor INFO [13/Oct/2022 16:02:41 ] supervisor INFO [INFO] Not running as root, [13/Oct/2022 16:02:41 ] supervisor INFO [13/Oct/2022 16:02:41 ] supervisor INFO [13/Oct/2022 16:02:43 ] settings [13/Oct/2022 16:02:43 ] settings [13/Oct/2022 09:02:44 -0700] backend [13/Oct/2022 09:02:44 -0700] backend [13/Oct/2022 09:02:44 -0700] client [13/Oct/2022 09:02:44 -0700] client [13/Oct/2022 09:02:47 -0700] apps [13/Oct/2022 09:02:47 -0700] apps [13/Oct/2022 09:02:47 -0700] apps [13/Oct/2022 09:02:47 -0700] apps [13/Oct/2022 09:02:47 -0700] apps [13/Oct/2022 09:02:47 -0700] apps [13/Oct/2022 09:02:48 -0700] api3 [13/Oct/2022 09:02:48 -0700] jdbc [13/Oct/2022 09:02:48 -0700] sql [13/Oct/2022 09:02:48 -0700] hiveserver2 [13/Oct/2022 09:02:48 -0700] query_api Traceback (most recent call last):
File “/usr/share/hue/apps/jobbrow from impala.server import ModuleNotFoundError: No module [13/Oct/2022 09:02:48 -0700] api3 [13/Oct/2022 09:02:48 -0700] jdbc [13/Oct/2022 09:02:48 -0700] sql [13/Oct/2022 09:02:49 -0700] hiveserver2 [13/Oct/2022 09:02:49 -0700] query_api Traceback (most recent call last):
File “/usr/share/hue/apps/jobbrow from impala.server import ModuleNotFoundError: No module [13/Oct/2022 09:02:49 -0700] views [13/Oct/2022 09:02:49 -0700] backend [13/Oct/2022 09:02:49 -0700] views [13/Oct/2022 09:02:49 -0700] backend [13/Oct/2022 09:02:49 -0700] kt_renewer [13/Oct/2022 16:02:50 ] supervisor INFO [13/Oct/2022 09:02:51 -0700] settings [13/Oct/2022 09:02:53 -0700] backend [13/Oct/2022 09:02:53 -0700] client [13/Oct/2022 09:02:55 -0700] apps [13/Oct/2022 09:02:55 -0700] apps [13/Oct/2022 09:02:55 -0700] apps [13/Oct/2022 09:02:56 -0700] api3 [13/Oct/2022 09:02:56 -0700] jdbc [13/Oct/2022 09:02:56 -0700] sql [13/Oct/2022 09:02:56 -0700] hiveserver2 [13/Oct/2022 09:02:56 -0700] query_api Traceback (most recent call last):
File “/usr/share/hue/apps/jobbrow from impala.server import ModuleNotFoundError: No module [13/Oct/2022 09:02:56 -0700] views [13/Oct/2022 09:02:56 -0700] backend [2022-10-13 09:02:57 -0700] [2022-10-13 09:02:57 -0700] [2022-10-13 09:02:57 -0700] /usr/lib/python3.8/os.py:1023: return io.open(fd, *args, **kwargs)
[2022-10-13 09:02:57 -0700] [13/Oct/2022 09:02:57 -0700] middleware [13/Oct/2022 09:02:57 -0700] middleware [13/Oct/2022 09:02:57 -0700] middleware [13/Oct/2022 09:02:57 -0700] middleware [2022-10-13 09:45:02 -0700] [2022-10-13 09:45:02 -0700] [2022-10-13 09:45:03 -0700] [13/Oct/2022 09:45:03 -0700] middleware [13/Oct/2022 09:45:03 -0700] middleware [13/Oct/2022 09:45:03 -0700] middleware [13/Oct/2022 09:45:03 -0700] middleware [2022-10-13 10:17:36 -0700] [2022-10-13 10:17:36 -0700] [2022-10-13 10:17:36 -0700] [13/Oct/2022 10:17:36 -0700] middleware [13/Oct/2022 10:17:36 -0700] middleware [13/Oct/2022 10:17:36 -0700] middleware [13/Oct/2022 10:17:36 -0700] middleware locally
f375d2e188cbb2d7a70ffacadc4f84e043b5ff332554
for gethue/hue:latest
platform (linux/amd64) does not match the detected host platform (linux/arm64/v8) and no specific platform was requested
INFO Welcome to Hue 4.10.0
WARNING mozilla_django_oidc module not found
WARNING gcs_oauth2_boto_plugin module not found
INFO AXES: BEGIN LOG
INFO AXES: Using django-axes version 5.13.0
INFO AXES: blocking by IP only.
WARNING simple_salesforce module not found
WARNING Failed to import py4j
WARNING Impala app is not enabled
WARNING Impala app is not enabled
ERROR Some application are not enabled: No module named ‘impala.server’
ser/src/jobbrowser/apis/query_api.py”, line 45, in
get_api as get_impalad_api, _get_impala_server_url
named ‘impala.server’
WARNING httplib2 module not found
WARNING httplib2 module not found
authtoken, axes, beeswax, contenttypes, desktop, jobsub, oozie, pig, sessions, sites, useradmin
INFO HuePermissions: 0 added, 0 updated, 33 up to date, 5 stale, 0 deleted
INFO HuePermissions: 0 added, 0 updated, 33 up to date, 5 stale, 0 deleted
INFO HuePermissions: 0 added, 0 updated, 33 up to date, 5 stale, 0 deleted
INFO HuePermissions: 0 added, 0 updated, 33 up to date, 5 stale, 0 deleted
INFO HuePermissions: 0 added, 0 updated, 33 up to date, 5 stale, 0 deleted
INFO HuePermissions: 0 added, 0 updated, 33 up to date, 5 stale, 0 deleted
INFO HuePermissions: 0 added, 0 updated, 33 up to date, 5 stale, 0 deleted
INFO HuePermissions: 0 added, 0 updated, 33 up to date, 5 stale, 0 deleted
INFO HuePermissions: 0 added, 0 updated, 33 up to date, 5 stale, 0 deleted
INFO HuePermissions: 0 added, 0 updated, 33 up to date, 5 stale, 0 deleted
INFO HuePermissions: 0 added, 0 updated, 33 up to date, 5 stale, 0 deleted
INFO HuePermissions: 0 added, 0 updated, 33 up to date, 5 stale, 0 deleted
INFO HuePermissions: 0 added, 0 updated, 33 up to date, 5 stale, 0 deleted
INFO HuePermissions: 0 added, 0 updated, 33 up to date, 5 stale, 0 deleted
INFO HuePermissions: 0 added, 0 updated, 33 up to date, 5 stale, 0 deleted
INFO HuePermissions: 0 added, 0 updated, 33 up to date, 5 stale, 0 deleted
INFO HuePermissions: 0 added, 0 updated, 33 up to date, 5 stale, 0 deleted
INFO HuePermissions: 0 added, 0 updated, 33 up to date, 5 stale, 0 deleted
INFO HuePermissions: 0 added, 0 updated, 33 up to date, 5 stale, 0 deleted
INFO HuePermissions: 0 added, 0 updated, 33 up to date, 5 stale, 0 deleted
INFO HuePermissions: 0 added, 0 updated, 33 up to date, 5 stale, 0 deleted
INFO HuePermissions: 0 added, 0 updated, 33 up to date, 5 stale, 0 deleted
INFO HuePermissions: 0 added, 0 updated, 33 up to date, 5 stale, 0 deleted
INFO HuePermissions: 0 added, 0 updated, 33 up to date, 5 stale, 0 deleted
INFO HuePermissions: 0 added, 0 updated, 33 up to date, 5 stale, 0 deleted
INFO HuePermissions: 0 added, 0 updated, 33 up to date, 5 stale, 0 deleted
INFO HuePermissions: 0 added, 0 updated, 33 up to date, 5 stale, 0 deleted
INFO HuePermissions: 0 added, 0 updated, 33 up to date, 5 stale, 0 deleted
Starting process /usr/share/hue/build/env/bin/hue kt_renewer
Starting process /usr/share/hue/build/env/bin/hue runcpserver
skipping privilege drop
Started proceses (pid 41) /usr/share/hue/build/env/bin/hue runcpserver
Started proceses (pid 39) /usr/share/hue/build/env/bin/hue kt_renewer
INFO Welcome to Hue 4.10.0
INFO Welcome to Hue 4.10.0
WARNING mozilla_django_oidc module not found
WARNING mozilla_django_oidc module not found
WARNING gcs_oauth2_boto_plugin module not found
WARNING gcs_oauth2_boto_plugin module not found
INFO AXES: BEGIN LOG
INFO AXES: Using django-axes version 5.13.0
INFO AXES: blocking by IP only.
INFO AXES: BEGIN LOG
INFO AXES: Using django-axes version 5.13.0
INFO AXES: blocking by IP only.
WARNING simple_salesforce module not found
WARNING Failed to import py4j
WARNING Impala app is not enabled
WARNING Impala app is not enabled
ERROR Some application are not enabled: No module named ‘impala.server’
ser/src/jobbrowser/apis/query_api.py”, line 45, in
get_api as get_impalad_api, _get_impala_server_url
named ‘impala.server’
WARNING simple_salesforce module not found
WARNING Failed to import py4j
WARNING Impala app is not enabled
WARNING Impala app is not enabled
ERROR Some application are not enabled: No module named ‘impala.server’
ser/src/jobbrowser/apis/query_api.py”, line 45, in
get_api as get_impalad_api, _get_impala_server_url
named ‘impala.server’
WARNING httplib2 module not found
WARNING httplib2 module not found
WARNING httplib2 module not found
WARNING httplib2 module not found
INFO Keytab renewer not starting, no keytab configured
Command “/usr/share/hue/build/env/bin/hue kt_renewer” exited normally.
INFO Welcome to Hue 4.10.0
WARNING mozilla_django_oidc module not found
WARNING gcs_oauth2_boto_plugin module not found
INFO AXES: BEGIN LOG
INFO AXES: Using django-axes version 5.13.0
INFO AXES: blocking by IP only.
WARNING simple_salesforce module not found
WARNING Failed to import py4j
WARNING Impala app is not enabled
WARNING Impala app is not enabled
ERROR Some application are not enabled: No module named ‘impala.server’
ser/src/jobbrowser/apis/query_api.py”, line 45, in
get_api as get_impalad_api, _get_impala_server_url
named ‘impala.server’
WARNING httplib2 module not found
WARNING httplib2 module not found
[41] [INFO] Starting gunicorn 19.9.0
[41] [INFO] Listening at: http://0.0.0.0:8888 (41)
[41] [INFO] Using worker: threads
RuntimeWarning: line buffering (buffering=1) isn’t supported in binary mode, the default buffer size will be used
[112] [INFO] Booting worker with pid: 112
INFO Unloading MimeTypeJSFileFixStreamingMiddleware
INFO Unloading HueRemoteUserMiddleware
INFO Unloading SpnegoMiddleware
INFO Unloading ProxyMiddleware
[41] [CRITICAL] WORKER TIMEOUT (pid:112)
[112] [INFO] Worker exiting (pid: 112)
[114] [INFO] Booting worker with pid: 114
INFO Unloading MimeTypeJSFileFixStreamingMiddleware
INFO Unloading HueRemoteUserMiddleware
INFO Unloading SpnegoMiddleware
INFO Unloading ProxyMiddleware
[41] [CRITICAL] WORKER TIMEOUT (pid:114)
[114] [INFO] Worker exiting (pid: 114)
[116] [INFO] Booting worker with pid: 116
INFO Unloading MimeTypeJSFileFixStreamingMiddleware
INFO Unloading HueRemoteUserMiddleware
INFO Unloading SpnegoMiddleware
INFO Unloading ProxyMiddleware

chris.topinka · October 13, 2022, 6:42pm

Pressing ^C resulted in hanging with and have to kill terminal to exit.

return io.open(fd, *args, **kwargs)
[2022-10-13 09:02:57 -0700] [112] [INFO] Booting worker with pid: 112
[13/Oct/2022 09:02:57 -0700] middleware INFO Unloading MimeTypeJSFileFixStreamingMiddleware
[13/Oct/2022 09:02:57 -0700] middleware INFO Unloading HueRemoteUserMiddleware
[13/Oct/2022 09:02:57 -0700] middleware INFO Unloading SpnegoMiddleware
[13/Oct/2022 09:02:57 -0700] middleware INFO Unloading ProxyMiddleware
[2022-10-13 09:45:02 -0700] [41] [CRITICAL] WORKER TIMEOUT (pid:112)
[2022-10-13 09:45:02 -0700] [112] [INFO] Worker exiting (pid: 112)
[2022-10-13 09:45:03 -0700] [114] [INFO] Booting worker with pid: 114
[13/Oct/2022 09:45:03 -0700] middleware INFO Unloading MimeTypeJSFileFixStreamingMiddleware
[13/Oct/2022 09:45:03 -0700] middleware INFO Unloading HueRemoteUserMiddleware
[13/Oct/2022 09:45:03 -0700] middleware INFO Unloading SpnegoMiddleware
[13/Oct/2022 09:45:03 -0700] middleware INFO Unloading ProxyMiddleware
[2022-10-13 10:17:36 -0700] [41] [CRITICAL] WORKER TIMEOUT (pid:114)
[2022-10-13 10:17:36 -0700] [114] [INFO] Worker exiting (pid: 114)
[2022-10-13 10:17:36 -0700] [116] [INFO] Booting worker with pid: 116
[13/Oct/2022 10:17:36 -0700] middleware INFO Unloading MimeTypeJSFileFixStreamingMiddleware
[13/Oct/2022 10:17:36 -0700] middleware INFO Unloading HueRemoteUserMiddleware
[13/Oct/2022 10:17:36 -0700] middleware INFO Unloading SpnegoMiddleware
[13/Oct/2022 10:17:36 -0700] middleware INFO Unloading ProxyMiddleware
^C[2022-10-13 11:25:40 -0700] [41] [INFO] Handling signal: int
[13/Oct/2022 18:25:40 ] supervisor ERROR Exception in supervisor main loop
Traceback (most recent call last):
File “/usr/share/hue/desktop/core/src/desktop/supervisor.py”, line 385, in main
wait_loop(sups, options)
File “/usr/share/hue/desktop/core/src/desktop/supervisor.py”, line 395, in wait_loop
time.sleep(1)
KeyboardInterrupt
[13/Oct/2022 18:25:40 ] supervisor WARNING Supervisor shutting down!
[13/Oct/2022 18:25:40 ] supervisor WARNING Waiting for children to exit for 5 seconds…
[2022-10-13 11:25:40 -0700] [116] [INFO] Worker exiting (pid: 116)
[2022-10-13 11:25:40 -0700] [41] [INFO] Shutting down: Master
[13/Oct/2022 18:25:41 ] supervisor INFO Command “/usr/share/hue/build/env/bin/hue runcpserver” exited normally.

chris.topinka · October 13, 2022, 10:55pm

try k8s instead?

Tried the github install form here - https://docs.gethue.com/administrator/installation/dependencies/#m1-or-intel-based-macs-with-python-3
using brew installed python3.

~(:|✔) % python3 --version
Python 3.9.6

getting

hue(master|✔) % make apps
“PYTHON_VER is python3.8.”
/Users/ctopinka/hue-proj/hue/Makefile.vars:75: *** “Error: Need python version 2.7 or >= 3.5”. Stop.

chris.topinka · October 18, 2022, 3:51am

Tried docker compose and still have errors. Changed mysql to version 8 to get it running. UI comes up but getting error dialog in ui like

Can’t connect to any of 127.0.0.1:10000 thriftransport error

Possibly related to impala server config?

chris.topinka · October 19, 2022, 9:40pm

Seeing when I boot the app

query_api ERROR Some application are not enabled: No module named ‘impala.server’
Traceback (most recent call last):
File “/usr/share/hue/apps/jobbrowser/src/jobbrowser/apis/query_api.py”, line 45, in
from impala.server import get_api as get_impalad_api, _get_impala_server_url
ModuleNotFoundError: No module named ‘impala.server’
[19/Oct/2022 14:33:04 -0700] query_api ERROR Some application are not enabled: No module named ‘impala.server’
Traceback (most recent call last):
File “/usr/share/hue/apps/jobbrowser/src/jobbrowser/apis/query_api.py”, line 45, in
from impala.server import get_api as get_impalad_api, _get_impala_server_url
ModuleNotFoundError: No module named ‘impala.server’
[19/Oct/2022 14:33:04 -0700] views WARNING httplib2 module not found
[19/Oct/2022 14:33:04 -0700] backend WARNING httplib2 module not found
[19/Oct/2022 14:33:04 -0700] views WARNING httplib2 module not found
[19/Oct/2022 14:33:04 -0700] backend WARNING httplib2 module not found
[19/Oct/2022 14:33:05 -0700] kt_renewer INFO Keytab renewer not starting, no keytab configured
[19/Oct/2022 21:33:05 ] supervisor INFO Command “/usr/share/hue/build/env/bin/hue kt_renewer” exited normally.
[19/Oct/2022 14:33:07 -0700] settings INFO Welcome to Hue 4.10.0
[19/Oct/2022 14:33:09 -0700] backend WARNING mozilla_django_oidc module not found
[19/Oct/2022 14:33:09 -0700] client WARNING gcs_oauth2_boto_plugin module not found
[19/Oct/2022 14:33:11 -0700] apps INFO AXES: BEGIN LOG
[19/Oct/2022 14:33:11 -0700] apps INFO AXES: Using django-axes version 5.13.0
[19/Oct/2022 14:33:11 -0700] apps INFO AXES: blocking by IP only.
[19/Oct/2022 14:33:12 -0700] api3 WARNING simple_salesforce module not found
[19/Oct/2022 14:33:12 -0700] jdbc WARNING Failed to import py4j
[19/Oct/2022 14:33:12 -0700] sql WARNING Impala app is not enabled
[19/Oct/2022 14:33:12 -0700] hiveserver2 WARNING Impala app is not enabled
[19/Oct/2022 14:33:12 -0700] query_api ERROR Some application are not enabled: No module named ‘impala.server’
Traceback (most recent call last):
File “/usr/share/hue/apps/jobbrowser/src/jobbrowser/apis/query_api.py”, line 45, in
from impala.server import get_api as get_impalad_api, _get_impala_server_url
ModuleNotFoundError: No module named ‘impala.server’

chris.topinka · October 19, 2022, 9:42pm

And then when I hit the app in a browser I get this loop in the logs

Traceback (most recent call last):
  File "/usr/share/hue/apps/useradmin/src/useradmin/models.py", line 379, in install_sample_user
    elif not fs.do_as_user(django_username_short, fs.get_home_dir):
  File "/usr/share/hue/desktop/libs/hadoop/src/hadoop/fs/webhdfs.py", line 916, in do_as_user
    return fn(*args, **kwargs)
  File "/usr/share/hue/desktop/libs/hadoop/src/hadoop/fs/webhdfs.py", line 542, in get_home_dir
    res = self._root.get(params=params, headers=headers)
  File "/usr/share/hue/desktop/core/src/desktop/lib/rest/resource.py", line 157, in get
    return self.invoke("GET", relpath, params, headers=headers, allow_redirects=True, clear_cookies=clear_cookies)
  File "/usr/share/hue/desktop/core/src/desktop/lib/rest/resource.py", line 78, in invoke
    resp = self._invoke(
  File "/usr/share/hue/desktop/core/src/desktop/lib/rest/resource.py", line 105, in _invoke
    resp = self._client.execute(
  File "/usr/share/hue/desktop/core/src/desktop/lib/rest/http_client.py", line 244, in execute
    raise self._exc_class(ex)
hadoop.fs.exceptions.WebHdfsException: HTTPConnectionPool(host='localhost', port=50070): Max retries exceeded with url: /webhdfs/v1?user.name=hue&doas=hue&op=GETHOMEDIRECTORY (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x40254a48b0>: Failed to establish a new connection: [Errno 111] Connection refused'))
[19/Oct/2022 14:39:23 -0700] access       INFO     172.19.0.1 admin - "GET /hue HTTP/1.1" returned in 120ms 200 240463
[19/Oct/2022 14:39:23 -0700] access       INFO     172.19.0.1 admin - "GET /hue HTTP/1.1" returned in 120ms 200 240463
172.19.0.1 - - [19/Oct/2022:14:39:23 -0700] "GET /hue HTTP/1.1" 200 240463 "http://localhost:8888/hue/editor/?type=hive" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/106.0.0.0 Safari/537.36"
[19/Oct/2022 14:39:25 -0700] access       INFO     172.19.0.1 admin - "GET /desktop/globalJsConstants.js HTTP/1.1" returned in 294ms 304 0
[19/Oct/2022 14:39:25 -0700] access       INFO     172.19.0.1 admin - "GET /desktop/globalJsConstants.js HTTP/1.1" returned in 294ms 304 0
172.19.0.1 - - [19/Oct/2022:14:39:25 -0700] "GET /desktop/globalJsConstants.js?v=4.10.0 HTTP/1.1" 304 0 "http://localhost:8888/hue" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/106.0.0.0 Safari/537.36"
[19/Oct/2022 14:39:25 -0700] access       INFO     172.19.0.1 admin - "POST /api/get_config/ HTTP/1.1" returned in 177ms 200 13633
[19/Oct/2022 14:39:25 -0700] access       INFO     172.19.0.1 admin - "POST /api/get_config/ HTTP/1.1" returned in 177ms 200 13633
172.19.0.1 - - [19/Oct/2022:14:39:25 -0700] "POST /api/get_config/ HTTP/1.1" 200 13633 "http://localhost:8888/hue" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/106.0.0.0 Safari/537.36"
[19/Oct/2022 14:39:26 -0700] access       INFO     172.19.0.1 admin - "POST /notebook/api/create_notebook HTTP/1.1" returned in 21ms 200 252
[19/Oct/2022 14:39:26 -0700] access       INFO     172.19.0.1 admin - "POST /notebook/api/create_notebook HTTP/1.1" returned in 21ms 200 252
172.19.0.1 - - [19/Oct/2022:14:39:26 -0700] "POST /notebook/api/create_notebook HTTP/1.1" 200 252 "http://localhost:8888/hue" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/106.0.0.0 Safari/537.36"
[19/Oct/2022 14:39:26 -0700] exceptions_renderable ERROR    Potential trace: [<FrameSummary file /usr/share/hue/desktop/libs/hadoop/src/hadoop/yarn/resource_manager_api.py, line 176 in _execute>, <FrameSummary file /usr/share/hue/desktop/core/src/desktop/lib/rest/resource.py, line 157 in get>, <FrameSummary file /usr/share/hue/desktop/core/src/desktop/lib/rest/resource.py, line 78 in invoke>, <FrameSummary file /usr/share/hue/desktop/core/src/desktop/lib/rest/resource.py, line 105 in _invoke>, <FrameSummary file /usr/share/hue/desktop/core/src/desktop/lib/rest/http_client.py, line 244 in execute>]
[19/Oct/2022 14:39:26 -0700] cluster      INFO     Resource Manager not available, trying another RM: YARN RM returned a failed response: HTTPConnectionPool(host='localhost', port=8088): Max retries exceeded with url: /ws/v1/cluster/apps?doAs=admin&user.name=hue&user=admin&finalStatus=UNDEFINED&limit=1000&startedTimeBegin=1665610766000 (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x404eec4e20>: Failed to establish a new connection: [Errno 111] Connection refused')).
[19/Oct/2022 14:39:26 -0700] middleware   INFO     Processing exception: No module named 'impala.conf': Traceback (most recent call last):
  File "/usr/share/hue/build/env/lib/python3.8/site-packages/django/core/handlers/base.py", line 181, in _get_response
    response = wrapped_callback(request, *callback_args, **callback_kwargs)
  File "/usr/lib/python3.8/contextlib.py", line 75, in inner
    return func(*args, **kwds)
  File "/usr/share/hue/apps/jobbrowser/src/jobbrowser/views.py", line 117, in apps
    return render('job_browser.mako', request, {
  File "/usr/share/hue/desktop/core/src/desktop/lib/django_util.py", line 242, in render
    return _render_to_response(
  File "/usr/share/hue/desktop/core/src/desktop/lib/django_util.py", line 161, in _render_to_response
    return django_mako.render_to_response(template, *args, **kwargs)
  File "/usr/share/hue/desktop/core/src/desktop/lib/django_mako.py", line 127, in render_to_response
    return HttpResponse(render_to_string(template_name, data_dictionary), **kwargs)
  File "/usr/share/hue/desktop/core/src/desktop/lib/django_mako.py", line 116, in render_to_string_normal
    result = template.render(**data_dict)
  File "/usr/share/hue/build/env/lib/python3.8/site-packages/mako/template.py", line 439, in render
    return runtime._render(self, self.callable_, args, data)
  File "/usr/share/hue/build/env/lib/python3.8/site-packages/mako/runtime.py", line 874, in _render
    _render_context(
  File "/usr/share/hue/build/env/lib/python3.8/site-packages/mako/runtime.py", line 916, in _render_context
    _exec_template(inherit, lclcontext, args=args, kwargs=kwargs)
  File "/usr/share/hue/build/env/lib/python3.8/site-packages/mako/runtime.py", line 943, in _exec_template
    callable_(context, *args, **kwargs)
  File "/tmp/tmpfkkndr5d/jobbrowser/job_browser.mako.py", line 39, in render_body
    from impala.conf import COORDINATOR_URL as IMPALA_COORDINATOR_URL
ModuleNotFoundError: No module named 'impala.conf'

[19/Oct/2022 14:39:26 -0700] access       INFO     172.19.0.1 admin - "POST /jobbrowser/jobs/ HTTP/1.1" returned in 104ms 200 82
[19/Oct/2022 14:39:26 -0700] access       INFO     172.19.0.1 admin - "POST /jobbrowser/jobs/ HTTP/1.1" returned in 104ms 200 82
172.19.0.1 - - [19/Oct/2022:14:39:26 -0700] "POST /jobbrowser/jobs/ HTTP/1.1" 200 82 "http://localhost:8888/hue/editor/?type=hive" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/106.0.0.0 Safari/537.36"
[19/Oct/2022 14:39:26 -0700] access       INFO     172.19.0.1 admin - "GET /editor HTTP/1.1" returned in 281ms 304 0
[19/Oct/2022 14:39:26 -0700] access       INFO     172.19.0.1 admin - "GET /editor HTTP/1.1" returned in 281ms 304 0
172.19.0.1 - - [19/Oct/2022:14:39:26 -0700] "GET /editor?is_embeddable=true&type=hive HTTP/1.1" 304 0 "http://localhost:8888/hue/editor/?type=hive" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/106.0.0.0 Safari/537.36"
[19/Oct/2022 14:39:26 -0700] access       INFO     172.19.0.1 admin - "GET /api/get_namespaces/hive HTTP/1.1" returned in 353ms 304 0
[19/Oct/2022 14:39:26 -0700] access       INFO     172.19.0.1 admin - "GET /api/get_namespaces/hive HTTP/1.1" returned in 353ms 304 0
172.19.0.1 - - [19/Oct/2022:14:39:26 -0700] "GET /api/get_namespaces/hive HTTP/1.1" 304 0 "http://localhost:8888/hue/editor/?type=hive" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/106.0.0.0 Safari/537.36"
[19/Oct/2022 14:39:26 -0700] access       INFO     172.19.0.1 admin - "GET /api/editor/get_history HTTP/1.1" returned in 27ms 304 0
[19/Oct/2022 14:39:26 -0700] access       INFO     172.19.0.1 admin - "GET /api/editor/get_history HTTP/1.1" returned in 27ms 304 0
172.19.0.1 - - [19/Oct/2022:14:39:26 -0700] "GET /api/editor/get_history?limit=50&page=1&doc_text=&is_notification_manager=true HTTP/1.1" 304 0 "http://localhost:8888/hue/editor/?type=hive" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/106.0.0.0 Safari/537.36"
[19/Oct/2022 14:39:26 -0700] views        WARNING  User admin is using Hue 3 UI
[19/Oct/2022 14:39:26 -0700] access       INFO     172.19.0.1 admin - "GET /static/desktop/js/bundles/hue/notebook~editor-bundle-6a37f309c866e4cc299b.fb64aed0dc8c.js HTTP/1.1" returned in 10ms 200 -
[19/Oct/2022 14:39:26 -0700] access       INFO     172.19.0.1 admin - "GET /static/desktop/js/bundles/hue/notebook~editor-bundle-6a37f309c866e4cc299b.fb64aed0dc8c.js HTTP/1.1" returned in 10ms 200 -
[19/Oct/2022 14:39:26 -0700] exceptions_renderable ERROR    Potential trace: [<FrameSummary file /usr/share/hue/desktop/libs/hadoop/src/hadoop/yarn/resource_manager_api.py, line 176 in _execute>, <FrameSummary file /usr/share/hue/desktop/core/src/desktop/lib/rest/resource.py, line 157 in get>, <FrameSummary file /usr/share/hue/desktop/core/src/desktop/lib/rest/resource.py, line 78 in invoke>, <FrameSummary file /usr/share/hue/desktop/core/src/desktop/lib/rest/resource.py, line 105 in _invoke>, <FrameSummary file /usr/share/hue/desktop/core/src/desktop/lib/rest/http_client.py, line 244 in execute>]
[19/Oct/2022 14:39:26 -0700] cluster      INFO     Resource Manager not available, trying another RM: YARN RM returned a failed response: HTTPConnectionPool(host='localhost', port=8088): Max retries exceeded with url: /ws/v1/cluster/apps?doAs=admin&user.name=hue&user=admin&finalStatus=UNDEFINED&limit=1000&startedTimeBegin=1665610766000 (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x404e66fe20>: Failed to establish a new connection: [Errno 111] Connection refused')).
172.19.0.1 - - [19/Oct/2022:14:39:26 -0700] "GET /static/desktop/js/bundles/hue/notebook~editor-bundle-6a37f309c866e4cc299b.fb64aed0dc8c.js?_=1666215565621 HTTP/1.1" 200 0 "http://localhost:8888/hue/editor/?type=hive" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/106.0.0.0 Safari/537.36"
[19/Oct/2022 14:39:26 -0700] access       INFO     172.19.0.1 admin - "POST /jobbrowser/jobs/ HTTP/1.1" returned in 163ms 200 82
[19/Oct/2022 14:39:26 -0700] access       INFO     172.19.0.1 admin - "POST /jobbrowser/jobs/ HTTP/1.1" returned in 163ms 200 82
[19/Oct/2022 14:39:26 -0700] access       INFO     172.19.0.1 admin - "GET /static/desktop/js/ko.common-dashboard.fa0750f86d59.js HTTP/1.1" returned in 31ms 200 -
172.19.0.1 - - [19/Oct/2022:14:39:26 -0700] "POST /jobbrowser/jobs/ HTTP/1.1" 200 82 "http://localhost:8888/hue/editor/?type=hive" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/106.0.0.0 Safari/537.36"
[19/Oct/2022 14:39:26 -0700] access       INFO     172.19.0.1 admin - "GET /static/desktop/js/ko.common-dashboard.fa0750f86d59.js HTTP/1.1" returned in 31ms 200 -
[19/Oct/2022 14:39:26 -0700] access       INFO     172.19.0.1 admin - "GET /static/desktop/js/bundles/hue/notebook-bundle-6a37f309c866e4cc299b.2b2ba1f12518.js HTTP/1.1" returned in 17ms 200 -
[19/Oct/2022 14:39:26 -0700] access       INFO     172.19.0.1 admin - "GET /static/desktop/js/bundles/hue/notebook-bundle-6a37f309c866e4cc299b.2b2ba1f12518.js HTTP/1.1" returned in 17ms 200 -
172.19.0.1 - - [19/Oct/2022:14:39:26 -0700] "GET /static/desktop/js/bundles/hue/notebook-bundle-6a37f309c866e4cc299b.2b2ba1f12518.js?_=1666215565622 HTTP/1.1" 200 0 "http://localhost:8888/hue/editor/?type=hive" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/106.0.0.0 Safari/537.36"
172.19.0.1 - - [19/Oct/2022:14:39:26 -0700] "GET /static/desktop/js/ko.common-dashboard.fa0750f86d59.js?_=1666215565620 HTTP/1.1" 200 0 "http://localhost:8888/hue/editor/?type=hive" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/106.0.0.0 Safari/537.36"
[19/Oct/2022 14:39:26 -0700] models       INFO     Sample user found with username "hue" and User ID: 1100713
[19/Oct/2022 14:39:27 -0700] models       ERROR    Failed to create home directory for user hue: HTTPConnectionPool(host='localhost', port=50070): Max retries exceeded with url: /webhdfs/v1?user.name=hue&doas=hue&op=GETHOMEDIRECTORY (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x404e5cb340>: Failed to establish a new connection: [Errno 111] Connection refused'))
Traceback (most recent call last):
  File "/usr/share/hue/build/env/lib/python3.8/site-packages/django/core/handlers/exception.py", line 47, in inner
    response = get_response(request)
  File "/usr/share/hue/build/env/lib/python3.8/site-packages/django/core/handlers/base.py", line 181, in _get_response
    response = wrapped_callback(request, *callback_args, **callback_kwargs)
  File "/usr/lib/python3.8/contextlib.py", line 75, in inner
    return func(*args, **kwds)
  File "/usr/share/hue/apps/jobbrowser/src/jobbrowser/views.py", line 117, in apps
    return render('job_browser.mako', request, {
  File "/usr/share/hue/desktop/core/src/desktop/lib/django_util.py", line 242, in render
    return _render_to_response(
  File "/usr/share/hue/desktop/core/src/desktop/lib/django_util.py", line 161, in _render_to_response
    return django_mako.render_to_response(template, *args, **kwargs)
  File "/usr/share/hue/desktop/core/src/desktop/lib/django_mako.py", line 127, in render_to_response
    return HttpResponse(render_to_string(template_name, data_dictionary), **kwargs)
  File "/usr/share/hue/desktop/core/src/desktop/lib/django_mako.py", line 116, in render_to_string_normal
    result = template.render(**data_dict)
  File "/usr/share/hue/build/env/lib/python3.8/site-packages/mako/template.py", line 439, in render
    return runtime._render(self, self.callable_, args, data)
  File "/usr/share/hue/build/env/lib/python3.8/site-packages/mako/runtime.py", line 874, in _render
    _render_context(
  File "/usr/share/hue/build/env/lib/python3.8/site-packages/mako/runtime.py", line 916, in _render_context
    _exec_template(inherit, lclcontext, args=args, kwargs=kwargs)
  File "/usr/share/hue/build/env/lib/python3.8/site-packages/mako/runtime.py", line 943, in _exec_template
    callable_(context, *args, **kwargs)
  File "/tmp/tmpfkkndr5d/jobbrowser/job_browser.mako.py", line 39, in render_body
    from impala.conf import COORDINATOR_URL as IMPALA_COORDINATOR_URL
ModuleNotFoundError: No module named 'impala.conf'

chris.topinka · October 19, 2022, 9:48pm

Seeing this in the browser dialog and logs

Connection refused
[19/Oct/2022 14:39:28 -0700] TSocket ERROR Could not connect to any of [(‘127.0.0.1’, 10000), (‘127.0.0.1’, 10000)]
[19/Oct/2022 14:39:28 -0700] thrift_util INFO Thrift saw a transport exception: Could not connect to any of [(‘127.0.0.1’, 10000), (‘127.0.0.1’, 10000)]

And this in the logs

INFO Sample user found with username “hue” and User ID: 1100713
[19/Oct/2022 14:35:44 -0700] models ERROR Failed to create home directory for user hue: HTTPConnectionPool(host=‘localhost’, port=50070): Max retries exceeded with url: /webhdfs/v1?user.name=hue&doas=hue&op=GETHOMEDIRECTORY (Caused by NewConnectionError(’<urllib3.connection.HTTPConnection object at 0x40250e1220>: Failed to establish a new connection: [Errno 111] Connection refused’))
Traceback (most recent call last):