I made a specific certificate for the bokeh server and running that as you do (no Nginx) works, however due to self signed certificate I get error messages but the bokeh document is displayed (Firefox).
SSL Error on 8 ('10.224.36.7', 45674): [SSL: SSLV3_ALERT_BAD_CERTIFICATE] sslv3 alert bad certificate (_ssl.c:897)
And now I suddenly got it working with Nginx… not sure what happend… clearing of browser cache? However Chromium/Chrome do not accept the self signed certificate.
I need to use some more time on the setup testing endpoints/routes. Also need to figure out if it is possible to create self signed certificate that works in Chrome. So far I have used openssl
sudo openssl req -x509 -nodes -days 365 -newkey rsa:2048 -keyout /etc/ssl/private/bokeh-selfsigned.key -out /etc/ssl/certs/bokeh-selfsigned.crt