Please take a look at quibbler.
In a nutshell, it makes matplotlib plots interactive with very few lines of code. Here is a talk about it:
The developers also wants to do the same with bokeh. Here is a issue:
I figured I will open a discussion on bokeh discourse in hope someone has ideas on how this can be done and what is involved.
Hopefully the active developers can give some guidance.