This sounds extremely similar to an issue I had. If it’s the same issue, the cause is that the default action mode for the tap tool was changed in 3.4.0. This can be fixed by changing the taptool mode to replace, the previous default. More detail and a link to the change in my code is here: Dynamic figure problem with Bokeh v 3.4.0 udgrade - #6 by Bryan
Hope this helps