There’s not enough information here to speculate. Do you mean “outside the central plot area”? If so that is intended behavior. scrolling on an “axis area” outside the main plot viewport is an intentional mechanism to selectively scroll a single axis. You can turn that off, but only in the sense that scrolling outside the plot area will have no effect whatsoever.
For some reason
bokeh.plotting.Figure.image
flips the image along the x-axis before rendering it?
Definitely would need an MRE to investigate and actually observe what is happening.