I had issues with layouts updating – unexpectedly in my case – that were similarly a result of Divs triggering the behavior.
My solution was to create a custom-widget that isolated the re-layout functionality, which served the purposes for my interactive analysis and visualization of scientific data and display of supporting info.
See the following bokeh discourse topic with my workaround as the entry in case it might suit your needs.