The data table header appearance is not currently configurable via any API. If you are embedding the Bokeh content in a template or page of your own, then you could target the underlying SlickGrid DOM elements using CSS. Feel free to open a GitHub issue to discuss it as a new feature.