Downsampling with bokeh-server 0.11

Hello,

I’m currently working on an AngularJS project for my lab. We are looking for a technology able to downsample huge amount of data in our application. When I started my searches few month ago, some of you recommended not to start a project with the bokeh-server version 0.10. Today, the version 0.11 has been released approximatively two month ago. I wonder if you could give me some documentation or examples to implement a simple downsample mecanism. The purpose would be to test your technology to decide if this is what we need or not.

Thanks,

Alec

Hi Alec,

There are several hosted example apps (with links to their source code) at:

  http://demo.bokehplots.com

Additionally, there is much more documentation on using, running, and deploying the new Bokeh server, at:

  http://bokeh.pydata.org/en/latest/docs/user_guide/server.html

including a nice conceptual overview which I would recommend as a good starting place.

Regarding downsampling specifically, it's really application and use-case specific, but the main take-away is that a Bokeh server app has access to things like plot data ranges, and can respond to changes to ranges with callbacks that execute arbitrary python code. That means you can implement whatever downsampling strategy is appropriate to your situation with standard pydata tools (e.g, numpy, scipy, pytables, etc.) In this sense Bokeh is an enabling tool that affords users the opportunity to create solutions suited to their specific needs.

That said, I recognize that an actual motivating example would be helpful. It's definitely on my list to do, but there are unfortunately only so many hours in a day, so I can't say for sure when I will be able to get to it.

Alternatively, if you are looking for something more "automatic" the new separate open-source bokeh/datashader project, might be useful. You can see a very recent webinar that showed off DataShader on the NYC taxi data set and a 3 billion point OSM data set here:

  http://go.continuum.io/datashader/

(There's a short info form to fill out, then click "Get the Recording") Since that webinar, new features for applying Datashader pipelines to other kinds of data sets (e.g. time series, etc.) have been added. There is a README and examples (including some very detailed narrative notebooks) in the public repo:

  https://github.com/bokeh/datashader

But I would suggest starting with viewing the webinar first, to get an idea if Datashader might be applicable to your data.

Thanks,

Bryan

···

On Mar 17, 2016, at 10:53 AM, [email protected] wrote:

Hello,

I'm currently working on an AngularJS project for my lab. We are looking for a technology able to downsample huge amount of data in our application. When I started my searches few month ago, some of you recommended not to start a project with the bokeh-server version 0.10. Today, the version 0.11 has been released approximatively two month ago. I wonder if you could give me some documentation or examples to implement a simple downsample mecanism. The purpose would be to test your technology to decide if this is what we need or not.

Thanks,

Alec

--
You received this message because you are subscribed to the Google Groups "Bokeh Discussion - Public" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [email protected].
To post to this group, send email to [email protected].
To view this discussion on the web visit https://groups.google.com/a/continuum.io/d/msgid/bokeh/76a729eb-8c1e-4a25-93dd-d020dc38ef07%40continuum.io.
For more options, visit https://groups.google.com/a/continuum.io/d/optout.

Hi Bryan,

Thanks for your reply. I will take a look to what you advice starting by Datashader.

And I will tell you if we think to use it for our project.

Please let me now when you have a working downsampling example. It would be great !

Thanks,

Alec

···

Le jeudi 17 mars 2016 16:53:47 UTC+1, [email protected] a écrit :

Hello,

I’m currently working on an AngularJS project for my lab. We are looking for a technology able to downsample huge amount of data in our application. When I started my searches few month ago, some of you recommended not to start a project with the bokeh-server version 0.10. Today, the version 0.11 has been released approximatively two month ago. I wonder if you could give me some documentation or examples to implement a simple downsample mecanism. The purpose would be to test your technology to decide if this is what we need or not.

Thanks,

Alec