Radio Spectrum Demo with live streaming data and machine learning model retraining + data size controls

Repo: https://github.com/triskadecaepyon/radio_predict_demo

An example of handling live radio spectrum data to run into a constantly running ML model (retrains every two seconds). Was used to demonstrate the optimizations of Intel’s Scikit-learn accelerator called daal4py as well as some of their NumPy and SciPy optimizations.

The idea came from my hobby of Amateur Radio (Ham radio) where I have to sift through lots of signal data to determine the morse signals that are available. This is a precursor project to the framework I’m building to help connect some of those workflows in the Ham radio world to the Python community.

Details:

  • Built as a Bokeh server application, with periodic callbacks handling the 1) spectrum data generation or live data 2) Scikit-learn calls to train with the new data available and 3) Look for changes to the interactive slider UI which changes the moving window or memory size of the radio data to put into scikit-learn.

  • Plots for the ML training time in a stacked horizontal graph, the FFT of the data, and the original signal waveform. It is heavily downsampled to save on Javascript rendering behavior. The graph below aligning call signs is still just a random placeholder until the morse code detector is implemented

  • Sliders to change model parameters. For now it is only the window size (array size/memory) that works.

It should also be noted that all the calls for ML and signal processing are blocking, so increasing the training size can slow down the demo dramatically. I’m trying to find a good way to make it non-blocking but it will take some time to figure out how it can be done cleanly.

1 Like

Hi triskadecaepyon,

This is great! Do you mind if we send out a @bokeh tweet about it?

Thanks so much!

Sure. There is a previous tweet about it a while back but I had not explained much about how it was designed and built. Here are some additional photos of where I demoed it at SuperComputing 2019 (https://sc19.supercomputing.org)

Photo of me with the media/press talking about the demo:

Original tweet: https://twitter.com/triskadecaepyon/status/1197914699259498497

2 Likes

Yes! I put two and two together a few minutes after posting that, hah!

I think I’ll still send out a tweet about the description-enhanced Showcase post-- it’s very inspiring. Thanks so much!

1 Like