I am looking to do data aggregation of events that are streaming into my timeseries graph. Currently I am using Pond's pipeline and ring objects to "stream" data into a graph. I am receiving nearly 60 pieces of data per second (meaning I have timestamps on each datapoint that go out to the millisecond). Although realistically I am only able to process about 30 data-points per second into the graph. Since I am getting 60 data-points per second, I would like to us an windowBy function on the pipeline to group the data-points in a 34 millisecond window based on their timestamp. Which is where I run into a problem. I don't see any examples of a time index based on milliseconds. I see "5m" for 5 minutes, or "1s" for 1 second. Can I window by milliseconds? I think this would be very useful for high-volume data streaming.
I am relatively new to timeseries. So if this is off the mark because of my lack of understanding of a Time Index or how the streams can work in other ways, I'd be happy to hear about it.
I am looking to do data aggregation of events that are streaming into my timeseries graph. Currently I am using Pond's
pipelineandringobjects to "stream" data into a graph. I am receiving nearly 60 pieces of data per second (meaning I have timestamps on each datapoint that go out to the millisecond). Although realistically I am only able to process about 30 data-points per second into the graph. Since I am getting 60 data-points per second, I would like to us an windowBy function on the pipeline to group the data-points in a 34 millisecond window based on their timestamp. Which is where I run into a problem. I don't see any examples of a time index based on milliseconds. I see "5m" for 5 minutes, or "1s" for 1 second. Can I window by milliseconds? I think this would be very useful for high-volume data streaming.I am relatively new to timeseries. So if this is off the mark because of my lack of understanding of a Time Index or how the streams can work in other ways, I'd be happy to hear about it.