Before reinventing the wheel, let me explain what I want to achieve.
I have a very large number of records containing incremental measurements. These are in a set order. I want to smooth that data and isolate those records whose data falls 10 measurements lower or 10 higher than the previous record.
If a record's data IS NOT plus of minus 10 that record is omitted and deleted. The next record will be evaluated against the previous successful test.
This will result in data incrementing by +/-10.
The aim is reduce the number of records [file size and memory] by retaining only those records rising or falling by 10.
I would appreciate the communities advice on the best way forward.
Thank you in advance.