Need to deal with a big long type array (100 – 200million elements) frequently. A data in the array will repeat a few times or thousands of times before next data. I need to remove the repeated data.
What I do now is take in a data, compare it to next, until the next data is not same. It takes 1.5s to complete one million elements. 100 seconds to complete 100 Million elements. How to do it faster.