Inconsistent results in terms of speed and memory usage

I love the feature that shows you the relative speed and memory usage of your solution once you've submitted a successful result. This has created a really interesting dynamic where I will spend time trying to profile and optimize my solution to improve it and get better results.

That said, I don't believe this feature is that accurate. I can submit the same solution multiple times in a row, and get varrying results for the performance in both speed and memory. Memory only varies a little bit, but speed can move up or down by 30 percentage points, for the same solution.

Memory, while it doesn't vary as much, for me, is always pretty poor. My solutions are better than between 5-7% of other solutions all the time. I feel like sometimes at least I should find solutions that are better than this, I can get speed numbers in 90+%, but I cannot move memory at all outside of this range no matter how hard I try. On some solutions for easy problems it seems to me as if there isn't the tiniest bit of inefficient memory usage, and yet, I'll still find myself at 5%. After googling for other people with this problem it seems to me that it is possible memory usage may not be accurate either.

Anybody have any thoughts on this? Is there something I can do differently to get consistent results?

Comments (2)