I think this is a fantastic read, thank you, Vincent, I'm using it in our experiments as we speak. At the same time, for publishing we do need to learn something general, beyond just the way you solved your specific problem. A set of simulators would be great to demonstrate and to generalize not only the particular methods you tried but also the experimental protocol itself. I know this is tough, a good simulator should reproduce not necessarily the same scores but the same rank ordering of the methods as your results on the real system. Then, playing with the simulators and observing the changing rankings can help us to understand what makes methods better or worse on certain types of systems.
