I think this is a fantastic read, thank you, Vincent, I'm using it in our experiments as we speak. At the same time, for publishing we do need to learn something general, beyond just the way you solved your specific problem. A set of simulators would be great to demonstrate and to generalize not only the particular methods you tried but also the experimental protocol itself. I know this is tough, a good simulator should reproduce not necessarily the same scores but the same rank ordering of the methods as your results on the real system. Then, playing with the simulators and observing the changing rankings can help us to understand what makes methods better or worse on certain types of systems.

--

Head of AI research, Huawei France, previously head of the Paris-Saclay Center for Data Science, co-creator of RAMP (http://www.ramp.studio).

Love podcasts or audiobooks? Learn on the go with our new app.

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store