Update build system to properly play with numpy