The slave handlers doing their job?
You can not have a world without slaves. It's a mental condition that needs a lot of integrative work to deal with dominating and submissive forces at the same time. A minority default to the former a majority to the latter. Verybfew people can balance those forces, which would be necessary for an upgraded society.