‘People told us setting up the Black British Business Awards would hurt our careers’