Not all Africans, but the north africans, granted anyone can edit wikipedia, but most of the articles online suggest it was related to North Africa and North Africans, who are Arabs and thus not as darker skinned or of the same religion as other Africans?

https://en.wikipedia.org/wiki/Barbary_slave_trade