It’s possible. But, only religious precepts consistently speak against harm to innocents: poor, young, infirm, weak of mind. While there may be fine sets of non-religious precepts, there are a whole range of them — e.g., materialism, Nihilism — that are dangerous. Hence, why one of the Founding Fathers stated that Americans should prefer leaders that are religious, and, ideally, Christian.
Remember what stopped the slave trade: British Christianity. Remember what stopped slavery in America: the flavor of Puritanism called Abolitionism.