Well, when I go to my grave, Allah will not ask me if you believed in Abu Bakr or Ali.
They were great people, companions of the Prophet pbuh, they served Islam, I love them.
But for the sake of uniting people, which is holier than anything else, we may stop glorifying any of them, we may just focus on the teachings of Quran and the life of Prophet without exalting the status of any particular companion.
Allah said in Quran that there's no differentiation among the Prophets, then why we have differentiation among the companions? We should respect and love all sahaba equally.