You will not always be fond of the people you are collaborating with; however, the interviewer needs to know that any potential dislike will not affect your job performance. Keep your answer positive and focus on your ability to self-manage despite team members who may drag you down.
"I really prefer to work with those who are punctual, reliable, and can take accountability for their own workload. With that said, I understand that I can only be responsible for my personal work ethic so I do not allow any delinquent co-workers to affect my personal performance."
"I can work with most personalities; however, I dislike working with others who do not pull their own weight and expect others to pick up their slack. It's not fair to the team and it's frustrating. When this has happened in the past, I have addressed it with the team member."