Usui works every day at the restaurant to the point of exhaustion, making him really unhappy. With Karin's "taste" being unhappiness it makes it impossible for Karin to be around him without overflowing.