I was uncomfortable always being asked to do a favor by a co-worker. I assessed the situation and took him aside and shared that I would no longer be willing to do the favor. I did not expound upon my reasons, because we do not have a whole lot of interaction in the workplace so it was not high stakes. It turned out to be the right decision because our relationship has been preserved and I no longer feel put upon, which had been my original problem.