Lyric discussion by gabivallu 

Cover art for Me in You lyrics by Kings of Convenience

"I see you building the castle with one hand while tearing down another with the other "

this part puzzles me a bit...

Someone that is not ready to leave a person before they start a new relationship. They would rather transition into another relationship.