When a guy says 'I'm trying not to get attached to you' he may not want to get into a serious relationship; he is married or living someone or perhaps you are. If he was free to truly love you there couldn't be any other reasons. Communication is always the key to questions in life and it would be wise of you to ask him what he meant by that comment.
