I need help with understanding this idiom- '... were constantly on our heels'?

This means the children that lived at the place where you were the first visitors-were constantly right behind you. On your heels is a way of saying near me all the time.