What does the idiom be on shaky ground mean?

The idiom you have alluded to means to be placed precariously or unfavourably in a situation. The American expression "skating on thin ice" has a meaning that is synonymous and can be used interchangeably with the idiom in question.