Can a non-custodial parent sign over their visitations to a power of attorney?

I am the custodial parent of my son. Recently, his father has moved out of state and has signed a power of attorney over to his mother. Can the grandmother claim his visitations without my consent?