Legal Question in Family Law in New Mexico

Yes. Apples and oranges: the grandparent's visitation rights are entirely separate from his. The only effect may be if the two separate visitations become too burdensome: in that case you could ask the court to modify them both to accommodate your and your daughter's schedules.

Also recognize that if the father's visitation becomes so extensive that it becomes like joint custody, it could affect your child support payments. I hope you are getting child support payments? If not, this is a good time to ask the court to order that.