Because the predicate verb got (go) in the sentence is an intransitive verb, you can't add an object directly after it, but to ... can be understood as an adverbial.

For example, he went to my school.

Go (qu) is an intransitive verb, and the object my school cannot be added directly after it, so it is not a subject-predicate object structure but a subject-predicate structure.