You can see an old castle ... the picture.

The correct preposition to use when referring to something depicted in a picture is 'in'. Therefore, the sentence should be 'You can see an old castle in the picture.'