I wish I (not/to be) afraid of heights.

The correct form is 'were not'. The sentence expresses a wish about a present situation that is contrary to fact. Therefore, the past subjunctive 'were' is used.