He could hardly hear what they were saying.
Explanation: 'Hardly' is an adverb meaning 'almost not at all', which fits the context of not being able to hear well.