What is the worst part about requirements gathering?

Assumptions are the worst part in a set of requirements.
(Things should be as simple (confusion free) as possible while gathering requirements since this is really a foundation for your project.)