What are the biggest challenges you face as you need to improve your verbal English skills?

Acquiring the right accent; which is neither too American slang nor Historical British!

I think it is a lot of expression which people who use English as a mothertongue use naturally but delivery of meaning is not clear for people who don't use English as a mothertongue.