Probably not as absurd as you think. I reckon if you dropped an American in a random town in Scotland (or even a northern English town, for that matter), they would also need to use very broken English and hand gestures to communicate as well. Glaswegian or Geordie is near incomprehensible to RP speaking Brits, yet alone to an American who's only exposure to Scottish is Mel Gibson as William Wallace.