A man who hurled abuses at Prime Minister Narendra Modi and his mother during Rahul Gandhi's 'Voter Adhikar Yatra' in poll-bound Bihar has been arrested.