Conservative George Conway says he 'smiled' at Trump at trial — and 'it got on his nerves'