A fan has expressed his disappointment after seeing Simon Cowell rent a hotel room with an adult film actress.