He always seemed more nervous by the fact he (accurately) believes Garak is a spy, which fascinates him, but also was shocked that said spy was trying to get information from him which boosted his ego and played to his interests. Like a kid having their own hero approach them and not the other way around.