How to restrict X server to localhost ?

[hd]

I'd like my X server is listening only on localhost

Is there a command line option (or config file option) to limit the 
scope of the listening socket of X server ?

there is '-nolisten' but this option seems disable the TCP stack

thanks,