Quasar clustering: Evidence for an increase with redshift and implications for the nature of active Galactic nuclei