Role of grain boundaries and micro-defects on the mechanical response of a crystalline rock at multiscale