On the classification of non-big Ulrich vector bundles on quadrics and fourfolds