No, empty (unassigned) voxels do not use memory. However, empty voxels must still be traversed by the raytracer, so they will increase the compute time by some extent.