See #969 for additional info.

The above was a quicker fix to unblock us but after further discussion I think long term xfailing here with no pinning makes more sense.