Unexpected .xlsx comparison after upgrading Verify

[knopa]

After migrating to the newer versions of the libraries, the verification process started comparing the raw .xlsx file in addition to the generated .csv and .txt outputs.

This introduces instability, since .xlsx files can differ across platforms due to metadata and formatting, even when the actual data is identical.

Previously, the library relied on its internal conversion (to CSV/TXT) for verification, but now it also includes the original .xlsx as a received artifact.

Message: 
VerifyException : Directory: C:\Users\knopa\Dropbox\Work\logity-space\ERP\LogityApp\TMS.IntegrationTests\TMS.Web\Controller\Users\Read\verify
New: -
Received: UsersControllerReadTests.UserExport.received.xlsx
Verified: UsersControllerReadTests.UserExport.verified.xlsx
Equal: -
Received: UsersControllerReadTests.UserExport.received.txt
Verified: UsersControllerReadTests.UserExport.verified.txt
Received: UsersControllerReadTests.UserExport#Users List.received.csv
Verified: UsersControllerReadTests.UserExport#Users List.verified.csv

• Visual Studio 18.4.1
• .NET Core 10
• Verify.Xunit updated from 30.7.3 to 31.12.5
• Verify.Syncfusion updated from 2.3.0 to 2.4.2
• Verify.PdfPig 2.1.0

Initialize

internal static class VerifyInitialize
{
    [ModuleInitializer]
    public static void Initialize()
    {
        DiffRunner.MaxInstancesToLaunch(100);
        VerifySyncfusion.Initialize();
        //syncfusion images are not same on linux and windows
        VerifyPdfPig.Initialize();
    }
}

Test

[Fact]
internal async Task UserExport()
{
    var client = Factory.GetClient<IUsersReadApi>(UsersForTesting.SystemUser);

    var response = await client.ExportUsersListReport(new UserFilterModel());
    Assert.True(response.IsSuccessStatusCode);

    var content = await response.Content.ReadAsByteArrayAsync();
    await Verify(content, "xlsx", VerifySettings());
}

protected static VerifySettings VerifySettings(string filename = null)
{
    var settings = new VerifySettings();
    settings.UseDirectory("verify");
    settings.DontScrubGuids();
    settings.DontScrubDateTimes();
    settings.DontIgnoreEmptyCollections();
    settings.DontSortDictionaries();
    settings.AddExtraSettings(_ => _.DefaultValueHandling = DefaultValueHandling.Include);
    if (!string.IsNullOrEmpty(filename))
    {
        settings.UseFileName(filename);
    }
    return settings;
}

[SimonCropp]

After migrating to the newer versions of the libraries, the verification process started comparing the raw .xlsx file in addition to the generated .csv and .txt outputs.

it was you update to Verify.Syncfusion

This introduces instability, since .xlsx files can differ across platforms due to metadata and formatting, even when the actual data is identical.

can u try https://github.com/VerifyTests/Verify.OpenXml instead of Verify.Syncfusion

BTW your settings can mostly be done in a module ModuleInitializer

[ModuleInitializer]
public static void Init()
{
    Verifier.DerivePathInfo((file, _, _, _) =>
        new(Path.Combine(Path.GetDirectoryName(file)!, "verify")));
    VerifierSettings.DontScrubGuids();
    VerifierSettings.DontScrubDateTimes();
    VerifierSettings.DontIgnoreEmptyCollections();
    VerifierSettings.DontSortDictionaries();
    VerifierSettings.AddExtraSettings(_ => _.DefaultValueHandling = DefaultValueHandling.Include);
}

[knopa]

I see any reason why it would have such change?

I will try OpenXml version.

Thanks for a tip in my case I have different set of settings per different scope

[SimonCropp]

the xlsx is the actual output. so it should be one of the snapshot files. the only reason it wasnt previously is that i could not get it to be deterministic. i solved the deterministic, hence it is now included