feat: Validate add.stats. numRecords must exist on writes when icebergCompatV3 enabled

[dengsh12]

🥞 Stacked PR

Use this link to review incremental changes.

• stack/add-v3-feature [Files changed] [MERGED]
  • stack/write-part-when-ice3 [Files changed] [MERGED]
    • stack/block-alter-table [Files changed]
      • stack/write-nested-id [Files changed]
        • stack/detect-no-num [Files changed]
          • stack/create-ice-v3-table

---

What changes are proposed in this pull request?

Added a new NumRecordsValidator to validate add.stats.numRecords must exist on writes when icebergCompatV3 enabled. Renamed Existing StatsVerifier to StatsColumnVerifier to distinguish.

How was this change tested?

Unit tests for:

1. Empty EngineData batches.
2. One EngineData batches with several numRecords as None(validates early-return).
3. Two EngineData batches with several numRecords as None(validates early-return).
4. One EngineData batch with numRecords in all add actions.

[dengsh12]

Currently we never enter this if branch since we can't write to icebergCompatV3 tables. Will covered by later integration tests

[github-actions]

PR title does not match the required pattern. Please ensure you follow the conventional commits spec.

Your title should start with feat:, fix:, chore:, docs:, perf:, refactor:, test:, or ci:, and if it's a breaking change that should be suffixed with a ! (like feat!:), and then a 1-72 character brief description of your change.

Title: feat: Validate add.stats. numRecordsmust exist on writes whenicebergCompatV3 enabled
PR title does not match the required pattern. Please ensure you follow the conventional commits spec.

Your title should start with feat:, fix:, chore:, docs:, perf:, refactor:, test:, or ci:, and if it's a breaking change that should be suffixed with a ! (like feat!:), and then a 1-72 character brief description of your change.

Title: feat: Validate add.stats. numRecordsmust exist on writes whenicebergCompatV3 enabled
PR title does not match the required pattern. Please ensure you follow the conventional commits spec.

Your title should start with feat:, fix:, chore:, docs:, perf:, refactor:, test:, or ci:, and if it's a breaking change that should be suffixed with a ! (like feat!:), and then a 1-72 character brief description of your change.

Title: feat: Validate add.stats. numRecordsmust exist on writes whenicebergCompatV3 enabled

[codecov]

Codecov Report

❌ Patch coverage is 94.44444% with 33 lines in your changes missing coverage. Please review.
✅ Project coverage is 88.56%. Comparing base (78670eb) to head (8480dfe).

Files with missing lines	Patch %	Lines
kernel/src/engine/arrow_expression/apply_schema.rs	89.47%	13 Missing and 3 partials ⚠️
kernel/src/engine/arrow_conversion/mod.rs	94.28%	0 Missing and 8 partials ⚠️
kernel/src/transaction/stats_verifier.rs	92.75%	2 Missing and 3 partials ⚠️
kernel/src/utils.rs	98.59%	3 Missing ⚠️
kernel/src/transaction/mod.rs	83.33%	1 Missing ⚠️

Additional details and impacted files

@@            Coverage Diff             @@
##             main    #2512      +/-   ##
==========================================
+ Coverage   88.50%   88.56%   +0.05%     
==========================================
  Files         179      179              
  Lines       59031    59551     +520     
  Branches    59031    59551     +520     
==========================================
+ Hits        52245    52739     +494     
- Misses       4785     4803      +18     
- Partials     2001     2009       +8     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:

• ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.