Feature: Add JSON Repair operation with comprehensive malformed JSON fixing capabilities#2087
Open
maojunxyz wants to merge 3 commits intogchq:masterfrom
Open
Feature: Add JSON Repair operation with comprehensive malformed JSON fixing capabilities#2087maojunxyz wants to merge 3 commits intogchq:masterfrom
maojunxyz wants to merge 3 commits intogchq:masterfrom
Conversation
- Add new JSON Repair operation using jsonrepair library (v3.13.0) - Support for fixing common JSON issues: * Missing quotes around object keys * Single quotes to double quotes conversion * Trailing commas removal * Missing commas insertion * Python constants (True/False/None) to JSON equivalents * Comments removal (both // and /* */ styles) * JSONP notation handling - Include comprehensive test suite with 11 test cases - Add operation to 'Code tidy' category - Follows KISS principle with minimal configuration - Uses dynamic import for robust module loading Resolves the common issue of repairing malformed JSON data, particularly useful for processing JSON with missing commas between object properties. Author: maojunxyz <maojun@linux.com>
- Add test case to verify JSONP callback wrapper removal
- Validates that callback({name: John, age: 30}) becomes {name: John, age: 30}
- Ensures comprehensive coverage of jsonrepair library features
- Total test cases now: 12 (previously 11)
- Fix trailing spaces in JSONRepair.mjs - Convert single quotes to double quotes in test files - Fix line ending style (CRLF to LF) - All lint checks now pass
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
Adds a new JSON Repair operation that fixes common JSON formatting issues using the
jsonrepairlibrary.Changes
jsonrepairlibrary (v3.13.0) for reliable repair functionalityFiles changed
src/core/operations/JSONRepair.mjs- Main operationtests/operations/tests/JSONRepair.mjs- Test suitesrc/core/config/Categories.json- Category configurationtests/operations/index.mjs- Test registrationpackage.json- Added jsonrepair dependencyTesting
Done.
Running Node API tests...
Tests completed ████████████████████████████████████████ 217/217 | 100% | Duration: 1s
TOTAL 217
PASSING 217
Running operation tests...
Tests completed ████████████████████████████████████████ 1728/1728 | 100% | Duration: 6s
TOTAL 1728
PASSING 1728
All tests pass (1728/1728). New operation includes comprehensive test coverage for:
Addresses common user need for fixing malformed JSON data.