Skip to content

[Bug]Error while trying to split key and value in configuration #4200

Closed
andystenhe wants to merge 3 commits intoapache:devfrom
andystenhe:dev
Closed

[Bug]Error while trying to split key and value in configuration #4200
andystenhe wants to merge 3 commits intoapache:devfrom
andystenhe:dev

Conversation

@andystenhe
Copy link
Copy Markdown

What changes were proposed in this pull request

Issue Number: close #4199

Brief change log

fix Flink config.yaml Parsing Error​

Verifying this change

This change is already covered by existing tests, such as (please describe tests).

org.apache.streampark.common.util.PropertiesUtilsTestCase

Does this pull request potentially affect one of the following parts

  • Dependencies (does it add or upgrade a dependency): no

@wolfboys
Copy link
Copy Markdown
Member

hi:

Thanks for your contribution. Before Flink 1.19, the format of the flink-conf.yaml file did not adhere to the standard YAML specification. When parsing these parameters, Flink implemented its own custom parsing logic, which is also used in StreamPark. If a standard YAML parser were applied, it would fail to parse the file correctly.

This issue has been raised multiple times in the Flink community. Flink 2.0's file format was standardized to align with proper YAML specifications. However, this updated parsing method is only suitable for Flink 2.0 and later versions. For versions below 2.0, the original parsing approach must still be retained. Therefore, we cannot resolve this problem with a one-size-fits-all solution. Instead, we need to determine the Flink version and select the appropriate parsing method based on the version.

@sonarqubecloud
Copy link
Copy Markdown

@sonarqubecloud
Copy link
Copy Markdown

@wolfboys
Copy link
Copy Markdown
Member

fixed: #4264

@wolfboys wolfboys closed this Jun 30, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[Bug] Error while trying to split key and value in configuration

2 participants