You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
This repository has been archived by the owner on Jun 28, 2021. It is now read-only.
Is your feature request related to a problem? Please describe.
If the data source is sending out multiple delimiter type files it should be possible to detect the delimiter automatically.
Describe the solution you'd like
Simple string comparison in the first few lines can give the column count equivalent character & finding the suitable delimiter
Describe alternatives you've considered
N/A Additional context
N/A
The text was updated successfully, but these errors were encountered:
So the idea could be that if the existing delimiter option or a new auto_delimiter or a combination of both options (like in the example below) equals an array of character delimiters or true (converted to the most common delimiters), auto-detection is activated and the first character matching the set will define the delimiter for the rest of the data set, right ?
I am personally quite uncomfortable with this issue because it implies to store in memory the first few lines and going backward once we decide on a delimiter. It feels more appropriate to write a dedicated stream transform plugged just before csv-parse to determine what is the delimiter.
Is your feature request related to a problem? Please describe.
If the data source is sending out multiple delimiter type files it should be possible to detect the delimiter automatically.
Describe the solution you'd like
Simple string comparison in the first few lines can give the column count equivalent character & finding the suitable delimiter
Describe alternatives you've considered
N/A
Additional context
N/A
The text was updated successfully, but these errors were encountered: