What happened?
characters_read_in_line in CSV Extractor is causing a huge amount of http calls when used with remote filesystems.
For local filesystem this value is fine, but with S3 like storage it will pretty much create a http request per row
How to reproduce?
Playground snippet
No response
Data required to reproduce bug locally
Version
0.38.0
Relevant error output
What happened?
characters_read_in_line in CSV Extractor is causing a huge amount of http calls when used with remote filesystems.
For local filesystem this value is fine, but with S3 like storage it will pretty much create a http request per row
How to reproduce?
Parse remote CSV filePlayground snippet
No response
Data required to reproduce bug locally
Version
0.38.0
Relevant error output