Skip to content

[Bug]: CSV Extractor - too small default for characters_read_in_line #2394

@norberttech

Description

@norberttech

What happened?

characters_read_in_line in CSV Extractor is causing a huge amount of http calls when used with remote filesystems.

For local filesystem this value is fine, but with S3 like storage it will pretty much create a http request per row

How to reproduce?

Parse remote CSV file

Playground snippet

No response

Data required to reproduce bug locally

Version

0.38.0

Relevant error output

no output

Metadata

Metadata

Assignees

Labels

Type

No fields configured for Bug.

Projects

Status

Todo

Milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions