Skip to content

Improve line parser - #294

Open
yuriworisch wants to merge 12 commits into
Data-Liberation-Front:mainfrom
ResultadosDigitais:improve-line-parser
Open

Improve line parser#294
yuriworisch wants to merge 12 commits into
Data-Liberation-Front:mainfrom
ResultadosDigitais:improve-line-parser

Conversation

@yuriworisch

Copy link
Copy Markdown

This PR fixes #

Changes proposed in this pull request:

@woodhull

Copy link
Copy Markdown

I like this idea for improving performance, we have an issue where we need to lint very large CSVs and the current code can be slow to do so.

What work is left to do on this PR -- or was it abandoned for some reason. I might try to pick it up if there is a clear path forward.

Comment thread .circleci/config.yml

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The project is using Github Action.

Comment thread Gemfile

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Github Action has a matrix for compatibility that test many Ruby version and ActiveSupport.
FastCSV should be added to the gemspec that is the equivalent to a Gemfile for a library.

All changes in this file should be reverted.

Comment thread spec/validator_spec.rb
end

it "checks for non rfc line breaks" do
xit "checks for non rfc line breaks" do

@D-system D-system Nov 7, 2024

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Obviously, disabling tests is not the way to go.

Comment thread spec/validator_spec.rb
Comment on lines -474 to -476
expect(validator.warnings.size).to eql(1)
expect(validator.warnings.first.type).to eql(:duplicate_column_name)
expect(validator.warnings.first.category).to eql(:schema)

@D-system D-system Nov 7, 2024

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Obviously, removing tests is not the way to go either.

@D-system D-system left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Some work are required for a review.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants