Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

cchardet is recommended now or is replaced by charset-normalizer by default? #305

Closed
lord-alfred opened this issue Feb 19, 2023 · 2 comments
Labels
feedback Feedback from users requested

Comments

@lord-alfred
Copy link

lord-alfred commented Feb 19, 2023

In docs:

A few additional libraries can be installed for extended functionality and faster processing: language detection and faster encoding detection: the cchardet package may not work on all systems but it is highly recommended.

But now charset-normalizer is setup by default, charset-normalizer is faster: aio-libs/aiohttp#5930 (comment)

@adbar adbar added the feedback Feedback from users requested label Feb 20, 2023
@adbar
Copy link
Owner

adbar commented Feb 20, 2023

Hi @lord-alfred, I need to revise the docs from time to time but in your case it's still up-to-date.

The cchardet library is just not the same as the chardet library, it is more accurate and faster. So I still recommend it, it's not maintained anymore so I had to use a fork.

Does this answer your concern?

@lord-alfred
Copy link
Author

lord-alfred commented Feb 20, 2023

Oh, I'm sorry, I figured it out. It was one character in the name of the library that confused me :)
The benchmark compares chardet, not cchardet

@adbar adbar closed this as completed Mar 6, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
feedback Feedback from users requested
Projects
None yet
Development

No branches or pull requests

2 participants