Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Mouser web scraping not working #146

Closed
xesscorp opened this issue Jan 15, 2018 · 4 comments
Closed

Mouser web scraping not working #146

xesscorp opened this issue Jan 15, 2018 · 4 comments
Labels
bug Bugs that impacts on main KiCost functionality.

Comments

@xesscorp
Copy link
Collaborator

I changed the web scraper to account for the new format of Mouser pages, but the scraping is still not working. This may be because Mouser is blocking my IP address because they think I'm a robot. Somebody else will have to try scraping and see if the Mouser information is appearing in the spreadsheet.

@hildogjr
Copy link
Owner

This explain, on my tests, why Mouser was always returning None.

@hildogjr hildogjr added the bug Bugs that impacts on main KiCost functionality. label Jan 16, 2018
@xesscorp
Copy link
Collaborator Author

Previous tests with Mouser were returning no data because they changed their web page format so it didn't match the scraper patterns. Current lack of data is caused by something else.

@hildogjr
Copy link
Owner

For some minor components is working, so I don't the extensions of the page change.
manf# = 3296Z-1-254LF --> 652-3296Z-1-254LF
manf# = 1888687 --> 651-1888687

@hildogjr
Copy link
Owner

hildogjr commented Mar 5, 2018

Today, 2018-03-04 BR clock, I had no more problem with Mouser scrape module.

@hildogjr hildogjr closed this as completed Mar 6, 2018
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Bugs that impacts on main KiCost functionality.
Projects
None yet
Development

No branches or pull requests

2 participants