Hey,

​

I'm trying to build a simple app that will take a user search input, and based on it, the app will connect to specific search urls on different websites and gather all results summarized and sorted for the user to see.

These websites have no APIs so I'm approaching to scrap them. The thing is that these sites are pretty complex and they are all dynamic.

I have tried htmlagilitypack but I get "The document is too complex to parse" exception, and now I don't know if the lib is not enough or I need some other lib to do that OR I'm just using it wrong.

Any thoughts?