Handle not supported content encoding

[y-code]

Although HtmlWeb class allows to ignore resp.ContentEncoding by OverrideEncoding property, it cannot help in the case where resp.ContentEncoding has encoding name which is not supported by Encoding class, and throws ArgumentException.

When OverrideEncoding is provided, the result from Encoding.GetEncoding method has not been actually used so that simply skipping Encoding.GetEncoding method call can make it work without impact to existing behaviors.

EncodingNotSupportedException is added in order to notify that such not supported content encoding is received from server. It helps when writing code to retry loading page with OverrideEncoding.

fix #326

[JonathanMagnan]

Hello @y-code ,

Thank you for the pull, we will look at it.

Best Regards,

Jonathan

---

Performance Libraries
context.BulkInsert(list, options => options.BatchSize = 1000);
Entity Framework Extensions • Entity Framework Classic • Bulk Operations • Dapper Plus

Runtime Evaluation
Eval.Execute("x + y", new {x = 1, y = 2}); // return 3
C# Eval Function • SQL Eval Function

[JonathanMagnan]

Hello @y-code ,

Sorry for the long delay, we were unable to work on HAP during September.

We checked the pull and it looks good but it's possible to get one case in which the new exception will be throw?

If you want, you can add it to the unit test section or just provide the code here.

[y-code]

Hi @JonathanMagnan,

Thank you for having time to review my change. I'll try to add a unit test.

[JonathanMagnan]

Hello @y-code ,

Do you think you would have time to add those unit tests soon?

We currently cannot merge this fix since we don't know how to reproduce the issue.

[JonathanMagnan]

Hello @y-code ,

Whenever you are ready to provide a unit test, just add it and we will re-open this pull.

Meanwhile, we will close it as my developer asked me to don't push it unless we better understand what will be the impact and for this, we need an example.

[y-code]

Hi @JonathanMagnan,

I added tests for my change. Please re-open this pull request and review the code I added.

In order to make HtmlWeb class testable in unit test, I added a code refactoring in the class. I hope you wouldn't mind this change. This refactoring abstracts HttpWebRequest and HttpWebResponse used in HtmlWeb class. It applies only to the code active with preprocessor symbol !(NETSTANDARD1_3 || NETSTANDARD1_6 || METRO).

For testing, I added another project so as to run the tests over .NET Core as well. This project targets multiple frameworks; net40, net45 and netcoreapp2.1. The tests can be run with every framework in Visual Studio. To run them in the command line, dotnet.exe test can run tests only over netcoreapp2.1. For net40 and net45, we still need to use nunit3-console.exe. To debug test with netcoreapp2.1, it sounds not reasonable but we need to edit csproj file so that netcoreapp2.1 comes first in tag.

I also migrated the existing tests in HtmlAgilityPack.Tests.Net45 test project to the new test project, so if the test project looks okay, we can remove HtmlAgilityPack.Tests.Net45 test project.

In addition, I added one more project for a tool to generate test code. It was a code I used for creating the base of the test code which I added this time. I thought it could be generally useful, so I included it in this pull request. If it is not, please advise me to remove it.

[JonathanMagnan]

Awesome,

We will look at it ;)