curl
Simple GET request
Main: GET request
-i
: Include response header
-L
: Follow redirection
-s
: Silent mode
Modify Header
For example, change user agent:
SED tips
If the output contains many space preceding, we can use sed
to trim. For example, if the output looks like:
We can pipe it to sed
:
The output will be:
Webpage to Text version
Note that we can use html2text
to 'see' the website on CMD:
Last updated