Howtos / Articles

Change the User Agent in Wget

The Wget application is a non-interactive tool to download data from a server using either the HTTP, HTTPS or FTP protocols. This article will focus on the HTTP and HTTPS protocols, as the user agent value has no relevance with the FTP protocol. There will be times when you need to download a web page, emulating a different browser. Some web sites may output different html code depending on the browser being used to request the page. By modifying the…

Read more [...]

Change the User Agent in Curl

The Curl application is a tool to transfer data from a server using a number of different protocols. The main protocols that are generally used are HTTP and HTTPS. There will be times when you need to download a web page, emulating a different browser. Some web sites may output different html code depending on the browser being used to request the page. By modifying the User Agent header on the http/https request, you can tell the server what browser…

Read more [...]

Remove nginx version from HTTP response headers

Its usually a good idea to prevent users from being able to determine the version number of the web server software you are using. This helps prevent people from then going and looking for known vulnerabilities in that specific version, and attacking your site. When a HTTP response comes back to the web browser, it also includes a number of headers. One of these headers is the “Server” header. This is used to identify the web server software being used.…

Read more [...]