TAG ARCHIVE

#user-agent

Spoof User Agent in http calls

Recently I was trying to download numerous files from a certain website using a shell script I wrote. With in the script, first I used wget to retrieve the files, but I kept on getting the…

Python modify user-agent

Set a custom User-Agent header in Python requests, inspect the request behavior, and understand why clients identify themselves to web servers.