Difference between revisions of "User-agent:"
Jump to navigation
Jump to search
(2 intermediate revisions by the same user not shown) | |||
Line 1: | Line 1: | ||
+ | User-Agent: [[Mozilla]]/5.0 (Macintosh; Intel Mac OS X 10.15; rv:89.0) Gecko/20100101 Firefox/89.0 | ||
[[robots.txt]] | [[robots.txt]] | ||
Line 6: | Line 7: | ||
[[curl -A]] | [[curl -A]] | ||
− | + | * {{Scraping}} | |
− | {{curl}} | + | * {{curl}} |
Latest revision as of 12:10, 9 September 2023
User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:89.0) Gecko/20100101 Firefox/89.0
robots.txt
curl -A
Advertising: