curl with gallica now gives tiny images.

Advice and Help

Moderator: kcleung

Post Reply
coulonnus
active poster
Posts: 1682
Joined: Thu Jul 12, 2007 8:53 am
notabot: 42
notabot2: Human
Location: Nice, France
Contact:

curl with gallica now gives tiny images.

Post by coulonnus »

Since a few weeks.

e.g. curl https://gallica.bnf.fr//iiif/ark:/12148 ... 0542322t/f[14-14]/full/full/0/native.jpg -o q#1.jpg
(only one page to make things simpler)

Note that https://gallica.bnf.fr//iiif/ark:/12148 ... native.jpg works well if you copy-paste it into the banner of your browser.
Pnorcks
regular poster
Posts: 46
Joined: Tue Jun 27, 2023 4:29 am
notabot: 42
notabot2: Human

Re: curl with gallica now gives tiny images.

Post by Pnorcks »

I suspect this is a server-side change to help prevent scraping from AI bots... For a while, I've not been able to download Gallica's IIIF manifests with curl, due to the captcha, so I was downloading the manifests through the web interface. But at that time, curl was still able to download the full-size images themselves. Apparently that's now changed... I have not downloaded from Gallica in a while, so not sure when the behavior changed (again), but I now see 403 error responses when attempting to download the images with curl. And similar to what you report, if I copy/paste the image URLs in a web browser, they download successfully.
coulonnus
active poster
Posts: 1682
Joined: Thu Jul 12, 2007 8:53 am
notabot: 42
notabot2: Human
Location: Nice, France
Contact:

Re: curl with gallica now gives tiny images.

Post by coulonnus »

Thanks for this contribution. If you know where the executable of your browser is, you can edit a command file containing e.g. start " " "C:\Program Files\Google\Chrome\Application\chrome.exe" https://gallica.bnf.fr/iiif/ark:/12148/ ... native.jpg
Then if you start if from the command prompt window you obtain this wanted image on the screen and you can save it. But how to automate the process? Or is there another web browser that you can control with à la DOS commands? In the past I used Lynx but it does'nt support https pages.
And mycommand>mypage.jpg gives no result.
Post Reply