Dominicbm added a comment.
In T253591#6164399 <https://phabricator.wikimedia.org/T253591#6164399>, @Xqt wrote: >> The problem is that, for my use case, I really just want page titles, but I guess since Pywikibot wants to generate all the page objects using all the metadata, there is no way around this error currently. > > `CategorizedPageGenerator `does not load the content by default. To get it you have to use `content=False` as parameter or use an explicit cat.get() later. It's not the page content, but the image metadata. So, if I look at the request in debug mode, even without `content=True`, since `metadata` is always included in `iiprop`, as you can see below, there will always be a possibility of an API response that is too large. I put `step API request to commons:commons (uses get: False): Headers: {'Content-Type': 'application/x-www-form-urlencoded'} URI: '/w/api.php' Body: 'gcmtitle=Category%3AMedia+contributed+by+the+Digital+Public+Library+of+America&gcmprop=ids%7Ctitle%7Csortkey&gcmtype=page%7Cfile&prop=info%7Cimageinfo%7Ccategoryinfo&inprop=protection&iiprop=timestamp%7Cuser%7Ccomment%7Curl%7Csize%7Csha1%7Cmetadata&iilimit=max&generator=categorymembers&action=query&indexpageids=&continue=&gcmnamespace=6&gcmlimit=1&meta=userinfo&uiprop=blockinfo%7Chasmsg&maxlag=5&format=json' TASK DETAIL https://phabricator.wikimedia.org/T253591 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Dominicbm Cc: Xqt, Aklapper, pywikibot-bugs-list, Dominicbm, JohnsonLee01, Dijkstra, Zkhalido, Viztor, Wenyi, Tbscho, MayS, Mdupont, JJMC89, Dvorapa, Altostratus, Avicennasis, mys_721tx, jayvdb, Masti, Alchimista, Rxy
_______________________________________________ pywikibot-bugs mailing list [email protected] https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs
