Commons:Bots/Requests
If you want to run a bot on Commons, you must get permission first. To do so, file a request following the instructions below.
Please read Commons:Bots before making a request for bot permission.
I | Create a user account (while logged in to your normal account) and user page for the bot
On the bot's userpage, add {{Bot}}, which automatically adds the page to Category:Commons bots. Then add the following information to the bot's userpage (all this is mandatory):
|
---|---|
II | Create your bot request:
Add your bot request to the list here:
|
III | Test run
You can be demanded to make a short test run with your bot account (30–50 edits/uploads) to allow other users to review your bot's tasks. Unauthorized test run is not allowed. |
IV | Waiting for approval.
You now need to wait for community approval. A bureaucrat will close the request and will also grant a bot flag, where necessary. Closed requests are moved to Commons:Bots/Archive. |
|
Requests made on this page are automatically transcluded in Commons:Requests and votes for wider comment.
Requests for permission to run a bot[edit]
Before making a bot request, please read the new version of the Commons:Bots page. Read Commons:Bots#Information on bots and make sure you have added the required details to the bot's page. A good example can be found here.
When complete, pages listed here should be archived to Commons:Bots/Archive.
Any user may comment on the merits of the request to run a bot. Please give reasons, as that makes it easier for the closing bureaucrat. Read Commons:Bots before commenting.
DaxBot (talk · contribs)[edit]
Operator: DaxServer (talk · contributions · Statistics · Recent activity · block log · User rights log · uploads · Global account information)
Bot's tasks for which permission is being sought: Task #2 - Upload images from en:UCLA Library which are deemed Public Domain. "The UCLA Library Digital Collections includes rare and unique digital materials developed by the UCLA Library to support education, research, service, and creative expression." – https://digital.library.ucla.edu/ Example: https://digital.library.ucla.edu/catalog/ark:/21198/z10g97m3
Automatic or manually assisted: Supervised automatic Manual
Edit type (e.g. Continuous, daily, one time run): Regular (not continuous)
Maximum edit rate (e.g. edits per minute): 5
Bot flag requested: (Y/N): N
Programming language(s): Python
I have not yet started any development work on this as I'll be awaiting for a test run approval. -- DaxServer (talk) 11:32, 7 January 2024 (UTC)
- Discussion
- Test runs is fine. Please make it. --EugeneZelenko (talk) 15:39, 7 January 2024 (UTC)
- @EugeneZelenko Test run is done with 25 images - Category:Files from UCLA Library uploaded by DaxBot. Thanks -- DaxServer (talk) 14:18, 9 January 2024 (UTC)
- Looks like UCLA metadata will need further refinement on your side. For example, File:Agastya asking Rama to deliver Dandakaranya from a curse from UCLA Library.png and File:Amirnama folio from UCLA Library.png are not photos. Also why UCLA license tag was used for work originated in non-USA territories (then)? Please use language ta for depatrment field. --EugeneZelenko (talk) 15:36, 9 January 2024 (UTC)
- I corrected all the uploads with respective PD licenses, dates, categories - the corrections are an output from the bot (as if it is run to upload). Thus, the bot is manually-assisted capable of corrections to the fields on-demand. There are some quirks here and there, but I expect to update the bot logic as they're encountered.
- I'm not sure what you meant by using language ta for department field. Could you explain?
- Apart from that, please review and let me know the feedback, and if I missed something. Thanks! -- DaxServer (talk) 19:58, 14 January 2024 (UTC)
- For example, {{en|UCLA Digital Library – AIIS Center for Art & Archaeology – Negatives & Slides Collection}}. Is it possible to use proper copyright tag based on part of collection like all photos are 2D reproductions of public domain art? --EugeneZelenko (talk) 16:55, 15 January 2024 (UTC)
- Looks like UCLA metadata will need further refinement on your side. For example, File:Agastya asking Rama to deliver Dandakaranya from a curse from UCLA Library.png and File:Amirnama folio from UCLA Library.png are not photos. Also why UCLA license tag was used for work originated in non-USA territories (then)? Please use language ta for depatrment field. --EugeneZelenko (talk) 15:36, 9 January 2024 (UTC)
- @EugeneZelenko Test run is done with 25 images - Category:Files from UCLA Library uploaded by DaxBot. Thanks -- DaxServer (talk) 14:18, 9 January 2024 (UTC)
GeertivpBot (talk · contribs)[edit]
Operator: Geertivp (talk · contributions · Statistics · Recent activity · block log · User rights log · uploads · Global account information)
Bot's tasks for which permission is being sought:
- Add missing SDC depict statements on media files (File namespace)
- Add missing Wikidata Infobox template to Category pages (Category namespace)
Automatic or manually assisted: Automatically, but monitored
Edit type (e.g. Continuous, daily, one time run): Intermittently
Maximum edit rate (e.g. edits per minute): 8 edits per minute
Bot flag requested: (Y/N): Y
Programming language(s): Pywikibot, Python scripts are on GitHub:
- https://github.com/geertivp/Pywikibot/blob/main/add_image_from_sdc.py
- https://github.com/geertivp/Pywikibot/blob/main/copy_label.py
Test runs are here.
Geert Van Pamel (talk) 22:29, 3 January 2024 (UTC)
- Discussion
- Could you please elaborate how `depicts` is filled? For example, File:Novosibirsk Regional Museum at night 2.jpg should depict building and condition of shoot (night shoot) should be qualifier. --EugeneZelenko (talk) 15:40, 4 January 2024 (UTC)
- The image depicts a "night view of the Royal museum", expressed as SDC depicts (P180) nighttime view (Q28333482) with qualifier of (P642) City Trade House (Q19908752), based upon and generated by the original Wikidata statement Q19908752#P3451 City Trade House (Q19908752) nighttime view (P3451) (M19171168). By doing so, both the SDC depict statement in Wikimedia Commons and the Wikidata statement are describing the same fact.
- What qualifier would you use instead? Can you please elaborate more about the exact statement that you would create? Thanks. Geert Van Pamel (talk) 16:23, 4 January 2024 (UTC)
- Maybe you would like to see: depicts (P180) City Trade House (Q19908752) with qualifier depicted format (P7984) nighttime view (Q28333482)? Please give your point of view/preferences. Geert Van Pamel (talk) 14:24, 5 January 2024 (UTC)
- It makes sense to have broader discussion on matter of qualifiers. May be bot should be limited just for subjects for now? --EugeneZelenko (talk) 15:35, 5 January 2024 (UTC)
- Maybe you would like to see: depicts (P180) City Trade House (Q19908752) with qualifier depicted format (P7984) nighttime view (Q28333482)? Please give your point of view/preferences. Geert Van Pamel (talk) 14:24, 5 January 2024 (UTC)
SchlurcherBot (talk · contribs)[edit]
Operator: Schlurcher (talk · contributions · Statistics · Recent activity · block log · User rights log · uploads · Global account information)
Bot's tasks for which permission is being sought: Actions as described in User:SchlurcherBot/Mass revert computer-aided tagging
Automatic or manually assisted: Automatic in batches
Edit type (e.g. Continuous, daily, one time run): One time run
Maximum edit rate (e.g. edits per minute): 20-30
Bot flag requested: (Y/N): N (already has bot status)
Programming language(s): C#
Schlurcher (talk) 13:38, 30 December 2023 (UTC)
- Discussion
- Please make test run. --EugeneZelenko (talk) 15:48, 30 December 2023 (UTC)
- Will do and report back once an appropriate tag is generated for these kind of mass edits, see Commons:Administrators'_noticeboard#Changes_to_Special:Tags. --Schlurcher (talk) 21:36, 2 January 2024 (UTC)
- @EugeneZelenko: While I'm still waiting for an appropriate tag to be generated, I've now made the first set of edits. Please see the contributions of my development bot account: SchlurcherBotT (talk · contribs) (the last 12 edits, after I had fixed the link to wikidata).
- In this first run, the bot processed a total of 20 revisions, leading to these 12 edits according to the following breakdown:
Message | Count
Done. | 12
Error: Claim already removed. | 1
Error: User on excemption list. | 6
- Let me know your comments. --Schlurcher (talk) 16:56, 10 January 2024 (UTC)
- I've made one more edit with the proper tag applied, as it was just created. Please let me know of any concerns of if I can start this operation. --Schlurcher (talk) 20:56, 13 January 2024 (UTC)
- Let me know your comments. --Schlurcher (talk) 16:56, 10 January 2024 (UTC)
SanbornMapBot (talk · contribs)[edit]
Operator: Nowakki (talk · contributions · Statistics · Recent activity · block log · User rights log · uploads · Global account information)
Bot's tasks for which permission is being sought: To upload, categorize, rename, provide with a generated index Sanborn Fire Insurance Maps downloaded from the Library of Congress and other places (seldomly).
Automatic or manually assisted: manual
Edit type (e.g. Continuous, daily, one time run): intermittently for a few weeks
Maximum edit rate (e.g. edits per minute): 100 when uploading
Bot flag requested: (Y/N): N
Programming language(s): perl
Nowakki (talk) 09:34, 25 December 2023 (UTC)
- Discussion
- Please make test run. --EugeneZelenko (talk) 15:40, 25 December 2023 (UTC)
- i have already uploaded 80,000 files through my main account in the last few days, unaware of this prior authorization requirement. Nowakki (talk) 16:28, 25 December 2023 (UTC)
- here is a proposal for the index which i would add to the category page of a town. this category would then have subcategories for the (year, volume) combo of a map too. But the index should suffice to access all the plates.
- User:Nowakki/sanborn test
- the code to add the index is not yet written. i will add comments above and below the generated content to allow automatic edits to easily be undone.
- For the moment i just need to upload the images. I can ask for additional permissions when i have the code ready.
- Additional permissions will almost certainly also include the renaming of old files that were uploaded by somebody else with a bad naming scheme.
- In any case, all accesses of the bot will be restricted to files and categories that start with "Sanborn Fire Insurance Map From". In other words, it may make more sense to just look at the end result as this is really just an upload job for new content with some alteration to old content in the same "namespace". Nowakki (talk) 16:38, 25 December 2023 (UTC)
- @EugeneZelenko: does this request for a test run still stand now or not? Nowakki (talk) 15:54, 26 December 2023 (UTC)
- Based on your uploads: will be good idea to put content of file name into description, not just plate number; please enclose description in language tag. --EugeneZelenko (talk) 16:12, 26 December 2023 (UTC)
- Ok, i am now using the in the description the same string as in the filename (File:ALLTHIS.jpg) with a language tag. I will delay editing existing pages in case something else comes up. Nowakki (talk) 05:01, 27 December 2023 (UTC)
- @EugeneZelenko: So what is the ruling here? Can i run the bot or not? If yes, can you transfer the auto patrol rights from my main to the bot account? Or do i have to make a separate request for that? I need that to get rid of the rate limit. Nowakki (talk) 03:55, 28 December 2023 (UTC)
- Please make test run. Bot could operate on full speed after approval, but it's necessary to verify that its uploads are fine. --EugeneZelenko (talk) 15:39, 28 December 2023 (UTC)
- This is an ongoing process. Functionality is continuously added. However uploads can proceed now. There are now a few more uploads for you to verify.
- I will then finalize the code and bring a few example towns to the intended end state, so you can approve of the old file rename and the generated index features when the time comes. SanbornMapBot (talk) 11:55, 29 December 2023 (UTC)
- Description is still not wrapped in language tag ({{en|<description>}}). --EugeneZelenko (talk) 15:02, 29 December 2023 (UTC)
- Damn. It is fixed now. Some more images uploaded. SanbornMapBot (talk) 02:43, 30 December 2023 (UTC)
- Looks OK for me. --EugeneZelenko (talk) 15:50, 30 December 2023 (UTC)
- can you transfer the autopatrol right from my main account to the bot? SanbornMapBot (talk) 02:20, 1 January 2024 (UTC)
- Done. But please perform only test uploads until this request approval. --EugeneZelenko (talk) 14:45, 1 January 2024 (UTC)
- I have today recategorized and supplied with a {{rename tag all map files from Wyoming (954 files). There are 218,807 files still to be renamed.
- As it stands the newly renamed files have a different structure, with different metadata, as provided by the original uploader, from all the plates that i uploaded.
- perhaps it would be a good idea to include at least one wiki-link with the newly uploaded files and behind that wikilink would be a page that explains everything about the files in general. SanbornMapBot (talk) 17:48, 2 January 2024 (UTC)
- Done. But please perform only test uploads until this request approval. --EugeneZelenko (talk) 14:45, 1 January 2024 (UTC)
- can you transfer the autopatrol right from my main account to the bot? SanbornMapBot (talk) 02:20, 1 January 2024 (UTC)
- Looks OK for me. --EugeneZelenko (talk) 15:50, 30 December 2023 (UTC)
- Damn. It is fixed now. Some more images uploaded. SanbornMapBot (talk) 02:43, 30 December 2023 (UTC)
- Description is still not wrapped in language tag ({{en|<description>}}). --EugeneZelenko (talk) 15:02, 29 December 2023 (UTC)
- Please make test run. Bot could operate on full speed after approval, but it's necessary to verify that its uploads are fine. --EugeneZelenko (talk) 15:39, 28 December 2023 (UTC)
- Based on your uploads: will be good idea to put content of file name into description, not just plate number; please enclose description in language tag. --EugeneZelenko (talk) 16:12, 26 December 2023 (UTC)
- A request to rename 200,000 files found no support after a recent poll failed.
- I am planning to add 500,000 redirects to commons and build an alternative tree of categories to
- hold the redirects instead. I am requesting permission to let the bot do that.
- To make this possible, all names in this tree will be of the form "Sanborn Fire Insurance Map of"
- instead of "Sanborn Fire Insurance Map from".
- An advertisement/notification for the "fixed and consistent with Sanborn original indexing practice" filenames will be placed in c:Category:Sanborn maps of the United States by state and in each of the 50 state categories, because 50 is not a big number.That should be sufficient for it to get noticed by anyone involved enough (i.e. using the files often) to benefit from the fix. Nowakki (talk) 16:27, 8 January 2024 (UTC)
- @EugeneZelenko I believe the request in the parent comment needs approval. Is there something you can do? Thanks. Nowakki (talk) 17:51, 9 January 2024 (UTC)
- What is usage statistics for these files? If absolute majority of them are not used, I think they should be renamed without leaving redirect. --EugeneZelenko (talk) 15:56, 11 January 2024 (UTC)
- @EugeneZelenko I believe the request in the parent comment needs approval. Is there something you can do? Thanks. Nowakki (talk) 17:51, 9 January 2024 (UTC)
- @EugeneZelenko I made a mistake during upload. a few thousand files were uploaded with a different naming scheme from the others. The volume and the year in the filename switched places. Since these files are barely a week old, they should be renamed without leaving redirects. I request permission to take care of the problem. Nowakki (talk) 09:45, 10 January 2024 (UTC)
- Please make test run. Sure, it's fine to rename without leaving redirect in such circumstances. --EugeneZelenko (talk) 15:44, 10 January 2024 (UTC)
- Have you read Commons:Bots and will you follow it? Multichill (talk) 17:44, 4 January 2024 (UTC)
- yes Nowakki (talk) 15:07, 5 January 2024 (UTC)
- @Nowakki: are you sure? Also the part "In particular, bot operators should not use a bot account to respond to messages related to the bot."? Please don't use your bot account in conversations. Multichill (talk) 11:46, 6 January 2024 (UTC)
- yes Nowakki (talk) 15:07, 5 January 2024 (UTC)
- Please do not use a bot account for manual edits, and especially not for discussions. We discuss with bot operators, not with bot accounts. --Krd 12:04, 6 January 2024 (UTC)
OsmappBot (talk · contribs)[edit]
Operator: Zbytovsky (talk · contributions · Statistics · Recent activity · block log · User rights log · uploads · Global account information)
Bot's tasks for which permission is being sought: upload images, update their description and structured data
Automatic or manually assisted: automatically triggered, when upload happens on OsmAPP.org
Edit type (e.g. Continuous, daily, one time run): when user uploads an image on OsmAPP.org
Maximum edit rate (e.g. edits per minute): 20 ?
Bot flag requested: (Y/N): N
Programming language(s): TypeScript
Note: Bot is currently in development, asking to be able to test it. Zbytovsky (talk) 19:20, 19 November 2023 (UTC)
- Discussion
- Do I get it right? Someone adds an image to osmapp and your bot will transfer it to Commons. If so, how is ensured that the license of that image is a) valid and b) meets Commons' requirements? --Achim55 (talk) 19:50, 19 November 2023 (UTC)
- @Achim55 Yes, i think you got it right. As OpenStreetMap is also a open data project, we aim to have open licenses. Please see the design of upload dialog. I tried to write it the best I can, but I welcome any suggestions. It will add images with direct link to OSM feature, which means also proper map coordinates and category (eg. castle, guidepost, school, bridge etc.) Zbytovsky (talk) 07:35, 20 November 2023 (UTC)
- And what about rejecting photos that violates Commons:Freedom of panorama? Wiki Loves Monument did not fix this obvious problem for many years. --EugeneZelenko (talk) 15:51, 21 November 2023 (UTC)
- @EugeneZelenko Well, I didn't think of that, thanks for bringing it to my attention :-) As we are a map application, it is pretty easy to inform users based on country of the object. I created a mockup here - it would show up for the "NO" countries. Do you think it is sufficient for the beginning? I don't expect many users soon, but if it turns out to be an issue, it is quite easy to be more restrictive, or eg. check if there is a building in 1km, etc. Zbytovsky (talk) 20:22, 21 November 2023 (UTC)
- It'll be OK for beginning, but will be good idea to extend database (Wikidata is perfect place to share with WLM if organizers will finally comprehend the need to do so) to include information about sculptress/architects, so it'll be possible to allow what is in public domain. There are also countries with partial freedom of panorama, where photos of buildings are allowed, but not of works of art. --EugeneZelenko (talk) 16:00, 22 November 2023 (UTC)
- Sure, I can reach out to WLM once this become an issue. Zbytovsky (talk) 19:51, 22 November 2023 (UTC)
- I think the FOP aspect should be addressed before is becomes any issue. At least all countries with partial FOP should be excluded; better all images should be manually reviewed, as even in FOP countries there will be images with works not permanently in public space. Krd 14:01, 30 December 2023 (UTC)
- Sure, I can reach out to WLM once this become an issue. Zbytovsky (talk) 19:51, 22 November 2023 (UTC)
- It'll be OK for beginning, but will be good idea to extend database (Wikidata is perfect place to share with WLM if organizers will finally comprehend the need to do so) to include information about sculptress/architects, so it'll be possible to allow what is in public domain. There are also countries with partial freedom of panorama, where photos of buildings are allowed, but not of works of art. --EugeneZelenko (talk) 16:00, 22 November 2023 (UTC)
- @EugeneZelenko Well, I didn't think of that, thanks for bringing it to my attention :-) As we are a map application, it is pretty easy to inform users based on country of the object. I created a mockup here - it would show up for the "NO" countries. Do you think it is sufficient for the beginning? I don't expect many users soon, but if it turns out to be an issue, it is quite easy to be more restrictive, or eg. check if there is a building in 1km, etc. Zbytovsky (talk) 20:22, 21 November 2023 (UTC)
- And what about rejecting photos that violates Commons:Freedom of panorama? Wiki Loves Monument did not fix this obvious problem for many years. --EugeneZelenko (talk) 15:51, 21 November 2023 (UTC)
- @Achim55 Yes, i think you got it right. As OpenStreetMap is also a open data project, we aim to have open licenses. Please see the design of upload dialog. I tried to write it the best I can, but I welcome any suggestions. It will add images with direct link to OSM feature, which means also proper map coordinates and category (eg. castle, guidepost, school, bridge etc.) Zbytovsky (talk) 07:35, 20 November 2023 (UTC)
FlickypediaBackfillrBot (talk · contribs)[edit]
Operator: Alexwlchan (talk · contributions · Statistics · Recent activity · block log · User rights log · uploads · Global account information) , working for the Flickr Foundation
Bot's tasks for which permission is being sought:
- Improving structured data for Flickr photos which have been uploaded to Wikimedia Commons, e.g. adding creator, license metadata.
- Adding the new Flickr photo ID (P12120) property to all files, to make it easier for other tools to work with Flickr photos
Automatic or manually assisted: unsupervised
Edit type (e.g. Continuous, daily, one time run): manually triggered
Maximum edit rate (e.g. edits per minute): tbc, probably 5–10 edits per second
Bot flag requested: (Y/N): Y
Programming language(s): Python
- Discussion
- Please don't make manual edits with the bot account. Please make few test edits. --Krd 14:31, 1 November 2023 (UTC)
- Interesting proposal. I made one edit to Commons:Flickypedia/Data Modeling, otherwise this looks good. Curious how you will handle conflicting existing SDC claims? --Schlurcher (talk) 17:53, 1 November 2023 (UTC)
- Good question! My general approach with these things is to be extremely conservative – imo the V1 bot should be purely additive, and any conflicts should be flagged for manual inspection.
- Then a couple of things might happen:
- The existing SDC looks wrong, so I make a manual edit from my account to fix it. e.g. I’ve already been looking at the use of source of file (P7482) for Flickr photos in the SDC snapshots, and I found ~200 cases where the URL points to the Flickr URL’s profile (
/photos/{username}
) rather than the photo itself (/photos/{username}/{photo_id}
). Those got dropped on a queue and I’ve been gradually tidying them up by hand – opening the files in question and making a manual edit from my account to point to the more specific URL. - The existing SDC looks right, so I work out why the bot is disagreeing. Is it a bug in my code, have I interpreted the data mapping wrong, is the data mapping at odds with the community approach to SDC, is the bot missing some bit of info on the Flickr photo. But the bot won't do anything on its own.
- The existing SDC looks wrong, so I make a manual edit from my account to fix it. e.g. I’ve already been looking at the use of source of file (P7482) for Flickr photos in the SDC snapshots, and I found ~200 cases where the URL points to the Flickr URL’s profile (
- There might also be cases where the existing SDC is wrong in large numbers and we'd want to write an automated fix, but that's somewhat risky and I’d want to be extremely careful before doing that. Two possible examples spring to mind:
- License versions. Flickr photos use CC 2.0 licenses, so that's what the bot will write into the SDC. But what if it finds a Wiki Commons file which links to the 4.0 version of the CC license? That sounds like an easy candidate for a fix buuuut I think there are Flickr users who leave descriptions on their photos saying "I license this as CC 4.0". A human copying their photo across would notice that; the bot might not. So in this case the bot would likely leave it as-is to avoid deleting info.
- Date granularity. Flickr has different levels of granularity for "date taken". Most photos are DDMMYY, but there are some which are MMYY or YY or "Circa YY". If there are lots of cases where there's an imprecise data but the SDC claims it's a full DDMMYY, we might consider automating that. (It's pretty obvious when this has happened – Flickr always returns a full timestamp from its API, but it sets all the unknown values to 0/1. So a YYYY becomes
taken="1950-01-01 00:00:00" takengranularity="6"
.) The bot could be written to fix these. But I don't know if that's a widespread issue in practice.
- If/when the bot does start editing existing SDC claims, I'll make sure we document those with examples – and if there are cases that seem contentious, I'll bring them back for community discussion before actually implementing them. Alexwlchan (talk) 08:13, 2 November 2023 (UTC)
- To return to this question of "how does the bot handle conflicting edits":
- Right now the bot will flag any conflicts as "unknown", not make any edits, and put them in a manual queue for review. I’ll look at them and decide if we need to update the bot code, do a manual edit to the SDC, or leave it be.
- Example: license has changed since upload to WMC
- I just ran it against File:MINDANAO BLEEDING-HEART DOVE (6939195884).jpg.
- The file on Commons has an existing copyright license (P275) = CC BY 2.0 statement
- The photo on Flickr currently has a CC BY-SA 2.0 license
- This confuses the bot, because it wants to write a different SDC statement to what’s currently in Commons – so it flags it as “unknown”.
- I went and had a look at it, and I can see that the license has changed since the initial upload – there’s a license history feature on Flickr, and it was changed from CC BY 2.0 in April 2014, a year after it was uploaded to Commons.
- (And now I'm going to look at tweaking the bot code so it gets the license from when the photo was uploaded to Commons, and uses that rather than whatever the license is now. But license is a pretty well-populated field, so I may not need this in practice.) Alexwlchan (talk) 08:22, 13 December 2023 (UTC)
- Brief addendum to this: I’m going to take license out of the bot for now.
- 1. Licenses are already pretty well-populated in SDC, so the potential gain here is less.
- 2. I’m encountering a lot of cases where Flickr users have changed their license after the fact, which makes the bot unhappy.
- It is possible to see license history on Flickr as far back as 2008, or I could inspect the Wikitext, but I’m going to leave it for now. I can come back later and see how many Flickr photos are actually missing a license in practice. Alexwlchan (talk) 14:45, 13 December 2023 (UTC)
- To add another example to this:
- If the bot encounters conflicting information in the "date taken" field, it flags a warning but doesn’t do anything.
- e.g. File:STS059-238-074 Strait of Gibraltar.jpg is a photo which was posted to both Flickr and a NASA website. On Flickr the taken date is "April 1994", but on NASA's website we get the more precise date "17 April 1994", which is what's used in the SDC.
- Flickypedia would write a statement "April 1994" if it was copying the photo fresh from Flickr, but it doesn't overwrite the existing, more-precise statement when it does the backfill. Alexwlchan (talk) 11:02, 15 December 2023 (UTC)
- Interesting proposal. I made one edit to Commons:Flickypedia/Data Modeling, otherwise this looks good. Curious how you will handle conflicting existing SDC claims? --Schlurcher (talk) 17:53, 1 November 2023 (UTC)
- 👍 I’ll probably get to making some test edits early next week, and I’ll link them here for inspection when they’re done. Alexwlchan (talk) 07:46, 2 November 2023 (UTC)
- I know it’s been a couple of weeks and nothing has happened on this.
- I am planning to get back to this bot eventually, but right now I’m prioritising getting the “uploader” part of Flickypedia working. Once that’s done, I’ll come back to the Backfillr bot. Alexwlchan (talk) 09:47, 23 November 2023 (UTC)
- I left some comments about the data model at Commons_talk:Flickypedia/Data_Modeling#Some_feedback_based_on_User:GeographBot. Where can we find the source code? The bot I mentioned is at https://github.com/multichill/toollabs/blob/master/bot/commons/geograph_uploader.py . Multichill (talk) 20:52, 16 November 2023 (UTC)
- Thanks for your feedback on the model; I’ll address that there.
- The source code isn’t public yet, but by the time we run the bot properly (and probably before I have time for test edits) it’ll be available here: https://github.com/Flickr-Foundation/flickypedia Alexwlchan (talk) 09:49, 23 November 2023 (UTC)
- I Oppose this bot request until two concerns are addressed:
- Source code should be published.
- Logic for looking up Wikidata items based on Flickr user ID (P3267) is removed (details on Commons talk:Flickypedia/Data Modeling)
- Multichill (talk) 19:50, 18 December 2023 (UTC)
- 1. Fixed! Sorry, this slipped my mind – I had a README and documentation all sorted so I could make it public, but never actually hit the button. 😅
- 2. I’ll reply to that on the other thread. Alexwlchan (talk) 09:04, 19 December 2023 (UTC)
- I Oppose this bot request until two concerns are addressed:
- Test edits are done! You can see some examples of the bot's changes here:
- File:Neasden Temple - Shree Swaminarayan Hindu Mandir - Power Plant.jpg
- File:Traditional vessel (Stone Town).jpg
- File:TimesSquare-500px.jpg
- File:Rfid implant after.jpg
- File:Bryn Athyn Cathedral - Pennsylvania (4825981267).jpg Alexwlchan (talk) 08:08, 13 December 2023 (UTC)
- Thanks for doing the test edits. Content looks good. I only have technical comments.
- Please combine these four edits into one: [1]
- If you use a JSON data specification this can be done by simply merging all the different claims.
- Please tag the edits with "BotSDC" as lots of user use this tag to filter out SDC edits
- If you use a JSON post request this can be done by adding
{ "tags", "BotSDC" }
- Please make sure you specify a maxlag for your edits as this got me into trouble once and avoid database overload
- If you use a JSON post request this can be done by adding
{ "maxlag", "2" }
- In the edit summary, please link the phrase structured data to
[[Commons:Structured data|structured data]]
or this bot request so users can find out more if needed.
- I would appreciate if you could perform another set of bot edits that incorporate this. --Schlurcher (talk) 08:46, 13 December 2023 (UTC)
- Thanks for the quick feedback! I’ve addressed all four of your suggestions.
- 1. Done, duh. For some reason I got it into my head that you can’t modify multiple properties at once, but I think that’s just a limitation of the visual editor? API seems fine with it, so that’s changed.
- 2. Done.
- 3. Done. I’m also planning to drop a note to somebody who works on the structured data team before I start running the bot at large scale, as a courtesy – backfilling Flickr data means 10s of millions of new statements, and I figure it’ll be easier if they have a direct line to the person adding database load.
- 4. Done. I’ve also added the property IDs, which I figured might be useful.
- Some more test edits:
- https://commons.wikimedia.org/w/index.php?title=File:Bolle_med_rygeost_(5080938528).jpg&diff=prev&oldid=830338946
- https://commons.wikimedia.org/w/index.php?title=File:%C5%81ukasz_Simlat_2013.jpg&diff=prev&oldid=830339027
- https://commons.wikimedia.org/w/index.php?title=File:2x_F-16CJ_91-352_%26_91-366_(6843244831).jpg&diff=prev&oldid=830339160
- https://commons.wikimedia.org/w/index.php?title=File:Restaurant_Kiin_Kiin_Sukkerr%C3%B8r_med_lime_(6200226667).jpg&diff=prev&oldid=830339211
- Alexwlchan (talk) 12:39, 13 December 2023 (UTC)
- Thanks. No further comments from my end. My database issue was described here [2] and as I learned, as long as we respect maxlag it should be fine. As I've myself added 100s of millions of statements, I would not be too concerned about this request. Contrary, I think it is an excellent addition to improving SDC use. --Schlurcher (talk) 13:27, 13 December 2023 (UTC)
- Thanks for doing the test edits. Content looks good. I only have technical comments.
Please summarize: Have all issues been addressed? --Krd 04:28, 21 December 2023 (UTC)
- @Alexwlchan: ? --Krd 13:57, 30 December 2023 (UTC)
MappeComuniBot (talk · contribs)[edit]
Operator: Sette-quattro (talk · contributions · Statistics · Recent activity · block log · User rights log · uploads · Global account information)
Tasks: Upload up-to-date maps of Italian municipalities. There are about 8000 municipalities, boundaries are updated yearly by the national statistical agency. Here is an example of image that will be uploaded, the description will be automatically updated for each municipality: [3]
Bot's tasks for which permission is being sought: upload several images automatically
Automatic or manually assisted: automatic supervised (through OpenRefine)
Edit type (e.g. Continuous, daily, one time run): One time run each year
Maximum edit rate (e.g. edits per minute): I don't know the edit rate allowed using the new OpenRefine function for uploading images. As fast as it can, i suppose.
Bot flag requested: (Y/N): Y
Programming language(s): used through OpenRefine Batch Uploading https://www.youtube.com/watch?v=sc6aNNmsNCI
Sette-quattro (talk) 16:03, 20 October 2023 (UTC)
- Discussion
- Please make test run. --EugeneZelenko (talk) 15:34, 22 October 2023 (UTC)
- Done a test run Sette-quattro (talk) 21:10, 1 November 2023 (UTC)
- Looks OK for me, but please fix space in Category: Maps of municipalities of the province of Monza and Brianza. Will be good idea to create templates for legend and data source. --EugeneZelenko (talk) 15:01, 3 November 2023 (UTC)
- Ok, I will create the two templates. Thank you and best regards. Sette-quattro (talk) 09:16, 8 November 2023 (UTC)
- Why have more than 1000 edits been done before the request is approved and the bot flag is applied? Krd 13:56, 30 December 2023 (UTC)
- Ok, I will create the two templates. Thank you and best regards. Sette-quattro (talk) 09:16, 8 November 2023 (UTC)
- Looks OK for me, but please fix space in Category: Maps of municipalities of the province of Monza and Brianza. Will be good idea to create templates for legend and data source. --EugeneZelenko (talk) 15:01, 3 November 2023 (UTC)
GlaMainBot (talk · contribs)[edit]
Operator: Beao (talk · contributions · Statistics · Recent activity · block log · User rights log · uploads · Global account information)
Bot's tasks for which permission is being sought: I've automated lossless crops for Category:Images from the German Federal Archive with borders and need permission to start uploading the results.
Automatic or manually assisted: Manually assisted to start.
Edit type (e.g. Continuous, daily, one time run): One time run for uploads, otherwise daily for my listing of User:GlaMainBot/Most_used_images_for_cleanup
Maximum edit rate (e.g. edits per minute): At most ten uploads per minute.
Bot flag requested: (Y/N): Y
Programming language(s): TypeScript (using mwn)
Beao 07:49, 23 September 2023 (UTC)
- Discussion
- Just to clarify: Is this to upload as a new version, or to overwrite? If the latter, is there a consensus to do so? I see that those borders include photo credits to the individual photographers, and these are from a respected archive, so I'd just want to make sure that there is agreement that this is desired; I've seen similar situations go either way. Clearly more useful in Wikipedia articles without the borders, but it's not clear to me that we don't want also to host a version with the credit line on the image. - Jmabel ! talk 23:58, 1 October 2023 (UTC)
- My thought is to overwrite. I've not seen any written consensus on the matter, but in practice that's what has been done for years in this category. I think that implies a silent consensus, considering these captions have been digitally added by the archive and provide no additional information not already in the description. Beao (talk) 08:36, 2 October 2023 (UTC)
- Please make some example edits. Krd 17:06, 6 October 2023 (UTC)
- All right, here are three examples:
- File:Bundesarchiv Bild 137-068842, Sonderzug der Einwandererzentralstelle.jpg
- File:Bundesarchiv Bild 137-068843, Sonderzug der Einwandererzentralstelle.jpg
- File:Bundesarchiv Bild 137-068852, Sonderzug der Einwandererzentralstelle.jpg Beao (talk) 10:55, 7 October 2023 (UTC)
- Looks good to me. Krd 13:49, 11 October 2023 (UTC)
- Please make some example edits. Krd 17:06, 6 October 2023 (UTC)
- Any more information or discussion needed? Beao (talk) 12:22, 14 October 2023 (UTC)
- [4] Why is this updated so often? Krd 03:04, 19 October 2023 (UTC)
- The "Images with watermarks" category is very big, so the retrieval of file usage statistics is batched to a fixed number of images every hour to avoid performance spikes, and I update the gallery after every batch. Is updating gallery pages too often problematic? I could do it less often (I'm thinking if images are not removed from the category), and also avoid doing it when nothing changes. Beao (talk) 15:53, 20 October 2023 (UTC)
- Please at least don't update when nothing significant changes. Krd 07:42, 21 October 2023 (UTC)
- The "Images with watermarks" category is very big, so the retrieval of file usage statistics is batched to a fixed number of images every hour to avoid performance spikes, and I update the gallery after every batch. Is updating gallery pages too often problematic? I could do it less often (I'm thinking if images are not removed from the category), and also avoid doing it when nothing changes. Beao (talk) 15:53, 20 October 2023 (UTC)
- [4] Why is this updated so often? Krd 03:04, 19 October 2023 (UTC)
- Are Special:Diff/826638942 and Special:Diff/826649450 useful edits? --Krd 06:32, 1 December 2023 (UTC)