Commons:Tools: Difference between revisions
→Python Wikipedia Bot: edit sample |
→Python Wikipedia Bot: bot option |
||
Line 145: | Line 145: | ||
=== Python Wikipedia Bot === |
=== Python Wikipedia Bot === |
||
The python framework includes various file upload tools. These tools require installing python and the pywikibot framework. |
The python framework includes various file upload tools. These tools require installing python and the pywikibot framework. |
||
For detailed information on its usage: |
For detailed information on its usage: |
Revision as of 14:15, 11 April 2010
![](https://cdn.statically.io/img/upload.wikimedia.org/wikipedia/commons/a/a9/Crystal_Clear_action_configure.png)
This page contains a collection of tools and services to simplify, make more efficient, or provide additional functionality to the work with Wikimedia Commons. Some of the tools here are optionally directly integrated within the Wikimedia Commons web interface. If you want to know how to play back and view contents of Wikimedia Commons have a look at the media help page. If you are in search for software editing and creating media files have a look at our software page.
Organize media
CommonSense
CommonSense is a web based tool for finding appropriate categories for images on Commons. This tool uses the live database copy on the Wikimedia tool server and is developed and maintained by User:Duesentrieb.
OrphanImages
OrphanImages is a web based tool for finding images that are not on a gallery page or in any category. This tool uses the live database copy on the Wikimedia tool server and is developed and maintained by User:Duesentrieb.
UntaggedImages
The UntaggedImages tool helps to find images that are missing a license tag. This tool uses the live database copy on the wikimedia tool server and is developed and maintained by User:Duesentrieb.
GeocodingToDo
GeocodingToDo Tool categorized images not yet geocoded.
- tools:~para/GeoCommons/geocodingtodo.php — web frontend
Bad Old Ones
Bad Old Ones lists images in a given category (and subcategories) with dates of their last edits, thumbnails, description, and usage on other Wikimedia projects. Intended for categories containing "bad" images, e.g. Category:Unknown. Developed by User:Magnus Manske.
- tools:~magnus/bad_old_ones.php
- Example: //toolserver.org/~magnus/bad_old_ones.php?category=Images%20with%20unknown%20source%20as%20of%20unknown%20date%202006
Commons sum-it-up
This tool can "summarize" articles from Wikipedias connected via interlanguage links by putting the initial paragraph of each article into a language template. Also finds missing interlanguage links. Developed by User:Magnus Manske.
LicenseToKill
![](https://cdn.statically.io/img/upload.wikimedia.org/wikipedia/commons/thumb/0/0d/Licensetokill-0.1.jpg/100px-Licensetokill-0.1.jpg)
This tool provides a simple GUI to allow easy deletion of multiple files within one category or from a list. Only for Windows with .NET 2.0. Developed by User:Dake.
Add information
Analyze the free-text description of an image and try to fit it into a standard {{Information}} template. Developed by Magnus Manske.
My "No Information"
Finds all images not using {{Information}} for a specific user. Invokes Add information.
ComDel
An edit button generator for keep/delete "votes".
What is that?
Get an image description in multiple languages from thumbnail texts.
Search
Default search is Special:Search (no gallery display). You can search for files by filename, at Special:Newimages; the order is from newest to oldest (by upload date).
CatScan
You can't put in any keywords, but has a useful display of images within a certain category, with or without a certain template, uploaded by a certain user, etc. Developed by User:Duesentrieb.
- //toolserver.org/~daniel/WikiSense/CategoryIntersect.php?wikilang=en&wikifam=commons.wikimedia.org
CatScan 2
Allows to search for images with or without one or several categories, with or without a certain template, etc. (User:Magnus Manske)
OggSearch
Search for audio and video. Search on size, length, category and media type. Developed by User:Bryan.
Find & compare duplicates
Find Wikipedia/Commons dupes
Tool for finding local Wikipedia files which are also uploaded to Commons. It can be used to add NowCommons tag to them.
Find individual Wikipedia or Commons dupes
Tool to find images at Commons or individual wiki which are uploaded more than once
UserDupes
Find all duplicate images uploaded by a single user. Checks for image dimensions and file size only! This might lead to false duplicates. Will be updated as soon as MediaWiki supports file checksums.
Commons Dupes
Compare images marked as duplicates. Developed by User:Magnus Manske.
- tools:~magnus/commons_dupes.php
- Example: //toolserver.org/~magnus/commons_dupes.php?category=Duplicate ({{Duplicate}})
- Also: //toolserver.org/~magnus/commons_dupes.php?category=Incorrectly%20named ({{Bad name}})
Got source?
Find (deleted) duplicates on other projects. Especially useful for finding deleted NowCommons images on other projects which were transferred with insufficient information.
Upload media
![](https://cdn.statically.io/img/upload.wikimedia.org/wikipedia/commons/thumb/e/ea/Commonist_screenshot.png/220px-Commonist_screenshot.png)
Commonist is a Java program for easy upload of larger numbers of images to Wikimedia Commons and other MediaWiki installations.
- http://djini.de/software/commonist/ — download page (no download necessary with Java Web Start installed)
- Information and discussion
File upload service script
A simple Perl script for uploading large numbers of files with metadata to Commons. It was developed by User:Eloquence. It is not actively being updated, but please report bugs to him by email.
Uploading from Flickr
There are various tools to help upload files from Flickr.
- Flickr upload bot - The standard upload bot. Makes uploading with all the correct info much easier.
- Flickr2Commons - This one is faster than the main Flickr upload bot (which can move really slowly occasionally and takes more clicks as it requires you to edit the image page), however a TUSC login is needed here and it adds a bunch of useless and redundant categories (but this one automatically adds geolocation information).
- FlickrLickr - A collaborative vetting process for selecting free (Creative Commons CC-BY) photos from Flickr, improving their metadata, and uploading them to Commons. No longer maintained and no new accounts will be created.
- Flinfo - For people who want to upload Flickr pictures by themselves.
Flickrripper is a free Python program for easy upload of large numbers of images from Flickr to Wikimedia Commons. The program is part of Pywikipedia and is currently in pre-alpha state.
Nichalp's upload script
![](https://cdn.statically.io/img/upload.wikimedia.org/wikipedia/commons/thumb/0/0d/Nichalp_upload_script_icon.svg/100px-Nichalp_upload_script_icon.svg.png)
A Perl script that creates a CSV file with the list of photographs in a folder. Enter all information, such as description, licence, category, latitude, longitude and so on. Also embeds certain Exif data to the photograph such as GPS data, name, licence etc. In addition, you can also rotate and rename it on-the-fly.
Commons Helper
This page will generate code that you can copy and paste when moving an image from a Wikipedia to Commons. Note that you still need to verify the source and only transfer images that have reasonable licenses. You also still need to give the image a category, although the assistant is hooked up to CommonSense, so it can suggest them at the same time. Developed by User:Magnus Manske.
Push for Commons
As a "push for Commons", push images from local Wikipedias to Commons, find copyright violations, bad or missing license tags, and images on both local wikipedia and commons. Developed by User:Magnus Manske.
Python Wikipedia Bot
The python framework includes various file upload tools. These tools require installing python and the pywikibot framework. If each upload is checked prior to upload (see verifyDescription option below), it isn't considered a bot.
For detailed information on its usage:
- http://meta.wikimedia.org/wiki/Using_the_python_wikipediabot
- http://www.sourceforge.net/projects/pywikipediabot - Project page
To login with this tool, your configuration file needs the following settings.
family='commons' mylang='commons' usernames['commons']['commons'] = 'nick' use_api_login = True
Usage:
- Upload.py - to upload files to Commons.
- Imagecopy.py - Image transfer in local wiki to Commons.
- Nowcommons.py - Image delete in local wiki already in Commons.
# -*- coding: utf-8 -*-
import wikipedia, upload, sys
import config
def complete_desc_and_upload(filename, pagetitle, desc, date, categories):
#complete this once if applies to all files
description = u"""{{Information
|Description = {{en|1=""" + desc + """}}
|Source = <!-- if applicable: {{own}} --->
|Author = <!-- your name: --->
|Date = """ + date + """
|Permission =
|other_versions =
}}
== {{int:license}} ==
<!-- your license --->
""" + categories + """
[[Category:Taken with camera 123]]
"""
url = filename
keepFilename=False #set to True to skip double-checking/editing destination filename
verifyDescription=True #set to False to skip double-checking/editing description => change to bot-mode
targetSite = wikipedia.getSite('commons', 'commons')
bot = upload.UploadRobot(url, description=description, useFilename=pagetitle, keepFilename=keepFilename, verifyDescription=verifyDescription, targetSite = targetSite)
bot.upload_image(debug=True)
def main(args):
#list each file here
filename = """testimage-1.jpg"""
pagetitle = """testimage-1-from asdfasdfa.jpg"""
desc = """Mount St Helens viewed from ... in the rain"""
date = "2010-04-07"
categories = """[[Category:Locality]]
[[Category:Theme]]
[[Category:View type]]
[[Category:Feature1]]
[[Category:Feature2]]"""
complete_desc_and_upload(filename, pagetitle, desc, date, categories)
#sample with: - local file name identical to file name at Commons
# - date as previous file
# - less quotes (no CR or " in fields)
filename = "testimage-2.jpg"
pagetitle = filename
desc = "Mount St Helens as seen from ... at sunset"
categories = "[[Category:Locality]] [[Category:Theme]] [[Category:View type]] [[Category:Feature1]] [[Category:Feature2]]"
complete_desc_and_upload(filename, pagetitle, desc, date, categories)
if __name__ == "__main__":
try:
main(sys.argv[1:])
finally:
wikipedia.stopme()
For other tools based on pywikipediabot, see multichill/bot
Content navigation
Check-Usage
Check-Usage is a web based tool which can be used to check where commons media is used throughout the Wikimedia universe. Also it is able to find "local" duplicates to Commons media. This tool uses the live database copy on the Wikimedia tool server and is developed and maintained by User:Duesentrieb.
- tools:~daniel/WikiSense/CheckUsage.php — web frontend, recommended and fast version
- http://www.juelich.de/avatar/check-usage/ — web frontend, outdated and slow version by User:Avatar not running at the Wikimedia tool server and not checking all wikis
- Information and discussion
Category-Tree
CategoryTree is a tool for showing the category structure as a dynamic tree. This can also be integrated into most browsers as a sidebar. This tool uses the live database copy on the Wikimedia tool server and is developed and maintained by User:Duesentrieb.
- tools:~daniel/WikiSense/CategoryTree.php — web frontend, recommended up to date version
- Information and discussion
- additionally see the (German language only) information page for the old tool at "Verzeichnisbaum" meta page
Cat-Scan (or CategoryIntersect)
Allows you to find images (images are a type of 'page') that are in two categories (category intersection), or images in a category by a certain template. It also searches in subcategories of a specified depth (although it fails at 1000 items).
- Information and discussion
- //toolserver.org/~daniel/WikiSense/CategoryIntersect.php?wikilang=en&wikifam=commons.wikimedia.org
Commons Sum-it-up
Sum-it-up will try to automatically gather brief descriptions as well as all the interwiki links for a particular topic (use it on article/gallery pages). All you need to know is the name of the corresponding article on a Wikipedia. You can usually copy and paste its output straight into the article page, although be sure to remove any strange descriptions that didn't come out quite right. Developed by User:Magnus Manske.
CoCat
Useful for those who like tidying categories. Goes through a category and lists which other categories co-occur with it. Good to use on high-level categories to identify redundant categories (such as listing an image in Category:Paris and Category:France).
- Information and discussion (German or English)
- //toolserver.org/~voj/cgi-bin/cocat%3Fwikilang%3Den%26wikifam%3Dcommons.wikimedia.org%26cat%3D
giùlemani
An alternative Check-Usage tool that does not work on the toolserver and thus may be useful when the toolserver is down. Developed by User:ColdShine. Interface in English and Italian.
Pictures of the Day
Collects the Commons', English Wikipedia's and German Wikipedia's Pictures of the Day (POTD) on one page, with convenient links to common screen resolution sized versions. Developed by User:Duesentrieb.
CommonsPictureOfTheDay
Sets Commons Picture of the day [dead link] automatically as your desktop wallpaper daily.
A JavaScript plugin that displays geocoded images on a world map. Developed by User:Dschwen.
CatFood
A category-based RSS feed by Magnus Manske. Shows thumbnailed image, author/uploader, and license (if found). Links back to commons image/page.
- tools:~magnus/catfood.php
- //toolserver.org/~magnus/catfood.php?category=Featured_pictures (Feed for Category:Featured pictures)
Flommons
A Flickr-like interface for Commons. No upload, yet.
Patrolling and notification
Gallery
The Gallery tool shows a list of images with information about their tagging and categorization status. It can be used to patrol recent uploads as well as to look at the upload of a given user. It is designed to help you spot any unlabeled, mislabeled or orphan images quickly and easily. Developed by User:Duesentrieb.
- tools:~daniel/WikiSense/Gallery.php (uploads until two hours ago) (Duesentrieb's uploads)
- Information and discussion
CommonsTicker
CommonsTicker is a bot that notifies individual wikis about changes on Commons that affect them: for example, if an image is marked for deletion, CommonsTicker can warn projects that are using that image. This is intended to improve the integration of commons into "local" projects. Developed by User:Duesentrieb.
ActiveUsers
ActiveUsers finds active admins, filtered by language (babel boxes). This is intended to help users to find an admin to talk to. Developed by User:Duesentrieb.
DeletedImage
Given an image sha1, provides a list of deleted images and the reasons.
Optional numeric parameter base (2>=base>=36, default: 16) for the hash. Optional parameter wiki: a comma split list of databases to check.
- //toolserver.org/~gmaxwell/cgi-bin/deletedimage.py?hash=03afdae8ee8c897b0a320a6c3192a0b7310558b92
New images
New Images is a tool used to patrol the latest uploaded files. With that tool, you can have a quick overview of the latest 50 images (but you can decide to go on and check also the older ones...) so you need less time to patrol a great amount of images. This tool is developed by User:Filnik.
Twinkle
Twinkle is a set of JavaScripts that gives registered users several new options to assist them in common maintenance tasks and to help them deal with acts of vandalism.
New images checker
New Images checker is a tool used to patrol the latest uploaded files, check similar images via Tineye. see User:Sz-iwbot/tineye.
See also
- Tool integration (direct integration of some of the tools into the web interface of Wikimedia Commons)
- List of software for working with files on Commons
- Media Help for playback of Commons media files
- Information about the toolserver hosting most web based tools
- Toolserver table of contents (human-maintained)
- Category:User scripts to for useful JavaScript/CSS tricks, like installing one-click "mark as no source/mark as no license/nominate for deletion" links
- Orgullomoore's scripts. A few python scripts for tasks performed by Orgullobot (based on pywikipedia).