WikiProjectMed talk:Translation task force/Weekly reports

From WikiProjectMed
Jump to navigation Jump to search
Translation done as part of the WPM translation taskforce in 2023.

For 2023 we received a grant of 4,000 USD from the WMF to improve the translation dashboard (ID: 22008517). All funds received went to paying our programmer User:Mr. Ibrahem.

As a result of this work not only did we improve the functioning of the tool in question but were able to significantly increase translations. In 2022 we saw work by 17 users, who created 597 articles composed of 125,875 words, with work carried out in 14 languages which garnered 206,000 pageviews. In 2023 we had 49 users, who created 1,062 articles composed of 217,696 words, with work carried out in 32 languages which garnered 927,212 pageviews.

Some of the highlights include:

  • moving the backend data to a database
  • allow various "campaigns" to be created
  • adding extra tools for coordinators
  • creating graphs of translations over time
  • adding real-time pageviews
  • improving the tools that automatically adjust translation post publication (like moving punctuation and the naming of months within references)
  • integrating Wikidata items into the process
  • improve the workflow for articles in process of being translated to prevent multiple people from translating the same content
  • collected information on our prior volunteers and impact to allow us to reinvite them to join the new workflow
  • create a mobile friendly version of the tool
  • calculate the impact of our collaboration with WHO around essential medicines (a paper on the topic may be worked on eventually)
  • convert some of the underlying code from Python to PHP and replace deprecated software
  • keep OAuth functioning
  • The Cure Award was distributed to all involved translators

In summary we surpassed the goals we set of doubling the number of translators, pageviews for the material translated, languages worked in, and total translations completed. And we meet our target of calculating our prior impact back to 2021. We managed to onboard a number of translators from outside our movement with more work planned in this area in 2024. A full overview of work in 2023 can be found below.

Nov/Dec 2023

Here is a list of the most prominent works I did during the months of November and December:

  • Toolforge Grid Engine deprecation:
    • Replace deprecated “Grid Engine” by "toolforge jobs" #56
    • Rewrite Python codes in PHP programming language to copy articles text from mdwiki.org to en.wikipedia.org (replace short reference tags, remove some maintain templates, etc …)
  • TD:
    • Use stable and its up-to-date version of MediaWiki/OAuthClient login library instead of OAuthHelloWorld in translation dashboard and Mass Uploader. to improve security and reliability. link
    • Remove "#unlinkedwikibase" when copy text to enwiki. (example)
    • Added language filter functionality for displaying recent translations in the coordinator tools.
    • Create WikiData items for some articles that are missing QIDs and link them to MDWiki.
    • Created a new Coordinator Tool (Translate Type) to allow full translation of some articles, and display those articles in the table of translatable articles, with correct of word counts and references:
      • Splitting articles by Campaigns categories in Translate Type Coordinator Tool, to make them easier to handle and edit.
      • full articles will be copied to title like: User:Mr. Ibrahem/WHO AWaRe/full.
  • NcCommons:
    • https://www.atlasdermatologico.com.br :
      • Implemented a web scraping functionality for collecting and saving images and information from a dermatological atlas.
      • Added a script to upload scraped data to a specified website, including creating categories and uploading images.
      • Create (category, Imagestack page) for each disease
      • Category:Atlasdermatologico
    • https://openpress.usask.ca/undergradimaging/
      • extract the images from Undergraduate Diagnostic Imaging Fundamentals.
      • Create (category, Imagestack page) for each chapter
      • Category:UndergradImaging
  • AWaRe classification:
    • added 2023 ‎AWaRe classification‎ as reference to all items.
  • Crop Tool
    • Mass Uploader:
    • check existing files
    • handle errors
  • Mdwiki.org:
    • added tag {{#unlinkedwikibase:id=}} to all articles
    • update the number of medical articles by language: here
  • Property:P11143
    • added property:P11143 for all mdwiki.org articles at wikidata. link
  • ToolForge python files:
    • Introduced new scripts for managing Wikidata identifiers and correcting database conversions. link

Oct 2023

WHO essential medicines

TD:

  • Added an "Uncategorized" option in the project dropdown menu.
  • Enhanced user registration by including registration date in the database.
  • Implemented user logging functionality to track new users.
  • Updated SQL queries across multiple files to use parameterized queries and prepared statements, significantly reducing the risk of SQL injection attacks.
  • fix an issue that does not display words for some articles.
  • fix an issue in views happening when the translated title is the same in different languages.
  • AWaRe classification:
  • match wikidata items for Property:P12081 and added the claims. List.

Others:

  • Fixed a bug when expanding some infoboxes like Special:diff/1369664.
  • wrote code to find all articles affected by this bug. result.

Crop Tool

  • updated the visual styling of the crop tool for a more intuitive user experience.
  • create Mass NC Commons Upload.

Sep 22, 2023

Create Prior List leaderboard: https://mdwiki.toolforge.org/prior/index.php

  • Link from prior/index.php to here User:Mr._Ibrahem/priorviews and link from Translation_Dashboard/leaderboard.php to here prior/index.php

Edits in TD:

  • Link to our new dashboard and leaderboard in https://mdwiki.toolforge.org/prior/index.php
  • Display at least 200 row in https://mdwiki.toolforge.org/prior/index.php?lang=es
  • column like #{{#target:User:XXX|YY.wikipedia.org}}
  • Graph of the number of translations per month, done in leaderboard.php
    • Add last month to the graph in Grey since it is not over yet.
    • change graph to match all leaderboard results, not only general statistics.
  • Talk link in In process table
  • trim template like 'about', 'redirect'.
  • Default campaign control in Coordinator Tools.
  • Apply multiple multiple categories / campaigns to a single article
  • Campaigns in leaderboard now based on articles categories.

Code to make changes in es articles (dates, templates, params)

  • fix es dates and templates params.
  • moves refs to the bottom.
  • added template Traducido ref.

Aug 3 2023

count articles translated by Translation Dashboard in User:Mr. Ibrahem/priorviews/bylang subpages.

fix issue in ncommons crop tool.

fix an issue that happened in page views, and was reported by user:Ozzie10aaaa.

med updater:

add function to change chembox to drupbox.

add function to format infobox medical condition and any template in the lead.

add function to “fixwikirefs.php” tool to fix dates in ptwiki within any param.

Translation Dashboard will open (Section translation) in mobile, and make some Improving mobile on the dashboard.

wrote code to find niosh citations that used in english wikipedia.

create User:Mr. Ibrahem/priorviews/translators report.

Jun 30 2023

page views by title for each section (example Emergency_medicine)

total views by language in one table in priorviews/bylang (The words were added later)

Create a page for each language that includes pageviews and words count and number of translations for each article and overall (example Arabic)

added total translations, total pageviews, total words and enwiki pageviews to priorviews

fix an issue that didn’t displays views for some Ozzie10aaaa translations. like Dutastéride and Léflunomide .

Fix an issue in Normalize references tool.

Added function to move lay source params to “Template:lay source”.

Created bot to generate titles to avoid errors like: (missing or empty |title=) in “Template:lay source”. (example) and also for other citation templates.

May 23 2023

Working in the prior list to get old versions of english pages to improve the results.

Made an update to the med updater tool to fix some issues that happened in params contains (=) like SMILES, and started using stable python packages.

Added autocomplete script to tools like (Med updater, Create redirects, Import history, Fix redirects, Normalize references).

Started using Python 3.10 instead of the default toolforge version 3.7.3 to avoid many errors that occur while processing wikitexts and connecting to databases.

Fix issue in “redirect importing tool”, it was importing user subpages like: User:Tamanna1510/sandbox.

Fix issues that did not display word counts and views of some articles in the leaderboard, e.g. Ozzie10aaaa.

Wrote a code to send emails via Google applications to the fix emails issue.

Fix the “Send me copy” issue in the new email code.

Remove line breaks between the navboxes and the categories in medupdater tool.

Apr 17 2023

Create wikidata items for mdwiki.org titles that dosen’t have items.

Fix some error that appear when translate to “or”

Add button to translate the in progress ones.

Improve med updater bot.

Remove title in process from translations list for 1 week.

Move and delete all categories created by “Fæ” from mdwiki.org to nccommons.org

Added task to looks for edits as well alongside with Content translation tags when it’s looks for new translations.

Create report of an old translations has been done in partnership with Translators Without Borders in User:Mr._Ibrahem/prior.

Make some tools from "Coordinator Tools" visible to everyone.

Added task to track WikiProjectMed ID property in wikidata items, it’s check the value if the title in mdwiki.org has moved to new title, and add missing one.

Added task to track wikidata items if moved to new ids.

Feb 28 2023

Uploaded all code to github so in case something happens or the internet goes down. This include Translation Dashboard and all its related code, and twitter code, crop tool, and every thing else.

Feb 13 2023

  • Fix issue some users not appear in leaderboard and Emails tab.
  • Created outlook email and use it to send messages to users from the tool.
  • Added tab in coordinator tools to display recent translations in process next to the previous tab showing the total number of pending translations.
  • Included zhwiki dots like (。) and coma (,) in fixwikirefs.php
  • Created fixwikirefs options page to choose which language need to (Move dots after references, Expand Infobox, add |language=en)
  • lining up the equal signs when expanding infoboxes
  • Added link to Fix references in recent translations
  • Added a function to modify the month names from EN to PT in fixwikirefs tool

Jan 22 2023

Ibrahem
  • add punctuation moving in fixwikirefs.php
  • display the leaderboard based on campaign, translators, year, with the ability to choose any of them separately or in combination
  • add tab for campaigns status in Coordinator tools
  • add option to control type of translates in Coordinator tools
  • add tool to “expend infobox” in fixwikirefs.php
James
  • Onboarding of WHO/CDC/NIOSH and setting them up to use our dashboard.[1]

Jan 10 2023

  • All WikiProjectMed Tools pages have been updated to Bootstrap 4 to look better in mobile and other devices
  • Fix api limits for some users that affect category members
  • add depth option in coordinator tools for campaigns
  • New tabs in Coordinator tools:
    • Translations in process
    • Add new translations
    • Emails tab
    • Projects tab
    • Coordinators tab to control tool coordinators
    • Fixwikirefs
  • New columns in emails tab:
    • Total number of live translations, Project, and wiki
  • Upgraded the Translation Dashboard to the last stable bootstrap 5.2
  • Expands the list of most recent translations to 100 items displayed by 25 rows
  • fix OAuth login

Dec 29 2022

Ibrahem
  • Move translate button before "Pageviews" column
  • Default ordered by pageviews
  • Replace category input by campaigns dropdown list
  • Add coordinator tools to control Translation campaign and incoming tools
  • Add most recent translation list in coordinator tools
  • Leaderboard by "campaign"
  • Upgraded the tool from bootstrap3 to bootstrap4
  • real time pageviews in leaderboard
  • add email button to send message to users contain last translation information and pageviews and suggest new translation
James
  • Work in Pl to get the cite template data to function
  • Building compatibility between the infobox disease templates
  • Onboarding three new translators (Es, Pl, and Sq)

Dec 22 2022

Ibrahem
  • Fix language codes dropdown list
  • Improved display of tables in the leaderboard and missing pages
  • Move the translate column to right after the title column, shorten "Lead words" to simple "Words" And lets shorten "Lead references" to simple "Lead refs"
  • Repairing views and using databases to store and update them on a daily basis
  • Adding a column for views for the last 30 days from the English Wikipedia updated weekly
  • ​Fix mdwiki redirect issue like Monkepox and Mpox
James
  • Met with Pau Giner to discuss better coordination between our dashboard and CTX2
  • Coordinating with ProZ via Slack