⚓ T308138 Deploy "add a link" to 13th round of wikis
Page Menu
Phabricator
Create Task
Maniphest
T308138
Deploy "add a link" to 13th round of wikis
Closed, Resolved
Public
Actions
Edit Task
Edit Related Tasks...
Create Subtask
Edit Parent Tasks
Edit Subtasks
Merge Duplicates In
Close As Duplicate
Edit Related Objects...
Edit Commits
Edit Mocks
Mute Notifications
Protect as security issue
Assigned To
Sgs
Authored By
Trizek-WMF
May 11 2022, 2:25 PM
2022-05-11 14:25:38 (UTC+0)
Tags
Add-Link-Structured-Task
(Backlog)
Machine-Learning-Team
(2023-2024 Q3 Done)
Growth-Team (Sprint 0 (Growth Team))
(Test in Production | Watching)
User-notice-archive
(Backlog)
Referenced Files
None
Subscribers
Aklapper
kevinbazira
kostajh
MGerlach
Sgs
Trizek-WMF
Description
Training models
Novial Wikipedia nov
N'Ko Wikipedia nqo
Nouormand Wikipedia nrm
Northern Sotho Wikipedia nso
Navajo Wikipedia nv
Nyanja Wikipedia ny
Occitan Wikipedia oc
Livvi-Karelian Wikipedia olo
Oromo Wikipedia om
Oriya Wikipedia or
Ossetic Wikipedia os
Punjabi Wikipedia pa
Pangasinan Wikipedia pag
Pampanga Wikipedia pam
Papiamento Wikipedia pap
Picard Wikipedia pcd
Pennsylvania German Wikipedia pdc
Palatine German Wikipedia pfl
Pali Wikipedia pi
see
T308138#8708597
Norfuk / Pitkern Wikipedia pih
Piedmontese Wikipedia pms
Western Punjabi Wikipedia pnb
Pontic Wikipedia pnt
Pashto Wikipedia ps
Models verification
Publish Datasets
Populate the excluded section titles, except for nov, nrm, nv wikis, see
T308138#9090826
Deploy back-end
Check how the model works on the wikis
In Search, use
hasrecommendation:link
to find articles
Test them on
Inform communities
Deploy front-end
Details
Due Date
Sep 6 2023, 4:00 PM
Related Changes in Gerrit:
Subject
Repo
Branch
Lines +/-
GrowthExperiments: enable add a link in 12 and 13th round of wikis
operations/mediawiki-config
master
+46
-0
GrowthExperiments: enable AddLink frontend 13th round of wikis
operations/mediawiki-config
master
+25
-0
GrowthExperiments: enable AddLink backend for swwiki
operations/mediawiki-config
master
+2
-3
GrowthExperiments: enable AddLink backend 13th round of wikis
operations/mediawiki-config
master
+24
-0
Customize query in gerrit
Related Objects
Search...
Task Graph
Mentions
Status
Subtype
Assigned
Task
Resolved
Trizek-WMF
T304110
[EPIC] Deploy "add a link" to all Wikipedias
Resolved
Sgs
T308138
Deploy "add a link" to 13th round of wikis
Mentioned In
T371600: Deploy Add Link to three more wikis
T370559: Review wikis that have Add Link models but do not have Add Link enabled
T308137: Deploy "add a link" to 12th round of wikis
T308139: Deploy "add a link" to 14th round of wikis
T306792: initWikiConfig should set excludedSections for link-recommendation task type
T343374: Create a single table with evaluation metrics from all trained add-a-link models
T309263: Support languages whose add-a-link models were not published
Mentioned Here
T308139: Deploy "add a link" to 14th round of wikis
T308137: Deploy "add a link" to 12th round of wikis
T306792: initWikiConfig should set excludedSections for link-recommendation task type
Event Timeline
Trizek-WMF
created this task.
May 11 2022, 2:25 PM
2022-05-11 14:25:38 (UTC+0)
Restricted Application
added a subscriber:
Aklapper
View Herald Transcript
May 11 2022, 2:25 PM
2022-05-11 14:25:38 (UTC+0)
Trizek-WMF
added a parent task:
T304110: [EPIC] Deploy "add a link" to all Wikipedias
May 11 2022, 2:25 PM
2022-05-11 14:25:55 (UTC+0)
kostajh
moved this task from
Inbox
to
Triaged
on the
Growth-Team
board.
May 12 2022, 10:28 AM
2022-05-12 10:28:52 (UTC+0)
Trizek-WMF
moved this task from
To Triage
to
Not ready to announce
on the
User-notice
board.
May 16 2022, 12:30 PM
2022-05-16 12:30:20 (UTC+0)
kevinbazira
claimed this task.
Mar 13 2023, 4:36 AM
2023-03-13 04:36:33 (UTC+0)
kevinbazira
added a project:
Machine-Learning-Team
kevinbazira
moved this task from
Unsorted
to
In Progress
on the
Machine-Learning-Team
board.
kevinbazira
updated the task description.
(Show Details)
Mar 16 2023, 8:25 AM
2023-03-16 08:25:51 (UTC+0)
Comment Actions
24/24 models were trained successfully in the 13th round of wikis.
kevinbazira
added a subscriber:
MGerlach
Mar 17 2023, 7:03 AM
2023-03-17 07:03:42 (UTC+0)
Comment Actions
Model evaluation has been completed and below are the backtesting results:
Precision@0.5
Recall@0.5
novwiki
0.88
0.61
nqowiki
0.73
0.11
nrmwiki
0.87
0.56
nsowiki
0.96
0.40
nvwiki
0.99
0.80
nywiki
0.91
0.67
ocwiki
0.89
0.66
olowiki
0.92
0.51
omwiki
0.84
0.53
orwiki
0.71
0.22
oswiki
0.79
0.28
pawiki
0.74
0.29
pagwiki
0.92
0.69
pamwiki
0.94
0.76
papwiki
0.88
0.60
pcdwiki
0.92
0.75
pdcwiki
0.88
0.73
pflwiki
0.98
0.79
piwiki
0.00
0.00
pihwiki
0.91
0.77
pmswiki
0.94
0.69
pnbwiki
0.80
0.53
pntwiki
0.93
0.81
pswiki
0.76
0.47
CCing
@MGerlach
, in case he would like to add comments on the backtesting evaluation.
kevinbazira
updated the task description.
(Show Details)
Mar 20 2023, 5:23 AM
2023-03-20 05:23:05 (UTC+0)
Comment Actions
The conclusion on the backtesting results is that most of the languages look fine besides:
piwiki's precision and recall are nil.
orwiki (0.71) and pawiki (0.74) have a precision slightly lower than the recommended one (0.75).
nqowiki has a slightly low precision (0.73) and low recall (0.11).
Talked to
@MGerlach
about these results and agreed orwiki, pawiki, and nqowiki should be deployed but piwiki shouldn't.
kevinbazira
updated the task description.
(Show Details)
Mar 21 2023, 3:07 AM
2023-03-21 03:07:34 (UTC+0)
kevinbazira
added a subscriber:
kostajh
Mar 21 2023, 3:11 AM
2023-03-21 03:11:41 (UTC+0)
Comment Actions
@kostajh
, we published datasets for all 23/24 models that passed the evaluation in this round.
kevinbazira
updated the task description.
(Show Details)
Mar 21 2023, 3:15 AM
2023-03-21 03:15:17 (UTC+0)
kostajh
added a comment.
Mar 21 2023, 1:06 PM
2023-03-21 13:06:13 (UTC+0)
Comment Actions
In
T308138#8712538
@kevinbazira
wrote:
@kostajh
, we published datasets for all 23/24 models that passed the evaluation in this round.
@kevinbazira
thanks!
elukey
reassigned this task from
kevinbazira
to
kostajh
May 15 2023, 3:04 PM
2023-05-15 15:04:00 (UTC+0)
elukey
moved this task from
In Progress
to
Watching
on the
Machine-Learning-Team
board.
elukey
added a subscriber:
kevinbazira
kevinbazira
mentioned this in
T309263: Support languages whose add-a-link models were not published
Jul 4 2023, 9:44 AM
2023-07-04 09:44:31 (UTC+0)
kevinbazira
mentioned this in
T343374: Create a single table with evaluation metrics from all trained add-a-link models
Aug 2 2023, 6:10 PM
2023-08-02 18:10:56 (UTC+0)
Sgs
mentioned this in
T306792: initWikiConfig should set excludedSections for link-recommendation task type
Aug 14 2023, 5:09 PM
2023-08-14 17:09:22 (UTC+0)
Sgs
subscribed.
Comment Actions
I ran this script for adding the link-recommendation task type and populating the excluded sections entries:
PHAB
T308138
for
WIKI in novwiki nqowiki nrmwiki nsowiki nvwiki nywiki ocwiki olowiki omwiki orwiki oswiki pawiki pagwiki pamwiki papwiki pcdwiki pdcwiki pflwiki pihwiki pmswiki pnbwiki pntwiki pswiki
do
ORIGIN
mwscript getConfiguration.php
$WIKI
--settings
'wgCanonicalServer'
--format json
jq --raw-output
'.wgCanonicalServer'
mwscript extensions/GrowthExperiments/maintenance/changeWikiConfig.php
$WIKI
--page MediaWiki:NewcomerTasks.json
--create-only
--json
--summary
"Growth features configuration boilerplate ([[phab:
$PHAB
]])"
link-recommendation
'{ "type": "link-recommendation", "group": "easy" }'
jq
"select(.wiki==\"
$WIKI
\" and .probability > 0.25) | .section"
wiki_sections.jsonl
jq --slurp --compact-output
"unique"
mwscript extensions/GrowthExperiments/maintenance/changeWikiConfig.php
$WIKI
--page MediaWiki:NewcomerTasks.json
--json
--summary
"machine-generated configuration for excluding sections from link recommendations ([[phab:
$PHAB
]]), feel free to improve"
link-recommendation.excludedSections
"`cat`"
echo
$ORIGIN
/wiki/MediaWiki:NewcomerTasks.json"
echo
$ORIGIN
/w/index.php?title=MediaWiki:NewcomerTasks.json&diff=next"
echo
"Press
read
# give time for manual verification
done
Note that the script didn't populate
excludedSections
for
novwiki
nrmwiki
and
nvwiki
because these were not present in the
wiki_sections.jsonl
. These might be the case for other wikis which presented the same problem in prior rounds. I have asked in about how to add more wikis to the sections file in
T306792#9090825
Planning to enable the cronjob in all round wikis (but the ones without excludedSections) tomorrow.
gerritbot
added a comment.
Aug 14 2023, 5:18 PM
2023-08-14 17:18:57 (UTC+0)
Comment Actions
Change 948631 had a related patch set uploaded (by Sergio Gimeno; author: Sergio Gimeno):
[operations/mediawiki-config@master] GrowthExperiments: enable AddLink backend 13th round of wikis
gerritbot
added a project:
Patch-For-Review
Aug 14 2023, 5:18 PM
2023-08-14 17:18:58 (UTC+0)
Sgs
claimed this task.
Aug 14 2023, 5:29 PM
2023-08-14 17:29:54 (UTC+0)
Sgs
updated the task description.
(Show Details)
Sgs
changed the task status from
Open
to
In Progress
Aug 14 2023, 5:31 PM
2023-08-14 17:31:56 (UTC+0)
Sgs
edited projects, added
Growth-Team (Sprint 0 (Growth Team))
; removed
Growth-Team
Sgs
moved this task from
Incoming
to
Top Product Priorities
on the
Growth-Team (Sprint 0 (Growth Team))
board.
Sgs
moved this task from
Top Product Priorities
to
In Progress
on the
Growth-Team (Sprint 0 (Growth Team))
board.
gerritbot
added a comment.
Aug 15 2023, 1:05 PM
2023-08-15 13:05:46 (UTC+0)
Comment Actions
Change 948631
merged
by jenkins-bot:
[operations/mediawiki-config@master] GrowthExperiments: enable AddLink backend 13th round of wikis
Stashbot
added a comment.
Aug 15 2023, 1:06 PM
2023-08-15 13:06:15 (UTC+0)
Comment Actions
Mentioned in SAL (#wikimedia-operations)
[2023-08-15T13:06:14Z]
T308138
)]]
Stashbot
added a comment.
Aug 15 2023, 1:07 PM
2023-08-15 13:07:54 (UTC+0)
Comment Actions
Mentioned in SAL (#wikimedia-operations)
[2023-08-15T13:07:53Z]
T308138
)]] synced to the testservers mwdebug1002.eqiad.wmnet, mwdebug2002.codfw.wmnet, mwdebug2001.codfw.wmnet, mwdebug1001.eqiad.wmnet, and mw-debug kubernetes deployment (accessible via k8s-experimental XWD option)
Maintenance_bot
removed a project:
Patch-For-Review
Aug 15 2023, 1:10 PM
2023-08-15 13:10:54 (UTC+0)
Stashbot
added a comment.
Aug 15 2023, 1:17 PM
2023-08-15 13:17:03 (UTC+0)
Comment Actions
Mentioned in SAL (#wikimedia-operations)
[2023-08-15T13:17:02Z]
T308138
)]] (duration: 10m 47s)
Sgs
triaged this task as
Medium
priority.
Aug 18 2023, 4:23 PM
2023-08-18 16:23:23 (UTC+0)
gerritbot
added a comment.
Aug 23 2023, 10:49 AM
2023-08-23 10:49:22 (UTC+0)
Comment Actions
Change 951897 had a related patch set uploaded (by Sergio Gimeno; author: Sergio Gimeno):
[operations/mediawiki-config@master] GrowthExperiments: enable AddLink frontend 13th round of wikis
gerritbot
added a project:
Patch-For-Review
Aug 23 2023, 10:49 AM
2023-08-23 10:49:23 (UTC+0)
Sgs
updated the task description.
(Show Details)
Aug 23 2023, 10:55 AM
2023-08-23 10:55:54 (UTC+0)
Comment Actions
All wikis have good amount of results except
pagwiki
which was showing
~20 results
at the time of the last check. I think we can proceed with all of them. cc
@Trizek-WMF
Trizek-WMF
moved this task from
Not ready to announce
to
Announce in next Tech/News
on the
User-notice
board.
Aug 28 2023, 4:56 PM
2023-08-28 16:56:25 (UTC+0)
Comment Actions
Let's go then.
can we schedule a deployment for Sept 6th?
Sgs
added a comment.
Aug 29 2023, 2:37 PM
2023-08-29 14:37:32 (UTC+0)
Comment Actions
In
T308138#9124406
@Trizek-WMF
wrote:
Let's go then.
can we schedule a deployment for Sept 6th?
Sure, but should we release the 12th round first or together (
T308137
)?
Trizek-WMF
added a comment.
Aug 29 2023, 3:41 PM
2023-08-29 15:41:45 (UTC+0)
Comment Actions
Let's do this!
Trizek-WMF
set Due Date to Sep 6 2023, 4:00 PM.
Aug 29 2023, 3:42 PM
2023-08-29 15:42:27 (UTC+0)
gerritbot
added a comment.
Aug 31 2023, 12:31 PM
2023-08-31 12:31:41 (UTC+0)
Comment Actions
Change 954004 had a related patch set uploaded (by Sergio Gimeno; author: Sergio Gimeno):
[operations/mediawiki-config@master] GrowthExperiments: enable AddLink backend for swwiki
gerritbot
added a comment.
Aug 31 2023, 2:08 PM
2023-08-31 14:08:38 (UTC+0)
Comment Actions
Change 954004
merged
by jenkins-bot:
[operations/mediawiki-config@master] GrowthExperiments: enable AddLink backend for swwiki
Stashbot
added a comment.
Aug 31 2023, 2:09 PM
2023-08-31 14:09:03 (UTC+0)
Comment Actions
Mentioned in SAL (#wikimedia-operations)
[2023-08-31T14:09:02Z]
T308138
T308139
)]]
Stashbot
mentioned this in
T308139: Deploy "add a link" to 14th round of wikis
Aug 31 2023, 2:09 PM
2023-08-31 14:09:05 (UTC+0)
Comment Actions
Mentioned in SAL (#wikimedia-operations)
[2023-08-31T14:10:43Z]
T308138
T308139
)]] synced to the testservers mwdebug2002.codfw.wmnet, mwdebug1001.eqiad.wmnet, mwdebug1002.eqiad.wmnet, mwdebug2001.codfw.wmnet, and mw-debug kubernetes deployment (accessible via k8s-experimental XWD option)
Stashbot
added a comment.
Aug 31 2023, 2:16 PM
2023-08-31 14:16:38 (UTC+0)
Comment Actions
Mentioned in SAL (#wikimedia-operations)
[2023-08-31T14:16:37Z]
T308138
T308139
)]] (duration: 07m 34s)
Quiddity
moved this task from
Announce in next Tech/News
to
In current Tech/News draft
on the
User-notice
board.
Aug 31 2023, 10:33 PM
2023-08-31 22:33:45 (UTC+0)
gerritbot
added a comment.
Sep 6 2023, 3:24 PM
2023-09-06 15:24:34 (UTC+0)
Comment Actions
Change 948144 had a related patch set uploaded (by Sergio Gimeno; author: Sergio Gimeno):
[operations/mediawiki-config@master] GrowthExperiments: enable add a link in 12 and 13th round of wikis
gerritbot
added a comment.
Sep 6 2023, 3:27 PM
2023-09-06 15:27:25 (UTC+0)
Comment Actions
Change 951897
abandoned
by Sergio Gimeno:
[operations/mediawiki-config@master] GrowthExperiments: enable AddLink frontend 13th round of wikis
Reason:
Squashed in Ie11b4524bb796429e55bbf8e0ce45110ce9d110c
gerritbot
added a comment.
Sep 6 2023, 8:02 PM
2023-09-06 20:02:34 (UTC+0)
Comment Actions
Change 948144
merged
by jenkins-bot:
[operations/mediawiki-config@master] GrowthExperiments: enable add a link in 12 and 13th round of wikis
Stashbot
mentioned this in
T308137: Deploy "add a link" to 12th round of wikis
Sep 6 2023, 8:03 PM
2023-09-06 20:03:05 (UTC+0)
Comment Actions
Mentioned in SAL (#wikimedia-operations)
[2023-09-06T20:03:03Z]
T308137
T308138
)]]
Stashbot
added a comment.
Sep 6 2023, 8:04 PM
2023-09-06 20:04:42 (UTC+0)
Comment Actions
Mentioned in SAL (#wikimedia-operations)
[2023-09-06T20:04:40Z]
T308137
T308138
)]] synced to the testservers mwdebug1001.eqiad.wmnet, mwdebug2002.codfw.wmnet, mwdebug1002.eqiad.wmnet, mwdebug2001.codfw.wmnet, and mw-debug kubernetes deployment (accessible via k8s-experimental XWD option)
Maintenance_bot
removed a project:
Patch-For-Review
Sep 6 2023, 8:11 PM
2023-09-06 20:11:39 (UTC+0)
Stashbot
added a comment.
Sep 6 2023, 8:13 PM
2023-09-06 20:13:22 (UTC+0)
Comment Actions
Mentioned in SAL (#wikimedia-operations)
[2023-09-06T20:13:20Z]
T308137
T308138
)]] (duration: 10m 16s)
Sgs
moved this task from
In Progress
to
Test in Production | Watching
on the
Growth-Team (Sprint 0 (Growth Team))
board.
Sep 6 2023, 8:18 PM
2023-09-06 20:18:08 (UTC+0)
Sgs
updated the task description.
(Show Details)
Sep 7 2023, 11:48 AM
2023-09-07 11:48:08 (UTC+0)
Quiddity
moved this task from
In current Tech/News draft
to
Already announced/Archive
on the
User-notice
board.
Sep 7 2023, 8:43 PM
2023-09-07 20:43:12 (UTC+0)
Etonkovidova
closed this task as
Resolved
Sep 21 2023, 1:31 AM
2023-09-21 01:31:06 (UTC+0)
Maintenance_bot
edited projects, added
User-notice-archive
; removed
User-notice
Oct 1 2023, 2:30 AM
2023-10-01 02:30:19 (UTC+0)
calbon
moved this task from
Watching
to
2023-2024 Q3 Done
on the
Machine-Learning-Team
board.
Nov 29 2023, 2:18 PM
2023-11-29 14:18:07 (UTC+0)
Trizek-WMF
mentioned this in
T370559: Review wikis that have Add Link models but do not have Add Link enabled
Jul 22 2024, 12:47 PM
2024-07-22 12:47:27 (UTC+0)
Urbanecm_WMF
mentioned this in
T371600: Deploy Add Link to three more wikis
Aug 1 2024, 12:34 PM
2024-08-01 12:34:19 (UTC+0)
Log In to Comment
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct.
Wikimedia Foundation
Code of Conduct
Disclaimer
CC-BY-SA
GPL
Credits
US