⚓ T391964 [Epic] Recent Changes ORES Enabled Revert Risk Powered Filters Rollout Plan

⚓ T391964 [Epic] Recent Changes ORES Enabled Revert Risk Powered Filters Rollout Plan
Page Menu
Phabricator
Create Task
Maniphest
T391964
[Epic] Recent Changes ORES Enabled Revert Risk Powered Filters Rollout Plan
Closed, Resolved
Public
Actions
Edit Task
Edit Related Tasks...
Create Subtask
Edit Parent Tasks
Edit Subtasks
Merge Duplicates In
Close As Duplicate
Edit Related Objects...
Edit Commits
Edit Mocks
Mute Notifications
Protect as security issue
Assigned To
isarantopoulos
Authored By
DMburugu
Apr 15 2025, 12:49 PM
2025-04-15 12:49:57 (UTC+0)
Tags
Machine-Learning-Team
(Previous Quarter Goals)
Moderator-Tools-Team
(Product backlog)
DBA
(Blocked external/Not db team)
MediaWiki-Recent-changes
(Component)
MediaWiki-extensions-ORES
(Backlog)
Epic
Referenced Files
None
Subscribers
A_smart_kitten
Aklapper
DMburugu
gkyziridis
isarantopoulos
Johannnes89
jsn.sherman
View All 10 Subscribers
Description
In order to deploy ORES Powered Revert Risk Filters to Recent Changes on a wiki the following steps will need to be covered.
Run Analysis to get Thresholds for a Wiki (similar to idwiki) and add this to MediaWiki config.
Dba add ORES table to selected wikis. DBA script. [✅Update 26/5/25 done for all wikis]
Create tables with this command for a specific wiki:
mwscript-k8s --comment="T382171" -- extensions/WikimediaMaintenance/createExtensionTables.php --wiki=idwiki ores
Enable ORES Extension on the Wikis + add the model thresholds (
similar to this patch
) To enable the extension to a new wiki we need to add it to the dblist. Example for idwiki:
composer manage-dblist add idwiki ores
Update i18n messages via translatewiki.net (
example of translating a message
Run Script to Backfill Scores on Wiki
backfill scores for a specific wiki:
mwscript-k8s --comment="T382171" -- extensions/ORES/maintenance/PopulateDatabase.php --wiki=idwiki
Add Filters on Revert Risk - enable the UI (switch the
wgOresUiEnabled
config variable in ext-ORES.php file in wmf-config to true)
QA Performance of the Filters on the Thresholds
This will serve as a tracking task for the work above.
The following list of wikis in which we'll enable the extension has been summarized in
T392144: Identify highest impact wikis to deploy recent changes revert risk language agnostic filters to
wiki
90d editcount
edits/day
admin count
idwiki
25605791
284508
46
cywiki
13545520
150505
11
simplewiki
9246024
102733
21
bewiki
4791865
53242
10
kkwiki
3178180
35313
12
nnwiki
3522538
39139
14
mkwiki
4379722
48663
12
lawiki
3736619
41517
21
afwiki
2706079
30067
14
tewiki
4200340
46670
11
mrwiki
2402453
26693
10
swwiki
1389796
15442
15
mlwiki
4078126
45312
14
iswiki
1836646
20407
12
pawiki
775906
8621
10
hawiki
581065
6456
10
tlwiki
1923816
21375
10
bnwiki
7553384
83926
15
trwiki
31916936
354632
23
azwiki
6818763
75764
13
Related Objects
Search...
Task Graph
Mentions
Status
Subtype
Assigned
Task
Open
None
T390058
Add new filters to Recent Changes
Resolved
isarantopoulos
T391964
[Epic] Recent Changes ORES Enabled Revert Risk Powered Filters Rollout Plan
Resolved
Kgraessle
T375280
PopulateDatabase errors out and stops processing revisions when any revertRiskLiftWingRequest request fails
Resolved
BAPerdana-WMF
T394455
Ensure all ORES i18n messages are available for idwiki
Resolved
gkyziridis
T392148
Run analysis to retrieve thresholds for high impact wikis to deploy recent changes revert risk language agnostic filters to
Resolved
Kgraessle
T392144
Identify highest impact wikis to deploy recent changes revert risk language agnostic filters to
Resolved
isarantopoulos
T391103
DBA Review of Tables that ORES Extension will create
Resolved
isarantopoulos
T382171
Install ORES extension on idwiki
Resolved
fnegri
T395122
Run maintain-views to create new ORES tables
Resolved
gkyziridis
T395253
Improve ORES extension table backfill script
Resolved
Kgraessle
T395256
[Spike] Investigate why filtering wasn't working on testwiki
Resolved
gkyziridis
T395668
[batch #1] Enable revertrisk filters in simplewiki & trwiki
Resolved
None
T395481
Ensure all ORES i18n messages are available for wikis to add revert risk language agnostic filters to
Resolved
gkyziridis
T395823
[batch #2] Enable revertrisk filters in recent changes in multiple wikis
Resolved
gkyziridis
T395824
[batch #3] Enable revertrisk filters in recent changes in multiple wikis
Mentioned In
T348298: Deploy Revert Risk (language agnostic) filter to all Wikipedias
T343938: [SPIKE] How might the Editing Team leverage the "revert risk" model to identify high value checks?
T398291: AI/ML Infrastructure Request: Expand ORES-enabled RevertRisk filters deployment to all wikis, excluding Commons and Wikidata
Mentioned Here
T395668: [batch #1] Enable revertrisk filters in simplewiki & trwiki
T395823: [batch #2] Enable revertrisk filters in recent changes in multiple wikis
T382171: Install ORES extension on idwiki
T392144: Identify highest impact wikis to deploy recent changes revert risk language agnostic filters to
Event Timeline
DMburugu
created this task.
Apr 15 2025, 12:49 PM
2025-04-15 12:49:57 (UTC+0)
Restricted Application
added a subscriber:
Aklapper
View Herald Transcript
Apr 15 2025, 12:49 PM
2025-04-15 12:49:57 (UTC+0)
DMburugu
updated the task description.
(Show Details)
Apr 15 2025, 12:50 PM
2025-04-15 12:50:39 (UTC+0)
DMburugu
renamed this task from
Epic - Recent Changes Revert Risk Powered Filters Rollout Plan
to
Epic - Recent Changes ORES Enabled Revert Risk Powered Filters Rollout Plan
Apr 15 2025, 12:55 PM
2025-04-15 12:55:29 (UTC+0)
DMburugu
added a parent task:
T390058: Add new filters to Recent Changes
DMburugu
updated the task description.
(Show Details)
Ladsgroup
subscribed.
Apr 15 2025, 1:09 PM
2025-04-15 13:09:12 (UTC+0)
Comment Actions
I suggest creating a dblist similar to flow for example:
That would make it easier to catalog the tables.
Aklapper
renamed this task from
Epic - Recent Changes ORES Enabled Revert Risk Powered Filters Rollout Plan
to
[Epic] Recent Changes ORES Enabled Revert Risk Powered Filters Rollout Plan
Apr 15 2025, 1:53 PM
2025-04-15 13:53:17 (UTC+0)
Restricted Application
added a project:
Epic
View Herald Transcript
Apr 15 2025, 1:53 PM
2025-04-15 13:53:17 (UTC+0)
A_smart_kitten
subscribed.
Apr 15 2025, 2:45 PM
2025-04-15 14:45:01 (UTC+0)
DMburugu
moved this task from
Inbox
to
Product backlog
on the
Moderator-Tools-Team
board.
Apr 15 2025, 4:17 PM
2025-04-15 16:17:39 (UTC+0)
isarantopoulos
moved this task from
Unsorted
to
Current Quarter Goals
on the
Machine-Learning-Team
board.
Apr 17 2025, 11:25 AM
2025-04-17 11:25:34 (UTC+0)
kevinbazira
subscribed.
May 13 2025, 2:42 PM
2025-05-13 14:42:23 (UTC+0)
Ladsgroup
moved this task from
Triage
to
Blocked external/Not db team
on the
DBA
board.
May 16 2025, 12:40 PM
2025-05-16 12:40:29 (UTC+0)
gkyziridis
subscribed.
May 19 2025, 8:16 AM
2025-05-19 08:16:55 (UTC+0)
isarantopoulos
updated the task description.
(Show Details)
May 19 2025, 8:43 AM
2025-05-19 08:43:56 (UTC+0)
isarantopoulos
added subtasks:
T382171: Install ORES extension on idwiki
T375280: PopulateDatabase errors out and stops processing revisions when any revertRiskLiftWingRequest request fails
T394455: Ensure all ORES i18n messages are available for idwiki
May 19 2025, 9:46 AM
2025-05-19 09:46:30 (UTC+0)
isarantopoulos
added a subtask:
T392148: Run analysis to retrieve thresholds for high impact wikis to deploy recent changes revert risk language agnostic filters to
May 19 2025, 9:51 AM
2025-05-19 09:51:05 (UTC+0)
isarantopoulos
added a subtask:
T392144: Identify highest impact wikis to deploy recent changes revert risk language agnostic filters to
May 19 2025, 9:54 AM
2025-05-19 09:54:42 (UTC+0)
isarantopoulos
added a subtask:
T391103: DBA Review of Tables that ORES Extension will create
May 19 2025, 9:56 AM
2025-05-19 09:56:48 (UTC+0)
isarantopoulos
updated the task description.
(Show Details)
May 19 2025, 1:54 PM
2025-05-19 13:54:55 (UTC+0)
Restricted Application
added a subscriber:
Nemoralis
View Herald Transcript
May 19 2025, 1:54 PM
2025-05-19 13:54:55 (UTC+0)
isarantopoulos
updated the task description.
(Show Details)
May 19 2025, 2:10 PM
2025-05-19 14:10:08 (UTC+0)
isarantopoulos
added a comment.
May 20 2025, 2:36 PM
2025-05-20 14:36:02 (UTC+0)
Comment Actions
We will deploy the ORES extension on idwiki without enabling the UI on Thursday 22nd of May during the afternoon UTC deployment window.
During this time we will also run the backfill jobs and QA the tables. This work is tracked in
T382171: Install ORES extension on idwiki
Kgraessle
closed subtask
T394455: Ensure all ORES i18n messages are available for idwiki
as
Resolved
May 22 2025, 4:04 PM
2025-05-22 16:04:42 (UTC+0)
Kgraessle
closed subtask
T375280: PopulateDatabase errors out and stops processing revisions when any revertRiskLiftWingRequest request fails
as
Resolved
isarantopoulos
added a subtask:
T395122: Run maintain-views to create new ORES tables
May 26 2025, 12:31 PM
2025-05-26 12:31:47 (UTC+0)
isarantopoulos
updated the task description.
(Show Details)
May 26 2025, 12:33 PM
2025-05-26 12:33:50 (UTC+0)
isarantopoulos
added a comment.
May 26 2025, 12:36 PM
2025-05-26 12:36:59 (UTC+0)
Comment Actions
✅ The tables for all the wikis in the list have now been created.
isarantopoulos
closed subtask
T391103: DBA Review of Tables that ORES Extension will create
as
Resolved
May 26 2025, 12:40 PM
2025-05-26 12:40:26 (UTC+0)
isarantopoulos
added a subtask:
T395256: [Spike] Investigate why filtering wasn't working on testwiki
May 28 2025, 8:04 AM
2025-05-28 08:04:21 (UTC+0)
gkyziridis
closed subtask
T392148: Run analysis to retrieve thresholds for high impact wikis to deploy recent changes revert risk language agnostic filters to
as
Resolved
May 28 2025, 8:40 AM
2025-05-28 08:40:08 (UTC+0)
isarantopoulos
added a comment.
May 28 2025, 12:46 PM
2025-05-28 12:46:56 (UTC+0)
Comment Actions
From the above initial list the extension is already enabled in the following wikis:
simplewiki
trwiki
And we have also enabled it in idwiki.
I have created the tables for the remaining list of wikis (
ores_classification
and
ores_model
tables).
This is the list of the remaining wikis:
cywiki
bewiki
kkwiki
nnwiki
mkwiki
lawiki
afwiki
tewiki
mrwiki
swwiki
mlwiki
iswiki
pawiki
hawiki
tlwiki
bnwiki
azwiki
I suggest we deploy simplewiki & trwiki in a separate batch and the rest of them in 2 groups so that we can QA properly.
gkyziridis
added a comment.
May 28 2025, 1:25 PM
2025-05-28 13:25:07 (UTC+0)
Comment Actions
Deploying Ores Extension 3 Batches
I was thinking that since we will deploy on batches, I would like to do the following:
Steps
for a batch of wikis
Disable UI
#patch1
Enable ORES extension and set the thresholds
#patch1
Schedule deployment and deploy
#patch1
Run the backfill script:
mwscript-k8s --comment={} -- extensions/ORES/maintenance/PopulateDatabase.php --wiki={}
Enable UI
#patch2
I was thinking to apply all the above steps on 3 batches:
Simple wiki and Turkish wiki:
simplewiki
trwiki
(ores extension is enable, I will set the thresholds and test both)
afwiki
bewiki
cywiki
kkwiki
lawiki
mkwiki
mrwiki
nnwiki
swwiki
tewiki
swwiki
mlwiki
iswiki
pawiki
hawiki
tlwiki
bnwiki
trwiki
azwiki
gerritbot
added a comment.
May 28 2025, 1:47 PM
2025-05-28 13:47:06 (UTC+0)
Comment Actions
Change #1151693 had a related patch set uploaded (by Gkyziridis; author: Gkyziridis):
[operations/mediawiki-config@master] ores-extension: enable ores extension for rrla without UI for simplewiki and trwiki
gerritbot
added a project:
Patch-For-Review
May 28 2025, 1:47 PM
2025-05-28 13:47:07 (UTC+0)
Johannnes89
subscribed.
May 30 2025, 3:13 PM
2025-05-30 15:13:25 (UTC+0)
gerritbot
added a comment.
Jun 2 2025, 12:57 PM
2025-06-02 12:57:46 (UTC+0)
Comment Actions
Change #1152682 had a related patch set uploaded (by Gkyziridis; author: Gkyziridis):
[operations/mediawiki-config@master] ores-extension: enable revertrisk filter for a list of wikis
isarantopoulos
added a subtask:
T395481: Ensure all ORES i18n messages are available for wikis to add revert risk language agnostic filters to
Jun 2 2025, 1:30 PM
2025-06-02 13:30:30 (UTC+0)
Nemoralis
unsubscribed.
Jun 2 2025, 1:38 PM
2025-06-02 13:38:48 (UTC+0)
gkyziridis
added a subscriber:
Kgraessle
Edited
Jun 2 2025, 2:13 PM
2025-06-02 14:13:45 (UTC+0)
Comment Actions
Hey
@Kgraessle
and
@isarantopoulos
. I just submitted a patch for the first batch of wikis as it is mentioned in the
comment above
. There is an issue for
cywiki
There was 1 failure:

1) InitialiseSettingsTest::testOnlyExistingWikis
cywiki is referenced for wgOresModels, but it isn't either a wiki or a dblist
Failed asserting that false is true.

/src/tests/InitialiseSettingsTest.php:433
phpvfscomposer:///src/vendor/phpunit/phpunit/phpunit:106
Based on the info provided by ci/cd the
cywiki
seems to not have a wiki or a dblist. It is also a heavy outlier in the
distribution of the thresholds
Do you have any info about it? Should we omit it from the deployment for now ?
isarantopoulos
added a comment.
Edited
Jun 2 2025, 6:31 PM
2025-06-02 18:31:35 (UTC+0)
Comment Actions
@gkyziridis
I have separated the wikis in 2 groups after sorting them alphabetically as I believe this would limit the confusion while trying to remember in which batch each wiki belongs to.
cywiki
is in the first batch {
T395823: [batch #2] Enable revertrisk filters in recent changes in multiple wikis
}. The issue was due to an additional whitespace, all seems fine now, so we can proceed.
I have updated your patch with the new wikis. Let's continue the discussion about this batch in the new task I created to track all the info.
A_smart_kitten
removed a project:
Patch-For-Review
Jun 2 2025, 8:39 PM
2025-06-02 20:39:38 (UTC+0)
gkyziridis
closed subtask
T395253: Improve ORES extension table backfill script
as
Resolved
Jun 5 2025, 9:04 AM
2025-06-05 09:04:14 (UTC+0)
isarantopoulos
closed subtask
T382171: Install ORES extension on idwiki
as
Resolved
Jun 10 2025, 2:55 PM
2025-06-10 14:55:48 (UTC+0)
Kgraessle
closed subtask
T395256: [Spike] Investigate why filtering wasn't working on testwiki
as
Resolved
Jun 10 2025, 4:05 PM
2025-06-10 16:05:30 (UTC+0)
isarantopoulos
closed subtask
T395823: [batch #2] Enable revertrisk filters in recent changes in multiple wikis
as
Resolved
Jun 17 2025, 12:41 PM
2025-06-17 12:41:31 (UTC+0)
kostajh
mentioned this in
T398291: AI/ML Infrastructure Request: Expand ORES-enabled RevertRisk filters deployment to all wikis, excluding Commons and Wikidata
Jul 1 2025, 10:36 AM
2025-07-01 10:36:05 (UTC+0)
isarantopoulos
added a comment.
Jul 1 2025, 2:29 PM
2025-07-01 14:29:44 (UTC+0)
Comment Actions
Remaining work:
Simplewiki and trwiki deployments are still pending as described in
T395668: [batch #1] Enable revertrisk filters in simplewiki & trwiki
isarantopoulos
closed subtask
T395824: [batch #3] Enable revertrisk filters in recent changes in multiple wikis
as
Resolved
Jul 7 2025, 8:55 AM
2025-07-07 08:55:30 (UTC+0)
isarantopoulos
moved this task from
Current Quarter Goals
to
Previous Quarter Goals
on the
Machine-Learning-Team
board.
Jul 8 2025, 9:16 AM
2025-07-08 09:16:58 (UTC+0)
isarantopoulos
closed subtask
T395668: [batch #1] Enable revertrisk filters in simplewiki & trwiki
as
Resolved
Jul 17 2025, 7:37 AM
2025-07-17 07:37:05 (UTC+0)
isarantopoulos
closed this task as
Resolved
Jul 17 2025, 9:03 AM
2025-07-17 09:03:53 (UTC+0)
isarantopoulos
claimed this task.
Comment Actions
The filters have now been deployed to all of the above wikis. Thank you all for your contributions to this epic!
kostajh
mentioned this in
T343938: [SPIKE] How might the Editing Team leverage the "revert risk" model to identify high value checks?
Jul 24 2025, 2:28 PM
2025-07-24 14:28:24 (UTC+0)
Samwalton9
closed subtask
T395481: Ensure all ORES i18n messages are available for wikis to add revert risk language agnostic filters to
as
Resolved
Sep 22 2025, 3:15 PM
2025-09-22 15:15:36 (UTC+0)
Samwalton9-WMF
mentioned this in
T348298: Deploy Revert Risk (language agnostic) filter to all Wikipedias
Sep 22 2025, 3:22 PM
2025-09-22 15:22:06 (UTC+0)
Log In to Comment
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct.
Wikimedia Foundation
Code of Conduct
Disclaimer
CC-BY-SA
GPL
Credits