⚓ T415536 Allow running multiple experiments in GrowthExperiments at the same time
Page Menu
Phabricator
Create Task
Maniphest
T415536
Allow running multiple experiments in GrowthExperiments at the same time
Closed, Resolved
Public
5 Estimated Story Points
Actions
Edit Task
Edit Related Tasks...
Create Subtask
Edit Parent Tasks
Edit Subtasks
Merge Duplicates In
Close As Duplicate
Edit Related Objects...
Edit Commits
Edit Mocks
Mute Notifications
Protect as security issue
Assigned To
Sgs
Authored By
Michael
Jan 26 2026, 12:33 PM
2026-01-26 12:33:27 (UTC+0)
Tags
GrowthExperiments
(Backlog)
OKR-Work
(Backlog)
MW-1.46-notes (1.46.0-wmf.18; 2026-03-03)
Growth-Team (FY2025-26 Q4 Sprint 1)
(Test in Production)
Referenced Files
None
Subscribers
Aklapper
Cyndymediawiksim
DMburugu
Etonkovidova
KStoller-WMF
Michael
Description
For our upcoming hypotheses in the current and next quarter, we are planning to run a lot of experiments. The current restriction in GrowthExperiments to only run a single experiment per wiki at any time would be major obstacle for that.
With
Test Kitchen
, it should be pretty straight forward in principle to run multiple experiments at the same time.
This task replaces
T288022
, which set out to achieve the same outcome but based on the legacy custom GrowthExperiments experimentation infrastructure and thus with a different approach that is no longer suitable for our current situation.
Acceptance criteria
GrowthExperiments experimentation infrastructure supports running multiple experiments in parallel on the same wiki
ge.utils.getUserVariant()
is either removed or returns all variants for active GrowthExperiments experiments
(the
isUserInVariant()
in the same file seems unused and can probably just be removed)
ge.utils.setUserVarian()
needs to be adjusted as well
Details
Related Changes in Gerrit:
Subject
Repo
Branch
Lines +/-
ExperimentManager: support multiple concurrent experiments
mediawiki/extensions/GrowthExperiments
master
+191
-349
Experiments: dismantle ExperimentUserManager
mediawiki/extensions/GrowthExperiments
master
+88
-373
Experiments: introduce IExperimentManager
mediawiki/extensions/GrowthExperiments
wmf/1.46.0-wmf.16
+106
-71
Experiments: introduce IExperimentManager
mediawiki/extensions/GrowthExperiments
master
+106
-71
[Growth] Specify notification delay as int instead of array
operations/mediawiki-config
master
+2
-6
Customize query in gerrit
Related Objects
Search...
Task Graph
Mentions
Status
Subtype
Assigned
Task
Open
None
T415546
[EPIC] Improve data collection and experiment ergonomics
Open
None
T409236
[EPIC] Account Creation Experiments (WE1.8 FY 25-26)
Resolved
Sgs
T415536
Allow running multiple experiments in GrowthExperiments at the same time
Resolved
Sgs
T416894
Integrate existing AB testable features with TestKitchen
Mentioned In
T375198: Fully adopt TestKitchen for experiment enrollment
T415651: Remove redundant experiment group CSS classes
Mentioned Here
T375198: Fully adopt TestKitchen for experiment enrollment
T416894: Integrate existing AB testable features with TestKitchen
T288022: Support multidimensional user variants in GrowthExperiments
Event Timeline
Michael
created this task.
Jan 26 2026, 12:33 PM
2026-01-26 12:33:27 (UTC+0)
Restricted Application
added a subscriber:
Aklapper
View Herald Transcript
Jan 26 2026, 12:33 PM
2026-01-26 12:33:27 (UTC+0)
Michael
moved this task from
Inbox
to
Product backlog
on the
Growth-Team
board.
Jan 26 2026, 12:35 PM
2026-01-26 12:35:25 (UTC+0)
Michael
added a parent task:
T415546: [EPIC] Improve data collection and experiment ergonomics
Jan 26 2026, 2:17 PM
2026-01-26 14:17:26 (UTC+0)
KStoller-WMF
subscribed.
Jan 26 2026, 8:27 PM
2026-01-26 20:27:02 (UTC+0)
Sgs
mentioned this in
T415651: Remove redundant experiment group CSS classes
Jan 27 2026, 11:50 AM
2026-01-27 11:50:16 (UTC+0)
Sgs
triaged this task as
High
priority.
Jan 28 2026, 4:48 PM
2026-01-28 16:48:37 (UTC+0)
Sgs
moved this task from
Product backlog
to
Needs Estimation
on the
Growth-Team
board.
KStoller-WMF
added a parent task:
T409236: [EPIC] Account Creation Experiments (WE1.8 FY 25-26)
Jan 29 2026, 12:42 AM
2026-01-29 00:42:59 (UTC+0)
Michael
updated the task description.
(Show Details)
Feb 9 2026, 4:44 PM
2026-02-09 16:44:15 (UTC+0)
Michael
updated the task description.
(Show Details)
Feb 9 2026, 4:47 PM
2026-02-09 16:47:40 (UTC+0)
DMburugu
set the point value for this task to
Feb 9 2026, 4:52 PM
2026-02-09 16:52:58 (UTC+0)
Michael
moved this task from
Needs Estimation
to
Estimated tasks backlog
on the
Growth-Team
board.
Feb 9 2026, 5:17 PM
2026-02-09 17:17:44 (UTC+0)
Michael
lowered the priority of this task from
High
to
Medium
Feb 10 2026, 5:53 PM
2026-02-10 17:53:41 (UTC+0)
Michael
moved this task from
Estimated tasks backlog
to
FY2025-26 Q3 Sprint 3
on the
Growth-Team
board.
Michael
edited projects, added
Growth-Team (FY2025-26 Q3 Sprint 3)
; removed
Growth-Team
Cyndymediawiksim
claimed this task.
Feb 16 2026, 8:04 AM
2026-02-16 08:04:49 (UTC+0)
Cyndymediawiksim
moved this task from
Incoming
to
Doing
on the
Growth-Team (FY2025-26 Q3 Sprint 3)
board.
Cyndymediawiksim
moved this task from
Doing
to
Blocked / Needs Work
on the
Growth-Team (FY2025-26 Q3 Sprint 3)
board.
Feb 17 2026, 9:33 AM
2026-02-17 09:33:47 (UTC+0)
Comment Actions
Blocked on
T416894
gerritbot
added a comment.
Feb 17 2026, 10:03 AM
2026-02-17 10:03:33 (UTC+0)
Comment Actions
Change #1239893 had a related patch set uploaded (by Sergio Gimeno; author: Sergio Gimeno):
[mediawiki/extensions/GrowthExperiments@master] Experiments: introduce StaticExperimentManager
gerritbot
added a project:
Patch-For-Review
Feb 17 2026, 10:03 AM
2026-02-17 10:03:35 (UTC+0)
Aklapper
added a subtask:
T416894: Integrate existing AB testable features with TestKitchen
Feb 17 2026, 10:45 AM
2026-02-17 10:45:45 (UTC+0)
gerritbot
added a comment.
Feb 17 2026, 7:42 PM
2026-02-17 19:42:05 (UTC+0)
Comment Actions
Change #1240032 had a related patch set uploaded (by Sergio Gimeno; author: Sergio Gimeno):
[operations/mediawiki-config@master] [Growth] Specify notification delay as int instead of array
gerritbot
added a comment.
Feb 17 2026, 8:08 PM
2026-02-17 20:08:43 (UTC+0)
Comment Actions
Change #1240040 had a related patch set uploaded (by Sergio Gimeno; author: Sergio Gimeno):
[mediawiki/extensions/GrowthExperiments@master] Experiments: introduce IExperimentManager
gerritbot
added a comment.
Feb 18 2026, 9:02 PM
2026-02-18 21:02:35 (UTC+0)
Comment Actions
Change #1240032
merged
by jenkins-bot:
[operations/mediawiki-config@master] [Growth] Specify notification delay as int instead of array
Stashbot
added a comment.
Feb 18 2026, 9:03 PM
2026-02-18 21:03:03 (UTC+0)
Comment Actions
Mentioned in SAL (#wikimedia-operations)
[2026-02-18T21:03:02Z]
T375198
T415536
)]]
Stashbot
mentioned this in
T375198: Fully adopt TestKitchen for experiment enrollment
Feb 18 2026, 9:03 PM
2026-02-18 21:03:05 (UTC+0)
Stashbot
added a comment.
Feb 18 2026, 9:05 PM
2026-02-18 21:05:15 (UTC+0)
Comment Actions
Mentioned in SAL (#wikimedia-operations)
[2026-02-18T21:05:15Z]
T375198
T415536
)]] synced to the testservers (see
). Changes can now be verified there.
Stashbot
added a comment.
Feb 18 2026, 9:10 PM
2026-02-18 21:10:51 (UTC+0)
Comment Actions
Mentioned in SAL (#wikimedia-operations)
[2026-02-18T21:10:50Z]
T375198
T415536
)]] (duration: 07m 48s)
gerritbot
added a comment.
Feb 20 2026, 3:09 PM
2026-02-20 15:09:37 (UTC+0)
Comment Actions
Change #1240040
merged
by jenkins-bot:
[mediawiki/extensions/GrowthExperiments@master] Experiments: introduce IExperimentManager
ReleaseTaggerBot
added a project:
MW-1.46-notes (1.46.0-wmf.17; 2026-02-24)
Feb 20 2026, 4:00 PM
2026-02-20 16:00:38 (UTC+0)
Cyndymediawiksim
moved this task from
Blocked / Needs Work
to
Doing
on the
Growth-Team (FY2025-26 Q3 Sprint 3)
board.
Feb 23 2026, 9:15 AM
2026-02-23 09:15:00 (UTC+0)
Cyndymediawiksim
updated Other Assignee, added:
Sgs
Sgs
moved this task from
Doing
to
Blocked / Needs Work
on the
Growth-Team (FY2025-26 Q3 Sprint 3)
board.
Feb 23 2026, 12:36 PM
2026-02-23 12:36:06 (UTC+0)
Urbanecm_WMF
edited projects, added
Growth-Team (FY2025-26 Q3 Sprint 4)
; removed
Growth-Team (FY2025-26 Q3 Sprint 3)
Feb 24 2026, 5:37 PM
2026-02-24 17:37:54 (UTC+0)
Urbanecm_WMF
moved this task from
Incoming
to
Blocked / Needs Work
on the
Growth-Team (FY2025-26 Q3 Sprint 4)
board.
gerritbot
added a comment.
Feb 25 2026, 3:18 PM
2026-02-25 15:18:39 (UTC+0)
Comment Actions
Change #1243857 had a related patch set uploaded (by Urbanecm; author: Sergio Gimeno):
[mediawiki/extensions/GrowthExperiments@wmf/1.46.0-wmf.16] Experiments: introduce IExperimentManager
gerritbot
added a comment.
Feb 25 2026, 4:08 PM
2026-02-25 16:08:12 (UTC+0)
Comment Actions
Change #1243857
merged
by jenkins-bot:
[mediawiki/extensions/GrowthExperiments@wmf/1.46.0-wmf.16] Experiments: introduce IExperimentManager
Stashbot
added a comment.
Feb 25 2026, 4:09 PM
2026-02-25 16:09:44 (UTC+0)
Comment Actions
Mentioned in SAL (#wikimedia-operations)
[2026-02-25T16:09:44Z]
T375198
T415536
)]], [[gerrit:1243858|Remove PHPDoc blocks that are 100% identical to the code]]
Stashbot
added a comment.
Feb 25 2026, 4:12 PM
2026-02-25 16:12:04 (UTC+0)
Comment Actions
Mentioned in SAL (#wikimedia-operations)
[2026-02-25T16:12:03Z]
T375198
T415536
)]], [[gerrit:1243858|Remove PHPDoc blocks that are 100% identical to the code]] synced to the testservers (see
). Changes can now be verified there.
Stashbot
added a comment.
Feb 25 2026, 4:16 PM
2026-02-25 16:16:29 (UTC+0)
Comment Actions
Mentioned in SAL (#wikimedia-operations)
[2026-02-25T16:16:28Z]
T375198
T415536
)]], [[gerrit:1243858|Remove PHPDoc blocks that are 100% identical to the code]] (duration: 06m 44s)
ReleaseTaggerBot
edited projects, added
MW-1.46-notes (1.46.0-wmf.16; 2026-02-17)
; removed
MW-1.46-notes (1.46.0-wmf.17; 2026-02-24)
Feb 25 2026, 5:00 PM
2026-02-25 17:00:14 (UTC+0)
gerritbot
added a comment.
Feb 27 2026, 4:39 PM
2026-02-27 16:39:20 (UTC+0)
Comment Actions
Change #1245408 had a related patch set uploaded (by Sergio Gimeno; author: Sergio Gimeno):
[mediawiki/extensions/GrowthExperiments@master] ExperimentManager: support multiple concurrent experiments
Sgs
claimed this task.
Feb 27 2026, 5:04 PM
2026-02-27 17:04:16 (UTC+0)
Sgs
updated Other Assignee, removed:
Sgs
Sgs
moved this task from
Blocked / Needs Work
to
Doing
on the
Growth-Team (FY2025-26 Q3 Sprint 4)
board.
Sgs
added a subscriber:
Cyndymediawiksim
gerritbot
added a comment.
Feb 27 2026, 5:44 PM
2026-02-27 17:44:52 (UTC+0)
Comment Actions
Change #1239893
merged
by jenkins-bot:
[mediawiki/extensions/GrowthExperiments@master] Experiments: dismantle ExperimentUserManager
Sgs
moved this task from
Doing
to
Code Review
on the
Growth-Team (FY2025-26 Q3 Sprint 4)
board.
Mar 2 2026, 2:27 PM
2026-03-02 14:27:03 (UTC+0)
gerritbot
added a comment.
Mar 2 2026, 6:59 PM
2026-03-02 18:59:00 (UTC+0)
Comment Actions
Change #1245408
merged
by jenkins-bot:
[mediawiki/extensions/GrowthExperiments@master] ExperimentManager: support multiple concurrent experiments
ReleaseTaggerBot
edited projects, added
MW-1.46-notes (1.46.0-wmf.18; 2026-03-03)
; removed
MW-1.46-notes (1.46.0-wmf.16; 2026-02-17)
Mar 2 2026, 7:00 PM
2026-03-02 19:00:45 (UTC+0)
Maintenance_bot
removed a project:
Patch-For-Review
Mar 2 2026, 7:30 PM
2026-03-02 19:30:53 (UTC+0)
Sgs
moved this task from
Code Review
to
QA
on the
Growth-Team (FY2025-26 Q3 Sprint 4)
board.
Mar 3 2026, 12:18 PM
2026-03-03 12:18:20 (UTC+0)
DMburugu
subscribed.
Mar 10 2026, 3:01 PM
2026-03-10 15:01:10 (UTC+0)
Comment Actions
Is this meant to be testable from the UI? I see a couple of patches which look like they implement the functionality.
Sgs
closed subtask
T416894: Integrate existing AB testable features with TestKitchen
as
Resolved
Mar 11 2026, 11:09 AM
2026-03-11 11:09:06 (UTC+0)
DMburugu
edited projects, added
Growth-Team (FY2025-26 Q3 Sprint 5)
; removed
Growth-Team (FY2025-26 Q3 Sprint 4)
Mar 11 2026, 11:17 AM
2026-03-11 11:17:15 (UTC+0)
DMburugu
moved this task from
Incoming
to
QA
on the
Growth-Team (FY2025-26 Q3 Sprint 5)
board.
Etonkovidova
moved this task from
QA
to
Test in Production
on the
Growth-Team (FY2025-26 Q3 Sprint 5)
board.
Mar 13 2026, 7:57 PM
2026-03-13 19:57:06 (UTC+0)
Etonkovidova
subscribed.
Comment Actions
Checked for
getUserVariant
- it is still listed as used
getUserVariantForLegacySchema
and in includes/Language/LanguageConverter.php. Is it ok for the scope of the task?
Sgs
added a comment.
Mar 16 2026, 12:28 PM
2026-03-16 12:28:07 (UTC+0)
Comment Actions
In
T415536#11708499
@Etonkovidova
wrote:
Checked for
getUserVariant
- it is still listed as used
getUserVariantForLegacySchema
and in includes/Language/LanguageConverter.php. Is it ok for the scope of the task?
Yes, the function is still used internally by GrowthExperiments to keep compatibility with the running experiments and existing instrumentation. The LanguageConverter is a different function with the same name in a core class, no relation. I guess this task will be testable in production once we enable the experiment for the changes in the create account form AND the revise tone experiment keeps running.
Michael
edited projects, added
Growth-Team (FY2025-26 Q3 Sprint 6)
; removed
Growth-Team (FY2025-26 Q3 Sprint 5)
Mar 24 2026, 4:28 PM
2026-03-24 16:28:32 (UTC+0)
Michael
moved this task from
Incoming
to
Test in Production
on the
Growth-Team (FY2025-26 Q3 Sprint 6)
board.
Michael
edited projects, added
Growth-Team (FY2025-26 Q4 Sprint 1)
; removed
Growth-Team (FY2025-26 Q3 Sprint 6)
Tue, Apr 7, 4:40 PM
2026-04-07 16:40:08 (UTC+0)
Michael
moved this task from
Incoming
to
Test in Production
on the
Growth-Team (FY2025-26 Q4 Sprint 1)
board.
Etonkovidova
closed this task as
Resolved
Wed, Apr 8, 3:57 PM
2026-04-08 15:57:38 (UTC+0)
Log In to Comment
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct.
Wikimedia Foundation
Code of Conduct
Disclaimer
CC-BY-SA
GPL
Credits
US